2024-02-09T23:29:11.846 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T23:29:11.846 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534 --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} --name yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/orig.config.yaml 2024-02-09T23:29:11.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T23:29:11.987 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534 branch: main description: fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} email: yweinste@redhat.com first_in_suite: false job_id: '7554534' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 3558 sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcZ0odxrGFwFkuDlW9Xe/BJAzMoBC4lOxQ9KoRExmv+JiFhgqyuMobsiFbuz6lCk+6vDcsLX80Y3DNOGAkVOM= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmWEPP5HSwhdOmzl8le8GtPRRmTc9NK68BKsSb97+NofI53vQQWiZ4r5Rr3mD9OQUWzak5i/uSvrpkSIGXGsNM= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbn3grc8ibnAG8w8nMLILDrjNRTEPt3B/r0eUWUrny7cmuT6sFjqXCsbH9mmL1aOGaXMtA0four9RlYG1sHV34= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - workunit: clients: all: - suites/fsstress.sh - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: quincy - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-09_19:35:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-09T23:29:11.987 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa; will attempt to use it 2024-02-09T23:29:11.988 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks 2024-02-09T23:29:11.988 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-09T23:29:11.990 INFO:teuthology.task.internal:Checking packages... 2024-02-09T23:29:12.013 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90' 2024-02-09T23:29:12.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:29:12.013 INFO:teuthology.packaging:ref: None 2024-02-09T23:29:12.013 INFO:teuthology.packaging:tag: None 2024-02-09T23:29:12.013 INFO:teuthology.packaging:branch: main 2024-02-09T23:29:12.013 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:29:12.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2024-02-09T23:29:12.272 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1361.gf8e4e331 2024-02-09T23:29:12.274 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-09T23:29:12.286 INFO:teuthology.task.internal:no buildpackages task found 2024-02-09T23:29:12.286 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-09T23:29:12.310 INFO:teuthology.task.internal:Saving configuration 2024-02-09T23:29:12.330 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-09T23:29:12.341 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-09T23:29:12.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.045794', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcZ0odxrGFwFkuDlW9Xe/BJAzMoBC4lOxQ9KoRExmv+JiFhgqyuMobsiFbuz6lCk+6vDcsLX80Y3DNOGAkVOM='} 2024-02-09T23:29:12.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.043238', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmWEPP5HSwhdOmzl8le8GtPRRmTc9NK68BKsSb97+NofI53vQQWiZ4r5Rr3mD9OQUWzak5i/uSvrpkSIGXGsNM='} 2024-02-09T23:29:12.406 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.044658', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbn3grc8ibnAG8w8nMLILDrjNRTEPt3B/r0eUWUrny7cmuT6sFjqXCsbH9mmL1aOGaXMtA0four9RlYG1sHV34='} 2024-02-09T23:29:12.407 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-09T23:29:12.419 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-09T23:29:12.419 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['client.0'] 2024-02-09T23:29:12.419 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['client.1'] 2024-02-09T23:29:12.419 INFO:teuthology.run_tasks:Running task console_log... 2024-02-09T23:29:12.532 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31242ce160>, signals=[15]) 2024-02-09T23:29:12.533 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-09T23:29:12.544 INFO:teuthology.task.internal:Opening connections... 2024-02-09T23:29:12.544 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:29:12.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:29:12.623 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-02-09T23:29:12.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:29:12.699 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-02-09T23:29:12.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:29:12.777 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-09T23:29:12.789 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-02-09T23:29:12.811 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-02-09T23:29:12.812 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-02-09T23:29:12.873 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-02-09T23:29:12.873 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-02-09T23:29:12.874 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T23:29:12.875 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-02-09T23:29:12.875 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T23:29:12.875 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T23:29:12.875 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T23:29:12.875 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-02-09T23:29:12.900 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-02-09T23:29:12.922 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-02-09T23:29:12.923 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-02-09T23:29:12.985 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-02-09T23:29:12.985 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2024-02-09T23:29:12.985 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-02-09T23:29:12.985 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-02-09T23:29:12.986 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T23:29:12.987 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T23:29:12.987 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T23:29:12.988 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-02-09T23:29:13.008 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-02-09T23:29:13.031 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-02-09T23:29:13.031 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T23:29:13.093 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-02-09T23:29:13.094 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T23:29:13.094 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T23:29:13.094 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T23:29:13.094 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-02-09T23:29:13.108 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-09T23:29:13.122 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-09T23:29:13.134 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-09T23:29:13.135 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-02-09T23:29:13.137 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-02-09T23:29:13.139 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-02-09T23:29:13.160 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-09T23:29:13.170 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-09T23:29:13.171 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-02-09T23:29:13.199 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-02-09T23:29:13.201 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-02-09T23:29:13.231 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-09T23:29:13.318 INFO:teuthology.run_tasks:Running task kernel... 2024-02-09T23:29:13.339 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-09T23:29:13.339 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-09T23:29:13.339 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-09T23:29:13.340 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-09T23:29:13.340 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-09T23:29:13.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:29:13.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:29:13.362 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-02-09T23:29:13.363 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-02-09T23:29:13.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:29:13.365 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-02-09T23:29:13.423 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-489.el8.x86_64 2024-02-09T23:29:13.423 INFO:teuthology.task.kernel:Running kernel on smithi183: 4.18.0-489.el8.x86_64 2024-02-09T23:29:13.424 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2024-02-09T23:29:13.425 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-489.el8.x86_64 2024-02-09T23:29:13.425 INFO:teuthology.task.kernel:Running kernel on smithi164: 4.18.0-489.el8.x86_64 2024-02-09T23:29:13.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-02-09T23:29:13.426 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-489.el8.x86_64 2024-02-09T23:29:13.427 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.18.0-489.el8.x86_64 2024-02-09T23:29:13.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-02-09T23:37:30.206 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - AppStream 56 kB/s | 27 MB 08:14 2024-02-09T23:37:34.832 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - AppStream 55 kB/s | 27 MB 08:18 2024-02-09T23:37:38.331 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - BaseOS 3.1 MB/s | 10 MB 00:03 2024-02-09T23:37:40.231 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - Extras 63 kB/s | 18 kB 00:00 2024-02-09T23:37:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2024-02-09T23:37:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-02-09T23:37:42.344 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-02-09T23:37:43.678 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - BaseOS 2.6 MB/s | 10 MB 00:03 2024-02-09T23:37:45.586 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2024-02-09T23:37:46.053 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2024-02-09T23:37:46.141 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 405 kB/s | 24 kB 00:00 2024-02-09T23:37:46.297 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-02-09T23:37:47.906 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-02-09T23:37:49.113 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-09T23:37:49.114 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-09T23:37:49.224 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-09T23:37:49.225 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout:Install 3 Packages 2024-02-09T23:37:49.226 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:37:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 90 M 2024-02-09T23:37:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 96 M 2024-02-09T23:37:49.227 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:37:49.387 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - AppStream 53 kB/s | 27 MB 08:33 2024-02-09T23:37:51.614 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 517 kB/s | 24 kB 00:00 2024-02-09T23:37:53.601 INFO:teuthology.orchestra.run.smithi164.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 2.4 MB/s | 10 MB 00:04 2024-02-09T23:37:54.535 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-09T23:37:54.535 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-09T23:37:54.664 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-09T23:37:54.665 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout:Install 3 Packages 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 90 M 2024-02-09T23:37:54.666 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 96 M 2024-02-09T23:37:54.667 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:37:56.317 INFO:teuthology.orchestra.run.smithi164.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 5.1 MB/s | 36 MB 00:07 2024-02-09T23:37:57.017 INFO:teuthology.orchestra.run.smithi164.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 5.6 MB/s | 44 MB 00:07 2024-02-09T23:37:57.018 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:37:57.018 INFO:teuthology.orchestra.run.smithi164.stdout:Total 12 MB/s | 90 MB 00:07 2024-02-09T23:37:57.062 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - BaseOS 3.5 MB/s | 10 MB 00:02 2024-02-09T23:37:57.265 INFO:teuthology.orchestra.run.smithi183.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 4.0 MB/s | 10 MB 00:02 2024-02-09T23:37:57.698 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:37:58.115 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:37:58.115 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:37:58.971 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras 60 kB/s | 18 kB 00:00 2024-02-09T23:37:59.344 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:37:59.371 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:37:59.440 INFO:teuthology.orchestra.run.smithi183.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 7.7 MB/s | 36 MB 00:04 2024-02-09T23:37:59.755 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras common packages 10 kB/s | 6.9 kB 00:00 2024-02-09T23:37:59.990 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-02-09T23:38:00.098 INFO:teuthology.orchestra.run.smithi183.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 8.1 MB/s | 44 MB 00:05 2024-02-09T23:38:00.098 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:38:00.099 INFO:teuthology.orchestra.run.smithi183.stdout:Total 17 MB/s | 90 MB 00:05 2024-02-09T23:38:00.785 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:38:01.205 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:38:01.206 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:38:01.376 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-02-09T23:38:02.177 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:38:02.456 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:38:02.491 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:38:02.691 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:05.155 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 406 kB/s | 24 kB 00:00 2024-02-09T23:38:05.285 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:38:05.786 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:06.398 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:06.799 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:08.062 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-09T23:38:08.063 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-09T23:38:08.192 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:08.193 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout:Install 3 Packages 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 90 M 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 96 M 2024-02-09T23:38:08.194 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:38:09.370 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:09.682 INFO:teuthology.orchestra.run.smithi089.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 7.9 MB/s | 10 MB 00:01 2024-02-09T23:38:09.777 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:10.255 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:10.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:10.892 INFO:teuthology.orchestra.run.smithi089.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 14 MB/s | 36 MB 00:02 2024-02-09T23:38:11.501 INFO:teuthology.orchestra.run.smithi089.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 14 MB/s | 44 MB 00:03 2024-02-09T23:38:11.501 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:38:11.501 INFO:teuthology.orchestra.run.smithi089.stdout:Total 27 MB/s | 90 MB 00:03 2024-02-09T23:38:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:38:12.619 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:38:12.619 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:38:13.207 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:13.515 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:13.851 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:38:13.871 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:38:16.670 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:38:17.242 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:20.822 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:21.225 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:24.650 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:24.966 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:32.576 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:32.600 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:32.952 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:32.952 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:32.953 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:38:33.421 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:38:33.548 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:33.775 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:33.775 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:33.775 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-09T23:38:33.775 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-09T23:38:33.776 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-09T23:38:33.776 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-02-09T23:38:33.776 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-02-09T23:38:33.776 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:33.991 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:33.992 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:33.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.02 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 129.el8 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-09T23:38:34.027 INFO:teuthology.orchestra.run.smithi164.stdout:Group : System Environment/Base 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 9265586 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Relocations : (not relocatable) 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : CentOS BuildSystem 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-09T23:38:34.028 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-09T23:38:34.029 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-09T23:38:34.029 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-02-09T23:38:34.029 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:38:34.029 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-02-09T23:38:34.030 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-09T23:38:34.030 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 4.18.0-536.el8.x86_64 2024-02-09T23:38:34.030 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-09T23:38:35.421 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:35.763 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-02-09T23:38:35.913 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:35.913 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:35.913 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:36.486 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:36.486 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:38:36.486 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:38:36.486 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-09T23:38:36.486 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-09T23:38:36.487 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:38:36.487 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:38:36.657 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:36.873 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:36.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:36.874 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-09T23:38:36.874 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-09T23:38:36.874 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-09T23:38:36.874 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-02-09T23:38:36.874 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2024-02-09T23:38:36.875 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:37.084 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:37.084 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:37.084 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.02 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 129.el8 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2024-02-09T23:38:37.117 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Group : System Environment/Base 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 9265586 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Relocations : (not relocatable) 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : CentOS BuildSystem 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2024-02-09T23:38:37.118 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:38:37.119 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2024-02-09T23:38:37.120 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-09T23:38:37.120 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 4.18.0-536.el8.x86_64 2024-02-09T23:38:37.120 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-09T23:38:37.681 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-02-09T23:38:37.683 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-02-09T23:38:37.707 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.Qw86cvu5GG 2024-02-09T23:38:37.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Qw86cvu5GG 2024-02-09T23:38:37.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.Qw86cvu5GG 2024-02-09T23:38:37.922 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.Qw86cvu5GG is 6KB 2024-02-09T23:38:37.971 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.Qw86cvu5GG 2024-02-09T23:38:37.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-02-09T23:38:38.060 INFO:teuthology.orchestra.run.smithi164.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-09T23:38:38.061 INFO:teuthology.orchestra.run.smithi164.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-09T23:38:38.061 INFO:teuthology.orchestra.run.smithi164.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-09T23:38:38.061 INFO:teuthology.orchestra.run.smithi164.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-09T23:38:38.062 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-09T23:38:38.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-02-09T23:38:38.550 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2024-02-09T23:38:40.882 INFO:teuthology.orchestra.run.smithi183.stderr:done 2024-02-09T23:38:40.883 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-02-09T23:38:40.918 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.wm0EIgZRTG 2024-02-09T23:38:40.918 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wm0EIgZRTG 2024-02-09T23:38:40.993 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.wm0EIgZRTG 2024-02-09T23:38:41.138 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.wm0EIgZRTG is 6KB 2024-02-09T23:38:41.186 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.wm0EIgZRTG 2024-02-09T23:38:41.203 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2024-02-09T23:38:41.280 INFO:teuthology.orchestra.run.smithi183.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-09T23:38:41.280 INFO:teuthology.orchestra.run.smithi183.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-09T23:38:41.281 INFO:teuthology.orchestra.run.smithi183.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-09T23:38:41.281 INFO:teuthology.orchestra.run.smithi183.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-09T23:38:41.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-09T23:38:41.440 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2024-02-09T23:38:47.035 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:47.057 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-09T23:38:47.645 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-09T23:38:48.147 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-09T23:38:48.147 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:48.148 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:38:48.148 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-09T23:38:48.148 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-09T23:38:48.148 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:48.148 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:38:48.298 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:48.517 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:48.517 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:48.517 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-09T23:38:48.517 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-09T23:38:48.517 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-09T23:38:48.517 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-09T23:38:48.517 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-02-09T23:38:48.518 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T23:38:48.729 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-09T23:38:48.729 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-09T23:38:48.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-02-09T23:38:48.762 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-02-09T23:38:48.762 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.02 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 129.el8 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Group : System Environment/Base 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 9265586 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Relocations : (not relocatable) 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : CentOS BuildSystem 2024-02-09T23:38:48.763 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:38:48.764 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-02-09T23:38:48.765 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-09T23:38:48.765 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 4.18.0-536.el8.x86_64 2024-02-09T23:38:48.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-09T23:38:50.276 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-02-09T23:38:52.394 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-02-09T23:38:52.400 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-02-09T23:38:52.428 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.BhKMxpigiN 2024-02-09T23:38:52.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BhKMxpigiN 2024-02-09T23:38:52.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.BhKMxpigiN 2024-02-09T23:38:52.643 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.BhKMxpigiN is 6KB 2024-02-09T23:38:52.691 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.BhKMxpigiN 2024-02-09T23:38:52.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-02-09T23:38:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-09T23:38:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-09T23:38:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-09T23:38:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-09T23:38:52.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-09T23:38:52.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-02-09T23:39:08.234 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-09T23:39:08.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:39:08.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:11.444 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-02-09T23:39:11.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:39:11.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:22.968 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-09T23:39:22.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:39:22.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:26.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-02-09T23:39:29.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-02-09T23:39:35.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:39:35.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:38.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-02-09T23:39:38.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:39:38.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:41.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-09T23:39:50.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:39:50.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:50.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:39:50.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:39:53.564 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-09T23:40:05.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:40:05.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:40:09.148 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-02-09T23:40:24.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:40:24.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:40:24.603 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-02-09T23:40:24.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:40:24.956 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-536.el8.x86_64"... 2024-02-09T23:40:24.957 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-02-09T23:40:24.973 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-536.el8.x86_64 2024-02-09T23:40:24.973 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-09T23:40:24.973 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-09T23:40:24.973 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-09T23:40:25.974 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-02-09T23:40:25.974 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-09T23:40:26.075 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-02-09T23:40:26.093 DEBUG:teuthology.parallel:result is None 2024-02-09T23:40:38.395 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-02-09T23:40:38.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:40:38.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-536.el8.x86_64"... 2024-02-09T23:40:38.888 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-02-09T23:40:38.904 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-536.el8.x86_64 2024-02-09T23:40:38.905 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-09T23:40:38.905 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-09T23:40:38.905 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-09T23:40:38.989 DEBUG:teuthology.orchestra.remote:timed out 2024-02-09T23:40:39.905 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-09T23:40:39.906 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-09T23:40:39.964 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-02-09T23:40:39.977 DEBUG:teuthology.parallel:result is None 2024-02-09T23:40:50.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:40:50.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:40:51.286 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-02-09T23:40:51.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:40:51.614 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-536.el8.x86_64"... 2024-02-09T23:40:51.614 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-02-09T23:40:51.634 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-536.el8.x86_64 2024-02-09T23:40:51.634 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-09T23:40:51.634 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-09T23:40:51.634 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-09T23:40:52.635 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-02-09T23:40:52.635 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-09T23:40:52.714 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2024-02-09T23:40:52.729 DEBUG:teuthology.parallel:result is None 2024-02-09T23:40:52.729 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-09T23:40:52.744 INFO:teuthology.task.internal:Creating test directory... 2024-02-09T23:40:52.744 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-09T23:40:52.747 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-09T23:40:52.753 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-09T23:40:52.775 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-09T23:40:52.784 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-09T23:40:52.798 INFO:teuthology.task.internal:Creating archive directory... 2024-02-09T23:40:52.799 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-09T23:40:52.809 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-09T23:40:52.821 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-09T23:40:52.870 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-09T23:40:52.887 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-09T23:40:52.887 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-09T23:40:52.890 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-09T23:40:52.892 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-09T23:40:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.937 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.940 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.951 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.953 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.963 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T23:40:52.965 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-09T23:40:52.975 INFO:teuthology.task.internal:Configuring sudo... 2024-02-09T23:40:52.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-09T23:40:52.981 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-09T23:40:52.983 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-09T23:40:53.014 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-09T23:40:53.028 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-09T23:40:53.028 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-09T23:40:53.051 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-09T23:40:53.054 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-09T23:40:53.073 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.203 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.331 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:40:53.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-09T23:40:53.398 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.497 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.629 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:40:53.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-09T23:40:53.697 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.744 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T23:40:53.807 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.853 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T23:40:53.897 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:40:53.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-09T23:40:53.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-02-09T23:40:53.967 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-02-09T23:40:53.969 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-02-09T23:40:54.032 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T23:40:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T23:40:54.062 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T23:40:54.506 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-09T23:40:54.516 INFO:teuthology.task.internal:Starting timer... 2024-02-09T23:40:54.516 INFO:teuthology.run_tasks:Running task pcp... 2024-02-09T23:40:54.567 INFO:teuthology.run_tasks:Running task selinux... 2024-02-09T23:40:54.577 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-09T23:40:54.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-02-09T23:40:54.664 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-02-09T23:40:54.664 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-02-09T23:40:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-02-09T23:40:54.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-02-09T23:40:54.817 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-02-09T23:40:54.818 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-09T23:40:54.818 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-02-09T23:40:54.890 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-02-09T23:40:54.890 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-02-09T23:40:54.949 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-02-09T23:40:54.949 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-02-09T23:40:54.988 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-02-09T23:40:54.988 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-02-09T23:40:54.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T23:40:55.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:40:55.016 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T23:40:55.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:40:55.043 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T23:40:55.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:40:55.072 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-09T23:40:55.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-02-09T23:40:55.100 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-02-09T23:40:55.126 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-02-09T23:40:55.155 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-09T23:40:55.166 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-09T23:40:55.184 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-09T23:40:55.185 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi164.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-09T23:55:15.643 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-02-09T23:55:15.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:55:15.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:55:15.722 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-02-09T23:55:15.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-09T23:55:15.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:55:15.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:55:15.866 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-02-09T23:55:15.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-09T23:55:15.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:55:15.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:55:16.017 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-02-09T23:55:16.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-02-09T23:55:16.094 INFO:teuthology.run_tasks:Running task clock... 2024-02-09T23:55:16.106 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-09T23:55:16.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-09T23:55:16.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T23:55:16.109 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-09T23:55:16.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T23:55:16.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-09T23:55:16.112 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T23:55:16.139 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-09T23:55:16.144 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-09T23:55:16.153 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-09T23:55:16.159 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-09T23:55:16.171 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-09T23:55:16.186 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-09T23:55:16.225 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-02-09T23:55:16.234 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-02-09T23:55:16.236 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-02-09T23:55:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-02-09T23:55:16.250 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-09T23:55:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-09T23:55:16.263 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-09T23:55:16.269 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-02-09T23:55:16.271 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-09T23:55:16.280 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-02-09T23:55:16.295 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-09T23:55:16.307 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-09T23:55:16.332 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.336 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.344 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.347 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.376 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2024-02-09T23:55:16.379 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T23:55:16.379 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-02-09T23:55:16.379 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.379 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.380 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.380 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T23:55:16.381 INFO:teuthology.run_tasks:Running task install... 2024-02-09T23:55:16.389 DEBUG:teuthology.task.install:project ceph 2024-02-09T23:55:16.389 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'}} 2024-02-09T23:55:16.389 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'} 2024-02-09T23:55:16.390 INFO:teuthology.task.install:Using flavor: default 2024-02-09T23:55:16.395 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-09T23:55:16.396 INFO:teuthology.task.install:extra packages: ['librados2'] 2024-02-09T23:55:16.396 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'tag': None, 'wait_for_package': False} 2024-02-09T23:55:16.396 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.396 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.396 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.397 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.397 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:55:16.399 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'tag': None, 'wait_for_package': False} 2024-02-09T23:55:16.399 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.399 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.399 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.399 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.399 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:55:16.400 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'tag': None, 'wait_for_package': False} 2024-02-09T23:55:16.401 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.401 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.401 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.401 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.401 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:55:16.625 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-02-09T23:55:16.625 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-02-09T23:55:16.655 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-02-09T23:55:16.655 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-02-09T23:55:16.660 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-09T23:55:16.661 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:55:16.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-09T23:55:16.670 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-02-09T23:55:16.670 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-02-09T23:55:16.698 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-02-09T23:55:16.698 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.699 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.699 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.699 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.699 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.699 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-09T23:55:16.707 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-09T23:55:16.708 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:55:16.708 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-09T23:55:16.711 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-09T23:55:16.711 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:55:16.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-09T23:55:16.740 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-02-09T23:55:16.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.741 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.741 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.741 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.741 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.741 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-09T23:55:16.744 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-02-09T23:55:16.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:55:16.744 INFO:teuthology.packaging:ref: None 2024-02-09T23:55:16.744 INFO:teuthology.packaging:tag: None 2024-02-09T23:55:16.744 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:55:16.744 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:55:16.744 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-09T23:55:16.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-09T23:55:16.809 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-09T23:55:16.811 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-09T23:55:16.846 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-09T23:55:16.887 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-09T23:55:16.889 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-09T23:55:16.913 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-02-09T23:55:16.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-02-09T23:55:16.953 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-02-09T23:55:16.955 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-02-09T23:55:16.956 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-02-09T23:55:16.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-02-09T23:55:17.179 INFO:teuthology.orchestra.run.smithi089.stdout:76 files removed 2024-02-09T23:55:17.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2024-02-09T23:55:17.217 INFO:teuthology.orchestra.run.smithi183.stdout:76 files removed 2024-02-09T23:55:17.228 INFO:teuthology.orchestra.run.smithi164.stdout:76 files removed 2024-02-09T23:55:17.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw 2024-02-09T23:55:17.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw 2024-02-09T23:55:17.674 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 1.0 MB/s | 68 kB 00:00 2024-02-09T23:55:17.726 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 919 kB/s | 68 kB 00:00 2024-02-09T23:55:17.779 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 577 kB/s | 68 kB 00:00 2024-02-09T23:55:17.822 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 135 kB/s | 15 kB 00:00 2024-02-09T23:55:17.844 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 186 kB/s | 15 kB 00:00 2024-02-09T23:55:17.888 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 211 kB/s | 15 kB 00:00 2024-02-09T23:55:17.933 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 21 kB/s | 1.7 kB 00:00 2024-02-09T23:55:17.944 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-02-09T23:55:17.980 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 27 kB/s | 1.7 kB 00:00 2024-02-09T23:55:20.006 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - AppStream 13 MB/s | 27 MB 00:01 2024-02-09T23:55:20.084 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - AppStream 13 MB/s | 27 MB 00:02 2024-02-09T23:55:20.103 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - AppStream 13 MB/s | 27 MB 00:02 2024-02-09T23:55:29.656 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - BaseOS 2.1 MB/s | 10 MB 00:04 2024-02-09T23:55:29.986 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - BaseOS 2.0 MB/s | 10 MB 00:05 2024-02-09T23:55:31.075 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - BaseOS 1.7 MB/s | 10 MB 00:06 2024-02-09T23:55:31.978 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-02-09T23:55:32.190 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - Extras 19 kB/s | 18 kB 00:00 2024-02-09T23:55:32.565 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - Extras common packages 27 kB/s | 6.9 kB 00:00 2024-02-09T23:55:32.645 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2024-02-09T23:55:33.367 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras 25 kB/s | 18 kB 00:00 2024-02-09T23:55:33.901 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2024-02-09T23:55:35.429 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 8 - PowerTools 1.8 MB/s | 4.8 MB 00:02 2024-02-09T23:55:36.698 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 9.4 kB/s | 3.5 kB 00:00 2024-02-09T23:55:39.783 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 8 - PowerTools 683 kB/s | 4.8 MB 00:07 2024-02-09T23:55:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-02-09T23:55:40.903 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - PowerTools 705 kB/s | 4.8 MB 00:06 2024-02-09T23:55:41.920 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-02-09T23:55:42.890 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 16 MB 00:06 2024-02-09T23:55:42.921 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-02-09T23:55:46.012 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 16 MB 00:05 2024-02-09T23:55:46.755 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 319 kB/s | 24 kB 00:00 2024-02-09T23:55:46.765 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 459 kB/s | 24 kB 00:00 2024-02-09T23:55:49.751 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 527 kB/s | 24 kB 00:00 2024-02-09T23:55:50.251 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-09T23:55:50.254 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-02-09T23:55:50.255 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout:Install 22 Packages 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-02-09T23:55:50.256 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:55:50.257 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 49 M 2024-02-09T23:55:50.257 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:55:50.275 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:55:50.277 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:55:50.277 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-02-09T23:55:50.277 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-02-09T23:55:50.278 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-02-09T23:55:50.279 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:Install 22 Packages 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 49 M 2024-02-09T23:55:50.280 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:55:50.941 INFO:teuthology.orchestra.run.smithi183.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 41 MB/s | 5.6 MB 00:00 2024-02-09T23:55:50.957 INFO:teuthology.orchestra.run.smithi183.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-02-09T23:55:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 36 MB/s | 5.6 MB 00:00 2024-02-09T23:55:50.999 INFO:teuthology.orchestra.run.smithi183.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 12 MB/s | 508 kB 00:00 2024-02-09T23:55:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-02-09T23:55:51.024 INFO:teuthology.orchestra.run.smithi183.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 15 MB/s | 380 kB 00:00 2024-02-09T23:55:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-02-09T23:55:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-02-09T23:55:51.100 INFO:teuthology.orchestra.run.smithi183.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 43 MB/s | 3.2 MB 00:00 2024-02-09T23:55:51.117 INFO:teuthology.orchestra.run.smithi183.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 2.4 MB/s | 40 kB 00:00 2024-02-09T23:55:51.142 INFO:teuthology.orchestra.run.smithi183.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-02-09T23:55:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 39 MB/s | 3.2 MB 00:00 2024-02-09T23:55:51.167 INFO:teuthology.orchestra.run.smithi183.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.5 MB/s | 164 kB 00:00 2024-02-09T23:55:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-02-09T23:55:51.192 INFO:teuthology.orchestra.run.smithi183.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 14 MB/s | 364 kB 00:00 2024-02-09T23:55:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 14 MB/s | 349 kB 00:00 2024-02-09T23:55:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2024-02-09T23:55:51.325 INFO:teuthology.orchestra.run.smithi089.stdout:(7/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 20 MB/s | 9.9 MB 00:00 2024-02-09T23:55:51.350 INFO:teuthology.orchestra.run.smithi089.stdout:(8/24): python3-ceph-common-15.2.17-0.el8.x86_6 483 kB/s | 77 kB 00:00 2024-02-09T23:55:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 18 MB/s | 9.9 MB 00:00 2024-02-09T23:55:51.375 INFO:teuthology.orchestra.run.smithi089.stdout:(9/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-02-09T23:55:51.400 INFO:teuthology.orchestra.run.smithi089.stdout:(10/24): python3-rados-15.2.17-0.el8.x86_64.rpm 7.1 MB/s | 364 kB 00:00 2024-02-09T23:55:51.426 INFO:teuthology.orchestra.run.smithi089.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 6.8 MB/s | 349 kB 00:00 2024-02-09T23:55:51.451 INFO:teuthology.orchestra.run.smithi089.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-02-09T23:55:51.602 INFO:teuthology.orchestra.run.smithi183.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 26 MB/s | 21 MB 00:00 2024-02-09T23:55:51.726 INFO:teuthology.orchestra.run.smithi089.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-02-09T23:55:52.011 INFO:teuthology.orchestra.run.smithi183.stdout:(14/24): librdkafka-1.6.1-1.el8.x86_64.rpm 882 kB/s | 677 kB 00:00 2024-02-09T23:55:52.036 INFO:teuthology.orchestra.run.smithi183.stdout:(15/24): python3-prettytable-0.7.2-14.el8.noarc 101 kB/s | 44 kB 00:00 2024-02-09T23:55:52.052 INFO:teuthology.orchestra.run.smithi089.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 135 kB/s | 44 kB 00:00 2024-02-09T23:55:52.087 INFO:teuthology.orchestra.run.smithi183.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 354 kB/s | 259 kB 00:00 2024-02-09T23:55:52.185 INFO:teuthology.orchestra.run.smithi089.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 354 kB/s | 259 kB 00:00 2024-02-09T23:55:52.394 INFO:teuthology.orchestra.run.smithi089.stdout:(16/24): librdkafka-1.6.1-1.el8.x86_64.rpm 718 kB/s | 677 kB 00:00 2024-02-09T23:55:52.447 INFO:teuthology.orchestra.run.smithi183.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 283 kB/s | 116 kB 00:00 2024-02-09T23:55:52.464 INFO:teuthology.orchestra.run.smithi183.stdout:(18/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 104 kB/s | 47 kB 00:00 2024-02-09T23:55:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 92 kB/s | 47 kB 00:00 2024-02-09T23:55:52.577 INFO:teuthology.orchestra.run.smithi183.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 630 kB/s | 306 kB 00:00 2024-02-09T23:55:52.615 INFO:teuthology.orchestra.run.smithi183.stdout:(20/24): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2024-02-09T23:55:52.657 INFO:teuthology.orchestra.run.smithi183.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 905 kB/s | 75 kB 00:00 2024-02-09T23:55:52.715 INFO:teuthology.orchestra.run.smithi183.stdout:(22/24): librados2-15.2.17-0.el8.x86_64.rpm 35 MB/s | 3.5 MB 00:00 2024-02-09T23:55:52.757 INFO:teuthology.orchestra.run.smithi183.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 19 MB/s | 1.9 MB 00:00 2024-02-09T23:55:52.782 INFO:teuthology.orchestra.run.smithi183.stdout:(24/24): liboath-2.6.2-3.el8.x86_64.rpm 185 kB/s | 59 kB 00:00 2024-02-09T23:55:52.787 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:55:52.787 INFO:teuthology.orchestra.run.smithi183.stdout:Total 19 MB/s | 49 MB 00:02 2024-02-09T23:55:52.830 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:55:52.878 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:55:52.878 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:55:53.003 INFO:teuthology.orchestra.run.smithi089.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 142 kB/s | 116 kB 00:00 2024-02-09T23:55:53.128 INFO:teuthology.orchestra.run.smithi089.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2024-02-09T23:55:53.201 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:55:53.204 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:55:53.229 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:55:53.232 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:55:53.232 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-02-09T23:55:53.232 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-09T23:55:53.233 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-02-09T23:55:53.234 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-09T23:55:53.235 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-02-09T23:55:53.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout:Install 22 Packages 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-02-09T23:55:53.237 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:55:53.238 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 49 M 2024-02-09T23:55:53.239 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:55:53.362 INFO:teuthology.orchestra.run.smithi089.stdout:(20/24): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2024-02-09T23:55:53.429 INFO:teuthology.orchestra.run.smithi089.stdout:(21/24): leveldb-1.22-1.el8.x86_64.rpm 208 kB/s | 181 kB 00:00 2024-02-09T23:55:53.454 INFO:teuthology.orchestra.run.smithi089.stdout:(22/24): gperftools-libs-2.7-9.el8.x86_64.rpm 289 kB/s | 306 kB 00:01 2024-02-09T23:55:53.512 INFO:teuthology.orchestra.run.smithi089.stdout:(23/24): librados2-15.2.17-0.el8.x86_64.rpm 23 MB/s | 3.5 MB 00:00 2024-02-09T23:55:53.554 INFO:teuthology.orchestra.run.smithi089.stdout:(24/24): librbd1-15.2.17-0.el8.x86_64.rpm 15 MB/s | 1.9 MB 00:00 2024-02-09T23:55:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:55:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 49 MB 00:03 2024-02-09T23:55:53.604 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:55:53.650 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:55:53.650 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:55:53.944 INFO:teuthology.orchestra.run.smithi164.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 37 MB/s | 5.6 MB 00:00 2024-02-09T23:55:53.968 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:55:53.969 INFO:teuthology.orchestra.run.smithi164.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-02-09T23:55:53.971 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:55:54.003 INFO:teuthology.orchestra.run.smithi164.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-02-09T23:55:54.061 INFO:teuthology.orchestra.run.smithi164.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 6.4 MB/s | 380 kB 00:00 2024-02-09T23:55:54.154 INFO:teuthology.orchestra.run.smithi164.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 35 MB/s | 3.2 MB 00:00 2024-02-09T23:55:54.179 INFO:teuthology.orchestra.run.smithi164.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-02-09T23:55:54.204 INFO:teuthology.orchestra.run.smithi164.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-02-09T23:55:54.230 INFO:teuthology.orchestra.run.smithi164.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.5 MB/s | 164 kB 00:00 2024-02-09T23:55:54.263 INFO:teuthology.orchestra.run.smithi164.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2024-02-09T23:55:54.293 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:55:54.372 INFO:teuthology.orchestra.run.smithi164.stdout:(10/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 17 MB/s | 9.9 MB 00:00 2024-02-09T23:55:54.424 INFO:teuthology.orchestra.run.smithi164.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 2.1 MB/s | 349 kB 00:00 2024-02-09T23:55:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 3.6 MB/s | 113 kB 00:00 2024-02-09T23:55:54.541 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-02-09T23:55:54.690 INFO:teuthology.orchestra.run.smithi164.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-02-09T23:55:54.761 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-02-09T23:55:54.928 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:55.007 INFO:teuthology.orchestra.run.smithi164.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 139 kB/s | 44 kB 00:00 2024-02-09T23:55:55.157 INFO:teuthology.orchestra.run.smithi164.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 370 kB/s | 259 kB 00:00 2024-02-09T23:55:55.232 INFO:teuthology.orchestra.run.smithi164.stdout:(16/24): librdkafka-1.6.1-1.el8.x86_64.rpm 839 kB/s | 677 kB 00:00 2024-02-09T23:55:55.297 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:55.321 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:55:55.407 INFO:teuthology.orchestra.run.smithi164.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 465 kB/s | 116 kB 00:00 2024-02-09T23:55:55.452 INFO:teuthology.orchestra.run.smithi164.stdout:(18/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 106 kB/s | 47 kB 00:00 2024-02-09T23:55:55.486 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:55.508 INFO:teuthology.orchestra.run.smithi164.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 1.8 MB/s | 181 kB 00:00 2024-02-09T23:55:55.542 INFO:teuthology.orchestra.run.smithi164.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 992 kB/s | 306 kB 00:00 2024-02-09T23:55:55.557 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-02-09T23:55:55.567 INFO:teuthology.orchestra.run.smithi164.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2024-02-09T23:55:55.580 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:55.626 INFO:teuthology.orchestra.run.smithi164.stdout:(22/24): librbd1-15.2.17-0.el8.x86_64.rpm 33 MB/s | 1.9 MB 00:00 2024-02-09T23:55:55.643 INFO:teuthology.orchestra.run.smithi164.stdout:(23/24): liboath-2.6.2-3.el8.x86_64.rpm 305 kB/s | 59 kB 00:00 2024-02-09T23:55:55.701 INFO:teuthology.orchestra.run.smithi164.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 22 MB/s | 3.5 MB 00:00 2024-02-09T23:55:55.706 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:55:55.706 INFO:teuthology.orchestra.run.smithi164.stdout:Total 20 MB/s | 49 MB 00:02 2024-02-09T23:55:55.749 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:55:55.769 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-02-09T23:55:55.797 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:55:55.797 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:55:55.868 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:55:55.976 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:56.044 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:56.108 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:55:56.111 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:55:56.269 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:56.331 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:56.511 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:56.526 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:56.579 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:56.796 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-02-09T23:55:56.891 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:55:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:57.244 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-02-09T23:55:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:57.386 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:55:57.447 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:55:57.462 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:55:57.468 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:57.527 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:57.615 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-02-09T23:55:57.679 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-02-09T23:55:57.761 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:55:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-02-09T23:55:57.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-02-09T23:55:57.947 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:55:58.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:58.127 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-02-09T23:55:58.252 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-02-09T23:55:58.309 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-02-09T23:55:58.392 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:55:58.444 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:55:58.444 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-02-09T23:55:58.509 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:55:58.516 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:55:58.602 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:58.697 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-02-09T23:55:58.740 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:55:58.745 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-02-09T23:55:58.876 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:55:58.943 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-02-09T23:55:58.967 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:55:59.046 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:55:59.101 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-02-09T23:55:59.160 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:59.250 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-02-09T23:55:59.269 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-02-09T23:55:59.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:55:59.474 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-02-09T23:55:59.585 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:59.609 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:55:59.657 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:55:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:55:59.895 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-02-09T23:55:59.918 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-02-09T23:56:00.133 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-02-09T23:56:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-02-09T23:56:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-02-09T23:56:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-02-09T23:56:00.551 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:56:00.614 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:56:00.822 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-02-09T23:56:00.985 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:56:01.196 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:56:01.401 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-02-09T23:56:01.422 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:01.617 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-02-09T23:56:01.652 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:01.776 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:56:01.879 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-02-09T23:56:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-02-09T23:56:02.310 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-02-09T23:56:02.310 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:02.478 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-02-09T23:56:02.553 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:02.666 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:02.766 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:02.793 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-02-09T23:56:02.843 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:02.959 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:03.612 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:03.860 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:04.011 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:04.150 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-02-09T23:56:06.240 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:06.351 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-02-09T23:56:06.468 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:21.624 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /run 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2024-02-09T23:56:21.625 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:22.625 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:22.687 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:22.687 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:22.933 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:22.934 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-02-09T23:56:23.101 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2024-02-09T23:56:23.102 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:23.589 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:23.589 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-02-09T23:56:23.589 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-02-09T23:56:23.589 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-02-09T23:56:23.589 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-02-09T23:56:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-02-09T23:56:23.591 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-02-09T23:56:24.114 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:24.231 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:24.231 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:24.441 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:24.441 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.491 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: leveldb-1.22-1.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.492 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:24.493 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:56:24.827 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-test 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-02-09T23:56:25.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:25.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-02-09T23:56:25.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-02-09T23:56:25.590 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:39 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /run 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2024-02-09T23:56:25.773 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:26.072 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:26.072 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:26.072 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: leveldb-1.22-1.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-09T23:56:26.073 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:26.074 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:26.075 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:56:26.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2024-02-09T23:56:26.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:26.907 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-02-09T23:56:26.907 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:27.089 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:56:27.090 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:27.090 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-09T23:56:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-09T23:56:27.092 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:56:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:Install 5 Packages 2024-02-09T23:56:27.092 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 43 M 2024-02-09T23:56:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 155 M 2024-02-09T23:56:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:56:27.150 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-02-09T23:56:27.150 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:27.191 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:41 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:27.720 INFO:teuthology.orchestra.run.smithi183.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 72 MB/s | 42 MB 00:00 2024-02-09T23:56:27.753 INFO:teuthology.orchestra.run.smithi183.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 305 kB/s | 188 kB 00:00 2024-02-09T23:56:27.784 INFO:teuthology.orchestra.run.smithi183.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 316 kB/s | 203 kB 00:00 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-02-09T23:56:27.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-02-09T23:56:27.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-02-09T23:56:27.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-02-09T23:56:27.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-02-09T23:56:27.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-02-09T23:56:27.803 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-02-09T23:56:27.920 INFO:teuthology.orchestra.run.smithi183.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 423 kB/s | 71 kB 00:00 2024-02-09T23:56:28.321 INFO:teuthology.orchestra.run.smithi183.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 538 kB/s | 323 kB 00:00 2024-02-09T23:56:28.322 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:28.322 INFO:teuthology.orchestra.run.smithi183.stdout:Total 35 MB/s | 43 MB 00:01 2024-02-09T23:56:28.365 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:56:28.384 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:56:28.384 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:56:28.658 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:56:28.661 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:56:28.686 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-02-09T23:56:28.686 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:28.686 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-02-09T23:56:28.686 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.686 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb-1.22-1.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-09T23:56:28.687 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:28.688 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:56:28.697 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-02-09T23:56:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:56:28.699 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:28.700 INFO:teuthology.orchestra.run.smithi089.stdout:Install 5 Packages 2024-02-09T23:56:28.700 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:28.702 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 43 M 2024-02-09T23:56:28.702 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 155 M 2024-02-09T23:56:28.702 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:56:29.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test 2024-02-09T23:56:29.086 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:56:29.326 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-02-09T23:56:29.475 INFO:teuthology.orchestra.run.smithi089.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 72 MB/s | 42 MB 00:00 2024-02-09T23:56:29.500 INFO:teuthology.orchestra.run.smithi089.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 334 kB/s | 203 kB 00:00 2024-02-09T23:56:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-02-09T23:56:29.525 INFO:teuthology.orchestra.run.smithi089.stdout:(3/5): oniguruma-6.8.2-3.el8.x86_64.rpm 297 kB/s | 188 kB 00:00 2024-02-09T23:56:29.638 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:29.675 INFO:teuthology.orchestra.run.smithi089.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 471 kB/s | 71 kB 00:00 2024-02-09T23:56:29.717 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:29.788 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:40 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:56:30.067 INFO:teuthology.orchestra.run.smithi089.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 546 kB/s | 323 kB 00:00 2024-02-09T23:56:30.068 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:30.068 INFO:teuthology.orchestra.run.smithi089.stdout:Total 31 MB/s | 43 MB 00:01 2024-02-09T23:56:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:56:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:56:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:56:30.410 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:56:30.413 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:56:30.870 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:56:31.126 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-02-09T23:56:31.306 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:56:31.307 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-02-09T23:56:31.308 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:31.308 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:56:31.308 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:31.308 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout:Install 5 Packages 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:31.309 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 43 M 2024-02-09T23:56:31.310 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 155 M 2024-02-09T23:56:31.310 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:56:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:31.965 INFO:teuthology.orchestra.run.smithi164.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 69 MB/s | 42 MB 00:00 2024-02-09T23:56:31.990 INFO:teuthology.orchestra.run.smithi164.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 294 kB/s | 188 kB 00:00 2024-02-09T23:56:32.023 INFO:teuthology.orchestra.run.smithi164.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 302 kB/s | 203 kB 00:00 2024-02-09T23:56:32.115 INFO:teuthology.orchestra.run.smithi164.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 565 kB/s | 71 kB 00:00 2024-02-09T23:56:32.507 INFO:teuthology.orchestra.run.smithi164.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 596 kB/s | 323 kB 00:00 2024-02-09T23:56:32.508 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:32.508 INFO:teuthology.orchestra.run.smithi164.stdout:Total 36 MB/s | 43 MB 00:01 2024-02-09T23:56:32.551 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:56:32.571 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:56:32.571 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:56:32.856 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:56:32.860 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:56:33.316 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:56:33.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-02-09T23:56:33.579 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-02-09T23:56:33.766 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-02-09T23:56:33.786 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:33.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:33.971 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:34.081 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:34.081 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-02-09T23:56:34.081 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-02-09T23:56:34.081 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:34.081 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-02-09T23:56:34.498 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-09T23:56:34.499 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:34.499 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:56:34.716 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph 2024-02-09T23:56:35.393 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-02-09T23:56:35.482 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:49 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:35.652 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-02-09T23:56:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-02-09T23:56:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:35.929 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:36.433 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:56:36.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2024-02-09T23:56:36.987 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:56:36.990 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:36.990 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-02-09T23:56:36.990 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:36.990 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:56:36.990 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-09T23:56:36.991 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-09T23:56:36.992 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-09T23:56:36.995 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:36.996 INFO:teuthology.orchestra.run.smithi183.stdout:Install 32 Packages 2024-02-09T23:56:36.997 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:36.997 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 28 M 2024-02-09T23:56:36.997 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 91 M 2024-02-09T23:56:36.997 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:56:37.329 INFO:teuthology.orchestra.run.smithi183.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 141 kB/s | 6.3 kB 00:00 2024-02-09T23:56:37.379 INFO:teuthology.orchestra.run.smithi183.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-02-09T23:56:37.429 INFO:teuthology.orchestra.run.smithi183.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-02-09T23:56:37.454 INFO:teuthology.orchestra.run.smithi183.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.5 MB/s | 193 kB 00:00 2024-02-09T23:56:37.477 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:51 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:37.571 INFO:teuthology.orchestra.run.smithi183.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 18 MB/s | 4.3 MB 00:00 2024-02-09T23:56:37.788 INFO:teuthology.orchestra.run.smithi183.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 41 MB/s | 17 MB 00:00 2024-02-09T23:56:37.871 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-02-09T23:56:37.955 INFO:teuthology.orchestra.run.smithi183.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 314 kB/s | 157 kB 00:00 2024-02-09T23:56:38.006 INFO:teuthology.orchestra.run.smithi183.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 89 kB/s | 39 kB 00:00 2024-02-09T23:56:38.073 INFO:teuthology.orchestra.run.smithi183.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 488 kB/s | 57 kB 00:00 2024-02-09T23:56:38.127 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:38.189 INFO:teuthology.orchestra.run.smithi183.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 258 kB/s | 103 kB 00:00 2024-02-09T23:56:38.398 INFO:teuthology.orchestra.run.smithi183.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.1 MB/s | 457 kB 00:00 2024-02-09T23:56:38.409 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-02-09T23:56:38.409 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-02-09T23:56:38.409 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-02-09T23:56:38.409 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-02-09T23:56:38.409 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-02-09T23:56:38.582 INFO:teuthology.orchestra.run.smithi183.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 489 kB/s | 249 kB 00:00 2024-02-09T23:56:38.798 INFO:teuthology.orchestra.run.smithi183.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-02-09T23:56:38.824 INFO:teuthology.orchestra.run.smithi183.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 256 kB/s | 109 kB 00:00 2024-02-09T23:56:38.836 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:38.837 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:56:38.966 INFO:teuthology.orchestra.run.smithi183.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 114 kB/s | 44 kB 00:00 2024-02-09T23:56:38.993 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-02-09T23:56:38.996 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-09T23:56:38.997 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-09T23:56:38.998 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout:Install 32 Packages 2024-02-09T23:56:38.999 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:39.000 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 28 M 2024-02-09T23:56:39.000 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 91 M 2024-02-09T23:56:39.000 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:56:39.056 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph 2024-02-09T23:56:39.374 INFO:teuthology.orchestra.run.smithi183.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 314 kB/s | 173 kB 00:00 2024-02-09T23:56:39.420 INFO:teuthology.orchestra.run.smithi089.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 104 kB/s | 6.3 kB 00:00 2024-02-09T23:56:39.464 INFO:teuthology.orchestra.run.smithi089.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-02-09T23:56:39.491 INFO:teuthology.orchestra.run.smithi183.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-02-09T23:56:39.521 INFO:teuthology.orchestra.run.smithi089.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-02-09T23:56:39.525 INFO:teuthology.orchestra.run.smithi183.stdout:(18/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 255 kB/s | 185 kB 00:00 2024-02-09T23:56:39.547 INFO:teuthology.orchestra.run.smithi089.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.5 MB/s | 193 kB 00:00 2024-02-09T23:56:39.639 INFO:teuthology.orchestra.run.smithi089.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 20 MB/s | 4.3 MB 00:00 2024-02-09T23:56:39.645 INFO:teuthology.orchestra.run.smithi183.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 114 kB/s | 18 kB 00:00 2024-02-09T23:56:39.676 INFO:teuthology.orchestra.run.smithi183.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 324 kB/s | 49 kB 00:00 2024-02-09T23:56:39.759 INFO:teuthology.orchestra.run.smithi183.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 516 kB/s | 59 kB 00:00 2024-02-09T23:56:39.785 INFO:teuthology.orchestra.run.smithi183.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 470 kB/s | 384 kB 00:00 2024-02-09T23:56:39.818 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:50 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:56:39.868 INFO:teuthology.orchestra.run.smithi183.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2024-02-09T23:56:39.894 INFO:teuthology.orchestra.run.smithi183.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-02-09T23:56:39.897 INFO:teuthology.orchestra.run.smithi089.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 39 MB/s | 17 MB 00:00 2024-02-09T23:56:39.977 INFO:teuthology.orchestra.run.smithi183.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 220 kB/s | 24 kB 00:00 2024-02-09T23:56:40.002 INFO:teuthology.orchestra.run.smithi183.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 269 kB/s | 29 kB 00:00 2024-02-09T23:56:40.022 INFO:teuthology.orchestra.run.smithi089.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 330 kB/s | 157 kB 00:00 2024-02-09T23:56:40.086 INFO:teuthology.orchestra.run.smithi183.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 253 kB/s | 27 kB 00:00 2024-02-09T23:56:40.115 INFO:teuthology.orchestra.run.smithi089.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 82 kB/s | 39 kB 00:00 2024-02-09T23:56:40.140 INFO:teuthology.orchestra.run.smithi089.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 487 kB/s | 57 kB 00:00 2024-02-09T23:56:40.153 INFO:teuthology.orchestra.run.smithi183.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 593 kB/s | 283 kB 00:00 2024-02-09T23:56:40.324 INFO:teuthology.orchestra.run.smithi089.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 243 kB/s | 103 kB 00:00 2024-02-09T23:56:40.362 INFO:teuthology.orchestra.run.smithi183.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 410 kB/s | 85 kB 00:00 2024-02-09T23:56:40.387 INFO:teuthology.orchestra.run.smithi183.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 665 kB/s | 255 kB 00:00 2024-02-09T23:56:40.470 INFO:teuthology.orchestra.run.smithi183.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2024-02-09T23:56:40.512 INFO:teuthology.orchestra.run.smithi183.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 590 kB/s | 251 kB 00:00 2024-02-09T23:56:40.513 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:40.514 INFO:teuthology.orchestra.run.smithi183.stdout:Total 8.1 MB/s | 28 MB 00:03 2024-02-09T23:56:40.532 INFO:teuthology.orchestra.run.smithi089.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.1 MB/s | 457 kB 00:00 2024-02-09T23:56:40.595 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:56:40.632 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:56:40.632 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:56:40.641 INFO:teuthology.orchestra.run.smithi089.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 497 kB/s | 249 kB 00:00 2024-02-09T23:56:40.841 INFO:teuthology.orchestra.run.smithi089.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 218 kB/s | 44 kB 00:00 2024-02-09T23:56:40.932 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:56:40.935 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:56:40.950 INFO:teuthology.orchestra.run.smithi089.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-02-09T23:56:40.975 INFO:teuthology.orchestra.run.smithi089.stdout:(15/32): python3-pycparser-2.14-14.el8.noarch.r 246 kB/s | 109 kB 00:00 2024-02-09T23:56:41.000 INFO:teuthology.orchestra.run.smithi089.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2024-02-09T23:56:41.067 INFO:teuthology.orchestra.run.smithi089.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 179 kB/s | 11 kB 00:00 2024-02-09T23:56:41.151 INFO:teuthology.orchestra.run.smithi089.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 212 kB/s | 18 kB 00:00 2024-02-09T23:56:41.210 INFO:teuthology.orchestra.run.smithi089.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 837 kB/s | 49 kB 00:00 2024-02-09T23:56:41.243 INFO:teuthology.orchestra.run.smithi089.stdout:(20/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 588 kB/s | 173 kB 00:00 2024-02-09T23:56:41.269 INFO:teuthology.orchestra.run.smithi089.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2024-02-09T23:56:41.327 INFO:teuthology.orchestra.run.smithi089.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2024-02-09T23:56:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-02-09T23:56:41.343 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-09T23:56:41.344 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:Install 32 Packages 2024-02-09T23:56:41.345 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 28 M 2024-02-09T23:56:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 91 M 2024-02-09T23:56:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:56:41.353 INFO:teuthology.orchestra.run.smithi089.stdout:(23/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.0 MB/s | 384 kB 00:00 2024-02-09T23:56:41.386 INFO:teuthology.orchestra.run.smithi089.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 319 kB/s | 19 kB 00:00 2024-02-09T23:56:41.412 INFO:teuthology.orchestra.run.smithi089.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 409 kB/s | 24 kB 00:00 2024-02-09T23:56:41.437 INFO:teuthology.orchestra.run.smithi089.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2024-02-09T23:56:41.454 INFO:teuthology.orchestra.run.smithi089.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 434 kB/s | 29 kB 00:00 2024-02-09T23:56:41.479 INFO:teuthology.orchestra.run.smithi089.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 409 kB/s | 27 kB 00:00 2024-02-09T23:56:41.563 INFO:teuthology.orchestra.run.smithi089.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2024-02-09T23:56:41.588 INFO:teuthology.orchestra.run.smithi089.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.7 MB/s | 255 kB 00:00 2024-02-09T23:56:41.613 INFO:teuthology.orchestra.run.smithi089.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2024-02-09T23:56:41.630 INFO:teuthology.orchestra.run.smithi089.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 344 kB/s | 23 kB 00:00 2024-02-09T23:56:41.634 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:41.634 INFO:teuthology.orchestra.run.smithi089.stdout:Total 11 MB/s | 28 MB 00:02 2024-02-09T23:56:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 119 kB/s | 6.3 kB 00:00 2024-02-09T23:56:41.702 INFO:teuthology.orchestra.run.smithi164.stdout:(2/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-02-09T23:56:41.716 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:56:41.744 INFO:teuthology.orchestra.run.smithi164.stdout:(3/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 9.9 MB/s | 1.4 MB 00:00 2024-02-09T23:56:41.756 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:56:41.756 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:56:41.778 INFO:teuthology.orchestra.run.smithi164.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-02-09T23:56:41.853 INFO:teuthology.orchestra.run.smithi164.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 22 MB/s | 4.3 MB 00:00 2024-02-09T23:56:42.064 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:56:42.068 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:56:42.070 INFO:teuthology.orchestra.run.smithi164.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 46 MB/s | 17 MB 00:00 2024-02-09T23:56:42.073 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:56:42.266 INFO:teuthology.orchestra.run.smithi164.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 321 kB/s | 157 kB 00:00 2024-02-09T23:56:42.274 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-09T23:56:42.295 INFO:teuthology.orchestra.run.smithi164.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 88 kB/s | 39 kB 00:00 2024-02-09T23:56:42.387 INFO:teuthology.orchestra.run.smithi164.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 474 kB/s | 57 kB 00:00 2024-02-09T23:56:42.488 INFO:teuthology.orchestra.run.smithi164.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 248 kB/s | 103 kB 00:00 2024-02-09T23:56:42.519 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-09T23:56:42.705 INFO:teuthology.orchestra.run.smithi164.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.1 MB/s | 457 kB 00:00 2024-02-09T23:56:42.736 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-09T23:56:42.913 INFO:teuthology.orchestra.run.smithi164.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 473 kB/s | 249 kB 00:00 2024-02-09T23:56:43.001 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-09T23:56:43.130 INFO:teuthology.orchestra.run.smithi164.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 256 kB/s | 109 kB 00:00 2024-02-09T23:56:43.172 INFO:teuthology.orchestra.run.smithi164.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 169 kB/s | 44 kB 00:00 2024-02-09T23:56:43.207 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-09T23:56:43.225 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:56:43.332 INFO:teuthology.orchestra.run.smithi164.stdout:(15/32): python3-cryptography-3.2.1-7.el8.x86_6 760 kB/s | 641 kB 00:00 2024-02-09T23:56:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-09T23:56:43.381 INFO:teuthology.orchestra.run.smithi164.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 826 kB/s | 173 kB 00:00 2024-02-09T23:56:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-09T23:56:43.473 INFO:teuthology.orchestra.run.smithi164.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 127 kB/s | 11 kB 00:00 2024-02-09T23:56:43.498 INFO:teuthology.orchestra.run.smithi164.stdout:(18/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 503 kB/s | 185 kB 00:00 2024-02-09T23:56:43.506 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-09T23:56:43.549 INFO:teuthology.orchestra.run.smithi164.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 234 kB/s | 18 kB 00:00 2024-02-09T23:56:43.582 INFO:teuthology.orchestra.run.smithi164.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 584 kB/s | 49 kB 00:00 2024-02-09T23:56:43.632 INFO:teuthology.orchestra.run.smithi164.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 702 kB/s | 59 kB 00:00 2024-02-09T23:56:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-09T23:56:43.683 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-09T23:56:43.716 INFO:teuthology.orchestra.run.smithi164.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-02-09T23:56:43.742 INFO:teuthology.orchestra.run.smithi164.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-02-09T23:56:43.775 INFO:teuthology.orchestra.run.smithi164.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 869 kB/s | 384 kB 00:00 2024-02-09T23:56:43.800 INFO:teuthology.orchestra.run.smithi164.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 224 kB/s | 19 kB 00:00 2024-02-09T23:56:43.826 INFO:teuthology.orchestra.run.smithi164.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 285 kB/s | 24 kB 00:00 2024-02-09T23:56:43.851 INFO:teuthology.orchestra.run.smithi164.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2024-02-09T23:56:43.876 INFO:teuthology.orchestra.run.smithi164.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2024-02-09T23:56:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-09T23:56:43.918 INFO:teuthology.orchestra.run.smithi164.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.7 MB/s | 255 kB 00:00 2024-02-09T23:56:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-09T23:56:43.952 INFO:teuthology.orchestra.run.smithi164.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2024-02-09T23:56:43.977 INFO:teuthology.orchestra.run.smithi164.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 852 kB/s | 85 kB 00:00 2024-02-09T23:56:44.026 INFO:teuthology.orchestra.run.smithi164.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 214 kB/s | 23 kB 00:00 2024-02-09T23:56:44.029 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:44.030 INFO:teuthology.orchestra.run.smithi164.stdout:Total 11 MB/s | 28 MB 00:02 2024-02-09T23:56:44.108 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:56:44.148 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:56:44.148 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:56:44.150 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-09T23:56:44.197 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-09T23:56:44.365 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-09T23:56:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-09T23:56:44.436 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:56:44.439 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:56:44.578 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-09T23:56:44.700 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-09T23:56:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-09T23:56:45.049 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-09T23:56:45.080 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-09T23:56:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-09T23:56:45.330 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-09T23:56:45.510 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-09T23:56:45.522 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-09T23:56:45.588 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:56:45.727 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-09T23:56:45.742 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-09T23:56:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-09T23:56:45.911 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:45.991 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-09T23:56:46.044 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-09T23:56:46.245 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-09T23:56:46.286 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-09T23:56:46.390 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-09T23:56:46.432 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-09T23:56:46.534 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-09T23:56:46.646 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-09T23:56:46.679 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-09T23:56:46.707 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-09T23:56:46.840 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-09T23:56:46.901 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-09T23:56:46.903 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-09T23:56:47.072 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-09T23:56:47.100 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-09T23:56:47.200 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-09T23:56:47.289 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-09T23:56:47.300 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-09T23:56:47.394 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:47.501 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-09T23:56:47.545 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-09T23:56:47.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-09T23:56:47.744 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-09T23:56:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-09T23:56:47.974 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-09T23:56:48.001 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-09T23:56:48.162 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-09T23:56:48.162 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-09T23:56:48.208 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-09T23:56:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-09T23:56:48.490 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-02-09T23:56:48.606 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-09T23:56:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-09T23:56:48.662 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:48.880 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-09T23:56:48.905 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-09T23:56:49.118 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-09T23:56:49.129 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-09T23:56:49.327 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-09T23:56:49.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-09T23:56:49.503 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:49.812 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-09T23:56:49.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-09T23:56:50.022 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:50.053 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-09T23:56:50.191 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-02-09T23:56:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:50.271 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-09T23:56:50.360 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:50.507 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-09T23:56:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:50.736 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-09T23:56:50.768 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:50.951 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:50.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-09T23:56:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:51.200 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-09T23:56:51.297 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-09T23:56:51.692 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-09T23:56:51.693 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-09T23:56:51.694 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-09T23:56:51.695 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-09T23:56:51.695 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-09T23:56:51.695 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-09T23:56:51.695 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-09T23:56:51.695 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-09T23:56:51.720 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:51.787 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-09T23:56:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:52.152 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-02-09T23:56:52.246 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-09T23:56:52.549 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-2.6-1.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-09T23:56:52.550 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:52.551 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:56:52.618 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:52.787 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base 2024-02-09T23:56:52.801 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:52.818 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:53.003 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-09T23:56:53.387 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-09T23:56:53.388 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-09T23:56:53.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-09T23:56:53.390 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-09T23:56:53.545 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:07 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-02-09T23:56:53.844 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:54.231 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-02-09T23:56:54.236 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-09T23:56:54.236 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:54.236 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:56:54.236 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-09T23:56:54.237 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2024-02-09T23:56:54.238 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-09T23:56:54.239 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:54.240 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:56:54.443 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:54.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2024-02-09T23:56:54.627 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-02-09T23:56:54.826 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:54.844 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-02-09T23:56:55.020 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:56:55.033 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:55.062 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:56:55.063 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:56:55.063 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:56:55.171 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-immutable-object-cache 2024-02-09T23:56:55.279 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:09 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-02-09T23:56:55.440 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-09T23:56:55.441 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-09T23:56:55.442 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-09T23:56:55.922 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:09 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:56.731 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:56:56.776 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:56:56.869 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-09T23:56:56.869 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:56.869 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-09T23:56:56.870 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-2.6-1.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-09T23:56:56.871 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:56:56.872 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:56:56.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2024-02-09T23:56:57.078 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base 2024-02-09T23:56:57.431 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:56:57.431 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:57.431 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2024-02-09T23:56:57.431 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:56:57.432 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:57.433 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 203 k 2024-02-09T23:56:57.433 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 599 k 2024-02-09T23:56:57.433 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:56:57.467 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 5.8 MB/s | 203 kB 00:00 2024-02-09T23:56:57.468 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:57.468 INFO:teuthology.orchestra.run.smithi183.stdout:Total 5.6 MB/s | 203 kB 00:00 2024-02-09T23:56:57.468 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:56:57.478 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:56:57.479 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:56:57.528 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:56:57.531 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:56:57.643 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:56:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:11 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:57.792 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:56:57.848 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:08 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:56:58.198 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:56:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:56:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:58.601 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:56:58.601 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-02-09T23:56:58.601 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:56:58.601 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:56:58.831 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr 2024-02-09T23:56:59.172 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:59.173 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 203 k 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 599 k 2024-02-09T23:56:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:56:59.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.0 MB/s | 203 kB 00:00 2024-02-09T23:56:59.224 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:56:59.225 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.9 MB/s | 203 kB 00:00 2024-02-09T23:56:59.225 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:56:59.236 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:56:59.237 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:56:59.285 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:56:59.288 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:56:59.311 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:56:59.357 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:56:59.358 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:56:59.358 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:56:59.425 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:56:59.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache 2024-02-09T23:56:59.575 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:56:59.598 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:13 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:56:59.994 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:00.218 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:11 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:00.404 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:00.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2024-02-09T23:57:01.046 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:01.092 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:01.093 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:01.093 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:01.208 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-fuse 2024-02-09T23:57:01.441 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:15 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:01.745 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:01.745 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:01.745 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:01.746 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:01.747 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 203 k 2024-02-09T23:57:01.747 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 599 k 2024-02-09T23:57:01.747 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:01.840 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 2.1 MB/s | 203 kB 00:00 2024-02-09T23:57:01.840 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:01.840 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.1 MB/s | 203 kB 00:00 2024-02-09T23:57:01.841 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:01.852 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:01.852 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:01.901 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:01.904 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:01.963 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:15 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:02.024 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:02.225 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:02.631 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:02.902 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:02.947 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:02.948 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:02.949 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:03.036 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:03.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2024-02-09T23:57:03.232 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr 2024-02-09T23:57:03.479 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:03.479 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:03.479 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:03.479 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout:Install 2 Packages 2024-02-09T23:57:03.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:03.481 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 655 k 2024-02-09T23:57:03.481 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.8 M 2024-02-09T23:57:03.481 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:03.777 INFO:teuthology.orchestra.run.smithi183.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 8.8 MB/s | 572 kB 00:00 2024-02-09T23:57:03.821 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:17 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:04.006 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:15 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:04.085 INFO:teuthology.orchestra.run.smithi183.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 223 kB/s | 83 kB 00:00 2024-02-09T23:57:04.086 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:04.086 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.1 MB/s | 655 kB 00:00 2024-02-09T23:57:04.096 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:04.117 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:04.117 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:04.199 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:04.202 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:04.620 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-09T23:57:04.765 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:05.167 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:05.167 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-02-09T23:57:05.331 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:05.332 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:05.332 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:05.332 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:05.332 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-02-09T23:57:05.333 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:05.334 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 655 k 2024-02-09T23:57:05.334 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 1.8 M 2024-02-09T23:57:05.334 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:05.420 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 12 MB/s | 572 kB 00:00 2024-02-09T23:57:05.461 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:05.508 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:05.508 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:05.508 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:05.564 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:05.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse 2024-02-09T23:57:05.729 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 234 kB/s | 83 kB 00:00 2024-02-09T23:57:05.729 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:05.729 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.6 MB/s | 655 kB 00:00 2024-02-09T23:57:05.739 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:05.840 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados-devel 2024-02-09T23:57:05.842 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:05.845 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:06.022 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:06.273 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-09T23:57:06.372 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:17 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:06.407 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:06.607 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:20 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:06.840 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:07.218 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:07.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2024-02-09T23:57:07.881 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:07.882 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:07.882 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:07.882 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:07.882 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:07.882 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-02-09T23:57:07.883 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:07.884 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 655 k 2024-02-09T23:57:07.884 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.8 M 2024-02-09T23:57:07.884 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:08.109 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:08.109 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:57:08.110 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:08.111 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 140 k 2024-02-09T23:57:08.111 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 478 k 2024-02-09T23:57:08.111 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:08.147 INFO:teuthology.orchestra.run.smithi183.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 3.9 MB/s | 140 kB 00:00 2024-02-09T23:57:08.147 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:08.147 INFO:teuthology.orchestra.run.smithi183.stdout:Total 3.7 MB/s | 140 kB 00:00 2024-02-09T23:57:08.148 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:08.200 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:08.203 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:08.281 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:22 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:08.478 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:08.671 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:08.945 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:09.138 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 11 MB/s | 572 kB 00:00 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:09.349 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:09.455 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 226 kB/s | 83 kB 00:00 2024-02-09T23:57:09.455 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:09.456 INFO:teuthology.orchestra.run.smithi164.stdout:Total 417 kB/s | 655 kB 00:01 2024-02-09T23:57:09.468 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:09.491 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:09.491 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:09.578 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:09.581 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:09.642 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs2 2024-02-09T23:57:09.762 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:09.769 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:09.770 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:09.770 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:09.770 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:09.770 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:09.770 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 140 k 2024-02-09T23:57:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 478 k 2024-02-09T23:57:09.772 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:09.817 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 3.0 MB/s | 140 kB 00:00 2024-02-09T23:57:09.818 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:09.818 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.0 MB/s | 140 kB 00:00 2024-02-09T23:57:09.818 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:09.823 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:09.823 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:09.870 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:09.873 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:09.962 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-09T23:57:10.010 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:10.140 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:10.400 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:24 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:10.452 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:10.526 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-02-09T23:57:10.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-02-09T23:57:10.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:10.856 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:10.857 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:10.857 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:10.857 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:10.857 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:10.946 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-09T23:57:10.946 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:10.946 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:10.946 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-09T23:57:10.947 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:10.947 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:11.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2024-02-09T23:57:11.172 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel 2024-02-09T23:57:11.846 INFO:teuthology.orchestra.run.smithi183.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:11.859 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:25 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:11.892 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:11.893 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:11.893 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:11.941 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:22 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:12.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs-devel 2024-02-09T23:57:12.765 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:26 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:13.329 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:13.376 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:13.376 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:13.376 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:13.461 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 140 k 2024-02-09T23:57:13.462 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 478 k 2024-02-09T23:57:13.462 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:13.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2024-02-09T23:57:13.525 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 140 kB 00:00 2024-02-09T23:57:13.526 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:13.526 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.1 MB/s | 140 kB 00:00 2024-02-09T23:57:13.526 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:13.532 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:13.532 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:13.578 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:13.581 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:13.716 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:13.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:14.208 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:14.232 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:28 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:14.278 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:14.278 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 22 k 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 78 k 2024-02-09T23:57:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:14.333 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 409 kB/s | 22 kB 00:00 2024-02-09T23:57:14.333 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:Total 398 kB/s | 22 kB 00:00 2024-02-09T23:57:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:14.337 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:14.337 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:14.338 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:14.341 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:14.386 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:14.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:14.588 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:14.809 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:14.858 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2 2024-02-09T23:57:15.189 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:15.189 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:15.189 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:15.189 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:15.190 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:15.190 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:15.322 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2 2024-02-09T23:57:15.618 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:26 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:15.740 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:15.741 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:15.742 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:15.742 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:57:15.742 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:15.742 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 22 k 2024-02-09T23:57:15.743 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 78 k 2024-02-09T23:57:15.743 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:15.820 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 280 kB/s | 22 kB 00:00 2024-02-09T23:57:15.821 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:15.821 INFO:teuthology.orchestra.run.smithi089.stdout:Total 275 kB/s | 22 kB 00:00 2024-02-09T23:57:15.821 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:15.824 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:15.824 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:15.828 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:15.885 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:16.046 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:16.073 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:30 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:16.296 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:16.650 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:16.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-02-09T23:57:17.091 INFO:teuthology.orchestra.run.smithi164.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:17.137 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:17.138 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:17.138 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:17.236 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs-devel 2024-02-09T23:57:17.531 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:17.539 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:31 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:17.577 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:17.578 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:17.578 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:17.693 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librbd1 2024-02-09T23:57:17.994 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:28 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:18.447 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:32 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:19.008 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:19.053 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:19.054 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:19.055 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:19.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2024-02-09T23:57:19.472 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:19.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:19.474 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 22 k 2024-02-09T23:57:19.474 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 78 k 2024-02-09T23:57:19.474 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:19.529 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 395 kB/s | 22 kB 00:00 2024-02-09T23:57:19.530 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:19.530 INFO:teuthology.orchestra.run.smithi164.stdout:Total 386 kB/s | 22 kB 00:00 2024-02-09T23:57:19.530 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:19.533 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:19.534 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:19.535 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:19.538 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:19.591 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:19.779 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:19.928 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:33 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:19.948 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:19.949 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:19.949 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:20.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rados 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:20.383 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:20.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-02-09T23:57:20.814 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:34 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:21.258 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:32 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:21.394 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:21.439 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:21.443 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:21.443 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:21.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2024-02-09T23:57:22.275 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:22.297 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:36 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:22.320 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:22.321 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:22.321 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:22.434 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rgw 2024-02-09T23:57:22.726 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:22.771 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:22.773 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:22.773 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:22.874 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1 2024-02-09T23:57:23.187 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:37 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:23.634 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:34 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:23.799 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:23.844 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:23.845 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:23.845 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:23.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2024-02-09T23:57:24.658 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:24.701 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:38 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:24.704 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:24.705 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:24.705 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:24.821 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-cephfs 2024-02-09T23:57:25.104 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:25.149 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:25.150 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:25.150 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:25.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados 2024-02-09T23:57:25.573 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:39 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:25.991 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:36 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:26.168 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:26.213 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:26.214 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:26.214 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:26.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2024-02-09T23:57:27.038 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:27.084 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:27.085 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:41 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:27.085 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:27.085 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:27.202 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rbd 2024-02-09T23:57:27.465 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:27.512 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:27.513 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:27.513 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:27.623 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw 2024-02-09T23:57:27.959 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:41 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:28.378 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:39 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:28.527 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:28.573 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:28.574 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:28.574 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:28.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2024-02-09T23:57:29.426 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:29.439 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:43 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:29.471 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:29.472 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:29.472 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:29.589 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-fuse 2024-02-09T23:57:29.865 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:29.910 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:29.912 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:29.912 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:30.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs 2024-02-09T23:57:30.343 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:44 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:30.784 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:30.913 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:30.958 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:30.959 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:30.959 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:31.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2024-02-09T23:57:31.847 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:31.847 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 73 k 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 188 k 2024-02-09T23:57:31.848 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:31.894 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:45 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:31.895 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 73 kB 00:00 2024-02-09T23:57:31.895 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:31.895 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-02-09T23:57:31.895 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:31.905 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:31.905 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:31.951 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:31.954 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:32.050 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:32.230 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:32.234 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:32.368 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd 2024-02-09T23:57:32.512 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:32.888 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:33.114 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:44 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:33.116 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-mirror 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:57:33.378 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:33.379 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 73 k 2024-02-09T23:57:33.379 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 188 k 2024-02-09T23:57:33.379 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.7 MB/s | 73 kB 00:00 2024-02-09T23:57:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:33.419 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.7 MB/s | 73 kB 00:00 2024-02-09T23:57:33.419 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:33.428 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:33.428 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:33.474 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:33.477 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:33.573 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:33.873 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:47 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:34.081 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:34.447 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:34.584 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:34.630 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:34.631 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:34.631 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:34.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2024-02-09T23:57:34.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse 2024-02-09T23:57:35.380 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:35.381 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:35.381 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:35.381 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:35.382 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:57:35.383 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.7 M 2024-02-09T23:57:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 9.8 M 2024-02-09T23:57:35.383 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:35.398 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:49 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:35.473 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 30 MB/s | 2.7 MB 00:00 2024-02-09T23:57:35.473 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:35.473 INFO:teuthology.orchestra.run.smithi183.stdout:Total 30 MB/s | 2.7 MB 00:00 2024-02-09T23:57:35.474 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:35.484 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:35.484 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:35.487 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:46 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:35.539 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:35.542 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:35.885 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:36.069 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:36.486 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:36.876 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:36.877 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:36.877 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:36.877 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:36.877 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:36.877 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:36.915 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:36.916 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:36.916 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:36.916 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.7 M 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 9.8 M 2024-02-09T23:57:36.917 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:36.989 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 38 MB/s | 2.7 MB 00:00 2024-02-09T23:57:36.989 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:36.989 INFO:teuthology.orchestra.run.smithi089.stdout:Total 37 MB/s | 2.7 MB 00:00 2024-02-09T23:57:36.990 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:36.993 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:36.994 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:36.995 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:36.995 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 73 k 2024-02-09T23:57:36.995 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 188 k 2024-02-09T23:57:36.995 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:37.000 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:37.001 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:37.041 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2024-02-09T23:57:37.041 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:37.042 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-02-09T23:57:37.042 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:37.051 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:37.051 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:37.056 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:37.059 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:37.097 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:37.100 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:37.126 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-nbd 2024-02-09T23:57:37.204 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:37.401 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:37.434 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:37.553 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:37.723 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:37.902 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:51 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:38.023 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:38.155 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:38.155 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:38.155 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:38.155 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:38.155 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:38.156 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:38.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror 2024-02-09T23:57:38.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:38.465 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:38.465 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:38.465 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:38.465 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:38.465 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:38.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2024-02-09T23:57:39.136 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:50 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:39.420 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-02-09T23:57:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-02-09T23:57:39.422 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:39.422 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 140 k 2024-02-09T23:57:39.422 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 418 k 2024-02-09T23:57:39.422 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-02-09T23:57:39.482 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:53 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:39.584 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 871 kB/s | 140 kB 00:00 2024-02-09T23:57:39.584 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:39.584 INFO:teuthology.orchestra.run.smithi183.stdout:Total 864 kB/s | 140 kB 00:00 2024-02-09T23:57:39.584 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-02-09T23:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-02-09T23:57:39.594 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-02-09T23:57:39.642 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-02-09T23:57:39.645 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-02-09T23:57:39.754 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-02-09T23:57:39.941 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:40.232 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:40.633 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:40.654 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.7 M 2024-02-09T23:57:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 9.8 M 2024-02-09T23:57:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 38 MB/s | 2.7 MB 00:00 2024-02-09T23:57:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:Total 37 MB/s | 2.7 MB 00:00 2024-02-09T23:57:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:40.900 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2 2024-02-09T23:57:40.969 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-02-09T23:57:40.970 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 140 k 2024-02-09T23:57:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 418 k 2024-02-09T23:57:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-09T23:57:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 1.9 MB/s | 140 kB 00:00 2024-02-09T23:57:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.9 MB/s | 140 kB 00:00 2024-02-09T23:57:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-09T23:57:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-09T23:57:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-09T23:57:41.099 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-09T23:57:41.102 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-09T23:57:41.140 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-09T23:57:41.319 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:41.464 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:41.681 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:55 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:41.741 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:42.120 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:42.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:42.121 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-09T23:57:42.121 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:42.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:42.121 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:42.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-02-09T23:57:42.353 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd 2024-02-09T23:57:43.088 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:57 ago on Fri 09 Feb 2024 11:55:46 PM UTC. 2024-02-09T23:57:43.124 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:54 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:43.154 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:43.199 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-02-09T23:57:43.201 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-02-09T23:57:43.201 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-02-09T23:57:43.317 DEBUG:teuthology.parallel:result is None 2024-02-09T23:57:44.542 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:44.587 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-09T23:57:44.588 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-02-09T23:57:44.588 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-09T23:57:44.638 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:44.638 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:44.638 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-02-09T23:57:44.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:44.640 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 140 k 2024-02-09T23:57:44.640 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 418 k 2024-02-09T23:57:44.640 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-09T23:57:44.689 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-02-09T23:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-09T23:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-02-09T23:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-09T23:57:44.698 DEBUG:teuthology.parallel:result is None 2024-02-09T23:57:44.699 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-09T23:57:44.699 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-09T23:57:44.746 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-09T23:57:44.749 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-09T23:57:44.894 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-09T23:57:45.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:45.440 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:45.813 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:46.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-02-09T23:57:46.819 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:57 ago on Fri 09 Feb 2024 11:55:49 PM UTC. 2024-02-09T23:57:48.288 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-02-09T23:57:48.335 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-09T23:57:48.336 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-02-09T23:57:48.336 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-09T23:57:48.472 DEBUG:teuthology.parallel:result is None 2024-02-09T23:57:48.472 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:57:48.472 INFO:teuthology.packaging:ref: None 2024-02-09T23:57:48.473 INFO:teuthology.packaging:tag: None 2024-02-09T23:57:48.473 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:57:48.473 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:57:48.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:57:48.831 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-09T23:57:48.873 INFO:teuthology.orchestra.run.smithi089.stdout:15.2.17-0.el8 2024-02-09T23:57:48.873 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-02-09T23:57:48.874 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-02-09T23:57:48.876 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:57:48.876 INFO:teuthology.packaging:ref: None 2024-02-09T23:57:48.876 INFO:teuthology.packaging:tag: None 2024-02-09T23:57:48.876 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:57:48.876 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:57:48.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:57:49.150 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-09T23:57:49.174 INFO:teuthology.orchestra.run.smithi164.stdout:15.2.17-0.el8 2024-02-09T23:57:49.174 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-02-09T23:57:49.174 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-02-09T23:57:49.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T23:57:49.176 INFO:teuthology.packaging:ref: None 2024-02-09T23:57:49.176 INFO:teuthology.packaging:tag: None 2024-02-09T23:57:49.176 INFO:teuthology.packaging:branch: octopus 2024-02-09T23:57:49.176 INFO:teuthology.packaging:sha1: 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:57:49.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-02-09T23:57:49.507 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-09T23:57:49.534 INFO:teuthology.orchestra.run.smithi183.stdout:15.2.17-0.el8 2024-02-09T23:57:49.534 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-02-09T23:57:49.534 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-02-09T23:57:49.537 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-09T23:57:49.537 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:49.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-09T23:57:49.570 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:49.570 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-09T23:57:49.600 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:49.601 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-09T23:57:49.632 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-09T23:57:49.632 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:49.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-02-09T23:57:49.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-09T23:57:49.737 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:49.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-02-09T23:57:49.768 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-09T23:57:49.838 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:49.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-02-09T23:57:49.870 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-09T23:57:49.940 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-09T23:57:49.941 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:49.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-09T23:57:49.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-09T23:57:50.043 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:50.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-09T23:57:50.075 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-09T23:57:50.144 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:50.145 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-09T23:57:50.176 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-09T23:57:50.247 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-09T23:57:50.247 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:50.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-02-09T23:57:50.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-09T23:57:50.350 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:50.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-02-09T23:57:50.380 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-09T23:57:50.449 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:50.449 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-02-09T23:57:50.481 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-09T23:57:50.553 INFO:teuthology.run_tasks:Running task print... 2024-02-09T23:57:50.564 INFO:teuthology.task.print:**** done installing octopus 2024-02-09T23:57:50.564 INFO:teuthology.run_tasks:Running task ceph... 2024-02-09T23:57:50.650 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-09T23:57:50.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-02-09T23:57:50.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-02-09T23:57:50.655 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2024-02-09T23:57:50.686 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-09T23:57:50.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-09T23:57:50.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-09T23:57:50.728 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-09T23:57:50.756 INFO:tasks.ceph:Creating extra log directories... 2024-02-09T23:57:50.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-09T23:57:50.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-09T23:57:50.798 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-09T23:57:50.838 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-09T23:57:50.838 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-09T23:57:50.839 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'branch': 'main', 'description': 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7554534', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 3558, 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcZ0odxrGFwFkuDlW9Xe/BJAzMoBC4lOxQ9KoRExmv+JiFhgqyuMobsiFbuz6lCk+6vDcsLX80Y3DNOGAkVOM=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmWEPP5HSwhdOmzl8le8GtPRRmTc9NK68BKsSb97+NofI53vQQWiZ4r5Rr3mD9OQUWzak5i/uSvrpkSIGXGsNM=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbn3grc8ibnAG8w8nMLILDrjNRTEPt3B/r0eUWUrny7cmuT6sFjqXCsbH9mmL1aOGaXMtA0four9RlYG1sHV34='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd9fdb2209e15b39d9f061fd85399f352ce0f0894', 'timestamp': '2024-02-09_19:35:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-09T23:57:50.839 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-09T23:57:50.865 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-09T23:57:50.867 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-09T23:57:50.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-02-09T23:57:50.923 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-02-09T23:57:50.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2024-02-09T23:57:50.955 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:50.955 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-02-09T23:57:51.008 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-09T23:57:51.008 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 166320 Links: 1 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-02-09 23:57:37.762911966 +0000 2024-02-09T23:57:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-02-09 23:50:20.913450267 +0000 2024-02-09T23:57:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-02-09 23:50:20.913450267 +0000 2024-02-09T23:57:51.067 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-02-09T23:57:51.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-09T23:57:51.132 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-02-09T23:57:51.133 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-02-09T23:57:51.133 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000251668 s, 2.0 MB/s 2024-02-09T23:57:51.134 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-09T23:57:51.193 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 161637 Links: 1 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T23:57:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-02-09 23:57:37.762911966 +0000 2024-02-09T23:57:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-02-09 23:50:21.287441781 +0000 2024-02-09T23:57:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-02-09 23:50:21.287441781 +0000 2024-02-09T23:57:51.253 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-02-09T23:57:51.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-09T23:57:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-02-09T23:57:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-02-09T23:57:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000236918 s, 2.2 MB/s 2024-02-09T23:57:51.318 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-09T23:57:51.378 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-02-09T23:57:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-09T23:57:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 166386 Links: 1 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-02-09 23:57:37.762911966 +0000 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-02-09 23:50:21.634433909 +0000 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-02-09 23:50:21.634433909 +0000 2024-02-09T23:57:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-02-09T23:57:51.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-09T23:57:51.501 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-02-09T23:57:51.501 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-02-09T23:57:51.501 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000186233 s, 2.7 MB/s 2024-02-09T23:57:51.502 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-09T23:57:51.561 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-02-09T23:57:51.618 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-09T23:57:51.618 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 161772 Links: 1 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-02-09 23:57:37.762911966 +0000 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-02-09 23:50:21.961426492 +0000 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-02-09 23:50:21.961426492 +0000 2024-02-09T23:57:51.619 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-02-09T23:57:51.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-09T23:57:51.683 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-02-09T23:57:51.684 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-02-09T23:57:51.684 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000225687 s, 2.3 MB/s 2024-02-09T23:57:51.685 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-09T23:57:51.744 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T23:57:51.744 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-02-09T23:57:51.744 INFO:tasks.ceph:Generating config... 2024-02-09T23:57:51.745 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-02-09T23:57:51.745 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-02-09T23:57:51.745 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2024-02-09T23:57:51.745 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2024-02-09T23:57:51.745 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-02-09T23:57:51.745 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-09T23:57:51.745 INFO:tasks.ceph:[client] debug client = 20 2024-02-09T23:57:51.745 INFO:tasks.ceph:[client] debug ms = 1 2024-02-09T23:57:51.746 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-09T23:57:51.746 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-09T23:57:51.746 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-09T23:57:51.747 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-09T23:57:51.747 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-09T23:57:51.747 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-09T23:57:51.747 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-09T23:57:51.747 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-09T23:57:51.747 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-09T23:57:51.748 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-09T23:57:51.748 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-09T23:57:51.749 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-09T23:57:51.749 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-09T23:57:51.749 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-09T23:57:51.749 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-09T23:57:51.749 INFO:tasks.ceph:Setting up mon.a... 2024-02-09T23:57:51.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-09T23:57:51.898 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-02-09T23:57:51.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-09T23:57:51.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T23:57:52.007 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.b', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]'), ('mon.c', '[v2:172.21.15.89:3302,v1:172.21.15.89:6791]')] 2024-02-09T23:57:52.007 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-09T23:57:52.008 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:52.008 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-09T23:57:52.065 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --addv b '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --addv c '[v2:172.21.15.89:3302,v1:172.21.15.89:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 951e35aa-74af-44e4-b74f-b1f2d00d0504 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 951e35aa-74af-44e4-b74f-b1f2d00d0504 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-02-09T23:57:52.146694+0000 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-02-09T23:57:52.146694+0000 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 0 (unknown) 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.b 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] mon.c 2024-02-09T23:57:52.148 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-09T23:57:52.150 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-09T23:57:52.209 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 951e35aa-74af-44e4-b74f-b1f2d00d0504... 2024-02-09T23:57:52.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-09T23:57:52.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-09T23:57:52.254 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-09T23:57:52.292 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-02-09T23:57:52.292 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.293 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-02-09T23:57:52.294 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-02-09T23:57:52.295 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on pool no app = False 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: ms bind msgr2 = False 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore warn on legacy statfs = False 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore warn on no per pool omap = False 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn min per osd = 0 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 951e35aa-74af-44e4-b74f-b1f2d00d0504 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-02-09T23:57:52.296 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-02-09T23:57:52.297 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2024-02-09T23:57:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-02-09T23:57:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-02-09T23:57:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.301 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = False 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.302 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2024-02-09T23:57:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.304 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.306 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2024-02-09T23:57:52.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2024-02-09T23:57:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2024-02-09T23:57:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on pool no app = False 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: ms bind msgr2 = False 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore warn on legacy statfs = False 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore warn on no per pool omap = False 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn min per osd = 0 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 951e35aa-74af-44e4-b74f-b1f2d00d0504 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2024-02-09T23:57:52.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2024-02-09T23:57:52.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2024-02-09T23:57:52.312 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-02-09T23:57:52.313 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.314 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = False 2024-02-09T23:57:52.315 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2024-02-09T23:57:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2024-02-09T23:57:52.317 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.318 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.319 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-02-09T23:57:52.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-02-09T23:57:52.321 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-02-09T23:57:52.322 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on pool no app = False 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: ms bind msgr2 = False 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore warn on legacy statfs = False 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore warn on no per pool omap = False 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn min per osd = 0 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 951e35aa-74af-44e4-b74f-b1f2d00d0504 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-02-09T23:57:52.323 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.324 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-09T23:57:52.325 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.326 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-09T23:57:52.327 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = False 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-09T23:57:52.328 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-02-09T23:57:52.329 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-02-09T23:57:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-02-09T23:57:52.330 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-09T23:57:52.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-09T23:57:52.395 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-09T23:57:52.396 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:52.396 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-09T23:57:52.415 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:52.415 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-09T23:57:52.472 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:57:52.472 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:52.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-09T23:57:52.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T23:57:52.547 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:57:52.547 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:52.606 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-02-09T23:57:52.606 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:52.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-09T23:57:52.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T23:57:52.647 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:57:52.647 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:52.706 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2024-02-09T23:57:52.706 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:52.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-09T23:57:52.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T23:57:52.749 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:57:52.749 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:52.811 INFO:tasks.ceph:Setting up mon nodes... 2024-02-09T23:57:52.811 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-09T23:57:52.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-09T23:57:52.859 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-09T23:57:52.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-09T23:57:52.909 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-09T23:57:52.912 INFO:tasks.ceph:Setting up mds nodes... 2024-02-09T23:57:52.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-09T23:57:52.961 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-09T23:57:52.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-09T23:57:52.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-09T23:57:53.078 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-09T23:57:53.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-09T23:57:53.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-09T23:57:53.194 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-09T23:57:53.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-09T23:57:53.223 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-09T23:57:53.223 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-09T23:57:53.352 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-09T23:57:53.366 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-09T23:57:53.485 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-09T23:57:53.498 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-09T23:57:53.499 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-02-09T23:57:53.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-09T23:57:53.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T23:57:53.526 INFO:tasks.ceph:role: osd.0 2024-02-09T23:57:53.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:57:53.526 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-02-09T23:57:53.600 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T23:57:53.601 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-09T23:57:53.601 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T23:57:53.601 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T23:57:54.028 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-02-09T23:57:54.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-02-09T23:57:54.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-09T23:57:54.187 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-09T23:57:54.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-09T23:57:54.289 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T23:57:54.289 INFO:tasks.ceph:role: osd.1 2024-02-09T23:57:54.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:57:54.289 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-09T23:57:54.364 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T23:57:54.365 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T23:57:54.791 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-02-09T23:57:54.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-02-09T23:57:54.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-09T23:57:54.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-09T23:57:54.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-09T23:57:54.993 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T23:57:54.993 INFO:tasks.ceph:role: osd.2 2024-02-09T23:57:54.993 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:57:54.993 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-09T23:57:55.067 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T23:57:55.067 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T23:57:55.067 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T23:57:55.067 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T23:57:55.068 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T23:57:55.514 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-02-09T23:57:55.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-02-09T23:57:55.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-09T23:57:55.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-09T23:57:55.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-09T23:57:55.771 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T23:57:55.771 INFO:tasks.ceph:role: osd.3 2024-02-09T23:57:55.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:57:55.771 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T23:57:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T23:57:56.290 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-02-09T23:57:56.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-02-09T23:57:56.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-09T23:57:56.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-09T23:57:56.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.639+0000 7fd9d5e9df00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.640+0000 7fd9d5e9df00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.640+0000 7fd9d5e9df00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.640+0000 7fd9d5e9df00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.640+0000 7fd9d5e9df00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T23:57:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.640+0000 7fd9d5e9df00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-09T23:57:56.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:56.652+0000 7fd9d5e9df00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-02-09T23:57:58.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-09T23:57:59.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:57:59.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-09T23:57:59.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-09T23:57:59.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T23:57:59.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T23:57:59.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T23:57:59.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.090+0000 7f287f9fff00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-09T23:57:59.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:57:59.099+0000 7f287f9fff00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-02-09T23:58:01.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-09T23:58:01.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:58:01.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.545+0000 7fd9c3fb4f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-09T23:58:01.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.545+0000 7fd9c3fb4f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-09T23:58:01.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.545+0000 7fd9c3fb4f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T23:58:01.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.545+0000 7fd9c3fb4f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T23:58:01.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.545+0000 7fd9c3fb4f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T23:58:01.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.546+0000 7fd9c3fb4f00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-09T23:58:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:01.554+0000 7fd9c3fb4f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-02-09T23:58:03.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-09T23:58:03.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:58:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.997+0000 7f0dd05d4f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-09T23:58:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.997+0000 7f0dd05d4f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-09T23:58:04.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.997+0000 7f0dd05d4f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T23:58:04.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.997+0000 7f0dd05d4f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T23:58:04.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.997+0000 7f0dd05d4f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T23:58:04.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:03.998+0000 7f0dd05d4f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-09T23:58:04.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:04.005+0000 7f0dd05d4f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-02-09T23:58:06.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-09T23:58:06.363 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-09T23:58:06.363 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-09T23:58:06.433 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-09T23:58:06.504 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-09T23:58:06.573 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-09T23:58:06.641 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-09T23:58:06.708 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-09T23:58:06.774 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-09T23:58:06.840 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-09T23:58:06.907 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:06.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-09T23:58:06.974 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:58:06.974 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-09T23:58:06.997 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:58:06.997 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-09T23:58:07.018 INFO:tasks.ceph:Adding keys to all mons... 2024-02-09T23:58:07.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAAvMZl9DguMxAADoY0Icpk1HpCQeyrGc/Irw== 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAAvMZl47EpNhAA9KAlSAuWXt5VzpA3jDRyag== 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-02-09T23:58:07.044 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAAvMZlv5tAORAAPx7VcxFHYq31z/LxPtoiCw== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQABvMZlQ/GZBBAAyBdIi7jBKsQi7zMg/NqI1w== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQABvMZltW6FCxAAXzHJ066Jpms5rbRiFnsNVg== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAEvMZlVlAyJhAAM2E9JALyDrN0TFadMf210A== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAHvMZlrFNsBRAAwVAWNPLXDQM9cByi1KEnzg== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAJvMZlYYaOIBAARHD3HRbFuBEu/zouc7xbDQ== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQALvMZlQHZ/OxAAaS1DcunCN8lGNtpxibnPBg== 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-02-09T23:58:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQABvMZleCHxFBAAe2ZH4Tg4bi8M5D8zbB6KLQ== 2024-02-09T23:58:07.046 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2024-02-09T23:58:07.046 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQABvMZl+xfeHBAAgXuxS/FvEXfNbDtBg3ybvg== 2024-02-09T23:58:07.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T23:58:07.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T23:58:07.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-09T23:58:07.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-09T23:58:07.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-09T23:58:07.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T23:58:07.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T23:58:07.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T23:58:07.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T23:58:07.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T23:58:07.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T23:58:07.624 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-09T23:58:07.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-09T23:58:07.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T23:58:07.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-09T23:58:07.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-09T23:58:07.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T23:58:07.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-09T23:58:07.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-09T23:58:08.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T23:58:08.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-09T23:58:08.144 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-09T23:58:08.202 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-09T23:58:08.202 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-09T23:58:08.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-09T23:58:08.245 INFO:tasks.ceph.mon.a:Started 2024-02-09T23:58:08.245 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-09T23:58:08.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-09T23:58:08.248 INFO:tasks.ceph.mon.b:Started 2024-02-09T23:58:08.248 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-09T23:58:08.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-09T23:58:08.250 INFO:tasks.ceph.mon.c:Started 2024-02-09T23:58:08.250 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-09T23:58:08.250 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-09T23:58:08.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-09T23:58:08.252 INFO:tasks.ceph.mgr.x:Started 2024-02-09T23:58:08.253 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-09T23:58:08.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-09T23:58:08.255 INFO:tasks.ceph.mgr.y:Started 2024-02-09T23:58:08.255 INFO:tasks.ceph:Setting crush tunables to default 2024-02-09T23:58:08.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-02-09T23:58:08.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.395+0000 7f63a910d700 1 Processor -- start 2024-02-09T23:58:08.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.395+0000 7f63a910d700 1 -- start start 2024-02-09T23:58:08.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a910d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a910d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a910d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a4066520 con 0x7f63a4139f90 2024-02-09T23:58:08.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a910d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a40a4da0 con 0x7f63a4139bb0 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a910d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4065fb0 con 0x7f63a4066c90 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47760/0 (socket says 172.21.15.89:47760) 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 -- 172.21.15.89:0/784362428 learned_addr learned my addr 172.21.15.89:0/784362428 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 msgr2=0x7f63a40a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a2d9d700 1 -- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 msgr2=0x7f63a4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 msgr2=0x7f63a40a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a2d9d700 1 -- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 msgr2=0x7f63a4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-09T23:58:08.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.396+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-09T23:58:08.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a2d9d700 1 -- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 msgr2=0x7f63a4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a259c700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 msgr2=0x7f63a40a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a2d9d700 1 -- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 msgr2=0x7f63a4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a259c700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 msgr2=0x7f63a40a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-02-09T23:58:08.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.597+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596609046 0 0) 0x7f63a4066520 con 0x7f63a4139f90 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6388003260 con 0x7f63a4139f90 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735510128 0 0) 0x7f6388003260 con 0x7f63a4139f90 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 msgr2=0x7f63a40a4360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a4066c90 0x7f63a40a4360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 msgr2=0x7f63a4065ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 --2- 172.21.15.89:0/784362428 >> v2:172.21.15.89:3300/0 conn(0x7f63a4139bb0 0x7f63a4065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40a4b00 con 0x7f63a4139f90 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4162454647 0 0) 0x7f639c0019e0 con 0x7f63a4139f90 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 >> v1:172.21.15.89:6789/0 conn(0x7f63a4139f90 legacy=0x7f63a405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63880037b0 0x7f6388003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004500 0x7f6388004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6388004e70 0x7f638800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40a4da0 con 0x7f6388004500 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4065fb0 con 0x7f63880037b0 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f638800bd20 con 0x7f6388004e70 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a359e700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6388004e70 0x7f638800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.598+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63880037b0 0x7f6388003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004500 0x7f6388004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63880037b0 msgr2=0x7f6388003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63880037b0 0x7f6388003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004500 msgr2=0x7f6388004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:08.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004500 0x7f6388004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 -- 172.21.15.89:0/784362428 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40a4b00 con 0x7f6388004e70 2024-02-09T23:58:08.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a259c700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004500 0x7f6388004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:08.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.599+0000 7f63a359e700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6388004e70 0x7f638800b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f639c0013c0 tx=0x7f639c007930).ready entity=mon.2 client_cookie=747db4b7ffd224ec server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639c007be0 con 0x7f6388004e70 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c00ccc0 con 0x7f6388004e70 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a1d9b700 1 -- 172.21.15.89:0/784362428 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639c0125f0 con 0x7f6388004e70 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a910d700 1 -- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6388004e70 msgr2=0x7f638800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a910d700 1 --2- 172.21.15.89:0/784362428 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6388004e70 0x7f638800b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f639c0013c0 tx=0x7f639c007930).stop 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.601+0000 7f63a359e700 1 -- 172.21.15.89:0/784362428 reap_dead start 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.602+0000 7f63a910d700 1 -- 172.21.15.89:0/784362428 shutdown_connections 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.602+0000 7f63a910d700 1 -- 172.21.15.89:0/784362428 >> 172.21.15.89:0/784362428 conn(0x7f63a40a89d0 msgr2=0x7f63a40a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:08.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.602+0000 7f63a910d700 1 -- 172.21.15.89:0/784362428 shutdown_connections 2024-02-09T23:58:08.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.602+0000 7f63a910d700 1 -- 172.21.15.89:0/784362428 wait complete. 2024-02-09T23:58:08.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.603+0000 7f63a910d700 1 Processor -- start 2024-02-09T23:58:08.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.603+0000 7f63a910d700 1 -- start start 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a40a1740 0x7f63a4145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f63a4146280 0x7f63a4148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a409f220 con 0x7f6388004e70 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4143510 con 0x7f63a40a1740 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a910d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4145830 con 0x7f63a4146280 2024-02-09T23:58:08.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58878/0 (socket says 172.21.15.89:58878) 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 -- 172.21.15.89:0/1225279725 learned_addr learned my addr 172.21.15.89:0/1225279725 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a40a1740 0x7f63a4145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a359e700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f63a4146280 0x7f63a4148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 -- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f63a4146280 msgr2=0x7f63a4148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f63a4146280 0x7f63a4148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 -- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a40a1740 msgr2=0x7f63a4145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a40a1740 0x7f63a4145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 -- 172.21.15.89:0/1225279725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a409fe00 con 0x7f6388004e70 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.604+0000 7f63a2d9d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f639800a000 tx=0x7f6398008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:08.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398015660 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63980157c0 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a4145ad0 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398015b20 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a40a0480 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f6398025070 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.605+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f639801ea00 con 0x7f6388004e70 2024-02-09T23:58:08.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.606+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40a2460 con 0x7f6388004e70 2024-02-09T23:58:08.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.610+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f639803c870 con 0x7f6388004e70 2024-02-09T23:58:08.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.677+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f63a4067350 con 0x7f6388004e70 2024-02-09T23:58:08.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.687+0000 7f6393fff700 1 -- 172.21.15.89:0/1225279725 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f639802c090 con 0x7f6388004e70 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 msgr2=0x7f63a40921c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f639800a000 tx=0x7f6398008040).stop 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 shutdown_connections 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f63a4146280 0x7f63a4148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6388004e70 0x7f63a40921c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 --2- 172.21.15.89:0/1225279725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a40a1740 0x7f63a4145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 >> 172.21.15.89:0/1225279725 conn(0x7f63a40a89d0 msgr2=0x7f63a40a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 shutdown_connections 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:08.688+0000 7f63a910d700 1 -- 172.21.15.89:0/1225279725 wait complete. 2024-02-09T23:58:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-02-09T23:58:08.701 INFO:tasks.ceph:check_enable_crimson: False 2024-02-09T23:58:08.701 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-09T23:58:08.702 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:08.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-09T23:58:08.729 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:08.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-09T23:58:08.795 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:08.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-09T23:58:08.862 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-09T23:58:08.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-09T23:58:08.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 54a6058f-90fd-4813-858e-89b0ab58a45e 0 2024-02-09T23:58:09.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 Processor -- start 2024-02-09T23:58:09.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 -- start start 2024-02-09T23:58:09.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72e41398c0 0x7f72e4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e405b970 0x7f72e405d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40a7260 con 0x7f72e40a8d30 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40a37e0 con 0x7f72e41398c0 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.070+0000 7f72ec655700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e405ca20 con 0x7f72e405b970 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72e41398c0 0x7f72e4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72eabf2700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f72e40a8d30 0x7f72e40a91e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43838/0 (socket says 172.21.15.89:43838) 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72eabf2700 1 -- 172.21.15.89:0/235275330 learned_addr learned my addr 172.21.15.89:0/235275330 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72e9bf0700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e405b970 0x7f72e405d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 -- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e405b970 msgr2=0x7f72e405d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e405b970 0x7f72e405d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 -- 172.21.15.89:0/235275330 >> v1:172.21.15.89:6789/0 conn(0x7f72e40a8d30 legacy=0x7f72e40a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 -- 172.21.15.89:0/235275330 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e405cc80 con 0x7f72e41398c0 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72ea3f1700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e41398c0 0x7f72e4139ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f72d40032f0 tx=0x7f72d40091d0).ready entity=mon.0 client_cookie=fa48abeb88ff0770 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72e93ef700 1 -- 172.21.15.89:0/235275330 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d4009ea0 con 0x7f72e41398c0 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72e93ef700 1 -- 172.21.15.89:0/235275330 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400b8a0 con 0x7f72e41398c0 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.071+0000 7f72e93ef700 1 -- 172.21.15.89:0/235275330 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d400ba10 con 0x7f72e41398c0 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 -- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e41398c0 msgr2=0x7f72e4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e41398c0 0x7f72e4139ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f72d40032f0 tx=0x7f72d40091d0).stop 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 -- 172.21.15.89:0/235275330 shutdown_connections 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e41398c0 0x7f72e4139ca0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 --2- 172.21.15.89:0/235275330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e405b970 0x7f72e405d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 -- 172.21.15.89:0/235275330 >> 172.21.15.89:0/235275330 conn(0x7f72e4066ae0 msgr2=0x7f72e406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 -- 172.21.15.89:0/235275330 shutdown_connections 2024-02-09T23:58:09.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.072+0000 7f72ec655700 1 -- 172.21.15.89:0/235275330 wait complete. 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.073+0000 7f72ec655700 1 Processor -- start 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.073+0000 7f72ec655700 1 -- start start 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 0x7f72e4114a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e41398c0 0x7f72e4131300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40a62a0 con 0x7f72e405b970 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41151d0 con 0x7f72e41398c0 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.074+0000 7f72ec655700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41142a0 con 0x7f72e40a8d30 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72ea3f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 0x7f72e4114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40214/0 (socket says 172.21.15.89:40214) 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 -- 172.21.15.89:0/1613117037 learned_addr learned my addr 172.21.15.89:0/1613117037 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72eabf2700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e41398c0 0x7f72e4131300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 -- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e41398c0 msgr2=0x7f72e4131300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e41398c0 0x7f72e4131300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 -- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 msgr2=0x7f72e4114a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 0x7f72e4114a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 -- 172.21.15.89:0/1613117037 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009470 con 0x7f72e40a8d30 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72ea3f1700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 0x7f72e4114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e9bf0700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f72d80030b0 tx=0x7f72d8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8011780 con 0x7f72e40a8d30 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d80118e0 con 0x7f72e40a8d30 2024-02-09T23:58:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e4114f70 con 0x7f72e40a8d30 2024-02-09T23:58:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8011c40 con 0x7f72e40a8d30 2024-02-09T23:58:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.075+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e40a6710 con 0x7f72e40a8d30 2024-02-09T23:58:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.076+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f72d8006020 con 0x7f72e40a8d30 2024-02-09T23:58:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.076+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f72d8005a40 con 0x7f72e40a8d30 2024-02-09T23:58:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.076+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e40a6410 con 0x7f72e40a8d30 2024-02-09T23:58:09.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.080+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f72d8005c50 con 0x7f72e40a8d30 2024-02-09T23:58:09.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.155+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd new", "uuid": "54a6058f-90fd-4813-858e-89b0ab58a45e", "id": 0} v 0) v1 -- 0x7f72e41323f0 con 0x7f72e40a8d30 2024-02-09T23:58:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.164+0000 7f72e37fe700 1 -- 172.21.15.89:0/1613117037 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54a6058f-90fd-4813-858e-89b0ab58a45e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72d802b0b0 con 0x7f72e40a8d30 2024-02-09T23:58:09.166 INFO:teuthology.orchestra.run.smithi089.stdout:0 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 msgr2=0x7f72e4130e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f72d80030b0 tx=0x7f72d8008040).stop 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 shutdown_connections 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72e41398c0 0x7f72e4131300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e405b970 0x7f72e4114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 --2- 172.21.15.89:0/1613117037 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f72e40a8d30 0x7f72e4130e10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 >> 172.21.15.89:0/1613117037 conn(0x7f72e4066ae0 msgr2=0x7f72e4135470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 shutdown_connections 2024-02-09T23:58:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.165+0000 7f72ec655700 1 -- 172.21.15.89:0/1613117037 wait complete. 2024-02-09T23:58:09.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 50a61229-5b79-4b67-bbef-f5070a3c0e79 1 2024-02-09T23:58:09.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 Processor -- start 2024-02-09T23:58:09.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 -- start start 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf413d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf4132df0 con 0x7fabf4133240 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4133d30 con 0x7fabf40646b0 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.278+0000 7fabf8d98700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40639f0 con 0x7fabf4136d80 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf1d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf413d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf1d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58904/0 (socket says 172.21.15.89:58904) 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf1d9b700 1 -- 172.21.15.89:0/3171843465 learned_addr learned my addr 172.21.15.89:0/3171843465 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf259c700 1 --1- 172.21.15.89:0/3171843465 >> v1:172.21.15.89:6789/0 conn(0x7fabf4133240 0x7fabf4133620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43852/0 (socket says 172.21.15.89:43852) 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 -- 172.21.15.89:0/3171843465 >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 msgr2=0x7fabf4136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 --2- 172.21.15.89:0/3171843465 >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 -- 172.21.15.89:0/3171843465 >> v1:172.21.15.89:6789/0 conn(0x7fabf4133240 legacy=0x7fabf4133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 -- 172.21.15.89:0/3171843465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4133020 con 0x7fabf4136d80 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf1d9b700 1 --2- 172.21.15.89:0/3171843465 >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf2d9d700 1 --2- 172.21.15.89:0/3171843465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf413d610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fabec0032f0 tx=0x7fabec00b470).ready entity=mon.1 client_cookie=511a36555b62cf01 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf159a700 1 -- 172.21.15.89:0/3171843465 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabec00dd70 con 0x7fabf4136d80 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf159a700 1 -- 172.21.15.89:0/3171843465 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec010470 con 0x7fabf4136d80 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.279+0000 7fabf159a700 1 -- 172.21.15.89:0/3171843465 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabec0107d0 con 0x7fabf4136d80 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 -- 172.21.15.89:0/3171843465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 msgr2=0x7fabf413d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 --2- 172.21.15.89:0/3171843465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf413d610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fabec0032f0 tx=0x7fabec00b470).stop 2024-02-09T23:58:09.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 -- 172.21.15.89:0/3171843465 shutdown_connections 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 --2- 172.21.15.89:0/3171843465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf413d610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 --2- 172.21.15.89:0/3171843465 >> v2:172.21.15.89:3300/0 conn(0x7fabf40646b0 0x7fabf4136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 -- 172.21.15.89:0/3171843465 >> 172.21.15.89:0/3171843465 conn(0x7fabf405cf10 msgr2=0x7fabf405d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 -- 172.21.15.89:0/3171843465 shutdown_connections 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.280+0000 7fabf8d98700 1 -- 172.21.15.89:0/3171843465 wait complete. 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.281+0000 7fabf8d98700 1 Processor -- start 2024-02-09T23:58:09.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.281+0000 7fabf8d98700 1 -- start start 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.281+0000 7fabf8d98700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 0x7fabf4065700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.281+0000 7fabf8d98700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.281+0000 7fabf8d98700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf8d98700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4067ee0 con 0x7fabf4133240 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf8d98700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40a8d70 con 0x7fabf4136d80 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf8d98700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4135bb0 con 0x7fabf40646b0 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf1d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf1d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58918/0 (socket says 172.21.15.89:58918) 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47870/0 (socket says 172.21.15.89:47870) 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf1d9b700 1 -- 172.21.15.89:0/1648155860 learned_addr learned my addr 172.21.15.89:0/1648155860 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf259c700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 0x7fabf4065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 -- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 msgr2=0x7fabf4065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 0x7fabf4065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 -- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 msgr2=0x7fabf4134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 -- 172.21.15.89:0/1648155860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe800b1e0 con 0x7fabf4136d80 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf259c700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 0x7fabf4065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf1d9b700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf2d9d700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fabf4136190 tx=0x7fabec00b470).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabec00dee0 con 0x7fabf4136d80 2024-02-09T23:58:09.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec018610 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec00b710 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabec018970 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf4066190 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fabec021070 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.282+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fabec0237c0 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.283+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf4132bd0 con 0x7fabf4136d80 2024-02-09T23:58:09.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.285+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fabec028020 con 0x7fabf4136d80 2024-02-09T23:58:09.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.361+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "50a61229-5b79-4b67-bbef-f5070a3c0e79", "id": 1} v 0) v1 -- 0x7fabf41362d0 con 0x7fabf4136d80 2024-02-09T23:58:09.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.369+0000 7fabe37fe700 1 -- 172.21.15.89:0/1648155860 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50a61229-5b79-4b67-bbef-f5070a3c0e79", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabec014070 con 0x7fabf4136d80 2024-02-09T23:58:09.371 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 msgr2=0x7fabf4144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fabf4136190 tx=0x7fabec00b470).stop 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 shutdown_connections 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabf4136d80 0x7fabf4144930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabf40646b0 0x7fabf4065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 --2- 172.21.15.89:0/1648155860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf4133240 0x7fabf4134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 >> 172.21.15.89:0/1648155860 conn(0x7fabf405cf10 msgr2=0x7fabf4130050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 shutdown_connections 2024-02-09T23:58:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.370+0000 7fabf8d98700 1 -- 172.21.15.89:0/1648155860 wait complete. 2024-02-09T23:58:09.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 53f5509d-daa0-4134-b559-84fe4a2ad3cd 2 2024-02-09T23:58:09.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.485+0000 7f69c0d87700 1 Processor -- start 2024-02-09T23:58:09.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.485+0000 7f69c0d87700 1 -- start start 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69c0d87700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 0x7f69bc1334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69c0d87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 0x7f69bc140b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69c0d87700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc0aad80 con 0x7f69bc1330f0 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69c0d87700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc0610e0 con 0x7f69bc060ca0 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69c0d87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0aab60 con 0x7f69bc13e770 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 0x7f69bc140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69b9d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 0x7f69bc1334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69ba59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f69bc1330f0 0x7f69bc0aa450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43858/0 (socket says 172.21.15.89:43858) 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69ba59c700 1 -- 172.21.15.89:0/929149859 learned_addr learned my addr 172.21.15.89:0/929149859 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 -- 172.21.15.89:0/929149859 >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 msgr2=0x7f69bc1334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 --2- 172.21.15.89:0/929149859 >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 0x7f69bc1334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 -- 172.21.15.89:0/929149859 >> v1:172.21.15.89:6789/0 conn(0x7f69bc1330f0 legacy=0x7f69bc0aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 -- 172.21.15.89:0/929149859 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc0ab020 con 0x7f69bc13e770 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69b9d9b700 1 --2- 172.21.15.89:0/929149859 >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 0x7f69bc1334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.486+0000 7f69bad9d700 1 --2- 172.21.15.89:0/929149859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 0x7f69bc140b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f69b40032f0 tx=0x7f69b40091d0).ready entity=mon.1 client_cookie=bad8d040f54042a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69b959a700 1 -- 172.21.15.89:0/929149859 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b400b6c0 con 0x7f69bc13e770 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69b959a700 1 -- 172.21.15.89:0/929149859 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b400b820 con 0x7f69bc13e770 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69b959a700 1 -- 172.21.15.89:0/929149859 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b400b990 con 0x7f69bc13e770 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 -- 172.21.15.89:0/929149859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 msgr2=0x7f69bc140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 --2- 172.21.15.89:0/929149859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 0x7f69bc140b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f69b40032f0 tx=0x7f69b40091d0).stop 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 -- 172.21.15.89:0/929149859 shutdown_connections 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 --2- 172.21.15.89:0/929149859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc13e770 0x7f69bc140b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 --2- 172.21.15.89:0/929149859 >> v2:172.21.15.89:3300/0 conn(0x7f69bc060ca0 0x7f69bc1334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 -- 172.21.15.89:0/929149859 >> 172.21.15.89:0/929149859 conn(0x7f69bc05c190 msgr2=0x7f69bc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 -- 172.21.15.89:0/929149859 shutdown_connections 2024-02-09T23:58:09.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.487+0000 7f69c0d87700 1 -- 172.21.15.89:0/929149859 wait complete. 2024-02-09T23:58:09.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.488+0000 7f69c0d87700 1 Processor -- start 2024-02-09T23:58:09.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.488+0000 7f69c0d87700 1 -- start start 2024-02-09T23:58:09.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 0x7f69bc13be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 0x7f69bc12da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc13d630 con 0x7f69bc1330f0 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc13d080 con 0x7f69bc060ca0 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69c0d87700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc136510 con 0x7f69bc13e770 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69ba59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69ba59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47898/0 (socket says 172.21.15.89:47898) 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69ba59c700 1 -- 172.21.15.89:0/522020777 learned_addr learned my addr 172.21.15.89:0/522020777 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69bad9d700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 0x7f69bc12da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69b9d9b700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 0x7f69bc13be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69ba59c700 1 -- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 msgr2=0x7f69bc12da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.489+0000 7f69ba59c700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 0x7f69bc12da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ba59c700 1 -- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 msgr2=0x7f69bc13be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ba59c700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 0x7f69bc13be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ba59c700 1 -- 172.21.15.89:0/522020777 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b000b180 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69bad9d700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 0x7f69bc12da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69b9d9b700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 0x7f69bc13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ba59c700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f69bc05dc90 tx=0x7f69ac007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac0070d0 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac007230 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4009470 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac005610 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.490+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc13b630 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.491+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f69ac010070 con 0x7f69bc060ca0 2024-02-09T23:58:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.491+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f69ac005940 con 0x7f69bc060ca0 2024-02-09T23:58:09.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.491+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc057a60 con 0x7f69bc060ca0 2024-02-09T23:58:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.496+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f69ac018020 con 0x7f69bc060ca0 2024-02-09T23:58:09.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.575+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53f5509d-daa0-4134-b559-84fe4a2ad3cd", "id": 2} v 0) v1 -- 0x7f69bc136790 con 0x7f69bc060ca0 2024-02-09T23:58:09.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.582+0000 7f69ab7fe700 1 -- 172.21.15.89:0/522020777 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53f5509d-daa0-4134-b559-84fe4a2ad3cd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f69ac013450 con 0x7f69bc060ca0 2024-02-09T23:58:09.585 INFO:teuthology.orchestra.run.smithi089.stdout:2 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 msgr2=0x7f69bc1378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f69bc05dc90 tx=0x7f69ac007c40).stop 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 shutdown_connections 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69bc13e770 0x7f69bc12da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69bc060ca0 0x7f69bc1378b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 --2- 172.21.15.89:0/522020777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69bc1330f0 0x7f69bc13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 >> 172.21.15.89:0/522020777 conn(0x7f69bc05c190 msgr2=0x7f69bc13dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 shutdown_connections 2024-02-09T23:58:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.583+0000 7f69c0d87700 1 -- 172.21.15.89:0/522020777 wait complete. 2024-02-09T23:58:09.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 5bfa695e-8e0f-4f1e-b65c-219837f522fe 3 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.698+0000 7fed0f69d700 1 Processor -- start 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.698+0000 7fed0f69d700 1 -- start start 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0f69d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08136a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0f69d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed080a2d10 0x7fed080a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0f69d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed080a1990 con 0x7fed0809c510 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0f69d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080a2660 con 0x7fed080a2d10 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0f69d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed080a1330 con 0x7fed08136660 2024-02-09T23:58:09.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0dc3a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fed0809c510 0x7fed080a38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43874/0 (socket says 172.21.15.89:43874) 2024-02-09T23:58:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0dc3a700 1 -- 172.21.15.89:0/1058263231 learned_addr learned my addr 172.21.15.89:0/1058263231 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0d439700 1 --2- 172.21.15.89:0/1058263231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.699+0000 7fed0cc38700 1 --2- 172.21.15.89:0/1058263231 >> v2:172.21.15.89:3300/0 conn(0x7fed080a2d10 0x7fed080a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fecf7fff700 1 -- 172.21.15.89:0/1058263231 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198416367 0 0) 0x7fed080a1990 con 0x7fed0809c510 2024-02-09T23:58:09.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fecf7fff700 1 -- 172.21.15.89:0/1058263231 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf0003260 con 0x7fed0809c510 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0d439700 1 -- 172.21.15.89:0/1058263231 >> v2:172.21.15.89:3300/0 conn(0x7fed080a2d10 msgr2=0x7fed080a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0d439700 1 --2- 172.21.15.89:0/1058263231 >> v2:172.21.15.89:3300/0 conn(0x7fed080a2d10 0x7fed080a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0d439700 1 -- 172.21.15.89:0/1058263231 >> v1:172.21.15.89:6789/0 conn(0x7fed0809c510 legacy=0x7fed080a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0d439700 1 -- 172.21.15.89:0/1058263231 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0805e330 con 0x7fed08136660 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0d439700 1 --2- 172.21.15.89:0/1058263231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08136a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fed00001490 tx=0x7fed04006df0).ready entity=mon.1 client_cookie=41738e3d0d319e5e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fecf7fff700 1 -- 172.21.15.89:0/1058263231 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed0400d4a0 con 0x7fed08136660 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fecf7fff700 1 -- 172.21.15.89:0/1058263231 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04000e90 con 0x7fed08136660 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fecf7fff700 1 -- 172.21.15.89:0/1058263231 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed0400d7f0 con 0x7fed08136660 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0f69d700 1 -- 172.21.15.89:0/1058263231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 msgr2=0x7fed08136a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.700+0000 7fed0f69d700 1 --2- 172.21.15.89:0/1058263231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08136a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fed00001490 tx=0x7fed04006df0).stop 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 -- 172.21.15.89:0/1058263231 shutdown_connections 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 --2- 172.21.15.89:0/1058263231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08136a40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 --2- 172.21.15.89:0/1058263231 >> v2:172.21.15.89:3300/0 conn(0x7fed080a2d10 0x7fed080a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 -- 172.21.15.89:0/1058263231 >> 172.21.15.89:0/1058263231 conn(0x7fed080a89d0 msgr2=0x7fed080a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 -- 172.21.15.89:0/1058263231 shutdown_connections 2024-02-09T23:58:09.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.701+0000 7fed0f69d700 1 -- 172.21.15.89:0/1058263231 wait complete. 2024-02-09T23:58:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 Processor -- start 2024-02-09T23:58:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 -- start start 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0809c510 0x7fed08063c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0809f5a0 con 0x7fed0809c510 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed08062c50 con 0x7fed08136660 2024-02-09T23:58:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0f69d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed08063740 con 0x7fed080a2d10 2024-02-09T23:58:09.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0cc38700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0cc38700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40232/0 (socket says 172.21.15.89:40232) 2024-02-09T23:58:09.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0cc38700 1 -- 172.21.15.89:0/725150727 learned_addr learned my addr 172.21.15.89:0/725150727 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0dc3a700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.702+0000 7fed0d439700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0809c510 0x7fed08063c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 -- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 msgr2=0x7fed08144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 -- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0809c510 msgr2=0x7fed08063c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0809c510 0x7fed08063c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 -- 172.21.15.89:0/725150727 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0400b180 con 0x7fed080a2d10 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0cc38700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fecf800e000 tx=0x7fecf8006e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf800bb60 con 0x7fed080a2d10 2024-02-09T23:58:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf800bcc0 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0809d990 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf8010630 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed08063460 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fecf8010790 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.703+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fecf8010e30 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.704+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed08061bf0 con 0x7fed080a2d10 2024-02-09T23:58:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.706+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fecf8010a20 con 0x7fed080a2d10 2024-02-09T23:58:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.781+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd new", "uuid": "5bfa695e-8e0f-4f1e-b65c-219837f522fe", "id": 3} v 0) v1 -- 0x7fed08057a60 con 0x7fed080a2d10 2024-02-09T23:58:09.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.784+0000 7fecf67fc700 1 -- 172.21.15.89:0/725150727 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bfa695e-8e0f-4f1e-b65c-219837f522fe", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fecf8018400 con 0x7fed080a2d10 2024-02-09T23:58:09.788 INFO:teuthology.orchestra.run.smithi089.stdout:3 2024-02-09T23:58:09.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.785+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 msgr2=0x7fed08144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.785+0000 7fed0f69d700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fecf800e000 tx=0x7fecf8006e80).stop 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 shutdown_connections 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed08136660 0x7fed08144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0809c510 0x7fed08063c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 --2- 172.21.15.89:0/725150727 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed080a2d10 0x7fed08144aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 >> 172.21.15.89:0/725150727 conn(0x7fed080a89d0 msgr2=0x7fed080a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 shutdown_connections 2024-02-09T23:58:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.786+0000 7fed0f69d700 1 -- 172.21.15.89:0/725150727 wait complete. 2024-02-09T23:58:09.798 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-09T23:58:09.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-09T23:58:09.801 INFO:tasks.ceph.osd.0:Started 2024-02-09T23:58:09.802 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-09T23:58:09.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-09T23:58:09.805 INFO:tasks.ceph.osd.1:Started 2024-02-09T23:58:09.805 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-09T23:58:09.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-09T23:58:09.809 INFO:tasks.ceph.osd.2:Started 2024-02-09T23:58:09.809 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-09T23:58:09.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-09T23:58:09.811 INFO:tasks.ceph.osd.3:Started 2024-02-09T23:58:09.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:09.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.978+0000 7faa0ca66700 1 Processor -- start 2024-02-09T23:58:09.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.978+0000 7faa0ca66700 1 -- start start 2024-02-09T23:58:09.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0ca66700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0ca66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 0x7faa081409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0ca66700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080603c0 con 0x7faa08132df0 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0ca66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa080aa230 con 0x7faa0813e600 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0ca66700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa080aa4d0 con 0x7faa080aae90 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa05d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa05d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40288/0 (socket says 172.21.15.89:40288) 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 0x7faa081409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa05d9b700 1 -- 172.21.15.89:0/2884007461 learned_addr learned my addr 172.21.15.89:0/2884007461 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 -- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 msgr2=0x7faa081331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 -- 172.21.15.89:0/2884007461 >> v1:172.21.15.89:6789/0 conn(0x7faa08132df0 legacy=0x7faa08060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 -- 172.21.15.89:0/2884007461 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080aa790 con 0x7faa0813e600 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa05d9b700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa06d9d700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 0x7faa081409f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faa000032f0 tx=0x7faa000091d0).ready entity=mon.1 client_cookie=57f8a7082b5b02cb server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0559a700 1 -- 172.21.15.89:0/2884007461 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0000b6c0 con 0x7faa0813e600 2024-02-09T23:58:09.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0559a700 1 -- 172.21.15.89:0/2884007461 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0000b820 con 0x7faa0813e600 2024-02-09T23:58:09.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.979+0000 7faa0559a700 1 -- 172.21.15.89:0/2884007461 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0000b990 con 0x7faa0813e600 2024-02-09T23:58:09.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 -- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 msgr2=0x7faa081409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 0x7faa081409f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faa000032f0 tx=0x7faa000091d0).stop 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 -- 172.21.15.89:0/2884007461 shutdown_connections 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa0813e600 0x7faa081409f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 --2- 172.21.15.89:0/2884007461 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa080aae90 0x7faa081331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 -- 172.21.15.89:0/2884007461 >> 172.21.15.89:0/2884007461 conn(0x7faa0805c300 msgr2=0x7faa0806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 -- 172.21.15.89:0/2884007461 shutdown_connections 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.980+0000 7faa0ca66700 1 -- 172.21.15.89:0/2884007461 wait complete. 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.981+0000 7faa0ca66700 1 Processor -- start 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.981+0000 7faa0ca66700 1 -- start start 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 0x7faa0813a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 0x7faa081363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 0x7faa0814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa081368d0 con 0x7faa080aae90 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0813ae20 con 0x7faa08132df0 2024-02-09T23:58:09.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa080a6670 con 0x7faa0813e600 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0659c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 0x7faa0813a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 0x7faa0814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0659c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 0x7faa0813a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58994/0 (socket says 172.21.15.89:58994) 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0659c700 1 -- 172.21.15.89:0/1745076899 learned_addr learned my addr 172.21.15.89:0/1745076899 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa05d9b700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 0x7faa081363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 -- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 msgr2=0x7faa081363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 0x7faa081363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 -- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 msgr2=0x7faa0813a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 0x7faa0813a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 -- 172.21.15.89:0/1745076899 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc00b1e0 con 0x7faa0813e600 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa06d9d700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 0x7faa0814cc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faa000032f0 tx=0x7faa00016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa05d9b700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 0x7faa081363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0000b6c0 con 0x7faa0813e600 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0000b030 con 0x7faa0813e600 2024-02-09T23:58:09.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa000207d0 con 0x7faa0813e600 2024-02-09T23:58:09.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.982+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa00009470 con 0x7faa0813e600 2024-02-09T23:58:09.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.983+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa081328b0 con 0x7faa0813e600 2024-02-09T23:58:09.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.983+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7faa0001e070 con 0x7faa0813e600 2024-02-09T23:58:09.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.983+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7faa00020b00 con 0x7faa0813e600 2024-02-09T23:58:09.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.984+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0813cf40 con 0x7faa0813e600 2024-02-09T23:58:09.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:09.986+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7faa0003f870 con 0x7faa0813e600 2024-02-09T23:58:10.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.048+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa0805fd70 con 0x7faa0813e600 2024-02-09T23:58:10.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.049+0000 7fa9f77fe700 1 -- 172.21.15.89:0/1745076899 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7faa0002f030 con 0x7faa0813e600 2024-02-09T23:58:10.051 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:10.051 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:09.783212+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:10.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 msgr2=0x7faa0814cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 0x7faa0814cc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faa000032f0 tx=0x7faa00016000).stop 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 shutdown_connections 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faa0813e600 0x7faa0814cc70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa080aae90 0x7faa0813a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 --2- 172.21.15.89:0/1745076899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa08132df0 0x7faa081363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 >> 172.21.15.89:0/1745076899 conn(0x7faa0805c300 msgr2=0x7faa08138dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 shutdown_connections 2024-02-09T23:58:10.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:10.050+0000 7faa0ca66700 1 -- 172.21.15.89:0/1745076899 wait complete. 2024-02-09T23:58:10.062 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-09T23:58:10.063 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-09T23:58:10.183 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-09T23:58:10.180+0000 7f98e1881f00 -1 Falling back to public interface 2024-02-09T23:58:10.423 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-09T23:58:10.421+0000 7f3c6a39af00 -1 Falling back to public interface 2024-02-09T23:58:10.428 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-09T23:58:10.426+0000 7f1514fb0f00 -1 Falling back to public interface 2024-02-09T23:58:10.437 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-09T23:58:10.435+0000 7f382b5acf00 -1 Falling back to public interface 2024-02-09T23:58:10.465 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:10.575 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.573+0000 7f9319c22700 1 Processor -- start 2024-02-09T23:58:10.575 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.573+0000 7f9319c22700 1 -- start start 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9319c22700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9319c22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f931405c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9319c22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93141375d0 con 0x7f9314137bd0 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9319c22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931409d340 con 0x7f9314138010 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9319c22700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93140a3a10 con 0x7f93141377f0 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40314/0 (socket says 172.21.15.89:40314) 2024-02-09T23:58:10.577 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 -- 172.21.15.89:0/2242736386 learned_addr learned my addr 172.21.15.89:0/2242736386 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f9313fff700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f931405c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 -- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 msgr2=0x7f931405c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f931405c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 -- 172.21.15.89:0/2242736386 >> v1:172.21.15.89:6789/0 conn(0x7f9314137bd0 legacy=0x7f931405b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.574+0000 7f93137fe700 1 -- 172.21.15.89:0/2242736386 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931409c6b0 con 0x7f93141377f0 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f9313fff700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f931405c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f93137fe700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9304002f70 tx=0x7f9304006eb0).ready entity=mon.2 client_cookie=99b6804952691af6 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f93127fc700 1 -- 172.21.15.89:0/2242736386 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93040095b0 con 0x7f93141377f0 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f93127fc700 1 -- 172.21.15.89:0/2242736386 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304000e90 con 0x7f93141377f0 2024-02-09T23:58:10.578 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f93127fc700 1 -- 172.21.15.89:0/2242736386 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9304009940 con 0x7f93141377f0 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f9319c22700 1 -- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 msgr2=0x7f931409cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.575+0000 7f9319c22700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9304002f70 tx=0x7f9304006eb0).stop 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 -- 172.21.15.89:0/2242736386 shutdown_connections 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f931405c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 --2- 172.21.15.89:0/2242736386 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93141377f0 0x7f931409cb80 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0x7f9304002f70 tx=0x7f9304006eb0).stop 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 -- 172.21.15.89:0/2242736386 >> 172.21.15.89:0/2242736386 conn(0x7f93140a8960 msgr2=0x7f93140a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:10.579 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 -- 172.21.15.89:0/2242736386 shutdown_connections 2024-02-09T23:58:10.580 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.576+0000 7f9319c22700 1 -- 172.21.15.89:0/2242736386 wait complete. 2024-02-09T23:58:10.580 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.578+0000 7f9319c22700 1 Processor -- start 2024-02-09T23:58:10.580 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.578+0000 7f9319c22700 1 -- start start 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9314137bd0 0x7f9314065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f9314144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314067720 con 0x7f9314137bd0 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9314066610 con 0x7f9314138010 2024-02-09T23:58:10.581 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9314063860 con 0x7f9314066130 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40332/0 (socket says 172.21.15.89:40332) 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 -- 172.21.15.89:0/591070056 learned_addr learned my addr 172.21.15.89:0/591070056 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9312ffd700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f9314144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 -- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 msgr2=0x7f9314144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f9314144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 -- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9314137bd0 msgr2=0x7f9314065c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9314137bd0 0x7f9314065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 -- 172.21.15.89:0/591070056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930400b1e0 con 0x7f9314066130 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9313fff700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f930c00a000 tx=0x7f930c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:10.582 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f930c014070 con 0x7f9314066130 2024-02-09T23:58:10.583 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00f210 con 0x7f9314066130 2024-02-09T23:58:10.583 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314136270 con 0x7f9314066130 2024-02-09T23:58:10.583 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f930c009ac0 con 0x7f9314066130 2024-02-09T23:58:10.583 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.579+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931409bdd0 con 0x7f9314066130 2024-02-09T23:58:10.584 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.581+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 2) v1 ==== 20942+0+0 (secure 0 0 0) 0x7f930c009c20 con 0x7f9314066130 2024-02-09T23:58:10.584 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.581+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f930c02df60 con 0x7f9314066130 2024-02-09T23:58:10.584 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.581+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931409d070 con 0x7f9314066130 2024-02-09T23:58:10.587 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.585+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f930c01fca0 con 0x7f9314066130 2024-02-09T23:58:10.690 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.688+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9314057a60 con 0x7f9314066130 2024-02-09T23:58:10.691 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.689+0000 7f9310ff9700 1 -- 172.21.15.89:0/591070056 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7f930c01fac0 con 0x7f9314066130 2024-02-09T23:58:10.691 INFO:teuthology.misc.health.smithi089.stdout: 2024-02-09T23:58:10.692 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":6,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:09.783212+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.689+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 msgr2=0x7f9314144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.689+0000 7f9319c22700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f930c00a000 tx=0x7f930c008040).stop 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 shutdown_connections 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9314066130 0x7f9314144fd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9314137bd0 0x7f9314065c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 --2- 172.21.15.89:0/591070056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9314138010 0x7f9314144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 >> 172.21.15.89:0/591070056 conn(0x7f93140a8960 msgr2=0x7f931405c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 shutdown_connections 2024-02-09T23:58:10.693 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:10.690+0000 7f9319c22700 1 -- 172.21.15.89:0/591070056 wait complete. 2024-02-09T23:58:10.702 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-09T23:58:11.276 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-09T23:58:11.274+0000 7f98e1881f00 -1 osd.2 0 log_to_monitors {default=true} 2024-02-09T23:58:11.489 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-09T23:58:11.487+0000 7f3c6a39af00 -1 osd.3 0 log_to_monitors {default=true} 2024-02-09T23:58:11.519 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-09T23:58:11.517+0000 7f1514fb0f00 -1 osd.0 0 log_to_monitors {default=true} 2024-02-09T23:58:11.521 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-09T23:58:11.519+0000 7f382b5acf00 -1 osd.1 0 log_to_monitors {default=true} 2024-02-09T23:58:12.563 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-09T23:58:12.560+0000 7f3c52865700 -1 osd.3 0 waiting for initial osdmap 2024-02-09T23:58:12.566 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-09T23:58:12.564+0000 7f98c9d4c700 -1 osd.2 0 waiting for initial osdmap 2024-02-09T23:58:12.567 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-09T23:58:12.561+0000 7f14fd47b700 -1 osd.0 0 waiting for initial osdmap 2024-02-09T23:58:12.570 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-09T23:58:12.568+0000 7f3813a77700 -1 osd.1 0 waiting for initial osdmap 2024-02-09T23:58:12.571 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-09T23:58:12.569+0000 7f1508e98700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T23:58:12.572 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-09T23:58:12.570+0000 7f98d5769700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T23:58:12.577 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-09T23:58:12.575+0000 7f3c5e282700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T23:58:12.577 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-09T23:58:12.575+0000 7f381f494700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T23:58:17.106 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:17.211 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.209+0000 7f82005bc700 1 Processor -- start 2024-02-09T23:58:17.212 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.209+0000 7f82005bc700 1 -- start start 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f82005bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f81377f0 0x7f81f809cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f82005bc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81f8137bd0 0x7f81f805b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f82005bc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f81375d0 con 0x7f81f8138010 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f82005bc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f809d340 con 0x7f81f8137bd0 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f82005bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80a3a10 con 0x7f81f81377f0 2024-02-09T23:58:17.214 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f81fdb57700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81f8137bd0 0x7f81f805b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f81feb59700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f81f8138010 0x7f81f805be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49218/0 (socket says 172.21.15.89:49218) 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f81feb59700 1 -- 172.21.15.89:0/3240392202 learned_addr learned my addr 172.21.15.89:0/3240392202 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.210+0000 7f81fe358700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f81377f0 0x7f81f809cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fdb57700 1 -- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f81377f0 msgr2=0x7f81f809cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fdb57700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f81377f0 0x7f81f809cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fdb57700 1 -- 172.21.15.89:0/3240392202 >> v1:172.21.15.89:6789/0 conn(0x7f81f8138010 legacy=0x7f81f805be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fd356700 1 -- 172.21.15.89:0/3240392202 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351134943 0 0) 0x7f81f81375d0 con 0x7f81f8138010 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fdb57700 1 -- 172.21.15.89:0/3240392202 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f809c6b0 con 0x7f81f8137bd0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fdb57700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f805b9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f81f809cad0 tx=0x7f81f4006df0).ready entity=mon.0 client_cookie=45ca81174c9963d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fd356700 1 -- 172.21.15.89:0/3240392202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f400d570 con 0x7f81f8137bd0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fd356700 1 -- 172.21.15.89:0/3240392202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4000e90 con 0x7f81f8137bd0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f81fd356700 1 -- 172.21.15.89:0/3240392202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f400d8c0 con 0x7f81f8137bd0 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f82005bc700 1 -- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 msgr2=0x7f81f805b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.211+0000 7f82005bc700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f805b9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f81f809cad0 tx=0x7f81f4006df0).stop 2024-02-09T23:58:17.215 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 -- 172.21.15.89:0/3240392202 shutdown_connections 2024-02-09T23:58:17.216 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f81377f0 0x7f81f809cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.216 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 --2- 172.21.15.89:0/3240392202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f805b9a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.216 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 -- 172.21.15.89:0/3240392202 >> 172.21.15.89:0/3240392202 conn(0x7f81f80a8960 msgr2=0x7f81f80a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:17.216 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 -- 172.21.15.89:0/3240392202 shutdown_connections 2024-02-09T23:58:17.216 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 -- 172.21.15.89:0/3240392202 wait complete. 2024-02-09T23:58:17.218 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 Processor -- start 2024-02-09T23:58:17.218 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.212+0000 7f82005bc700 1 -- start start 2024-02-09T23:58:17.218 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 0x7f81f8092ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.218 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f8135530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.218 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80947b0 con 0x7f81f8137bd0 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8094920 con 0x7f81f8138010 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f82005bc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8093d80 con 0x7f81f81377f0 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81fe358700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 0x7f81f8092ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36898/0 (socket says 172.21.15.89:36898) 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 -- 172.21.15.89:0/1210466153 learned_addr learned my addr 172.21.15.89:0/1210466153 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81fe358700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 0x7f81f8092ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52172/0 (socket says 172.21.15.89:52172) 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81fdb57700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f8135530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 -- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 msgr2=0x7f81f8092ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 0x7f81f8092ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 -- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 msgr2=0x7f81f8135530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.213+0000 7f81feb59700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f8135530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.219 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81feb59700 1 -- 172.21.15.89:0/1210466153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f400b180 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81fdb57700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f8135530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81feb59700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f81f0001250 tx=0x7f81f0001360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f0005ba0 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0005d00 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f80a1e40 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f0004a90 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.214+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8092fa0 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.215+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f81f0004bf0 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.215+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f81f0049f70 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.215+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f809d070 con 0x7f81f8138010 2024-02-09T23:58:17.220 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.218+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f81f002f320 con 0x7f81f8138010 2024-02-09T23:58:17.333 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.330+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f8057a60 con 0x7f81f8138010 2024-02-09T23:58:17.333 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.331+0000 7f81e77fe700 1 -- 172.21.15.89:0/1210466153 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6237 (secure 0 0 0) 0x7f81f0032940 con 0x7f81f8138010 2024-02-09T23:58:17.333 INFO:teuthology.misc.health.smithi089.stdout: 2024-02-09T23:58:17.333 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":11,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:15.572104+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:17.335 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 >> v1:172.21.15.89:6816/39389 conn(0x7f81d8038ec0 legacy=0x7f81d803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.335 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 msgr2=0x7f81f8135a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f81f0001250 tx=0x7f81f0001360).stop 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 shutdown_connections 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f8138010 0x7f81f8135a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81f81377f0 0x7f81f8092ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 --2- 172.21.15.89:0/1210466153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f8137bd0 0x7f81f8135530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 >> 172.21.15.89:0/1210466153 conn(0x7f81f80a8960 msgr2=0x7f81f805b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 shutdown_connections 2024-02-09T23:58:17.336 INFO:teuthology.misc.health.smithi089.stderr:2024-02-09T23:58:17.332+0000 7f82005bc700 1 -- 172.21.15.89:0/1210466153 wait complete. 2024-02-09T23:58:17.344 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-09T23:58:17.344 INFO:tasks.ceph:Creating RBD pool 2024-02-09T23:58:17.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-09T23:58:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.443+0000 7fed1ec52700 1 Processor -- start 2024-02-09T23:58:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.443+0000 7fed1ec52700 1 -- start start 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1ec52700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 0x7fed18067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1ec52700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed18139fa0 0x7fed1813a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1ec52700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180a4c50 con 0x7fed181337e0 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1ec52700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18133fe0 con 0x7fed18139fa0 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1ec52700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed180a4f10 con 0x7fed18133bc0 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed17fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 0x7fed18067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1c9ee700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fed181337e0 0x7fed18139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49222/0 (socket says 172.21.15.89:49222) 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1d1ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed18139fa0 0x7fed1813a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1c9ee700 1 -- 172.21.15.89:0/742257800 learned_addr learned my addr 172.21.15.89:0/742257800 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1d1ef700 1 -- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 msgr2=0x7fed18067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1d1ef700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 0x7fed18067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1d1ef700 1 -- 172.21.15.89:0/742257800 >> v1:172.21.15.89:6789/0 conn(0x7fed181337e0 legacy=0x7fed18139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed1d1ef700 1 -- 172.21.15.89:0/742257800 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18060520 con 0x7fed18139fa0 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.444+0000 7fed17fff700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 0x7fed18067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1d1ef700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18139fa0 0x7fed1813a400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fed0c001110 tx=0x7fed100091d0).ready entity=mon.0 client_cookie=39e8bcdf55edb5ce server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed177fe700 1 -- 172.21.15.89:0/742257800 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1000b580 con 0x7fed18139fa0 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed177fe700 1 -- 172.21.15.89:0/742257800 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000b6e0 con 0x7fed18139fa0 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed177fe700 1 -- 172.21.15.89:0/742257800 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1000b850 con 0x7fed18139fa0 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 -- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18139fa0 msgr2=0x7fed1813a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18139fa0 0x7fed1813a400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fed0c001110 tx=0x7fed100091d0).stop 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 -- 172.21.15.89:0/742257800 shutdown_connections 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18139fa0 0x7fed1813a400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 --2- 172.21.15.89:0/742257800 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18133bc0 0x7fed18067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 -- 172.21.15.89:0/742257800 >> 172.21.15.89:0/742257800 conn(0x7fed180a93f0 msgr2=0x7fed180a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:17.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 -- 172.21.15.89:0/742257800 shutdown_connections 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.445+0000 7fed1ec52700 1 -- 172.21.15.89:0/742257800 wait complete. 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.446+0000 7fed1ec52700 1 Processor -- start 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.446+0000 7fed1ec52700 1 -- start start 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 0x7fed181491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 0x7fed181496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180a1040 con 0x7fed181337e0 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180a1270 con 0x7fed18133bc0 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1ec52700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed180a1530 con 0x7fed18139fa0 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1c9ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 0x7fed181496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1c9ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34404/0 (socket says 172.21.15.89:34404) 2024-02-09T23:58:17.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1c9ee700 1 -- 172.21.15.89:0/3981350016 learned_addr learned my addr 172.21.15.89:0/3981350016 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed17fff700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 0x7fed181491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 -- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 msgr2=0x7fed181491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 0x7fed181491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 -- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 msgr2=0x7fed180929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 -- 172.21.15.89:0/3981350016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0400b180 con 0x7fed18139fa0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed17fff700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 0x7fed181491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1c9ee700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.447+0000 7fed1d1ef700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 0x7fed181496b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed0c001110 tx=0x7fed10016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1000b580 con 0x7fed18139fa0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10009470 con 0x7fed18139fa0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10011b40 con 0x7fed18139fa0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed10011ea0 con 0x7fed18139fa0 2024-02-09T23:58:17.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed180a1fd0 con 0x7fed18139fa0 2024-02-09T23:58:17.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.448+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fed1000f070 con 0x7fed18139fa0 2024-02-09T23:58:17.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.449+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18065a50 con 0x7fed18139fa0 2024-02-09T23:58:17.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.449+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7fed1004aa50 con 0x7fed18139fa0 2024-02-09T23:58:17.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.452+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fed100066a0 con 0x7fed18139fa0 2024-02-09T23:58:17.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.562+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fed18057a60 con 0x7fed18139fa0 2024-02-09T23:58:17.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.650+0000 7fed15ffb700 1 -- 172.21.15.89:0/3981350016 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (secure 0 0 0) 0x7fed1001f3f0 con 0x7fed18139fa0 2024-02-09T23:58:17.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.651+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 >> v1:172.21.15.89:6816/39389 conn(0x7fecf8038dd0 legacy=0x7fecf803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.651+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 msgr2=0x7fed181496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.651+0000 7fed1ec52700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 0x7fed181496b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed0c001110 tx=0x7fed10016000).stop 2024-02-09T23:58:17.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 shutdown_connections 2024-02-09T23:58:17.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fed18139fa0 0x7fed181496b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed181337e0 0x7fed180929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 --2- 172.21.15.89:0/3981350016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed18133bc0 0x7fed181491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 >> 172.21.15.89:0/3981350016 conn(0x7fed180a93f0 msgr2=0x7fed18139680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:17.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 shutdown_connections 2024-02-09T23:58:17.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.652+0000 7fed1ec52700 1 -- 172.21.15.89:0/3981350016 wait complete. 2024-02-09T23:58:17.655 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2024-02-09T23:58:17.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-09T23:58:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.765+0000 7fac8f6fb700 1 Processor -- start 2024-02-09T23:58:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.765+0000 7fac8f6fb700 1 -- start start 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8f6fb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8f6fb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 0x7fac88141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8f6fb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac880a6340 con 0x7fac88133b50 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8f6fb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac88133f90 con 0x7fac88139ff0 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8f6fb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac88066430 con 0x7fac88133770 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8dc98700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 0x7fac88141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52196/0 (socket says 172.21.15.89:52196) 2024-02-09T23:58:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8cc96700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fac88133b50 0x7fac881398e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49230/0 (socket says 172.21.15.89:49230) 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 -- 172.21.15.89:0/4279957100 learned_addr learned my addr 172.21.15.89:0/4279957100 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 -- 172.21.15.89:0/4279957100 >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 msgr2=0x7fac88141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 --2- 172.21.15.89:0/4279957100 >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 0x7fac88141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 -- 172.21.15.89:0/4279957100 >> v1:172.21.15.89:6789/0 conn(0x7fac88133b50 legacy=0x7fac881398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac77fff700 1 -- 172.21.15.89:0/4279957100 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276979988 0 0) 0x7fac880a6340 con 0x7fac88133b50 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8d497700 1 -- 172.21.15.89:0/4279957100 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88067610 con 0x7fac88133770 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.766+0000 7fac8dc98700 1 --2- 172.21.15.89:0/4279957100 >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 0x7fac88141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8d497700 1 --2- 172.21.15.89:0/4279957100 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fac78002f70 tx=0x7fac78006eb0).ready entity=mon.2 client_cookie=417c9094abff1232 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac77fff700 1 -- 172.21.15.89:0/4279957100 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7800d570 con 0x7fac88133770 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac77fff700 1 -- 172.21.15.89:0/4279957100 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac78000e90 con 0x7fac88133770 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac77fff700 1 -- 172.21.15.89:0/4279957100 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7800d8c0 con 0x7fac88133770 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4279957100 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 msgr2=0x7fac880a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4279957100 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fac78002f70 tx=0x7fac78006eb0).stop 2024-02-09T23:58:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4279957100 shutdown_connections 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4279957100 >> v2:172.21.15.89:3300/0 conn(0x7fac88139ff0 0x7fac88141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4279957100 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a4b80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4279957100 >> 172.21.15.89:0/4279957100 conn(0x7fac880a9450 msgr2=0x7fac880a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4279957100 shutdown_connections 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.767+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4279957100 wait complete. 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.768+0000 7fac8f6fb700 1 Processor -- start 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.768+0000 7fac8f6fb700 1 -- start start 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8809e060 con 0x7fac88139ff0 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880a15e0 con 0x7fac88133b50 2024-02-09T23:58:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac88146dc0 con 0x7fac88133770 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8dc98700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8d497700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36910/0 (socket says 172.21.15.89:36910) 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8dc98700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34426/0 (socket says 172.21.15.89:34426) 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 -- 172.21.15.89:0/4048701353 learned_addr learned my addr 172.21.15.89:0/4048701353 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 -- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 msgr2=0x7fac880a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 -- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 msgr2=0x7fac881468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 -- 172.21.15.89:0/4048701353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009470 con 0x7fac88133b50 2024-02-09T23:58:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8d497700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8dc98700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8cc96700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fac8809e1a0 tx=0x7fac84007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac840070d0 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84007230 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84005740 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.769+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7800b1e0 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.770+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac880a1280 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.770+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fac84010070 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.770+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2811+0+0 (secure 0 0 0) 0x7fac84049c30 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.771+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880678b0 con 0x7fac88133b50 2024-02-09T23:58:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.774+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fac8402ee90 con 0x7fac88133b50 2024-02-09T23:58:17.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:17.885+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fac88057a60 con 0x7fac88133b50 2024-02-09T23:58:18.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.652+0000 7fac767fc700 1 -- 172.21.15.89:0/4048701353 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (secure 0 0 0) 0x7fac840324b0 con 0x7fac88133b50 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 >> v1:172.21.15.89:6816/39389 conn(0x7fac68038ec0 legacy=0x7fac6803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 msgr2=0x7fac881463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fac8809e1a0 tx=0x7fac84007a30).stop 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 shutdown_connections 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac88139ff0 0x7fac881468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac88133770 0x7fac880a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 --2- 172.21.15.89:0/4048701353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac88133b50 0x7fac881463e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 >> 172.21.15.89:0/4048701353 conn(0x7fac880a9450 msgr2=0x7fac88132a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:18.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 shutdown_connections 2024-02-09T23:58:18.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.657+0000 7fac8f6fb700 1 -- 172.21.15.89:0/4048701353 wait complete. 2024-02-09T23:58:18.661 INFO:teuthology.orchestra.run.smithi089.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-09T23:58:18.672 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-09T23:58:18.673 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-09T23:58:18.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-09T23:58:18.675 INFO:tasks.ceph.mds.a:Started 2024-02-09T23:58:18.675 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-09T23:58:18.675 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-09T23:58:18.677 INFO:tasks.ceph.mds.b:Started 2024-02-09T23:58:18.677 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-09T23:58:18.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-09T23:58:18.679 INFO:tasks.ceph.mds.c:Started 2024-02-09T23:58:18.679 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-09T23:58:18.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:18.756 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2024-02-09T23:58:18.759 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2024-02-09T23:58:18.760 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-02-09T23:58:18.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.794+0000 7f284854e700 1 Processor -- start 2024-02-09T23:58:18.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.794+0000 7f284854e700 1 -- start start 2024-02-09T23:58:18.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f284854e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28400ac780 0x7f284005cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:18.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f284854e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 0x7f28400a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:18.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f284854e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2840136080 con 0x7f2840139230 2024-02-09T23:58:18.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f284854e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2840136340 con 0x7f28400ac780 2024-02-09T23:58:18.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f284854e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28400a7880 con 0x7f284005d5d0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2845ae9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 0x7f28400a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2846aeb700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2840139230 0x7f28401396a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49282/0 (socket says 172.21.15.89:49282) 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2846aeb700 1 -- 172.21.15.89:0/2606062854 learned_addr learned my addr 172.21.15.89:0/2606062854 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f28462ea700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28400ac780 0x7f284005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2845ae9700 1 -- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28400ac780 msgr2=0x7f284005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2845ae9700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28400ac780 0x7f284005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f28452e8700 1 -- 172.21.15.89:0/2606062854 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962012141 0 0) 0x7f2840136080 con 0x7f2840139230 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2845ae9700 1 -- 172.21.15.89:0/2606062854 >> v1:172.21.15.89:6789/0 conn(0x7f2840139230 legacy=0x7f28401396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.795+0000 7f2845ae9700 1 -- 172.21.15.89:0/2606062854 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400a7d00 con 0x7f284005d5d0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f2845ae9700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 0x7f28400a9710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2834002f70 tx=0x7f2834006df0).ready entity=mon.2 client_cookie=684bd79a75421563 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f28452e8700 1 -- 172.21.15.89:0/2606062854 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283400d570 con 0x7f284005d5d0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f28452e8700 1 -- 172.21.15.89:0/2606062854 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2834000e90 con 0x7f284005d5d0 2024-02-09T23:58:18.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f28452e8700 1 -- 172.21.15.89:0/2606062854 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283400d8c0 con 0x7f284005d5d0 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 -- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 msgr2=0x7f28400a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 0x7f28400a9710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2834002f70 tx=0x7f2834006df0).stop 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 -- 172.21.15.89:0/2606062854 shutdown_connections 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28400ac780 0x7f284005cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 --2- 172.21.15.89:0/2606062854 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f284005d5d0 0x7f28400a9710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 -- 172.21.15.89:0/2606062854 >> 172.21.15.89:0/2606062854 conn(0x7f2840067790 msgr2=0x7f2840067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 -- 172.21.15.89:0/2606062854 shutdown_connections 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.796+0000 7f284854e700 1 -- 172.21.15.89:0/2606062854 wait complete. 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.797+0000 7f284854e700 1 Processor -- start 2024-02-09T23:58:18.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.797+0000 7f284854e700 1 -- start start 2024-02-09T23:58:18.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:18.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 0x7f2840132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28400a0f90 con 0x7f2840139230 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2840130380 con 0x7f284005d5d0 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28400a1e50 con 0x7f28400ac780 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2846aeb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2845ae9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 0x7f2840132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2846aeb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34448/0 (socket says 172.21.15.89:34448) 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36962/0 (socket says 172.21.15.89:36962) 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2846aeb700 1 -- 172.21.15.89:0/312500315 learned_addr learned my addr 172.21.15.89:0/312500315 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 -- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 msgr2=0x7f2840132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 0x7f2840132850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 -- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 msgr2=0x7f28401487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 -- 172.21.15.89:0/312500315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283400b180 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2845ae9700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 0x7f2840132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f2846aeb700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f28462ea700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f283800c000 tx=0x7f2838006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2838010780 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28380108e0 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28401331e0 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2838010c40 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.798+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2840135820 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.799+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284005da10 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.800+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f283801b410 con 0x7f284005d5d0 2024-02-09T23:58:18.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.800+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f283804a510 con 0x7f284005d5d0 2024-02-09T23:58:18.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.803+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f283802f760 con 0x7f284005d5d0 2024-02-09T23:58:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.912+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2840057a60 con 0x7f284005d5d0 2024-02-09T23:58:18.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.913+0000 7f283f7fe700 1 -- 172.21.15.89:0/312500315 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7622 (secure 0 0 0) 0x7f2838032d80 con 0x7f284005d5d0 2024-02-09T23:58:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:18.917 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:18.646551+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:18.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 >> v1:172.21.15.89:6816/39389 conn(0x7f2820038e60 legacy=0x7f282003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 msgr2=0x7f28400a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:18.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f283800c000 tx=0x7f2838006df0).stop 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 shutdown_connections 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840139230 0x7f28401487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f284005d5d0 0x7f28400a0aa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 --2- 172.21.15.89:0/312500315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f28400ac780 0x7f2840132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 >> 172.21.15.89:0/312500315 conn(0x7f2840067790 msgr2=0x7f28400ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 shutdown_connections 2024-02-09T23:58:18.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:18.914+0000 7f284854e700 1 -- 172.21.15.89:0/312500315 wait complete. 2024-02-09T23:58:18.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-02-09T23:58:18.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-09T23:58:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.029+0000 7f38214a4700 1 Processor -- start 2024-02-09T23:58:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.029+0000 7f38214a4700 1 -- start start 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f38214a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f38214a4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381c136ad0 0x7f381c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f38214a4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c136f40 con 0x7f381c09b520 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f38214a4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c09a380 con 0x7f381c136ad0 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f38214a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c135fe0 con 0x7f381c1366f0 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381c136ad0 0x7f381c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381a7fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f381c09b520 0x7f381c139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49292/0 (socket says 172.21.15.89:49292) 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381a7fc700 1 -- 172.21.15.89:0/2836757081 learned_addr learned my addr 172.21.15.89:0/2836757081 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 -- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 msgr2=0x7f381c09bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 --2- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c09bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 -- 172.21.15.89:0/2836757081 >> v1:172.21.15.89:6789/0 conn(0x7f381c09b520 legacy=0x7f381c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 -- 172.21.15.89:0/2836757081 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c09a0c0 con 0x7f381c136ad0 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.030+0000 7f381b7fe700 1 --2- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c099a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f381c05c360 tx=0x7f38140091d0).ready entity=mon.0 client_cookie=d5c26e90c8cb94ab server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f3819ffb700 1 -- 172.21.15.89:0/2836757081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381400b680 con 0x7f381c136ad0 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f3819ffb700 1 -- 172.21.15.89:0/2836757081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381400b7e0 con 0x7f381c136ad0 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f3819ffb700 1 -- 172.21.15.89:0/2836757081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381400b950 con 0x7f381c136ad0 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 -- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 msgr2=0x7f381c099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 --2- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c099a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f381c05c360 tx=0x7f38140091d0).stop 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 -- 172.21.15.89:0/2836757081 shutdown_connections 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 --2- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c099a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 --2- 172.21.15.89:0/2836757081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c09bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 -- 172.21.15.89:0/2836757081 >> 172.21.15.89:0/2836757081 conn(0x7f381c06c0c0 msgr2=0x7f381c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 -- 172.21.15.89:0/2836757081 shutdown_connections 2024-02-09T23:58:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.031+0000 7f38214a4700 1 -- 172.21.15.89:0/2836757081 wait complete. 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.032+0000 7f38214a4700 1 Processor -- start 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.032+0000 7f38214a4700 1 -- start start 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c093600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c12ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c096230 con 0x7f381c136ad0 2024-02-09T23:58:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c093fd0 con 0x7f381c1366f0 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f381c094290 con 0x7f381c09b520 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c12ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52240/0 (socket says 172.21.15.89:52240) 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 -- 172.21.15.89:0/1988799175 learned_addr learned my addr 172.21.15.89:0/1988799175 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381a7fc700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c093600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 -- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 msgr2=0x7f381c093600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c093600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 -- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 msgr2=0x7f381c12ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c12ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 -- 172.21.15.89:0/1988799175 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814009470 con 0x7f381c09b520 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381b7fe700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f381affd700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f381000c000 tx=0x7f3810006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3810010780 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100108e0 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c139f10 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3810010c40 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.033+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c093af0 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.034+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f381001c460 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.034+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c0963d0 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.035+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f381004a850 con 0x7f381c09b520 2024-02-09T23:58:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.038+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f381c0963d0 con 0x7f381c09b520 2024-02-09T23:58:19.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.148+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f381c0963d0 con 0x7f381c09b520 2024-02-09T23:58:19.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.148+0000 7f380bfff700 1 -- 172.21.15.89:0/1988799175 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f381c0963d0 con 0x7f381c09b520 2024-02-09T23:58:19.152 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-09T23:58:19.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 >> v1:172.21.15.89:6816/39389 conn(0x7f37f8038e60 legacy=0x7f37f803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 msgr2=0x7f381c095d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f381000c000 tx=0x7f3810006df0).stop 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 shutdown_connections 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381c136ad0 0x7f381c12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f381c09b520 0x7f381c095d40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 --2- 172.21.15.89:0/1988799175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f381c1366f0 0x7f381c093600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 >> 172.21.15.89:0/1988799175 conn(0x7f381c06c0c0 msgr2=0x7f381c0a8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 shutdown_connections 2024-02-09T23:58:19.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.150+0000 7f38214a4700 1 -- 172.21.15.89:0/1988799175 wait complete. 2024-02-09T23:58:19.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-09T23:58:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.265+0000 7f2dd1282700 1 Processor -- start 2024-02-09T23:58:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.265+0000 7f2dd1282700 1 -- start start 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dd1282700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dd1282700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dd1282700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0a1f10 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dd1282700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc0a0f60 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dd1282700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0a1200 con 0x7f2dcc13b6a0 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dca7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52242/0 (socket says 172.21.15.89:52242) 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dca7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34480/0 (socket says 172.21.15.89:34480) 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dcb7fe700 1 -- 172.21.15.89:0/4153274745 learned_addr learned my addr 172.21.15.89:0/4153274745 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.266+0000 7f2dcaffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2dcc05dfb0 0x7f2dcc0a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49306/0 (socket says 172.21.15.89:49306) 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dca7fc700 1 -- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 msgr2=0x7f2dcc13da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dca7fc700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dca7fc700 1 -- 172.21.15.89:0/4153274745 >> v1:172.21.15.89:6789/0 conn(0x7f2dcc05dfb0 legacy=0x7f2dcc0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dca7fc700 1 -- 172.21.15.89:0/4153274745 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc060520 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dc9ffb700 1 -- 172.21.15.89:0/4153274745 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162738120 0 0) 0x7f2dcc0a1f10 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dcb7fe700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dca7fc700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2dbc002f70 tx=0x7f2dbc006df0).ready entity=mon.0 client_cookie=3ee883c02aa25af9 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dc9ffb700 1 -- 172.21.15.89:0/4153274745 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc00d570 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dc9ffb700 1 -- 172.21.15.89:0/4153274745 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc000e90 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dc9ffb700 1 -- 172.21.15.89:0/4153274745 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc00d8c0 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 -- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc09f5d0 msgr2=0x7f2dcc13b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2dbc002f70 tx=0x7f2dbc006df0).stop 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 -- 172.21.15.89:0/4153274745 shutdown_connections 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc13b6a0 0x7f2dcc13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 --2- 172.21.15.89:0/4153274745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc09f5d0 0x7f2dcc13b1b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.267+0000 7f2dd1282700 1 -- 172.21.15.89:0/4153274745 >> 172.21.15.89:0/4153274745 conn(0x7f2dcc0a93f0 msgr2=0x7f2dcc0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.268+0000 7f2dd1282700 1 -- 172.21.15.89:0/4153274745 shutdown_connections 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.268+0000 7f2dd1282700 1 -- 172.21.15.89:0/4153274745 wait complete. 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.268+0000 7f2dd1282700 1 Processor -- start 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.268+0000 7f2dd1282700 1 -- start start 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 0x7f2dcc063230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 0x7f2dcc061b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc063b50 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc062b30 con 0x7f2dcc13b6a0 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dd1282700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc064d70 con 0x7f2dcc09f5d0 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dca7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 0x7f2dcc061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dca7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52248/0 (socket says 172.21.15.89:52248) 2024-02-09T23:58:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dca7fc700 1 -- 172.21.15.89:0/1226174977 learned_addr learned my addr 172.21.15.89:0/1226174977 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 0x7f2dcc063230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 -- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 msgr2=0x7f2dcc061640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 -- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 msgr2=0x7f2dcc061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 0x7f2dcc061b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 -- 172.21.15.89:0/1226174977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc400b7d0 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dca7fc700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcb7fe700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 0x7f2dcc061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.269+0000 7f2dcaffd700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 0x7f2dcc063230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2dc0000bc0 tx=0x7f2dc00079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc000cdd0 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc00070d0 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc00b180 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc0005550 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc065690 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2dc001a060 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.270+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc057a60 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.271+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f2dc0049be0 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.274+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2dc002edb0 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.385+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2dcc09e830 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.385+0000 7f2dbbfff700 1 -- 172.21.15.89:0/1226174977 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2dc0018070 con 0x7f2dcc05dfb0 2024-02-09T23:58:19.389 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-09T23:58:19.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 >> v1:172.21.15.89:6816/39389 conn(0x7f2da8038da0 legacy=0x7f2da803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 msgr2=0x7f2dcc063230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 0x7f2dcc063230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2dc0000bc0 tx=0x7f2dc00079e0).stop 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 shutdown_connections 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dcc13b6a0 0x7f2dcc061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dcc05dfb0 0x7f2dcc063230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 --2- 172.21.15.89:0/1226174977 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2dcc09f5d0 0x7f2dcc061640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 >> 172.21.15.89:0/1226174977 conn(0x7f2dcc0a93f0 msgr2=0x7f2dcc09de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 shutdown_connections 2024-02-09T23:58:19.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.387+0000 7f2dd1282700 1 -- 172.21.15.89:0/1226174977 wait complete. 2024-02-09T23:58:19.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:19.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.498+0000 7f8c306be700 1 Processor -- start 2024-02-09T23:58:19.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 -- start start 2024-02-09T23:58:19.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c280aae90 0x7f8c281331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280603c0 con 0x7f8c280aae90 2024-02-09T23:58:19.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280aa230 con 0x7f8c280674b0 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c306be700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280aa4d0 con 0x7f8c28132df0 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c2dc59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c280aae90 0x7f8c281331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c2ec5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.499+0000 7f8c2e45a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c280aae90 0x7f8c281331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34488/0 (socket says 172.21.15.89:34488) 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2ec5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36996/0 (socket says 172.21.15.89:36996) 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2e45a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52256/0 (socket says 172.21.15.89:52256) 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 -- 172.21.15.89:0/1087468400 learned_addr learned my addr 172.21.15.89:0/1087468400 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 -- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 msgr2=0x7f8c28060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 -- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 msgr2=0x7f8c28067960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 -- 172.21.15.89:0/1087468400 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280aa790 con 0x7f8c280aae90 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2ec5b700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2e45a700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae90 0x7f8c281331d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8c1c002f70 tx=0x7f8c1c006eb0).ready entity=mon.0 client_cookie=5ff4b0a5f3216b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2d458700 1 -- 172.21.15.89:0/1087468400 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1c00d570 con 0x7f8c280aae90 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2d458700 1 -- 172.21.15.89:0/1087468400 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c000e90 con 0x7f8c280aae90 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c2d458700 1 -- 172.21.15.89:0/1087468400 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1c00d900 con 0x7f8c280aae90 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c306be700 1 -- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae90 msgr2=0x7f8c281331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.500+0000 7f8c306be700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae90 0x7f8c281331d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8c1c002f70 tx=0x7f8c1c006eb0).stop 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 -- 172.21.15.89:0/1087468400 shutdown_connections 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c280674b0 0x7f8c28067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c28132df0 0x7f8c28060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 --2- 172.21.15.89:0/1087468400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280aae90 0x7f8c281331d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 -- 172.21.15.89:0/1087468400 >> 172.21.15.89:0/1087468400 conn(0x7f8c2805c300 msgr2=0x7f8c2806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 -- 172.21.15.89:0/1087468400 shutdown_connections 2024-02-09T23:58:19.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 -- 172.21.15.89:0/1087468400 wait complete. 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 Processor -- start 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.501+0000 7f8c306be700 1 -- start start 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 0x7f8c28145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 0x7f8c28095220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280930e0 con 0x7f8c280674b0 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281465c0 con 0x7f8c28132df0 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c306be700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28093d90 con 0x7f8c280aae90 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2e45a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 0x7f8c28145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2ec5b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 0x7f8c28095220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52264/0 (socket says 172.21.15.89:52264) 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 -- 172.21.15.89:0/2583130887 learned_addr learned my addr 172.21.15.89:0/2583130887 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:19.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 -- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 msgr2=0x7f8c28095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 0x7f8c28095220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 -- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 msgr2=0x7f8c28145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 0x7f8c28145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2dc59700 1 -- 172.21.15.89:0/2583130887 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009470 con 0x7f8c280aae90 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2e45a700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 0x7f8c28145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.502+0000 7f8c2ec5b700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 0x7f8c28095220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c2dc59700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8c1c002f70 tx=0x7f8c1c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1c00dea0 con 0x7f8c280aae90 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c006b40 con 0x7f8c280aae90 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2400b180 con 0x7f8c280aae90 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1c011e20 con 0x7f8c280aae90 2024-02-09T23:58:19.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.503+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c00b1e0 con 0x7f8c280aae90 2024-02-09T23:58:19.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.504+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8c1c025030 con 0x7f8c280aae90 2024-02-09T23:58:19.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.504+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f8c1c04b5f0 con 0x7f8c280aae90 2024-02-09T23:58:19.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.504+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28093ed0 con 0x7f8c280aae90 2024-02-09T23:58:19.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.507+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8c1c023020 con 0x7f8c280aae90 2024-02-09T23:58:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.650+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c280a9a90 con 0x7f8c280aae90 2024-02-09T23:58:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.650+0000 7f8c1b7fe700 1 -- 172.21.15.89:0/2583130887 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+794 (secure 0 0 0) 0x7f8c1c023020 con 0x7f8c280aae90 2024-02-09T23:58:19.654 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:19.654 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.651+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 >> v1:172.21.15.89:6816/39389 conn(0x7f8c08038da0 legacy=0x7f8c0803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.651+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 msgr2=0x7f8c280938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.651+0000 7f8c306be700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8c1c002f70 tx=0x7f8c1c015000).stop 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 shutdown_connections 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c28132df0 0x7f8c28095220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c280674b0 0x7f8c28145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 --2- 172.21.15.89:0/2583130887 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c280aae90 0x7f8c280938a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 >> 172.21.15.89:0/2583130887 conn(0x7f8c2805c300 msgr2=0x7f8c28136610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 shutdown_connections 2024-02-09T23:58:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:19.652+0000 7f8c306be700 1 -- 172.21.15.89:0/2583130887 wait complete. 2024-02-09T23:58:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-02-09T23:58:21.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:21.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.780+0000 7fec568c6700 1 Processor -- start 2024-02-09T23:58:21.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.780+0000 7fec568c6700 1 -- start start 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.780+0000 7fec568c6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec501337e0 0x7fec50133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.780+0000 7fec568c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 0x7fec50141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec568c6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec50067990 con 0x7fec50067570 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec568c6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec500a4c50 con 0x7fec501337e0 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec568c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec500a4f10 con 0x7fec50139fa0 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec501337e0 0x7fec50133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec54e63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 0x7fec50141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fec50067570 0x7fec50139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49308/0 (socket says 172.21.15.89:49308) 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4f7fe700 1 -- 172.21.15.89:0/2710792227 learned_addr learned my addr 172.21.15.89:0/2710792227 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec501337e0 0x7fec50133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34504/0 (socket says 172.21.15.89:34504) 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 -- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 msgr2=0x7fec50141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 0x7fec50141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 -- 172.21.15.89:0/2710792227 >> v1:172.21.15.89:6789/0 conn(0x7fec50067570 legacy=0x7fec50139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 -- 172.21.15.89:0/2710792227 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50060520 con 0x7fec501337e0 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4effd700 1 -- 172.21.15.89:0/2710792227 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378703316 0 0) 0x7fec50067990 con 0x7fec50067570 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec54e63700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 0x7fec50141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4ffff700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec501337e0 0x7fec50133bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fec44002f70 tx=0x7fec44006df0).ready entity=mon.0 client_cookie=758d7e0be268544b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4effd700 1 -- 172.21.15.89:0/2710792227 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec4400d570 con 0x7fec501337e0 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4effd700 1 -- 172.21.15.89:0/2710792227 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec44000e90 con 0x7fec501337e0 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.781+0000 7fec4effd700 1 -- 172.21.15.89:0/2710792227 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec4400d8c0 con 0x7fec501337e0 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 -- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec501337e0 msgr2=0x7fec50133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec501337e0 0x7fec50133bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fec44002f70 tx=0x7fec44006df0).stop 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 -- 172.21.15.89:0/2710792227 shutdown_connections 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec50139fa0 0x7fec50141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 --2- 172.21.15.89:0/2710792227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec501337e0 0x7fec50133bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 -- 172.21.15.89:0/2710792227 >> 172.21.15.89:0/2710792227 conn(0x7fec500a93f0 msgr2=0x7fec500a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:21.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 -- 172.21.15.89:0/2710792227 shutdown_connections 2024-02-09T23:58:21.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.782+0000 7fec568c6700 1 -- 172.21.15.89:0/2710792227 wait complete. 2024-02-09T23:58:21.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 Processor -- start 2024-02-09T23:58:21.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 -- start start 2024-02-09T23:58:21.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:21.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 0x7fec50132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:21.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 0x7fec50132b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:21.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec500a2bb0 con 0x7fec50139fa0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec50133050 con 0x7fec501337e0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.783+0000 7fec568c6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec500926b0 con 0x7fec50067570 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 0x7fec50132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52280/0 (socket says 172.21.15.89:52280) 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4ffff700 1 -- 172.21.15.89:0/942608697 learned_addr learned my addr 172.21.15.89:0/942608697 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec54e63700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 0x7fec50132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 -- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 msgr2=0x7fec5009dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 -- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 msgr2=0x7fec50132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 0x7fec50132b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 -- 172.21.15.89:0/942608697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec48009470 con 0x7fec501337e0 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4ffff700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:21.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec54e63700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 0x7fec50132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4f7fe700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 0x7fec50132670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fec50133190 tx=0x7fec40007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec40001d30 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec400070d0 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec40007430 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4400b180 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.784+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec50092960 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.785+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec40010070 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.785+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec50092c30 con 0x7fec501337e0 2024-02-09T23:58:21.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.785+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fec400498f0 con 0x7fec501337e0 2024-02-09T23:58:21.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.788+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec4002eb80 con 0x7fec501337e0 2024-02-09T23:58:21.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.930+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec50092960 con 0x7fec501337e0 2024-02-09T23:58:21.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.930+0000 7fec4d7fa700 1 -- 172.21.15.89:0/942608697 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+794 (secure 0 0 0) 0x7fec50092960 con 0x7fec501337e0 2024-02-09T23:58:21.933 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:21.933 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 >> v1:172.21.15.89:6816/39389 conn(0x7fec30038da0 legacy=0x7fec3003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 msgr2=0x7fec50132670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 0x7fec50132670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fec50133190 tx=0x7fec40007c00).stop 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 shutdown_connections 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec50139fa0 0x7fec50132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec50067570 0x7fec5009dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 --2- 172.21.15.89:0/942608697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec501337e0 0x7fec50132670 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:21.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 >> 172.21.15.89:0/942608697 conn(0x7fec500a93f0 msgr2=0x7fec50135b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:21.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 shutdown_connections 2024-02-09T23:58:21.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:21.932+0000 7fec568c6700 1 -- 172.21.15.89:0/942608697 wait complete. 2024-02-09T23:58:21.935 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-02-09T23:58:23.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:24.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 Processor -- start 2024-02-09T23:58:24.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 -- start start 2024-02-09T23:58:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f95700630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 0x7f95700a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700649c0 con 0x7f9570063590 2024-02-09T23:58:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9570063a70 con 0x7f95700650c0 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.058+0000 7f9575c72700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9570064bc0 con 0x7f9570137860 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f95700630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 0x7f95700a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:52284/0 (socket says 172.21.15.89:52284) 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956f7fe700 1 -- 172.21.15.89:0/171384368 learned_addr learned my addr 172.21.15.89:0/171384368 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 -- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 msgr2=0x7f9570137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 --2- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 -- 172.21.15.89:0/171384368 >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 msgr2=0x7f95700a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 --2- 172.21.15.89:0/171384368 >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 0x7f95700a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 -- 172.21.15.89:0/171384368 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700ab0d0 con 0x7f95700650c0 2024-02-09T23:58:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956ffff700 1 --2- 172.21.15.89:0/171384368 >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 0x7f95700a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956effd700 1 --2- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f95700630a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9564002f70 tx=0x7f9564006df0).ready entity=mon.1 client_cookie=4412ddf9550e71f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956e7fc700 1 -- 172.21.15.89:0/171384368 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956400d4a0 con 0x7f95700650c0 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956e7fc700 1 -- 172.21.15.89:0/171384368 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564000e90 con 0x7f95700650c0 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.059+0000 7f956e7fc700 1 -- 172.21.15.89:0/171384368 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956400d7f0 con 0x7f95700650c0 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 -- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 msgr2=0x7f95700630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 --2- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f95700630a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9564002f70 tx=0x7f9564006df0).stop 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 -- 172.21.15.89:0/171384368 shutdown_connections 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 --2- 172.21.15.89:0/171384368 >> v2:172.21.15.89:3300/0 conn(0x7f9570063590 0x7f95700a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 --2- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 --2- 172.21.15.89:0/171384368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f95700630a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 -- 172.21.15.89:0/171384368 >> 172.21.15.89:0/171384368 conn(0x7f957005c300 msgr2=0x7f957006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 -- 172.21.15.89:0/171384368 shutdown_connections 2024-02-09T23:58:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.060+0000 7f9575c72700 1 -- 172.21.15.89:0/171384368 wait complete. 2024-02-09T23:58:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.061+0000 7f9575c72700 1 Processor -- start 2024-02-09T23:58:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.061+0000 7f9575c72700 1 -- start start 2024-02-09T23:58:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f9570144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570097ee0 con 0x7f9570063590 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9570098d50 con 0x7f95700650c0 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95700966f0 con 0x7f9570137860 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34528/0 (socket says 172.21.15.89:34528) 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 -- 172.21.15.89:0/98309497 learned_addr learned my addr 172.21.15.89:0/98309497 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956effd700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f9570144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956ffff700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 -- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 msgr2=0x7f9570144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 -- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 msgr2=0x7f9570144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f9570144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 -- 172.21.15.89:0/98309497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009470 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956ffff700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956effd700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f9570144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956f7fe700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9570095830 tx=0x7f956000f040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95600107a0 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560013040 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956400b180 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9560010af0 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.062+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570096390 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.063+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f956001f030 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.063+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700654c0 con 0x7f9570063590 2024-02-09T23:58:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.063+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f956004e280 con 0x7f9570063590 2024-02-09T23:58:24.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.067+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9560036f00 con 0x7f9570063590 2024-02-09T23:58:24.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.207+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9570057a60 con 0x7f9570063590 2024-02-09T23:58:24.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.208+0000 7f956cff9700 1 -- 172.21.15.89:0/98309497 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1378 (secure 0 0 0) 0x7f9560036af0 con 0x7f9570063590 2024-02-09T23:58:24.210 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:24.211 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4190,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 >> v1:172.21.15.89:6816/39389 conn(0x7f9550038da0 legacy=0x7f955003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 msgr2=0x7f9570095ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9570095830 tx=0x7f956000f040).stop 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 shutdown_connections 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9570137860 0x7f9570144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9570063590 0x7f9570095ea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 --2- 172.21.15.89:0/98309497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95700650c0 0x7f9570144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 >> 172.21.15.89:0/98309497 conn(0x7f957005c300 msgr2=0x7f957009c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 shutdown_connections 2024-02-09T23:58:24.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.209+0000 7f9575c72700 1 -- 172.21.15.89:0/98309497 wait complete. 2024-02-09T23:58:24.213 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 3 2024-02-09T23:58:24.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:24.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.322+0000 7f3f3941e700 1 Processor -- start 2024-02-09T23:58:24.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.322+0000 7f3f3941e700 1 -- start start 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f3941e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 0x7f3f3405bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f3941e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f3405ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f3941e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3405b970 con 0x7f3f3405d370 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f3941e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f34136710 con 0x7f3f34136210 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f3941e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341369d0 con 0x7f3f34136bf0 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f327fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f3405ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 0x7f3f3405bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f337fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3f3405d370 0x7f3f341397e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49316/0 (socket says 172.21.15.89:49316) 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f337fe700 1 -- 172.21.15.89:0/653790469 learned_addr learned my addr 172.21.15.89:0/653790469 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:24.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 -- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 msgr2=0x7f3f3405ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f3405ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f31ffb700 1 -- 172.21.15.89:0/653790469 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677696884 0 0) 0x7f3f3405b970 con 0x7f3f3405d370 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 -- 172.21.15.89:0/653790469 >> v1:172.21.15.89:6789/0 conn(0x7f3f3405d370 legacy=0x7f3f341397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 -- 172.21.15.89:0/653790469 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34136fd0 con 0x7f3f34136bf0 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f327fc700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f3405ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f32ffd700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 0x7f3f3405bde0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3f28002f70 tx=0x7f3f28006df0).ready entity=mon.2 client_cookie=7a8c2c0da711abff server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f31ffb700 1 -- 172.21.15.89:0/653790469 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2800d570 con 0x7f3f34136bf0 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f31ffb700 1 -- 172.21.15.89:0/653790469 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28000e90 con 0x7f3f34136bf0 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.323+0000 7f3f31ffb700 1 -- 172.21.15.89:0/653790469 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2800d8c0 con 0x7f3f34136bf0 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 -- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 msgr2=0x7f3f3405bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 0x7f3f3405bde0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3f28002f70 tx=0x7f3f28006df0).stop 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 -- 172.21.15.89:0/653790469 shutdown_connections 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f34136bf0 0x7f3f3405bde0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 --2- 172.21.15.89:0/653790469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f3405ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 -- 172.21.15.89:0/653790469 >> 172.21.15.89:0/653790469 conn(0x7f3f34066a50 msgr2=0x7f3f3406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 -- 172.21.15.89:0/653790469 shutdown_connections 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.324+0000 7f3f3941e700 1 -- 172.21.15.89:0/653790469 wait complete. 2024-02-09T23:58:24.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 Processor -- start 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 -- start start 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f340a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f34136bf0 0x7f3f34149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3413a440 con 0x7f3f34136bf0 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340a33d0 con 0x7f3f34136210 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f3941e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340a3670 con 0x7f3f3405d370 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.325+0000 7f3f32ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56822/0 (socket says 172.21.15.89:56822) 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 -- 172.21.15.89:0/2574318097 learned_addr learned my addr 172.21.15.89:0/2574318097 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f327fc700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f340a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f337fe700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f34136bf0 0x7f3f34149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 -- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 msgr2=0x7f3f340a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f340a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 -- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f34136bf0 msgr2=0x7f3f34149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f34136bf0 0x7f3f34149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 -- 172.21.15.89:0/2574318097 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2400b180 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f327fc700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f340a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f32ffd700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3f28002f70 tx=0x7f3f28014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f28016070 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28013bf0 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2800b180 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2801e450 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.326+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f340a68a0 con 0x7f3f3405d370 2024-02-09T23:58:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.327+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3f28025030 con 0x7f3f3405d370 2024-02-09T23:58:24.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.327+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3f2804b410 con 0x7f3f3405d370 2024-02-09T23:58:24.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.327+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f34060150 con 0x7f3f3405d370 2024-02-09T23:58:24.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.330+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3f28023030 con 0x7f3f3405d370 2024-02-09T23:58:24.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.441+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f340a53a0 con 0x7f3f3405d370 2024-02-09T23:58:24.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.442+0000 7f3f23fff700 1 -- 172.21.15.89:0/2574318097 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7609 (secure 0 0 0) 0x7f3f28028440 con 0x7f3f3405d370 2024-02-09T23:58:24.444 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:24.445 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":14,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:19.647899+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 >> v1:172.21.15.89:6816/39389 conn(0x7f3f10038da0 legacy=0x7f3f1003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 msgr2=0x7f3f34139f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3f28002f70 tx=0x7f3f28014000).stop 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 shutdown_connections 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f34136bf0 0x7f3f34149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f3405d370 0x7f3f34139f50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 --2- 172.21.15.89:0/2574318097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f34136210 0x7f3f340a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.443+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 >> 172.21.15.89:0/2574318097 conn(0x7f3f34066a50 msgr2=0x7f3f340a8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.444+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 shutdown_connections 2024-02-09T23:58:24.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.444+0000 7f3f3941e700 1 -- 172.21.15.89:0/2574318097 wait complete. 2024-02-09T23:58:24.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-02-09T23:58:24.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-09T23:58:24.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 Processor -- start 2024-02-09T23:58:24.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 -- start start 2024-02-09T23:58:24.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c00137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c000649c0 con 0x7f1c00063590 2024-02-09T23:58:24.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00063a70 con 0x7f1c00137860 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1c05f1f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00064bc0 con 0x7f1c000650c0 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bfffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bff7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c00137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bfffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49696/0 (socket says 172.21.15.89:49696) 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56830/0 (socket says 172.21.15.89:56830) 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.560+0000 7f1bfffff700 1 -- 172.21.15.89:0/3589577046 learned_addr learned my addr 172.21.15.89:0/3589577046 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 -- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 msgr2=0x7f1c00137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c00137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 -- 172.21.15.89:0/3589577046 >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 msgr2=0x7f1c000a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 --2- 172.21.15.89:0/3589577046 >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 -- 172.21.15.89:0/3589577046 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000ab0d0 con 0x7f1c000650c0 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfffff700 1 --2- 172.21.15.89:0/3589577046 >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bff7fe700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c00137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfeffd700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1bf4002f70 tx=0x7f1bf4006df0).ready entity=mon.2 client_cookie=b34292a7e24d21a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfe7fc700 1 -- 172.21.15.89:0/3589577046 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf400d4a0 con 0x7f1c000650c0 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfe7fc700 1 -- 172.21.15.89:0/3589577046 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4000e90 con 0x7f1c000650c0 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.561+0000 7f1bfe7fc700 1 -- 172.21.15.89:0/3589577046 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf400d7f0 con 0x7f1c000650c0 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 -- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 msgr2=0x7f1c000630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1bf4002f70 tx=0x7f1bf4006df0).stop 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 -- 172.21.15.89:0/3589577046 shutdown_connections 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/3589577046 >> v2:172.21.15.89:3300/0 conn(0x7f1c00063590 0x7f1c000a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c00137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/3589577046 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000630a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 -- 172.21.15.89:0/3589577046 >> 172.21.15.89:0/3589577046 conn(0x7f1c0005c300 msgr2=0x7f1c0006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 -- 172.21.15.89:0/3589577046 shutdown_connections 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 -- 172.21.15.89:0/3589577046 wait complete. 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.562+0000 7f1c05f1f700 1 Processor -- start 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 -- start start 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 0x7f1c00095b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000972f0 con 0x7f1c00063590 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00093b20 con 0x7f1c00137860 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1c05f1f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00092030 con 0x7f1c000650c0 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bfffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bfffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44520/0 (socket says 172.21.15.89:44520) 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bfeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56840/0 (socket says 172.21.15.89:56840) 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bff7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 0x7f1c00095b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.563+0000 7f1bfffff700 1 -- 172.21.15.89:0/161205293 learned_addr learned my addr 172.21.15.89:0/161205293 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 -- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 msgr2=0x7f1c000948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 -- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 msgr2=0x7f1c00095b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 0x7f1c00095b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 -- 172.21.15.89:0/161205293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009530 con 0x7f1c00137860 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bff7fe700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 0x7f1c00095b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfeffd700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfffff700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1bf800c000 tx=0x7f1bf8009290).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf800c850 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800c9b0 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf000b180 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf800cd10 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.564+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf400b180 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.565+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1bf8022070 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.565+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c000654c0 con 0x7f1c00137860 2024-02-09T23:58:24.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.565+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f1bf804ac60 con 0x7f1c00137860 2024-02-09T23:58:24.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.568+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1bf80338e0 con 0x7f1c00137860 2024-02-09T23:58:24.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.680+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1c00096e60 con 0x7f1c00137860 2024-02-09T23:58:24.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.680+0000 7f1bfcff9700 1 -- 172.21.15.89:0/161205293 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1bf8016030 con 0x7f1c00137860 2024-02-09T23:58:24.683 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.681+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 >> v1:172.21.15.89:6816/39389 conn(0x7f1be0038dd0 legacy=0x7f1be003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.681+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 msgr2=0x7f1c0012fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.681+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1bf800c000 tx=0x7f1bf8009290).stop 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 shutdown_connections 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c00137860 0x7f1c0012fdf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c00063590 0x7f1c00095b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 --2- 172.21.15.89:0/161205293 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1c000650c0 0x7f1c000948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 >> 172.21.15.89:0/161205293 conn(0x7f1c0005c300 msgr2=0x7f1c000aa060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 shutdown_connections 2024-02-09T23:58:24.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.682+0000 7f1c05f1f700 1 -- 172.21.15.89:0/161205293 wait complete. 2024-02-09T23:58:24.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-09T23:58:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 Processor -- start 2024-02-09T23:58:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 -- start start 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c09c8f0 con 0x7fb03c09f8e0 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c09c5e0 con 0x7fb03c0a4fa0 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.796+0000 7fb042af2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0a1540 con 0x7fb03c09f010 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56854/0 (socket says 172.21.15.89:56854) 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49710/0 (socket says 172.21.15.89:49710) 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04108f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb03c09f8e0 0x7fb03c0a3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37744/0 (socket says 172.21.15.89:37744) 2024-02-09T23:58:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 -- 172.21.15.89:0/1565829426 learned_addr learned my addr 172.21.15.89:0/1565829426 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 -- 172.21.15.89:0/1565829426 >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 msgr2=0x7fb03c09f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 --2- 172.21.15.89:0/1565829426 >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 -- 172.21.15.89:0/1565829426 >> v1:172.21.15.89:6789/0 conn(0x7fb03c09f8e0 legacy=0x7fb03c0a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 -- 172.21.15.89:0/1565829426 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c09cb20 con 0x7fb03c09f010 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03bfff700 1 --2- 172.21.15.89:0/1565829426 >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03b7fe700 1 -- 172.21.15.89:0/1565829426 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935497385 0 0) 0x7fb03c09c8f0 con 0x7fb03c09f8e0 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb04088e700 1 --2- 172.21.15.89:0/1565829426 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb03c0a0030 tx=0x7fb030006eb0).ready entity=mon.2 client_cookie=d8658e9a8557f85 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03b7fe700 1 -- 172.21.15.89:0/1565829426 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03000d5c0 con 0x7fb03c09f010 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03b7fe700 1 -- 172.21.15.89:0/1565829426 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030000e90 con 0x7fb03c09f010 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.797+0000 7fb03b7fe700 1 -- 172.21.15.89:0/1565829426 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03000d910 con 0x7fb03c09f010 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 -- 172.21.15.89:0/1565829426 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 msgr2=0x7fb03c0a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 --2- 172.21.15.89:0/1565829426 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb03c0a0030 tx=0x7fb030006eb0).stop 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 -- 172.21.15.89:0/1565829426 shutdown_connections 2024-02-09T23:58:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 --2- 172.21.15.89:0/1565829426 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c0a1cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 --2- 172.21.15.89:0/1565829426 >> v2:172.21.15.89:3300/0 conn(0x7fb03c0a4fa0 0x7fb03c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 -- 172.21.15.89:0/1565829426 >> 172.21.15.89:0/1565829426 conn(0x7fb03c0a93f0 msgr2=0x7fb03c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 -- 172.21.15.89:0/1565829426 shutdown_connections 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.798+0000 7fb042af2700 1 -- 172.21.15.89:0/1565829426 wait complete. 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 Processor -- start 2024-02-09T23:58:24.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 -- start start 2024-02-09T23:58:24.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 0x7fb03c133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 0x7fb03c0629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c061960 con 0x7fb03c09f8e0 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c134320 con 0x7fb03c0a4fa0 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb042af2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1345e0 con 0x7fb03c09f010 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb03bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 0x7fb03c133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb04088e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb04108f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 0x7fb03c0629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb03bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 0x7fb03c133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49724/0 (socket says 172.21.15.89:49724) 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.799+0000 7fb03bfff700 1 -- 172.21.15.89:0/3438366373 learned_addr learned my addr 172.21.15.89:0/3438366373 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 -- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 msgr2=0x7fb03c0629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 0x7fb03c0629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 -- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 msgr2=0x7fb03c133950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 0x7fb03c133950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 -- 172.21.15.89:0/3438366373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02800b180 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04108f700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 0x7fb03c0629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb04088e700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c064720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb03c0a0030 tx=0x7fb030015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb030002f50 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000d940 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03000b1e0 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb030011d70 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.800+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c063be0 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.801+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb030025030 con 0x7fb03c09f010 2024-02-09T23:58:24.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.801+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c057a60 con 0x7fb03c09f010 2024-02-09T23:58:24.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.801+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fb03004b620 con 0x7fb03c09f010 2024-02-09T23:58:24.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.804+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb030028b30 con 0x7fb03c09f010 2024-02-09T23:58:24.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.915+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb03c0a1210 con 0x7fb03c09f010 2024-02-09T23:58:24.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.915+0000 7fb039ffb700 1 -- 172.21.15.89:0/3438366373 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb030023020 con 0x7fb03c09f010 2024-02-09T23:58:24.917 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 >> v1:172.21.15.89:6816/39389 conn(0x7fb01c038da0 legacy=0x7fb01c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 msgr2=0x7fb03c064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c064720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb03c0a0030 tx=0x7fb030015000).stop 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 shutdown_connections 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c0a4fa0 0x7fb03c0629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb03c09f010 0x7fb03c064720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 --2- 172.21.15.89:0/3438366373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c09f8e0 0x7fb03c133950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 >> 172.21.15.89:0/3438366373 conn(0x7fb03c0a93f0 msgr2=0x7fb03c0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 shutdown_connections 2024-02-09T23:58:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:24.916+0000 7fb042af2700 1 -- 172.21.15.89:0/3438366373 wait complete. 2024-02-09T23:58:24.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-09T23:58:25.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.031+0000 7f09cb870700 1 Processor -- start 2024-02-09T23:58:25.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.031+0000 7f09cb870700 1 -- start start 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09cb870700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09cb870700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4139fa0 0x7f09c4141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09cb870700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c4067990 con 0x7f09c4067570 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09cb870700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a4c50 con 0x7f09c41337e0 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09cb870700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a4f10 con 0x7f09c4139fa0 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c8e0b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f09c4067570 0x7f09c4139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37756/0 (socket says 172.21.15.89:37756) 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c8e0b700 1 -- 172.21.15.89:0/1608829347 learned_addr learned my addr 172.21.15.89:0/1608829347 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c9e0d700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4139fa0 0x7f09c4141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09b3fff700 1 -- 172.21.15.89:0/1608829347 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165788180 0 0) 0x7f09c4067990 con 0x7f09c4067570 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09b3fff700 1 -- 172.21.15.89:0/1608829347 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac003260 con 0x7f09c4067570 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 -- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4139fa0 msgr2=0x7f09c4141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4139fa0 0x7f09c4141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 -- 172.21.15.89:0/1608829347 >> v1:172.21.15.89:6789/0 conn(0x7f09c4067570 legacy=0x7f09c4139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 -- 172.21.15.89:0/1608829347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4060520 con 0x7f09c41337e0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09c960c700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4133bc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f09c0002f70 tx=0x7f09c0006df0).ready entity=mon.1 client_cookie=603d49842e57771e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09b3fff700 1 -- 172.21.15.89:0/1608829347 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000d570 con 0x7f09c41337e0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09b3fff700 1 -- 172.21.15.89:0/1608829347 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c0000e90 con 0x7f09c41337e0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.032+0000 7f09b3fff700 1 -- 172.21.15.89:0/1608829347 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000d8c0 con 0x7f09c41337e0 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 -- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 msgr2=0x7f09c4133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4133bc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f09c0002f70 tx=0x7f09c0006df0).stop 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 -- 172.21.15.89:0/1608829347 shutdown_connections 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4133bc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 --2- 172.21.15.89:0/1608829347 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4139fa0 0x7f09c4141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 -- 172.21.15.89:0/1608829347 >> 172.21.15.89:0/1608829347 conn(0x7f09c40a93f0 msgr2=0x7f09c40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 -- 172.21.15.89:0/1608829347 shutdown_connections 2024-02-09T23:58:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.033+0000 7f09cb870700 1 -- 172.21.15.89:0/1608829347 wait complete. 2024-02-09T23:58:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 Processor -- start 2024-02-09T23:58:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 -- start start 2024-02-09T23:58:25.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 0x7f09c4149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c409f450 con 0x7f09c4139fa0 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a1310 con 0x7f09c41337e0 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09cb870700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c409ffc0 con 0x7f09c4067570 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09c960c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09c960c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56888/0 (socket says 172.21.15.89:56888) 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.034+0000 7f09c8e0b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 -- 172.21.15.89:0/2831958205 learned_addr learned my addr 172.21.15.89:0/2831958205 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c9e0d700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 0x7f09c4149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 -- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 msgr2=0x7f09c4149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 -- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 msgr2=0x7f09c4149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 0x7f09c4149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 -- 172.21.15.89:0/2831958205 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c000b180 con 0x7f09c4067570 2024-02-09T23:58:25.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c8e0b700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c9e0d700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 0x7f09c4149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09c960c700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f09c0002f70 tx=0x7f09c0014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c0016070 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000de70 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c0013de0 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c40a2550 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.035+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c409fa00 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.036+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f09c000f030 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.036+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c40a0660 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.037+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f09c004b050 con 0x7f09c4067570 2024-02-09T23:58:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.039+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f09c40a0660 con 0x7f09c4067570 2024-02-09T23:58:25.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.152+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09c40a0660 con 0x7f09c4067570 2024-02-09T23:58:25.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.153+0000 7f09b27fc700 1 -- 172.21.15.89:0/2831958205 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v14) v1 ==== 84+0+143 (secure 0 0 0) 0x7f09c40a0660 con 0x7f09c4067570 2024-02-09T23:58:25.155 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:25.155 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "device_health_metrics" 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 2, 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "rbd" 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-09T23:58:25.156 INFO:teuthology.orchestra.run.smithi089.stdout:] 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 >> v1:172.21.15.89:6816/39389 conn(0x7f09a4038ec0 legacy=0x7f09a403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 msgr2=0x7f09c40a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f09c0002f70 tx=0x7f09c0014000).stop 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 shutdown_connections 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c4139fa0 0x7f09c4149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c4067570 0x7f09c40a0940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 --2- 172.21.15.89:0/2831958205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c41337e0 0x7f09c4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 >> 172.21.15.89:0/2831958205 conn(0x7f09c40a93f0 msgr2=0x7f09c405c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:25.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 shutdown_connections 2024-02-09T23:58:25.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.154+0000 7f09cb870700 1 -- 172.21.15.89:0/2831958205 wait complete. 2024-02-09T23:58:25.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-09T23:58:25.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-09T23:58:25.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 Processor -- start 2024-02-09T23:58:25.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 -- start start 2024-02-09T23:58:25.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 0x7fce30133b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 0x7fce30141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300a6340 con 0x7fce30133770 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce30066430 con 0x7fce30139ff0 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.270+0000 7fce3800b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce30067610 con 0x7fce300a4b80 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce355a6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 0x7fce30133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce35da7700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fce30133770 0x7fce301398e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37760/0 (socket says 172.21.15.89:37760) 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 0x7fce30141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce35da7700 1 -- 172.21.15.89:0/726019679 learned_addr learned my addr 172.21.15.89:0/726019679 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce34da5700 1 -- 172.21.15.89:0/726019679 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347565552 0 0) 0x7fce300a6340 con 0x7fce30133770 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 -- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 msgr2=0x7fce30133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 0x7fce30133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 -- 172.21.15.89:0/726019679 >> v1:172.21.15.89:6789/0 conn(0x7fce30133770 legacy=0x7fce301398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 -- 172.21.15.89:0/726019679 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300a4fc0 con 0x7fce30139ff0 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce355a6700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 0x7fce30133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce365a8700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 0x7fce30141c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fce280032f0 tx=0x7fce280091d0).ready entity=mon.1 client_cookie=ba5a746fa7bdc4b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce34da5700 1 -- 172.21.15.89:0/726019679 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2800b6c0 con 0x7fce30139ff0 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce34da5700 1 -- 172.21.15.89:0/726019679 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800b820 con 0x7fce30139ff0 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.271+0000 7fce34da5700 1 -- 172.21.15.89:0/726019679 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2800b990 con 0x7fce30139ff0 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 -- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 msgr2=0x7fce30141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 0x7fce30141c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fce280032f0 tx=0x7fce280091d0).stop 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 -- 172.21.15.89:0/726019679 shutdown_connections 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce30139ff0 0x7fce30141c30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 --2- 172.21.15.89:0/726019679 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce300a4b80 0x7fce30133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 -- 172.21.15.89:0/726019679 >> 172.21.15.89:0/726019679 conn(0x7fce300a9450 msgr2=0x7fce300a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 -- 172.21.15.89:0/726019679 shutdown_connections 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 -- 172.21.15.89:0/726019679 wait complete. 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.272+0000 7fce3800b700 1 Processor -- start 2024-02-09T23:58:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 -- start start 2024-02-09T23:58:25.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce30139ff0 0x7fce30149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:25.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30092c70 con 0x7fce30133770 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300a06e0 con 0x7fce300a4b80 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce3800b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce300a09a0 con 0x7fce30139ff0 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce355a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44570/0 (socket says 172.21.15.89:44570) 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce355a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49736/0 (socket says 172.21.15.89:49736) 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 -- 172.21.15.89:0/2440936796 learned_addr learned my addr 172.21.15.89:0/2440936796 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce365a8700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce30139ff0 0x7fce30149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 -- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce30139ff0 msgr2=0x7fce30149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce30139ff0 0x7fce30149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 -- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 msgr2=0x7fce3009fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce35da7700 1 -- 172.21.15.89:0/2440936796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2000b180 con 0x7fce300a4b80 2024-02-09T23:58:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.273+0000 7fce355a6700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce35da7700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fce2c000bc0 tx=0x7fce2c007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2c0070d0 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c007230 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce28009470 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2c005610 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce300a2be0 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.274+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fce2c010070 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.275+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fce2c049a80 con 0x7fce300a4b80 2024-02-09T23:58:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.275+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3009c540 con 0x7fce300a4b80 2024-02-09T23:58:25.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.278+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fce2c02ecd0 con 0x7fce300a4b80 2024-02-09T23:58:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:25.389+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce30057a60 con 0x7fce300a4b80 2024-02-09T23:58:26.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.007+0000 7fce1effd700 1 -- 172.21.15.89:0/2440936796 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce2c0322f0 con 0x7fce300a4b80 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 >> v1:172.21.15.89:6816/39389 conn(0x7fce10038e30 legacy=0x7fce1003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 msgr2=0x7fce30092780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fce2c000bc0 tx=0x7fce2c007a60).stop 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 shutdown_connections 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fce30139ff0 0x7fce30149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce300a4b80 0x7fce30092780 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 --2- 172.21.15.89:0/2440936796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce30133770 0x7fce3009fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 >> 172.21.15.89:0/2440936796 conn(0x7fce300a9450 msgr2=0x7fce30137f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 shutdown_connections 2024-02-09T23:58:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.012+0000 7fce3800b700 1 -- 172.21.15.89:0/2440936796 wait complete. 2024-02-09T23:58:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2024-02-09T23:58:26.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-09T23:58:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.139+0000 7fe8d0254700 1 Processor -- start 2024-02-09T23:58:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.139+0000 7fe8d0254700 1 -- start start 2024-02-09T23:58:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8d0254700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8d0254700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 0x7fe8c81331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8d0254700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c80603c0 con 0x7fe8c80674b0 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8d0254700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c80aa230 con 0x7fe8c80aae90 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8d0254700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80aa4d0 con 0x7fe8c8132df0 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8cdff0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8cdff0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44586/0 (socket says 172.21.15.89:44586) 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8cdff0700 1 -- 172.21.15.89:0/2017701096 learned_addr learned my addr 172.21.15.89:0/2017701096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.140+0000 7fe8cd7ef700 1 --2- 172.21.15.89:0/2017701096 >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 0x7fe8c81331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cdff0700 1 -- 172.21.15.89:0/2017701096 >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 msgr2=0x7fe8c81331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cdff0700 1 --2- 172.21.15.89:0/2017701096 >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 0x7fe8c81331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cdff0700 1 -- 172.21.15.89:0/2017701096 >> v1:172.21.15.89:6789/0 conn(0x7fe8c80674b0 legacy=0x7fe8c8067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cdff0700 1 -- 172.21.15.89:0/2017701096 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80aa790 con 0x7fe8c8132df0 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cd7ef700 1 --2- 172.21.15.89:0/2017701096 >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 0x7fe8c81331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8cdff0700 1 --2- 172.21.15.89:0/2017701096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe8b8002f70 tx=0x7fe8b8006eb0).ready entity=mon.1 client_cookie=90fabb9eb67eb792 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8ccfee700 1 -- 172.21.15.89:0/2017701096 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b800d570 con 0x7fe8c8132df0 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8ccfee700 1 -- 172.21.15.89:0/2017701096 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b8000e90 con 0x7fe8c8132df0 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8ccfee700 1 -- 172.21.15.89:0/2017701096 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b800d900 con 0x7fe8c8132df0 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 -- 172.21.15.89:0/2017701096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 msgr2=0x7fe8c8060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2017701096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe8b8002f70 tx=0x7fe8b8006eb0).stop 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 -- 172.21.15.89:0/2017701096 shutdown_connections 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2017701096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c8132df0 0x7fe8c8060dc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2017701096 >> v2:172.21.15.89:3300/0 conn(0x7fe8c80aae90 0x7fe8c81331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 -- 172.21.15.89:0/2017701096 >> 172.21.15.89:0/2017701096 conn(0x7fe8c805c300 msgr2=0x7fe8c806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 -- 172.21.15.89:0/2017701096 shutdown_connections 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.141+0000 7fe8d0254700 1 -- 172.21.15.89:0/2017701096 wait complete. 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.142+0000 7fe8d0254700 1 Processor -- start 2024-02-09T23:58:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.142+0000 7fe8d0254700 1 -- start start 2024-02-09T23:58:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 0x7fe8c8093a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c80aae90 0x7fe8c8145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8135770 con 0x7fe8c8132df0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80927d0 con 0x7fe8c80aae90 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8d0254700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8094730 con 0x7fe8c80674b0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8cdff0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 0x7fe8c8093a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49752/0 (socket says 172.21.15.89:49752) 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8cdff0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 0x7fe8c8093a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56916/0 (socket says 172.21.15.89:56916) 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 -- 172.21.15.89:0/2630970324 learned_addr learned my addr 172.21.15.89:0/2630970324 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8cd7ef700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c80aae90 0x7fe8c8145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 -- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 msgr2=0x7fe8c8093a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 0x7fe8c8093a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 -- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c80aae90 msgr2=0x7fe8c8145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c80aae90 0x7fe8c8145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 -- 172.21.15.89:0/2630970324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c400b180 con 0x7fe8c8132df0 2024-02-09T23:58:26.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.143+0000 7fe8ce7f1700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe8c809cc20 tx=0x7fe8c0007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c000f470 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000f5d0 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b800b1e0 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c000f930 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c8094a10 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.144+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe8c0019030 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.145+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3192+0+0 (secure 0 0 0) 0x7fe8c0049cb0 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.145+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c80a9a90 con 0x7fe8c8132df0 2024-02-09T23:58:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.148+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe8c002ed90 con 0x7fe8c8132df0 2024-02-09T23:58:26.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:26.258+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe8c8095470 con 0x7fe8c8132df0 2024-02-09T23:58:27.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.005+0000 7fe8b6ffd700 1 -- 172.21.15.89:0/2630970324 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v16) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe8c00323b0 con 0x7fe8c8132df0 2024-02-09T23:58:27.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.016+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 >> v1:172.21.15.89:6816/39389 conn(0x7fe8a8038da0 legacy=0x7fe8a803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.016+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 msgr2=0x7fe8c8145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.016+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe8c809cc20 tx=0x7fe8c0007f40).stop 2024-02-09T23:58:27.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 shutdown_connections 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8c8132df0 0x7fe8c8145b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8c80674b0 0x7fe8c8093a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 --2- 172.21.15.89:0/2630970324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8c80aae90 0x7fe8c8145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 >> 172.21.15.89:0/2630970324 conn(0x7fe8c805c300 msgr2=0x7fe8c81389a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 shutdown_connections 2024-02-09T23:58:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.024+0000 7fe8d0254700 1 -- 172.21.15.89:0/2630970324 wait complete. 2024-02-09T23:58:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2024-02-09T23:58:27.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-09T23:58:27.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 Processor -- start 2024-02-09T23:58:27.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 -- start start 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9fc09aa10 0x7fd9fc0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc09b280 con 0x7fd9fc09adf0 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc09bc50 con 0x7fd9fc09aa10 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.154+0000 7fda009bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1367e0 con 0x7fd9fc064700 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9fc09aa10 0x7fd9fc0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fad9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd9fc09adf0 0x7fd9fc132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37776/0 (socket says 172.21.15.89:37776) 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fad9d700 1 -- 172.21.15.89:0/3092537873 learned_addr learned my addr 172.21.15.89:0/3092537873 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:27.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9fc09aa10 0x7fd9fc0621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49764/0 (socket says 172.21.15.89:49764) 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44600/0 (socket says 172.21.15.89:44600) 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 -- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 msgr2=0x7fd9fc136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 -- 172.21.15.89:0/3092537873 >> v1:172.21.15.89:6789/0 conn(0x7fd9fc09adf0 legacy=0x7fd9fc132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 -- 172.21.15.89:0/3092537873 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc136aa0 con 0x7fd9fc09aa10 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f959a700 1 -- 172.21.15.89:0/3092537873 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680874388 0 0) 0x7fd9fc09b280 con 0x7fd9fc09adf0 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f9d9b700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9fa59c700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc0621e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd9ec002f70 tx=0x7fd9ec006df0).ready entity=mon.0 client_cookie=e40357a79ed752e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f959a700 1 -- 172.21.15.89:0/3092537873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9ec00d570 con 0x7fd9fc09aa10 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f959a700 1 -- 172.21.15.89:0/3092537873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec000e90 con 0x7fd9fc09aa10 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.155+0000 7fd9f959a700 1 -- 172.21.15.89:0/3092537873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9ec00d8c0 con 0x7fd9fc09aa10 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 -- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 msgr2=0x7fd9fc0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc0621e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd9ec002f70 tx=0x7fd9ec006df0).stop 2024-02-09T23:58:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 -- 172.21.15.89:0/3092537873 shutdown_connections 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc0621e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 --2- 172.21.15.89:0/3092537873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 -- 172.21.15.89:0/3092537873 >> 172.21.15.89:0/3092537873 conn(0x7fd9fc06c0c0 msgr2=0x7fd9fc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 -- 172.21.15.89:0/3092537873 shutdown_connections 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 -- 172.21.15.89:0/3092537873 wait complete. 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.156+0000 7fda009bb700 1 Processor -- start 2024-02-09T23:58:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 -- start start 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc0a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc098890 con 0x7fd9fc09aa10 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc098b50 con 0x7fd9fc064700 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fda009bb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc098470 con 0x7fd9fc09adf0 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc0a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56930/0 (socket says 172.21.15.89:56930) 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 -- 172.21.15.89:0/3472157232 learned_addr learned my addr 172.21.15.89:0/3472157232 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9f9d9b700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 -- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 msgr2=0x7fd9fc0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc0a6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 -- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 msgr2=0x7fd9fc09d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc09d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.157+0000 7fd9fad9d700 1 -- 172.21.15.89:0/3472157232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f000d3b0 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fd9fad9d700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd9f4001250 tx=0x7fd9f4001360).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f4005ba0 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4005d00 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec00b180 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f4004a90 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.158+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc066970 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.159+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd9f4004bf0 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.159+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3574+0+0 (secure 0 0 0) 0x7fd9f404a2a0 con 0x7fd9fc09adf0 2024-02-09T23:58:27.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.159+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc097d70 con 0x7fd9fc09adf0 2024-02-09T23:58:27.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.162+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd9f402f240 con 0x7fd9fc09adf0 2024-02-09T23:58:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.303+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd9fc057a60 con 0x7fd9fc09adf0 2024-02-09T23:58:27.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.309+0000 7fd9eb7fe700 1 -- 172.21.15.89:0/3472157232 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd9f4032820 con 0x7fd9fc09adf0 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 >> v1:172.21.15.89:6816/39389 conn(0x7fd9d8038da0 legacy=0x7fd9d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 msgr2=0x7fd9fc148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd9f4001250 tx=0x7fd9f4001360).stop 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 shutdown_connections 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9fc09adf0 0x7fd9fc148c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc064700 0x7fd9fc0a6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 --2- 172.21.15.89:0/3472157232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc09aa10 0x7fd9fc09d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.311+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 >> 172.21.15.89:0/3472157232 conn(0x7fd9fc06c0c0 msgr2=0x7fd9fc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.312+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 shutdown_connections 2024-02-09T23:58:27.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.312+0000 7fda009bb700 1 -- 172.21.15.89:0/3472157232 wait complete. 2024-02-09T23:58:27.321 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 3 and data pool 4 2024-02-09T23:58:27.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.449+0000 7f256f098700 1 Processor -- start 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.449+0000 7f256f098700 1 -- start start 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256f098700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256f098700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256f098700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680a50b0 con 0x7f256805e170 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256f098700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256809f800 con 0x7f256809d570 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256f098700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256805e550 con 0x7f256813c6b0 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256d635700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44630/0 (socket says 172.21.15.89:44630) 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 -- 172.21.15.89:0/84614599 learned_addr learned my addr 172.21.15.89:0/84614599 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256d635700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56934/0 (socket says 172.21.15.89:56934) 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256ce34700 1 --1- 172.21.15.89:0/84614599 >> v1:172.21.15.89:6789/0 conn(0x7f256805e170 0x7f25680a45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37788/0 (socket says 172.21.15.89:37788) 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 -- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 msgr2=0x7f256813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f25677fe700 1 -- 172.21.15.89:0/84614599 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050294399 0 0) 0x7f25680a50b0 con 0x7f256805e170 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 -- 172.21.15.89:0/84614599 >> v1:172.21.15.89:6789/0 conn(0x7f256805e170 legacy=0x7f25680a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 -- 172.21.15.89:0/84614599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680a4190 con 0x7f256809d570 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f256d635700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.450+0000 7f2567fff700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f256809f940 tx=0x7f2554006eb0).ready entity=mon.1 client_cookie=d03ef864eb52e24b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f25677fe700 1 -- 172.21.15.89:0/84614599 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255400d570 con 0x7f256809d570 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f25677fe700 1 -- 172.21.15.89:0/84614599 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554000e90 con 0x7f256809d570 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f25677fe700 1 -- 172.21.15.89:0/84614599 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255400d8c0 con 0x7f256809d570 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 -- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 msgr2=0x7f256813c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f256809f940 tx=0x7f2554006eb0).stop 2024-02-09T23:58:27.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 -- 172.21.15.89:0/84614599 shutdown_connections 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f256813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 --2- 172.21.15.89:0/84614599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f256813c1c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 -- 172.21.15.89:0/84614599 >> 172.21.15.89:0/84614599 conn(0x7f25680a93f0 msgr2=0x7f25680a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 -- 172.21.15.89:0/84614599 shutdown_connections 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.451+0000 7f256f098700 1 -- 172.21.15.89:0/84614599 wait complete. 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.452+0000 7f256f098700 1 Processor -- start 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.452+0000 7f256f098700 1 -- start start 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 0x7f25681493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568092030 con 0x7f256805e170 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568149d60 con 0x7f256809d570 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256814a020 con 0x7f256813c6b0 2024-02-09T23:58:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2567fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256ce34700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 0x7f25681493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56938/0 (socket says 172.21.15.89:56938) 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2567fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44640/0 (socket says 172.21.15.89:44640) 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256ce34700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 0x7f25681493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49790/0 (socket says 172.21.15.89:49790) 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 -- 172.21.15.89:0/3402029028 learned_addr learned my addr 172.21.15.89:0/3402029028 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 -- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 msgr2=0x7f2568065a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 -- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 msgr2=0x7f25681493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 0x7f25681493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 -- 172.21.15.89:0/3402029028 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009470 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2567fff700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256d635700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f256000c000 tx=0x7f25600091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256000ee60 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000c850 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255400b1e0 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256000cbb0 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.453+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681387c0 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.454+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2560022070 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.454+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25680921e0 con 0x7f256813c6b0 2024-02-09T23:58:27.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.454+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f256004af30 con 0x7f256813c6b0 2024-02-09T23:58:27.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.457+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f25680921e0 con 0x7f256813c6b0 2024-02-09T23:58:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.570+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25680921e0 con 0x7f256813c6b0 2024-02-09T23:58:27.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.570+0000 7f2565ffb700 1 -- 172.21.15.89:0/3402029028 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7f25680921e0 con 0x7f256813c6b0 2024-02-09T23:58:27.573 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:27.573 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":17,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:27.305271+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:27.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 >> v1:172.21.15.89:6816/39389 conn(0x7f2548038e60 legacy=0x7f254803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 msgr2=0x7f2568065f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f256000c000 tx=0x7f25600091d0).stop 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 shutdown_connections 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f256813c6b0 0x7f2568065f40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f256805e170 0x7f25681493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 --2- 172.21.15.89:0/3402029028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f256809d570 0x7f2568065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 >> 172.21.15.89:0/3402029028 conn(0x7f25680a93f0 msgr2=0x7f256805b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 shutdown_connections 2024-02-09T23:58:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.572+0000 7f256f098700 1 -- 172.21.15.89:0/3402029028 wait complete. 2024-02-09T23:58:27.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.685+0000 7f0f773e2700 1 Processor -- start 2024-02-09T23:58:27.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.685+0000 7f0f773e2700 1 -- start start 2024-02-09T23:58:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f773e2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f773e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f773e2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7009bc50 con 0x7f0f70064700 2024-02-09T23:58:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f773e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f701365f0 con 0x7f0f70136140 2024-02-09T23:58:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f773e2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7009b2e0 con 0x7f0f7009aa10 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7597f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7497d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0f70064700 0x7f0f70132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37798/0 (socket says 172.21.15.89:37798) 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7597f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44644/0 (socket says 172.21.15.89:44644) 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56940/0 (socket says 172.21.15.89:56940) 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7497d700 1 -- 172.21.15.89:0/882578966 learned_addr learned my addr 172.21.15.89:0/882578966 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f5ffff700 1 -- 172.21.15.89:0/882578966 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732985001 0 0) 0x7f0f7009bc50 con 0x7f0f70064700 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 -- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 msgr2=0x7f0f7009adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 -- 172.21.15.89:0/882578966 >> v1:172.21.15.89:6789/0 conn(0x7f0f70064700 legacy=0x7f0f70132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7517e700 1 -- 172.21.15.89:0/882578966 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f701367e0 con 0x7f0f7009aa10 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.686+0000 7f0f7597f700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f7517e700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0f60002f70 tx=0x7f0f60006e80).ready entity=mon.2 client_cookie=1a54c7a67eac464a server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f5ffff700 1 -- 172.21.15.89:0/882578966 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6000ba00 con 0x7f0f7009aa10 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f5ffff700 1 -- 172.21.15.89:0/882578966 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60000e90 con 0x7f0f7009aa10 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f5ffff700 1 -- 172.21.15.89:0/882578966 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6000bda0 con 0x7f0f7009aa10 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 -- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 msgr2=0x7f0f700621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0f60002f70 tx=0x7f0f60006e80).stop 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 -- 172.21.15.89:0/882578966 shutdown_connections 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f7009adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 --2- 172.21.15.89:0/882578966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f700621e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 -- 172.21.15.89:0/882578966 >> 172.21.15.89:0/882578966 conn(0x7f0f7006c0c0 msgr2=0x7f0f7006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 -- 172.21.15.89:0/882578966 shutdown_connections 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.687+0000 7f0f773e2700 1 -- 172.21.15.89:0/882578966 wait complete. 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.688+0000 7f0f773e2700 1 Processor -- start 2024-02-09T23:58:27.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.688+0000 7f0f773e2700 1 -- start start 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 0x7f0f70097900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f70095640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70092fc0 con 0x7f0f70064700 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70097190 con 0x7f0f70136140 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70096010 con 0x7f0f7009aa10 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7517e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 0x7f0f70097900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7517e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 0x7f0f70097900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49802/0 (socket says 172.21.15.89:49802) 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44658/0 (socket says 172.21.15.89:44658) 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7517e700 1 -- 172.21.15.89:0/1407312045 learned_addr learned my addr 172.21.15.89:0/1407312045 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7497d700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f70095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 -- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 msgr2=0x7f0f70095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f70095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 -- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 msgr2=0x7f0f70097900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 0x7f0f70097900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 -- 172.21.15.89:0/1407312045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009470 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f7597f700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0f6800c000 tx=0x7f0f680091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6800c610 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800c770 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6000d410 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.689+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6800cad0 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.690+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f70097fb0 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.690+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0f68022070 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.690+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0f6804aeb0 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.691+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f70136aa0 con 0x7f0f70136140 2024-02-09T23:58:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.694+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0f68016030 con 0x7f0f70136140 2024-02-09T23:58:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.804+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f70057a60 con 0x7f0f70136140 2024-02-09T23:58:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.805+0000 7f0f5e7fc700 1 -- 172.21.15.89:0/1407312045 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7f0f6802a090 con 0x7f0f70136140 2024-02-09T23:58:27.807 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:27.807 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":17,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:27.305271+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:27.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 >> v1:172.21.15.89:6816/39389 conn(0x7f0f50038dd0 legacy=0x7f0f5003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 msgr2=0x7f0f70144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0f6800c000 tx=0x7f0f680091d0).stop 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 shutdown_connections 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f70136140 0x7f0f70144960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f70064700 0x7f0f70097900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 --2- 172.21.15.89:0/1407312045 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0f7009aa10 0x7f0f70095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 >> 172.21.15.89:0/1407312045 conn(0x7f0f7006c0c0 msgr2=0x7f0f701331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 shutdown_connections 2024-02-09T23:58:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.806+0000 7f0f773e2700 1 -- 172.21.15.89:0/1407312045 wait complete. 2024-02-09T23:58:27.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-09T23:58:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.920+0000 7fb76ea4d700 1 Processor -- start 2024-02-09T23:58:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.920+0000 7fb76ea4d700 1 -- start start 2024-02-09T23:58:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb76ea4d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7681337e0 0x7fb768133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb76ea4d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 0x7fb768139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb76ea4d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb768067990 con 0x7fb768139d80 2024-02-09T23:58:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb76ea4d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7680a4c50 con 0x7fb7681337e0 2024-02-09T23:58:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb76ea4d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680a4f10 con 0x7fb768067570 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7681337e0 0x7fb768133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7681337e0 0x7fb768133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49804/0 (socket says 172.21.15.89:49804) 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 -- 172.21.15.89:0/145868683 learned_addr learned my addr 172.21.15.89:0/145868683 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb7677fe700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 0x7fb768139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 -- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 msgr2=0x7fb768139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 0x7fb768139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 -- 172.21.15.89:0/145868683 >> v1:172.21.15.89:6789/0 conn(0x7fb768139d80 legacy=0x7fb76813a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.921+0000 7fb767fff700 1 -- 172.21.15.89:0/145868683 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768060520 con 0x7fb7681337e0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb7677fe700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 0x7fb768139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb767fff700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768133bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb75c002f70 tx=0x7fb75c006eb0).ready entity=mon.0 client_cookie=1fec7ee93f4e8e65 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb766ffd700 1 -- 172.21.15.89:0/145868683 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb75c00d570 con 0x7fb7681337e0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb766ffd700 1 -- 172.21.15.89:0/145868683 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c000e90 con 0x7fb7681337e0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb766ffd700 1 -- 172.21.15.89:0/145868683 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb75c00d900 con 0x7fb7681337e0 2024-02-09T23:58:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 -- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 msgr2=0x7fb768133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768133bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb75c002f70 tx=0x7fb75c006eb0).stop 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 -- 172.21.15.89:0/145868683 shutdown_connections 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768133bc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/145868683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768067570 0x7fb768139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 -- 172.21.15.89:0/145868683 >> 172.21.15.89:0/145868683 conn(0x7fb7680a93f0 msgr2=0x7fb7680a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 -- 172.21.15.89:0/145868683 shutdown_connections 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.922+0000 7fb76ea4d700 1 -- 172.21.15.89:0/145868683 wait complete. 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.923+0000 7fb76ea4d700 1 Processor -- start 2024-02-09T23:58:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.923+0000 7fb76ea4d700 1 -- start start 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680a1c30 con 0x7fb7681337e0 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680a1270 con 0x7fb768067570 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76ea4d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb76809f680 con 0x7fb768139d80 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb767fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76cfea700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb767fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44668/0 (socket says 172.21.15.89:44668) 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49820/0 (socket says 172.21.15.89:49820) 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76cfea700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56956/0 (socket says 172.21.15.89:56956) 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb767fff700 1 -- 172.21.15.89:0/3661823667 learned_addr learned my addr 172.21.15.89:0/3661823667 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 -- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 msgr2=0x7fb768131980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 -- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 msgr2=0x7fb7680a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb7677fe700 1 -- 172.21.15.89:0/3661823667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75800b180 con 0x7fb7681337e0 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb76cfea700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.924+0000 7fb767fff700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb7677fe700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb7680a1910 tx=0x7fb758006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:27.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb758010780 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580108e0 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c00b1e0 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb758010c40 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7680a04e0 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.925+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb75801c460 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.926+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb768065a50 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.926+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb75804ad30 con 0x7fb7681337e0 2024-02-09T23:58:27.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:27.929+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb7580335c0 con 0x7fb7681337e0 2024-02-09T23:58:28.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.074+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb768057a60 con 0x7fb7681337e0 2024-02-09T23:58:28.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.310+0000 7fb7657fa700 1 -- 172.21.15.89:0/3661823667 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb7580331b0 con 0x7fb7681337e0 2024-02-09T23:58:28.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 >> v1:172.21.15.89:6816/39389 conn(0x7fb748038da0 legacy=0x7fb74803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 msgr2=0x7fb768131490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb7680a1910 tx=0x7fb758006df0).stop 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 shutdown_connections 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb768139d80 0x7fb768131980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb768067570 0x7fb7680a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 --2- 172.21.15.89:0/3661823667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7681337e0 0x7fb768131490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 >> 172.21.15.89:0/3661823667 conn(0x7fb7680a93f0 msgr2=0x7fb7681329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 shutdown_connections 2024-02-09T23:58:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.311+0000 7fb76ea4d700 1 -- 172.21.15.89:0/3661823667 wait complete. 2024-02-09T23:58:28.328 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2024-02-09T23:58:28.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-02-09T23:58:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.432+0000 7f08bdf83700 1 Processor -- start 2024-02-09T23:58:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.432+0000 7f08bdf83700 1 -- start start 2024-02-09T23:58:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08bdf83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b80621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08bdf83700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 0x7f08b809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08bdf83700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b809bc50 con 0x7f08b8064700 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08bdf83700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b81365f0 con 0x7f08b8136140 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08bdf83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b809b2e0 con 0x7f08b809aa10 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 0x7f08b809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b80621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b6ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f08b8064700 0x7f08b8132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37816/0 (socket says 172.21.15.89:37816) 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b6ffd700 1 -- 172.21.15.89:0/3454869338 learned_addr learned my addr 172.21.15.89:0/3454869338 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 -- 172.21.15.89:0/3454869338 >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 msgr2=0x7f08b809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 --2- 172.21.15.89:0/3454869338 >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 0x7f08b809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 -- 172.21.15.89:0/3454869338 >> v1:172.21.15.89:6789/0 conn(0x7f08b8064700 legacy=0x7f08b8132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 -- 172.21.15.89:0/3454869338 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b81367e0 con 0x7f08b809aa10 2024-02-09T23:58:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b7fff700 1 --2- 172.21.15.89:0/3454869338 >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 0x7f08b809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b77fe700 1 --2- 172.21.15.89:0/3454869338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b80621e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f08ac002f70 tx=0x7f08ac006e80).ready entity=mon.1 client_cookie=dc833fe2e7a5134c server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.433+0000 7f08b67fc700 1 -- 172.21.15.89:0/3454869338 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac00b7d0 con 0x7f08b809aa10 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08b67fc700 1 -- 172.21.15.89:0/3454869338 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00b930 con 0x7f08b809aa10 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08b67fc700 1 -- 172.21.15.89:0/3454869338 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac00bc90 con 0x7f08b809aa10 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 -- 172.21.15.89:0/3454869338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 msgr2=0x7f08b80621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3454869338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b80621e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f08ac002f70 tx=0x7f08ac006e80).stop 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 -- 172.21.15.89:0/3454869338 shutdown_connections 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3454869338 >> v2:172.21.15.89:3300/0 conn(0x7f08b8136140 0x7f08b809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3454869338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b80621e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 -- 172.21.15.89:0/3454869338 >> 172.21.15.89:0/3454869338 conn(0x7f08b806c0c0 msgr2=0x7f08b806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 -- 172.21.15.89:0/3454869338 shutdown_connections 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.434+0000 7f08bdf83700 1 -- 172.21.15.89:0/3454869338 wait complete. 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.435+0000 7f08bdf83700 1 Processor -- start 2024-02-09T23:58:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.435+0000 7f08bdf83700 1 -- start start 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 0x7f08b8144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8095f20 con 0x7f08b8136140 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80946d0 con 0x7f08b809aa10 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8097710 con 0x7f08b8064700 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56970/0 (socket says 172.21.15.89:56970) 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b7fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 0x7f08b8144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b8144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44698/0 (socket says 172.21.15.89:44698) 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 -- 172.21.15.89:0/3801090110 learned_addr learned my addr 172.21.15.89:0/3801090110 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 -- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 msgr2=0x7f08b8144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b8144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 -- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 msgr2=0x7f08b8144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 0x7f08b8144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 -- 172.21.15.89:0/3801090110 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009470 con 0x7f08b8064700 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b7fff700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 0x7f08b8144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b77fe700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f08b8096090 tx=0x7f08b8063930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac020070 con 0x7f08b8064700 2024-02-09T23:58:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac000e90 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac00d410 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac00b7d0 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.436+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b80959b0 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.437+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f08ac02c070 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.437+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b8096290 con 0x7f08b8064700 2024-02-09T23:58:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.437+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f08ac04e120 con 0x7f08b8064700 2024-02-09T23:58:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.440+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f08ac001f00 con 0x7f08b8064700 2024-02-09T23:58:28.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:28.583+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f08b80960d0 con 0x7f08b8064700 2024-02-09T23:58:29.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.371+0000 7f08b4ff9700 1 -- 172.21.15.89:0/3801090110 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f08ac026980 con 0x7f08b8064700 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.373+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 >> v1:172.21.15.89:6816/39389 conn(0x7f0898038ec0 legacy=0x7f089803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.373+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 msgr2=0x7f08b8094b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.373+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f08b8096090 tx=0x7f08b8063930).stop 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 shutdown_connections 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08b8136140 0x7f08b8144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f08b8064700 0x7f08b8094b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 --2- 172.21.15.89:0/3801090110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08b809aa10 0x7f08b8144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 >> 172.21.15.89:0/3801090110 conn(0x7f08b806c0c0 msgr2=0x7f08b8133310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:29.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 shutdown_connections 2024-02-09T23:58:29.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.374+0000 7f08bdf83700 1 -- 172.21.15.89:0/3801090110 wait complete. 2024-02-09T23:58:29.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-09T23:58:29.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.500+0000 7f7358ab9700 1 Processor -- start 2024-02-09T23:58:29.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.500+0000 7f7358ab9700 1 -- start start 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7358ab9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f7354133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7358ab9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7354067570 0x7f7354139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7358ab9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7354067990 con 0x7f7354139d80 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7358ab9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540a4c50 con 0x7f7354067570 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7358ab9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73540a4f10 con 0x7f73541337e0 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7354067570 0x7f7354139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f735259c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f7354133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7352d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7354139d80 0x7f7354140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37832/0 (socket says 172.21.15.89:37832) 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7352d9d700 1 -- 172.21.15.89:0/624906762 learned_addr learned my addr 172.21.15.89:0/624906762 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7354067570 0x7f7354139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49852/0 (socket says 172.21.15.89:49852) 2024-02-09T23:58:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 -- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 msgr2=0x7f7354133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f7354133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 -- 172.21.15.89:0/624906762 >> v1:172.21.15.89:6789/0 conn(0x7f7354139d80 legacy=0x7f7354140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f7351d9b700 1 -- 172.21.15.89:0/624906762 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354060520 con 0x7f7354067570 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f735159a700 1 -- 172.21.15.89:0/624906762 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991109175 0 0) 0x7f7354067990 con 0x7f7354139d80 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.501+0000 7f735259c700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f7354133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7351d9b700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f7354139890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7344002f70 tx=0x7f7344006df0).ready entity=mon.0 client_cookie=63d31c8962a2093d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f735159a700 1 -- 172.21.15.89:0/624906762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f734400d570 con 0x7f7354067570 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f735159a700 1 -- 172.21.15.89:0/624906762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344000e90 con 0x7f7354067570 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f735159a700 1 -- 172.21.15.89:0/624906762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f734400d8c0 con 0x7f7354067570 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 -- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 msgr2=0x7f7354139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f7354139890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7344002f70 tx=0x7f7344006df0).stop 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 -- 172.21.15.89:0/624906762 shutdown_connections 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f7354133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 --2- 172.21.15.89:0/624906762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f7354139890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 -- 172.21.15.89:0/624906762 >> 172.21.15.89:0/624906762 conn(0x7f73540a93f0 msgr2=0x7f73540a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 -- 172.21.15.89:0/624906762 shutdown_connections 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.502+0000 7f7358ab9700 1 -- 172.21.15.89:0/624906762 wait complete. 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.503+0000 7f7358ab9700 1 Processor -- start 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.503+0000 7f7358ab9700 1 -- start start 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f73540a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f73541490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7354139d80 0x7f7354149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735409fce0 con 0x7f7354067570 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540a06c0 con 0x7f7354139d80 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73540a1520 con 0x7f73541337e0 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f735259c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f73540a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7352d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7354139d80 0x7f7354149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f735259c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f73540a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49856/0 (socket says 172.21.15.89:49856) 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f73541490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f735259c700 1 -- 172.21.15.89:0/3097567030 learned_addr learned my addr 172.21.15.89:0/3097567030 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 -- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7354139d80 msgr2=0x7f7354149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7354139d80 0x7f7354149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 -- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 msgr2=0x7f73540a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f73540a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 -- 172.21.15.89:0/3097567030 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734800b180 con 0x7f73541337e0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7351d9b700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f73541490a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7344002f70 tx=0x7f7344014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7344013de0 con 0x7f73541337e0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734401e400 con 0x7f73541337e0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734400b180 con 0x7f73541337e0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f734401e760 con 0x7f73541337e0 2024-02-09T23:58:29.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.504+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73540a56a0 con 0x7f73541337e0 2024-02-09T23:58:29.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.505+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7344025030 con 0x7f73541337e0 2024-02-09T23:58:29.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.506+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f734404b510 con 0x7f73541337e0 2024-02-09T23:58:29.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.506+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354065a50 con 0x7f73541337e0 2024-02-09T23:58:29.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.509+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7344006320 con 0x7f73541337e0 2024-02-09T23:58:29.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:29.650+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7354057a60 con 0x7f73541337e0 2024-02-09T23:58:30.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.375+0000 7f73437fe700 1 -- 172.21.15.89:0/3097567030 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f734401e8c0 con 0x7f73541337e0 2024-02-09T23:58:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 >> v1:172.21.15.89:6816/39389 conn(0x7f7330038dd0 legacy=0x7f733003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 msgr2=0x7f73541490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f73541490a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7344002f70 tx=0x7f7344014000).stop 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 shutdown_connections 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7354139d80 0x7f7354149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354067570 0x7f73540a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 --2- 172.21.15.89:0/3097567030 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f73541337e0 0x7f73541490a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 >> 172.21.15.89:0/3097567030 conn(0x7f73540a93f0 msgr2=0x7f7354067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 shutdown_connections 2024-02-09T23:58:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.377+0000 7f7358ab9700 1 -- 172.21.15.89:0/3097567030 wait complete. 2024-02-09T23:58:30.392 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-09T23:58:30.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:30.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.498+0000 7f17f9516700 1 Processor -- start 2024-02-09T23:58:30.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.498+0000 7f17f9516700 1 -- start start 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17f41366f0 0x7f17f409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f409a380 con 0x7f17f41366f0 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4135fe0 con 0x7f17f4099a00 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f9516700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4099e90 con 0x7f17f409b520 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17f41366f0 0x7f17f409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f27fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17f41366f0 0x7f17f409bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49860/0 (socket says 172.21.15.89:49860) 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f27fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57002/0 (socket says 172.21.15.89:57002) 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44716/0 (socket says 172.21.15.89:44716) 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 -- 172.21.15.89:0/3105794716 learned_addr learned my addr 172.21.15.89:0/3105794716 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 -- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 msgr2=0x7f17f4136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 -- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 msgr2=0x7f17f4139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f2ffd700 1 -- 172.21.15.89:0/3105794716 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f409a0c0 con 0x7f17f41366f0 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.499+0000 7f17f37fe700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f27fc700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f2ffd700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f41366f0 0x7f17f409bbb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f17ec0032f0 tx=0x7f17ec009290).ready entity=mon.0 client_cookie=ff0e437886aa43bd server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f1ffb700 1 -- 172.21.15.89:0/3105794716 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ec00b6c0 con 0x7f17f41366f0 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f1ffb700 1 -- 172.21.15.89:0/3105794716 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00b820 con 0x7f17f41366f0 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f1ffb700 1 -- 172.21.15.89:0/3105794716 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ec00b990 con 0x7f17f41366f0 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 -- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f41366f0 msgr2=0x7f17f409bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f41366f0 0x7f17f409bbb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f17ec0032f0 tx=0x7f17ec009290).stop 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 -- 172.21.15.89:0/3105794716 shutdown_connections 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f4099a00 0x7f17f4139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f41366f0 0x7f17f409bbb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 --2- 172.21.15.89:0/3105794716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f409b520 0x7f17f4136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 -- 172.21.15.89:0/3105794716 >> 172.21.15.89:0/3105794716 conn(0x7f17f406c0c0 msgr2=0x7f17f406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 -- 172.21.15.89:0/3105794716 shutdown_connections 2024-02-09T23:58:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.500+0000 7f17f9516700 1 -- 172.21.15.89:0/3105794716 wait complete. 2024-02-09T23:58:30.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.501+0000 7f17f9516700 1 Processor -- start 2024-02-09T23:58:30.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.501+0000 7f17f9516700 1 -- start start 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 0x7f17f4148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40971e0 con 0x7f17f4099a00 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40973e0 con 0x7f17f409b520 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f9516700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4095ef0 con 0x7f17f41366f0 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f2ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f2ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49876/0 (socket says 172.21.15.89:49876) 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44718/0 (socket says 172.21.15.89:44718) 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f2ffd700 1 -- 172.21.15.89:0/3839691653 learned_addr learned my addr 172.21.15.89:0/3839691653 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f37fe700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 0x7f17f4148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 -- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 msgr2=0x7f17f4148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 0x7f17f4148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 -- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 msgr2=0x7f17f4098470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 -- 172.21.15.89:0/3839691653 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e400b180 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f37fe700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 0x7f17f4148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f2ffd700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.502+0000 7f17f27fc700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f17e800c000 tx=0x7f17e8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e8012600 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8012760 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e8012ac0 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e800b120 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec009530 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.503+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f17e8022070 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.504+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4067cb0 con 0x7f17f409b520 2024-02-09T23:58:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.504+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f17e804ab90 con 0x7f17f409b520 2024-02-09T23:58:30.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.507+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f17e80334c0 con 0x7f17f409b520 2024-02-09T23:58:30.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.648+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17f4057a60 con 0x7f17f409b520 2024-02-09T23:58:30.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.648+0000 7f17e3fff700 1 -- 172.21.15.89:0/3839691653 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2320 (secure 0 0 0) 0x7f17e80330b0 con 0x7f17f409b520 2024-02-09T23:58:30.651 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:30.651 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-09T23:58:30.373217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-09T23:58:30.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.649+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 >> v1:172.21.15.89:6816/39389 conn(0x7f17d0038e60 legacy=0x7f17d003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.649+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 msgr2=0x7f17f4095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.649+0000 7f17f9516700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f17e800c000 tx=0x7f17e8008040).stop 2024-02-09T23:58:30.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 shutdown_connections 2024-02-09T23:58:30.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f41366f0 0x7f17f4148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f4099a00 0x7f17f4098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 --2- 172.21.15.89:0/3839691653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f409b520 0x7f17f4095520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 >> 172.21.15.89:0/3839691653 conn(0x7f17f406c0c0 msgr2=0x7f17f40663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 shutdown_connections 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.650+0000 7f17f9516700 1 -- 172.21.15.89:0/3839691653 wait complete. 2024-02-09T23:58:30.653 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2024-02-09T23:58:30.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:30.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.761+0000 7f977c576700 1 Processor -- start 2024-02-09T23:58:30.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.761+0000 7f977c576700 1 -- start start 2024-02-09T23:58:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 0x7f97740621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977409b280 con 0x7f977409aa10 2024-02-09T23:58:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977409bc50 con 0x7f977409adf0 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977c576700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97741367e0 con 0x7f9774064700 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977ab13700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f9779b11700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977a312700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 0x7f97740621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977ab13700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44728/0 (socket says 172.21.15.89:44728) 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f9779b11700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57026/0 (socket says 172.21.15.89:57026) 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.762+0000 7f977ab13700 1 -- 172.21.15.89:0/3194519912 learned_addr learned my addr 172.21.15.89:0/3194519912 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 -- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 msgr2=0x7f9774132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 -- 172.21.15.89:0/3194519912 >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 msgr2=0x7f97740621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 --2- 172.21.15.89:0/3194519912 >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 0x7f97740621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 -- 172.21.15.89:0/3194519912 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774136aa0 con 0x7f9774064700 2024-02-09T23:58:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977ab13700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977a312700 1 --2- 172.21.15.89:0/3194519912 >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 0x7f97740621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779b11700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9770002f70 tx=0x7f9770006d90).ready entity=mon.2 client_cookie=21f1b40cff0158e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779310700 1 -- 172.21.15.89:0/3194519912 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977000e540 con 0x7f9774064700 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779310700 1 -- 172.21.15.89:0/3194519912 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770000e90 con 0x7f9774064700 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f9779310700 1 -- 172.21.15.89:0/3194519912 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977000e890 con 0x7f9774064700 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 -- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 msgr2=0x7f9774136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9770002f70 tx=0x7f9770006d90).stop 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 -- 172.21.15.89:0/3194519912 shutdown_connections 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977409adf0 0x7f9774132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 --2- 172.21.15.89:0/3194519912 >> v2:172.21.15.89:3300/0 conn(0x7f977409aa10 0x7f97740621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 --2- 172.21.15.89:0/3194519912 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9774064700 0x7f9774136140 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 -- 172.21.15.89:0/3194519912 >> 172.21.15.89:0/3194519912 conn(0x7f977406c0c0 msgr2=0x7f977406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 -- 172.21.15.89:0/3194519912 shutdown_connections 2024-02-09T23:58:30.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.763+0000 7f977c576700 1 -- 172.21.15.89:0/3194519912 wait complete. 2024-02-09T23:58:30.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.764+0000 7f977c576700 1 Processor -- start 2024-02-09T23:58:30.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.764+0000 7f977c576700 1 -- start start 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 0x7f9774067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 0x7f97740a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 0x7f9774144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740a8a50 con 0x7f977409aa10 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740a82e0 con 0x7f9774064700 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977c576700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97740a8c90 con 0x7f977409adf0 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977a312700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 0x7f9774067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977ab13700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 0x7f9774144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977a312700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 0x7f9774067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44744/0 (socket says 172.21.15.89:44744) 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977a312700 1 -- 172.21.15.89:0/66849795 learned_addr learned my addr 172.21.15.89:0/66849795 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:30.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 0x7f97740a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 -- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 msgr2=0x7f9774144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 0x7f9774144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 -- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 msgr2=0x7f9774067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 0x7f9774067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 -- 172.21.15.89:0/66849795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976800d410 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f977ab13700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 0x7f9774144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.765+0000 7f9779b11700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 0x7f97740a8560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9770002f70 tx=0x7f9770014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977000e750 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000e8b0 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c009530 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977000ec10 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977000b120 con 0x7f977409aa10 2024-02-09T23:58:30.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.766+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9770021070 con 0x7f977409aa10 2024-02-09T23:58:30.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.767+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f977004f1a0 con 0x7f977409aa10 2024-02-09T23:58:30.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.767+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977406b1b0 con 0x7f977409aa10 2024-02-09T23:58:30.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.770+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f977000ed70 con 0x7f977409aa10 2024-02-09T23:58:30.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.879+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9774060880 con 0x7f977409aa10 2024-02-09T23:58:30.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.880+0000 7f97677fe700 1 -- 172.21.15.89:0/66849795 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f9770028030 con 0x7f977409aa10 2024-02-09T23:58:30.882 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:30.882 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 >> v1:172.21.15.89:6816/39389 conn(0x7f9754038f50 legacy=0x7f975403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 msgr2=0x7f97740a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 0x7f97740a8560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9770002f70 tx=0x7f9770014000).stop 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 shutdown_connections 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f977409adf0 0x7f9774144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9774064700 0x7f9774067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 --2- 172.21.15.89:0/66849795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f977409aa10 0x7f97740a8560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 >> 172.21.15.89:0/66849795 conn(0x7f977406c0c0 msgr2=0x7f977412eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 shutdown_connections 2024-02-09T23:58:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.881+0000 7f977c576700 1 -- 172.21.15.89:0/66849795 wait complete. 2024-02-09T23:58:30.894 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-09T23:58:30.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T23:58:30.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 Processor -- start 2024-02-09T23:58:30.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 -- start start 2024-02-09T23:58:30.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 0x7f51f813c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 0x7f51f813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f80a4190 con 0x7f51f805dfb0 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80a62d0 con 0x7f51f809d570 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.994+0000 7f51ffea9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f809df90 con 0x7f51f813c6b0 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fdc45700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f51f805dfb0 0x7f51f80a45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37836/0 (socket says 172.21.15.89:37836) 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fe446700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 0x7f51f813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fdc45700 1 -- 172.21.15.89:0/3019343939 learned_addr learned my addr 172.21.15.89:0/3019343939 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 0x7f51f813c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fcc43700 1 -- 172.21.15.89:0/3019343939 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821056547 0 0) 0x7f51f80a4190 con 0x7f51f805dfb0 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 -- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 msgr2=0x7f51f813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 0x7f51f813eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 -- 172.21.15.89:0/3019343939 >> v1:172.21.15.89:6789/0 conn(0x7f51f805dfb0 legacy=0x7f51f80a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 -- 172.21.15.89:0/3019343939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80a4cd0 con 0x7f51f809d570 2024-02-09T23:58:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fe446700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 0x7f51f813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fd444700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 0x7f51f813c1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f51e8002f70 tx=0x7f51e8006df0).ready entity=mon.1 client_cookie=d235ea3e5a7719ae server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fcc43700 1 -- 172.21.15.89:0/3019343939 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e800d570 con 0x7f51f809d570 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fcc43700 1 -- 172.21.15.89:0/3019343939 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8000e90 con 0x7f51f809d570 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.995+0000 7f51fcc43700 1 -- 172.21.15.89:0/3019343939 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e800d8c0 con 0x7f51f809d570 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 -- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 msgr2=0x7f51f813c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 0x7f51f813c1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f51e8002f70 tx=0x7f51e8006df0).stop 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 -- 172.21.15.89:0/3019343939 shutdown_connections 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f813c6b0 0x7f51f813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3019343939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f809d570 0x7f51f813c1c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 -- 172.21.15.89:0/3019343939 >> 172.21.15.89:0/3019343939 conn(0x7f51f80a93f0 msgr2=0x7f51f80a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 -- 172.21.15.89:0/3019343939 shutdown_connections 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 -- 172.21.15.89:0/3019343939 wait complete. 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.996+0000 7f51ffea9700 1 Processor -- start 2024-02-09T23:58:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 -- start start 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 0x7f51f809fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f813c6b0 0x7f51f80a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f809bdc0 con 0x7f51f813c6b0 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8092030 con 0x7f51f805dfb0 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51ffea9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80922d0 con 0x7f51f809d570 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fd444700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 0x7f51f809fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44772/0 (socket says 172.21.15.89:44772) 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 -- 172.21.15.89:0/3771047002 learned_addr learned my addr 172.21.15.89:0/3771047002 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fe446700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f813c6b0 0x7f51f80a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 -- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 msgr2=0x7f51f809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 0x7f51f809fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 -- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f813c6b0 msgr2=0x7f51f80a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f813c6b0 0x7f51f80a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fdc45700 1 -- 172.21.15.89:0/3771047002 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009470 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.997+0000 7f51fd444700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 0x7f51f809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51fdc45700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f51f4000bc0 tx=0x7f51f4007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f40070d0 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4007230 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e800b180 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f4005610 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.998+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f8067040 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.999+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f51f4010070 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.999+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f8057a60 con 0x7f51f805dfb0 2024-02-09T23:58:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:30.999+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f51f4049fe0 con 0x7f51f805dfb0 2024-02-09T23:58:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.002+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f51f402eee0 con 0x7f51f805dfb0 2024-02-09T23:58:31.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.109+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 --> v1:172.21.15.89:6816/39389 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51f80a3600 con 0x7f51d8038da0 2024-02-09T23:58:31.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.116+0000 7f51e6ffd700 1 -- 172.21.15.89:0/3771047002 <== mgr.4100 v1:172.21.15.89:6816/39389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246994 (unknown 2965378022 0 3521224733) 0x7f51f80a3600 con 0x7f51d8038da0 2024-02-09T23:58:31.125 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 >> v1:172.21.15.89:6816/39389 conn(0x7f51d8038da0 legacy=0x7f51d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 msgr2=0x7f51f80945e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f51f4000bc0 tx=0x7f51f4007a60).stop 2024-02-09T23:58:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 shutdown_connections 2024-02-09T23:58:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f813c6b0 0x7f51f80a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f805dfb0 0x7f51f80945e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 --2- 172.21.15.89:0/3771047002 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f51f809d570 0x7f51f809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 >> 172.21.15.89:0/3771047002 conn(0x7f51f80a93f0 msgr2=0x7f51f80a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 shutdown_connections 2024-02-09T23:58:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.118+0000 7f51ffea9700 1 -- 172.21.15.89:0/3771047002 wait complete. 2024-02-09T23:58:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-09T23:58:31.133 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-09T23:58:30.554311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195008,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292352,"statfs":{"total":386547056640,"available":382251368448,"internally_reserved":4294967296,"allocated":688128,"data_stored":203855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334099+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-09T23:58:27.334099+0000","last_peered":"2024-02-09T23:58:27.334099+0000","last_clean":"2024-02-09T23:58:27.334099+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-09T23:58:27.334099+0000","last_undegraded":"2024-02-09T23:58:27.334099+0000","last_fullsized":"2024-02-09T23:58:27.334099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357573+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-09T23:58:27.357573+0000","last_peered":"2024-02-09T23:58:27.357573+0000","last_clean":"2024-02-09T23:58:27.357573+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-09T23:58:27.357573+0000","last_undegraded":"2024-02-09T23:58:27.357573+0000","last_fullsized":"2024-02-09T23:58:27.357573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.351216+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-09T23:58:27.351216+0000","last_peered":"2024-02-09T23:58:27.351216+0000","last_clean":"2024-02-09T23:58:27.351216+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-09T23:58:27.351216+0000","last_undegraded":"2024-02-09T23:58:27.351216+0000","last_fullsized":"2024-02-09T23:58:27.351216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345605+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-09T23:58:27.345605+0000","last_peered":"2024-02-09T23:58:27.345605+0000","last_clean":"2024-02-09T23:58:27.345605+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-09T23:58:27.345605+0000","last_undegraded":"2024-02-09T23:58:27.345605+0000","last_fullsized":"2024-02-09T23:58:27.345605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333159+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-09T23:58:27.333159+0000","last_peered":"2024-02-09T23:58:27.333159+0000","last_clean":"2024-02-09T23:58:27.333159+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-09T23:58:27.333159+0000","last_undegraded":"2024-02-09T23:58:27.333159+0000","last_fullsized":"2024-02-09T23:58:27.333159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340038+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-09T23:58:27.340038+0000","last_peered":"2024-02-09T23:58:27.340038+0000","last_clean":"2024-02-09T23:58:27.340038+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-09T23:58:27.340038+0000","last_undegraded":"2024-02-09T23:58:27.340038+0000","last_fullsized":"2024-02-09T23:58:27.340038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334038+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-09T23:58:27.334038+0000","last_peered":"2024-02-09T23:58:27.334038+0000","last_clean":"2024-02-09T23:58:27.334038+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-09T23:58:27.334038+0000","last_undegraded":"2024-02-09T23:58:27.334038+0000","last_fullsized":"2024-02-09T23:58:27.334038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352692+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-09T23:58:27.352692+0000","last_peered":"2024-02-09T23:58:27.352692+0000","last_clean":"2024-02-09T23:58:27.352692+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-09T23:58:27.352692+0000","last_undegraded":"2024-02-09T23:58:27.352692+0000","last_fullsized":"2024-02-09T23:58:27.352692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331551+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-09T23:58:27.331551+0000","last_peered":"2024-02-09T23:58:27.331551+0000","last_clean":"2024-02-09T23:58:27.331551+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-09T23:58:27.331551+0000","last_undegraded":"2024-02-09T23:58:27.331551+0000","last_fullsized":"2024-02-09T23:58:27.331551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347929+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-09T23:58:27.347929+0000","last_peered":"2024-02-09T23:58:27.347929+0000","last_clean":"2024-02-09T23:58:27.347929+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-09T23:58:27.347929+0000","last_undegraded":"2024-02-09T23:58:27.347929+0000","last_fullsized":"2024-02-09T23:58:27.347929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347930+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-09T23:58:27.347930+0000","last_peered":"2024-02-09T23:58:27.347930+0000","last_clean":"2024-02-09T23:58:27.347930+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-09T23:58:27.347930+0000","last_undegraded":"2024-02-09T23:58:27.347930+0000","last_fullsized":"2024-02-09T23:58:27.347930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336683+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-09T23:58:27.336683+0000","last_peered":"2024-02-09T23:58:27.336683+0000","last_clean":"2024-02-09T23:58:27.336683+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-09T23:58:27.336683+0000","last_undegraded":"2024-02-09T23:58:27.336683+0000","last_fullsized":"2024-02-09T23:58:27.336683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332924+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-09T23:58:27.332924+0000","last_peered":"2024-02-09T23:58:27.332924+0000","last_clean":"2024-02-09T23:58:27.332924+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-09T23:58:27.332924+0000","last_undegraded":"2024-02-09T23:58:27.332924+0000","last_fullsized":"2024-02-09T23:58:27.332924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350195+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-09T23:58:27.350195+0000","last_peered":"2024-02-09T23:58:27.350195+0000","last_clean":"2024-02-09T23:58:27.350195+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-09T23:58:27.350195+0000","last_undegraded":"2024-02-09T23:58:27.350195+0000","last_fullsized":"2024-02-09T23:58:27.350195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345711+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-09T23:58:27.345711+0000","last_peered":"2024-02-09T23:58:27.345711+0000","last_clean":"2024-02-09T23:58:27.345711+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-09T23:58:27.345711+0000","last_undegraded":"2024-02-09T23:58:27.345711+0000","last_fullsized":"2024-02-09T23:58:27.345711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334575+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-09T23:58:27.334575+0000","last_peered":"2024-02-09T23:58:27.334575+0000","last_clean":"2024-02-09T23:58:27.334575+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-09T23:58:27.334575+0000","last_undegraded":"2024-02-09T23:58:27.334575+0000","last_fullsized":"2024-02-09T23:58:27.334575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333238+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-09T23:58:27.333238+0000","last_peered":"2024-02-09T23:58:27.333238+0000","last_clean":"2024-02-09T23:58:27.333238+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-09T23:58:27.333238+0000","last_undegraded":"2024-02-09T23:58:27.333238+0000","last_fullsized":"2024-02-09T23:58:27.333238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333651+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-09T23:58:27.333651+0000","last_peered":"2024-02-09T23:58:27.333651+0000","last_clean":"2024-02-09T23:58:27.333651+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-09T23:58:27.333651+0000","last_undegraded":"2024-02-09T23:58:27.333651+0000","last_fullsized":"2024-02-09T23:58:27.333651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336247+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-09T23:58:27.336247+0000","last_peered":"2024-02-09T23:58:27.336247+0000","last_clean":"2024-02-09T23:58:27.336247+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-09T23:58:27.336247+0000","last_undegraded":"2024-02-09T23:58:27.336247+0000","last_fullsized":"2024-02-09T23:58:27.336247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.341796+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-09T23:58:27.341796+0000","last_peered":"2024-02-09T23:58:27.341796+0000","last_clean":"2024-02-09T23:58:27.341796+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-09T23:58:27.341796+0000","last_undegraded":"2024-02-09T23:58:27.341796+0000","last_fullsized":"2024-02-09T23:58:27.341796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.341174+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-09T23:58:27.341174+0000","last_peered":"2024-02-09T23:58:27.341174+0000","last_clean":"2024-02-09T23:58:27.341174+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-09T23:58:27.341174+0000","last_undegraded":"2024-02-09T23:58:27.341174+0000","last_fullsized":"2024-02-09T23:58:27.341174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356686+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-09T23:58:27.356686+0000","last_peered":"2024-02-09T23:58:27.356686+0000","last_clean":"2024-02-09T23:58:27.356686+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-09T23:58:27.356686+0000","last_undegraded":"2024-02-09T23:58:27.356686+0000","last_fullsized":"2024-02-09T23:58:27.356686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335658+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-09T23:58:27.335658+0000","last_peered":"2024-02-09T23:58:27.335658+0000","last_clean":"2024-02-09T23:58:27.335658+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-09T23:58:27.335658+0000","last_undegraded":"2024-02-09T23:58:27.335658+0000","last_fullsized":"2024-02-09T23:58:27.335658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352309+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-09T23:58:27.352309+0000","last_peered":"2024-02-09T23:58:27.352309+0000","last_clean":"2024-02-09T23:58:27.352309+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-09T23:58:27.352309+0000","last_undegraded":"2024-02-09T23:58:27.352309+0000","last_fullsized":"2024-02-09T23:58:27.352309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.346106+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-09T23:58:27.346106+0000","last_peered":"2024-02-09T23:58:27.346106+0000","last_clean":"2024-02-09T23:58:27.346106+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-09T23:58:27.346106+0000","last_undegraded":"2024-02-09T23:58:27.346106+0000","last_fullsized":"2024-02-09T23:58:27.346106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350703+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-09T23:58:27.350703+0000","last_peered":"2024-02-09T23:58:27.350703+0000","last_clean":"2024-02-09T23:58:27.350703+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-09T23:58:27.350703+0000","last_undegraded":"2024-02-09T23:58:27.350703+0000","last_fullsized":"2024-02-09T23:58:27.350703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337216+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-09T23:58:27.337216+0000","last_peered":"2024-02-09T23:58:27.337216+0000","last_clean":"2024-02-09T23:58:27.337216+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-09T23:58:27.337216+0000","last_undegraded":"2024-02-09T23:58:27.337216+0000","last_fullsized":"2024-02-09T23:58:27.337216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333805+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-09T23:58:27.333805+0000","last_peered":"2024-02-09T23:58:27.333805+0000","last_clean":"2024-02-09T23:58:27.333805+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-09T23:58:27.333805+0000","last_undegraded":"2024-02-09T23:58:27.333805+0000","last_fullsized":"2024-02-09T23:58:27.333805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356716+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-09T23:58:27.356716+0000","last_peered":"2024-02-09T23:58:27.356716+0000","last_clean":"2024-02-09T23:58:27.356716+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-09T23:58:27.356716+0000","last_undegraded":"2024-02-09T23:58:27.356716+0000","last_fullsized":"2024-02-09T23:58:27.356716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.034729+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-09T23:58:27.034729+0000","last_peered":"2024-02-09T23:58:27.034729+0000","last_clean":"2024-02-09T23:58:27.034729+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-09T23:58:27.034729+0000","last_undegraded":"2024-02-09T23:58:27.034729+0000","last_fullsized":"2024-02-09T23:58:27.034729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357566+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-09T23:58:27.357566+0000","last_peered":"2024-02-09T23:58:27.357566+0000","last_clean":"2024-02-09T23:58:27.357566+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-09T23:58:27.357566+0000","last_undegraded":"2024-02-09T23:58:27.357566+0000","last_fullsized":"2024-02-09T23:58:27.357566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.322312+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-09T23:58:28.322312+0000","last_peered":"2024-02-09T23:58:28.322312+0000","last_clean":"2024-02-09T23:58:28.322312+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-09T23:58:28.322312+0000","last_undegraded":"2024-02-09T23:58:28.322312+0000","last_fullsized":"2024-02-09T23:58:28.322312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356684+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-09T23:58:27.356684+0000","last_peered":"2024-02-09T23:58:27.356684+0000","last_clean":"2024-02-09T23:58:27.356684+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-09T23:58:27.356684+0000","last_undegraded":"2024-02-09T23:58:27.356684+0000","last_fullsized":"2024-02-09T23:58:27.356684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390174+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-09T23:58:29.390174+0000","last_peered":"2024-02-09T23:58:29.390174+0000","last_clean":"2024-02-09T23:58:29.390174+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-09T23:58:29.390174+0000","last_undegraded":"2024-02-09T23:58:29.390174+0000","last_fullsized":"2024-02-09T23:58:29.390174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356876+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-09T23:58:27.356876+0000","last_peered":"2024-02-09T23:58:27.356876+0000","last_clean":"2024-02-09T23:58:27.356876+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-09T23:58:27.356876+0000","last_undegraded":"2024-02-09T23:58:27.356876+0000","last_fullsized":"2024-02-09T23:58:27.356876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.384963+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-09T23:58:29.384963+0000","last_peered":"2024-02-09T23:58:29.384963+0000","last_clean":"2024-02-09T23:58:29.384963+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-09T23:58:29.384963+0000","last_undegraded":"2024-02-09T23:58:29.384963+0000","last_fullsized":"2024-02-09T23:58:29.384963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335972+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-09T23:58:27.335972+0000","last_peered":"2024-02-09T23:58:27.335972+0000","last_clean":"2024-02-09T23:58:27.335972+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-09T23:58:27.335972+0000","last_undegraded":"2024-02-09T23:58:27.335972+0000","last_fullsized":"2024-02-09T23:58:27.335972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325146+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-09T23:58:28.325146+0000","last_peered":"2024-02-09T23:58:28.325146+0000","last_clean":"2024-02-09T23:58:28.325146+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-09T23:58:28.325146+0000","last_undegraded":"2024-02-09T23:58:28.325146+0000","last_fullsized":"2024-02-09T23:58:28.325146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347143+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-09T23:58:27.347143+0000","last_peered":"2024-02-09T23:58:27.347143+0000","last_clean":"2024-02-09T23:58:27.347143+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-09T23:58:27.347143+0000","last_undegraded":"2024-02-09T23:58:27.347143+0000","last_fullsized":"2024-02-09T23:58:27.347143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387191+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-09T23:58:29.387191+0000","last_peered":"2024-02-09T23:58:29.387191+0000","last_clean":"2024-02-09T23:58:29.387191+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-09T23:58:29.387191+0000","last_undegraded":"2024-02-09T23:58:29.387191+0000","last_fullsized":"2024-02-09T23:58:29.387191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332881+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-09T23:58:27.332881+0000","last_peered":"2024-02-09T23:58:27.332881+0000","last_clean":"2024-02-09T23:58:27.332881+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-09T23:58:27.332881+0000","last_undegraded":"2024-02-09T23:58:27.332881+0000","last_fullsized":"2024-02-09T23:58:27.332881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390474+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-09T23:58:29.390474+0000","last_peered":"2024-02-09T23:58:29.390474+0000","last_clean":"2024-02-09T23:58:29.390474+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-09T23:58:29.390474+0000","last_undegraded":"2024-02-09T23:58:29.390474+0000","last_fullsized":"2024-02-09T23:58:29.390474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.355440+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-09T23:58:27.355440+0000","last_peered":"2024-02-09T23:58:27.355440+0000","last_clean":"2024-02-09T23:58:27.355440+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-09T23:58:27.355440+0000","last_undegraded":"2024-02-09T23:58:27.355440+0000","last_fullsized":"2024-02-09T23:58:27.355440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387264+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-09T23:58:29.387264+0000","last_peered":"2024-02-09T23:58:29.387264+0000","last_clean":"2024-02-09T23:58:29.387264+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-09T23:58:29.387264+0000","last_undegraded":"2024-02-09T23:58:29.387264+0000","last_fullsized":"2024-02-09T23:58:29.387264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337193+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-09T23:58:27.337193+0000","last_peered":"2024-02-09T23:58:27.337193+0000","last_clean":"2024-02-09T23:58:27.337193+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-09T23:58:27.337193+0000","last_undegraded":"2024-02-09T23:58:27.337193+0000","last_fullsized":"2024-02-09T23:58:27.337193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317849+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-09T23:58:27.317849+0000","last_peered":"2024-02-09T23:58:27.317849+0000","last_clean":"2024-02-09T23:58:27.317849+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-09T23:58:27.317849+0000","last_undegraded":"2024-02-09T23:58:27.317849+0000","last_fullsized":"2024-02-09T23:58:27.317849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.343562+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-09T23:58:27.343562+0000","last_peered":"2024-02-09T23:58:27.343562+0000","last_clean":"2024-02-09T23:58:27.343562+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-09T23:58:27.343562+0000","last_undegraded":"2024-02-09T23:58:27.343562+0000","last_fullsized":"2024-02-09T23:58:27.343562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357978+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-09T23:58:27.357978+0000","last_peered":"2024-02-09T23:58:27.357978+0000","last_clean":"2024-02-09T23:58:27.357978+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-09T23:58:27.357978+0000","last_undegraded":"2024-02-09T23:58:27.357978+0000","last_fullsized":"2024-02-09T23:58:27.357978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356663+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-09T23:58:27.356663+0000","last_peered":"2024-02-09T23:58:27.356663+0000","last_clean":"2024-02-09T23:58:27.356663+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-09T23:58:27.356663+0000","last_undegraded":"2024-02-09T23:58:27.356663+0000","last_fullsized":"2024-02-09T23:58:27.356663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357059+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-09T23:58:27.357059+0000","last_peered":"2024-02-09T23:58:27.357059+0000","last_clean":"2024-02-09T23:58:27.357059+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-09T23:58:27.357059+0000","last_undegraded":"2024-02-09T23:58:27.357059+0000","last_fullsized":"2024-02-09T23:58:27.357059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356856+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-09T23:58:27.356856+0000","last_peered":"2024-02-09T23:58:27.356856+0000","last_clean":"2024-02-09T23:58:27.356856+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-09T23:58:27.356856+0000","last_undegraded":"2024-02-09T23:58:27.356856+0000","last_fullsized":"2024-02-09T23:58:27.356856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335801+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-09T23:58:27.335801+0000","last_peered":"2024-02-09T23:58:27.335801+0000","last_clean":"2024-02-09T23:58:27.335801+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-09T23:58:27.335801+0000","last_undegraded":"2024-02-09T23:58:27.335801+0000","last_fullsized":"2024-02-09T23:58:27.335801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.338581+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-09T23:58:27.338581+0000","last_peered":"2024-02-09T23:58:27.338581+0000","last_clean":"2024-02-09T23:58:27.338581+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-09T23:58:27.338581+0000","last_undegraded":"2024-02-09T23:58:27.338581+0000","last_fullsized":"2024-02-09T23:58:27.338581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350753+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-09T23:58:27.350753+0000","last_peered":"2024-02-09T23:58:27.350753+0000","last_clean":"2024-02-09T23:58:27.350753+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-09T23:58:27.350753+0000","last_undegraded":"2024-02-09T23:58:27.350753+0000","last_fullsized":"2024-02-09T23:58:27.350753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334268+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-09T23:58:27.334268+0000","last_peered":"2024-02-09T23:58:27.334268+0000","last_clean":"2024-02-09T23:58:27.334268+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-09T23:58:27.334268+0000","last_undegraded":"2024-02-09T23:58:27.334268+0000","last_fullsized":"2024-02-09T23:58:27.334268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.311900+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-09T23:58:27.311900+0000","last_peered":"2024-02-09T23:58:27.311900+0000","last_clean":"2024-02-09T23:58:27.311900+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-09T23:58:27.311900+0000","last_undegraded":"2024-02-09T23:58:27.311900+0000","last_fullsized":"2024-02-09T23:58:27.311900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345793+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-09T23:58:27.345793+0000","last_peered":"2024-02-09T23:58:27.345793+0000","last_clean":"2024-02-09T23:58:27.345793+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-09T23:58:27.345793+0000","last_undegraded":"2024-02-09T23:58:27.345793+0000","last_fullsized":"2024-02-09T23:58:27.345793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389958+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-09T23:58:29.389958+0000","last_peered":"2024-02-09T23:58:29.389958+0000","last_clean":"2024-02-09T23:58:29.389958+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-09T23:58:29.389958+0000","last_undegraded":"2024-02-09T23:58:29.389958+0000","last_fullsized":"2024-02-09T23:58:29.389958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.326532+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-09T23:58:27.326532+0000","last_peered":"2024-02-09T23:58:27.326532+0000","last_clean":"2024-02-09T23:58:27.326532+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-09T23:58:27.326532+0000","last_undegraded":"2024-02-09T23:58:27.326532+0000","last_fullsized":"2024-02-09T23:58:27.326532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323278+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-09T23:58:27.323278+0000","last_peered":"2024-02-09T23:58:27.323278+0000","last_clean":"2024-02-09T23:58:27.323278+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-09T23:58:27.323278+0000","last_undegraded":"2024-02-09T23:58:27.323278+0000","last_fullsized":"2024-02-09T23:58:27.323278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356738+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-09T23:58:27.356738+0000","last_peered":"2024-02-09T23:58:27.356738+0000","last_clean":"2024-02-09T23:58:27.356738+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-09T23:58:27.356738+0000","last_undegraded":"2024-02-09T23:58:27.356738+0000","last_fullsized":"2024-02-09T23:58:27.356738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389494+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-09T23:58:29.389494+0000","last_peered":"2024-02-09T23:58:29.389494+0000","last_clean":"2024-02-09T23:58:29.389494+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-09T23:58:29.389494+0000","last_undegraded":"2024-02-09T23:58:29.389494+0000","last_fullsized":"2024-02-09T23:58:29.389494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332253+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-09T23:58:27.332253+0000","last_peered":"2024-02-09T23:58:27.332253+0000","last_clean":"2024-02-09T23:58:27.332253+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-09T23:58:27.332253+0000","last_undegraded":"2024-02-09T23:58:27.332253+0000","last_fullsized":"2024-02-09T23:58:27.332253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387177+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-09T23:58:29.387177+0000","last_peered":"2024-02-09T23:58:29.387177+0000","last_clean":"2024-02-09T23:58:29.387177+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-09T23:58:29.387177+0000","last_undegraded":"2024-02-09T23:58:29.387177+0000","last_fullsized":"2024-02-09T23:58:29.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.346222+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-09T23:58:27.346222+0000","last_peered":"2024-02-09T23:58:27.346222+0000","last_clean":"2024-02-09T23:58:27.346222+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-09T23:58:27.346222+0000","last_undegraded":"2024-02-09T23:58:27.346222+0000","last_fullsized":"2024-02-09T23:58:27.346222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.012542+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:27.012542+0000","last_peered":"2024-02-09T23:58:27.012542+0000","last_clean":"2024-02-09T23:58:27.012542+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:27.012542+0000","last_undegraded":"2024-02-09T23:58:27.012542+0000","last_fullsized":"2024-02-09T23:58:27.012542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324223+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-09T23:58:28.324223+0000","last_peered":"2024-02-09T23:58:28.324223+0000","last_clean":"2024-02-09T23:58:28.324223+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-09T23:58:28.324223+0000","last_undegraded":"2024-02-09T23:58:28.324223+0000","last_fullsized":"2024-02-09T23:58:28.324223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347097+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-09T23:58:27.347097+0000","last_peered":"2024-02-09T23:58:27.347097+0000","last_clean":"2024-02-09T23:58:27.347097+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-09T23:58:27.347097+0000","last_undegraded":"2024-02-09T23:58:27.347097+0000","last_fullsized":"2024-02-09T23:58:27.347097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323352+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:27.323352+0000","last_peered":"2024-02-09T23:58:27.323352+0000","last_clean":"2024-02-09T23:58:27.323352+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:27.323352+0000","last_undegraded":"2024-02-09T23:58:27.323352+0000","last_fullsized":"2024-02-09T23:58:27.323352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389391+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-09T23:58:29.389391+0000","last_peered":"2024-02-09T23:58:29.389391+0000","last_clean":"2024-02-09T23:58:29.389391+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-09T23:58:29.389391+0000","last_undegraded":"2024-02-09T23:58:29.389391+0000","last_fullsized":"2024-02-09T23:58:29.389391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352307+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-09T23:58:27.352307+0000","last_peered":"2024-02-09T23:58:27.352307+0000","last_clean":"2024-02-09T23:58:27.352307+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-09T23:58:27.352307+0000","last_undegraded":"2024-02-09T23:58:27.352307+0000","last_fullsized":"2024-02-09T23:58:27.352307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.314672+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:27.314672+0000","last_peered":"2024-02-09T23:58:27.314672+0000","last_clean":"2024-02-09T23:58:27.314672+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:27.314672+0000","last_undegraded":"2024-02-09T23:58:27.314672+0000","last_fullsized":"2024-02-09T23:58:27.314672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.024344+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-09T23:58:27.024344+0000","last_peered":"2024-02-09T23:58:27.024344+0000","last_clean":"2024-02-09T23:58:27.024344+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-09T23:58:27.024344+0000","last_undegraded":"2024-02-09T23:58:27.024344+0000","last_fullsized":"2024-02-09T23:58:27.024344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347986+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-09T23:58:27.347986+0000","last_peered":"2024-02-09T23:58:27.347986+0000","last_clean":"2024-02-09T23:58:27.347986+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-09T23:58:27.347986+0000","last_undegraded":"2024-02-09T23:58:27.347986+0000","last_fullsized":"2024-02-09T23:58:27.347986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.319295+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:27.319295+0000","last_peered":"2024-02-09T23:58:27.319295+0000","last_clean":"2024-02-09T23:58:27.319295+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:27.319295+0000","last_undegraded":"2024-02-09T23:58:27.319295+0000","last_fullsized":"2024-02-09T23:58:27.319295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.008477+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:27.008477+0000","last_peered":"2024-02-09T23:58:27.008477+0000","last_clean":"2024-02-09T23:58:27.008477+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:27.008477+0000","last_undegraded":"2024-02-09T23:58:27.008477+0000","last_fullsized":"2024-02-09T23:58:27.008477+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320951+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-09T23:58:27.320951+0000","last_peered":"2024-02-09T23:58:27.320951+0000","last_clean":"2024-02-09T23:58:27.320951+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-09T23:58:27.320951+0000","last_undegraded":"2024-02-09T23:58:27.320951+0000","last_fullsized":"2024-02-09T23:58:27.320951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356758+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-09T23:58:27.356758+0000","last_peered":"2024-02-09T23:58:27.356758+0000","last_clean":"2024-02-09T23:58:27.356758+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-09T23:58:27.356758+0000","last_undegraded":"2024-02-09T23:58:27.356758+0000","last_fullsized":"2024-02-09T23:58:27.356758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.318145+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:27.318145+0000","last_peered":"2024-02-09T23:58:27.318145+0000","last_clean":"2024-02-09T23:58:27.318145+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:27.318145+0000","last_undegraded":"2024-02-09T23:58:27.318145+0000","last_fullsized":"2024-02-09T23:58:27.318145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324007+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-09T23:58:28.324007+0000","last_peered":"2024-02-09T23:58:28.324007+0000","last_clean":"2024-02-09T23:58:28.324007+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-09T23:58:28.324007+0000","last_undegraded":"2024-02-09T23:58:28.324007+0000","last_fullsized":"2024-02-09T23:58:28.324007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345678+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-09T23:58:27.345678+0000","last_peered":"2024-02-09T23:58:27.345678+0000","last_clean":"2024-02-09T23:58:27.345678+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-09T23:58:27.345678+0000","last_undegraded":"2024-02-09T23:58:27.345678+0000","last_fullsized":"2024-02-09T23:58:27.345678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320229+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:27.320229+0000","last_peered":"2024-02-09T23:58:27.320229+0000","last_clean":"2024-02-09T23:58:27.320229+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:27.320229+0000","last_undegraded":"2024-02-09T23:58:27.320229+0000","last_fullsized":"2024-02-09T23:58:27.320229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.028836+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-09T23:58:27.028836+0000","last_peered":"2024-02-09T23:58:27.028836+0000","last_clean":"2024-02-09T23:58:27.028836+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-09T23:58:27.028836+0000","last_undegraded":"2024-02-09T23:58:27.028836+0000","last_fullsized":"2024-02-09T23:58:27.028836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.339496+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-09T23:58:27.339496+0000","last_peered":"2024-02-09T23:58:27.339496+0000","last_clean":"2024-02-09T23:58:27.339496+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-09T23:58:27.339496+0000","last_undegraded":"2024-02-09T23:58:27.339496+0000","last_fullsized":"2024-02-09T23:58:27.339496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387255+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-09T23:58:29.387255+0000","last_peered":"2024-02-09T23:58:29.387255+0000","last_clean":"2024-02-09T23:58:29.387255+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-09T23:58:29.387255+0000","last_undegraded":"2024-02-09T23:58:29.387255+0000","last_fullsized":"2024-02-09T23:58:29.387255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.010038+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:27.010038+0000","last_peered":"2024-02-09T23:58:27.010038+0000","last_clean":"2024-02-09T23:58:27.010038+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:27.010038+0000","last_undegraded":"2024-02-09T23:58:27.010038+0000","last_fullsized":"2024-02-09T23:58:27.010038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356834+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-09T23:58:27.356834+0000","last_peered":"2024-02-09T23:58:27.356834+0000","last_clean":"2024-02-09T23:58:27.356834+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-09T23:58:27.356834+0000","last_undegraded":"2024-02-09T23:58:27.356834+0000","last_fullsized":"2024-02-09T23:58:27.356834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317100+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:27.317100+0000","last_peered":"2024-02-09T23:58:27.317100+0000","last_clean":"2024-02-09T23:58:27.317100+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:27.317100+0000","last_undegraded":"2024-02-09T23:58:27.317100+0000","last_fullsized":"2024-02-09T23:58:27.317100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325268+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-09T23:58:28.325268+0000","last_peered":"2024-02-09T23:58:28.325268+0000","last_clean":"2024-02-09T23:58:28.325268+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-09T23:58:28.325268+0000","last_undegraded":"2024-02-09T23:58:28.325268+0000","last_fullsized":"2024-02-09T23:58:28.325268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334225+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-09T23:58:27.334225+0000","last_peered":"2024-02-09T23:58:27.334225+0000","last_clean":"2024-02-09T23:58:27.334225+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-09T23:58:27.334225+0000","last_undegraded":"2024-02-09T23:58:27.334225+0000","last_fullsized":"2024-02-09T23:58:27.334225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390822+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-09T23:58:29.390822+0000","last_peered":"2024-02-09T23:58:29.390822+0000","last_clean":"2024-02-09T23:58:29.390822+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-09T23:58:29.390822+0000","last_undegraded":"2024-02-09T23:58:29.390822+0000","last_fullsized":"2024-02-09T23:58:29.390822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357559+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-09T23:58:27.357559+0000","last_peered":"2024-02-09T23:58:27.357559+0000","last_clean":"2024-02-09T23:58:27.357559+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-09T23:58:27.357559+0000","last_undegraded":"2024-02-09T23:58:27.357559+0000","last_fullsized":"2024-02-09T23:58:27.357559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347517+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-09T23:58:27.347517+0000","last_peered":"2024-02-09T23:58:27.347517+0000","last_clean":"2024-02-09T23:58:27.347517+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-09T23:58:27.347517+0000","last_undegraded":"2024-02-09T23:58:27.347517+0000","last_fullsized":"2024-02-09T23:58:27.347517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332903+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-09T23:58:27.332903+0000","last_peered":"2024-02-09T23:58:27.332903+0000","last_clean":"2024-02-09T23:58:27.332903+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-09T23:58:27.332903+0000","last_undegraded":"2024-02-09T23:58:27.332903+0000","last_fullsized":"2024-02-09T23:58:27.332903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340185+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-09T23:58:27.340185+0000","last_peered":"2024-02-09T23:58:27.340185+0000","last_clean":"2024-02-09T23:58:27.340185+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-09T23:58:27.340185+0000","last_undegraded":"2024-02-09T23:58:27.340185+0000","last_fullsized":"2024-02-09T23:58:27.340185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334290+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-09T23:58:27.334290+0000","last_peered":"2024-02-09T23:58:27.334290+0000","last_clean":"2024-02-09T23:58:27.334290+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-09T23:58:27.334290+0000","last_undegraded":"2024-02-09T23:58:27.334290+0000","last_fullsized":"2024-02-09T23:58:27.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337567+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-09T23:58:27.337567+0000","last_peered":"2024-02-09T23:58:27.337567+0000","last_clean":"2024-02-09T23:58:27.337567+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-09T23:58:27.337567+0000","last_undegraded":"2024-02-09T23:58:27.337567+0000","last_fullsized":"2024-02-09T23:58:27.337567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334061+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-09T23:58:27.334061+0000","last_peered":"2024-02-09T23:58:27.334061+0000","last_clean":"2024-02-09T23:58:27.334061+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-09T23:58:27.334061+0000","last_undegraded":"2024-02-09T23:58:27.334061+0000","last_fullsized":"2024-02-09T23:58:27.334061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.353922+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-09T23:58:27.353922+0000","last_peered":"2024-02-09T23:58:27.353922+0000","last_clean":"2024-02-09T23:58:27.353922+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-09T23:58:27.353922+0000","last_undegraded":"2024-02-09T23:58:27.353922+0000","last_fullsized":"2024-02-09T23:58:27.353922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348660+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-09T23:58:27.348660+0000","last_peered":"2024-02-09T23:58:27.348660+0000","last_clean":"2024-02-09T23:58:27.348660+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-09T23:58:27.348660+0000","last_undegraded":"2024-02-09T23:58:27.348660+0000","last_fullsized":"2024-02-09T23:58:27.348660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352936+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-09T23:58:27.352936+0000","last_peered":"2024-02-09T23:58:27.352936+0000","last_clean":"2024-02-09T23:58:27.352936+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-09T23:58:27.352936+0000","last_undegraded":"2024-02-09T23:58:27.352936+0000","last_fullsized":"2024-02-09T23:58:27.352936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.354758+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-09T23:58:27.354758+0000","last_peered":"2024-02-09T23:58:27.354758+0000","last_clean":"2024-02-09T23:58:27.354758+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-09T23:58:27.354758+0000","last_undegraded":"2024-02-09T23:58:27.354758+0000","last_fullsized":"2024-02-09T23:58:27.354758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333673+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-09T23:58:27.333673+0000","last_peered":"2024-02-09T23:58:27.333673+0000","last_clean":"2024-02-09T23:58:27.333673+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-09T23:58:27.333673+0000","last_undegraded":"2024-02-09T23:58:27.333673+0000","last_fullsized":"2024-02-09T23:58:27.333673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356759+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-09T23:58:27.356759+0000","last_peered":"2024-02-09T23:58:27.356759+0000","last_clean":"2024-02-09T23:58:27.356759+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-09T23:58:27.356759+0000","last_undegraded":"2024-02-09T23:58:27.356759+0000","last_fullsized":"2024-02-09T23:58:27.356759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349719+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-09T23:58:27.349719+0000","last_peered":"2024-02-09T23:58:27.349719+0000","last_clean":"2024-02-09T23:58:27.349719+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-09T23:58:27.349719+0000","last_undegraded":"2024-02-09T23:58:27.349719+0000","last_fullsized":"2024-02-09T23:58:27.349719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":47236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}]}} 2024-02-09T23:58:31.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T23:58:31.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 Processor -- start 2024-02-09T23:58:31.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 -- start start 2024-02-09T23:58:31.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 0x7ffb94060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb9413e600 0x7ffb941409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb940603c0 con 0x7ffb940aae90 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb941338e0 con 0x7ffb9413e600 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.274+0000 7ffb9c1bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940aa230 con 0x7ffb94132df0 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb9413e600 0x7ffb941409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb99756700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ffb940aae90 0x7ffb941331d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37838/0 (socket says 172.21.15.89:37838) 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb99756700 1 -- 172.21.15.89:0/394408876 learned_addr learned my addr 172.21.15.89:0/394408876 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb99f57700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 0x7ffb94060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 -- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 msgr2=0x7ffb94060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 0x7ffb94060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 -- 172.21.15.89:0/394408876 >> v1:172.21.15.89:6789/0 conn(0x7ffb940aae90 legacy=0x7ffb941331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 -- 172.21.15.89:0/394408876 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940aa4d0 con 0x7ffb9413e600 2024-02-09T23:58:31.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb98f55700 1 -- 172.21.15.89:0/394408876 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934690530 0 0) 0x7ffb940603c0 con 0x7ffb940aae90 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb99f57700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 0x7ffb94060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb9a758700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9413e600 0x7ffb941409f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ffb8c0032f0 tx=0x7ffb8c0091d0).ready entity=mon.0 client_cookie=424c0855923f73d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb98f55700 1 -- 172.21.15.89:0/394408876 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c00b6c0 con 0x7ffb9413e600 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb98f55700 1 -- 172.21.15.89:0/394408876 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c00b820 con 0x7ffb9413e600 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.275+0000 7ffb98f55700 1 -- 172.21.15.89:0/394408876 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c00b990 con 0x7ffb9413e600 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9413e600 msgr2=0x7ffb941409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9413e600 0x7ffb941409f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ffb8c0032f0 tx=0x7ffb8c0091d0).stop 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/394408876 shutdown_connections 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9413e600 0x7ffb941409f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/394408876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb94132df0 0x7ffb94060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/394408876 >> 172.21.15.89:0/394408876 conn(0x7ffb9405c300 msgr2=0x7ffb9406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/394408876 shutdown_connections 2024-02-09T23:58:31.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/394408876 wait complete. 2024-02-09T23:58:31.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.276+0000 7ffb9c1bb700 1 Processor -- start 2024-02-09T23:58:31.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 -- start start 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb9413e600 0x7ffb9412ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94138410 con 0x7ffb94132df0 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940926e0 con 0x7ffb940aae90 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9c1bb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9413bfb0 con 0x7ffb9413e600 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99756700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99756700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49916/0 (socket says 172.21.15.89:49916) 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44780/0 (socket says 172.21.15.89:44780) 2024-02-09T23:58:31.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99756700 1 -- 172.21.15.89:0/2776543845 learned_addr learned my addr 172.21.15.89:0/2776543845 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb9a758700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb9413e600 0x7ffb9412ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 -- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb9413e600 msgr2=0x7ffb9412ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb9413e600 0x7ffb9412ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 -- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 msgr2=0x7ffb9412fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99f57700 1 -- 172.21.15.89:0/2776543845 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9000b180 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.277+0000 7ffb99756700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb99f57700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ffb9000c000 tx=0x7ffb90006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90010780 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900108e0 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90010c40 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c009470 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.278+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb941379b0 con 0x7ffb940aae90 2024-02-09T23:58:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.279+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ffb9001c460 con 0x7ffb940aae90 2024-02-09T23:58:31.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.279+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ffb9004aca0 con 0x7ffb940aae90 2024-02-09T23:58:31.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.279+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb94137bd0 con 0x7ffb940aae90 2024-02-09T23:58:31.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.282+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ffb900335d0 con 0x7ffb940aae90 2024-02-09T23:58:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.392+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 --> v1:172.21.15.89:6816/39389 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb940aa790 con 0x7ffb74038da0 2024-02-09T23:58:31.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.398+0000 7ffb82ffd700 1 -- 172.21.15.89:0/2776543845 <== mgr.4100 v1:172.21.15.89:6816/39389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246994 (unknown 2965378022 0 3521224733) 0x7ffb940aa790 con 0x7ffb74038da0 2024-02-09T23:58:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 >> v1:172.21.15.89:6816/39389 conn(0x7ffb74038da0 legacy=0x7ffb7403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 msgr2=0x7ffb9413c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ffb9000c000 tx=0x7ffb90006df0).stop 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 shutdown_connections 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb9413e600 0x7ffb9412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb940aae90 0x7ffb9413c8e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 --2- 172.21.15.89:0/2776543845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb94132df0 0x7ffb9412fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 >> 172.21.15.89:0/2776543845 conn(0x7ffb9405c300 msgr2=0x7ffb9413d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 shutdown_connections 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.401+0000 7ffb9c1bb700 1 -- 172.21.15.89:0/2776543845 wait complete. 2024-02-09T23:58:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-09T23:58:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-09T23:58:30.554311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195008,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292352,"statfs":{"total":386547056640,"available":382251368448,"internally_reserved":4294967296,"allocated":688128,"data_stored":203855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334099+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-09T23:58:27.334099+0000","last_peered":"2024-02-09T23:58:27.334099+0000","last_clean":"2024-02-09T23:58:27.334099+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-09T23:58:27.334099+0000","last_undegraded":"2024-02-09T23:58:27.334099+0000","last_fullsized":"2024-02-09T23:58:27.334099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357573+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-09T23:58:27.357573+0000","last_peered":"2024-02-09T23:58:27.357573+0000","last_clean":"2024-02-09T23:58:27.357573+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-09T23:58:27.357573+0000","last_undegraded":"2024-02-09T23:58:27.357573+0000","last_fullsized":"2024-02-09T23:58:27.357573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.351216+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-09T23:58:27.351216+0000","last_peered":"2024-02-09T23:58:27.351216+0000","last_clean":"2024-02-09T23:58:27.351216+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-09T23:58:27.351216+0000","last_undegraded":"2024-02-09T23:58:27.351216+0000","last_fullsized":"2024-02-09T23:58:27.351216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345605+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-09T23:58:27.345605+0000","last_peered":"2024-02-09T23:58:27.345605+0000","last_clean":"2024-02-09T23:58:27.345605+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-09T23:58:27.345605+0000","last_undegraded":"2024-02-09T23:58:27.345605+0000","last_fullsized":"2024-02-09T23:58:27.345605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333159+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-09T23:58:27.333159+0000","last_peered":"2024-02-09T23:58:27.333159+0000","last_clean":"2024-02-09T23:58:27.333159+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-09T23:58:27.333159+0000","last_undegraded":"2024-02-09T23:58:27.333159+0000","last_fullsized":"2024-02-09T23:58:27.333159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340038+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-09T23:58:27.340038+0000","last_peered":"2024-02-09T23:58:27.340038+0000","last_clean":"2024-02-09T23:58:27.340038+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-09T23:58:27.340038+0000","last_undegraded":"2024-02-09T23:58:27.340038+0000","last_fullsized":"2024-02-09T23:58:27.340038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334038+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-09T23:58:27.334038+0000","last_peered":"2024-02-09T23:58:27.334038+0000","last_clean":"2024-02-09T23:58:27.334038+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-09T23:58:27.334038+0000","last_undegraded":"2024-02-09T23:58:27.334038+0000","last_fullsized":"2024-02-09T23:58:27.334038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352692+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-09T23:58:27.352692+0000","last_peered":"2024-02-09T23:58:27.352692+0000","last_clean":"2024-02-09T23:58:27.352692+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-09T23:58:27.352692+0000","last_undegraded":"2024-02-09T23:58:27.352692+0000","last_fullsized":"2024-02-09T23:58:27.352692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331551+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-09T23:58:27.331551+0000","last_peered":"2024-02-09T23:58:27.331551+0000","last_clean":"2024-02-09T23:58:27.331551+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-09T23:58:27.331551+0000","last_undegraded":"2024-02-09T23:58:27.331551+0000","last_fullsized":"2024-02-09T23:58:27.331551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347929+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-09T23:58:27.347929+0000","last_peered":"2024-02-09T23:58:27.347929+0000","last_clean":"2024-02-09T23:58:27.347929+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-09T23:58:27.347929+0000","last_undegraded":"2024-02-09T23:58:27.347929+0000","last_fullsized":"2024-02-09T23:58:27.347929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347930+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-09T23:58:27.347930+0000","last_peered":"2024-02-09T23:58:27.347930+0000","last_clean":"2024-02-09T23:58:27.347930+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-09T23:58:27.347930+0000","last_undegraded":"2024-02-09T23:58:27.347930+0000","last_fullsized":"2024-02-09T23:58:27.347930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336683+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-09T23:58:27.336683+0000","last_peered":"2024-02-09T23:58:27.336683+0000","last_clean":"2024-02-09T23:58:27.336683+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-09T23:58:27.336683+0000","last_undegraded":"2024-02-09T23:58:27.336683+0000","last_fullsized":"2024-02-09T23:58:27.336683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332924+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-09T23:58:27.332924+0000","last_peered":"2024-02-09T23:58:27.332924+0000","last_clean":"2024-02-09T23:58:27.332924+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-09T23:58:27.332924+0000","last_undegraded":"2024-02-09T23:58:27.332924+0000","last_fullsized":"2024-02-09T23:58:27.332924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350195+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-09T23:58:27.350195+0000","last_peered":"2024-02-09T23:58:27.350195+0000","last_clean":"2024-02-09T23:58:27.350195+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-09T23:58:27.350195+0000","last_undegraded":"2024-02-09T23:58:27.350195+0000","last_fullsized":"2024-02-09T23:58:27.350195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345711+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-09T23:58:27.345711+0000","last_peered":"2024-02-09T23:58:27.345711+0000","last_clean":"2024-02-09T23:58:27.345711+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-09T23:58:27.345711+0000","last_undegraded":"2024-02-09T23:58:27.345711+0000","last_fullsized":"2024-02-09T23:58:27.345711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334575+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-09T23:58:27.334575+0000","last_peered":"2024-02-09T23:58:27.334575+0000","last_clean":"2024-02-09T23:58:27.334575+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-09T23:58:27.334575+0000","last_undegraded":"2024-02-09T23:58:27.334575+0000","last_fullsized":"2024-02-09T23:58:27.334575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333238+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-09T23:58:27.333238+0000","last_peered":"2024-02-09T23:58:27.333238+0000","last_clean":"2024-02-09T23:58:27.333238+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-09T23:58:27.333238+0000","last_undegraded":"2024-02-09T23:58:27.333238+0000","last_fullsized":"2024-02-09T23:58:27.333238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333651+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-09T23:58:27.333651+0000","last_peered":"2024-02-09T23:58:27.333651+0000","last_clean":"2024-02-09T23:58:27.333651+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-09T23:58:27.333651+0000","last_undegraded":"2024-02-09T23:58:27.333651+0000","last_fullsized":"2024-02-09T23:58:27.333651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336247+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-09T23:58:27.336247+0000","last_peered":"2024-02-09T23:58:27.336247+0000","last_clean":"2024-02-09T23:58:27.336247+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-09T23:58:27.336247+0000","last_undegraded":"2024-02-09T23:58:27.336247+0000","last_fullsized":"2024-02-09T23:58:27.336247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.341796+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-09T23:58:27.341796+0000","last_peered":"2024-02-09T23:58:27.341796+0000","last_clean":"2024-02-09T23:58:27.341796+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-09T23:58:27.341796+0000","last_undegraded":"2024-02-09T23:58:27.341796+0000","last_fullsized":"2024-02-09T23:58:27.341796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.341174+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-09T23:58:27.341174+0000","last_peered":"2024-02-09T23:58:27.341174+0000","last_clean":"2024-02-09T23:58:27.341174+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-09T23:58:27.341174+0000","last_undegraded":"2024-02-09T23:58:27.341174+0000","last_fullsized":"2024-02-09T23:58:27.341174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356686+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-09T23:58:27.356686+0000","last_peered":"2024-02-09T23:58:27.356686+0000","last_clean":"2024-02-09T23:58:27.356686+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-09T23:58:27.356686+0000","last_undegraded":"2024-02-09T23:58:27.356686+0000","last_fullsized":"2024-02-09T23:58:27.356686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335658+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-09T23:58:27.335658+0000","last_peered":"2024-02-09T23:58:27.335658+0000","last_clean":"2024-02-09T23:58:27.335658+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-09T23:58:27.335658+0000","last_undegraded":"2024-02-09T23:58:27.335658+0000","last_fullsized":"2024-02-09T23:58:27.335658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352309+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-09T23:58:27.352309+0000","last_peered":"2024-02-09T23:58:27.352309+0000","last_clean":"2024-02-09T23:58:27.352309+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-09T23:58:27.352309+0000","last_undegraded":"2024-02-09T23:58:27.352309+0000","last_fullsized":"2024-02-09T23:58:27.352309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.346106+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-09T23:58:27.346106+0000","last_peered":"2024-02-09T23:58:27.346106+0000","last_clean":"2024-02-09T23:58:27.346106+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-09T23:58:27.346106+0000","last_undegraded":"2024-02-09T23:58:27.346106+0000","last_fullsized":"2024-02-09T23:58:27.346106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350703+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-09T23:58:27.350703+0000","last_peered":"2024-02-09T23:58:27.350703+0000","last_clean":"2024-02-09T23:58:27.350703+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-09T23:58:27.350703+0000","last_undegraded":"2024-02-09T23:58:27.350703+0000","last_fullsized":"2024-02-09T23:58:27.350703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337216+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-09T23:58:27.337216+0000","last_peered":"2024-02-09T23:58:27.337216+0000","last_clean":"2024-02-09T23:58:27.337216+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-09T23:58:27.337216+0000","last_undegraded":"2024-02-09T23:58:27.337216+0000","last_fullsized":"2024-02-09T23:58:27.337216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333805+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-09T23:58:27.333805+0000","last_peered":"2024-02-09T23:58:27.333805+0000","last_clean":"2024-02-09T23:58:27.333805+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-09T23:58:27.333805+0000","last_undegraded":"2024-02-09T23:58:27.333805+0000","last_fullsized":"2024-02-09T23:58:27.333805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356716+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-09T23:58:27.356716+0000","last_peered":"2024-02-09T23:58:27.356716+0000","last_clean":"2024-02-09T23:58:27.356716+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-09T23:58:27.356716+0000","last_undegraded":"2024-02-09T23:58:27.356716+0000","last_fullsized":"2024-02-09T23:58:27.356716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.034729+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-09T23:58:27.034729+0000","last_peered":"2024-02-09T23:58:27.034729+0000","last_clean":"2024-02-09T23:58:27.034729+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-09T23:58:27.034729+0000","last_undegraded":"2024-02-09T23:58:27.034729+0000","last_fullsized":"2024-02-09T23:58:27.034729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357566+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-09T23:58:27.357566+0000","last_peered":"2024-02-09T23:58:27.357566+0000","last_clean":"2024-02-09T23:58:27.357566+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-09T23:58:27.357566+0000","last_undegraded":"2024-02-09T23:58:27.357566+0000","last_fullsized":"2024-02-09T23:58:27.357566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.322312+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-09T23:58:28.322312+0000","last_peered":"2024-02-09T23:58:28.322312+0000","last_clean":"2024-02-09T23:58:28.322312+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-09T23:58:28.322312+0000","last_undegraded":"2024-02-09T23:58:28.322312+0000","last_fullsized":"2024-02-09T23:58:28.322312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356684+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-09T23:58:27.356684+0000","last_peered":"2024-02-09T23:58:27.356684+0000","last_clean":"2024-02-09T23:58:27.356684+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-09T23:58:27.356684+0000","last_undegraded":"2024-02-09T23:58:27.356684+0000","last_fullsized":"2024-02-09T23:58:27.356684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390174+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-09T23:58:29.390174+0000","last_peered":"2024-02-09T23:58:29.390174+0000","last_clean":"2024-02-09T23:58:29.390174+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-09T23:58:29.390174+0000","last_undegraded":"2024-02-09T23:58:29.390174+0000","last_fullsized":"2024-02-09T23:58:29.390174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356876+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-09T23:58:27.356876+0000","last_peered":"2024-02-09T23:58:27.356876+0000","last_clean":"2024-02-09T23:58:27.356876+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-09T23:58:27.356876+0000","last_undegraded":"2024-02-09T23:58:27.356876+0000","last_fullsized":"2024-02-09T23:58:27.356876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.384963+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-09T23:58:29.384963+0000","last_peered":"2024-02-09T23:58:29.384963+0000","last_clean":"2024-02-09T23:58:29.384963+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-09T23:58:29.384963+0000","last_undegraded":"2024-02-09T23:58:29.384963+0000","last_fullsized":"2024-02-09T23:58:29.384963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335972+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-09T23:58:27.335972+0000","last_peered":"2024-02-09T23:58:27.335972+0000","last_clean":"2024-02-09T23:58:27.335972+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-09T23:58:27.335972+0000","last_undegraded":"2024-02-09T23:58:27.335972+0000","last_fullsized":"2024-02-09T23:58:27.335972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325146+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-09T23:58:28.325146+0000","last_peered":"2024-02-09T23:58:28.325146+0000","last_clean":"2024-02-09T23:58:28.325146+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-09T23:58:28.325146+0000","last_undegraded":"2024-02-09T23:58:28.325146+0000","last_fullsized":"2024-02-09T23:58:28.325146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347143+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-09T23:58:27.347143+0000","last_peered":"2024-02-09T23:58:27.347143+0000","last_clean":"2024-02-09T23:58:27.347143+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-09T23:58:27.347143+0000","last_undegraded":"2024-02-09T23:58:27.347143+0000","last_fullsized":"2024-02-09T23:58:27.347143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387191+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-09T23:58:29.387191+0000","last_peered":"2024-02-09T23:58:29.387191+0000","last_clean":"2024-02-09T23:58:29.387191+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-09T23:58:29.387191+0000","last_undegraded":"2024-02-09T23:58:29.387191+0000","last_fullsized":"2024-02-09T23:58:29.387191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332881+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-09T23:58:27.332881+0000","last_peered":"2024-02-09T23:58:27.332881+0000","last_clean":"2024-02-09T23:58:27.332881+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-09T23:58:27.332881+0000","last_undegraded":"2024-02-09T23:58:27.332881+0000","last_fullsized":"2024-02-09T23:58:27.332881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390474+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-09T23:58:29.390474+0000","last_peered":"2024-02-09T23:58:29.390474+0000","last_clean":"2024-02-09T23:58:29.390474+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-09T23:58:29.390474+0000","last_undegraded":"2024-02-09T23:58:29.390474+0000","last_fullsized":"2024-02-09T23:58:29.390474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.355440+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-09T23:58:27.355440+0000","last_peered":"2024-02-09T23:58:27.355440+0000","last_clean":"2024-02-09T23:58:27.355440+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-09T23:58:27.355440+0000","last_undegraded":"2024-02-09T23:58:27.355440+0000","last_fullsized":"2024-02-09T23:58:27.355440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387264+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-09T23:58:29.387264+0000","last_peered":"2024-02-09T23:58:29.387264+0000","last_clean":"2024-02-09T23:58:29.387264+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-09T23:58:29.387264+0000","last_undegraded":"2024-02-09T23:58:29.387264+0000","last_fullsized":"2024-02-09T23:58:29.387264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337193+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-09T23:58:27.337193+0000","last_peered":"2024-02-09T23:58:27.337193+0000","last_clean":"2024-02-09T23:58:27.337193+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-09T23:58:27.337193+0000","last_undegraded":"2024-02-09T23:58:27.337193+0000","last_fullsized":"2024-02-09T23:58:27.337193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317849+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-09T23:58:27.317849+0000","last_peered":"2024-02-09T23:58:27.317849+0000","last_clean":"2024-02-09T23:58:27.317849+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-09T23:58:27.317849+0000","last_undegraded":"2024-02-09T23:58:27.317849+0000","last_fullsized":"2024-02-09T23:58:27.317849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.343562+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-09T23:58:27.343562+0000","last_peered":"2024-02-09T23:58:27.343562+0000","last_clean":"2024-02-09T23:58:27.343562+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-09T23:58:27.343562+0000","last_undegraded":"2024-02-09T23:58:27.343562+0000","last_fullsized":"2024-02-09T23:58:27.343562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357978+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-09T23:58:27.357978+0000","last_peered":"2024-02-09T23:58:27.357978+0000","last_clean":"2024-02-09T23:58:27.357978+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-09T23:58:27.357978+0000","last_undegraded":"2024-02-09T23:58:27.357978+0000","last_fullsized":"2024-02-09T23:58:27.357978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356663+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-09T23:58:27.356663+0000","last_peered":"2024-02-09T23:58:27.356663+0000","last_clean":"2024-02-09T23:58:27.356663+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-09T23:58:27.356663+0000","last_undegraded":"2024-02-09T23:58:27.356663+0000","last_fullsized":"2024-02-09T23:58:27.356663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357059+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-09T23:58:27.357059+0000","last_peered":"2024-02-09T23:58:27.357059+0000","last_clean":"2024-02-09T23:58:27.357059+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-09T23:58:27.357059+0000","last_undegraded":"2024-02-09T23:58:27.357059+0000","last_fullsized":"2024-02-09T23:58:27.357059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356856+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-09T23:58:27.356856+0000","last_peered":"2024-02-09T23:58:27.356856+0000","last_clean":"2024-02-09T23:58:27.356856+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-09T23:58:27.356856+0000","last_undegraded":"2024-02-09T23:58:27.356856+0000","last_fullsized":"2024-02-09T23:58:27.356856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335801+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-09T23:58:27.335801+0000","last_peered":"2024-02-09T23:58:27.335801+0000","last_clean":"2024-02-09T23:58:27.335801+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-09T23:58:27.335801+0000","last_undegraded":"2024-02-09T23:58:27.335801+0000","last_fullsized":"2024-02-09T23:58:27.335801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.338581+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-09T23:58:27.338581+0000","last_peered":"2024-02-09T23:58:27.338581+0000","last_clean":"2024-02-09T23:58:27.338581+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-09T23:58:27.338581+0000","last_undegraded":"2024-02-09T23:58:27.338581+0000","last_fullsized":"2024-02-09T23:58:27.338581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350753+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-09T23:58:27.350753+0000","last_peered":"2024-02-09T23:58:27.350753+0000","last_clean":"2024-02-09T23:58:27.350753+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-09T23:58:27.350753+0000","last_undegraded":"2024-02-09T23:58:27.350753+0000","last_fullsized":"2024-02-09T23:58:27.350753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334268+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-09T23:58:27.334268+0000","last_peered":"2024-02-09T23:58:27.334268+0000","last_clean":"2024-02-09T23:58:27.334268+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-09T23:58:27.334268+0000","last_undegraded":"2024-02-09T23:58:27.334268+0000","last_fullsized":"2024-02-09T23:58:27.334268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.311900+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-09T23:58:27.311900+0000","last_peered":"2024-02-09T23:58:27.311900+0000","last_clean":"2024-02-09T23:58:27.311900+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-09T23:58:27.311900+0000","last_undegraded":"2024-02-09T23:58:27.311900+0000","last_fullsized":"2024-02-09T23:58:27.311900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345793+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-09T23:58:27.345793+0000","last_peered":"2024-02-09T23:58:27.345793+0000","last_clean":"2024-02-09T23:58:27.345793+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-09T23:58:27.345793+0000","last_undegraded":"2024-02-09T23:58:27.345793+0000","last_fullsized":"2024-02-09T23:58:27.345793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389958+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-09T23:58:29.389958+0000","last_peered":"2024-02-09T23:58:29.389958+0000","last_clean":"2024-02-09T23:58:29.389958+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-09T23:58:29.389958+0000","last_undegraded":"2024-02-09T23:58:29.389958+0000","last_fullsized":"2024-02-09T23:58:29.389958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.326532+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-09T23:58:27.326532+0000","last_peered":"2024-02-09T23:58:27.326532+0000","last_clean":"2024-02-09T23:58:27.326532+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-09T23:58:27.326532+0000","last_undegraded":"2024-02-09T23:58:27.326532+0000","last_fullsized":"2024-02-09T23:58:27.326532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323278+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-09T23:58:27.323278+0000","last_peered":"2024-02-09T23:58:27.323278+0000","last_clean":"2024-02-09T23:58:27.323278+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-09T23:58:27.323278+0000","last_undegraded":"2024-02-09T23:58:27.323278+0000","last_fullsized":"2024-02-09T23:58:27.323278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356738+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-09T23:58:27.356738+0000","last_peered":"2024-02-09T23:58:27.356738+0000","last_clean":"2024-02-09T23:58:27.356738+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-09T23:58:27.356738+0000","last_undegraded":"2024-02-09T23:58:27.356738+0000","last_fullsized":"2024-02-09T23:58:27.356738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389494+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-09T23:58:29.389494+0000","last_peered":"2024-02-09T23:58:29.389494+0000","last_clean":"2024-02-09T23:58:29.389494+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-09T23:58:29.389494+0000","last_undegraded":"2024-02-09T23:58:29.389494+0000","last_fullsized":"2024-02-09T23:58:29.389494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332253+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-09T23:58:27.332253+0000","last_peered":"2024-02-09T23:58:27.332253+0000","last_clean":"2024-02-09T23:58:27.332253+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-09T23:58:27.332253+0000","last_undegraded":"2024-02-09T23:58:27.332253+0000","last_fullsized":"2024-02-09T23:58:27.332253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387177+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-09T23:58:29.387177+0000","last_peered":"2024-02-09T23:58:29.387177+0000","last_clean":"2024-02-09T23:58:29.387177+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-09T23:58:29.387177+0000","last_undegraded":"2024-02-09T23:58:29.387177+0000","last_fullsized":"2024-02-09T23:58:29.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.346222+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-09T23:58:27.346222+0000","last_peered":"2024-02-09T23:58:27.346222+0000","last_clean":"2024-02-09T23:58:27.346222+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-09T23:58:27.346222+0000","last_undegraded":"2024-02-09T23:58:27.346222+0000","last_fullsized":"2024-02-09T23:58:27.346222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.012542+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:27.012542+0000","last_peered":"2024-02-09T23:58:27.012542+0000","last_clean":"2024-02-09T23:58:27.012542+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:27.012542+0000","last_undegraded":"2024-02-09T23:58:27.012542+0000","last_fullsized":"2024-02-09T23:58:27.012542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324223+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-09T23:58:28.324223+0000","last_peered":"2024-02-09T23:58:28.324223+0000","last_clean":"2024-02-09T23:58:28.324223+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-09T23:58:28.324223+0000","last_undegraded":"2024-02-09T23:58:28.324223+0000","last_fullsized":"2024-02-09T23:58:28.324223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347097+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-09T23:58:27.347097+0000","last_peered":"2024-02-09T23:58:27.347097+0000","last_clean":"2024-02-09T23:58:27.347097+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-09T23:58:27.347097+0000","last_undegraded":"2024-02-09T23:58:27.347097+0000","last_fullsized":"2024-02-09T23:58:27.347097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323352+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:27.323352+0000","last_peered":"2024-02-09T23:58:27.323352+0000","last_clean":"2024-02-09T23:58:27.323352+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:27.323352+0000","last_undegraded":"2024-02-09T23:58:27.323352+0000","last_fullsized":"2024-02-09T23:58:27.323352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389391+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-09T23:58:29.389391+0000","last_peered":"2024-02-09T23:58:29.389391+0000","last_clean":"2024-02-09T23:58:29.389391+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-09T23:58:29.389391+0000","last_undegraded":"2024-02-09T23:58:29.389391+0000","last_fullsized":"2024-02-09T23:58:29.389391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352307+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-09T23:58:27.352307+0000","last_peered":"2024-02-09T23:58:27.352307+0000","last_clean":"2024-02-09T23:58:27.352307+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-09T23:58:27.352307+0000","last_undegraded":"2024-02-09T23:58:27.352307+0000","last_fullsized":"2024-02-09T23:58:27.352307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.314672+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:27.314672+0000","last_peered":"2024-02-09T23:58:27.314672+0000","last_clean":"2024-02-09T23:58:27.314672+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:27.314672+0000","last_undegraded":"2024-02-09T23:58:27.314672+0000","last_fullsized":"2024-02-09T23:58:27.314672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.024344+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-09T23:58:27.024344+0000","last_peered":"2024-02-09T23:58:27.024344+0000","last_clean":"2024-02-09T23:58:27.024344+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-09T23:58:27.024344+0000","last_undegraded":"2024-02-09T23:58:27.024344+0000","last_fullsized":"2024-02-09T23:58:27.024344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347986+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-09T23:58:27.347986+0000","last_peered":"2024-02-09T23:58:27.347986+0000","last_clean":"2024-02-09T23:58:27.347986+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-09T23:58:27.347986+0000","last_undegraded":"2024-02-09T23:58:27.347986+0000","last_fullsized":"2024-02-09T23:58:27.347986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.319295+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:27.319295+0000","last_peered":"2024-02-09T23:58:27.319295+0000","last_clean":"2024-02-09T23:58:27.319295+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:27.319295+0000","last_undegraded":"2024-02-09T23:58:27.319295+0000","last_fullsized":"2024-02-09T23:58:27.319295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.008477+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:27.008477+0000","last_peered":"2024-02-09T23:58:27.008477+0000","last_clean":"2024-02-09T23:58:27.008477+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:27.008477+0000","last_undegraded":"2024-02-09T23:58:27.008477+0000","last_fullsized":"2024-02-09T23:58:27.008477+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320951+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-09T23:58:27.320951+0000","last_peered":"2024-02-09T23:58:27.320951+0000","last_clean":"2024-02-09T23:58:27.320951+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-09T23:58:27.320951+0000","last_undegraded":"2024-02-09T23:58:27.320951+0000","last_fullsized":"2024-02-09T23:58:27.320951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356758+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-09T23:58:27.356758+0000","last_peered":"2024-02-09T23:58:27.356758+0000","last_clean":"2024-02-09T23:58:27.356758+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-09T23:58:27.356758+0000","last_undegraded":"2024-02-09T23:58:27.356758+0000","last_fullsized":"2024-02-09T23:58:27.356758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.318145+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:27.318145+0000","last_peered":"2024-02-09T23:58:27.318145+0000","last_clean":"2024-02-09T23:58:27.318145+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:27.318145+0000","last_undegraded":"2024-02-09T23:58:27.318145+0000","last_fullsized":"2024-02-09T23:58:27.318145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324007+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-09T23:58:28.324007+0000","last_peered":"2024-02-09T23:58:28.324007+0000","last_clean":"2024-02-09T23:58:28.324007+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-09T23:58:28.324007+0000","last_undegraded":"2024-02-09T23:58:28.324007+0000","last_fullsized":"2024-02-09T23:58:28.324007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345678+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-09T23:58:27.345678+0000","last_peered":"2024-02-09T23:58:27.345678+0000","last_clean":"2024-02-09T23:58:27.345678+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-09T23:58:27.345678+0000","last_undegraded":"2024-02-09T23:58:27.345678+0000","last_fullsized":"2024-02-09T23:58:27.345678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320229+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:27.320229+0000","last_peered":"2024-02-09T23:58:27.320229+0000","last_clean":"2024-02-09T23:58:27.320229+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:27.320229+0000","last_undegraded":"2024-02-09T23:58:27.320229+0000","last_fullsized":"2024-02-09T23:58:27.320229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.028836+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-09T23:58:27.028836+0000","last_peered":"2024-02-09T23:58:27.028836+0000","last_clean":"2024-02-09T23:58:27.028836+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-09T23:58:27.028836+0000","last_undegraded":"2024-02-09T23:58:27.028836+0000","last_fullsized":"2024-02-09T23:58:27.028836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.339496+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-09T23:58:27.339496+0000","last_peered":"2024-02-09T23:58:27.339496+0000","last_clean":"2024-02-09T23:58:27.339496+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-09T23:58:27.339496+0000","last_undegraded":"2024-02-09T23:58:27.339496+0000","last_fullsized":"2024-02-09T23:58:27.339496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387255+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-09T23:58:29.387255+0000","last_peered":"2024-02-09T23:58:29.387255+0000","last_clean":"2024-02-09T23:58:29.387255+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-09T23:58:29.387255+0000","last_undegraded":"2024-02-09T23:58:29.387255+0000","last_fullsized":"2024-02-09T23:58:29.387255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.010038+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:27.010038+0000","last_peered":"2024-02-09T23:58:27.010038+0000","last_clean":"2024-02-09T23:58:27.010038+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:27.010038+0000","last_undegraded":"2024-02-09T23:58:27.010038+0000","last_fullsized":"2024-02-09T23:58:27.010038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356834+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-09T23:58:27.356834+0000","last_peered":"2024-02-09T23:58:27.356834+0000","last_clean":"2024-02-09T23:58:27.356834+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-09T23:58:27.356834+0000","last_undegraded":"2024-02-09T23:58:27.356834+0000","last_fullsized":"2024-02-09T23:58:27.356834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317100+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:27.317100+0000","last_peered":"2024-02-09T23:58:27.317100+0000","last_clean":"2024-02-09T23:58:27.317100+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:27.317100+0000","last_undegraded":"2024-02-09T23:58:27.317100+0000","last_fullsized":"2024-02-09T23:58:27.317100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325268+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-09T23:58:28.325268+0000","last_peered":"2024-02-09T23:58:28.325268+0000","last_clean":"2024-02-09T23:58:28.325268+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-09T23:58:28.325268+0000","last_undegraded":"2024-02-09T23:58:28.325268+0000","last_fullsized":"2024-02-09T23:58:28.325268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334225+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-09T23:58:27.334225+0000","last_peered":"2024-02-09T23:58:27.334225+0000","last_clean":"2024-02-09T23:58:27.334225+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-09T23:58:27.334225+0000","last_undegraded":"2024-02-09T23:58:27.334225+0000","last_fullsized":"2024-02-09T23:58:27.334225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390822+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-09T23:58:29.390822+0000","last_peered":"2024-02-09T23:58:29.390822+0000","last_clean":"2024-02-09T23:58:29.390822+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-09T23:58:29.390822+0000","last_undegraded":"2024-02-09T23:58:29.390822+0000","last_fullsized":"2024-02-09T23:58:29.390822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357559+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-09T23:58:27.357559+0000","last_peered":"2024-02-09T23:58:27.357559+0000","last_clean":"2024-02-09T23:58:27.357559+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-09T23:58:27.357559+0000","last_undegraded":"2024-02-09T23:58:27.357559+0000","last_fullsized":"2024-02-09T23:58:27.357559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.347517+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-09T23:58:27.347517+0000","last_peered":"2024-02-09T23:58:27.347517+0000","last_clean":"2024-02-09T23:58:27.347517+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-09T23:58:27.347517+0000","last_undegraded":"2024-02-09T23:58:27.347517+0000","last_fullsized":"2024-02-09T23:58:27.347517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332903+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-09T23:58:27.332903+0000","last_peered":"2024-02-09T23:58:27.332903+0000","last_clean":"2024-02-09T23:58:27.332903+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-09T23:58:27.332903+0000","last_undegraded":"2024-02-09T23:58:27.332903+0000","last_fullsized":"2024-02-09T23:58:27.332903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340185+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-09T23:58:27.340185+0000","last_peered":"2024-02-09T23:58:27.340185+0000","last_clean":"2024-02-09T23:58:27.340185+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-09T23:58:27.340185+0000","last_undegraded":"2024-02-09T23:58:27.340185+0000","last_fullsized":"2024-02-09T23:58:27.340185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334290+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-09T23:58:27.334290+0000","last_peered":"2024-02-09T23:58:27.334290+0000","last_clean":"2024-02-09T23:58:27.334290+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-09T23:58:27.334290+0000","last_undegraded":"2024-02-09T23:58:27.334290+0000","last_fullsized":"2024-02-09T23:58:27.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337567+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-09T23:58:27.337567+0000","last_peered":"2024-02-09T23:58:27.337567+0000","last_clean":"2024-02-09T23:58:27.337567+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-09T23:58:27.337567+0000","last_undegraded":"2024-02-09T23:58:27.337567+0000","last_fullsized":"2024-02-09T23:58:27.337567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334061+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-09T23:58:27.334061+0000","last_peered":"2024-02-09T23:58:27.334061+0000","last_clean":"2024-02-09T23:58:27.334061+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-09T23:58:27.334061+0000","last_undegraded":"2024-02-09T23:58:27.334061+0000","last_fullsized":"2024-02-09T23:58:27.334061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.353922+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-09T23:58:27.353922+0000","last_peered":"2024-02-09T23:58:27.353922+0000","last_clean":"2024-02-09T23:58:27.353922+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-09T23:58:27.353922+0000","last_undegraded":"2024-02-09T23:58:27.353922+0000","last_fullsized":"2024-02-09T23:58:27.353922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348660+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-09T23:58:27.348660+0000","last_peered":"2024-02-09T23:58:27.348660+0000","last_clean":"2024-02-09T23:58:27.348660+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-09T23:58:27.348660+0000","last_undegraded":"2024-02-09T23:58:27.348660+0000","last_fullsized":"2024-02-09T23:58:27.348660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352936+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-09T23:58:27.352936+0000","last_peered":"2024-02-09T23:58:27.352936+0000","last_clean":"2024-02-09T23:58:27.352936+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-09T23:58:27.352936+0000","last_undegraded":"2024-02-09T23:58:27.352936+0000","last_fullsized":"2024-02-09T23:58:27.352936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.354758+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-09T23:58:27.354758+0000","last_peered":"2024-02-09T23:58:27.354758+0000","last_clean":"2024-02-09T23:58:27.354758+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-09T23:58:27.354758+0000","last_undegraded":"2024-02-09T23:58:27.354758+0000","last_fullsized":"2024-02-09T23:58:27.354758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333673+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-09T23:58:27.333673+0000","last_peered":"2024-02-09T23:58:27.333673+0000","last_clean":"2024-02-09T23:58:27.333673+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-09T23:58:27.333673+0000","last_undegraded":"2024-02-09T23:58:27.333673+0000","last_fullsized":"2024-02-09T23:58:27.333673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356759+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-09T23:58:27.356759+0000","last_peered":"2024-02-09T23:58:27.356759+0000","last_clean":"2024-02-09T23:58:27.356759+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-09T23:58:27.356759+0000","last_undegraded":"2024-02-09T23:58:27.356759+0000","last_fullsized":"2024-02-09T23:58:27.356759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349719+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-09T23:58:27.349719+0000","last_peered":"2024-02-09T23:58:27.349719+0000","last_clean":"2024-02-09T23:58:27.349719+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-09T23:58:27.349719+0000","last_undegraded":"2024-02-09T23:58:27.349719+0000","last_fullsized":"2024-02-09T23:58:27.349719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":47236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}]}} 2024-02-09T23:58:31.417 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-09T23:58:31.418 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-09T23:58:31.418 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-09T23:58:31.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-09T23:58:31.419 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-09T23:58:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.554+0000 7fae73e51700 1 Processor -- start 2024-02-09T23:58:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.554+0000 7fae73e51700 1 -- start start 2024-02-09T23:58:31.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae73e51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 0x7fae6c13b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae73e51700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 0x7fae6c13da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae73e51700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c0a1f10 con 0x7fae6c05dfb0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae73e51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0a0f60 con 0x7fae6c09f5d0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae73e51700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0a1200 con 0x7fae6c13b6a0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae71bed700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fae6c05dfb0 0x7fae6c0a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37852/0 (socket says 172.21.15.89:37852) 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae71bed700 1 -- 172.21.15.89:0/1806486224 learned_addr learned my addr 172.21.15.89:0/1806486224 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae713ec700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 0x7fae6c13b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae723ee700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 0x7fae6c13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae70beb700 1 -- 172.21.15.89:0/1806486224 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174874159 0 0) 0x7fae6c0a1f10 con 0x7fae6c05dfb0 2024-02-09T23:58:31.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae70beb700 1 -- 172.21.15.89:0/1806486224 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54003260 con 0x7fae6c05dfb0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae713ec700 1 -- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 msgr2=0x7fae6c13da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae713ec700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 0x7fae6c13da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae713ec700 1 -- 172.21.15.89:0/1806486224 >> v1:172.21.15.89:6789/0 conn(0x7fae6c05dfb0 legacy=0x7fae6c0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae713ec700 1 -- 172.21.15.89:0/1806486224 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c060520 con 0x7fae6c09f5d0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.555+0000 7fae723ee700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 0x7fae6c13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae713ec700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 0x7fae6c13b1b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fae6c0a20a0 tx=0x7fae68006df0).ready entity=mon.1 client_cookie=74fbe41036861e83 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae70beb700 1 -- 172.21.15.89:0/1806486224 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800d4a0 con 0x7fae6c09f5d0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae70beb700 1 -- 172.21.15.89:0/1806486224 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68000e90 con 0x7fae6c09f5d0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae70beb700 1 -- 172.21.15.89:0/1806486224 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800d7f0 con 0x7fae6c09f5d0 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 -- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 msgr2=0x7fae6c13b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 0x7fae6c13b1b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fae6c0a20a0 tx=0x7fae68006df0).stop 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 -- 172.21.15.89:0/1806486224 shutdown_connections 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c13b6a0 0x7fae6c13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 --2- 172.21.15.89:0/1806486224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c09f5d0 0x7fae6c13b1b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 -- 172.21.15.89:0/1806486224 >> 172.21.15.89:0/1806486224 conn(0x7fae6c0a93f0 msgr2=0x7fae6c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 -- 172.21.15.89:0/1806486224 shutdown_connections 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.556+0000 7fae73e51700 1 -- 172.21.15.89:0/1806486224 wait complete. 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.557+0000 7fae73e51700 1 Processor -- start 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.557+0000 7fae73e51700 1 -- start start 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 0x7fae6c137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 0x7fae6c131130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1385d0 con 0x7fae6c05dfb0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c139110 con 0x7fae6c13b6a0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1393b0 con 0x7fae6c09f5d0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae71bed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 0x7fae6c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae713ec700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 0x7fae6c137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae71bed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49932/0 (socket says 172.21.15.89:49932) 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae71bed700 1 -- 172.21.15.89:0/2179159943 learned_addr learned my addr 172.21.15.89:0/2179159943 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 -- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 msgr2=0x7fae6c137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 0x7fae6c137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 -- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 msgr2=0x7fae6c13b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 -- 172.21.15.89:0/2179159943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009470 con 0x7fae6c13b6a0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae71bed700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae713ec700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 0x7fae6c137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae723ee700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 0x7fae6c131130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fae6400c000 tx=0x7fae640091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae64012600 con 0x7fae6c13b6a0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64012760 con 0x7fae6c13b6a0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6800b180 con 0x7fae6c13b6a0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.558+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae64012ac0 con 0x7fae6c13b6a0 2024-02-09T23:58:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.559+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c138d40 con 0x7fae6c13b6a0 2024-02-09T23:58:31.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.559+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fae64022070 con 0x7fae6c13b6a0 2024-02-09T23:58:31.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.560+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fae6404ae80 con 0x7fae6c13b6a0 2024-02-09T23:58:31.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.560+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c057a60 con 0x7fae6c13b6a0 2024-02-09T23:58:31.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.563+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fae64016030 con 0x7fae6c13b6a0 2024-02-09T23:58:31.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.693+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fae6c09ec50 con 0x7fae6c13b6a0 2024-02-09T23:58:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.695+0000 7fae5affd700 1 -- 172.21.15.89:0/2179159943 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84879 (secure 0 0 0) 0x7fae6402a090 con 0x7fae6c13b6a0 2024-02-09T23:58:31.699 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 >> v1:172.21.15.89:6816/39389 conn(0x7fae4c038dd0 legacy=0x7fae4c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 msgr2=0x7fae6c131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 0x7fae6c131130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fae6400c000 tx=0x7fae640091d0).stop 2024-02-09T23:58:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 shutdown_connections 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae6c13b6a0 0x7fae6c131130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae6c05dfb0 0x7fae6c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 --2- 172.21.15.89:0/2179159943 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae6c09f5d0 0x7fae6c137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 >> 172.21.15.89:0/2179159943 conn(0x7fae6c0a93f0 msgr2=0x7fae6c05b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 shutdown_connections 2024-02-09T23:58:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.697+0000 7fae73e51700 1 -- 172.21.15.89:0/2179159943 wait complete. 2024-02-09T23:58:31.709 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6816","nonce":39389}]},"active_addr":"172.21.15.89:6816/39389","active_change":"2024-02-09T23:58:10.547083+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2640344124}]},{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3978228942}]},{"addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3039776512}]}]}} 2024-02-09T23:58:31.711 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-09T23:58:31.711 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-09T23:58:31.711 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:31.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 Processor -- start 2024-02-09T23:58:31.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 -- start start 2024-02-09T23:58:31.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff498133bc0 0x7ff498067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980a4c50 con 0x7ff4981337e0 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498133fe0 con 0x7ff498133bc0 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.812+0000 7ff49fefb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980a4f10 con 0x7ff498139fa0 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff498133bc0 0x7ff498067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49e498700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff498133bc0 0x7ff498067570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49934/0 (socket says 172.21.15.89:49934) 2024-02-09T23:58:31.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49e498700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44812/0 (socket says 172.21.15.89:44812) 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 -- 172.21.15.89:0/3448313748 learned_addr learned my addr 172.21.15.89:0/3448313748 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49dc97700 1 --1- 172.21.15.89:0/3448313748 >> v1:172.21.15.89:6789/0 conn(0x7ff4981337e0 0x7ff498139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37866/0 (socket says 172.21.15.89:37866) 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 -- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 msgr2=0x7ff498141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 -- 172.21.15.89:0/3448313748 >> v1:172.21.15.89:6789/0 conn(0x7ff4981337e0 legacy=0x7ff498139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 -- 172.21.15.89:0/3448313748 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498060520 con 0x7ff498133bc0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49cc95700 1 -- 172.21.15.89:0/3448313748 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703791357 0 0) 0x7ff4980a4c50 con 0x7ff4981337e0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49e498700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49d496700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498067570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488006eb0).ready entity=mon.0 client_cookie=5556f4072a037d28 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49cc95700 1 -- 172.21.15.89:0/3448313748 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48800d570 con 0x7ff498133bc0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49cc95700 1 -- 172.21.15.89:0/3448313748 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488000e90 con 0x7ff498133bc0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.813+0000 7ff49cc95700 1 -- 172.21.15.89:0/3448313748 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48800d8c0 con 0x7ff498133bc0 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 -- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 msgr2=0x7ff498067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498067570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488006eb0).stop 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 -- 172.21.15.89:0/3448313748 shutdown_connections 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff498139fa0 0x7ff498141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 --2- 172.21.15.89:0/3448313748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498067570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 -- 172.21.15.89:0/3448313748 >> 172.21.15.89:0/3448313748 conn(0x7ff4980a93f0 msgr2=0x7ff4980a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 -- 172.21.15.89:0/3448313748 shutdown_connections 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 -- 172.21.15.89:0/3448313748 wait complete. 2024-02-09T23:58:31.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.814+0000 7ff49fefb700 1 Processor -- start 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 -- start start 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 0x7ff498149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980a1420 con 0x7ff498133bc0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49809cab0 con 0x7ff4981337e0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49fefb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff49809cfe0 con 0x7ff498139fa0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49dc97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49dc97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44820/0 (socket says 172.21.15.89:44820) 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49dc97700 1 -- 172.21.15.89:0/4273976014 learned_addr learned my addr 172.21.15.89:0/4273976014 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49d496700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49e498700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 0x7ff498149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.815+0000 7ff49dc97700 1 -- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 msgr2=0x7ff498149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49dc97700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 0x7ff498149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49dc97700 1 -- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 msgr2=0x7ff498149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49dc97700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49dc97700 1 -- 172.21.15.89:0/4273976014 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009470 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49d496700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49e498700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 0x7ff498149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49dc97700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff494000bc0 tx=0x7ff494007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4940070d0 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff494007230 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48800b1e0 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff494005740 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.816+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49809ef90 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.817+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff494010070 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.817+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff494049f40 con 0x7ff4981337e0 2024-02-09T23:58:31.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.817+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff498065a50 con 0x7ff4981337e0 2024-02-09T23:58:31.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.820+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff49402ee40 con 0x7ff4981337e0 2024-02-09T23:58:31.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.931+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff498057a60 con 0x7ff4981337e0 2024-02-09T23:58:31.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.931+0000 7ff486ffd700 1 -- 172.21.15.89:0/4273976014 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7ff494032460 con 0x7ff4981337e0 2024-02-09T23:58:31.934 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:31.934 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.932+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 >> v1:172.21.15.89:6816/39389 conn(0x7ff478038dd0 legacy=0x7ff47803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.932+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 msgr2=0x7ff49809dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff494000bc0 tx=0x7ff494007a60).stop 2024-02-09T23:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 shutdown_connections 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff498139fa0 0x7ff498149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4981337e0 0x7ff49809dcb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 --2- 172.21.15.89:0/4273976014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff498133bc0 0x7ff498149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 >> 172.21.15.89:0/4273976014 conn(0x7ff4980a93f0 msgr2=0x7ff4980a7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 shutdown_connections 2024-02-09T23:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:31.933+0000 7ff49fefb700 1 -- 172.21.15.89:0/4273976014 wait complete. 2024-02-09T23:58:31.945 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-09T23:58:31.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:32.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.045+0000 7f1e55264700 1 Processor -- start 2024-02-09T23:58:32.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.045+0000 7f1e55264700 1 -- start start 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e500aae90 0x7f1e501331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 0x7f1e50067960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500603c0 con 0x7f1e500aae90 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500aa230 con 0x7f1e50132df0 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e55264700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500aa4d0 con 0x7f1e500674b0 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e500aae90 0x7f1e501331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 0x7f1e50067960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e500aae90 0x7f1e501331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49952/0 (socket says 172.21.15.89:49952) 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44834/0 (socket says 172.21.15.89:44834) 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/1824382049 learned_addr learned my addr 172.21.15.89:0/1824382049 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 msgr2=0x7f1e50067960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 0x7f1e50067960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 msgr2=0x7f1e50060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/1824382049 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500aa790 con 0x7f1e500aae90 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4f7fe700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 0x7f1e50067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.046+0000 7f1e4effd700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e500aae90 0x7f1e501331d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1e40002f70 tx=0x7f1e40006eb0).ready entity=mon.0 client_cookie=2d33587e5721437 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e4dffb700 1 -- 172.21.15.89:0/1824382049 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e4000d570 con 0x7f1e500aae90 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e4dffb700 1 -- 172.21.15.89:0/1824382049 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40000e90 con 0x7f1e500aae90 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e4dffb700 1 -- 172.21.15.89:0/1824382049 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e4000d900 con 0x7f1e500aae90 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 -- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e500aae90 msgr2=0x7f1e501331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e500aae90 0x7f1e501331d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1e40002f70 tx=0x7f1e40006eb0).stop 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 -- 172.21.15.89:0/1824382049 shutdown_connections 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500674b0 0x7f1e50067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e50132df0 0x7f1e50060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 --2- 172.21.15.89:0/1824382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e500aae90 0x7f1e501331d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 -- 172.21.15.89:0/1824382049 >> 172.21.15.89:0/1824382049 conn(0x7f1e5005c300 msgr2=0x7f1e5006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 -- 172.21.15.89:0/1824382049 shutdown_connections 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.047+0000 7f1e55264700 1 -- 172.21.15.89:0/1824382049 wait complete. 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.048+0000 7f1e55264700 1 Processor -- start 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.048+0000 7f1e55264700 1 -- start start 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 0x7f1e501375b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50095230 con 0x7f1e50132df0 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500954d0 con 0x7f1e500674b0 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500941d0 con 0x7f1e500aae90 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 0x7f1e501375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44838/0 (socket says 172.21.15.89:44838) 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4effd700 1 -- 172.21.15.89:0/2317645269 learned_addr learned my addr 172.21.15.89:0/2317645269 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4f7fe700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49956/0 (socket says 172.21.15.89:49956) 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 msgr2=0x7f1e50097860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 msgr2=0x7f1e50092fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 -- 172.21.15.89:0/2317645269 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009470 con 0x7f1e500aae90 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4effd700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4f7fe700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e4e7fc700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 0x7f1e501375b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1e40002f70 tx=0x7f1e40015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e4000dea0 con 0x7f1e500aae90 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40006b40 con 0x7f1e500aae90 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4400b180 con 0x7f1e500aae90 2024-02-09T23:58:32.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.049+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e40011e20 con 0x7f1e500aae90 2024-02-09T23:58:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.050+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4000b1e0 con 0x7f1e500aae90 2024-02-09T23:58:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.050+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1e40025030 con 0x7f1e500aae90 2024-02-09T23:58:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.050+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e500a9a90 con 0x7f1e500aae90 2024-02-09T23:58:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.051+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1e4004b920 con 0x7f1e500aae90 2024-02-09T23:58:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.053+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1e40028440 con 0x7f1e500aae90 2024-02-09T23:58:32.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.165+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e50057a60 con 0x7f1e500aae90 2024-02-09T23:58:32.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.165+0000 7f1e3ffff700 1 -- 172.21.15.89:0/2317645269 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f1e400206d0 con 0x7f1e500aae90 2024-02-09T23:58:32.168 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:32.168 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:32.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 >> v1:172.21.15.89:6816/39389 conn(0x7f1e2c038dd0 legacy=0x7f1e2c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 msgr2=0x7f1e501375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 0x7f1e501375b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1e40002f70 tx=0x7f1e40015000).stop 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 shutdown_connections 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e50132df0 0x7f1e50092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e500674b0 0x7f1e50097860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 --2- 172.21.15.89:0/2317645269 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1e500aae90 0x7f1e501375b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 >> 172.21.15.89:0/2317645269 conn(0x7f1e5005c300 msgr2=0x7f1e500a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 shutdown_connections 2024-02-09T23:58:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.167+0000 7f1e55264700 1 -- 172.21.15.89:0/2317645269 wait complete. 2024-02-09T23:58:32.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-09T23:58:32.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-09T23:58:32.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-09T23:58:32.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-09T23:58:32.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.289+0000 7fd368c58700 1 Processor -- start 2024-02-09T23:58:32.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.289+0000 7fd368c58700 1 -- start start 2024-02-09T23:58:32.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd368c58700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409aa10 0x7fd3640621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd368c58700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd364064700 0x7fd364136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd368c58700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36409b2a0 con 0x7fd36409adf0 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd368c58700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36409bc50 con 0x7fd364064700 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd368c58700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641367e0 con 0x7fd36409aa10 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd364064700 0x7fd364136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd364064700 0x7fd364136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49972/0 (socket says 172.21.15.89:49972) 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd362d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd36409adf0 0x7fd364132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37882/0 (socket says 172.21.15.89:37882) 2024-02-09T23:58:32.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 -- 172.21.15.89:0/1050049021 learned_addr learned my addr 172.21.15.89:0/1050049021 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd36259c700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409aa10 0x7fd3640621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 -- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409aa10 msgr2=0x7fd3640621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409aa10 0x7fd3640621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 -- 172.21.15.89:0/1050049021 >> v1:172.21.15.89:6789/0 conn(0x7fd36409adf0 legacy=0x7fd364132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 -- 172.21.15.89:0/1050049021 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364136aa0 con 0x7fd364064700 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.290+0000 7fd361d9b700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364136140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd358002f70 tx=0x7fd358006e50).ready entity=mon.0 client_cookie=da0c2bf6c2078a8d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd36159a700 1 -- 172.21.15.89:0/1050049021 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd358014a70 con 0x7fd364064700 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd36159a700 1 -- 172.21.15.89:0/1050049021 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358000e90 con 0x7fd364064700 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd36159a700 1 -- 172.21.15.89:0/1050049021 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd358014e00 con 0x7fd364064700 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 -- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 msgr2=0x7fd364136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364136140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd358002f70 tx=0x7fd358006e50).stop 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 -- 172.21.15.89:0/1050049021 shutdown_connections 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409aa10 0x7fd3640621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 --2- 172.21.15.89:0/1050049021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364136140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 -- 172.21.15.89:0/1050049021 >> 172.21.15.89:0/1050049021 conn(0x7fd36406c0c0 msgr2=0x7fd36406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 -- 172.21.15.89:0/1050049021 shutdown_connections 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.291+0000 7fd368c58700 1 -- 172.21.15.89:0/1050049021 wait complete. 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.292+0000 7fd368c58700 1 Processor -- start 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 -- start start 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364094ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36409aa10 0x7fd364093680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 0x7fd364141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640933e0 con 0x7fd364064700 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364067420 con 0x7fd36409aa10 2024-02-09T23:58:32.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd368c58700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd364092230 con 0x7fd36409adf0 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd362d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 0x7fd364141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd362d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 0x7fd364141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57132/0 (socket says 172.21.15.89:57132) 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd362d9d700 1 -- 172.21.15.89:0/643498380 learned_addr learned my addr 172.21.15.89:0/643498380 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.293+0000 7fd36259c700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364094ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 -- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 msgr2=0x7fd364141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 0x7fd364141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 -- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36409aa10 msgr2=0x7fd364093680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36409aa10 0x7fd364093680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 -- 172.21.15.89:0/643498380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35800b1e0 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd362d9d700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd36409adf0 0x7fd364141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd36259c700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364094ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd35400c000 tx=0x7fd354006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd354010780 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3540108e0 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364094400 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd354010c40 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.294+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364141920 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.295+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd35401b410 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.295+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd364092370 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.295+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd35404a9a0 con 0x7fd364064700 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.295+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 --> v1:172.21.15.89:6804/39985 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3400455b0 con 0x7fd3400418c0 2024-02-09T23:58:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.295+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd354033230 con 0x7fd364064700 2024-02-09T23:58:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 Processor -- start 2024-02-09T23:58:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 -- start start 2024-02-09T23:58:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== osd.3 v1:172.21.15.89:6804/39985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fd3400455b0 con 0x7fd3400418c0 2024-02-09T23:58:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec0a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6ec13e5c0 0x7fb6ec1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec05d160 con 0x7fb6ec0ac780 2024-02-09T23:58:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec136080 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6f247a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec136340 con 0x7fb6ec05cd20 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6ebfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb6ec0ac780 0x7fb6ec05d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37894/0 (socket says 172.21.15.89:37894) 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6ebfff700 1 -- 172.21.15.89:0/1145063625 learned_addr learned my addr 172.21.15.89:0/1145063625 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.296+0000 7fb6eb7fe700 1 --2- 172.21.15.89:0/1145063625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec0a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.297+0000 7fb6eb7fe700 1 -- 172.21.15.89:0/1145063625 >> v2:172.21.15.89:3300/0 conn(0x7fb6ec13e5c0 msgr2=0x7fb6ec1409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.297+0000 7fb6eb7fe700 1 --2- 172.21.15.89:0/1145063625 >> v2:172.21.15.89:3300/0 conn(0x7fb6ec13e5c0 0x7fb6ec1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.297+0000 7fb6eb7fe700 1 -- 172.21.15.89:0/1145063625 >> v1:172.21.15.89:6789/0 conn(0x7fb6ec0ac780 legacy=0x7fb6ec05d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.297+0000 7fb6eb7fe700 1 -- 172.21.15.89:0/1145063625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0a7880 con 0x7fb6ec05cd20 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.297+0000 7fb6eb7fe700 1 --2- 172.21.15.89:0/1145063625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec0a9710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb6e0001110 tx=0x7fb6dc006df0).ready entity=mon.1 client_cookie=ccd96a0d7820f304 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6eaffd700 1 -- 172.21.15.89:0/1145063625 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6dc00d570 con 0x7fb6ec05cd20 2024-02-09T23:58:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6eaffd700 1 -- 172.21.15.89:0/1145063625 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc000e90 con 0x7fb6ec05cd20 2024-02-09T23:58:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6eaffd700 1 -- 172.21.15.89:0/1145063625 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6dc00d8c0 con 0x7fb6ec05cd20 2024-02-09T23:58:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 -- 172.21.15.89:0/1145063625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 msgr2=0x7fb6ec0a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 --2- 172.21.15.89:0/1145063625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec0a9710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb6e0001110 tx=0x7fb6dc006df0).stop 2024-02-09T23:58:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 -- 172.21.15.89:0/1145063625 shutdown_connections 2024-02-09T23:58:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 --2- 172.21.15.89:0/1145063625 >> v2:172.21.15.89:3300/0 conn(0x7fb6ec13e5c0 0x7fb6ec1409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 --2- 172.21.15.89:0/1145063625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec0a9710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 -- 172.21.15.89:0/1145063625 >> 172.21.15.89:0/1145063625 conn(0x7fb6ec067790 msgr2=0x7fb6ec067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.298+0000 7fb6f247a700 1 -- 172.21.15.89:0/1145063625 shutdown_connections 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.299+0000 7fb6f247a700 1 -- 172.21.15.89:0/1145063625 wait complete. 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.299+0000 7fb6f247a700 1 Processor -- start 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.299+0000 7fb6f247a700 1 -- start start 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec1385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6ec0ac780 0x7fb6ec1379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6ec13e5c0 0x7fb6ec13b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec138ab0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec12c010 con 0x7fb6ec05cd20 2024-02-09T23:58:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f247a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec139af0 con 0x7fb6ec0ac780 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec1385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec1385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44856/0 (socket says 172.21.15.89:44856) 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6ebfff700 1 -- 172.21.15.89:0/1125090515 learned_addr learned my addr 172.21.15.89:0/1125090515 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6f0a17700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6ec13e5c0 0x7fb6ec13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.300+0000 7fb6eb7fe700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6ec0ac780 0x7fb6ec1379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 -- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6ec0ac780 msgr2=0x7fb6ec1379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6ec0ac780 0x7fb6ec1379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 -- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 msgr2=0x7fb6ec1385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6ec05cd20 0x7fb6ec1385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 -- 172.21.15.89:0/1125090515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc00b180 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f0a17700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6ec13e5c0 0x7fb6ec13b530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb6e40032f0 tx=0x7fb6e40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400e470 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec139db0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.301+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec13c920 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.302+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400e5d0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.302+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400e930 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.302+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6ec1398b0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7f5f489bf700 1 Processor -- start 2024-02-09T23:58:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb6e4018030 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb6e404a8c0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 --> v1:172.21.15.89:6808/39986 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6cc0455e0 con 0x7fb6cc041990 2024-02-09T23:58:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e404aca0 con 0x7fb6ec13e5c0 2024-02-09T23:58:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.303+0000 7f5f489bf700 1 -- start start 2024-02-09T23:58:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f4409f010 0x7f5f440a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 0x7f5f4409f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f4409f8e0 0x7f5f440a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4409c8f0 con 0x7f5f4409f8e0 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4409c5e0 con 0x7f5f440a4fa0 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f489bf700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440a1540 con 0x7f5f4409f010 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f4409f8e0 0x7f5f440a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 0x7f5f4409f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 0x7f5f4409f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44862/0 (socket says 172.21.15.89:44862) 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f4409f8e0 0x7f5f440a3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49998/0 (socket says 172.21.15.89:49998) 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f41d9b700 1 -- 172.21.15.89:0/4190605394 learned_addr learned my addr 172.21.15.89:0/4190605394 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f4259c700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f4409f010 0x7f5f440a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 -- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f4409f010 msgr2=0x7f5f440a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f4409f010 0x7f5f440a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 -- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 msgr2=0x7f5f4409f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 0x7f5f4409f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 -- 172.21.15.89:0/4190605394 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4409cb20 con 0x7f5f4409f8e0 2024-02-09T23:58:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.304+0000 7f5f42d9d700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f8e0 0x7f5f440a3220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5f3c0032f0 tx=0x7f5f3c0091d0).ready entity=mon.0 client_cookie=1bde5d6558124e14 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 Processor -- start 2024-02-09T23:58:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7f5f4159a700 1 -- 172.21.15.89:0/4190605394 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3c00f940 con 0x7f5f4409f8e0 2024-02-09T23:58:32.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7f5f4159a700 1 -- 172.21.15.89:0/4190605394 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00faa0 con 0x7f5f4409f8e0 2024-02-09T23:58:32.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7f5f4159a700 1 -- 172.21.15.89:0/4190605394 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3c00fe00 con 0x7f5f4409f8e0 2024-02-09T23:58:32.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 -- start start 2024-02-09T23:58:32.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb4067570 0x7fdeb4139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7f5f489bf700 1 -- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f8e0 msgr2=0x7f5f440a3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7f5f489bf700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f8e0 0x7f5f440a3220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5f3c0032f0 tx=0x7f5f3c0091d0).stop 2024-02-09T23:58:32.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== osd.0 v1:172.21.15.89:6808/39986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fb6cc0455e0 con 0x7fb6cc041990 2024-02-09T23:58:32.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdeb4139d80 0x7fdeb413a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb4067990 con 0x7fdeb4139d80 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb413a6f0 con 0x7fdeb4067570 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.305+0000 7fdebbaad700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40a4c50 con 0x7fdeb41337e0 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb9849700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdeb4139d80 0x7fdeb413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb9849700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57154/0 (socket says 172.21.15.89:57154) 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb9849700 1 -- 172.21.15.89:0/744556946 learned_addr learned my addr 172.21.15.89:0/744556946 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb9048700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb4067570 0x7fdeb4139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 -- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 msgr2=0x7fdeb4133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 -- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb4067570 msgr2=0x7fdeb4139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb4067570 0x7fdeb4139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 -- 172.21.15.89:0/744556946 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40a4f10 con 0x7fdeb4139d80 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb9849700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeba04a700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4139d80 0x7fdeb413a200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdeac0032f0 tx=0x7fdeac0091d0).ready entity=mon.0 client_cookie=fbaaf8f93cd778e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb8847700 1 -- 172.21.15.89:0/744556946 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac009ea0 con 0x7fdeb4139d80 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb8847700 1 -- 172.21.15.89:0/744556946 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac00b8a0 con 0x7fdeb4139d80 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7fdeb8847700 1 -- 172.21.15.89:0/744556946 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac00ba10 con 0x7fdeb4139d80 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 -- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4139d80 msgr2=0x7fdeb413a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4139d80 0x7fdeb413a200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdeac0032f0 tx=0x7fdeac0091d0).stop 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 -- 172.21.15.89:0/744556946 shutdown_connections 2024-02-09T23:58:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4139d80 0x7fdeb413a200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb41337e0 0x7fdeb4133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 --2- 172.21.15.89:0/744556946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb4067570 0x7fdeb4139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 -- 172.21.15.89:0/744556946 >> 172.21.15.89:0/744556946 conn(0x7fdeb40a93f0 msgr2=0x7fdeb40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 -- 172.21.15.89:0/744556946 shutdown_connections 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.307+0000 7fdebbaad700 1 -- 172.21.15.89:0/744556946 wait complete. 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 Processor -- start 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 -- start start 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4067570 0x7fdeb409fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb41337e0 0x7fdeb4132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb4139d80 0x7fdeb4132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb4092d30 con 0x7fdeb4067570 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb4092ee0 con 0x7fdeb41337e0 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.308+0000 7fdebbaad700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40a0850 con 0x7fdeb4139d80 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeb9048700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb41337e0 0x7fdeb4132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeb9048700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb41337e0 0x7fdeb4132140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44880/0 (socket says 172.21.15.89:44880) 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeb9048700 1 -- 172.21.15.89:0/2833120716 learned_addr learned my addr 172.21.15.89:0/2833120716 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb4139d80 0x7fdeb4132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeb9849700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4067570 0x7fdeb409fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 -- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb41337e0 msgr2=0x7fdeb4132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdeb41337e0 0x7fdeb4132140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 -- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4067570 msgr2=0x7fdeb409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeb4067570 0x7fdeb409fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 -- 172.21.15.89:0/2833120716 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009470 con 0x7fdeb4139d80 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdeba04a700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb4139d80 0x7fdeb4132630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdeac0032f0 tx=0x7fdeac016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac009ea0 con 0x7fdeb4139d80 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac021670 con 0x7fdeb4139d80 2024-02-09T23:58:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb40920d0 con 0x7fdeb4139d80 2024-02-09T23:58:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7f5f489bf700 1 -- 172.21.15.89:0/4190605394 shutdown_connections 2024-02-09T23:58:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7f5f489bf700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f8e0 0x7f5f440a3220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7f5f489bf700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f4409f010 0x7f5f440a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7f5f489bf700 1 --2- 172.21.15.89:0/4190605394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f440a4fa0 0x7f5f4409f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.306+0000 7f5f489bf700 1 -- 172.21.15.89:0/4190605394 >> 172.21.15.89:0/4190605394 conn(0x7f5f440a93f0 msgr2=0x7f5f440a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac0219d0 con 0x7fdeb4139d80 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.309+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb40a1420 con 0x7fdeb4139d80 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.310+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdeb409fce0 con 0x7fdeb4139d80 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7f5f489bf700 1 -- 172.21.15.89:0/4190605394 shutdown_connections 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7f5f489bf700 1 -- 172.21.15.89:0/4190605394 wait complete. 2024-02-09T23:58:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdeac00f070 con 0x7fdeb4139d80 2024-02-09T23:58:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdeac04bcb0 con 0x7fdeb4139d80 2024-02-09T23:58:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 --> v1:172.21.15.89:6800/39988 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde940456b0 con 0x7fde940419c0 2024-02-09T23:58:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.311+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdeac04bfc0 con 0x7fdeb4139d80 2024-02-09T23:58:32.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 Processor -- start 2024-02-09T23:58:32.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 -- start start 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f010 0x7f5f441200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f4409f8e0 0x7f5f44121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f440a4fa0 0x7f5f44147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44120ab0 con 0x7f5f4409f010 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44120590 con 0x7f5f4409f8e0 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f489bf700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4414a130 con 0x7f5f440a4fa0 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f42d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f440a4fa0 0x7f5f44147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f4409f8e0 0x7f5f44121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f4259c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f010 0x7f5f441200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f4409f8e0 0x7f5f44121220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44882/0 (socket says 172.21.15.89:44882) 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f42d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f440a4fa0 0x7f5f44147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57166/0 (socket says 172.21.15.89:57166) 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.312+0000 7f5f41d9b700 1 -- 172.21.15.89:0/3514092658 learned_addr learned my addr 172.21.15.89:0/3514092658 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 -- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f440a4fa0 msgr2=0x7f5f44147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 --2- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5f440a4fa0 0x7f5f44147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 -- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f4409f8e0 msgr2=0x7f5f44121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 --2- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f4409f8e0 0x7f5f44121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 -- 172.21.15.89:0/3514092658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009470 con 0x7f5f4409f010 2024-02-09T23:58:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f4259c700 1 --2- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f010 0x7f5f441200a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5f3800c000 tx=0x7f5f38006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38010780 con 0x7f5f4409f010 2024-02-09T23:58:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380108e0 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f44066510 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38010c40 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.313+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f44067170 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5f3801c460 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f440666a0 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5f3804ab80 con 0x7f5f4409f010 2024-02-09T23:58:32.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== osd.2 v1:172.21.15.89:6800/39988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fde940456b0 con 0x7fde940419c0 2024-02-09T23:58:32.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 --> v1:172.21.15.89:6812/39987 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f200456d0 con 0x7f5f200419e0 2024-02-09T23:58:32.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.315+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f3802f820 con 0x7f5f4409f010 2024-02-09T23:58:32.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.316+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== osd.1 v1:172.21.15.89:6812/39987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f5f200456d0 con 0x7f5f200419e0 2024-02-09T23:58:32.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.317+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 --> v1:172.21.15.89:6804/39985 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd364057a60 con 0x7fd3400418c0 2024-02-09T23:58:32.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd3537fe700 1 -- 172.21.15.89:0/643498380 <== osd.3 v1:172.21.15.89:6804/39985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7fd364057a60 con 0x7fd3400418c0 2024-02-09T23:58:32.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 >> v1:172.21.15.89:6804/39985 conn(0x7fd3400418c0 legacy=0x7fd340043d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 >> v1:172.21.15.89:6816/39389 conn(0x7fd340038dd0 legacy=0x7fd34003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 msgr2=0x7fd364094ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd368c58700 1 --2- 172.21.15.89:0/643498380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd364064700 0x7fd364094ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd35400c000 tx=0x7fd354006df0).stop 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.319+0000 7fd362d9d700 1 -- 172.21.15.89:0/643498380 reap_dead start 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.320+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 shutdown_connections 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.320+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 >> 172.21.15.89:0/643498380 conn(0x7fd36406c0c0 msgr2=0x7fd364133560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.320+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 shutdown_connections 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.320+0000 7fd368c58700 1 -- 172.21.15.89:0/643498380 wait complete. 2024-02-09T23:58:32.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.326+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 --> v1:172.21.15.89:6808/39986 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6ec1382e0 con 0x7fb6cc041990 2024-02-09T23:58:32.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.326+0000 7fb6e97fa700 1 -- 172.21.15.89:0/1125090515 <== osd.0 v1:172.21.15.89:6808/39986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fb6ec1382e0 con 0x7fb6cc041990 2024-02-09T23:58:32.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 >> v1:172.21.15.89:6808/39986 conn(0x7fb6cc041990 legacy=0x7fb6cc043e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 >> v1:172.21.15.89:6816/39389 conn(0x7fb6cc038ec0 legacy=0x7fb6cc03b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6ec13e5c0 msgr2=0x7fb6ec13b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 --2- 172.21.15.89:0/1125090515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6ec13e5c0 0x7fb6ec13b530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb6e40032f0 tx=0x7fb6e40090f0).stop 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f0a17700 1 -- 172.21.15.89:0/1125090515 reap_dead start 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 shutdown_connections 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 >> 172.21.15.89:0/1125090515 conn(0x7fb6ec067790 msgr2=0x7fb6ec05d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 shutdown_connections 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.327+0000 7fb6f247a700 1 -- 172.21.15.89:0/1125090515 wait complete. 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.331+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 --> v1:172.21.15.89:6800/39988 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdeb40a0600 con 0x7fde940419c0 2024-02-09T23:58:32.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.331+0000 7fdea2ffd700 1 -- 172.21.15.89:0/2833120716 <== osd.2 v1:172.21.15.89:6800/39988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2972949718) 0x7fdea400b460 con 0x7fde940419c0 2024-02-09T23:58:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.332+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 >> v1:172.21.15.89:6800/39988 conn(0x7fde940419c0 legacy=0x7fde94043e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.332+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 >> v1:172.21.15.89:6816/39389 conn(0x7fde94038dd0 legacy=0x7fde9403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.332+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb4139d80 msgr2=0x7fdeb4132630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.332+0000 7fdebbaad700 1 --2- 172.21.15.89:0/2833120716 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdeb4139d80 0x7fdeb4132630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdeac0032f0 tx=0x7fdeac016000).stop 2024-02-09T23:58:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7fdeba04a700 1 -- 172.21.15.89:0/2833120716 reap_dead start 2024-02-09T23:58:32.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 --> v1:172.21.15.89:6812/39987 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f44057a60 con 0x7f5f200419e0 2024-02-09T23:58:32.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 shutdown_connections 2024-02-09T23:58:32.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 >> 172.21.15.89:0/2833120716 conn(0x7fdeb40a93f0 msgr2=0x7fdeb41353d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 shutdown_connections 2024-02-09T23:58:32.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7fdebbaad700 1 -- 172.21.15.89:0/2833120716 wait complete. 2024-02-09T23:58:32.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.333+0000 7f5f337fe700 1 -- 172.21.15.89:0/3514092658 <== osd.1 v1:172.21.15.89:6812/39987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f5f44057a60 con 0x7f5f200419e0 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 >> v1:172.21.15.89:6812/39987 conn(0x7f5f200419e0 legacy=0x7f5f20043e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 >> v1:172.21.15.89:6816/39389 conn(0x7f5f20038df0 legacy=0x7f5f2003b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f010 msgr2=0x7f5f441200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 --2- 172.21.15.89:0/3514092658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f4409f010 0x7f5f441200a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5f3800c000 tx=0x7f5f38006df0).stop 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f42d9d700 1 -- 172.21.15.89:0/3514092658 reap_dead start 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 shutdown_connections 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 >> 172.21.15.89:0/3514092658 conn(0x7f5f440a93f0 msgr2=0x7f5f440a53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 shutdown_connections 2024-02-09T23:58:32.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.334+0000 7f5f489bf700 1 -- 172.21.15.89:0/3514092658 wait complete. 2024-02-09T23:58:32.343 INFO:teuthology.orchestra.run.smithi089.stdout:38654705670 2024-02-09T23:58:32.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-09T23:58:32.345 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-02-09T23:58:32.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-09T23:58:32.351 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-02-09T23:58:32.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-09T23:58:32.352 INFO:teuthology.orchestra.run.smithi089.stdout:38654705671 2024-02-09T23:58:32.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-09T23:58:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.470+0000 7f4259435700 1 Processor -- start 2024-02-09T23:58:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.470+0000 7f4259435700 1 -- start start 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f425409b520 0x7f4254136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425409a380 con 0x7f425409b520 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254135fe0 con 0x7f4254099a00 2024-02-09T23:58:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4259435700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4254099eb0 con 0x7f42541366f0 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f42537fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f42537fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44892/0 (socket says 172.21.15.89:44892) 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57174/0 (socket says 172.21.15.89:57174) 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f42537fe700 1 -- 172.21.15.89:0/254874557 learned_addr learned my addr 172.21.15.89:0/254874557 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f42527fc700 1 --2- 172.21.15.89:0/254874557 >> v2:172.21.15.89:3300/0 conn(0x7f425409b520 0x7f4254136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 -- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 msgr2=0x7f4254139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 -- 172.21.15.89:0/254874557 >> v2:172.21.15.89:3300/0 conn(0x7f425409b520 msgr2=0x7f4254136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 --2- 172.21.15.89:0/254874557 >> v2:172.21.15.89:3300/0 conn(0x7f425409b520 0x7f4254136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 -- 172.21.15.89:0/254874557 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425409a0c0 con 0x7f42541366f0 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f42537fe700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.471+0000 7f4252ffd700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4244002f70 tx=0x7f4244006df0).ready entity=mon.2 client_cookie=fdcc14a8cb950f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4251ffb700 1 -- 172.21.15.89:0/254874557 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424400d4a0 con 0x7f42541366f0 2024-02-09T23:58:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4251ffb700 1 -- 172.21.15.89:0/254874557 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244000e90 con 0x7f42541366f0 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4251ffb700 1 -- 172.21.15.89:0/254874557 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424400d7f0 con 0x7f42541366f0 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 -- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 msgr2=0x7f425409bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4244002f70 tx=0x7f4244006df0).stop 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 -- 172.21.15.89:0/254874557 shutdown_connections 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4254099a00 0x7f4254139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 --2- 172.21.15.89:0/254874557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f425409bbb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.472+0000 7f4259435700 1 --2- 172.21.15.89:0/254874557 >> v2:172.21.15.89:3300/0 conn(0x7f425409b520 0x7f4254136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.473+0000 7f4259435700 1 -- 172.21.15.89:0/254874557 >> 172.21.15.89:0/254874557 conn(0x7f425406c0c0 msgr2=0x7f425406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.473+0000 7f4259435700 1 -- 172.21.15.89:0/254874557 shutdown_connections 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.473+0000 7f4259435700 1 -- 172.21.15.89:0/254874557 wait complete. 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.474+0000 7f4259435700 1 Processor -- start 2024-02-09T23:58:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.474+0000 7f4259435700 1 -- start start 2024-02-09T23:58:32.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 0x7f4254148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f42541492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425409cff0 con 0x7f4254099a00 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42540983b0 con 0x7f425409b520 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4259435700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4254094a40 con 0x7f42541366f0 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50042/0 (socket says 172.21.15.89:50042) 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f4252ffd700 1 -- 172.21.15.89:0/4162751404 learned_addr learned my addr 172.21.15.89:0/4162751404 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f42537fe700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f42541492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f42527fc700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 0x7f4254148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.475+0000 7f42527fc700 1 -- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 msgr2=0x7f42541492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f42527fc700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f42541492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f42527fc700 1 -- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 msgr2=0x7f42540979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f42527fc700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f42527fc700 1 -- 172.21.15.89:0/4162751404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009530 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4252ffd700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f42527fc700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 0x7f4254148dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f424800c000 tx=0x7f4248006d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424800be00 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42480104c0 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424400b180 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4248010820 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.476+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42540967c0 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.477+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f424801a030 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.477+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4254057a60 con 0x7f425409b520 2024-02-09T23:58:32.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.477+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f424804a2d0 con 0x7f425409b520 2024-02-09T23:58:32.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.483+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4248032c00 con 0x7f425409b520 2024-02-09T23:58:32.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.500+0000 7f64ab0be700 1 Processor -- start 2024-02-09T23:58:32.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.500+0000 7fcbbfb3b700 1 Processor -- start 2024-02-09T23:58:32.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.500+0000 7fcbbfb3b700 1 -- start start 2024-02-09T23:58:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.500+0000 7f64ab0be700 1 -- start start 2024-02-09T23:58:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64ab0be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64a40a4fa0 0x7f64a409f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64ab0be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64a409f8e0 0x7f64a413d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64ab0be700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a409c8f0 con 0x7f64a409f010 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64ab0be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a409c5e0 con 0x7f64a40a4fa0 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64ab0be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40a1540 con 0x7f64a409f8e0 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64a8e5a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f64a409f010 0x7f64a40a1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37904/0 (socket says 172.21.15.89:37904) 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64a8e5a700 1 -- 172.21.15.89:0/2212612524 learned_addr learned my addr 172.21.15.89:0/2212612524 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:32.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64a3fff700 1 --2- 172.21.15.89:0/2212612524 >> v2:172.21.15.89:3300/0 conn(0x7f64a40a4fa0 0x7f64a409f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbfb3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbfb3b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbfb3b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb809a0c0 con 0x7fcbb81366f0 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbfb3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb809a380 con 0x7fcbb809b520 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbfb3b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8135fe0 con 0x7fcbb8136ad0 2024-02-09T23:58:32.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbd0d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64a965b700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64a409f8e0 0x7f64a413d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbd0d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44914/0 (socket says 172.21.15.89:44914) 2024-02-09T23:58:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7fcbbd0d6700 1 -- 172.21.15.89:0/3276856606 learned_addr learned my addr 172.21.15.89:0/3276856606 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.501+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153657037 0 0) 0x7f64a409c8f0 con 0x7f64a409f010 2024-02-09T23:58:32.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6488003260 con 0x7f64a409f010 2024-02-09T23:58:32.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbd0d6700 1 -- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 msgr2=0x7fcbb8099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbd0d6700 1 --2- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbd0d6700 1 -- 172.21.15.89:0/3276856606 >> v1:172.21.15.89:6789/0 conn(0x7fcbb81366f0 legacy=0x7fcbb8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbd0d6700 1 -- 172.21.15.89:0/3276856606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8067cb0 con 0x7fcbb809b520 2024-02-09T23:58:32.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbd0d6700 1 --2- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcbb809af80 tx=0x7fcba8006e50).ready entity=mon.1 client_cookie=1a310186a5f3244 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbc8d5700 1 -- 172.21.15.89:0/3276856606 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcba800d570 con 0x7fcbb809b520 2024-02-09T23:58:32.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbc8d5700 1 -- 172.21.15.89:0/3276856606 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8000e90 con 0x7fcbb809b520 2024-02-09T23:58:32.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7fcbbc8d5700 1 -- 172.21.15.89:0/3276856606 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcba800d900 con 0x7fcbb809b520 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 842106240 0 0) 0x7f6488003260 con 0x7f64a409f010 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64a409f8e0 msgr2=0x7f64a413d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64a409f8e0 0x7f64a413d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 >> v2:172.21.15.89:3300/0 conn(0x7f64a40a4fa0 msgr2=0x7f64a409f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 --2- 172.21.15.89:0/2212612524 >> v2:172.21.15.89:3300/0 conn(0x7f64a40a4fa0 0x7f64a409f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a409cb20 con 0x7f64a409f010 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4162454647 0 0) 0x7f6498001660 con 0x7f64a409f010 2024-02-09T23:58:32.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 >> v1:172.21.15.89:6789/0 conn(0x7f64a409f010 legacy=0x7f64a40a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f6488003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6488004500 0x7f6488004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6488004e70 0x7f648800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a409c5e0 con 0x7f6488004e70 2024-02-09T23:58:32.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40a1540 con 0x7f64880037d0 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f648800bc90 con 0x7f6488004500 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a8e5a700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f6488003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.502+0000 7f64a965b700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6488004e70 0x7f648800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 -- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6488004500 msgr2=0x7f6488004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6488004500 0x7f6488004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 -- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6488004e70 msgr2=0x7f648800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6488004e70 0x7f648800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 -- 172.21.15.89:0/2212612524 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488003260 con 0x7f64880037d0 2024-02-09T23:58:32.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 msgr2=0x7fcbb809bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcbb809af80 tx=0x7fcba8006e50).stop 2024-02-09T23:58:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a8e5a700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f6488003bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6498001370 tx=0x7f6498001d80).ready entity=mon.1 client_cookie=2f23ffdd0c56c089 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64980070d0 con 0x7f64880037d0 2024-02-09T23:58:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/3276856606 shutdown_connections 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/3276856606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb809b520 0x7fcbb809bbb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/3276856606 >> 172.21.15.89:0/3276856606 conn(0x7fcbb806c0c0 msgr2=0x7fcbb806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6498007230 con 0x7f64880037d0 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7f64a37fe700 1 -- 172.21.15.89:0/2212612524 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649800c8f0 con 0x7f64880037d0 2024-02-09T23:58:32.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/3276856606 shutdown_connections 2024-02-09T23:58:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.503+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/3276856606 wait complete. 2024-02-09T23:58:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 -- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 msgr2=0x7f6488003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 --2- 172.21.15.89:0/2212612524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f6488003bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6498001370 tx=0x7f6498001d80).stop 2024-02-09T23:58:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64a965b700 1 -- 172.21.15.89:0/2212612524 reap_dead start 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7fcbbfb3b700 1 Processor -- start 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7fcbbfb3b700 1 -- start start 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 -- 172.21.15.89:0/2212612524 shutdown_connections 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 -- 172.21.15.89:0/2212612524 >> 172.21.15.89:0/2212612524 conn(0x7f64a40a93f0 msgr2=0x7f64a40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 -- 172.21.15.89:0/2212612524 shutdown_connections 2024-02-09T23:58:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.504+0000 7f64ab0be700 1 -- 172.21.15.89:0/2212612524 wait complete. 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 0x7fcbb8065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb814d250 con 0x7fcbb809b520 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8066240 con 0x7fcbb81366f0 2024-02-09T23:58:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.505+0000 7fcbbfb3b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb814d480 con 0x7fcbb8136ad0 2024-02-09T23:58:32.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7f64ab0be700 1 Processor -- start 2024-02-09T23:58:32.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd0d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd0d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44934/0 (socket says 172.21.15.89:44934) 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbe0d8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd0d6700 1 -- 172.21.15.89:0/2784721687 learned_addr learned my addr 172.21.15.89:0/2784721687 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 0x7fcbb8065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 -- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 msgr2=0x7fcbb8065400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8065400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 -- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 msgr2=0x7fcbb8092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 -- 172.21.15.89:0/2784721687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba800b1e0 con 0x7fcbb809b520 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd0d6700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbe0d8700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8065400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7fcbbd8d7700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 0x7fcbb8065c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcbb805cde0 tx=0x7fcbb4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.506+0000 7f64ab0be700 1 -- start start 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f64a4062e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f64a4066890 0x7f64a414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40646e0 con 0x7f64a4063340 2024-02-09T23:58:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4135310 con 0x7f64880037d0 2024-02-09T23:58:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64ab0be700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4062350 con 0x7f64a4066890 2024-02-09T23:58:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbb4012400 con 0x7fcbb809b520 2024-02-09T23:58:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50070/0 (socket says 172.21.15.89:50070) 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 -- 172.21.15.89:0/1767314023 learned_addr learned my addr 172.21.15.89:0/1767314023 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4012560 con 0x7fcbb809b520 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb8092520 con 0x7fcbb809b520 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbb40128c0 con 0x7fcbb809b520 2024-02-09T23:58:32.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb8063b70 con 0x7fcbb809b520 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 -- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f64a4066890 msgr2=0x7f64a414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f64a4066890 0x7f64a414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 -- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 msgr2=0x7f64a4062e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f64a4062e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.507+0000 7f64a3fff700 1 -- 172.21.15.89:0/1767314023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40674e0 con 0x7f64a4063340 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64a3fff700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f649000e000 tx=0x7f649000f040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6490009840 con 0x7f64a4063340 2024-02-09T23:58:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490000e90 con 0x7f64a4063340 2024-02-09T23:58:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6490009b90 con 0x7f64a4063340 2024-02-09T23:58:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a4063820 con 0x7f64a4063340 2024-02-09T23:58:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.508+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a40648c0 con 0x7f64a4063340 2024-02-09T23:58:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.509+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb8057a60 con 0x7fcbb809b520 2024-02-09T23:58:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.509+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a40a5e80 con 0x7f64a4063340 2024-02-09T23:58:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.509+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6490009cf0 con 0x7f64a4063340 2024-02-09T23:58:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.510+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f649004a9c0 con 0x7f64a4063340 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.510+0000 7f251d24c700 1 Processor -- start 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.510+0000 7f251d24c700 1 -- start start 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.511+0000 7f251d24c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25180a5020 0x7f25180a4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251d24c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251d24c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180631c0 con 0x7f2518068090 2024-02-09T23:58:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251d24c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180a4950 con 0x7f25180a5020 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251d24c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25180a4bf0 con 0x7f25180a5400 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57216/0 (socket says 172.21.15.89:57216) 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 -- 172.21.15.89:0/1185958207 learned_addr learned my addr 172.21.15.89:0/1185958207 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 -- 172.21.15.89:0/1185958207 >> v2:172.21.15.89:3300/0 conn(0x7f25180a5020 msgr2=0x7f25180a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 --2- 172.21.15.89:0/1185958207 >> v2:172.21.15.89:3300/0 conn(0x7f25180a5020 0x7f25180a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 -- 172.21.15.89:0/1185958207 >> v1:172.21.15.89:6789/0 conn(0x7f2518068090 legacy=0x7f251813da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 -- 172.21.15.89:0/1185958207 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180a5890 con 0x7f25180a5400 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f251759e700 1 --2- 172.21.15.89:0/1185958207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f25180a5c40 tx=0x7f2510009290).ready entity=mon.2 client_cookie=738bc5146c423431 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f2515d9b700 1 -- 172.21.15.89:0/1185958207 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251000b860 con 0x7f25180a5400 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f2515d9b700 1 -- 172.21.15.89:0/1185958207 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000b9c0 con 0x7f25180a5400 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.512+0000 7f2515d9b700 1 -- 172.21.15.89:0/1185958207 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251000bb70 con 0x7f25180a5400 2024-02-09T23:58:32.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 -- 172.21.15.89:0/1185958207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 msgr2=0x7f251813e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 --2- 172.21.15.89:0/1185958207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f25180a5c40 tx=0x7f2510009290).stop 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcbb4019030 con 0x7fcbb809b520 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcbb404a130 con 0x7fcbb809b520 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcbb404a3a0 con 0x7fcbb809b520 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 -- 172.21.15.89:0/1185958207 shutdown_connections 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 --2- 172.21.15.89:0/1185958207 >> v2:172.21.15.89:3300/0 conn(0x7f25180a5020 0x7f25180a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 --2- 172.21.15.89:0/1185958207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f25180a5400 0x7f251813e130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.513+0000 7f251d24c700 1 -- 172.21.15.89:0/1185958207 >> 172.21.15.89:0/1185958207 conn(0x7f251806c0c0 msgr2=0x7f251806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.517+0000 7f251d24c700 1 -- 172.21.15.89:0/1185958207 shutdown_connections 2024-02-09T23:58:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.517+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f64900331e0 con 0x7f64a4063340 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.517+0000 7f251d24c700 1 -- 172.21.15.89:0/1185958207 wait complete. 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.517+0000 7f251d24c700 1 Processor -- start 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 -- start start 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 0x7f2518152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25180a5020 0x7f25180a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251809d4c0 con 0x7f25180a5400 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180a0500 con 0x7f25180a5020 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251d24c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25181534a0 con 0x7f2518068090 2024-02-09T23:58:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50086/0 (socket says 172.21.15.89:50086) 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251759e700 1 -- 172.21.15.89:0/3337244760 learned_addr learned my addr 172.21.15.89:0/3337244760 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f2516d9d700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 0x7f2518152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.518+0000 7f251659c700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25180a5020 0x7f25180a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 -- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 msgr2=0x7f2518152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 0x7f2518152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 -- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25180a5020 msgr2=0x7f25180a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25180a5020 0x7f25180a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 -- 172.21.15.89:0/3337244760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009530 con 0x7f25180a5400 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f2516d9d700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 0x7f2518152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251759e700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f25180a0bc0 tx=0x7f2510016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25100032d0 con 0x7f25180a5400 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251809f330 con 0x7f25180a5400 2024-02-09T23:58:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251809f020 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.519+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510006b00 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.520+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251001f420 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.520+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8003410 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.521+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f251000f070 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.521+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f251004b280 con 0x7f25180a5400 2024-02-09T23:58:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.524+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f25100205f0 con 0x7f25180a5400 2024-02-09T23:58:32.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.632+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64a4057a60 con 0x7f64a4063340 2024-02-09T23:58:32.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.633+0000 7f64a1ffb700 1 -- 172.21.15.89:0/1767314023 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6490032dd0 con 0x7f64a4063340 2024-02-09T23:58:32.635 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 >> v1:172.21.15.89:6816/39389 conn(0x7f6484038ef0 legacy=0x7f648403b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 msgr2=0x7f64a40663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f649000e000 tx=0x7f649000f040).stop 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 shutdown_connections 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f64a4066890 0x7f64a414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64880037d0 0x7f64a4062e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 --2- 172.21.15.89:0/1767314023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a4063340 0x7f64a40663a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 >> 172.21.15.89:0/1767314023 conn(0x7f64a40a93f0 msgr2=0x7f64a405dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 shutdown_connections 2024-02-09T23:58:32.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.634+0000 7f64ab0be700 1 -- 172.21.15.89:0/1767314023 wait complete. 2024-02-09T23:58:32.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.643+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24f80036c0 con 0x7f25180a5400 2024-02-09T23:58:32.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.643+0000 7f2507fff700 1 -- 172.21.15.89:0/3337244760 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2510015070 con 0x7f25180a5400 2024-02-09T23:58:32.647 INFO:teuthology.orchestra.run.smithi089.stdout:38654705670 2024-02-09T23:58:32.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-02-09T23:58:32.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 >> v1:172.21.15.89:6816/39389 conn(0x7f24f4038e30 legacy=0x7f24f403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 msgr2=0x7f251809f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f25180a0bc0 tx=0x7f2510016000).stop 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 shutdown_connections 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25180a5400 0x7f251809f5f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2518068090 0x7f2518152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 --2- 172.21.15.89:0/3337244760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25180a5020 0x7f25180a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 >> 172.21.15.89:0/3337244760 conn(0x7f251806c0c0 msgr2=0x7f251813ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 shutdown_connections 2024-02-09T23:58:32.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.645+0000 7f251d24c700 1 -- 172.21.15.89:0/3337244760 wait complete. 2024-02-09T23:58:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.654+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4254060880 con 0x7f425409b520 2024-02-09T23:58:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.654+0000 7f4243fff700 1 -- 172.21.15.89:0/4162751404 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42480327f0 con 0x7f425409b520 2024-02-09T23:58:32.657 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-02-09T23:58:32.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-02-09T23:58:32.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 >> v1:172.21.15.89:6816/39389 conn(0x7f4230038dd0 legacy=0x7f423003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 msgr2=0x7f4254148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 0x7f4254148dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f424800c000 tx=0x7f4248006d90).stop 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 shutdown_connections 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f42541366f0 0x7f42541492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254099a00 0x7f42540979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 --2- 172.21.15.89:0/4162751404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f425409b520 0x7f4254148dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 >> 172.21.15.89:0/4162751404 conn(0x7f425406c0c0 msgr2=0x7f4254133330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 shutdown_connections 2024-02-09T23:58:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.656+0000 7f4259435700 1 -- 172.21.15.89:0/4162751404 wait complete. 2024-02-09T23:58:32.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2024-02-09T23:58:32.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.681+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcbb8060880 con 0x7fcbb809b520 2024-02-09T23:58:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.682+0000 7fcba6ffd700 1 -- 172.21.15.89:0/2784721687 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbb402ef20 con 0x7fcbb809b520 2024-02-09T23:58:32.684 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2024-02-09T23:58:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 >> v1:172.21.15.89:6816/39389 conn(0x7fcb98038e80 legacy=0x7fcb9803b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 msgr2=0x7fcbb8065c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 0x7fcbb8065c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcbb805cde0 tx=0x7fcbb4007b90).stop 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 shutdown_connections 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcbb8136ad0 0x7fcbb8065400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb809b520 0x7fcbb8065c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 --2- 172.21.15.89:0/2784721687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbb81366f0 0x7fcbb8092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 >> 172.21.15.89:0/2784721687 conn(0x7fcbb806c0c0 msgr2=0x7fcbb8133330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 shutdown_connections 2024-02-09T23:58:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:32.683+0000 7fcbbfb3b700 1 -- 172.21.15.89:0/2784721687 wait complete. 2024-02-09T23:58:32.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-02-09T23:58:33.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-09T23:58:33.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-09T23:58:33.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-09T23:58:33.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-09T23:58:33.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.766+0000 7f8b8258e700 1 Processor -- start 2024-02-09T23:58:33.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.766+0000 7f8b8258e700 1 -- start start 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b8258e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c142c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b8258e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b7c09a460 0x7f8b7c145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b8258e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c13d890 con 0x7f8b7c13e190 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b8258e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c137e70 con 0x7f8b7c09a460 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b8258e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c13dac0 con 0x7f8b7c13e570 2024-02-09T23:58:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b73fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b80b2b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b7c09a460 0x7f8b7c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b73fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44970/0 (socket says 172.21.15.89:44970) 2024-02-09T23:58:33.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.767+0000 7f8b73fff700 1 -- 172.21.15.89:0/3659290385 learned_addr learned my addr 172.21.15.89:0/3659290385 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b80b2b700 1 -- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 msgr2=0x7f8b7c142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b80b2b700 1 --2- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b80b2b700 1 -- 172.21.15.89:0/3659290385 >> v1:172.21.15.89:6789/0 conn(0x7f8b7c13e190 legacy=0x7f8b7c09b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b80b2b700 1 -- 172.21.15.89:0/3659290385 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c13dd60 con 0x7f8b7c09a460 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b7b7fe700 1 -- 172.21.15.89:0/3659290385 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452628130 0 0) 0x7f8b7c13d890 con 0x7f8b7c13e190 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b80b2b700 1 --2- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c09a460 0x7f8b7c145120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8b740032f0 tx=0x7f8b740091d0).ready entity=mon.0 client_cookie=eea21445eb3d7526 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b7b7fe700 1 -- 172.21.15.89:0/3659290385 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7400b6c0 con 0x7f8b7c09a460 2024-02-09T23:58:33.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b7b7fe700 1 -- 172.21.15.89:0/3659290385 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400b820 con 0x7f8b7c09a460 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.768+0000 7f8b7b7fe700 1 -- 172.21.15.89:0/3659290385 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7400b990 con 0x7f8b7c09a460 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 -- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c09a460 msgr2=0x7f8b7c145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 --2- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c09a460 0x7f8b7c145120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8b740032f0 tx=0x7f8b740091d0).stop 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 -- 172.21.15.89:0/3659290385 shutdown_connections 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 --2- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c09a460 0x7f8b7c145120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 --2- 172.21.15.89:0/3659290385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 -- 172.21.15.89:0/3659290385 >> 172.21.15.89:0/3659290385 conn(0x7f8b7c06c0c0 msgr2=0x7f8b7c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 -- 172.21.15.89:0/3659290385 shutdown_connections 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.769+0000 7f8b8258e700 1 -- 172.21.15.89:0/3659290385 wait complete. 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.770+0000 7f8b8258e700 1 Processor -- start 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.770+0000 7f8b8258e700 1 -- start start 2024-02-09T23:58:33.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 0x7f8b7c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c14ac70 con 0x7f8b7c13e190 2024-02-09T23:58:33.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c066480 con 0x7f8b7c13e570 2024-02-09T23:58:33.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b8258e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c063ef0 con 0x7f8b7c09a460 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57228/0 (socket says 172.21.15.89:57228) 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 -- 172.21.15.89:0/2879111773 learned_addr learned my addr 172.21.15.89:0/2879111773 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b80b2b700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b73fff700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 0x7f8b7c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 -- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 msgr2=0x7f8b7c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 -- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 msgr2=0x7f8b7c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 0x7f8b7c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 -- 172.21.15.89:0/2879111773 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74009470 con 0x7f8b7c09a460 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b73fff700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 0x7f8b7c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:33.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.771+0000 7f8b7bfff700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8b6c000bc0 tx=0x7f8b6c007a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.772+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6c012400 con 0x7f8b7c09a460 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.772+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c012560 con 0x7f8b7c09a460 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.772+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c149cb0 con 0x7f8b7c09a460 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.772+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6c0128c0 con 0x7f8b7c09a460 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.772+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c065ed0 con 0x7f8b7c09a460 2024-02-09T23:58:33.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.773+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8b6c019030 con 0x7f8b7c09a460 2024-02-09T23:58:33.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.773+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c05c8c0 con 0x7f8b7c09a460 2024-02-09T23:58:33.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.773+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8b6c049c70 con 0x7f8b7c09a460 2024-02-09T23:58:33.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.776+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8b6c02e9c0 con 0x7f8b7c09a460 2024-02-09T23:58:33.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.810+0000 7ff1bac0f700 1 Processor -- start 2024-02-09T23:58:33.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.810+0000 7ff1bac0f700 1 -- start start 2024-02-09T23:58:33.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b409f010 0x7ff1b40a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1b409f8e0 0x7ff1b40a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b409c8f0 con 0x7ff1b409f8e0 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b409c5e0 con 0x7ff1b409f010 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1bac0f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40a1540 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57242/0 (socket says 172.21.15.89:57242) 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2187070882 learned_addr learned my addr 172.21.15.89:0/2187070882 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b89ab700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b409f010 0x7ff1b40a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b91ac700 1 --2- 172.21.15.89:0/2187070882 >> v2:172.21.15.89:3300/0 conn(0x7ff1b409f8e0 0x7ff1b40a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b409f010 msgr2=0x7ff1b40a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b409f010 0x7ff1b40a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2187070882 >> v2:172.21.15.89:3300/0 conn(0x7ff1b409f8e0 msgr2=0x7ff1b40a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2187070882 >> v2:172.21.15.89:3300/0 conn(0x7ff1b409f8e0 0x7ff1b40a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2187070882 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b409cb20 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.811+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff1a0002f70 tx=0x7ff1a0006eb0).ready entity=mon.2 client_cookie=38c283c271a75b3e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1b37fe700 1 -- 172.21.15.89:0/2187070882 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0012a50 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1b37fe700 1 -- 172.21.15.89:0/2187070882 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0000e90 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1b37fe700 1 -- 172.21.15.89:0/2187070882 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0012de0 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 msgr2=0x7ff1b409f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff1a0002f70 tx=0x7ff1a0006eb0).stop 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2187070882 shutdown_connections 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2187070882 >> v2:172.21.15.89:3300/0 conn(0x7ff1b409f8e0 0x7ff1b40a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b409f010 0x7ff1b40a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2187070882 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b40a4fa0 0x7ff1b409f3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2187070882 >> 172.21.15.89:0/2187070882 conn(0x7ff1b40a93f0 msgr2=0x7ff1b40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2187070882 shutdown_connections 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.812+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2187070882 wait complete. 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.813+0000 7ff1bac0f700 1 Processor -- start 2024-02-09T23:58:33.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.813+0000 7ff1bac0f700 1 -- start start 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 0x7ff1b4141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 0x7ff1b4092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4142140 con 0x7ff1b409f8e0 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4142400 con 0x7ff1b40a4fa0 2024-02-09T23:58:33.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1bac0f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4066f60 con 0x7ff1b409f010 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1b3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1b3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50120/0 (socket says 172.21.15.89:50120) 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2555869616 learned_addr learned my addr 172.21.15.89:0/2555869616 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1b89ab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 0x7ff1b4141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.814+0000 7ff1b91ac700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 0x7ff1b4092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 msgr2=0x7ff1b4141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 0x7ff1b4141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 msgr2=0x7ff1b4092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 0x7ff1b4092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 -- 172.21.15.89:0/2555869616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a000b1e0 con 0x7ff1b409f8e0 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b89ab700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 0x7ff1b4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b91ac700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 0x7ff1b4092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b3fff700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff1a0002f70 tx=0x7ff1a0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0022070 con 0x7ff1b409f8e0 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b40960d0 con 0x7ff1b409f8e0 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00068b0 con 0x7ff1b409f8e0 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0027600 con 0x7ff1b409f8e0 2024-02-09T23:58:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.815+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b4066580 con 0x7ff1b409f8e0 2024-02-09T23:58:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.816+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff1a002e070 con 0x7ff1b409f8e0 2024-02-09T23:58:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.816+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b40667d0 con 0x7ff1b409f8e0 2024-02-09T23:58:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.816+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff1a004f840 con 0x7ff1b409f8e0 2024-02-09T23:58:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.817+0000 7fc00b287700 1 Processor -- start 2024-02-09T23:58:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.817+0000 7fc00b287700 1 -- start start 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc00b287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc004064700 0x7fc0040621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc00b287700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 0x7fc00409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc00b287700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00409bc50 con 0x7fc00409aa10 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc00b287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00409b2e0 con 0x7fc004064700 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc00b287700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0041365d0 con 0x7fc004136140 2024-02-09T23:58:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc009023700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc00409aa10 0x7fc004132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37954/0 (socket says 172.21.15.89:37954) 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc009023700 1 -- 172.21.15.89:0/3222770173 learned_addr learned my addr 172.21.15.89:0/3222770173 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc008822700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc004064700 0x7fc0040621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.818+0000 7fc009824700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 0x7fc00409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fc009824700 1 -- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc004064700 msgr2=0x7fc0040621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fc009824700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc004064700 0x7fc0040621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fc009824700 1 -- 172.21.15.89:0/3222770173 >> v1:172.21.15.89:6789/0 conn(0x7fc00409aa10 legacy=0x7fc004132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fc009824700 1 -- 172.21.15.89:0/3222770173 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0041367e0 con 0x7fc004136140 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fc009824700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 0x7fc00409adf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbffc0032f0 tx=0x7fbffc0091d0).ready entity=mon.2 client_cookie=b2214d1608154e44 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fbff3fff700 1 -- 172.21.15.89:0/3222770173 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbffc00b6c0 con 0x7fc004136140 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fbff3fff700 1 -- 172.21.15.89:0/3222770173 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00b820 con 0x7fc004136140 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.819+0000 7fbff3fff700 1 -- 172.21.15.89:0/3222770173 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbffc00b9e0 con 0x7fc004136140 2024-02-09T23:58:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 -- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 msgr2=0x7fc00409adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 0x7fc00409adf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbffc0032f0 tx=0x7fbffc0091d0).stop 2024-02-09T23:58:33.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 -- 172.21.15.89:0/3222770173 shutdown_connections 2024-02-09T23:58:33.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004136140 0x7fc00409adf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 --2- 172.21.15.89:0/3222770173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc004064700 0x7fc0040621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 -- 172.21.15.89:0/3222770173 >> 172.21.15.89:0/3222770173 conn(0x7fc00406c0c0 msgr2=0x7fc00406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff1a0001f00 con 0x7ff1b409f8e0 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 -- 172.21.15.89:0/3222770173 shutdown_connections 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.820+0000 7fc00b287700 1 -- 172.21.15.89:0/3222770173 wait complete. 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.822+0000 7fc00b287700 1 Processor -- start 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.822+0000 7fc00b287700 1 -- start start 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00409aa10 0x7fc0040920c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc004136140 0x7fc004130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc004096cc0 con 0x7fc004136140 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc004092a90 con 0x7fc00409aa10 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc00b287700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc004092d50 con 0x7fc004064700 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57280/0 (socket says 172.21.15.89:57280) 2024-02-09T23:58:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 -- 172.21.15.89:0/331094767 learned_addr learned my addr 172.21.15.89:0/331094767 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc008822700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00409aa10 0x7fc0040920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009824700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc004136140 0x7fc004130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 -- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00409aa10 msgr2=0x7fc0040920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00409aa10 0x7fc0040920c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 -- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc004136140 msgr2=0x7fc004130aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc004136140 0x7fc004130aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.823+0000 7fc009023700 1 -- 172.21.15.89:0/331094767 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009470 con 0x7fc004064700 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fc009023700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc00405cde0 tx=0x7fc000007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0000070d0 con 0x7fc004064700 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000007230 con 0x7fc004064700 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000005610 con 0x7fc004064700 2024-02-09T23:58:33.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0040a9e30 con 0x7fc004064700 2024-02-09T23:58:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.824+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004067be0 con 0x7fc004064700 2024-02-09T23:58:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.825+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc004136aa0 con 0x7fc004064700 2024-02-09T23:58:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.826+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc000010070 con 0x7fc004064700 2024-02-09T23:58:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.826+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc000049e20 con 0x7fc004064700 2024-02-09T23:58:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.831+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc00002ec80 con 0x7fc004064700 2024-02-09T23:58:33.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.854+0000 7f2451493700 1 Processor -- start 2024-02-09T23:58:33.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.854+0000 7f2451493700 1 -- start start 2024-02-09T23:58:33.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f2451493700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f2451493700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f244c064700 0x7f244c136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f2451493700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244c09b2a0 con 0x7f244c09adf0 2024-02-09T23:58:33.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f2451493700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244c09bc50 con 0x7f244c064700 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f2451493700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c1367e0 con 0x7f244c09aa10 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f244affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f244affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45008/0 (socket says 172.21.15.89:45008) 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f244affd700 1 -- 172.21.15.89:0/413555898 learned_addr learned my addr 172.21.15.89:0/413555898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.855+0000 7f244a7fc700 1 --2- 172.21.15.89:0/413555898 >> v2:172.21.15.89:3300/0 conn(0x7f244c064700 0x7f244c136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f244affd700 1 -- 172.21.15.89:0/413555898 >> v2:172.21.15.89:3300/0 conn(0x7f244c064700 msgr2=0x7f244c136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f244affd700 1 --2- 172.21.15.89:0/413555898 >> v2:172.21.15.89:3300/0 conn(0x7f244c064700 0x7f244c136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f244affd700 1 -- 172.21.15.89:0/413555898 >> v1:172.21.15.89:6789/0 conn(0x7f244c09adf0 legacy=0x7f244c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f244affd700 1 -- 172.21.15.89:0/413555898 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c136aa0 con 0x7f244c09aa10 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f244affd700 1 --2- 172.21.15.89:0/413555898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f244c09b960 tx=0x7f243c006eb0).ready entity=mon.1 client_cookie=487f2dcf09357bcc server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f2449ffb700 1 -- 172.21.15.89:0/413555898 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c00d570 con 0x7f244c09aa10 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f2449ffb700 1 -- 172.21.15.89:0/413555898 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c000e90 con 0x7f244c09aa10 2024-02-09T23:58:33.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.856+0000 7f2449ffb700 1 -- 172.21.15.89:0/413555898 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c00d900 con 0x7f244c09aa10 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 -- 172.21.15.89:0/413555898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 msgr2=0x7f244c0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 --2- 172.21.15.89:0/413555898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f244c09b960 tx=0x7f243c006eb0).stop 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 -- 172.21.15.89:0/413555898 shutdown_connections 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 --2- 172.21.15.89:0/413555898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09aa10 0x7f244c0621e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 --2- 172.21.15.89:0/413555898 >> v2:172.21.15.89:3300/0 conn(0x7f244c064700 0x7f244c136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 -- 172.21.15.89:0/413555898 >> 172.21.15.89:0/413555898 conn(0x7f244c06c0c0 msgr2=0x7f244c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 -- 172.21.15.89:0/413555898 shutdown_connections 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.857+0000 7f2451493700 1 -- 172.21.15.89:0/413555898 wait complete. 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.858+0000 7f2451493700 1 Processor -- start 2024-02-09T23:58:33.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.858+0000 7f2451493700 1 -- start start 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.859+0000 7f2451493700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 0x7f244c138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.859+0000 7f2451493700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 0x7f244c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f2451493700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09adf0 0x7f244c147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f2451493700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c065fe0 con 0x7f244c09aa10 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f2451493700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c067760 con 0x7f244c09adf0 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244a7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 0x7f244c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f2451493700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244c13a540 con 0x7f244c064700 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244a7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 0x7f244c146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50150/0 (socket says 172.21.15.89:50150) 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244a7fc700 1 -- 172.21.15.89:0/2142959075 learned_addr learned my addr 172.21.15.89:0/2142959075 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 0x7f244c138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244b7fe700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09adf0 0x7f244c147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 -- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09adf0 msgr2=0x7f244c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09adf0 0x7f244c147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 -- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 msgr2=0x7f244c146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 0x7f244c146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 -- 172.21.15.89:0/2142959075 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c00b1e0 con 0x7f244c064700 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f244affd700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 0x7f244c138050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f244c09b960 tx=0x7f243c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c011760 con 0x7f244c064700 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0118c0 con 0x7f244c064700 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.860+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c1378d0 con 0x7f244c064700 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.861+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c011c20 con 0x7f244c064700 2024-02-09T23:58:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.861+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c139290 con 0x7f244c064700 2024-02-09T23:58:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.862+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c057a60 con 0x7f244c064700 2024-02-09T23:58:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.862+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f243c025030 con 0x7f244c064700 2024-02-09T23:58:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.862+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f243c04b8d0 con 0x7f244c064700 2024-02-09T23:58:33.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.865+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f243c028b70 con 0x7f244c064700 2024-02-09T23:58:33.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.902+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b7c057a60 con 0x7f8b7c09a460 2024-02-09T23:58:33.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.902+0000 7f8b79ffb700 1 -- 172.21.15.89:0/2879111773 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b6c032190 con 0x7f8b7c09a460 2024-02-09T23:58:33.904 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 >> v1:172.21.15.89:6816/39389 conn(0x7f8b60038da0 legacy=0x7f8b6003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 msgr2=0x7f8b7c14a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8b6c000bc0 tx=0x7f8b6c007a70).stop 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 shutdown_connections 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7c13e570 0x7f8b7c14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8b7c09a460 0x7f8b7c14a2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 --2- 172.21.15.89:0/2879111773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7c13e190 0x7f8b7c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 >> 172.21.15.89:0/2879111773 conn(0x7f8b7c06c0c0 msgr2=0x7f8b7c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 shutdown_connections 2024-02-09T23:58:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.904+0000 7f8b8258e700 1 -- 172.21.15.89:0/2879111773 wait complete. 2024-02-09T23:58:33.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-02-09T23:58:33.921 DEBUG:teuthology.parallel:result is None 2024-02-09T23:58:33.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.941+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1b4057a60 con 0x7ff1b409f8e0 2024-02-09T23:58:33.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.941+0000 7ff1b1ffb700 1 -- 172.21.15.89:0/2555869616 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1a0027f50 con 0x7ff1b409f8e0 2024-02-09T23:58:33.944 INFO:teuthology.orchestra.run.smithi089.stdout:38654705671 2024-02-09T23:58:33.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.942+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 >> v1:172.21.15.89:6816/39389 conn(0x7ff194038da0 legacy=0x7ff19403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.942+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 msgr2=0x7ff1b4092030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.942+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff1a0002f70 tx=0x7ff1a0019000).stop 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 shutdown_connections 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1b40a4fa0 0x7ff1b4092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff1b409f010 0x7ff1b4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 --2- 172.21.15.89:0/2555869616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1b409f8e0 0x7ff1b4092030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 >> 172.21.15.89:0/2555869616 conn(0x7ff1b40a93f0 msgr2=0x7ff1b40a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 shutdown_connections 2024-02-09T23:58:33.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.943+0000 7ff1bac0f700 1 -- 172.21.15.89:0/2555869616 wait complete. 2024-02-09T23:58:33.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-02-09T23:58:33.955 DEBUG:teuthology.parallel:result is None 2024-02-09T23:58:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.961+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc004057a60 con 0x7fc004064700 2024-02-09T23:58:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.961+0000 7fbff27fc700 1 -- 172.21.15.89:0/331094767 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc000018020 con 0x7fc004064700 2024-02-09T23:58:33.964 INFO:teuthology.orchestra.run.smithi089.stdout:38654705670 2024-02-09T23:58:33.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 >> v1:172.21.15.89:6816/39389 conn(0x7fbfe4038f50 legacy=0x7fbfe403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 msgr2=0x7fc0040967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc00405cde0 tx=0x7fc000007c40).stop 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 shutdown_connections 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc004136140 0x7fc004130aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc004064700 0x7fc0040967d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 --2- 172.21.15.89:0/331094767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00409aa10 0x7fc0040920c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 >> 172.21.15.89:0/331094767 conn(0x7fc00406c0c0 msgr2=0x7fc00405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 shutdown_connections 2024-02-09T23:58:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.963+0000 7fc00b287700 1 -- 172.21.15.89:0/331094767 wait complete. 2024-02-09T23:58:33.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-02-09T23:58:33.977 DEBUG:teuthology.parallel:result is None 2024-02-09T23:58:33.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.982+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f244c09b2a0 con 0x7f244c064700 2024-02-09T23:58:33.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.982+0000 7f243bfff700 1 -- 172.21.15.89:0/2142959075 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f244c09b2a0 con 0x7f244c064700 2024-02-09T23:58:33.985 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-02-09T23:58:33.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 >> v1:172.21.15.89:6816/39389 conn(0x7f2428038da0 legacy=0x7f242803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 msgr2=0x7f244c138050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:33.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 0x7f244c138050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f244c09b960 tx=0x7f243c015000).stop 2024-02-09T23:58:33.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 shutdown_connections 2024-02-09T23:58:33.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f244c09adf0 0x7f244c147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f244c064700 0x7f244c138050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 --2- 172.21.15.89:0/2142959075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244c09aa10 0x7f244c146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:33.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 >> 172.21.15.89:0/2142959075 conn(0x7f244c06c0c0 msgr2=0x7f244c13ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:33.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 shutdown_connections 2024-02-09T23:58:33.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:33.984+0000 7f2451493700 1 -- 172.21.15.89:0/2142959075 wait complete. 2024-02-09T23:58:33.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-02-09T23:58:33.996 DEBUG:teuthology.parallel:result is None 2024-02-09T23:58:33.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-09T23:58:33.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T23:58:34.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.137+0000 7f8c1b475700 1 Processor -- start 2024-02-09T23:58:34.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.137+0000 7f8c1b475700 1 -- start start 2024-02-09T23:58:34.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c1409aa10 0x7f8c140621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1409b280 con 0x7f8c1409aa10 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1409bc50 con 0x7f8c14064700 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c1b475700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141367e0 con 0x7f8c1409adf0 2024-02-09T23:58:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c18a10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c18a10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45016/0 (socket says 172.21.15.89:45016) 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57290/0 (socket says 172.21.15.89:57290) 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c18a10700 1 -- 172.21.15.89:0/2517461289 learned_addr learned my addr 172.21.15.89:0/2517461289 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19211700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c1409aa10 0x7f8c140621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 -- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 msgr2=0x7f8c14136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 -- 172.21.15.89:0/2517461289 >> v2:172.21.15.89:3300/0 conn(0x7f8c1409aa10 msgr2=0x7f8c140621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 --2- 172.21.15.89:0/2517461289 >> v2:172.21.15.89:3300/0 conn(0x7f8c1409aa10 0x7f8c140621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 -- 172.21.15.89:0/2517461289 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14136aa0 con 0x7f8c1409adf0 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c18a10700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c19a12700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8c0c0032f0 tx=0x7f8c0c0091d0).ready entity=mon.2 client_cookie=614b8190c3221150 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c03fff700 1 -- 172.21.15.89:0/2517461289 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c0c00b600 con 0x7f8c1409adf0 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c03fff700 1 -- 172.21.15.89:0/2517461289 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00b760 con 0x7f8c1409adf0 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.138+0000 7f8c03fff700 1 -- 172.21.15.89:0/2517461289 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c0c00b8d0 con 0x7f8c1409adf0 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 -- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 msgr2=0x7f8c14132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8c0c0032f0 tx=0x7f8c0c0091d0).stop 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 -- 172.21.15.89:0/2517461289 shutdown_connections 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14132c40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 --2- 172.21.15.89:0/2517461289 >> v2:172.21.15.89:3300/0 conn(0x7f8c1409aa10 0x7f8c140621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 --2- 172.21.15.89:0/2517461289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c14136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 -- 172.21.15.89:0/2517461289 >> 172.21.15.89:0/2517461289 conn(0x7f8c1406c0c0 msgr2=0x7f8c1406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 -- 172.21.15.89:0/2517461289 shutdown_connections 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.139+0000 7f8c1b475700 1 -- 172.21.15.89:0/2517461289 wait complete. 2024-02-09T23:58:34.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 Processor -- start 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 -- start start 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c1409aa10 0x7f8c140a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14065310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140a7f50 con 0x7f8c1409aa10 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140a8dd0 con 0x7f8c14064700 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c1b475700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14066fe0 con 0x7f8c1409adf0 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c19211700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c19211700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45020/0 (socket says 172.21.15.89:45020) 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c19211700 1 -- 172.21.15.89:0/4031166147 learned_addr learned my addr 172.21.15.89:0/4031166147 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c19a12700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14065310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.140+0000 7f8c18a10700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c1409aa10 0x7f8c140a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 -- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 msgr2=0x7f8c1413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 -- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c1409aa10 msgr2=0x7f8c140a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c1409aa10 0x7f8c140a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 -- 172.21.15.89:0/4031166147 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0400b1e0 con 0x7f8c1409adf0 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19211700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c19a12700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14065310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8c0c0032f0 tx=0x7f8c0c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c0c00b600 con 0x7f8c1409adf0 2024-02-09T23:58:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c011e00 con 0x7f8c1409adf0 2024-02-09T23:58:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c009470 con 0x7f8c1409adf0 2024-02-09T23:58:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c0c0205f0 con 0x7f8c1409adf0 2024-02-09T23:58:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.141+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c14066380 con 0x7f8c1409adf0 2024-02-09T23:58:34.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.142+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8c0c027030 con 0x7f8c1409adf0 2024-02-09T23:58:34.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.142+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140a9730 con 0x7f8c1409adf0 2024-02-09T23:58:34.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.142+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8c0c04b5e0 con 0x7f8c1409adf0 2024-02-09T23:58:34.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.145+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8c0c02b5b0 con 0x7f8c1409adf0 2024-02-09T23:58:34.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.250+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 --> v1:172.21.15.89:6816/39389 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c140a92e0 con 0x7f8bf4038dd0 2024-02-09T23:58:34.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.257+0000 7f8c027fc700 1 -- 172.21.15.89:0/4031166147 <== mgr.4100 v1:172.21.15.89:6816/39389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246936 (unknown 2965378022 0 3192924599) 0x7f8c140a92e0 con 0x7f8bf4038dd0 2024-02-09T23:58:34.263 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:34.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 >> v1:172.21.15.89:6816/39389 conn(0x7f8bf4038dd0 legacy=0x7f8bf403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 msgr2=0x7f8c14065310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14065310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8c0c0032f0 tx=0x7f8c0c016000).stop 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 shutdown_connections 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8c1409adf0 0x7f8c14065310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c14064700 0x7f8c1413bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 --2- 172.21.15.89:0/4031166147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c1409aa10 0x7f8c140a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 >> 172.21.15.89:0/4031166147 conn(0x7f8c1406c0c0 msgr2=0x7f8c14130c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 shutdown_connections 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.259+0000 7f8c1b475700 1 -- 172.21.15.89:0/4031166147 wait complete. 2024-02-09T23:58:34.265 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-09T23:58:34.271 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-09T23:58:32.554727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001003"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334099+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-09T23:58:27.334099+0000","last_peered":"2024-02-09T23:58:27.334099+0000","last_clean":"2024-02-09T23:58:27.334099+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-09T23:58:27.334099+0000","last_undegraded":"2024-02-09T23:58:27.334099+0000","last_fullsized":"2024-02-09T23:58:27.334099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357573+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-09T23:58:27.357573+0000","last_peered":"2024-02-09T23:58:27.357573+0000","last_clean":"2024-02-09T23:58:27.357573+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-09T23:58:27.357573+0000","last_undegraded":"2024-02-09T23:58:27.357573+0000","last_fullsized":"2024-02-09T23:58:27.357573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.351216+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-09T23:58:27.351216+0000","last_peered":"2024-02-09T23:58:27.351216+0000","last_clean":"2024-02-09T23:58:27.351216+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-09T23:58:27.351216+0000","last_undegraded":"2024-02-09T23:58:27.351216+0000","last_fullsized":"2024-02-09T23:58:27.351216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345605+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-09T23:58:27.345605+0000","last_peered":"2024-02-09T23:58:27.345605+0000","last_clean":"2024-02-09T23:58:27.345605+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-09T23:58:27.345605+0000","last_undegraded":"2024-02-09T23:58:27.345605+0000","last_fullsized":"2024-02-09T23:58:27.345605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333159+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-09T23:58:27.333159+0000","last_peered":"2024-02-09T23:58:27.333159+0000","last_clean":"2024-02-09T23:58:27.333159+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-09T23:58:27.333159+0000","last_undegraded":"2024-02-09T23:58:27.333159+0000","last_fullsized":"2024-02-09T23:58:27.333159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340038+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-09T23:58:27.340038+0000","last_peered":"2024-02-09T23:58:27.340038+0000","last_clean":"2024-02-09T23:58:27.340038+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-09T23:58:27.340038+0000","last_undegraded":"2024-02-09T23:58:27.340038+0000","last_fullsized":"2024-02-09T23:58:27.340038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334038+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-09T23:58:27.334038+0000","last_peered":"2024-02-09T23:58:27.334038+0000","last_clean":"2024-02-09T23:58:27.334038+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-09T23:58:27.334038+0000","last_undegraded":"2024-02-09T23:58:27.334038+0000","last_fullsized":"2024-02-09T23:58:27.334038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357718+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-09T23:58:27.357718+0000","last_peered":"2024-02-09T23:58:27.357718+0000","last_clean":"2024-02-09T23:58:27.357718+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-09T23:58:27.357718+0000","last_undegraded":"2024-02-09T23:58:27.357718+0000","last_fullsized":"2024-02-09T23:58:27.357718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331551+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-09T23:58:27.331551+0000","last_peered":"2024-02-09T23:58:27.331551+0000","last_clean":"2024-02-09T23:58:27.331551+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-09T23:58:27.331551+0000","last_undegraded":"2024-02-09T23:58:27.331551+0000","last_fullsized":"2024-02-09T23:58:27.331551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356313+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-09T23:58:27.356313+0000","last_peered":"2024-02-09T23:58:27.356313+0000","last_clean":"2024-02-09T23:58:27.356313+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-09T23:58:27.356313+0000","last_undegraded":"2024-02-09T23:58:27.356313+0000","last_fullsized":"2024-02-09T23:58:27.356313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356534+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-09T23:58:27.356534+0000","last_peered":"2024-02-09T23:58:27.356534+0000","last_clean":"2024-02-09T23:58:27.356534+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-09T23:58:27.356534+0000","last_undegraded":"2024-02-09T23:58:27.356534+0000","last_fullsized":"2024-02-09T23:58:27.356534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336683+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-09T23:58:27.336683+0000","last_peered":"2024-02-09T23:58:27.336683+0000","last_clean":"2024-02-09T23:58:27.336683+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-09T23:58:27.336683+0000","last_undegraded":"2024-02-09T23:58:27.336683+0000","last_fullsized":"2024-02-09T23:58:27.336683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332924+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-09T23:58:27.332924+0000","last_peered":"2024-02-09T23:58:27.332924+0000","last_clean":"2024-02-09T23:58:27.332924+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-09T23:58:27.332924+0000","last_undegraded":"2024-02-09T23:58:27.332924+0000","last_fullsized":"2024-02-09T23:58:27.332924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357122+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-09T23:58:27.357122+0000","last_peered":"2024-02-09T23:58:27.357122+0000","last_clean":"2024-02-09T23:58:27.357122+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-09T23:58:27.357122+0000","last_undegraded":"2024-02-09T23:58:27.357122+0000","last_fullsized":"2024-02-09T23:58:27.357122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345711+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-09T23:58:27.345711+0000","last_peered":"2024-02-09T23:58:27.345711+0000","last_clean":"2024-02-09T23:58:27.345711+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-09T23:58:27.345711+0000","last_undegraded":"2024-02-09T23:58:27.345711+0000","last_fullsized":"2024-02-09T23:58:27.345711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334575+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-09T23:58:27.334575+0000","last_peered":"2024-02-09T23:58:27.334575+0000","last_clean":"2024-02-09T23:58:27.334575+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-09T23:58:27.334575+0000","last_undegraded":"2024-02-09T23:58:27.334575+0000","last_fullsized":"2024-02-09T23:58:27.334575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333238+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-09T23:58:27.333238+0000","last_peered":"2024-02-09T23:58:27.333238+0000","last_clean":"2024-02-09T23:58:27.333238+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-09T23:58:27.333238+0000","last_undegraded":"2024-02-09T23:58:27.333238+0000","last_fullsized":"2024-02-09T23:58:27.333238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333651+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-09T23:58:27.333651+0000","last_peered":"2024-02-09T23:58:27.333651+0000","last_clean":"2024-02-09T23:58:27.333651+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-09T23:58:27.333651+0000","last_undegraded":"2024-02-09T23:58:27.333651+0000","last_fullsized":"2024-02-09T23:58:27.333651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336247+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-09T23:58:27.336247+0000","last_peered":"2024-02-09T23:58:27.336247+0000","last_clean":"2024-02-09T23:58:27.336247+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-09T23:58:27.336247+0000","last_undegraded":"2024-02-09T23:58:27.336247+0000","last_fullsized":"2024-02-09T23:58:27.336247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349813+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-09T23:58:27.349813+0000","last_peered":"2024-02-09T23:58:27.349813+0000","last_clean":"2024-02-09T23:58:27.349813+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-09T23:58:27.349813+0000","last_undegraded":"2024-02-09T23:58:27.349813+0000","last_fullsized":"2024-02-09T23:58:27.349813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349514+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-09T23:58:27.349514+0000","last_peered":"2024-02-09T23:58:27.349514+0000","last_clean":"2024-02-09T23:58:27.349514+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-09T23:58:27.349514+0000","last_undegraded":"2024-02-09T23:58:27.349514+0000","last_fullsized":"2024-02-09T23:58:27.349514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356686+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-09T23:58:27.356686+0000","last_peered":"2024-02-09T23:58:27.356686+0000","last_clean":"2024-02-09T23:58:27.356686+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-09T23:58:27.356686+0000","last_undegraded":"2024-02-09T23:58:27.356686+0000","last_fullsized":"2024-02-09T23:58:27.356686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335658+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-09T23:58:27.335658+0000","last_peered":"2024-02-09T23:58:27.335658+0000","last_clean":"2024-02-09T23:58:27.335658+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-09T23:58:27.335658+0000","last_undegraded":"2024-02-09T23:58:27.335658+0000","last_fullsized":"2024-02-09T23:58:27.335658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357705+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-09T23:58:27.357705+0000","last_peered":"2024-02-09T23:58:27.357705+0000","last_clean":"2024-02-09T23:58:27.357705+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-09T23:58:27.357705+0000","last_undegraded":"2024-02-09T23:58:27.357705+0000","last_fullsized":"2024-02-09T23:58:27.357705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352451+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-09T23:58:27.352451+0000","last_peered":"2024-02-09T23:58:27.352451+0000","last_clean":"2024-02-09T23:58:27.352451+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-09T23:58:27.352451+0000","last_undegraded":"2024-02-09T23:58:27.352451+0000","last_fullsized":"2024-02-09T23:58:27.352451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357289+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-09T23:58:27.357289+0000","last_peered":"2024-02-09T23:58:27.357289+0000","last_clean":"2024-02-09T23:58:27.357289+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-09T23:58:27.357289+0000","last_undegraded":"2024-02-09T23:58:27.357289+0000","last_fullsized":"2024-02-09T23:58:27.357289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337216+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-09T23:58:27.337216+0000","last_peered":"2024-02-09T23:58:27.337216+0000","last_clean":"2024-02-09T23:58:27.337216+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-09T23:58:27.337216+0000","last_undegraded":"2024-02-09T23:58:27.337216+0000","last_fullsized":"2024-02-09T23:58:27.337216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348696+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-09T23:58:27.348696+0000","last_peered":"2024-02-09T23:58:27.348696+0000","last_clean":"2024-02-09T23:58:27.348696+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-09T23:58:27.348696+0000","last_undegraded":"2024-02-09T23:58:27.348696+0000","last_fullsized":"2024-02-09T23:58:27.348696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356716+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-09T23:58:27.356716+0000","last_peered":"2024-02-09T23:58:27.356716+0000","last_clean":"2024-02-09T23:58:27.356716+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-09T23:58:27.356716+0000","last_undegraded":"2024-02-09T23:58:27.356716+0000","last_fullsized":"2024-02-09T23:58:27.356716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.315722+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-09T23:58:27.315722+0000","last_peered":"2024-02-09T23:58:27.315722+0000","last_clean":"2024-02-09T23:58:27.315722+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-09T23:58:27.315722+0000","last_undegraded":"2024-02-09T23:58:27.315722+0000","last_fullsized":"2024-02-09T23:58:27.315722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357566+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-09T23:58:27.357566+0000","last_peered":"2024-02-09T23:58:27.357566+0000","last_clean":"2024-02-09T23:58:27.357566+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-09T23:58:27.357566+0000","last_undegraded":"2024-02-09T23:58:27.357566+0000","last_fullsized":"2024-02-09T23:58:27.357566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.322312+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-09T23:58:28.322312+0000","last_peered":"2024-02-09T23:58:28.322312+0000","last_clean":"2024-02-09T23:58:28.322312+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-09T23:58:28.322312+0000","last_undegraded":"2024-02-09T23:58:28.322312+0000","last_fullsized":"2024-02-09T23:58:28.322312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356684+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-09T23:58:27.356684+0000","last_peered":"2024-02-09T23:58:27.356684+0000","last_clean":"2024-02-09T23:58:27.356684+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-09T23:58:27.356684+0000","last_undegraded":"2024-02-09T23:58:27.356684+0000","last_fullsized":"2024-02-09T23:58:27.356684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390174+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-09T23:58:29.390174+0000","last_peered":"2024-02-09T23:58:29.390174+0000","last_clean":"2024-02-09T23:58:29.390174+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-09T23:58:29.390174+0000","last_undegraded":"2024-02-09T23:58:29.390174+0000","last_fullsized":"2024-02-09T23:58:29.390174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356876+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-09T23:58:27.356876+0000","last_peered":"2024-02-09T23:58:27.356876+0000","last_clean":"2024-02-09T23:58:27.356876+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-09T23:58:27.356876+0000","last_undegraded":"2024-02-09T23:58:27.356876+0000","last_fullsized":"2024-02-09T23:58:27.356876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.384963+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-09T23:58:29.384963+0000","last_peered":"2024-02-09T23:58:29.384963+0000","last_clean":"2024-02-09T23:58:29.384963+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-09T23:58:29.384963+0000","last_undegraded":"2024-02-09T23:58:29.384963+0000","last_fullsized":"2024-02-09T23:58:29.384963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335972+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-09T23:58:27.335972+0000","last_peered":"2024-02-09T23:58:27.335972+0000","last_clean":"2024-02-09T23:58:27.335972+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-09T23:58:27.335972+0000","last_undegraded":"2024-02-09T23:58:27.335972+0000","last_fullsized":"2024-02-09T23:58:27.335972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325146+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-09T23:58:28.325146+0000","last_peered":"2024-02-09T23:58:28.325146+0000","last_clean":"2024-02-09T23:58:28.325146+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-09T23:58:28.325146+0000","last_undegraded":"2024-02-09T23:58:28.325146+0000","last_fullsized":"2024-02-09T23:58:28.325146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352617+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-09T23:58:27.352617+0000","last_peered":"2024-02-09T23:58:27.352617+0000","last_clean":"2024-02-09T23:58:27.352617+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-09T23:58:27.352617+0000","last_undegraded":"2024-02-09T23:58:27.352617+0000","last_fullsized":"2024-02-09T23:58:27.352617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387191+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-09T23:58:29.387191+0000","last_peered":"2024-02-09T23:58:29.387191+0000","last_clean":"2024-02-09T23:58:29.387191+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-09T23:58:29.387191+0000","last_undegraded":"2024-02-09T23:58:29.387191+0000","last_fullsized":"2024-02-09T23:58:29.387191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332881+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-09T23:58:27.332881+0000","last_peered":"2024-02-09T23:58:27.332881+0000","last_clean":"2024-02-09T23:58:27.332881+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-09T23:58:27.332881+0000","last_undegraded":"2024-02-09T23:58:27.332881+0000","last_fullsized":"2024-02-09T23:58:27.332881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390474+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-09T23:58:29.390474+0000","last_peered":"2024-02-09T23:58:29.390474+0000","last_clean":"2024-02-09T23:58:29.390474+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-09T23:58:29.390474+0000","last_undegraded":"2024-02-09T23:58:29.390474+0000","last_fullsized":"2024-02-09T23:58:29.390474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.355440+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-09T23:58:27.355440+0000","last_peered":"2024-02-09T23:58:27.355440+0000","last_clean":"2024-02-09T23:58:27.355440+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-09T23:58:27.355440+0000","last_undegraded":"2024-02-09T23:58:27.355440+0000","last_fullsized":"2024-02-09T23:58:27.355440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387264+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-09T23:58:29.387264+0000","last_peered":"2024-02-09T23:58:29.387264+0000","last_clean":"2024-02-09T23:58:29.387264+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-09T23:58:29.387264+0000","last_undegraded":"2024-02-09T23:58:29.387264+0000","last_fullsized":"2024-02-09T23:58:29.387264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337193+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-09T23:58:27.337193+0000","last_peered":"2024-02-09T23:58:27.337193+0000","last_clean":"2024-02-09T23:58:27.337193+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-09T23:58:27.337193+0000","last_undegraded":"2024-02-09T23:58:27.337193+0000","last_fullsized":"2024-02-09T23:58:27.337193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317849+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-09T23:58:27.317849+0000","last_peered":"2024-02-09T23:58:27.317849+0000","last_clean":"2024-02-09T23:58:27.317849+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-09T23:58:27.317849+0000","last_undegraded":"2024-02-09T23:58:27.317849+0000","last_fullsized":"2024-02-09T23:58:27.317849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.343562+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-09T23:58:27.343562+0000","last_peered":"2024-02-09T23:58:27.343562+0000","last_clean":"2024-02-09T23:58:27.343562+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-09T23:58:27.343562+0000","last_undegraded":"2024-02-09T23:58:27.343562+0000","last_fullsized":"2024-02-09T23:58:27.343562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389939+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-09T23:58:29.389939+0000","last_peered":"2024-02-09T23:58:29.389939+0000","last_clean":"2024-02-09T23:58:29.389939+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-09T23:58:29.389939+0000","last_undegraded":"2024-02-09T23:58:29.389939+0000","last_fullsized":"2024-02-09T23:58:29.389939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356663+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-09T23:58:27.356663+0000","last_peered":"2024-02-09T23:58:27.356663+0000","last_clean":"2024-02-09T23:58:27.356663+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-09T23:58:27.356663+0000","last_undegraded":"2024-02-09T23:58:27.356663+0000","last_fullsized":"2024-02-09T23:58:27.356663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357059+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-09T23:58:27.357059+0000","last_peered":"2024-02-09T23:58:27.357059+0000","last_clean":"2024-02-09T23:58:27.357059+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-09T23:58:27.357059+0000","last_undegraded":"2024-02-09T23:58:27.357059+0000","last_fullsized":"2024-02-09T23:58:27.357059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356856+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-09T23:58:27.356856+0000","last_peered":"2024-02-09T23:58:27.356856+0000","last_clean":"2024-02-09T23:58:27.356856+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-09T23:58:27.356856+0000","last_undegraded":"2024-02-09T23:58:27.356856+0000","last_fullsized":"2024-02-09T23:58:27.356856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335801+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-09T23:58:27.335801+0000","last_peered":"2024-02-09T23:58:27.335801+0000","last_clean":"2024-02-09T23:58:27.335801+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-09T23:58:27.335801+0000","last_undegraded":"2024-02-09T23:58:27.335801+0000","last_fullsized":"2024-02-09T23:58:27.335801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349629+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-09T23:58:27.349629+0000","last_peered":"2024-02-09T23:58:27.349629+0000","last_clean":"2024-02-09T23:58:27.349629+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-09T23:58:27.349629+0000","last_undegraded":"2024-02-09T23:58:27.349629+0000","last_fullsized":"2024-02-09T23:58:27.349629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350753+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-09T23:58:27.350753+0000","last_peered":"2024-02-09T23:58:27.350753+0000","last_clean":"2024-02-09T23:58:27.350753+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-09T23:58:27.350753+0000","last_undegraded":"2024-02-09T23:58:27.350753+0000","last_fullsized":"2024-02-09T23:58:27.350753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334268+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-09T23:58:27.334268+0000","last_peered":"2024-02-09T23:58:27.334268+0000","last_clean":"2024-02-09T23:58:27.334268+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-09T23:58:27.334268+0000","last_undegraded":"2024-02-09T23:58:27.334268+0000","last_fullsized":"2024-02-09T23:58:27.334268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.311900+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-09T23:58:27.311900+0000","last_peered":"2024-02-09T23:58:27.311900+0000","last_clean":"2024-02-09T23:58:27.311900+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-09T23:58:27.311900+0000","last_undegraded":"2024-02-09T23:58:27.311900+0000","last_fullsized":"2024-02-09T23:58:27.311900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345793+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-09T23:58:27.345793+0000","last_peered":"2024-02-09T23:58:27.345793+0000","last_clean":"2024-02-09T23:58:27.345793+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-09T23:58:27.345793+0000","last_undegraded":"2024-02-09T23:58:27.345793+0000","last_fullsized":"2024-02-09T23:58:27.345793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389958+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-09T23:58:29.389958+0000","last_peered":"2024-02-09T23:58:29.389958+0000","last_clean":"2024-02-09T23:58:29.389958+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-09T23:58:29.389958+0000","last_undegraded":"2024-02-09T23:58:29.389958+0000","last_fullsized":"2024-02-09T23:58:29.389958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.326532+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-09T23:58:27.326532+0000","last_peered":"2024-02-09T23:58:27.326532+0000","last_clean":"2024-02-09T23:58:27.326532+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-09T23:58:27.326532+0000","last_undegraded":"2024-02-09T23:58:27.326532+0000","last_fullsized":"2024-02-09T23:58:27.326532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323278+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-09T23:58:27.323278+0000","last_peered":"2024-02-09T23:58:27.323278+0000","last_clean":"2024-02-09T23:58:27.323278+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-09T23:58:27.323278+0000","last_undegraded":"2024-02-09T23:58:27.323278+0000","last_fullsized":"2024-02-09T23:58:27.323278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356738+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-09T23:58:27.356738+0000","last_peered":"2024-02-09T23:58:27.356738+0000","last_clean":"2024-02-09T23:58:27.356738+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-09T23:58:27.356738+0000","last_undegraded":"2024-02-09T23:58:27.356738+0000","last_fullsized":"2024-02-09T23:58:27.356738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389494+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-09T23:58:29.389494+0000","last_peered":"2024-02-09T23:58:29.389494+0000","last_clean":"2024-02-09T23:58:29.389494+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-09T23:58:29.389494+0000","last_undegraded":"2024-02-09T23:58:29.389494+0000","last_fullsized":"2024-02-09T23:58:29.389494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332253+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-09T23:58:27.332253+0000","last_peered":"2024-02-09T23:58:27.332253+0000","last_clean":"2024-02-09T23:58:27.332253+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-09T23:58:27.332253+0000","last_undegraded":"2024-02-09T23:58:27.332253+0000","last_fullsized":"2024-02-09T23:58:27.332253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387177+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-09T23:58:29.387177+0000","last_peered":"2024-02-09T23:58:29.387177+0000","last_clean":"2024-02-09T23:58:29.387177+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-09T23:58:29.387177+0000","last_undegraded":"2024-02-09T23:58:29.387177+0000","last_fullsized":"2024-02-09T23:58:29.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352474+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-09T23:58:27.352474+0000","last_peered":"2024-02-09T23:58:27.352474+0000","last_clean":"2024-02-09T23:58:27.352474+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-09T23:58:27.352474+0000","last_undegraded":"2024-02-09T23:58:27.352474+0000","last_fullsized":"2024-02-09T23:58:27.352474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331213+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:27.331213+0000","last_peered":"2024-02-09T23:58:27.331213+0000","last_clean":"2024-02-09T23:58:27.331213+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:27.331213+0000","last_undegraded":"2024-02-09T23:58:27.331213+0000","last_fullsized":"2024-02-09T23:58:27.331213+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324223+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-09T23:58:28.324223+0000","last_peered":"2024-02-09T23:58:28.324223+0000","last_clean":"2024-02-09T23:58:28.324223+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-09T23:58:28.324223+0000","last_undegraded":"2024-02-09T23:58:28.324223+0000","last_fullsized":"2024-02-09T23:58:28.324223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352591+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-09T23:58:27.352591+0000","last_peered":"2024-02-09T23:58:27.352591+0000","last_clean":"2024-02-09T23:58:27.352591+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-09T23:58:27.352591+0000","last_undegraded":"2024-02-09T23:58:27.352591+0000","last_fullsized":"2024-02-09T23:58:27.352591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323352+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:27.323352+0000","last_peered":"2024-02-09T23:58:27.323352+0000","last_clean":"2024-02-09T23:58:27.323352+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:27.323352+0000","last_undegraded":"2024-02-09T23:58:27.323352+0000","last_fullsized":"2024-02-09T23:58:27.323352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389391+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-09T23:58:29.389391+0000","last_peered":"2024-02-09T23:58:29.389391+0000","last_clean":"2024-02-09T23:58:29.389391+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-09T23:58:29.389391+0000","last_undegraded":"2024-02-09T23:58:29.389391+0000","last_fullsized":"2024-02-09T23:58:29.389391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357319+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-09T23:58:27.357319+0000","last_peered":"2024-02-09T23:58:27.357319+0000","last_clean":"2024-02-09T23:58:27.357319+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-09T23:58:27.357319+0000","last_undegraded":"2024-02-09T23:58:27.357319+0000","last_fullsized":"2024-02-09T23:58:27.357319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.314672+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:27.314672+0000","last_peered":"2024-02-09T23:58:27.314672+0000","last_clean":"2024-02-09T23:58:27.314672+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:27.314672+0000","last_undegraded":"2024-02-09T23:58:27.314672+0000","last_fullsized":"2024-02-09T23:58:27.314672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.765383+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-09T23:58:28.765383+0000","last_peered":"2024-02-09T23:58:28.765383+0000","last_clean":"2024-02-09T23:58:28.765383+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-09T23:58:28.765383+0000","last_undegraded":"2024-02-09T23:58:28.765383+0000","last_fullsized":"2024-02-09T23:58:28.765383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356883+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-09T23:58:27.356883+0000","last_peered":"2024-02-09T23:58:27.356883+0000","last_clean":"2024-02-09T23:58:27.356883+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-09T23:58:27.356883+0000","last_undegraded":"2024-02-09T23:58:27.356883+0000","last_fullsized":"2024-02-09T23:58:27.356883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.319295+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:27.319295+0000","last_peered":"2024-02-09T23:58:27.319295+0000","last_clean":"2024-02-09T23:58:27.319295+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:27.319295+0000","last_undegraded":"2024-02-09T23:58:27.319295+0000","last_fullsized":"2024-02-09T23:58:27.319295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.316863+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:27.316863+0000","last_peered":"2024-02-09T23:58:27.316863+0000","last_clean":"2024-02-09T23:58:27.316863+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:27.316863+0000","last_undegraded":"2024-02-09T23:58:27.316863+0000","last_fullsized":"2024-02-09T23:58:27.316863+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320951+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-09T23:58:27.320951+0000","last_peered":"2024-02-09T23:58:27.320951+0000","last_clean":"2024-02-09T23:58:27.320951+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-09T23:58:27.320951+0000","last_undegraded":"2024-02-09T23:58:27.320951+0000","last_fullsized":"2024-02-09T23:58:27.320951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356758+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-09T23:58:27.356758+0000","last_peered":"2024-02-09T23:58:27.356758+0000","last_clean":"2024-02-09T23:58:27.356758+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-09T23:58:27.356758+0000","last_undegraded":"2024-02-09T23:58:27.356758+0000","last_fullsized":"2024-02-09T23:58:27.356758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.318145+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:27.318145+0000","last_peered":"2024-02-09T23:58:27.318145+0000","last_clean":"2024-02-09T23:58:27.318145+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:27.318145+0000","last_undegraded":"2024-02-09T23:58:27.318145+0000","last_fullsized":"2024-02-09T23:58:27.318145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324007+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-09T23:58:28.324007+0000","last_peered":"2024-02-09T23:58:28.324007+0000","last_clean":"2024-02-09T23:58:28.324007+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-09T23:58:28.324007+0000","last_undegraded":"2024-02-09T23:58:28.324007+0000","last_fullsized":"2024-02-09T23:58:28.324007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345678+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-09T23:58:27.345678+0000","last_peered":"2024-02-09T23:58:27.345678+0000","last_clean":"2024-02-09T23:58:27.345678+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-09T23:58:27.345678+0000","last_undegraded":"2024-02-09T23:58:27.345678+0000","last_fullsized":"2024-02-09T23:58:27.345678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320229+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:27.320229+0000","last_peered":"2024-02-09T23:58:27.320229+0000","last_clean":"2024-02-09T23:58:27.320229+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:27.320229+0000","last_undegraded":"2024-02-09T23:58:27.320229+0000","last_fullsized":"2024-02-09T23:58:27.320229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.330957+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-09T23:58:27.330957+0000","last_peered":"2024-02-09T23:58:27.330957+0000","last_clean":"2024-02-09T23:58:27.330957+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-09T23:58:27.330957+0000","last_undegraded":"2024-02-09T23:58:27.330957+0000","last_fullsized":"2024-02-09T23:58:27.330957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.339496+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-09T23:58:27.339496+0000","last_peered":"2024-02-09T23:58:27.339496+0000","last_clean":"2024-02-09T23:58:27.339496+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-09T23:58:27.339496+0000","last_undegraded":"2024-02-09T23:58:27.339496+0000","last_fullsized":"2024-02-09T23:58:27.339496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387255+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-09T23:58:29.387255+0000","last_peered":"2024-02-09T23:58:29.387255+0000","last_clean":"2024-02-09T23:58:29.387255+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-09T23:58:29.387255+0000","last_undegraded":"2024-02-09T23:58:29.387255+0000","last_fullsized":"2024-02-09T23:58:29.387255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337306+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:27.337306+0000","last_peered":"2024-02-09T23:58:27.337306+0000","last_clean":"2024-02-09T23:58:27.337306+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:27.337306+0000","last_undegraded":"2024-02-09T23:58:27.337306+0000","last_fullsized":"2024-02-09T23:58:27.337306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356834+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-09T23:58:27.356834+0000","last_peered":"2024-02-09T23:58:27.356834+0000","last_clean":"2024-02-09T23:58:27.356834+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-09T23:58:27.356834+0000","last_undegraded":"2024-02-09T23:58:27.356834+0000","last_fullsized":"2024-02-09T23:58:27.356834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317100+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:27.317100+0000","last_peered":"2024-02-09T23:58:27.317100+0000","last_clean":"2024-02-09T23:58:27.317100+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:27.317100+0000","last_undegraded":"2024-02-09T23:58:27.317100+0000","last_fullsized":"2024-02-09T23:58:27.317100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325268+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-09T23:58:28.325268+0000","last_peered":"2024-02-09T23:58:28.325268+0000","last_clean":"2024-02-09T23:58:28.325268+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-09T23:58:28.325268+0000","last_undegraded":"2024-02-09T23:58:28.325268+0000","last_fullsized":"2024-02-09T23:58:28.325268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334225+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-09T23:58:27.334225+0000","last_peered":"2024-02-09T23:58:27.334225+0000","last_clean":"2024-02-09T23:58:27.334225+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-09T23:58:27.334225+0000","last_undegraded":"2024-02-09T23:58:27.334225+0000","last_fullsized":"2024-02-09T23:58:27.334225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390822+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-09T23:58:29.390822+0000","last_peered":"2024-02-09T23:58:29.390822+0000","last_clean":"2024-02-09T23:58:29.390822+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-09T23:58:29.390822+0000","last_undegraded":"2024-02-09T23:58:29.390822+0000","last_fullsized":"2024-02-09T23:58:29.390822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357559+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-09T23:58:27.357559+0000","last_peered":"2024-02-09T23:58:27.357559+0000","last_clean":"2024-02-09T23:58:27.357559+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-09T23:58:27.357559+0000","last_undegraded":"2024-02-09T23:58:27.357559+0000","last_fullsized":"2024-02-09T23:58:27.357559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352295+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-09T23:58:27.352295+0000","last_peered":"2024-02-09T23:58:27.352295+0000","last_clean":"2024-02-09T23:58:27.352295+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-09T23:58:27.352295+0000","last_undegraded":"2024-02-09T23:58:27.352295+0000","last_fullsized":"2024-02-09T23:58:27.352295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332903+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-09T23:58:27.332903+0000","last_peered":"2024-02-09T23:58:27.332903+0000","last_clean":"2024-02-09T23:58:27.332903+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-09T23:58:27.332903+0000","last_undegraded":"2024-02-09T23:58:27.332903+0000","last_fullsized":"2024-02-09T23:58:27.332903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340185+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-09T23:58:27.340185+0000","last_peered":"2024-02-09T23:58:27.340185+0000","last_clean":"2024-02-09T23:58:27.340185+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-09T23:58:27.340185+0000","last_undegraded":"2024-02-09T23:58:27.340185+0000","last_fullsized":"2024-02-09T23:58:27.340185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334290+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-09T23:58:27.334290+0000","last_peered":"2024-02-09T23:58:27.334290+0000","last_clean":"2024-02-09T23:58:27.334290+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-09T23:58:27.334290+0000","last_undegraded":"2024-02-09T23:58:27.334290+0000","last_fullsized":"2024-02-09T23:58:27.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337567+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-09T23:58:27.337567+0000","last_peered":"2024-02-09T23:58:27.337567+0000","last_clean":"2024-02-09T23:58:27.337567+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-09T23:58:27.337567+0000","last_undegraded":"2024-02-09T23:58:27.337567+0000","last_fullsized":"2024-02-09T23:58:27.337567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334061+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-09T23:58:27.334061+0000","last_peered":"2024-02-09T23:58:27.334061+0000","last_clean":"2024-02-09T23:58:27.334061+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-09T23:58:27.334061+0000","last_undegraded":"2024-02-09T23:58:27.334061+0000","last_fullsized":"2024-02-09T23:58:27.334061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.353922+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-09T23:58:27.353922+0000","last_peered":"2024-02-09T23:58:27.353922+0000","last_clean":"2024-02-09T23:58:27.353922+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-09T23:58:27.353922+0000","last_undegraded":"2024-02-09T23:58:27.353922+0000","last_fullsized":"2024-02-09T23:58:27.353922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348660+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-09T23:58:27.348660+0000","last_peered":"2024-02-09T23:58:27.348660+0000","last_clean":"2024-02-09T23:58:27.348660+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-09T23:58:27.348660+0000","last_undegraded":"2024-02-09T23:58:27.348660+0000","last_fullsized":"2024-02-09T23:58:27.348660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357729+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-09T23:58:27.357729+0000","last_peered":"2024-02-09T23:58:27.357729+0000","last_clean":"2024-02-09T23:58:27.357729+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-09T23:58:27.357729+0000","last_undegraded":"2024-02-09T23:58:27.357729+0000","last_fullsized":"2024-02-09T23:58:27.357729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.354758+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-09T23:58:27.354758+0000","last_peered":"2024-02-09T23:58:27.354758+0000","last_clean":"2024-02-09T23:58:27.354758+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-09T23:58:27.354758+0000","last_undegraded":"2024-02-09T23:58:27.354758+0000","last_fullsized":"2024-02-09T23:58:27.354758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333673+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-09T23:58:27.333673+0000","last_peered":"2024-02-09T23:58:27.333673+0000","last_clean":"2024-02-09T23:58:27.333673+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-09T23:58:27.333673+0000","last_undegraded":"2024-02-09T23:58:27.333673+0000","last_fullsized":"2024-02-09T23:58:27.333673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356759+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-09T23:58:27.356759+0000","last_peered":"2024-02-09T23:58:27.356759+0000","last_clean":"2024-02-09T23:58:27.356759+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-09T23:58:27.356759+0000","last_undegraded":"2024-02-09T23:58:27.356759+0000","last_fullsized":"2024-02-09T23:58:27.356759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356963+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-09T23:58:27.356963+0000","last_peered":"2024-02-09T23:58:27.356963+0000","last_clean":"2024-02-09T23:58:27.356963+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-09T23:58:27.356963+0000","last_undegraded":"2024-02-09T23:58:27.356963+0000","last_fullsized":"2024-02-09T23:58:27.356963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}]}} 2024-02-09T23:58:34.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T23:58:34.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.413+0000 7fc964288700 1 Processor -- start 2024-02-09T23:58:34.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.413+0000 7fc964288700 1 -- start start 2024-02-09T23:58:34.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc964288700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc964288700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc964288700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c09c8f0 con 0x7fc95c09f010 2024-02-09T23:58:34.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc964288700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c09c5e0 con 0x7fc95c09f8e0 2024-02-09T23:58:34.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc964288700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0a1540 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc962825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc961823700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc962825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54268/0 (socket says 172.21.15.89:54268) 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc961823700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39920/0 (socket says 172.21.15.89:39920) 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.414+0000 7fc962825700 1 -- 172.21.15.89:0/3423583263 learned_addr learned my addr 172.21.15.89:0/3423583263 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc962825700 1 -- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 msgr2=0x7fc95c09f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:34.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc962825700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc962825700 1 -- 172.21.15.89:0/3423583263 >> v1:172.21.15.89:6789/0 conn(0x7fc95c09f010 legacy=0x7fc95c0a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc961022700 1 -- 172.21.15.89:0/3423583263 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664114143 0 0) 0x7fc95c09c8f0 con 0x7fc95c09f010 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc962825700 1 -- 172.21.15.89:0/3423583263 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c09cb20 con 0x7fc95c09f8e0 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc961823700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc962825700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc9540032f0 tx=0x7fc954009290).ready entity=mon.1 client_cookie=bd422fd993a13257 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc961022700 1 -- 172.21.15.89:0/3423583263 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400b8a0 con 0x7fc95c09f8e0 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc961022700 1 -- 172.21.15.89:0/3423583263 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400ba00 con 0x7fc95c09f8e0 2024-02-09T23:58:34.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc961022700 1 -- 172.21.15.89:0/3423583263 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400bb70 con 0x7fc95c09f8e0 2024-02-09T23:58:34.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 -- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 msgr2=0x7fc95c13d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc9540032f0 tx=0x7fc954009290).stop 2024-02-09T23:58:34.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 -- 172.21.15.89:0/3423583263 shutdown_connections 2024-02-09T23:58:34.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c09f8e0 0x7fc95c13d1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 --2- 172.21.15.89:0/3423583263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c0a4fa0 0x7fc95c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 -- 172.21.15.89:0/3423583263 >> 172.21.15.89:0/3423583263 conn(0x7fc95c0a93f0 msgr2=0x7fc95c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 -- 172.21.15.89:0/3423583263 shutdown_connections 2024-02-09T23:58:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.415+0000 7fc964288700 1 -- 172.21.15.89:0/3423583263 wait complete. 2024-02-09T23:58:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.416+0000 7fc964288700 1 Processor -- start 2024-02-09T23:58:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.416+0000 7fc964288700 1 -- start start 2024-02-09T23:58:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c09f010 0x7fc95c092430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c136c00 con 0x7fc95c09f010 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c137f70 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc964288700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c138230 con 0x7fc95c09f8e0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc961823700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc961823700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39924/0 (socket says 172.21.15.89:39924) 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54282/0 (socket says 172.21.15.89:54282) 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc961823700 1 -- 172.21.15.89:0/2553314336 learned_addr learned my addr 172.21.15.89:0/2553314336 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962024700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c09f010 0x7fc95c092430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 -- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 msgr2=0x7fc95c149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 -- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c09f010 msgr2=0x7fc95c092430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c09f010 0x7fc95c092430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 -- 172.21.15.89:0/2553314336 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c00b180 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc961823700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.417+0000 7fc962825700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc9540032f0 tx=0x7fc954016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400b8a0 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954021630 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc954009530 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc954021990 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c137840 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.418+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc954027020 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.419+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc95404bb30 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.419+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c0921f0 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.422+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc954021d20 con 0x7fc95c0a4fa0 2024-02-09T23:58:34.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.529+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 --> v1:172.21.15.89:6816/39389 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc95c060500 con 0x7fc93c038dd0 2024-02-09T23:58:34.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.535+0000 7fc94b7fe700 1 -- 172.21.15.89:0/2553314336 <== mgr.4100 v1:172.21.15.89:6816/39389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246936 (unknown 2965378022 0 3192924599) 0x7fc95c060500 con 0x7fc93c038dd0 2024-02-09T23:58:34.541 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:34.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 >> v1:172.21.15.89:6816/39389 conn(0x7fc93c038dd0 legacy=0x7fc93c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 msgr2=0x7fc95c149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc9540032f0 tx=0x7fc954016000).stop 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 shutdown_connections 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0a4fa0 0x7fc95c149620 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c09f010 0x7fc95c092430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 --2- 172.21.15.89:0/2553314336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc95c09f8e0 0x7fc95c149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 >> 172.21.15.89:0/2553314336 conn(0x7fc95c0a93f0 msgr2=0x7fc95c05dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 shutdown_connections 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.538+0000 7fc964288700 1 -- 172.21.15.89:0/2553314336 wait complete. 2024-02-09T23:58:34.544 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-09T23:58:34.550 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-09T23:58:32.554727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001003"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334099+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-09T23:58:27.334099+0000","last_peered":"2024-02-09T23:58:27.334099+0000","last_clean":"2024-02-09T23:58:27.334099+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-09T23:58:27.334099+0000","last_undegraded":"2024-02-09T23:58:27.334099+0000","last_fullsized":"2024-02-09T23:58:27.334099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357573+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-09T23:58:27.357573+0000","last_peered":"2024-02-09T23:58:27.357573+0000","last_clean":"2024-02-09T23:58:27.357573+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-09T23:58:27.357573+0000","last_undegraded":"2024-02-09T23:58:27.357573+0000","last_fullsized":"2024-02-09T23:58:27.357573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.351216+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-09T23:58:27.351216+0000","last_peered":"2024-02-09T23:58:27.351216+0000","last_clean":"2024-02-09T23:58:27.351216+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-09T23:58:27.351216+0000","last_undegraded":"2024-02-09T23:58:27.351216+0000","last_fullsized":"2024-02-09T23:58:27.351216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345605+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-09T23:58:27.345605+0000","last_peered":"2024-02-09T23:58:27.345605+0000","last_clean":"2024-02-09T23:58:27.345605+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-09T23:58:27.345605+0000","last_undegraded":"2024-02-09T23:58:27.345605+0000","last_fullsized":"2024-02-09T23:58:27.345605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333159+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-09T23:58:27.333159+0000","last_peered":"2024-02-09T23:58:27.333159+0000","last_clean":"2024-02-09T23:58:27.333159+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-09T23:58:27.333159+0000","last_undegraded":"2024-02-09T23:58:27.333159+0000","last_fullsized":"2024-02-09T23:58:27.333159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340038+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-09T23:58:27.340038+0000","last_peered":"2024-02-09T23:58:27.340038+0000","last_clean":"2024-02-09T23:58:27.340038+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-09T23:58:27.340038+0000","last_undegraded":"2024-02-09T23:58:27.340038+0000","last_fullsized":"2024-02-09T23:58:27.340038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334038+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-09T23:58:27.334038+0000","last_peered":"2024-02-09T23:58:27.334038+0000","last_clean":"2024-02-09T23:58:27.334038+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-09T23:58:27.334038+0000","last_undegraded":"2024-02-09T23:58:27.334038+0000","last_fullsized":"2024-02-09T23:58:27.334038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357718+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-09T23:58:27.357718+0000","last_peered":"2024-02-09T23:58:27.357718+0000","last_clean":"2024-02-09T23:58:27.357718+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-09T23:58:27.357718+0000","last_undegraded":"2024-02-09T23:58:27.357718+0000","last_fullsized":"2024-02-09T23:58:27.357718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331551+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-09T23:58:27.331551+0000","last_peered":"2024-02-09T23:58:27.331551+0000","last_clean":"2024-02-09T23:58:27.331551+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-09T23:58:27.331551+0000","last_undegraded":"2024-02-09T23:58:27.331551+0000","last_fullsized":"2024-02-09T23:58:27.331551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356313+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-09T23:58:27.356313+0000","last_peered":"2024-02-09T23:58:27.356313+0000","last_clean":"2024-02-09T23:58:27.356313+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-09T23:58:27.356313+0000","last_undegraded":"2024-02-09T23:58:27.356313+0000","last_fullsized":"2024-02-09T23:58:27.356313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356534+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-09T23:58:27.356534+0000","last_peered":"2024-02-09T23:58:27.356534+0000","last_clean":"2024-02-09T23:58:27.356534+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-09T23:58:27.356534+0000","last_undegraded":"2024-02-09T23:58:27.356534+0000","last_fullsized":"2024-02-09T23:58:27.356534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336683+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-09T23:58:27.336683+0000","last_peered":"2024-02-09T23:58:27.336683+0000","last_clean":"2024-02-09T23:58:27.336683+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-09T23:58:27.336683+0000","last_undegraded":"2024-02-09T23:58:27.336683+0000","last_fullsized":"2024-02-09T23:58:27.336683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332924+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-09T23:58:27.332924+0000","last_peered":"2024-02-09T23:58:27.332924+0000","last_clean":"2024-02-09T23:58:27.332924+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-09T23:58:27.332924+0000","last_undegraded":"2024-02-09T23:58:27.332924+0000","last_fullsized":"2024-02-09T23:58:27.332924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357122+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-09T23:58:27.357122+0000","last_peered":"2024-02-09T23:58:27.357122+0000","last_clean":"2024-02-09T23:58:27.357122+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-09T23:58:27.357122+0000","last_undegraded":"2024-02-09T23:58:27.357122+0000","last_fullsized":"2024-02-09T23:58:27.357122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345711+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-09T23:58:27.345711+0000","last_peered":"2024-02-09T23:58:27.345711+0000","last_clean":"2024-02-09T23:58:27.345711+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-09T23:58:27.345711+0000","last_undegraded":"2024-02-09T23:58:27.345711+0000","last_fullsized":"2024-02-09T23:58:27.345711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334575+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-09T23:58:27.334575+0000","last_peered":"2024-02-09T23:58:27.334575+0000","last_clean":"2024-02-09T23:58:27.334575+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-09T23:58:27.334575+0000","last_undegraded":"2024-02-09T23:58:27.334575+0000","last_fullsized":"2024-02-09T23:58:27.334575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333238+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-09T23:58:27.333238+0000","last_peered":"2024-02-09T23:58:27.333238+0000","last_clean":"2024-02-09T23:58:27.333238+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-09T23:58:27.333238+0000","last_undegraded":"2024-02-09T23:58:27.333238+0000","last_fullsized":"2024-02-09T23:58:27.333238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333651+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-09T23:58:27.333651+0000","last_peered":"2024-02-09T23:58:27.333651+0000","last_clean":"2024-02-09T23:58:27.333651+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-09T23:58:27.333651+0000","last_undegraded":"2024-02-09T23:58:27.333651+0000","last_fullsized":"2024-02-09T23:58:27.333651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.336247+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-09T23:58:27.336247+0000","last_peered":"2024-02-09T23:58:27.336247+0000","last_clean":"2024-02-09T23:58:27.336247+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-09T23:58:27.336247+0000","last_undegraded":"2024-02-09T23:58:27.336247+0000","last_fullsized":"2024-02-09T23:58:27.336247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349813+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-09T23:58:27.349813+0000","last_peered":"2024-02-09T23:58:27.349813+0000","last_clean":"2024-02-09T23:58:27.349813+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-09T23:58:27.349813+0000","last_undegraded":"2024-02-09T23:58:27.349813+0000","last_fullsized":"2024-02-09T23:58:27.349813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349514+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-09T23:58:27.349514+0000","last_peered":"2024-02-09T23:58:27.349514+0000","last_clean":"2024-02-09T23:58:27.349514+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-09T23:58:27.349514+0000","last_undegraded":"2024-02-09T23:58:27.349514+0000","last_fullsized":"2024-02-09T23:58:27.349514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356686+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-09T23:58:27.356686+0000","last_peered":"2024-02-09T23:58:27.356686+0000","last_clean":"2024-02-09T23:58:27.356686+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-09T23:58:27.356686+0000","last_undegraded":"2024-02-09T23:58:27.356686+0000","last_fullsized":"2024-02-09T23:58:27.356686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335658+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-09T23:58:27.335658+0000","last_peered":"2024-02-09T23:58:27.335658+0000","last_clean":"2024-02-09T23:58:27.335658+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-09T23:58:27.335658+0000","last_undegraded":"2024-02-09T23:58:27.335658+0000","last_fullsized":"2024-02-09T23:58:27.335658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357705+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-09T23:58:27.357705+0000","last_peered":"2024-02-09T23:58:27.357705+0000","last_clean":"2024-02-09T23:58:27.357705+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-09T23:58:27.357705+0000","last_undegraded":"2024-02-09T23:58:27.357705+0000","last_fullsized":"2024-02-09T23:58:27.357705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352451+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-09T23:58:27.352451+0000","last_peered":"2024-02-09T23:58:27.352451+0000","last_clean":"2024-02-09T23:58:27.352451+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-09T23:58:27.352451+0000","last_undegraded":"2024-02-09T23:58:27.352451+0000","last_fullsized":"2024-02-09T23:58:27.352451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357289+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-09T23:58:27.357289+0000","last_peered":"2024-02-09T23:58:27.357289+0000","last_clean":"2024-02-09T23:58:27.357289+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-09T23:58:27.357289+0000","last_undegraded":"2024-02-09T23:58:27.357289+0000","last_fullsized":"2024-02-09T23:58:27.357289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337216+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-09T23:58:27.337216+0000","last_peered":"2024-02-09T23:58:27.337216+0000","last_clean":"2024-02-09T23:58:27.337216+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-09T23:58:27.337216+0000","last_undegraded":"2024-02-09T23:58:27.337216+0000","last_fullsized":"2024-02-09T23:58:27.337216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348696+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-09T23:58:27.348696+0000","last_peered":"2024-02-09T23:58:27.348696+0000","last_clean":"2024-02-09T23:58:27.348696+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-09T23:58:27.348696+0000","last_undegraded":"2024-02-09T23:58:27.348696+0000","last_fullsized":"2024-02-09T23:58:27.348696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356716+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-09T23:58:27.356716+0000","last_peered":"2024-02-09T23:58:27.356716+0000","last_clean":"2024-02-09T23:58:27.356716+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-09T23:58:27.356716+0000","last_undegraded":"2024-02-09T23:58:27.356716+0000","last_fullsized":"2024-02-09T23:58:27.356716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.315722+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-09T23:58:27.315722+0000","last_peered":"2024-02-09T23:58:27.315722+0000","last_clean":"2024-02-09T23:58:27.315722+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-09T23:58:27.315722+0000","last_undegraded":"2024-02-09T23:58:27.315722+0000","last_fullsized":"2024-02-09T23:58:27.315722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357566+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-09T23:58:27.357566+0000","last_peered":"2024-02-09T23:58:27.357566+0000","last_clean":"2024-02-09T23:58:27.357566+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-09T23:58:27.357566+0000","last_undegraded":"2024-02-09T23:58:27.357566+0000","last_fullsized":"2024-02-09T23:58:27.357566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.322312+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-09T23:58:28.322312+0000","last_peered":"2024-02-09T23:58:28.322312+0000","last_clean":"2024-02-09T23:58:28.322312+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-09T23:58:28.322312+0000","last_undegraded":"2024-02-09T23:58:28.322312+0000","last_fullsized":"2024-02-09T23:58:28.322312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356684+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-09T23:58:27.356684+0000","last_peered":"2024-02-09T23:58:27.356684+0000","last_clean":"2024-02-09T23:58:27.356684+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-09T23:58:27.356684+0000","last_undegraded":"2024-02-09T23:58:27.356684+0000","last_fullsized":"2024-02-09T23:58:27.356684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390174+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-09T23:58:29.390174+0000","last_peered":"2024-02-09T23:58:29.390174+0000","last_clean":"2024-02-09T23:58:29.390174+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-09T23:58:29.390174+0000","last_undegraded":"2024-02-09T23:58:29.390174+0000","last_fullsized":"2024-02-09T23:58:29.390174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356876+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-09T23:58:27.356876+0000","last_peered":"2024-02-09T23:58:27.356876+0000","last_clean":"2024-02-09T23:58:27.356876+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-09T23:58:27.356876+0000","last_undegraded":"2024-02-09T23:58:27.356876+0000","last_fullsized":"2024-02-09T23:58:27.356876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.384963+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-09T23:58:29.384963+0000","last_peered":"2024-02-09T23:58:29.384963+0000","last_clean":"2024-02-09T23:58:29.384963+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-09T23:58:29.384963+0000","last_undegraded":"2024-02-09T23:58:29.384963+0000","last_fullsized":"2024-02-09T23:58:29.384963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335972+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-09T23:58:27.335972+0000","last_peered":"2024-02-09T23:58:27.335972+0000","last_clean":"2024-02-09T23:58:27.335972+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-09T23:58:27.335972+0000","last_undegraded":"2024-02-09T23:58:27.335972+0000","last_fullsized":"2024-02-09T23:58:27.335972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325146+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-09T23:58:28.325146+0000","last_peered":"2024-02-09T23:58:28.325146+0000","last_clean":"2024-02-09T23:58:28.325146+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-09T23:58:28.325146+0000","last_undegraded":"2024-02-09T23:58:28.325146+0000","last_fullsized":"2024-02-09T23:58:28.325146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352617+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-09T23:58:27.352617+0000","last_peered":"2024-02-09T23:58:27.352617+0000","last_clean":"2024-02-09T23:58:27.352617+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-09T23:58:27.352617+0000","last_undegraded":"2024-02-09T23:58:27.352617+0000","last_fullsized":"2024-02-09T23:58:27.352617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387191+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-09T23:58:29.387191+0000","last_peered":"2024-02-09T23:58:29.387191+0000","last_clean":"2024-02-09T23:58:29.387191+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-09T23:58:29.387191+0000","last_undegraded":"2024-02-09T23:58:29.387191+0000","last_fullsized":"2024-02-09T23:58:29.387191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332881+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-09T23:58:27.332881+0000","last_peered":"2024-02-09T23:58:27.332881+0000","last_clean":"2024-02-09T23:58:27.332881+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-09T23:58:27.332881+0000","last_undegraded":"2024-02-09T23:58:27.332881+0000","last_fullsized":"2024-02-09T23:58:27.332881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390474+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-09T23:58:29.390474+0000","last_peered":"2024-02-09T23:58:29.390474+0000","last_clean":"2024-02-09T23:58:29.390474+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-09T23:58:29.390474+0000","last_undegraded":"2024-02-09T23:58:29.390474+0000","last_fullsized":"2024-02-09T23:58:29.390474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.355440+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-09T23:58:27.355440+0000","last_peered":"2024-02-09T23:58:27.355440+0000","last_clean":"2024-02-09T23:58:27.355440+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-09T23:58:27.355440+0000","last_undegraded":"2024-02-09T23:58:27.355440+0000","last_fullsized":"2024-02-09T23:58:27.355440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387264+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-09T23:58:29.387264+0000","last_peered":"2024-02-09T23:58:29.387264+0000","last_clean":"2024-02-09T23:58:29.387264+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-09T23:58:29.387264+0000","last_undegraded":"2024-02-09T23:58:29.387264+0000","last_fullsized":"2024-02-09T23:58:29.387264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337193+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-09T23:58:27.337193+0000","last_peered":"2024-02-09T23:58:27.337193+0000","last_clean":"2024-02-09T23:58:27.337193+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-09T23:58:27.337193+0000","last_undegraded":"2024-02-09T23:58:27.337193+0000","last_fullsized":"2024-02-09T23:58:27.337193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317849+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-09T23:58:27.317849+0000","last_peered":"2024-02-09T23:58:27.317849+0000","last_clean":"2024-02-09T23:58:27.317849+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-09T23:58:27.317849+0000","last_undegraded":"2024-02-09T23:58:27.317849+0000","last_fullsized":"2024-02-09T23:58:27.317849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.343562+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-09T23:58:27.343562+0000","last_peered":"2024-02-09T23:58:27.343562+0000","last_clean":"2024-02-09T23:58:27.343562+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-09T23:58:27.343562+0000","last_undegraded":"2024-02-09T23:58:27.343562+0000","last_fullsized":"2024-02-09T23:58:27.343562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389939+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-09T23:58:29.389939+0000","last_peered":"2024-02-09T23:58:29.389939+0000","last_clean":"2024-02-09T23:58:29.389939+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-09T23:58:29.389939+0000","last_undegraded":"2024-02-09T23:58:29.389939+0000","last_fullsized":"2024-02-09T23:58:29.389939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356663+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-09T23:58:27.356663+0000","last_peered":"2024-02-09T23:58:27.356663+0000","last_clean":"2024-02-09T23:58:27.356663+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-09T23:58:27.356663+0000","last_undegraded":"2024-02-09T23:58:27.356663+0000","last_fullsized":"2024-02-09T23:58:27.356663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357059+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-09T23:58:27.357059+0000","last_peered":"2024-02-09T23:58:27.357059+0000","last_clean":"2024-02-09T23:58:27.357059+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-09T23:58:27.357059+0000","last_undegraded":"2024-02-09T23:58:27.357059+0000","last_fullsized":"2024-02-09T23:58:27.357059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356856+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-09T23:58:27.356856+0000","last_peered":"2024-02-09T23:58:27.356856+0000","last_clean":"2024-02-09T23:58:27.356856+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-09T23:58:27.356856+0000","last_undegraded":"2024-02-09T23:58:27.356856+0000","last_fullsized":"2024-02-09T23:58:27.356856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.335801+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-09T23:58:27.335801+0000","last_peered":"2024-02-09T23:58:27.335801+0000","last_clean":"2024-02-09T23:58:27.335801+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-09T23:58:27.335801+0000","last_undegraded":"2024-02-09T23:58:27.335801+0000","last_fullsized":"2024-02-09T23:58:27.335801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.349629+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-09T23:58:27.349629+0000","last_peered":"2024-02-09T23:58:27.349629+0000","last_clean":"2024-02-09T23:58:27.349629+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-09T23:58:27.349629+0000","last_undegraded":"2024-02-09T23:58:27.349629+0000","last_fullsized":"2024-02-09T23:58:27.349629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.350753+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-09T23:58:27.350753+0000","last_peered":"2024-02-09T23:58:27.350753+0000","last_clean":"2024-02-09T23:58:27.350753+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-09T23:58:27.350753+0000","last_undegraded":"2024-02-09T23:58:27.350753+0000","last_fullsized":"2024-02-09T23:58:27.350753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334268+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-09T23:58:27.334268+0000","last_peered":"2024-02-09T23:58:27.334268+0000","last_clean":"2024-02-09T23:58:27.334268+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-09T23:58:27.334268+0000","last_undegraded":"2024-02-09T23:58:27.334268+0000","last_fullsized":"2024-02-09T23:58:27.334268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.311900+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-09T23:58:27.311900+0000","last_peered":"2024-02-09T23:58:27.311900+0000","last_clean":"2024-02-09T23:58:27.311900+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-09T23:58:27.311900+0000","last_undegraded":"2024-02-09T23:58:27.311900+0000","last_fullsized":"2024-02-09T23:58:27.311900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345793+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-09T23:58:27.345793+0000","last_peered":"2024-02-09T23:58:27.345793+0000","last_clean":"2024-02-09T23:58:27.345793+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-09T23:58:27.345793+0000","last_undegraded":"2024-02-09T23:58:27.345793+0000","last_fullsized":"2024-02-09T23:58:27.345793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389958+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-09T23:58:29.389958+0000","last_peered":"2024-02-09T23:58:29.389958+0000","last_clean":"2024-02-09T23:58:29.389958+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-09T23:58:29.389958+0000","last_undegraded":"2024-02-09T23:58:29.389958+0000","last_fullsized":"2024-02-09T23:58:29.389958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.326532+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-09T23:58:27.326532+0000","last_peered":"2024-02-09T23:58:27.326532+0000","last_clean":"2024-02-09T23:58:27.326532+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-09T23:58:27.326532+0000","last_undegraded":"2024-02-09T23:58:27.326532+0000","last_fullsized":"2024-02-09T23:58:27.326532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323278+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-09T23:58:27.323278+0000","last_peered":"2024-02-09T23:58:27.323278+0000","last_clean":"2024-02-09T23:58:27.323278+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-09T23:58:27.323278+0000","last_undegraded":"2024-02-09T23:58:27.323278+0000","last_fullsized":"2024-02-09T23:58:27.323278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356738+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-09T23:58:27.356738+0000","last_peered":"2024-02-09T23:58:27.356738+0000","last_clean":"2024-02-09T23:58:27.356738+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-09T23:58:27.356738+0000","last_undegraded":"2024-02-09T23:58:27.356738+0000","last_fullsized":"2024-02-09T23:58:27.356738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389494+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-09T23:58:29.389494+0000","last_peered":"2024-02-09T23:58:29.389494+0000","last_clean":"2024-02-09T23:58:29.389494+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-09T23:58:29.389494+0000","last_undegraded":"2024-02-09T23:58:29.389494+0000","last_fullsized":"2024-02-09T23:58:29.389494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332253+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-09T23:58:27.332253+0000","last_peered":"2024-02-09T23:58:27.332253+0000","last_clean":"2024-02-09T23:58:27.332253+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-09T23:58:27.332253+0000","last_undegraded":"2024-02-09T23:58:27.332253+0000","last_fullsized":"2024-02-09T23:58:27.332253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387177+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-09T23:58:29.387177+0000","last_peered":"2024-02-09T23:58:29.387177+0000","last_clean":"2024-02-09T23:58:29.387177+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-09T23:58:29.387177+0000","last_undegraded":"2024-02-09T23:58:29.387177+0000","last_fullsized":"2024-02-09T23:58:29.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352474+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-09T23:58:27.352474+0000","last_peered":"2024-02-09T23:58:27.352474+0000","last_clean":"2024-02-09T23:58:27.352474+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-09T23:58:27.352474+0000","last_undegraded":"2024-02-09T23:58:27.352474+0000","last_fullsized":"2024-02-09T23:58:27.352474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.331213+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:27.331213+0000","last_peered":"2024-02-09T23:58:27.331213+0000","last_clean":"2024-02-09T23:58:27.331213+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:27.331213+0000","last_undegraded":"2024-02-09T23:58:27.331213+0000","last_fullsized":"2024-02-09T23:58:27.331213+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324223+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-09T23:58:28.324223+0000","last_peered":"2024-02-09T23:58:28.324223+0000","last_clean":"2024-02-09T23:58:28.324223+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-09T23:58:28.324223+0000","last_undegraded":"2024-02-09T23:58:28.324223+0000","last_fullsized":"2024-02-09T23:58:28.324223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352591+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-09T23:58:27.352591+0000","last_peered":"2024-02-09T23:58:27.352591+0000","last_clean":"2024-02-09T23:58:27.352591+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-09T23:58:27.352591+0000","last_undegraded":"2024-02-09T23:58:27.352591+0000","last_fullsized":"2024-02-09T23:58:27.352591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.323352+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:27.323352+0000","last_peered":"2024-02-09T23:58:27.323352+0000","last_clean":"2024-02-09T23:58:27.323352+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:27.323352+0000","last_undegraded":"2024-02-09T23:58:27.323352+0000","last_fullsized":"2024-02-09T23:58:27.323352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.389391+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-09T23:58:29.389391+0000","last_peered":"2024-02-09T23:58:29.389391+0000","last_clean":"2024-02-09T23:58:29.389391+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-09T23:58:29.389391+0000","last_undegraded":"2024-02-09T23:58:29.389391+0000","last_fullsized":"2024-02-09T23:58:29.389391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357319+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-09T23:58:27.357319+0000","last_peered":"2024-02-09T23:58:27.357319+0000","last_clean":"2024-02-09T23:58:27.357319+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-09T23:58:27.357319+0000","last_undegraded":"2024-02-09T23:58:27.357319+0000","last_fullsized":"2024-02-09T23:58:27.357319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.314672+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:27.314672+0000","last_peered":"2024-02-09T23:58:27.314672+0000","last_clean":"2024-02-09T23:58:27.314672+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:27.314672+0000","last_undegraded":"2024-02-09T23:58:27.314672+0000","last_fullsized":"2024-02-09T23:58:27.314672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.765383+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-09T23:58:28.765383+0000","last_peered":"2024-02-09T23:58:28.765383+0000","last_clean":"2024-02-09T23:58:28.765383+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-09T23:58:28.765383+0000","last_undegraded":"2024-02-09T23:58:28.765383+0000","last_fullsized":"2024-02-09T23:58:28.765383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356883+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-09T23:58:27.356883+0000","last_peered":"2024-02-09T23:58:27.356883+0000","last_clean":"2024-02-09T23:58:27.356883+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-09T23:58:27.356883+0000","last_undegraded":"2024-02-09T23:58:27.356883+0000","last_fullsized":"2024-02-09T23:58:27.356883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.319295+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:27.319295+0000","last_peered":"2024-02-09T23:58:27.319295+0000","last_clean":"2024-02-09T23:58:27.319295+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:27.319295+0000","last_undegraded":"2024-02-09T23:58:27.319295+0000","last_fullsized":"2024-02-09T23:58:27.319295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.316863+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:27.316863+0000","last_peered":"2024-02-09T23:58:27.316863+0000","last_clean":"2024-02-09T23:58:27.316863+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:27.316863+0000","last_undegraded":"2024-02-09T23:58:27.316863+0000","last_fullsized":"2024-02-09T23:58:27.316863+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320951+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-09T23:58:27.320951+0000","last_peered":"2024-02-09T23:58:27.320951+0000","last_clean":"2024-02-09T23:58:27.320951+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-09T23:58:27.320951+0000","last_undegraded":"2024-02-09T23:58:27.320951+0000","last_fullsized":"2024-02-09T23:58:27.320951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356758+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-09T23:58:27.356758+0000","last_peered":"2024-02-09T23:58:27.356758+0000","last_clean":"2024-02-09T23:58:27.356758+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-09T23:58:27.356758+0000","last_undegraded":"2024-02-09T23:58:27.356758+0000","last_fullsized":"2024-02-09T23:58:27.356758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.318145+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:27.318145+0000","last_peered":"2024-02-09T23:58:27.318145+0000","last_clean":"2024-02-09T23:58:27.318145+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:27.318145+0000","last_undegraded":"2024-02-09T23:58:27.318145+0000","last_fullsized":"2024-02-09T23:58:27.318145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.324007+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-09T23:58:28.324007+0000","last_peered":"2024-02-09T23:58:28.324007+0000","last_clean":"2024-02-09T23:58:28.324007+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-09T23:58:28.324007+0000","last_undegraded":"2024-02-09T23:58:28.324007+0000","last_fullsized":"2024-02-09T23:58:28.324007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.345678+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-09T23:58:27.345678+0000","last_peered":"2024-02-09T23:58:27.345678+0000","last_clean":"2024-02-09T23:58:27.345678+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-09T23:58:27.345678+0000","last_undegraded":"2024-02-09T23:58:27.345678+0000","last_fullsized":"2024-02-09T23:58:27.345678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.320229+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:27.320229+0000","last_peered":"2024-02-09T23:58:27.320229+0000","last_clean":"2024-02-09T23:58:27.320229+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:27.320229+0000","last_undegraded":"2024-02-09T23:58:27.320229+0000","last_fullsized":"2024-02-09T23:58:27.320229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.330957+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-09T23:58:27.330957+0000","last_peered":"2024-02-09T23:58:27.330957+0000","last_clean":"2024-02-09T23:58:27.330957+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-09T23:58:27.330957+0000","last_undegraded":"2024-02-09T23:58:27.330957+0000","last_fullsized":"2024-02-09T23:58:27.330957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.339496+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-09T23:58:27.339496+0000","last_peered":"2024-02-09T23:58:27.339496+0000","last_clean":"2024-02-09T23:58:27.339496+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-09T23:58:27.339496+0000","last_undegraded":"2024-02-09T23:58:27.339496+0000","last_fullsized":"2024-02-09T23:58:27.339496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.387255+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-09T23:58:29.387255+0000","last_peered":"2024-02-09T23:58:29.387255+0000","last_clean":"2024-02-09T23:58:29.387255+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-09T23:58:29.387255+0000","last_undegraded":"2024-02-09T23:58:29.387255+0000","last_fullsized":"2024-02-09T23:58:29.387255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337306+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:27.337306+0000","last_peered":"2024-02-09T23:58:27.337306+0000","last_clean":"2024-02-09T23:58:27.337306+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:27.337306+0000","last_undegraded":"2024-02-09T23:58:27.337306+0000","last_fullsized":"2024-02-09T23:58:27.337306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356834+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-09T23:58:27.356834+0000","last_peered":"2024-02-09T23:58:27.356834+0000","last_clean":"2024-02-09T23:58:27.356834+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-09T23:58:27.356834+0000","last_undegraded":"2024-02-09T23:58:27.356834+0000","last_fullsized":"2024-02-09T23:58:27.356834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.317100+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:27.317100+0000","last_peered":"2024-02-09T23:58:27.317100+0000","last_clean":"2024-02-09T23:58:27.317100+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:27.317100+0000","last_undegraded":"2024-02-09T23:58:27.317100+0000","last_fullsized":"2024-02-09T23:58:27.317100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:28.325268+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-09T23:58:28.325268+0000","last_peered":"2024-02-09T23:58:28.325268+0000","last_clean":"2024-02-09T23:58:28.325268+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-09T23:58:28.325268+0000","last_undegraded":"2024-02-09T23:58:28.325268+0000","last_fullsized":"2024-02-09T23:58:28.325268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334225+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-09T23:58:27.334225+0000","last_peered":"2024-02-09T23:58:27.334225+0000","last_clean":"2024-02-09T23:58:27.334225+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-09T23:58:27.334225+0000","last_undegraded":"2024-02-09T23:58:27.334225+0000","last_fullsized":"2024-02-09T23:58:27.334225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-09T23:58:29.390822+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-09T23:58:29.390822+0000","last_peered":"2024-02-09T23:58:29.390822+0000","last_clean":"2024-02-09T23:58:29.390822+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-09T23:58:29.390822+0000","last_undegraded":"2024-02-09T23:58:29.390822+0000","last_fullsized":"2024-02-09T23:58:29.390822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357559+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-09T23:58:27.357559+0000","last_peered":"2024-02-09T23:58:27.357559+0000","last_clean":"2024-02-09T23:58:27.357559+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-09T23:58:27.357559+0000","last_undegraded":"2024-02-09T23:58:27.357559+0000","last_fullsized":"2024-02-09T23:58:27.357559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.352295+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-09T23:58:27.352295+0000","last_peered":"2024-02-09T23:58:27.352295+0000","last_clean":"2024-02-09T23:58:27.352295+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-09T23:58:27.352295+0000","last_undegraded":"2024-02-09T23:58:27.352295+0000","last_fullsized":"2024-02-09T23:58:27.352295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.332903+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-09T23:58:27.332903+0000","last_peered":"2024-02-09T23:58:27.332903+0000","last_clean":"2024-02-09T23:58:27.332903+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-09T23:58:27.332903+0000","last_undegraded":"2024-02-09T23:58:27.332903+0000","last_fullsized":"2024-02-09T23:58:27.332903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.340185+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-09T23:58:27.340185+0000","last_peered":"2024-02-09T23:58:27.340185+0000","last_clean":"2024-02-09T23:58:27.340185+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-09T23:58:27.340185+0000","last_undegraded":"2024-02-09T23:58:27.340185+0000","last_fullsized":"2024-02-09T23:58:27.340185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334290+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-09T23:58:27.334290+0000","last_peered":"2024-02-09T23:58:27.334290+0000","last_clean":"2024-02-09T23:58:27.334290+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-09T23:58:27.334290+0000","last_undegraded":"2024-02-09T23:58:27.334290+0000","last_fullsized":"2024-02-09T23:58:27.334290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.337567+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-09T23:58:27.337567+0000","last_peered":"2024-02-09T23:58:27.337567+0000","last_clean":"2024-02-09T23:58:27.337567+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-09T23:58:27.337567+0000","last_undegraded":"2024-02-09T23:58:27.337567+0000","last_fullsized":"2024-02-09T23:58:27.337567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.334061+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-09T23:58:27.334061+0000","last_peered":"2024-02-09T23:58:27.334061+0000","last_clean":"2024-02-09T23:58:27.334061+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-09T23:58:27.334061+0000","last_undegraded":"2024-02-09T23:58:27.334061+0000","last_fullsized":"2024-02-09T23:58:27.334061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.353922+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-09T23:58:27.353922+0000","last_peered":"2024-02-09T23:58:27.353922+0000","last_clean":"2024-02-09T23:58:27.353922+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-09T23:58:27.353922+0000","last_undegraded":"2024-02-09T23:58:27.353922+0000","last_fullsized":"2024-02-09T23:58:27.353922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.348660+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-09T23:58:27.348660+0000","last_peered":"2024-02-09T23:58:27.348660+0000","last_clean":"2024-02-09T23:58:27.348660+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-09T23:58:27.348660+0000","last_undegraded":"2024-02-09T23:58:27.348660+0000","last_fullsized":"2024-02-09T23:58:27.348660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.357729+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-09T23:58:27.357729+0000","last_peered":"2024-02-09T23:58:27.357729+0000","last_clean":"2024-02-09T23:58:27.357729+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-09T23:58:27.357729+0000","last_undegraded":"2024-02-09T23:58:27.357729+0000","last_fullsized":"2024-02-09T23:58:27.357729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.354758+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-09T23:58:27.354758+0000","last_peered":"2024-02-09T23:58:27.354758+0000","last_clean":"2024-02-09T23:58:27.354758+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-09T23:58:27.354758+0000","last_undegraded":"2024-02-09T23:58:27.354758+0000","last_fullsized":"2024-02-09T23:58:27.354758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.333673+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-09T23:58:27.333673+0000","last_peered":"2024-02-09T23:58:27.333673+0000","last_clean":"2024-02-09T23:58:27.333673+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-09T23:58:27.333673+0000","last_undegraded":"2024-02-09T23:58:27.333673+0000","last_fullsized":"2024-02-09T23:58:27.333673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356759+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-09T23:58:27.356759+0000","last_peered":"2024-02-09T23:58:27.356759+0000","last_clean":"2024-02-09T23:58:27.356759+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-09T23:58:27.356759+0000","last_undegraded":"2024-02-09T23:58:27.356759+0000","last_fullsized":"2024-02-09T23:58:27.356759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-09T23:58:27.356963+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-09T23:58:27.356963+0000","last_peered":"2024-02-09T23:58:27.356963+0000","last_clean":"2024-02-09T23:58:27.356963+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-09T23:58:27.356963+0000","last_undegraded":"2024-02-09T23:58:27.356963+0000","last_fullsized":"2024-02-09T23:58:27.356963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}]}} 2024-02-09T23:58:34.554 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-09T23:58:34.554 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-09T23:58:34.554 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-09T23:58:34.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-09T23:58:34.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.691+0000 7f55b3e35700 1 Processor -- start 2024-02-09T23:58:34.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.691+0000 7f55b3e35700 1 -- start start 2024-02-09T23:58:34.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b3e35700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55ac136210 0x7f55ac05bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b3e35700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b3e35700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac05b970 con 0x7f55ac136bf0 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b3e35700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac05d590 con 0x7f55ac136210 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b3e35700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac136710 con 0x7f55ac13eb70 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55ac136210 0x7f55ac05bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b23d2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55ac136210 0x7f55ac05bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54504/0 (socket says 172.21.15.89:54504) 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b23d2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39928/0 (socket says 172.21.15.89:39928) 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 -- 172.21.15.89:0/3855754370 learned_addr learned my addr 172.21.15.89:0/3855754370 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b1bd1700 1 --1- 172.21.15.89:0/3855754370 >> v1:172.21.15.89:6789/0 conn(0x7f55ac136bf0 0x7f55ac05ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40270/0 (socket says 172.21.15.89:40270) 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 -- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 msgr2=0x7f55ac140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 -- 172.21.15.89:0/3855754370 >> v1:172.21.15.89:6789/0 conn(0x7f55ac136bf0 legacy=0x7f55ac05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 -- 172.21.15.89:0/3855754370 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac1369d0 con 0x7f55ac136210 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b0bcf700 1 -- 172.21.15.89:0/3855754370 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594031912 0 0) 0x7f55ac05b970 con 0x7f55ac136bf0 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b23d2700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b13d0700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac05bde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f55a8002f70 tx=0x7f55a8006eb0).ready entity=mon.0 client_cookie=4095daf65a5e75f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b0bcf700 1 -- 172.21.15.89:0/3855754370 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a800d570 con 0x7f55ac136210 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b0bcf700 1 -- 172.21.15.89:0/3855754370 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8000e90 con 0x7f55ac136210 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.692+0000 7f55b0bcf700 1 -- 172.21.15.89:0/3855754370 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a800d8c0 con 0x7f55ac136210 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 -- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 msgr2=0x7f55ac05bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac05bde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f55a8002f70 tx=0x7f55a8006eb0).stop 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 -- 172.21.15.89:0/3855754370 shutdown_connections 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac13eb70 0x7f55ac140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3855754370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac05bde0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 -- 172.21.15.89:0/3855754370 >> 172.21.15.89:0/3855754370 conn(0x7f55ac066a50 msgr2=0x7f55ac06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 -- 172.21.15.89:0/3855754370 shutdown_connections 2024-02-09T23:58:34.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.693+0000 7f55b3e35700 1 -- 172.21.15.89:0/3855754370 wait complete. 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 Processor -- start 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 -- start start 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac0a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55ac13eb70 0x7f55ac149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac13dbd0 con 0x7f55ac136210 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac13c6c0 con 0x7f55ac13eb70 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.694+0000 7f55b3e35700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac13c980 con 0x7f55ac136bf0 2024-02-09T23:58:34.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b23d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55ac13eb70 0x7f55ac149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39940/0 (socket says 172.21.15.89:39940) 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 -- 172.21.15.89:0/3682241959 learned_addr learned my addr 172.21.15.89:0/3682241959 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b1bd1700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac0a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 -- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55ac13eb70 msgr2=0x7f55ac149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55ac13eb70 0x7f55ac149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 -- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 msgr2=0x7f55ac0a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac0a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 -- 172.21.15.89:0/3682241959 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009470 con 0x7f55ac136bf0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b13d0700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f55ac13a380 tx=0x7f55a8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a80117e0 con 0x7f55ac136bf0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8011940 con 0x7f55ac136bf0 2024-02-09T23:58:34.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a800b1e0 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a8011ca0 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.695+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac13bec0 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.696+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f55a8025030 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.696+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f55a804bb30 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.696+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac060150 con 0x7f55ac136bf0 2024-02-09T23:58:34.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.699+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f55a8023020 con 0x7f55ac136bf0 2024-02-09T23:58:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.847+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55ac057a60 con 0x7f55ac136bf0 2024-02-09T23:58:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.847+0000 7f559affd700 1 -- 172.21.15.89:0/3682241959 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f55a8023030 con 0x7f55ac136bf0 2024-02-09T23:58:34.850 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.848+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 >> v1:172.21.15.89:6816/39389 conn(0x7f558c038ec0 legacy=0x7f558c03b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.848+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 msgr2=0x7f55ac149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.848+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f55ac13a380 tx=0x7f55a8015000).stop 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 shutdown_connections 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55ac13eb70 0x7f55ac149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ac136210 0x7f55ac0a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 --2- 172.21.15.89:0/3682241959 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f55ac136bf0 0x7f55ac149430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 >> 172.21.15.89:0/3682241959 conn(0x7f55ac066a50 msgr2=0x7f55ac0ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 shutdown_connections 2024-02-09T23:58:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.849+0000 7f55b3e35700 1 -- 172.21.15.89:0/3682241959 wait complete. 2024-02-09T23:58:34.861 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-09T23:58:34.861 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-09T23:58:34.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.962+0000 7fc179e59700 1 Processor -- start 2024-02-09T23:58:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.962+0000 7fc179e59700 1 -- start start 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.962+0000 7fc179e59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 0x7fc17405cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc179e59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 0x7fc1741409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc179e59700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc174136080 con 0x7fc17405d5d0 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc179e59700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740a9e20 con 0x7fc1740ac780 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc179e59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174136340 con 0x7fc17413e5c0 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1737fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 0x7fc17405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 0x7fc1741409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc172ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc17405d5d0 0x7fc1740a9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40280/0 (socket says 172.21.15.89:40280) 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc172ffd700 1 -- 172.21.15.89:0/4005312904 learned_addr learned my addr 172.21.15.89:0/4005312904 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 -- 172.21.15.89:0/4005312904 >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 msgr2=0x7fc17405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 --2- 172.21.15.89:0/4005312904 >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 0x7fc17405cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 -- 172.21.15.89:0/4005312904 >> v1:172.21.15.89:6789/0 conn(0x7fc17405d5d0 legacy=0x7fc1740a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 -- 172.21.15.89:0/4005312904 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740a7880 con 0x7fc17413e5c0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1727fc700 1 -- 172.21.15.89:0/4005312904 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595214404 0 0) 0x7fc174136080 con 0x7fc17405d5d0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1737fe700 1 --2- 172.21.15.89:0/4005312904 >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 0x7fc17405cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc173fff700 1 --2- 172.21.15.89:0/4005312904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 0x7fc1741409b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc1740a9f60 tx=0x7fc164006df0).ready entity=mon.1 client_cookie=3b4cc6b3ede04c28 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1727fc700 1 -- 172.21.15.89:0/4005312904 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16400d570 con 0x7fc17413e5c0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1727fc700 1 -- 172.21.15.89:0/4005312904 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164000e90 con 0x7fc17413e5c0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.963+0000 7fc1727fc700 1 -- 172.21.15.89:0/4005312904 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16400d8c0 con 0x7fc17413e5c0 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 -- 172.21.15.89:0/4005312904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 msgr2=0x7fc1741409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 --2- 172.21.15.89:0/4005312904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 0x7fc1741409b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc1740a9f60 tx=0x7fc164006df0).stop 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 -- 172.21.15.89:0/4005312904 shutdown_connections 2024-02-09T23:58:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 --2- 172.21.15.89:0/4005312904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17413e5c0 0x7fc1741409b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 --2- 172.21.15.89:0/4005312904 >> v2:172.21.15.89:3300/0 conn(0x7fc1740ac780 0x7fc17405cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 -- 172.21.15.89:0/4005312904 >> 172.21.15.89:0/4005312904 conn(0x7fc174067790 msgr2=0x7fc174067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 -- 172.21.15.89:0/4005312904 shutdown_connections 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.964+0000 7fc179e59700 1 -- 172.21.15.89:0/4005312904 wait complete. 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 Processor -- start 2024-02-09T23:58:34.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 -- start start 2024-02-09T23:58:34.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 0x7fc174133b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 0x7fc174133ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:34.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174132bc0 con 0x7fc1740ac780 2024-02-09T23:58:34.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17413b7a0 con 0x7fc17405d5d0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc179e59700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17413ba40 con 0x7fc17413e5c0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.965+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54316/0 (socket says 172.21.15.89:54316) 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc1737fe700 1 -- 172.21.15.89:0/2259213416 learned_addr learned my addr 172.21.15.89:0/2259213416 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 0x7fc174133ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc172ffd700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 0x7fc174133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 -- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 msgr2=0x7fc174134f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 -- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 msgr2=0x7fc174133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 0x7fc174133b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 -- 172.21.15.89:0/2259213416 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16800b180 con 0x7fc17413e5c0 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc1737fe700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc172ffd700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 0x7fc174133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:34.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc173fff700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 0x7fc174133ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc1740a9f60 tx=0x7fc164014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164013de0 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164002f70 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16400b180 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16401e5f0 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.966+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174130450 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.967+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc164025030 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.967+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc174132d30 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.967+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc16404b440 con 0x7fc17413e5c0 2024-02-09T23:58:34.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:34.970+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc174132d30 con 0x7fc17413e5c0 2024-02-09T23:58:35.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.083+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc174132d30 con 0x7fc17413e5c0 2024-02-09T23:58:35.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.083+0000 7fc170ff9700 1 -- 172.21.15.89:0/2259213416 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fc174132d30 con 0x7fc17413e5c0 2024-02-09T23:58:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:35.086 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:35.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 >> v1:172.21.15.89:6816/39389 conn(0x7fc154038e30 legacy=0x7fc15403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 msgr2=0x7fc174133ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 0x7fc174133ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc1740a9f60 tx=0x7fc164014000).stop 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 shutdown_connections 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc17413e5c0 0x7fc174133ff0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc17405d5d0 0x7fc174134f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 --2- 172.21.15.89:0/2259213416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740ac780 0x7fc174133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 >> 172.21.15.89:0/2259213416 conn(0x7fc174067790 msgr2=0x7fc17412f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 shutdown_connections 2024-02-09T23:58:35.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.085+0000 7fc179e59700 1 -- 172.21.15.89:0/2259213416 wait complete. 2024-02-09T23:58:35.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-09T23:58:35.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-09T23:58:35.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 Processor -- start 2024-02-09T23:58:35.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 -- start start 2024-02-09T23:58:35.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd934139f20 0x7fd9340a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 0x7fd934140af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd934139390 con 0x7fd934139b40 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340a68f0 con 0x7fd934139f20 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd93359e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340a75c0 con 0x7fd93413e700 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd932d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 0x7fd934140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.200+0000 7fd931d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd934139f20 0x7fd9340a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93259c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd934139b40 0x7fd934066290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40294/0 (socket says 172.21.15.89:40294) 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93259c700 1 -- 172.21.15.89:0/2456966256 learned_addr learned my addr 172.21.15.89:0/2456966256 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd931d9b700 1 -- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 msgr2=0x7fd934140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd931d9b700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 0x7fd934140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd931d9b700 1 -- 172.21.15.89:0/2456966256 >> v1:172.21.15.89:6789/0 conn(0x7fd934139b40 legacy=0x7fd934066290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd931d9b700 1 -- 172.21.15.89:0/2456966256 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9341395c0 con 0x7fd934139f20 2024-02-09T23:58:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd932d9d700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 0x7fd934140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd931d9b700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd9340a70d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd928002f70 tx=0x7fd928006df0).ready entity=mon.0 client_cookie=7536f0b9ff12843e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93159a700 1 -- 172.21.15.89:0/2456966256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92800d570 con 0x7fd934139f20 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93159a700 1 -- 172.21.15.89:0/2456966256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd928000e90 con 0x7fd934139f20 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93159a700 1 -- 172.21.15.89:0/2456966256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92800d8c0 con 0x7fd934139f20 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93359e700 1 -- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 msgr2=0x7fd9340a70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.201+0000 7fd93359e700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd9340a70d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd928002f70 tx=0x7fd928006df0).stop 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 -- 172.21.15.89:0/2456966256 shutdown_connections 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd93413e700 0x7fd934140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 --2- 172.21.15.89:0/2456966256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd9340a70d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 -- 172.21.15.89:0/2456966256 >> 172.21.15.89:0/2456966256 conn(0x7fd9340608d0 msgr2=0x7fd9340a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 -- 172.21.15.89:0/2456966256 shutdown_connections 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 -- 172.21.15.89:0/2456966256 wait complete. 2024-02-09T23:58:35.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 Processor -- start 2024-02-09T23:58:35.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.202+0000 7fd93359e700 1 -- start start 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd93413e700 0x7fd934136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340929a0 con 0x7fd934139f20 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93409c080 con 0x7fd93413e700 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93359e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340a1010 con 0x7fd934139b40 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93259c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93259c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39972/0 (socket says 172.21.15.89:39972) 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93259c700 1 -- 172.21.15.89:0/376982053 learned_addr learned my addr 172.21.15.89:0/376982053 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54560/0 (socket says 172.21.15.89:54560) 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd932d9d700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd93413e700 0x7fd934136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 -- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 msgr2=0x7fd9340a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 -- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd93413e700 msgr2=0x7fd934136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd93413e700 0x7fd934136880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd931d9b700 1 -- 172.21.15.89:0/376982053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c009470 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.203+0000 7fd93259c700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd931d9b700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd928002f70 tx=0x7fd928014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd928013e50 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92801e400 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92800b180 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92801e760 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9340a1580 con 0x7fd934139f20 2024-02-09T23:58:35.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.204+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd928025030 con 0x7fd934139f20 2024-02-09T23:58:35.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.205+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd92804b540 con 0x7fd934139f20 2024-02-09T23:58:35.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.205+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340669a0 con 0x7fd934139f20 2024-02-09T23:58:35.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.208+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd928028610 con 0x7fd934139f20 2024-02-09T23:58:35.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.317+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd9340a3e30 con 0x7fd934139f20 2024-02-09T23:58:35.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.317+0000 7fd9237fe700 1 -- 172.21.15.89:0/376982053 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd928006df0 con 0x7fd934139f20 2024-02-09T23:58:35.320 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 >> v1:172.21.15.89:6816/39389 conn(0x7fd910038da0 legacy=0x7fd91003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 msgr2=0x7fd934136390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd928002f70 tx=0x7fd928014000).stop 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 shutdown_connections 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd93413e700 0x7fd934136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd934139b40 0x7fd9340a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.318+0000 7fd93359e700 1 --2- 172.21.15.89:0/376982053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934139f20 0x7fd934136390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.319+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 >> 172.21.15.89:0/376982053 conn(0x7fd9340608d0 msgr2=0x7fd9340a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.319+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 shutdown_connections 2024-02-09T23:58:35.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.319+0000 7fd93359e700 1 -- 172.21.15.89:0/376982053 wait complete. 2024-02-09T23:58:35.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-09T23:58:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 Processor -- start 2024-02-09T23:58:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 -- start start 2024-02-09T23:58:35.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 0x7fec6813e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec68063a70 con 0x7fec680650c0 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec680649c0 con 0x7fec6813c420 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.437+0000 7fec6fd1f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec68064bc0 con 0x7fec68137860 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6dabb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 0x7fec6813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6d2ba700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fec680650c0 0x7fec680630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40304/0 (socket says 172.21.15.89:40304) 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6d2ba700 1 -- 172.21.15.89:0/548780315 learned_addr learned my addr 172.21.15.89:0/548780315 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 -- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 msgr2=0x7fec68137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 -- 172.21.15.89:0/548780315 >> v1:172.21.15.89:6789/0 conn(0x7fec680650c0 legacy=0x7fec680630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6cab9700 1 -- 172.21.15.89:0/548780315 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038089940 0 0) 0x7fec68063a70 con 0x7fec680650c0 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 -- 172.21.15.89:0/548780315 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680ab0d0 con 0x7fec6813c420 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6dabb700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6e2bc700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 0x7fec6813e810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec600032f0 tx=0x7fec600091d0).ready entity=mon.1 client_cookie=9d5e6d4a4f3b2400 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6cab9700 1 -- 172.21.15.89:0/548780315 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6000b6c0 con 0x7fec6813c420 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6cab9700 1 -- 172.21.15.89:0/548780315 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6000b820 con 0x7fec6813c420 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.438+0000 7fec6cab9700 1 -- 172.21.15.89:0/548780315 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6000b990 con 0x7fec6813c420 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 -- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 msgr2=0x7fec6813e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 0x7fec6813e810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec600032f0 tx=0x7fec600091d0).stop 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 -- 172.21.15.89:0/548780315 shutdown_connections 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec6813c420 0x7fec6813e810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/548780315 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 -- 172.21.15.89:0/548780315 >> 172.21.15.89:0/548780315 conn(0x7fec6805c300 msgr2=0x7fec6806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 -- 172.21.15.89:0/548780315 shutdown_connections 2024-02-09T23:58:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.439+0000 7fec6fd1f700 1 -- 172.21.15.89:0/548780315 wait complete. 2024-02-09T23:58:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 Processor -- start 2024-02-09T23:58:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 -- start start 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 0x7fec681322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 0x7fec68146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6813afe0 con 0x7fec6813c420 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6813a0f0 con 0x7fec680650c0 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6fd1f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6813a3b0 con 0x7fec68137860 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6dabb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 0x7fec681322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6dabb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 0x7fec681322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54340/0 (socket says 172.21.15.89:54340) 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6e2bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 0x7fec68146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6dabb700 1 -- 172.21.15.89:0/651107467 learned_addr learned my addr 172.21.15.89:0/651107467 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6d2ba700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6d2ba700 1 -- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 msgr2=0x7fec681322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6d2ba700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 0x7fec681322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6d2ba700 1 -- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 msgr2=0x7fec68146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.440+0000 7fec6d2ba700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 0x7fec68146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec6d2ba700 1 -- 172.21.15.89:0/651107467 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6400b180 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec6e2bc700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 0x7fec68146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec6d2ba700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68146980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec58000bc0 tx=0x7fec580079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800cdd0 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580070d0 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60009470 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec58007430 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.441+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68131120 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.442+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec58010070 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.442+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fec58049bd0 con 0x7fec68137860 2024-02-09T23:58:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.442+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6813b150 con 0x7fec68137860 2024-02-09T23:58:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.445+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec6813b150 con 0x7fec68137860 2024-02-09T23:58:35.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.554+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec6813b150 con 0x7fec68137860 2024-02-09T23:58:35.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.555+0000 7fec56ffd700 1 -- 172.21.15.89:0/651107467 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec6813b150 con 0x7fec68137860 2024-02-09T23:58:35.557 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-09T23:58:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 >> v1:172.21.15.89:6816/39389 conn(0x7fec48038da0 legacy=0x7fec4803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 msgr2=0x7fec68146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68146980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec58000bc0 tx=0x7fec580079e0).stop 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 shutdown_connections 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6813c420 0x7fec68146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680650c0 0x7fec681322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 --2- 172.21.15.89:0/651107467 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fec68137860 0x7fec68146980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 >> 172.21.15.89:0/651107467 conn(0x7fec6805c300 msgr2=0x7fec681365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 shutdown_connections 2024-02-09T23:58:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.556+0000 7fec6fd1f700 1 -- 172.21.15.89:0/651107467 wait complete. 2024-02-09T23:58:35.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-09T23:58:35.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.671+0000 7fa2b8dd0700 1 Processor -- start 2024-02-09T23:58:35.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.671+0000 7fa2b8dd0700 1 -- start start 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b8dd0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2b4064700 0x7fa2b40621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b8dd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b8dd0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b409bc50 con 0x7fa2b409aa10 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b8dd0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b41365f0 con 0x7fa2b4064700 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b8dd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b409b2e0 con 0x7fa2b4136140 2024-02-09T23:58:35.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2b4064700 0x7fa2b40621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b2d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2b4064700 0x7fa2b40621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54578/0 (socket says 172.21.15.89:54578) 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b2d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54348/0 (socket says 172.21.15.89:54348) 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1021014153 learned_addr learned my addr 172.21.15.89:0/1021014153 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b259c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa2b409aa10 0x7fa2b4132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40316/0 (socket says 172.21.15.89:40316) 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 msgr2=0x7fa2b409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1021014153 >> v1:172.21.15.89:6789/0 conn(0x7fa2b409aa10 legacy=0x7fa2b4132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1021014153 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b41367e0 con 0x7fa2b4064700 2024-02-09T23:58:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b159a700 1 -- 172.21.15.89:0/1021014153 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286207285 0 0) 0x7fa2b409bc50 con 0x7fa2b409aa10 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b2d9d700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.672+0000 7fa2b1d9b700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b40621e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2a4002f70 tx=0x7fa2a4006e50).ready entity=mon.0 client_cookie=98eef8367e1a0bab server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b159a700 1 -- 172.21.15.89:0/1021014153 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a400d5c0 con 0x7fa2b4064700 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b159a700 1 -- 172.21.15.89:0/1021014153 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a4000e90 con 0x7fa2b4064700 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b159a700 1 -- 172.21.15.89:0/1021014153 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a400d910 con 0x7fa2b4064700 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 msgr2=0x7fa2b40621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b40621e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2a4002f70 tx=0x7fa2a4006e50).stop 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1021014153 shutdown_connections 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b4136140 0x7fa2b409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1021014153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b40621e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1021014153 >> 172.21.15.89:0/1021014153 conn(0x7fa2b406c0c0 msgr2=0x7fa2b406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1021014153 shutdown_connections 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.673+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1021014153 wait complete. 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.674+0000 7fa2b8dd0700 1 Processor -- start 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.674+0000 7fa2b8dd0700 1 -- start start 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b4093510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa2b4136140 0x7fa2b4144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4098660 con 0x7fa2b4064700 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40930e0 con 0x7fa2b409aa10 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4066430 con 0x7fa2b4136140 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54360/0 (socket says 172.21.15.89:54360) 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1094404963 learned_addr learned my addr 172.21.15.89:0/1094404963 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b2d9d700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa2b4136140 0x7fa2b4144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b259c700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b4093510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa2b4136140 msgr2=0x7fa2b4144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa2b4136140 0x7fa2b4144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 msgr2=0x7fa2b4093510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b4093510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 -- 172.21.15.89:0/1094404963 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac00b710 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b259c700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b4093510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b1d9b700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa2a4002f70 tx=0x7fa2a4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a4006850 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a401e400 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a400b1e0 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a401e760 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.675+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b4094dc0 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.676+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa2a4025030 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.676+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa2a404b790 con 0x7fa2b409aa10 2024-02-09T23:58:35.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.676+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b4136aa0 con 0x7fa2b409aa10 2024-02-09T23:58:35.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.679+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa2a4028830 con 0x7fa2b409aa10 2024-02-09T23:58:35.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.789+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2b4057a60 con 0x7fa2b409aa10 2024-02-09T23:58:35.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.790+0000 7fa2a37fe700 1 -- 172.21.15.89:0/1094404963 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2a401e8c0 con 0x7fa2b409aa10 2024-02-09T23:58:35.792 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 >> v1:172.21.15.89:6816/39389 conn(0x7fa290038dd0 legacy=0x7fa29003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 msgr2=0x7fa2b41448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa2a4002f70 tx=0x7fa2a4014000).stop 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 shutdown_connections 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa2b4136140 0x7fa2b4144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2b4064700 0x7fa2b4093510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 --2- 172.21.15.89:0/1094404963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2b409aa10 0x7fa2b41448c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 >> 172.21.15.89:0/1094404963 conn(0x7fa2b406c0c0 msgr2=0x7fa2b406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 shutdown_connections 2024-02-09T23:58:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.791+0000 7fa2b8dd0700 1 -- 172.21.15.89:0/1094404963 wait complete. 2024-02-09T23:58:35.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-09T23:58:35.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.910+0000 7fc81d7a4700 1 Processor -- start 2024-02-09T23:58:35.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.910+0000 7fc81d7a4700 1 -- start start 2024-02-09T23:58:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc81d7a4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc818136bf0 0x7fc81805bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc81d7a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc81d7a4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81805b970 con 0x7fc81805d370 2024-02-09T23:58:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc81d7a4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc818136710 con 0x7fc818136bf0 2024-02-09T23:58:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc81d7a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181369d0 con 0x7fc818136210 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc8167fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc8167fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54376/0 (socket says 172.21.15.89:54376) 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc818136bf0 0x7fc81805bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc8167fc700 1 -- 172.21.15.89:0/3039003481 learned_addr learned my addr 172.21.15.89:0/3039003481 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc8177fe700 1 --1- 172.21.15.89:0/3039003481 >> v1:172.21.15.89:6789/0 conn(0x7fc81805d370 0x7fc8181397e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40324/0 (socket says 172.21.15.89:40324) 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 -- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 msgr2=0x7fc81805ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 -- 172.21.15.89:0/3039003481 >> v1:172.21.15.89:6789/0 conn(0x7fc81805d370 legacy=0x7fc8181397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc815ffb700 1 -- 172.21.15.89:0/3039003481 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841964650 0 0) 0x7fc81805b970 con 0x7fc81805d370 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 -- 172.21.15.89:0/3039003481 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818136fd0 con 0x7fc818136bf0 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc8167fc700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc816ffd700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136bf0 0x7fc81805bde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc80c002f70 tx=0x7fc80c006df0).ready entity=mon.0 client_cookie=b23ee29fb427e4a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.911+0000 7fc815ffb700 1 -- 172.21.15.89:0/3039003481 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80c00d570 con 0x7fc818136bf0 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc815ffb700 1 -- 172.21.15.89:0/3039003481 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c000e90 con 0x7fc818136bf0 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc815ffb700 1 -- 172.21.15.89:0/3039003481 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80c00d8c0 con 0x7fc818136bf0 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 -- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136bf0 msgr2=0x7fc81805bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136bf0 0x7fc81805bde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc80c002f70 tx=0x7fc80c006df0).stop 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 -- 172.21.15.89:0/3039003481 shutdown_connections 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136bf0 0x7fc81805bde0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/3039003481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc818136210 0x7fc81805ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 -- 172.21.15.89:0/3039003481 >> 172.21.15.89:0/3039003481 conn(0x7fc818066a50 msgr2=0x7fc81806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 -- 172.21.15.89:0/3039003481 shutdown_connections 2024-02-09T23:58:35.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.912+0000 7fc81d7a4700 1 -- 172.21.15.89:0/3039003481 wait complete. 2024-02-09T23:58:35.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.913+0000 7fc81d7a4700 1 Processor -- start 2024-02-09T23:58:35.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.913+0000 7fc81d7a4700 1 -- start start 2024-02-09T23:58:35.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 0x7fc818149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc818136bf0 0x7fc818129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81812ba30 con 0x7fc818136210 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818139b00 con 0x7fc81805d370 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81814a040 con 0x7fc818136bf0 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc816ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 0x7fc818149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54604/0 (socket says 172.21.15.89:54604) 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 -- 172.21.15.89:0/637799493 learned_addr learned my addr 172.21.15.89:0/637799493 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc816ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 0x7fc818149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54380/0 (socket says 172.21.15.89:54380) 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 -- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc818136bf0 msgr2=0x7fc818129730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc818136bf0 0x7fc818129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 -- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 msgr2=0x7fc818149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 0x7fc818149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 -- 172.21.15.89:0/637799493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80800b1e0 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc8167fc700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc80800c000 tx=0x7fc808006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808012600 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808012760 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.914+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c00b180 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.915+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808012ac0 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.915+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81812c950 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.915+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc808022070 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.915+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818060150 con 0x7fc818136210 2024-02-09T23:58:35.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.916+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc80804ae00 con 0x7fc818136210 2024-02-09T23:58:35.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:35.918+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc808033690 con 0x7fc818136210 2024-02-09T23:58:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.027+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc818057a60 con 0x7fc818136210 2024-02-09T23:58:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.028+0000 7fc807fff700 1 -- 172.21.15.89:0/637799493 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc808033280 con 0x7fc818136210 2024-02-09T23:58:36.030 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-09T23:58:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 >> v1:172.21.15.89:6816/39389 conn(0x7fc7f4038da0 legacy=0x7fc7f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 msgr2=0x7fc818129240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc80800c000 tx=0x7fc808006eb0).stop 2024-02-09T23:58:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 shutdown_connections 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc818136bf0 0x7fc818129730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc81805d370 0x7fc818149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 --2- 172.21.15.89:0/637799493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc818136210 0x7fc818129240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 >> 172.21.15.89:0/637799493 conn(0x7fc818066a50 msgr2=0x7fc8180a8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 shutdown_connections 2024-02-09T23:58:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.029+0000 7fc81d7a4700 1 -- 172.21.15.89:0/637799493 wait complete. 2024-02-09T23:58:36.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:36.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.141+0000 7fb720da1700 1 Processor -- start 2024-02-09T23:58:36.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.141+0000 7fb720da1700 1 -- start start 2024-02-09T23:58:36.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.141+0000 7fb720da1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb71c09f010 0x7fb71c0a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.141+0000 7fb720da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb720da1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c09c8f0 con 0x7fb71c09f8e0 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb720da1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c09c5e0 con 0x7fb71c09f010 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb720da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0a1540 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb719d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb71c09f010 0x7fb71c0a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71ad9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb71c09f8e0 0x7fb71c0a3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40328/0 (socket says 172.21.15.89:40328) 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb719d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54396/0 (socket says 172.21.15.89:54396) 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb71c09f010 0x7fb71c0a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54620/0 (socket says 172.21.15.89:54620) 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71ad9d700 1 -- 172.21.15.89:0/2319177271 learned_addr learned my addr 172.21.15.89:0/2319177271 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 -- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 msgr2=0x7fb71c09f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 -- 172.21.15.89:0/2319177271 >> v1:172.21.15.89:6789/0 conn(0x7fb71c09f8e0 legacy=0x7fb71c0a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 -- 172.21.15.89:0/2319177271 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c09cb20 con 0x7fb71c09f010 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71959a700 1 -- 172.21.15.89:0/2319177271 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053283488 0 0) 0x7fb71c09c8f0 con 0x7fb71c09f8e0 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb719d9b700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71a59c700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f010 0x7fb71c0a1cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb71c0a0030 tx=0x7fb70c006df0).ready entity=mon.0 client_cookie=94572a85fbf74070 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71959a700 1 -- 172.21.15.89:0/2319177271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70c00d570 con 0x7fb71c09f010 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71959a700 1 -- 172.21.15.89:0/2319177271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c000e90 con 0x7fb71c09f010 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.142+0000 7fb71959a700 1 -- 172.21.15.89:0/2319177271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70c00d8c0 con 0x7fb71c09f010 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 -- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f010 msgr2=0x7fb71c0a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f010 0x7fb71c0a1cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb71c0a0030 tx=0x7fb70c006df0).stop 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 -- 172.21.15.89:0/2319177271 shutdown_connections 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f010 0x7fb71c0a1cb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 --2- 172.21.15.89:0/2319177271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c09f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 -- 172.21.15.89:0/2319177271 >> 172.21.15.89:0/2319177271 conn(0x7fb71c0a93f0 msgr2=0x7fb71c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 -- 172.21.15.89:0/2319177271 shutdown_connections 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.143+0000 7fb720da1700 1 -- 172.21.15.89:0/2319177271 wait complete. 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 Processor -- start 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 -- start start 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb71c09f010 0x7fb71c13d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c13c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c13c8b0 con 0x7fb71c09f8e0 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c146c80 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb720da1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c13d580 con 0x7fb71c09f010 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb719d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb71ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c13c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb719d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54636/0 (socket says 172.21.15.89:54636) 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb719d9b700 1 -- 172.21.15.89:0/3800389683 learned_addr learned my addr 172.21.15.89:0/3800389683 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.144+0000 7fb71a59c700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb71c09f010 0x7fb71c13d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 -- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb71c09f010 msgr2=0x7fb71c13d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb71c09f010 0x7fb71c13d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 -- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 msgr2=0x7fb71c13bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 -- 172.21.15.89:0/3800389683 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71000c310 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb719d9b700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb71ad9d700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c13c0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb714001250 tx=0x7fb714007d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb714005ba0 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714005d00 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c00b180 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb714004a90 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.145+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c13ab80 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.146+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb714004bf0 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.146+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb71404a1f0 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.146+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c057a60 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.149+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb71402f170 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.290+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb71c0a1210 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.290+0000 7fb70b7fe700 1 -- 172.21.15.89:0/3800389683 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2320 (secure 0 0 0) 0x7fb714032710 con 0x7fb71c0a4fa0 2024-02-09T23:58:36.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:36.293 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-09T23:58:30.373217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 >> v1:172.21.15.89:6816/39389 conn(0x7fb6f8038dd0 legacy=0x7fb6f803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 msgr2=0x7fb71c13c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c13c0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb714001250 tx=0x7fb714007d00).stop 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 shutdown_connections 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb71c0a4fa0 0x7fb71c13c0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb71c09f010 0x7fb71c13d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 --2- 172.21.15.89:0/3800389683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71c09f8e0 0x7fb71c13bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 >> 172.21.15.89:0/3800389683 conn(0x7fb71c0a93f0 msgr2=0x7fb71c0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 shutdown_connections 2024-02-09T23:58:36.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.291+0000 7fb720da1700 1 -- 172.21.15.89:0/3800389683 wait complete. 2024-02-09T23:58:36.295 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2024-02-09T23:58:36.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:36.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.405+0000 7f0e1123b700 1 Processor -- start 2024-02-09T23:58:36.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.405+0000 7f0e1123b700 1 -- start start 2024-02-09T23:58:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e1123b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e1123b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e0c13c420 0x7f0e0c13e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e1123b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c063a70 con 0x7f0e0c0650c0 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e1123b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c0649c0 con 0x7f0e0c13c420 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e1123b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c064bc0 con 0x7f0e0c137860 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40036/0 (socket says 172.21.15.89:40036) 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0ad9d700 1 -- 172.21.15.89:0/79850715 learned_addr learned my addr 172.21.15.89:0/79850715 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0b59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e0c13c420 0x7f0e0c13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0b59e700 1 -- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 msgr2=0x7f0e0c137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0b59e700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e0b59e700 1 -- 172.21.15.89:0/79850715 >> v1:172.21.15.89:6789/0 conn(0x7f0e0c0650c0 legacy=0x7f0e0c0630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e0b59e700 1 -- 172.21.15.89:0/79850715 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0ab0d0 con 0x7f0e0c13c420 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.406+0000 7f0e09d9b700 1 -- 172.21.15.89:0/79850715 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843566442 0 0) 0x7f0e0c063a70 con 0x7f0e0c0650c0 2024-02-09T23:58:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e0ad9d700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e0b59e700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c13c420 0x7f0e0c13e810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0e040032f0 tx=0x7f0e040091d0).ready entity=mon.0 client_cookie=a531597c0111087b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e09d9b700 1 -- 172.21.15.89:0/79850715 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400b6c0 con 0x7f0e0c13c420 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e09d9b700 1 -- 172.21.15.89:0/79850715 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400b820 con 0x7f0e0c13c420 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e09d9b700 1 -- 172.21.15.89:0/79850715 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400b990 con 0x7f0e0c13c420 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 -- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c13c420 msgr2=0x7f0e0c13e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c13c420 0x7f0e0c13e810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0e040032f0 tx=0x7f0e040091d0).stop 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 -- 172.21.15.89:0/79850715 shutdown_connections 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c13c420 0x7f0e0c13e810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 --2- 172.21.15.89:0/79850715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c137860 0x7f0e0c137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 -- 172.21.15.89:0/79850715 >> 172.21.15.89:0/79850715 conn(0x7f0e0c05c300 msgr2=0x7f0e0c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 -- 172.21.15.89:0/79850715 shutdown_connections 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.407+0000 7f0e1123b700 1 -- 172.21.15.89:0/79850715 wait complete. 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.408+0000 7f0e1123b700 1 Processor -- start 2024-02-09T23:58:36.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.408+0000 7f0e1123b700 1 -- start start 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 0x7f0e0c133450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e0c13c420 0x7f0e0c143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c143050 con 0x7f0e0c137860 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c133e20 con 0x7f0e0c13c420 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c13ac90 con 0x7f0e0c0650c0 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40044/0 (socket says 172.21.15.89:40044) 2024-02-09T23:58:36.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 -- 172.21.15.89:0/1410046918 learned_addr learned my addr 172.21.15.89:0/1410046918 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0b59e700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e0c13c420 0x7f0e0c143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0a59c700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 0x7f0e0c133450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 -- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e0c13c420 msgr2=0x7f0e0c143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e0c13c420 0x7f0e0c143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 -- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 msgr2=0x7f0e0c133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 0x7f0e0c133450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 -- 172.21.15.89:0/1410046918 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0000b1e0 con 0x7f0e0c0650c0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0a59c700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 0x7f0e0c133450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e0ad9d700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0e0000c000 tx=0x7f0e00006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e00012600 con 0x7f0e0c0650c0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00012760 con 0x7f0e0c0650c0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e04009470 con 0x7f0e0c0650c0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e00012ac0 con 0x7f0e0c0650c0 2024-02-09T23:58:36.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.409+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c0926e0 con 0x7f0e0c0650c0 2024-02-09T23:58:36.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.410+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0e00022070 con 0x7f0e0c0650c0 2024-02-09T23:58:36.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.410+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c1332a0 con 0x7f0e0c0650c0 2024-02-09T23:58:36.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.411+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0e0004ae00 con 0x7f0e0c0650c0 2024-02-09T23:58:36.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.414+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0e00033690 con 0x7f0e0c0650c0 2024-02-09T23:58:36.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.525+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e0c0637b0 con 0x7f0e0c0650c0 2024-02-09T23:58:36.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.526+0000 7f0dfbfff700 1 -- 172.21.15.89:0/1410046918 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f0e0004d070 con 0x7f0e0c0650c0 2024-02-09T23:58:36.528 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:36.528 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:36.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 >> v1:172.21.15.89:6816/39389 conn(0x7f0de8038ec0 legacy=0x7f0de803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 msgr2=0x7f0e0c092030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0e0000c000 tx=0x7f0e00006eb0).stop 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 shutdown_connections 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e0c13c420 0x7f0e0c143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0e0c0650c0 0x7f0e0c092030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 --2- 172.21.15.89:0/1410046918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e0c137860 0x7f0e0c133450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 >> 172.21.15.89:0/1410046918 conn(0x7f0e0c05c300 msgr2=0x7f0e0c1365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 shutdown_connections 2024-02-09T23:58:36.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.527+0000 7f0e1123b700 1 -- 172.21.15.89:0/1410046918 wait complete. 2024-02-09T23:58:36.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-09T23:58:36.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-09T23:58:36.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.643+0000 7f10a3bd2700 1 Processor -- start 2024-02-09T23:58:36.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.643+0000 7f10a3bd2700 1 -- start start 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c067990 con 0x7f109c139d80 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c13a6f0 con 0x7f109c067570 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a3bd2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0a4c50 con 0x7f109c1337e0 2024-02-09T23:58:36.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a116d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a216f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40060/0 (socket says 172.21.15.89:40060) 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a216f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54674/0 (socket says 172.21.15.89:54674) 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a116d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54426/0 (socket says 172.21.15.89:54426) 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 -- 172.21.15.89:0/2349088241 learned_addr learned my addr 172.21.15.89:0/2349088241 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 -- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 msgr2=0x7f109c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 -- 172.21.15.89:0/2349088241 >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 msgr2=0x7f109c13a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 --2- 172.21.15.89:0/2349088241 >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 -- 172.21.15.89:0/2349088241 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0a4f10 con 0x7f109c1337e0 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a216f700 1 --2- 172.21.15.89:0/2349088241 >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a116d700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a196e700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f108c002f70 tx=0x7f108c006eb0).ready entity=mon.2 client_cookie=1c41ddeedf9bd2b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.644+0000 7f10a096c700 1 -- 172.21.15.89:0/2349088241 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f108c00d570 con 0x7f109c1337e0 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a096c700 1 -- 172.21.15.89:0/2349088241 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c000e90 con 0x7f109c1337e0 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a096c700 1 -- 172.21.15.89:0/2349088241 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f108c00d900 con 0x7f109c1337e0 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 -- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 msgr2=0x7f109c133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f108c002f70 tx=0x7f108c006eb0).stop 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 -- 172.21.15.89:0/2349088241 shutdown_connections 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/2349088241 >> v2:172.21.15.89:3300/0 conn(0x7f109c139d80 0x7f109c13a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c1337e0 0x7f109c133bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/2349088241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c067570 0x7f109c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 -- 172.21.15.89:0/2349088241 >> 172.21.15.89:0/2349088241 conn(0x7f109c0a93f0 msgr2=0x7f109c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 -- 172.21.15.89:0/2349088241 shutdown_connections 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.645+0000 7f10a3bd2700 1 -- 172.21.15.89:0/2349088241 wait complete. 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.646+0000 7f10a3bd2700 1 Processor -- start 2024-02-09T23:58:36.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.646+0000 7f10a3bd2700 1 -- start start 2024-02-09T23:58:36.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.646+0000 7f10a3bd2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.646+0000 7f10a3bd2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 0x7f109c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c139d80 0x7f109c1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c092f40 con 0x7f109c067570 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c09ce00 con 0x7f109c1337e0 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c09d0a0 con 0x7f109c139d80 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a196e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a196e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54682/0 (socket says 172.21.15.89:54682) 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a196e700 1 -- 172.21.15.89:0/4163010650 learned_addr learned my addr 172.21.15.89:0/4163010650 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 0x7f109c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a216f700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c139d80 0x7f109c1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 -- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c139d80 msgr2=0x7f109c1490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c139d80 0x7f109c1490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 -- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 msgr2=0x7f109c092740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 -- 172.21.15.89:0/4163010650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109800b180 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a196e700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a116d700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 0x7f109c09c540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f109800c000 tx=0x7f1098006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1098010780 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980108e0 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1098010c40 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1094009470 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.647+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c00b1e0 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.648+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f109801c460 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.648+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c0a5ed0 con 0x7f109c1337e0 2024-02-09T23:58:36.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.648+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f109804ad10 con 0x7f109c1337e0 2024-02-09T23:58:36.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.651+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1098033640 con 0x7f109c1337e0 2024-02-09T23:58:36.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.764+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f109c057a60 con 0x7f109c1337e0 2024-02-09T23:58:36.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.765+0000 7f108affd700 1 -- 172.21.15.89:0/4163010650 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1098033230 con 0x7f109c1337e0 2024-02-09T23:58:36.767 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 >> v1:172.21.15.89:6816/39389 conn(0x7f107c038dd0 legacy=0x7f107c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 msgr2=0x7f109c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 0x7f109c09c540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f109800c000 tx=0x7f1098006df0).stop 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 shutdown_connections 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f109c139d80 0x7f109c1490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f109c067570 0x7f109c092740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 --2- 172.21.15.89:0/4163010650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f109c1337e0 0x7f109c09c540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 >> 172.21.15.89:0/4163010650 conn(0x7f109c0a93f0 msgr2=0x7f109c0a2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 shutdown_connections 2024-02-09T23:58:36.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.766+0000 7f10a3bd2700 1 -- 172.21.15.89:0/4163010650 wait complete. 2024-02-09T23:58:36.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-09T23:58:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.881+0000 7fe3af2d2700 1 Processor -- start 2024-02-09T23:58:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.881+0000 7fe3af2d2700 1 -- start start 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3af2d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3af2d2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 0x7fe3a8136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3af2d2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a809b2a0 con 0x7fe3a809adf0 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3af2d2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a809bc50 con 0x7fe3a8064700 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3af2d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81367e0 con 0x7fe3a809aa10 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54436/0 (socket says 172.21.15.89:54436) 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 -- 172.21.15.89:0/3990313097 learned_addr learned my addr 172.21.15.89:0/3990313097 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ac86d700 1 --2- 172.21.15.89:0/3990313097 >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 0x7fe3a8136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 -- 172.21.15.89:0/3990313097 >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 msgr2=0x7fe3a8136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 --2- 172.21.15.89:0/3990313097 >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 0x7fe3a8136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 -- 172.21.15.89:0/3990313097 >> v1:172.21.15.89:6789/0 conn(0x7fe3a809adf0 legacy=0x7fe3a8132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ad06e700 1 -- 172.21.15.89:0/3990313097 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8136aa0 con 0x7fe3a809aa10 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe397fff700 1 -- 172.21.15.89:0/3990313097 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036241312 0 0) 0x7fe3a0001490 con 0x7fe3a809adf0 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.882+0000 7fe3ac86d700 1 --2- 172.21.15.89:0/3990313097 >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 0x7fe3a8136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3ad06e700 1 --2- 172.21.15.89:0/3990313097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe398002f70 tx=0x7fe398006eb0).ready entity=mon.1 client_cookie=f1988246e0c5931 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe397fff700 1 -- 172.21.15.89:0/3990313097 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39800d570 con 0x7fe3a809aa10 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe397fff700 1 -- 172.21.15.89:0/3990313097 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398000e90 con 0x7fe3a809aa10 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe397fff700 1 -- 172.21.15.89:0/3990313097 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39800d8c0 con 0x7fe3a809aa10 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 -- 172.21.15.89:0/3990313097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 msgr2=0x7fe3a80621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/3990313097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe398002f70 tx=0x7fe398006eb0).stop 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 -- 172.21.15.89:0/3990313097 shutdown_connections 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/3990313097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a809aa10 0x7fe3a80621e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/3990313097 >> v2:172.21.15.89:3300/0 conn(0x7fe3a8064700 0x7fe3a8136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 -- 172.21.15.89:0/3990313097 >> 172.21.15.89:0/3990313097 conn(0x7fe3a806c0c0 msgr2=0x7fe3a806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 -- 172.21.15.89:0/3990313097 shutdown_connections 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.883+0000 7fe3af2d2700 1 -- 172.21.15.89:0/3990313097 wait complete. 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.884+0000 7fe3af2d2700 1 Processor -- start 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.884+0000 7fe3af2d2700 1 -- start start 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 0x7fe3a813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 0x7fe3a813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a813c830 con 0x7fe3a809aa10 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8148f10 con 0x7fe3a8064700 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a813e350 con 0x7fe3a809adf0 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54448/0 (socket says 172.21.15.89:54448) 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 -- 172.21.15.89:0/1683871878 learned_addr learned my addr 172.21.15.89:0/1683871878 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad86f700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 0x7fe3a813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ac86d700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 0x7fe3a813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 -- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 msgr2=0x7fe3a813c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 0x7fe3a813c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 -- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 msgr2=0x7fe3a813d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 0x7fe3a813d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 -- 172.21.15.89:0/1683871878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a400b120 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad86f700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 0x7fe3a813c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ac86d700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 0x7fe3a813d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3ad06e700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe3a8092060 tx=0x7fe398015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39800d8f0 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398011b40 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39800b1e0 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.885+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe398011ea0 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.886+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a80a9850 con 0x7fe3a8064700 2024-02-09T23:58:36.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.886+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe398025030 con 0x7fe3a8064700 2024-02-09T23:58:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.887+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80920a0 con 0x7fe3a8064700 2024-02-09T23:58:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.887+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe39804bba0 con 0x7fe3a8064700 2024-02-09T23:58:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:36.890+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe3a80920a0 con 0x7fe3a8064700 2024-02-09T23:58:37.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.000+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3a80920a0 con 0x7fe3a8064700 2024-02-09T23:58:37.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.001+0000 7fe3967fc700 1 -- 172.21.15.89:0/1683871878 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3a80920a0 con 0x7fe3a8064700 2024-02-09T23:58:37.003 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-09T23:58:37.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 >> v1:172.21.15.89:6816/39389 conn(0x7fe388038da0 legacy=0x7fe38803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 msgr2=0x7fe3a813bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe3a8092060 tx=0x7fe398015000).stop 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 shutdown_connections 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe3a809adf0 0x7fe3a813c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8064700 0x7fe3a813bb10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 --2- 172.21.15.89:0/1683871878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a809aa10 0x7fe3a813d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 >> 172.21.15.89:0/1683871878 conn(0x7fe3a806c0c0 msgr2=0x7fe3a805b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 shutdown_connections 2024-02-09T23:58:37.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.002+0000 7fe3af2d2700 1 -- 172.21.15.89:0/1683871878 wait complete. 2024-02-09T23:58:37.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-09T23:58:37.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.117+0000 7f31feba9700 1 Processor -- start 2024-02-09T23:58:37.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.117+0000 7f31feba9700 1 -- start start 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31feba9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31feba9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31feba9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f8063a70 con 0x7f31f80650c0 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31feba9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f80649c0 con 0x7f31f813c420 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31feba9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8064bc0 con 0x7f31f8137860 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fd146700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fd146700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54708/0 (socket says 172.21.15.89:54708) 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40084/0 (socket says 172.21.15.89:40084) 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fd146700 1 -- 172.21.15.89:0/645903966 learned_addr learned my addr 172.21.15.89:0/645903966 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31f7fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f31f80650c0 0x7f31f80630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40352/0 (socket says 172.21.15.89:40352) 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 -- 172.21.15.89:0/645903966 >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 msgr2=0x7f31f813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 --2- 172.21.15.89:0/645903966 >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 -- 172.21.15.89:0/645903966 >> v1:172.21.15.89:6789/0 conn(0x7f31f80650c0 legacy=0x7f31f80630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fc945700 1 -- 172.21.15.89:0/645903966 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80ab0d0 con 0x7f31f8137860 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.118+0000 7f31fd146700 1 --2- 172.21.15.89:0/645903966 >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31fc945700 1 --2- 172.21.15.89:0/645903966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31ec002f70 tx=0x7f31ec006df0).ready entity=mon.2 client_cookie=f821eeb696fa34e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31f77fe700 1 -- 172.21.15.89:0/645903966 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec00d570 con 0x7f31f8137860 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31f77fe700 1 -- 172.21.15.89:0/645903966 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec000e90 con 0x7f31f8137860 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31f77fe700 1 -- 172.21.15.89:0/645903966 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec00d8c0 con 0x7f31f8137860 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 -- 172.21.15.89:0/645903966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 msgr2=0x7f31f8137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 --2- 172.21.15.89:0/645903966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31ec002f70 tx=0x7f31ec006df0).stop 2024-02-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 -- 172.21.15.89:0/645903966 shutdown_connections 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 --2- 172.21.15.89:0/645903966 >> v2:172.21.15.89:3300/0 conn(0x7f31f813c420 0x7f31f813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 --2- 172.21.15.89:0/645903966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f8137c40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 -- 172.21.15.89:0/645903966 >> 172.21.15.89:0/645903966 conn(0x7f31f805c300 msgr2=0x7f31f806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 -- 172.21.15.89:0/645903966 shutdown_connections 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.119+0000 7f31feba9700 1 -- 172.21.15.89:0/645903966 wait complete. 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.120+0000 7f31feba9700 1 Processor -- start 2024-02-09T23:58:37.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.120+0000 7f31feba9700 1 -- start start 2024-02-09T23:58:37.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f812cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f812d8c0 con 0x7f31f813c420 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8139dd0 con 0x7f31f80650c0 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f813a570 con 0x7f31f8137860 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fd146700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31f7fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f812cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54464/0 (socket says 172.21.15.89:54464) 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fd146700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54716/0 (socket says 172.21.15.89:54716) 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 -- 172.21.15.89:0/149601925 learned_addr learned my addr 172.21.15.89:0/149601925 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 -- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 msgr2=0x7f31f812cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f812cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 -- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 msgr2=0x7f31f812d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 -- 172.21.15.89:0/149601925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009530 con 0x7f31f80650c0 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31f7fff700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f812cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fd146700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31fc945700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f31f8131f40 tx=0x7f31ec014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec013da0 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec01e400 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec00b180 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.121+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec01e760 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.122+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f8134840 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.122+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f31ec025030 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.122+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f80637b0 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.123+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f31ec04b690 con 0x7f31f80650c0 2024-02-09T23:58:37.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.126+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f31ec028810 con 0x7f31f80650c0 2024-02-09T23:58:37.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.234+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31f8057a60 con 0x7f31f80650c0 2024-02-09T23:58:37.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.234+0000 7f31f5ffb700 1 -- 172.21.15.89:0/149601925 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31ec01e8c0 con 0x7f31f80650c0 2024-02-09T23:58:37.236 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 >> v1:172.21.15.89:6816/39389 conn(0x7f31d8038da0 legacy=0x7f31d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 msgr2=0x7f31f812c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f31f8131f40 tx=0x7f31ec014000).stop 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 shutdown_connections 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f813c420 0x7f31f812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f80650c0 0x7f31f812c9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 --2- 172.21.15.89:0/149601925 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f31f8137860 0x7f31f812cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 >> 172.21.15.89:0/149601925 conn(0x7f31f805c300 msgr2=0x7f31f813b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.235+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 shutdown_connections 2024-02-09T23:58:37.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.236+0000 7f31feba9700 1 -- 172.21.15.89:0/149601925 wait complete. 2024-02-09T23:58:37.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-09T23:58:37.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 Processor -- start 2024-02-09T23:58:37.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 -- start start 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 0x7fcdfc0a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc09f800 con 0x7fcdfc09d570 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0a50b0 con 0x7fcdfc05e170 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.352+0000 7fce020e8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0a4190 con 0x7fcdfc0a4ab0 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54718/0 (socket says 172.21.15.89:54718) 2024-02-09T23:58:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 -- 172.21.15.89:0/2640213975 learned_addr learned my addr 172.21.15.89:0/2640213975 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54474/0 (socket says 172.21.15.89:54474) 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfbfff700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 0x7fcdfc0a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 -- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 msgr2=0x7fcdfc0a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 0x7fcdfc0a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 -- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 msgr2=0x7fcdfc0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 -- 172.21.15.89:0/2640213975 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc05e550 con 0x7fcdfc09d570 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfbfff700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 0x7fcdfc0a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfb7fe700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfaffd700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fcdfc09cd40 tx=0x7fcde4009290).ready entity=mon.0 client_cookie=a9a08b372fa81e15 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfa7fc700 1 -- 172.21.15.89:0/2640213975 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcde400b6b0 con 0x7fcdfc09d570 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfa7fc700 1 -- 172.21.15.89:0/2640213975 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde400b810 con 0x7fcdfc09d570 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.353+0000 7fcdfa7fc700 1 -- 172.21.15.89:0/2640213975 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcde400b980 con 0x7fcdfc09d570 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 -- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 msgr2=0x7fcdfc0a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fcdfc09cd40 tx=0x7fcde4009290).stop 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 -- 172.21.15.89:0/2640213975 shutdown_connections 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc0a4ab0 0x7fcdfc0a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc05e170 0x7fcdfc0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 --2- 172.21.15.89:0/2640213975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc0a1fe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 -- 172.21.15.89:0/2640213975 >> 172.21.15.89:0/2640213975 conn(0x7fcdfc0a93f0 msgr2=0x7fcdfc0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 -- 172.21.15.89:0/2640213975 shutdown_connections 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.354+0000 7fce020e8700 1 -- 172.21.15.89:0/2640213975 wait complete. 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 Processor -- start 2024-02-09T23:58:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 -- start start 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 0x7fcdfc134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc093080 con 0x7fcdfc09d570 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0a17a0 con 0x7fcdfc0a4ab0 2024-02-09T23:58:37.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fce020e8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0a1a40 con 0x7fcdfc05e170 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40106/0 (socket says 172.21.15.89:40106) 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fcdfb7fe700 1 -- 172.21.15.89:0/4245335598 learned_addr learned my addr 172.21.15.89:0/4245335598 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.355+0000 7fcdfbfff700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 0x7fcdfc134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfaffd700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 -- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 msgr2=0x7fcdfc134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 0x7fcdfc134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 -- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 msgr2=0x7fcdfc134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 -- 172.21.15.89:0/4245335598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf400b180 con 0x7fcdfc05e170 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfbfff700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 0x7fcdfc134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfaffd700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdfb7fe700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcdf400c000 tx=0x7fcdf4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf400c890 con 0x7fcdfc05e170 2024-02-09T23:58:37.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf400c9f0 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec00b180 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf400cd50 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.356+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde4009530 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.357+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcdf401c460 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.357+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc09df90 con 0x7fcdfc05e170 2024-02-09T23:58:37.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.357+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcdf404aea0 con 0x7fcdfc05e170 2024-02-09T23:58:37.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.360+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcdf40337d0 con 0x7fcdfc05e170 2024-02-09T23:58:37.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.471+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcdfc057a60 con 0x7fcdfc05e170 2024-02-09T23:58:37.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.472+0000 7fcdf8ff9700 1 -- 172.21.15.89:0/4245335598 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdf40333c0 con 0x7fcdfc05e170 2024-02-09T23:58:37.474 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 >> v1:172.21.15.89:6816/39389 conn(0x7fcde0038da0 legacy=0x7fcde003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 msgr2=0x7fcdfc0938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcdf400c000 tx=0x7fcdf4006df0).stop 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 shutdown_connections 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdfc0a4ab0 0x7fcdfc134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcdfc05e170 0x7fcdfc0938b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 --2- 172.21.15.89:0/4245335598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdfc09d570 0x7fcdfc134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 >> 172.21.15.89:0/4245335598 conn(0x7fcdfc0a93f0 msgr2=0x7fcdfc0a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 shutdown_connections 2024-02-09T23:58:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.473+0000 7fce020e8700 1 -- 172.21.15.89:0/4245335598 wait complete. 2024-02-09T23:58:37.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:37.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.586+0000 7fb363c31700 1 Processor -- start 2024-02-09T23:58:37.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.586+0000 7fb363c31700 1 -- start start 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.586+0000 7fb363c31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.586+0000 7fb363c31700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 0x7fb35c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb363c31700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c067990 con 0x7fb35c139d80 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb363c31700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0a4c50 con 0x7fb35c067570 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb363c31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0a4f10 con 0x7fb35c1337e0 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3611cc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 0x7fb35c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3621ce700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb35c139d80 0x7fb35c140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40360/0 (socket says 172.21.15.89:40360) 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3621ce700 1 -- 172.21.15.89:0/1718595814 learned_addr learned my addr 172.21.15.89:0/1718595814 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 -- 172.21.15.89:0/1718595814 >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 msgr2=0x7fb35c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 --2- 172.21.15.89:0/1718595814 >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 0x7fb35c139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 -- 172.21.15.89:0/1718595814 >> v1:172.21.15.89:6789/0 conn(0x7fb35c139d80 legacy=0x7fb35c140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 -- 172.21.15.89:0/1718595814 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c060520 con 0x7fb35c1337e0 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3611cc700 1 --2- 172.21.15.89:0/1718595814 >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 0x7fb35c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3619cd700 1 --2- 172.21.15.89:0/1718595814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c133bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb358002f70 tx=0x7fb358006df0).ready entity=mon.1 client_cookie=5f03e037f2dce03f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3609cb700 1 -- 172.21.15.89:0/1718595814 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35800d570 con 0x7fb35c1337e0 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3609cb700 1 -- 172.21.15.89:0/1718595814 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358000e90 con 0x7fb35c1337e0 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.587+0000 7fb3609cb700 1 -- 172.21.15.89:0/1718595814 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35800d8c0 con 0x7fb35c1337e0 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 -- 172.21.15.89:0/1718595814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 msgr2=0x7fb35c133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 --2- 172.21.15.89:0/1718595814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c133bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb358002f70 tx=0x7fb358006df0).stop 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 -- 172.21.15.89:0/1718595814 shutdown_connections 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 --2- 172.21.15.89:0/1718595814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c133bc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 --2- 172.21.15.89:0/1718595814 >> v2:172.21.15.89:3300/0 conn(0x7fb35c067570 0x7fb35c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 -- 172.21.15.89:0/1718595814 >> 172.21.15.89:0/1718595814 conn(0x7fb35c0a93f0 msgr2=0x7fb35c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 -- 172.21.15.89:0/1718595814 shutdown_connections 2024-02-09T23:58:37.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.588+0000 7fb363c31700 1 -- 172.21.15.89:0/1718595814 wait complete. 2024-02-09T23:58:37.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.589+0000 7fb363c31700 1 Processor -- start 2024-02-09T23:58:37.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.589+0000 7fb363c31700 1 -- start start 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 0x7fb35c1357c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb35c139d80 0x7fb35c148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c09f250 con 0x7fb35c139d80 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c09d7f0 con 0x7fb35c1337e0 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c09dab0 con 0x7fb35c067570 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3619cd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 0x7fb35c1357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54486/0 (socket says 172.21.15.89:54486) 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3619cd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 0x7fb35c1357c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40118/0 (socket says 172.21.15.89:40118) 2024-02-09T23:58:37.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 -- 172.21.15.89:0/390908351 learned_addr learned my addr 172.21.15.89:0/390908351 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3621ce700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb35c139d80 0x7fb35c148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 -- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 msgr2=0x7fb35c1357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 0x7fb35c1357c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 -- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb35c139d80 msgr2=0x7fb35c148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb35c139d80 0x7fb35c148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 -- 172.21.15.89:0/390908351 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c00b180 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb3611cc700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb34c00c000 tx=0x7fb34c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c010780 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0108e0 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c010c40 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35800b180 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.590+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c09f530 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.591+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb34c01c460 con 0x7fb35c1337e0 2024-02-09T23:58:37.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.591+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb34c04af00 con 0x7fb35c1337e0 2024-02-09T23:58:37.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.591+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c09f6c0 con 0x7fb35c1337e0 2024-02-09T23:58:37.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.594+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb34c033730 con 0x7fb35c1337e0 2024-02-09T23:58:37.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.734+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb35c065a50 con 0x7fb35c1337e0 2024-02-09T23:58:37.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.735+0000 7fb34affd700 1 -- 172.21.15.89:0/390908351 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2320 (secure 0 0 0) 0x7fb34c02b090 con 0x7fb35c1337e0 2024-02-09T23:58:37.737 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:37.737 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-09T23:58:30.373217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-09T23:58:37.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 >> v1:172.21.15.89:6816/39389 conn(0x7fb33c038da0 legacy=0x7fb33c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 msgr2=0x7fb35c09fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb34c00c000 tx=0x7fb34c006df0).stop 2024-02-09T23:58:37.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 shutdown_connections 2024-02-09T23:58:37.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb35c139d80 0x7fb35c148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb35c067570 0x7fb35c1357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 --2- 172.21.15.89:0/390908351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb35c1337e0 0x7fb35c09fb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 >> 172.21.15.89:0/390908351 conn(0x7fb35c0a93f0 msgr2=0x7fb35c0a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 shutdown_connections 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.736+0000 7fb363c31700 1 -- 172.21.15.89:0/390908351 wait complete. 2024-02-09T23:58:37.739 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2024-02-09T23:58:37.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.848+0000 7f99143c2700 1 Processor -- start 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.848+0000 7f99143c2700 1 -- start start 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c0a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c09f800 con 0x7f990c0a4ab0 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a50b0 con 0x7f990c09d570 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f99143c2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a4190 con 0x7f990c05e170 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991295f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991215e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c0a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54490/0 (socket says 172.21.15.89:54490) 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991295f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54774/0 (socket says 172.21.15.89:54774) 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991215e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c0a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40132/0 (socket says 172.21.15.89:40132) 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 -- 172.21.15.89:0/1038582468 learned_addr learned my addr 172.21.15.89:0/1038582468 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 -- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 msgr2=0x7f990c0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 --2- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c0a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 -- 172.21.15.89:0/1038582468 >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 msgr2=0x7f990c0a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 --2- 172.21.15.89:0/1038582468 >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 -- 172.21.15.89:0/1038582468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c05e550 con 0x7f990c09d570 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991295f700 1 --2- 172.21.15.89:0/1038582468 >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991195d700 1 --2- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f990c09f940 tx=0x7f9908006eb0).ready entity=mon.1 client_cookie=e0f8db656037d318 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991115c700 1 -- 172.21.15.89:0/1038582468 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800d570 con 0x7f990c09d570 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991115c700 1 -- 172.21.15.89:0/1038582468 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908000e90 con 0x7f990c09d570 2024-02-09T23:58:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.849+0000 7f991115c700 1 -- 172.21.15.89:0/1038582468 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800d900 con 0x7f990c09d570 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 -- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 msgr2=0x7f990c0a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 --2- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f990c09f940 tx=0x7f9908006eb0).stop 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 -- 172.21.15.89:0/1038582468 shutdown_connections 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 --2- 172.21.15.89:0/1038582468 >> v2:172.21.15.89:3300/0 conn(0x7f990c0a4ab0 0x7f990c0a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 --2- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 --2- 172.21.15.89:0/1038582468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c0a1fe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 -- 172.21.15.89:0/1038582468 >> 172.21.15.89:0/1038582468 conn(0x7f990c0a93f0 msgr2=0x7f990c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 -- 172.21.15.89:0/1038582468 shutdown_connections 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.850+0000 7f99143c2700 1 -- 172.21.15.89:0/1038582468 wait complete. 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 Processor -- start 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 -- start start 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 0x7f990c098610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c099400 con 0x7f990c0a4ab0 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c098120 con 0x7f990c09d570 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f99143c2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a1390 con 0x7f990c05e170 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f991195d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f991215e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f991195d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54500/0 (socket says 172.21.15.89:54500) 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f991195d700 1 -- 172.21.15.89:0/1724857937 learned_addr learned my addr 172.21.15.89:0/1724857937 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.851+0000 7f991215e700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40144/0 (socket says 172.21.15.89:40144) 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991295f700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 0x7f990c098610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 -- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 msgr2=0x7f990c099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 -- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 msgr2=0x7f990c098610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 0x7f990c098610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 -- 172.21.15.89:0/1724857937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904009470 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991215e700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991295f700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 0x7f990c098610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f991195d700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f990c0a1b00 tx=0x7f9908015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800dea0 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908002f70 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990800b1e0 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800bee0 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.852+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c098350 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.853+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9908024030 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.853+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f990804b7f0 con 0x7f990c09d570 2024-02-09T23:58:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.853+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c09df90 con 0x7f990c09d570 2024-02-09T23:58:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.856+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f990801f200 con 0x7f990c09d570 2024-02-09T23:58:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.967+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f990c057a60 con 0x7f990c09d570 2024-02-09T23:58:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.967+0000 7f98fb7fe700 1 -- 172.21.15.89:0/1724857937 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f9908001f00 con 0x7f990c09d570 2024-02-09T23:58:37.970 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:37.970 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:28.306959+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-09T23:58:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 >> v1:172.21.15.89:6816/39389 conn(0x7f98ec038da0 legacy=0x7f98ec03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 msgr2=0x7f990c1462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f990c0a1b00 tx=0x7f9908015000).stop 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 shutdown_connections 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f990c0a4ab0 0x7f990c098610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f990c05e170 0x7f990c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 --2- 172.21.15.89:0/1724857937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f990c09d570 0x7f990c1462f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 >> 172.21.15.89:0/1724857937 conn(0x7f990c0a93f0 msgr2=0x7f990c0a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 shutdown_connections 2024-02-09T23:58:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:37.969+0000 7f99143c2700 1 -- 172.21.15.89:0/1724857937 wait complete. 2024-02-09T23:58:37.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-09T23:58:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 Processor -- start 2024-02-09T23:58:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 -- start start 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5934067990 con 0x7f5934067570 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593413a6f0 con 0x7f5934139d80 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.082+0000 7f593b28c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59340a4c50 con 0x7f59341337e0 2024-02-09T23:58:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5938827700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939829700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40146/0 (socket says 172.21.15.89:40146) 2024-02-09T23:58:38.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939829700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54516/0 (socket says 172.21.15.89:54516) 2024-02-09T23:58:38.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5938827700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54796/0 (socket says 172.21.15.89:54796) 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 -- 172.21.15.89:0/1531578553 learned_addr learned my addr 172.21.15.89:0/1531578553 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 -- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 msgr2=0x7f593413a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 -- 172.21.15.89:0/1531578553 >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 msgr2=0x7f5934139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 --2- 172.21.15.89:0/1531578553 >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 -- 172.21.15.89:0/1531578553 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340a4f10 con 0x7f59341337e0 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939829700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5938827700 1 --2- 172.21.15.89:0/1531578553 >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5939028700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5930002f70 tx=0x7f5930006eb0).ready entity=mon.2 client_cookie=a3d9e8da5f279246 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5923fff700 1 -- 172.21.15.89:0/1531578553 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593000d570 con 0x7f59341337e0 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5923fff700 1 -- 172.21.15.89:0/1531578553 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930000e90 con 0x7f59341337e0 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.083+0000 7f5923fff700 1 -- 172.21.15.89:0/1531578553 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593000d900 con 0x7f59341337e0 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 -- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 msgr2=0x7f5934133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5930002f70 tx=0x7f5930006eb0).stop 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 -- 172.21.15.89:0/1531578553 shutdown_connections 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5934139d80 0x7f593413a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 --2- 172.21.15.89:0/1531578553 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f59341337e0 0x7f5934133bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 --2- 172.21.15.89:0/1531578553 >> v2:172.21.15.89:3300/0 conn(0x7f5934067570 0x7f5934139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 -- 172.21.15.89:0/1531578553 >> 172.21.15.89:0/1531578553 conn(0x7f59340a93f0 msgr2=0x7f59340a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 -- 172.21.15.89:0/1531578553 shutdown_connections 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.084+0000 7f593b28c700 1 -- 172.21.15.89:0/1531578553 wait complete. 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 Processor -- start 2024-02-09T23:58:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 -- start start 2024-02-09T23:58:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 0x7f59340a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 0x7f5934132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59340a06d0 con 0x7f5934139d80 2024-02-09T23:58:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340a22c0 con 0x7f59341337e0 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f593b28c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f593409ff80 con 0x7f5934067570 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f5938827700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f5939028700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 0x7f59340a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f5938827700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54530/0 (socket says 172.21.15.89:54530) 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f5938827700 1 -- 172.21.15.89:0/1540455573 learned_addr learned my addr 172.21.15.89:0/1540455573 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.085+0000 7f5939829700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 0x7f5934132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 -- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 msgr2=0x7f5934132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 -- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 msgr2=0x7f5934132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 0x7f5934132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 -- 172.21.15.89:0/1540455573 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592400b180 con 0x7f5934067570 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939829700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 0x7f5934132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5938827700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f5939028700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 0x7f59340a0b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5930002f70 tx=0x7f5930015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593000dea0 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930006b40 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c009470 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930011e20 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.086+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593000b1e0 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.087+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5930025030 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.087+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f593004b990 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.087+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59340a1f10 con 0x7f5934067570 2024-02-09T23:58:38.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.090+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5930023070 con 0x7f5934067570 2024-02-09T23:58:38.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.230+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5934057a60 con 0x7f5934067570 2024-02-09T23:58:38.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.230+0000 7f59227fc700 1 -- 172.21.15.89:0/1540455573 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2320 (secure 0 0 0) 0x7f5930023020 con 0x7f5934067570 2024-02-09T23:58:38.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-09T23:58:38.233 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-09T23:58:30.373217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 >> v1:172.21.15.89:6816/39389 conn(0x7f5914038da0 legacy=0x7f591403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 msgr2=0x7f59340a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 0x7f59340a0b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5930002f70 tx=0x7f5930015000).stop 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 shutdown_connections 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5934139d80 0x7f5934132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5934067570 0x7f59340a0b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 --2- 172.21.15.89:0/1540455573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59341337e0 0x7f5934132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 >> 172.21.15.89:0/1540455573 conn(0x7f59340a93f0 msgr2=0x7f59340a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 shutdown_connections 2024-02-09T23:58:38.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.232+0000 7f593b28c700 1 -- 172.21.15.89:0/1540455573 wait complete. 2024-02-09T23:58:38.235 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2024-02-09T23:58:38.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-09T23:58:30.373217+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-09T23:58:38.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-02-09T23:58:38.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-09T23:58:38.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.650+0000 7f8e7a890700 1 Processor -- start 2024-02-09T23:58:38.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.650+0000 7f8e7a890700 1 -- start start 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e7a890700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e740621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e7a890700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e7409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e7a890700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7409bc50 con 0x7f8e74064700 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e7a890700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741365f0 con 0x7f8e74136140 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e7a890700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7409b2e0 con 0x7f8e7409aa10 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e740621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e7409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e737fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8e74064700 0x7f8e74132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40366/0 (socket says 172.21.15.89:40366) 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e737fe700 1 -- 172.21.15.89:0/1685979377 learned_addr learned my addr 172.21.15.89:0/1685979377 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-09T23:58:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e72ffd700 1 -- 172.21.15.89:0/1685979377 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248633192 0 0) 0x7f8e7409bc50 con 0x7f8e74064700 2024-02-09T23:58:38.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 -- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 msgr2=0x7f8e7409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e7409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 -- 172.21.15.89:0/1685979377 >> v1:172.21.15.89:6789/0 conn(0x7f8e74064700 legacy=0x7f8e74132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 -- 172.21.15.89:0/1685979377 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e741367e0 con 0x7f8e7409aa10 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e7409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e73fff700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e740621e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8e68002f70 tx=0x7f8e68006df0).ready entity=mon.2 client_cookie=ae1ed22c1a78049 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e72ffd700 1 -- 172.21.15.89:0/1685979377 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6800d570 con 0x7f8e7409aa10 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e72ffd700 1 -- 172.21.15.89:0/1685979377 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68000e90 con 0x7f8e7409aa10 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.651+0000 7f8e72ffd700 1 -- 172.21.15.89:0/1685979377 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6800d8c0 con 0x7f8e7409aa10 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 -- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 msgr2=0x7f8e740621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e740621e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8e68002f70 tx=0x7f8e68006df0).stop 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 -- 172.21.15.89:0/1685979377 shutdown_connections 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e7409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1685979377 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e740621e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 -- 172.21.15.89:0/1685979377 >> 172.21.15.89:0/1685979377 conn(0x7f8e7406c0c0 msgr2=0x7f8e7406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 -- 172.21.15.89:0/1685979377 shutdown_connections 2024-02-09T23:58:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.652+0000 7f8e7a890700 1 -- 172.21.15.89:0/1685979377 wait complete. 2024-02-09T23:58:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 Processor -- start 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 -- start start 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e74094770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e74094c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74143000 con 0x7f8e74064700 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74094320 con 0x7f8e74136140 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e7a890700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74067a00 con 0x7f8e7409aa10 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e74094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54812/0 (socket says 172.21.15.89:54812) 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e73fff700 1 -- 172.21.15.89:0/1849103140 learned_addr learned my addr 172.21.15.89:0/1849103140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.653+0000 7f8e737fe700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e74094770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 -- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 msgr2=0x7f8e74094770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e74094770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 -- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 msgr2=0x7f8e74142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 -- 172.21.15.89:0/1849103140 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009470 con 0x7f8e74136140 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e73fff700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e74094c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8e6c00c000 tx=0x7f8e6c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e717fa700 1 -- 172.21.15.89:0/1849103140 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6c015070 con 0x7f8e74136140 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e717fa700 1 -- 172.21.15.89:0/1849103140 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00bb00 con 0x7f8e74136140 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6800b180 con 0x7f8e74136140 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e717fa700 1 -- 172.21.15.89:0/1849103140 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6c00be60 con 0x7f8e74136140 2024-02-09T23:58:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.654+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74067360 con 0x7f8e74136140 2024-02-09T23:58:38.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.655+0000 7f8e717fa700 1 -- 172.21.15.89:0/1849103140 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8e6c020020 con 0x7f8e74136140 2024-02-09T23:58:38.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.655+0000 7f8e717fa700 1 -- 172.21.15.89:0/1849103140 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e6c04eaf0 con 0x7f8e74136140 2024-02-09T23:58:38.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.658+0000 7f8e8c317b80 1 Processor -- start 2024-02-09T23:58:38.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.658+0000 7f8e8c317b80 1 -- start start 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df640a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628df5eea10 con 0x5628df64d1d0 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628df593e10 con 0x5628df652590 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5628df5648b0 con 0x5628df64d5b0 2024-02-09T23:58:38.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df640a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54558/0 (socket says 172.21.15.89:54558) 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40200/0 (socket says 172.21.15.89:40200) 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e78e2d700 1 -- 172.21.15.89:0/4276207041 learned_addr learned my addr 172.21.15.89:0/4276207041 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 -- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 msgr2=0x5628df652a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 -- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 msgr2=0x5628df640a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df640a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 -- 172.21.15.89:0/4276207041 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628df5fae20 con 0x5628df64d5b0 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e73fff700 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df640a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e737fe700 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e6400d000 tx=0x7f8e64001780).ready entity=mon.2 client_cookie=db0b0bb278312a45 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e7a890700 1 -- 172.21.15.89:0/4276207041 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e640114c0 con 0x5628df64d5b0 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e7a890700 1 -- 172.21.15.89:0/4276207041 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64011620 con 0x5628df64d5b0 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.659+0000 7f8e7a890700 1 -- 172.21.15.89:0/4276207041 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e64011980 con 0x5628df64d5b0 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 msgr2=0x5628df64d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e6400d000 tx=0x7f8e64001780).stop 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- 172.21.15.89:0/4276207041 shutdown_connections 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df652a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df640a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/4276207041 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df64d9b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- 172.21.15.89:0/4276207041 >> 172.21.15.89:0/4276207041 conn(0x5628df5ec970 msgr2=0x5628df546690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- 172.21.15.89:0/4276207041 shutdown_connections 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- 172.21.15.89:0/4276207041 wait complete. 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.660+0000 7f8e8c317b80 1 -- start start 2024-02-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 Processor -- start 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df6459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628df578180 con 0x5628df64d1d0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628df5587f0 con 0x5628df652590 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5628df548710 con 0x5628df64d5b0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e8c317b80 10 client.0 ll_register_callbacks cb 0x5628df56d570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e737fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e737fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40210/0 (socket says 172.21.15.89:40210) 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df6459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.661+0000 7f8e737fe700 1 -- 172.21.15.89:0/3598787715 learned_addr learned my addr 172.21.15.89:0/3598787715 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 msgr2=0x5628df6585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 msgr2=0x5628df6459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df6459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3598787715 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741367e0 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8e6c01c4a0 tx=0x7f8e6c018000).ready entity=mon.1 client_cookie=81b3c1847a3c9b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.89:3301/0 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6c01c1c0 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mon.1 v2:172.21.15.89:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e6c0330d0 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628df4ef0c0 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e6c01c320 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 10 client.4498 fetch_fsmap learned FSMap version 8 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f8e74067360 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mon.1 v2:172.21.15.89:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628df4ef0c0 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mon.1 v2:172.21.15.89:3301/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f8e6c018070 con 0x5628df652590 2024-02-09T23:58:38.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 10 client.4498 fetch_fsmap finished waiting for FSMap version 8 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 10 client.4498 resolve_mds: resolved ID 'c' to GID 4190 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 20 client.4498 populate_metadata read hostname 'smithi089' 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 4 client.4498 mds_command: new command op to 4190 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 --> v1:172.21.15.89:6818/1003489341 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628df56e230 con 0x5628df643d90 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.662+0000 7f8e52ffd700 10 client.4498 ms_handle_connect on v1:172.21.15.89:6818/1003489341 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e52ffd700 1 -- 172.21.15.89:0/3598787715 <== mds.1 v1:172.21.15.89:6818/1003489341 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x5628df56e230 con 0x5628df643d90 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e52ffd700 10 client.4498 handle_command_reply: tid=0 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 client.4498 shutdown 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 msgr2=0x5628df658ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8e6c01c4a0 tx=0x7f8e6c018000).stop 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 shutdown_connections 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df6459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3598787715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e52ffd700 0 client.4498 ms_handle_reset on v1:172.21.15.89:6818/1003489341 2024-02-09T23:58:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 >> 172.21.15.89:0/3598787715 conn(0x5628df5ec970 msgr2=0x5628df541cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 shutdown_connections 2024-02-09T23:58:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3598787715 wait complete. 2024-02-09T23:58:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.663+0000 7f8e8c317b80 20 client.4498 trim_cache size 0 max 16384 2024-02-09T23:58:38.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.679+0000 7f8e8c317b80 1 Processor -- start 2024-02-09T23:58:38.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.679+0000 7f8e8c317b80 1 -- start start 2024-02-09T23:58:38.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df61f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628df651820 con 0x5628df64d1d0 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628df620700 con 0x5628df652590 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5628df6425f0 con 0x5628df64d5b0 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df61f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e78e2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df61f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54832/0 (socket says 172.21.15.89:54832) 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e73fff700 1 -- 172.21.15.89:0/3992730105 learned_addr learned my addr 172.21.15.89:0/3992730105 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.680+0000 7f8e737fe700 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 msgr2=0x5628df6585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 msgr2=0x5628df61f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df61f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 -- 172.21.15.89:0/3992730105 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64001d20 con 0x5628df652590 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8e6c01c4a0 tx=0x7f8e6c02d000).ready entity=mon.1 client_cookie=c71009ce3faa9c39 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e597fa700 1 -- 172.21.15.89:0/3992730105 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6c036310 con 0x5628df652590 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e597fa700 1 -- 172.21.15.89:0/3992730105 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c036470 con 0x5628df652590 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e597fa700 1 -- 172.21.15.89:0/3992730105 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6c01c2b0 con 0x5628df652590 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 msgr2=0x5628df658ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8e6c01c4a0 tx=0x7f8e6c02d000).stop 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3992730105 shutdown_connections 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df652590 0x5628df658ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df64d1d0 0x5628df61f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/3992730105 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d5b0 0x5628df6585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3992730105 >> 172.21.15.89:0/3992730105 conn(0x5628df5ec970 msgr2=0x5628df640260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3992730105 shutdown_connections 2024-02-09T23:58:38.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.681+0000 7f8e8c317b80 1 -- 172.21.15.89:0/3992730105 wait complete. 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.682+0000 7f8e8c317b80 1 -- start start 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.682+0000 7f8e8c317b80 1 Processor -- start 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df64d5b0 0x5628df649200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df652590 0x5628df650560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628df64a250 con 0x5628df652590 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628df654f40 con 0x5628df64d5b0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5628df655200 con 0x5628df64d1d0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 10 client.0 ll_register_callbacks cb 0x5628df658530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40222/0 (socket says 172.21.15.89:40222) 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 -- 172.21.15.89:0/198113990 learned_addr learned my addr 172.21.15.89:0/198113990 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e737fe700 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df64d5b0 0x5628df649200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e78e2d700 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df652590 0x5628df650560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 -- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df64d5b0 msgr2=0x5628df649200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df64d5b0 0x5628df649200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 -- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df652590 msgr2=0x5628df650560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df652590 0x5628df650560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 -- 172.21.15.89:0/198113990 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74067360 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e73fff700 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e68023000 tx=0x7f8e6801e040).ready entity=mon.2 client_cookie=7705e093e9a0691d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e53fff700 10 client.0 ms_handle_connect on v2:172.21.15.89:3302/0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e68021070 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mon.2 v2:172.21.15.89:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e68013850 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628df566570 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e68016040 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 10 client.4475 fetch_fsmap learned FSMap version 8 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5628df567ae0 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.683+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mon.2 v2:172.21.15.89:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628df566570 con 0x5628df64d1d0 2024-02-09T23:58:38.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mon.2 v2:172.21.15.89:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f8e68038410 con 0x5628df64d1d0 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 10 client.4475 fetch_fsmap finished waiting for FSMap version 8 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 10 client.4475 resolve_mds: resolved ID 'c' to GID 4190 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 20 client.4475 populate_metadata read hostname 'smithi089' 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 4 client.4475 mds_command: new command op to 4190 tid=0[{"prefix": "status"}] 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 --> v1:172.21.15.89:6818/1003489341 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5628df44d1b0 con 0x5628df650a50 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e53fff700 10 client.4475 ms_handle_connect on v1:172.21.15.89:6818/1003489341 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e53fff700 1 -- 172.21.15.89:0/198113990 <== mds.1 v1:172.21.15.89:6818/1003489341 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+305 (unknown 0 0 1796473581) 0x5628df44d1b0 con 0x5628df650a50 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e53fff700 10 client.4475 handle_command_reply: tid=0 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 client.4475 shutdown 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 msgr2=0x5628df649d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e68023000 tx=0x7f8e6801e040).stop 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 shutdown_connections 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5628df652590 0x5628df650560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e53fff700 0 client.4475 ms_handle_reset on v1:172.21.15.89:6818/1003489341 2024-02-09T23:58:38.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5628df64d1d0 0x5628df649d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 --2- 172.21.15.89:0/198113990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5628df64d5b0 0x5628df649200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 >> 172.21.15.89:0/198113990 conn(0x5628df5ec970 msgr2=0x5628df6585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 shutdown_connections 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.684+0000 7f8e8c317b80 1 -- 172.21.15.89:0/198113990 wait complete. 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e8c317b80 20 client.4475 trim_cache size 0 max 16384 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 1, 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4190, 2024-02-09T23:58:38.697 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 9.3092572629999992, 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 8, 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 18, 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 18, 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 19.926362385000001 2024-02-09T23:58:38.698 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-09T23:58:38.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 >> v1:172.21.15.89:6816/39389 conn(0x7f8e54038da0 legacy=0x7f8e5403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 msgr2=0x7f8e74094c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e74094c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8e6c00c000 tx=0x7f8e6c0091d0).stop 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 shutdown_connections 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e74136140 0x7f8e74094c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e74064700 0x7f8e74142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 --2- 172.21.15.89:0/1849103140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e7409aa10 0x7f8e74094770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 >> 172.21.15.89:0/1849103140 conn(0x7f8e7406c0c0 msgr2=0x7f8e740a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 shutdown_connections 2024-02-09T23:58:38.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.685+0000 7f8e7a890700 1 -- 172.21.15.89:0/1849103140 wait complete. 2024-02-09T23:58:38.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-09T23:58:38.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.802+0000 7f379f93b700 1 Processor -- start 2024-02-09T23:58:38.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.802+0000 7f379f93b700 1 -- start start 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379f93b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379f93b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37980a4ab0 0x7f37980a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379f93b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37980a50b0 con 0x7f379809d570 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379f93b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379809f800 con 0x7f37980a4ab0 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379f93b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379805e550 con 0x7f379805e170 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37980a4ab0 0x7f37980a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40238/0 (socket says 172.21.15.89:40238) 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379d6d7700 1 -- 172.21.15.89:0/2800033901 learned_addr learned my addr 172.21.15.89:0/2800033901 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37980a4ab0 0x7f37980a26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54840/0 (socket says 172.21.15.89:54840) 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ced6700 1 --1- 172.21.15.89:0/2800033901 >> v1:172.21.15.89:6789/0 conn(0x7f379809d570 0x7f37980a1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40372/0 (socket says 172.21.15.89:40372) 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 -- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 msgr2=0x7f37980a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 -- 172.21.15.89:0/2800033901 >> v1:172.21.15.89:6789/0 conn(0x7f379809d570 legacy=0x7f37980a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f3787fff700 1 -- 172.21.15.89:0/2800033901 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123717684 0 0) 0x7f37980a50b0 con 0x7f379809d570 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 -- 172.21.15.89:0/2800033901 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980a4190 con 0x7f37980a4ab0 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379d6d7700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f379ded8700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37980a4ab0 0x7f37980a26f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f37900032f0 tx=0x7f37900091d0).ready entity=mon.0 client_cookie=8ba8bacf366047a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f3787fff700 1 -- 172.21.15.89:0/2800033901 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000b6c0 con 0x7f37980a4ab0 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f3787fff700 1 -- 172.21.15.89:0/2800033901 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000b820 con 0x7f37980a4ab0 2024-02-09T23:58:38.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.803+0000 7f3787fff700 1 -- 172.21.15.89:0/2800033901 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000b990 con 0x7f37980a4ab0 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 -- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37980a4ab0 msgr2=0x7f37980a26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37980a4ab0 0x7f37980a26f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f37900032f0 tx=0x7f37900091d0).stop 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 -- 172.21.15.89:0/2800033901 shutdown_connections 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37980a4ab0 0x7f37980a26f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 --2- 172.21.15.89:0/2800033901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f379805e170 0x7f37980a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 -- 172.21.15.89:0/2800033901 >> 172.21.15.89:0/2800033901 conn(0x7f37980a93f0 msgr2=0x7f37980a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 -- 172.21.15.89:0/2800033901 shutdown_connections 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.804+0000 7f379f93b700 1 -- 172.21.15.89:0/2800033901 wait complete. 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.805+0000 7f379f93b700 1 Processor -- start 2024-02-09T23:58:38.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.805+0000 7f379f93b700 1 -- start start 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 0x7f3798061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 0x7f3798061b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3798065400 con 0x7f379809d570 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37980662b0 con 0x7f379805e170 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379f93b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3798065600 con 0x7f37980a4ab0 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 0x7f3798061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ded8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 0x7f3798061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54602/0 (socket says 172.21.15.89:54602) 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379d6d7700 1 -- 172.21.15.89:0/1787641881 learned_addr learned my addr 172.21.15.89:0/1787641881 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 -- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 msgr2=0x7f3798061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 0x7f3798061b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 -- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 msgr2=0x7f3798065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 -- 172.21.15.89:0/1787641881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378800b1e0 con 0x7f379809d570 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ded8700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 0x7f3798061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379d6d7700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f379ced6700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 0x7f3798061640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3794000bc0 tx=0x7f37940079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.806+0000 7f37867fc700 1 -- 172.21.15.89:0/1787641881 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37940072e0 con 0x7f379809d570 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.807+0000 7f37867fc700 1 -- 172.21.15.89:0/1787641881 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400cb60 con 0x7f379809d570 2024-02-09T23:58:38.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.807+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3790009470 con 0x7f379809d570 2024-02-09T23:58:38.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.807+0000 7f37867fc700 1 -- 172.21.15.89:0/1787641881 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3794005550 con 0x7f379809d570 2024-02-09T23:58:38.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.807+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3798064290 con 0x7f379809d570 2024-02-09T23:58:38.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.808+0000 7f37867fc700 1 -- 172.21.15.89:0/1787641881 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3794010070 con 0x7f379809d570 2024-02-09T23:58:38.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.808+0000 7f37867fc700 1 -- 172.21.15.89:0/1787641881 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3794049d40 con 0x7f379809d570 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.810+0000 7f37b13c2b80 1 Processor -- start 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 -- start start 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c610a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c622a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51c5bea10 con 0x55d51c61d5b0 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51c563e10 con 0x55d51c61d1d0 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d51c5348b0 con 0x55d51c622590 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ced6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ded8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c622a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ced6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54866/0 (socket says 172.21.15.89:54866) 2024-02-09T23:58:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ced6700 1 -- 172.21.15.89:0/580178980 learned_addr learned my addr 172.21.15.89:0/580178980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379d6d7700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c610a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ded8700 1 -- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 msgr2=0x55d51c610a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ded8700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c610a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ded8700 1 -- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 msgr2=0x55d51c61d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.811+0000 7f379ded8700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379ded8700 1 -- 172.21.15.89:0/580178980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d51c5cae20 con 0x55d51c622590 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379ced6700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379d6d7700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c610a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379ded8700 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c622a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f379001b000 tx=0x7f3790016000).ready entity=mon.2 client_cookie=e94227f847973716 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379f93b700 1 -- 172.21.15.89:0/580178980 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000b6c0 con 0x55d51c622590 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379f93b700 1 -- 172.21.15.89:0/580178980 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790021600 con 0x55d51c622590 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f379f93b700 1 -- 172.21.15.89:0/580178980 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3790021960 con 0x55d51c622590 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 -- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 msgr2=0x55d51c622a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c622a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f379001b000 tx=0x7f3790016000).stop 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 -- 172.21.15.89:0/580178980 shutdown_connections 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c622a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c610a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/580178980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c61d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 -- 172.21.15.89:0/580178980 >> 172.21.15.89:0/580178980 conn(0x55d51c5bc970 msgr2=0x55d51c516690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 -- 172.21.15.89:0/580178980 shutdown_connections 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.812+0000 7f37b13c2b80 1 -- 172.21.15.89:0/580178980 wait complete. 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.813+0000 7f37b13c2b80 1 -- start start 2024-02-09T23:58:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.813+0000 7f37b13c2b80 1 Processor -- start 2024-02-09T23:58:38.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d5b0 0x55d51c60e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c60ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51c548180 con 0x55d51c61d1d0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51c5287f0 con 0x55d51c61d5b0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d51c518710 con 0x55d51c622590 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f37b13c2b80 10 client.0 ll_register_callbacks cb 0x55d51c53d570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54880/0 (socket says 172.21.15.89:54880) 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f379d6d7700 1 -- 172.21.15.89:0/1149357370 learned_addr learned my addr 172.21.15.89:0/1149357370 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f379ded8700 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c60ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.814+0000 7f379ced6700 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d5b0 0x55d51c60e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 -- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 msgr2=0x55d51c60ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c60ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 -- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d5b0 msgr2=0x55d51c60e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d5b0 0x55d51c60e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 -- 172.21.15.89:0/1149357370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37880133a0 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f379d6d7700 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3788014000 tx=0x7f3788006eb0).ready entity=mon.0 client_cookie=f07d44619e377180 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3788014750 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f37880148b0 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d51c4bf0c0 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3788014a70 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 10 client.4662 fetch_fsmap learned FSMap version 8 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f3798064290 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d51c4bf0c0 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f3788027020 con 0x55d51c61d1d0 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-02-09T23:58:38.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 10 client.4662 resolve_mds: resolved ID 'b' to GID 4193 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 20 client.4662 populate_metadata read hostname 'smithi089' 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 4 client.4662 mds_command: new command op to 4193 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d51c53e230 con 0x55d51c620990 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.815+0000 7f3773fff700 10 client.4662 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f3773fff700 1 -- 172.21.15.89:0/1149357370 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55d51c53e230 con 0x55d51c620990 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f3773fff700 10 client.4662 handle_command_reply: tid=0 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 client.4662 shutdown 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 msgr2=0x55d51c613e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3788014000 tx=0x7f3788006eb0).stop 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 shutdown_connections 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c60ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d1d0 0x55d51c613e70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/1149357370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d5b0 0x55d51c60e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f3773fff700 0 client.4662 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-09T23:58:38.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 >> 172.21.15.89:0/1149357370 conn(0x55d51c5bc970 msgr2=0x55d51c511f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 shutdown_connections 2024-02-09T23:58:38.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 1 -- 172.21.15.89:0/1149357370 wait complete. 2024-02-09T23:58:38.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.816+0000 7f37b13c2b80 20 client.4662 trim_cache size 0 max 16384 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.832+0000 7f37b13c2b80 1 Processor -- start 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.832+0000 7f37b13c2b80 1 -- start start 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c613840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51c5f0520 con 0x55d51c61d5b0 2024-02-09T23:58:38.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51c61acf0 con 0x55d51c61d1d0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d51c61e180 con 0x55d51c622590 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379ced6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54632/0 (socket says 172.21.15.89:54632) 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379ced6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54894/0 (socket says 172.21.15.89:54894) 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 -- 172.21.15.89:0/2834748848 learned_addr learned my addr 172.21.15.89:0/2834748848 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379ded8700 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c613840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 -- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 msgr2=0x55d51c613840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c613840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 -- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 msgr2=0x55d51c5153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 -- 172.21.15.89:0/2834748848 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980a4190 con 0x55d51c61d1d0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379ced6700 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.833+0000 7f379d6d7700 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f37880135b0 tx=0x7f378801f000).ready entity=mon.1 client_cookie=a12f6e565d2e9962 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f377e7fc700 1 -- 172.21.15.89:0/2834748848 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f378801fe80 con 0x55d51c61d1d0 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f377e7fc700 1 -- 172.21.15.89:0/2834748848 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788014d10 con 0x55d51c61d1d0 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f377e7fc700 1 -- 172.21.15.89:0/2834748848 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3788014940 con 0x55d51c61d1d0 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 msgr2=0x55d51c6195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f37880135b0 tx=0x7f378801f000).stop 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2834748848 shutdown_connections 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c613840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c6195f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2834748848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c5153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2834748848 >> 172.21.15.89:0/2834748848 conn(0x55d51c5bc970 msgr2=0x55d51c612f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2834748848 shutdown_connections 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.834+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2834748848 wait complete. 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 -- start start 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 Processor -- start 2024-02-09T23:58:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c620d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c621260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51c686fd0 con 0x55d51c61d5b0 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51c687290 con 0x55d51c61d1d0 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d51c610c30 con 0x55d51c622590 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f37b13c2b80 10 client.0 ll_register_callbacks cb 0x55d51c616270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f379ded8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c621260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f379d6d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54636/0 (socket says 172.21.15.89:54636) 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.835+0000 7f379d6d7700 1 -- 172.21.15.89:0/2890087829 learned_addr learned my addr 172.21.15.89:0/2890087829 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 -- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 msgr2=0x55d51c686790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 -- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 msgr2=0x55d51c620d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c620d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 -- 172.21.15.89:0/2890087829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790009470 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379d6d7700 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f379ded8700 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c621260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x55d51c60dc30 tx=0x7f379001f000).ready entity=mon.2 client_cookie=5e8a49e597cb760f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.89:3302/0 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f379000b6c0 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mon.2 v2:172.21.15.89:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f379001d040 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3790021600 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37900032e0 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 10 client.4493 fetch_fsmap learned FSMap version 8 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f3798064290 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mon.2 v2:172.21.15.89:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790021600 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mon.2 v2:172.21.15.89:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f3790011bc0 con 0x55d51c622590 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 10 client.4493 fetch_fsmap finished waiting for FSMap version 8 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 10 client.4493 resolve_mds: resolved ID 'b' to GID 4193 2024-02-09T23:58:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 20 client.4493 populate_metadata read hostname 'smithi089' 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 4 client.4493 mds_command: new command op to 4193 tid=0[{"prefix": "status"}] 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d51c536570 con 0x55d51c60d6b0 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.836+0000 7f377d7fa700 10 client.4493 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f377d7fa700 1 -- 172.21.15.89:0/2890087829 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+299 (unknown 0 0 3753224477) 0x55d51c536570 con 0x55d51c60d6b0 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f377d7fa700 10 client.4493 handle_command_reply: tid=0 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 client.4493 shutdown 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 msgr2=0x55d51c621260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c621260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x55d51c60dc30 tx=0x7f379001f000).stop 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 shutdown_connections 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x55d51c622590 0x55d51c621260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55d51c61d1d0 0x55d51c686790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f377d7fa700 0 client.4493 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 --2- 172.21.15.89:0/2890087829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d51c61d5b0 0x55d51c620d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 >> 172.21.15.89:0/2890087829 conn(0x55d51c5bc970 msgr2=0x55d51c613840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 shutdown_connections 2024-02-09T23:58:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 1 -- 172.21.15.89:0/2890087829 wait complete. 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f37b13c2b80 20 client.4493 trim_cache size 0 max 16384 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4193, 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 11.530858536, 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 8, 2024-02-09T23:58:38.847 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 18, 2024-02-09T23:58:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 18, 2024-02-09T23:58:38.848 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 20.077102878000002 2024-02-09T23:58:38.848 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-09T23:58:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 >> v1:172.21.15.89:6816/39389 conn(0x7f3778038ef0 legacy=0x7f377803b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 msgr2=0x7f3798061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 0x7f3798061640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3794000bc0 tx=0x7f37940079e0).stop 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 shutdown_connections 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f37980a4ab0 0x7f3798061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379805e170 0x7f3798065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.837+0000 7f379f93b700 1 --2- 172.21.15.89:0/1787641881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379809d570 0x7f3798061640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.838+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 >> 172.21.15.89:0/1787641881 conn(0x7f37980a93f0 msgr2=0x7f37980a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.838+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 shutdown_connections 2024-02-09T23:58:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.838+0000 7f379f93b700 1 -- 172.21.15.89:0/1787641881 wait complete. 2024-02-09T23:58:38.850 INFO:teuthology.run_tasks:Running task exec... 2024-02-09T23:58:38.864 INFO:teuthology.task.exec:Executing custom commands... 2024-02-09T23:58:38.864 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi089.front.sepia.ceph.com 2024-02-09T23:58:38.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2024-02-09T23:58:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.962+0000 7fcf5e566700 1 Processor -- start 2024-02-09T23:58:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.962+0000 7fcf5e566700 1 -- start start 2024-02-09T23:58:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 0x7fcf580a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5805c8d0 con 0x7fcf580a4ce0 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5805c630 con 0x7fcf5805c150 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5e566700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580a41c0 con 0x7fcf5812ffd0 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5cb03700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 0x7fcf580a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5cb03700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54902/0 (socket says 172.21.15.89:54902) 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40274/0 (socket says 172.21.15.89:40274) 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5cb03700 1 -- 172.21.15.89:0/3672811189 learned_addr learned my addr 172.21.15.89:0/3672811189 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 -- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 msgr2=0x7fcf5805bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 -- 172.21.15.89:0/3672811189 >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 msgr2=0x7fcf58066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 --2- 172.21.15.89:0/3672811189 >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf577fe700 1 -- 172.21.15.89:0/3672811189 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580a4330 con 0x7fcf5805c150 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf57fff700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.963+0000 7fcf5cb03700 1 --2- 172.21.15.89:0/3672811189 >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf577fe700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 0x7fcf580a47f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcf48002f70 tx=0x7fcf48006df0).ready entity=mon.1 client_cookie=2a3f45de170b7ace server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf56ffd700 1 -- 172.21.15.89:0/3672811189 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4800d4a0 con 0x7fcf5805c150 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf56ffd700 1 -- 172.21.15.89:0/3672811189 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48000e90 con 0x7fcf5805c150 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf56ffd700 1 -- 172.21.15.89:0/3672811189 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4800d7f0 con 0x7fcf5805c150 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 -- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 msgr2=0x7fcf580a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 0x7fcf580a47f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcf48002f70 tx=0x7fcf48006df0).stop 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 -- 172.21.15.89:0/3672811189 shutdown_connections 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 --2- 172.21.15.89:0/3672811189 >> v2:172.21.15.89:3300/0 conn(0x7fcf580a4ce0 0x7fcf58066690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf5812ffd0 0x7fcf5805bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 --2- 172.21.15.89:0/3672811189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5805c150 0x7fcf580a47f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 -- 172.21.15.89:0/3672811189 >> 172.21.15.89:0/3672811189 conn(0x7fcf58060aa0 msgr2=0x7fcf580a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:38.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 -- 172.21.15.89:0/3672811189 shutdown_connections 2024-02-09T23:58:38.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.964+0000 7fcf5e566700 1 -- 172.21.15.89:0/3672811189 wait complete. 2024-02-09T23:58:38.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.965+0000 7fcf5e566700 1 Processor -- start 2024-02-09T23:58:38.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.965+0000 7fcf5e566700 1 -- start start 2024-02-09T23:58:38.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 0x7fcf58132420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 0x7fcf58148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:38.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58131730 con 0x7fcf5805c150 2024-02-09T23:58:38.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581312a0 con 0x7fcf5812ffd0 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58135490 con 0x7fcf580a4ce0 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5cb03700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 0x7fcf58148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54906/0 (socket says 172.21.15.89:54906) 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 -- 172.21.15.89:0/1629090140 learned_addr learned my addr 172.21.15.89:0/1629090140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf577fe700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 0x7fcf58132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 -- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 msgr2=0x7fcf58132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 0x7fcf58132420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 -- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 msgr2=0x7fcf58148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 0x7fcf58148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 -- 172.21.15.89:0/1629090140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009530 con 0x7fcf5805c150 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf577fe700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 0x7fcf58132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5cb03700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 0x7fcf58148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:38.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf57fff700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcf4c00c000 tx=0x7fcf4c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c010780 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0108e0 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.966+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c00b180 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.967+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c010c40 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.967+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4800b180 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.967+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcf4c01c460 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.968+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcf4c04ae30 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.968+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58131580 con 0x7fcf5805c150 2024-02-09T23:58:38.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:38.971+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcf4c0336c0 con 0x7fcf5805c150 2024-02-09T23:58:39.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.090+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7fcf581386b0 con 0x7fcf5805c150 2024-02-09T23:58:39.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.406+0000 7fcf557fa700 1 -- 172.21.15.89:0/1629090140 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7fcf4c02b0a0 con 0x7fcf5805c150 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 >> v1:172.21.15.89:6816/39389 conn(0x7fcf38038dd0 legacy=0x7fcf3803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 msgr2=0x7fcf58133030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcf4c00c000 tx=0x7fcf4c006df0).stop 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 shutdown_connections 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf5812ffd0 0x7fcf58148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf5805c150 0x7fcf58133030 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 --2- 172.21.15.89:0/1629090140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcf580a4ce0 0x7fcf58132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 >> 172.21.15.89:0/1629090140 conn(0x7fcf58060aa0 msgr2=0x7fcf580a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 shutdown_connections 2024-02-09T23:58:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.407+0000 7fcf5e566700 1 -- 172.21.15.89:0/1629090140 wait complete. 2024-02-09T23:58:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:set require_min_compat_client to octopus 2024-02-09T23:58:39.420 INFO:teuthology.run_tasks:Running task print... 2024-02-09T23:58:39.429 INFO:teuthology.task.print:**** done ceph 2024-02-09T23:58:39.429 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-09T23:58:39.453 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-09T23:58:39.453 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-09T23:58:39.453 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-09T23:58:39.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-09T23:58:39.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:39.454 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-09T23:58:39.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-09T23:58:39.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:39.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.454 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-02-09T23:58:39.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.477 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2024-02-09T23:58:39.553 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2024-02-09T23:58:39.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:58:39.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.554 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-02-09T23:58:39.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-02-09T23:58:39.651 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-02-09T23:58:39.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T23:58:39.652 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-09T23:58:39.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-09T23:58:39.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.758+0000 7f230990c700 1 Processor -- start 2024-02-09T23:58:39.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.758+0000 7f230990c700 1 -- start start 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 0x7f230405bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 0x7f230405ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230405b970 con 0x7f2304136bf0 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2304136710 con 0x7f230405d370 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f230990c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23041369d0 con 0x7f2304136210 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23037fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 0x7f230405ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f2302ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 0x7f230405bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23037fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54658/0 (socket says 172.21.15.89:54658) 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23037fe700 1 -- 172.21.15.89:0/4241858598 learned_addr learned my addr 172.21.15.89:0/4241858598 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 -- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 msgr2=0x7f23041397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 -- 172.21.15.89:0/4241858598 >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 msgr2=0x7f230405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 --2- 172.21.15.89:0/4241858598 >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 0x7f230405bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 -- 172.21.15.89:0/4241858598 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304136fd0 con 0x7f2304136210 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23037fe700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f2302ffd700 1 --2- 172.21.15.89:0/4241858598 >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 0x7f230405bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f23027fc700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 0x7f230405ce80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f22f8002f70 tx=0x7f22f8006df0).ready entity=mon.2 client_cookie=75b74ad6d2496824 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f2301ffb700 1 -- 172.21.15.89:0/4241858598 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f800d4a0 con 0x7f2304136210 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f2301ffb700 1 -- 172.21.15.89:0/4241858598 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8000e90 con 0x7f2304136210 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.759+0000 7f2301ffb700 1 -- 172.21.15.89:0/4241858598 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f800d7f0 con 0x7f2304136210 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 -- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 msgr2=0x7f230405ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 0x7f230405ce80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f22f8002f70 tx=0x7f22f8006df0).stop 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 -- 172.21.15.89:0/4241858598 shutdown_connections 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23041397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 --2- 172.21.15.89:0/4241858598 >> v2:172.21.15.89:3300/0 conn(0x7f2304136bf0 0x7f230405bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 --2- 172.21.15.89:0/4241858598 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136210 0x7f230405ce80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 -- 172.21.15.89:0/4241858598 >> 172.21.15.89:0/4241858598 conn(0x7f2304066a50 msgr2=0x7f230406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 -- 172.21.15.89:0/4241858598 shutdown_connections 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.760+0000 7f230990c700 1 -- 172.21.15.89:0/4241858598 wait complete. 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 Processor -- start 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 -- start start 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23040a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2304136210 0x7f23041493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 0x7f23041498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040a6950 con 0x7f2304136210 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040a4740 con 0x7f230405d370 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f230990c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23040a3cc0 con 0x7f2304136bf0 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f2302ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23040a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f2302ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23040a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54660/0 (socket says 172.21.15.89:54660) 2024-02-09T23:58:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f23037fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 0x7f23041498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.761+0000 7f2302ffd700 1 -- 172.21.15.89:0/2820681333 learned_addr learned my addr 172.21.15.89:0/2820681333 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23027fc700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2304136210 0x7f23041493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 -- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 msgr2=0x7f23040a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23040a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 -- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2304136210 msgr2=0x7f23041493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2304136210 0x7f23041493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 -- 172.21.15.89:0/2820681333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc009530 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f23037fe700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 0x7f23041498d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f23040a6a90 tx=0x7f22fc009290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22fc00c770 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc00c8d0 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f400b180 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22fc00cc30 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.762+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f800b180 con 0x7f2304136bf0 2024-02-09T23:58:39.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.763+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f22fc022070 con 0x7f2304136bf0 2024-02-09T23:58:39.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.763+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040a5330 con 0x7f2304136bf0 2024-02-09T23:58:39.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.763+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f22fc04aed0 con 0x7f2304136bf0 2024-02-09T23:58:39.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.766+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f22fc033800 con 0x7f2304136bf0 2024-02-09T23:58:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.905+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2304060150 con 0x7f2304136bf0 2024-02-09T23:58:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.905+0000 7f22f3fff700 1 -- 172.21.15.89:0/2820681333 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f22fc0333f0 con 0x7f2304136bf0 2024-02-09T23:58:39.908 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.906+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 >> v1:172.21.15.89:6816/39389 conn(0x7f22e0038da0 legacy=0x7f22e003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.906+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 msgr2=0x7f23041498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 0x7f23041498d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f23040a6a90 tx=0x7f22fc009290).stop 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 shutdown_connections 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2304136bf0 0x7f23041498d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f230405d370 0x7f23040a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 --2- 172.21.15.89:0/2820681333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2304136210 0x7f23041493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 >> 172.21.15.89:0/2820681333 conn(0x7f2304066a50 msgr2=0x7f23040acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:39.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 shutdown_connections 2024-02-09T23:58:39.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:39.907+0000 7f230990c700 1 -- 172.21.15.89:0/2820681333 wait complete. 2024-02-09T23:58:39.919 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-09T23:58:39.919 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-09T23:58:39.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-02-09T23:58:39.919 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-09T23:58:39.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:39.920 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-09T23:58:39.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-09T23:58:39.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-09T23:58:39.920 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-09T23:58:39.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.920 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-02-09T23:58:39.942 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-02-09T23:58:39.943 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42099sec preferred_lft 42099sec 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:39.944 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-09T23:58:39.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-09T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-02-09T23:58:40.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.117 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-09T23:58:40.149 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-02-09T23:58:40.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.150 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-02-09T23:58:40.243 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-02-09T23:58:40.244 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-09T23:58:40.244 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-09T23:58:40.244 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-09T23:58:40.244 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-09T23:58:40.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-09T23:58:40.245 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-02-09T23:58:40.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.514 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-02-09T23:58:40.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.532 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-02-09T23:58:40.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.590 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2024-02-09T23:58:40.590 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-02-09T23:58:40.590 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-09T23:58:40.590 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-09T23:58:40.590 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-02-09T23:58:40.684 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-09T23:58:40.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-09T23:58:40.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-09T23:58:40.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-09T23:58:40.685 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-02-09T23:58:40.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:40.890 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2024-02-09T23:58:40.890 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-02-09T23:58:40.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-02-09T23:58:40.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-02-09T23:58:40.890 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-02-09T23:58:40.989 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-09T23:58:40.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-09T23:58:40.989 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-09T23:58:41.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-09T23:58:41.010 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:41.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-02-09T23:58:41.145 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-02-09T23:58:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-02-09T23:58:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-02-09T23:58:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/systemd 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/rdma 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/memory 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/freezer 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/devices 2024-02-09T23:58:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/perf_event 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/pids 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/cpuset 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/hugetlb 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/blkio 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-02-09T23:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-09T23:58:41.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:41.209 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-02-09T23:58:41.268 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-09T23:58:41.268 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-09T23:58:41.312 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-02-09T23:58:41.339 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-02-09T23:58:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-02-09T23:58:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-02-09T23:58:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-02-09T23:58:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/systemd 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/rdma 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/memory 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/freezer 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/devices 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/perf_event 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/pids 2024-02-09T23:58:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/cpuset 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/hugetlb 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup/blkio 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-02-09T23:58:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-02-09T23:58:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-02-09T23:58:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-02-09T23:58:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-09T23:58:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-09T23:58:41.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:41.401 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-02-09T23:58:41.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:2024-02-09T23:58:41.400+0000 7ff578211200 -1 init, newargv = 0x56089a19f350 newargc=9 2024-02-09T23:58:41.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[37214]: starting ceph client 2024-02-09T23:58:41.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[37214]: starting fuse 2024-02-09T23:58:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:46 2024-02-09T23:58:41.420 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-09T23:58:41.420 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-02-09T23:58:41.421 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-02-09T23:58:41.422 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-09T23:58:41.422 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-09T23:58:41.422 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.0")) 2024-02-09T23:58:41.422 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-02-09T23:58:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.0.37214.asok 2024-02-09T23:58:41.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-09T23:58:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-09T23:58:41.551 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37214.asok 2024-02-09T23:58:41.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:41.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37214.asok status 2024-02-09T23:58:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "0", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "37214", 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/" 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4686, 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-02-09T23:58:41.691 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4686 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3331993086 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-02-09T23:58:41.692 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3331993086 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4686 172.21.15.164:0/3331993086", 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "172.21.15.164:0/3331993086", 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 1, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 8, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 19, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "blacklisted": false, 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2024-02-09T23:58:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-02-09T23:58:41.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-09T23:58:41.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.811+0000 7fdfbdcd7700 1 Processor -- start 2024-02-09T23:58:41.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.811+0000 7fdfbdcd7700 1 -- start start 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb80a02c0 0x7fdfb80a0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80a1f10 con 0x7fdfb80a02c0 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80a0f60 con 0x7fdfb805dfb0 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfbdcd7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80a1200 con 0x7fdfb809f5d0 2024-02-09T23:58:41.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb80a02c0 0x7fdfb80a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40308/0 (socket says 172.21.15.89:40308) 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb6ffd700 1 -- 172.21.15.89:0/2564528584 learned_addr learned my addr 172.21.15.89:0/2564528584 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54672/0 (socket says 172.21.15.89:54672) 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 -- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 msgr2=0x7fdfb809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 -- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 msgr2=0x7fdfb80a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 -- 172.21.15.89:0/2564528584 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8060520 con 0x7fdfb80a02c0 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb6ffd700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb77fe700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-09T23:58:41.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb7fff700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb80a02c0 0x7fdfb80a0720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdfb00032f0 tx=0x7fdfb00090f0).ready entity=mon.0 client_cookie=93dec3d03c9aaefe server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb67fc700 1 -- 172.21.15.89:0/2564528584 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb000cab0 con 0x7fdfb80a02c0 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb67fc700 1 -- 172.21.15.89:0/2564528584 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000cc10 con 0x7fdfb80a02c0 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.812+0000 7fdfb67fc700 1 -- 172.21.15.89:0/2564528584 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb000f460 con 0x7fdfb80a02c0 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb80a02c0 msgr2=0x7fdfb80a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb80a02c0 0x7fdfb80a0720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdfb00032f0 tx=0x7fdfb00090f0).stop 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/2564528584 shutdown_connections 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb80a02c0 0x7fdfb80a0720 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb805dfb0 0x7fdfb80a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/2564528584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/2564528584 >> 172.21.15.89:0/2564528584 conn(0x7fdfb80a93f0 msgr2=0x7fdfb80a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/2564528584 shutdown_connections 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.813+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/2564528584 wait complete. 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.814+0000 7fdfbdcd7700 1 Processor -- start 2024-02-09T23:58:41.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.814+0000 7fdfbdcd7700 1 -- start start 2024-02-09T23:58:41.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb805dfb0 0x7fdfb8144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb80a02c0 0x7fdfb8145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8145d80 con 0x7fdfb805dfb0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80947f0 con 0x7fdfb80a02c0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80954b0 con 0x7fdfb809f5d0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40322/0 (socket says 172.21.15.89:40322) 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 -- 172.21.15.89:0/500044781 learned_addr learned my addr 172.21.15.89:0/500044781 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb77fe700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb805dfb0 0x7fdfb8144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb7fff700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb80a02c0 0x7fdfb8145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 -- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb80a02c0 msgr2=0x7fdfb8145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb80a02c0 0x7fdfb8145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 -- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb805dfb0 msgr2=0x7fdfb8144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb805dfb0 0x7fdfb8144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 -- 172.21.15.89:0/500044781 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac00b180 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb6ffd700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fdfb80934d0 tx=0x7fdfa800f040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8010870 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8013040 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa800d660 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8010bc0 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.815+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb000b520 con 0x7fdfb809f5d0 2024-02-09T23:58:41.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.816+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdfa801f030 con 0x7fdfb809f5d0 2024-02-09T23:58:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.816+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdfa804e8a0 con 0x7fdfb809f5d0 2024-02-09T23:58:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.816+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8095e40 con 0x7fdfb809f5d0 2024-02-09T23:58:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.820+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdfa8033b00 con 0x7fdfb809f5d0 2024-02-09T23:58:41.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.960+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfb80a62d0 con 0x7fdfb809f5d0 2024-02-09T23:58:41.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.961+0000 7fdfb4ff9700 1 -- 172.21.15.89:0/500044781 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfa802a070 con 0x7fdfb809f5d0 2024-02-09T23:58:41.963 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-09T23:58:41.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 >> v1:172.21.15.89:6816/39389 conn(0x7fdf98038da0 legacy=0x7fdf9803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 msgr2=0x7fdfb81453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fdfb80934d0 tx=0x7fdfa800f040).stop 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 shutdown_connections 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb80a02c0 0x7fdfb8145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb805dfb0 0x7fdfb8144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 --2- 172.21.15.89:0/500044781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdfb809f5d0 0x7fdfb81453a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 >> 172.21.15.89:0/500044781 conn(0x7fdfb80a93f0 msgr2=0x7fdfb809e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 shutdown_connections 2024-02-09T23:58:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-09T23:58:41.962+0000 7fdfbdcd7700 1 -- 172.21.15.89:0/500044781 wait complete. 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-09T23:58:41.975 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-09T23:58:41.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:41.975 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-02-09T23:58:41.998 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-09T23:58:41.999 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-02-09T23:58:42.000 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-09T23:58:42.000 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42095sec preferred_lft 42095sec 2024-02-09T23:58:42.000 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-02-09T23:58:42.000 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-02-09T23:58:42.000 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-09T23:58:42.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.000 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-02-09T23:58:42.000 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-02-09T23:58:42.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2024-02-09T23:58:42.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2024-02-09T23:58:42.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2024-02-09T23:58:42.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-09T23:58:42.001 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-02-09T23:58:42.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.181 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-09T23:58:42.214 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-02-09T23:58:42.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.216 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-09T23:58:42.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-09T23:58:42.293 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-02-09T23:58:42.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.558 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-02-09T23:58:42.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.576 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2024-02-09T23:58:42.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.633 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-02-09T23:58:42.633 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-02-09T23:58:42.633 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-09T23:58:42.633 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-09T23:58:42.633 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-02-09T23:58:42.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-09T23:58:42.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.725 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-09T23:58:42.726 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-02-09T23:58:42.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:42.912 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-02-09T23:58:42.912 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-02-09T23:58:42.912 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2024-02-09T23:58:42.912 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2024-02-09T23:58:42.912 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-02-09T23:58:43.008 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-09T23:58:43.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-09T23:58:43.008 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:43.025 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-09T23:58:43.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-09T23:58:43.026 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:43.082 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-02-09T23:58:43.149 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-02-09T23:58:43.207 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/systemd 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-02-09T23:58:43.208 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/devices 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/memory 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/rdma 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/perf_event 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/hugetlb 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/blkio 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/freezer 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/cpuset 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/pids 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-02-09T23:58:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-09T23:58:43.210 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-09T23:58:43.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.211 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-02-09T23:58:43.267 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-09T23:58:43.267 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-09T23:58:43.310 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-02-09T23:58:43.336 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-02-09T23:58:43.394 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/systemd 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/devices 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/memory 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/rdma 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/perf_event 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/hugetlb 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/blkio 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/freezer 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/cpuset 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/pids 2024-02-09T23:58:43.395 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-02-09T23:58:43.396 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-09T23:58:43.397 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-09T23:58:43.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.397 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-02-09T23:58:43.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-02-09T23:58:43.425+0000 7ff803847200 -1 init, newargv = 0x5580f1a421b0 newargc=9 2024-02-09T23:58:43.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[37237]: starting ceph client 2024-02-09T23:58:43.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[37237]: starting fuse 2024-02-09T23:58:43.445 INFO:teuthology.orchestra.run.smithi183.stdout:47 2024-02-09T23:58:43.445 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-02-09T23:58:43.446 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-02-09T23:58:43.447 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-02-09T23:58:43.567 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.37237.asok 2024-02-09T23:58:43.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-02-09T23:58:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-09T23:58:43.576 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37237.asok 2024-02-09T23:58:43.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.576 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37237.asok status 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "37237", 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-02-09T23:58:43.715 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4520, 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4520 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "172.21.15.183:0", 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 432961506 2024-02-09T23:58:43.716 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "172.21.15.183:0", 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 432961506 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4520 172.21.15.183:0/432961506", 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "172.21.15.183:0/432961506", 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 8, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 19, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "blacklisted": false, 2024-02-09T23:58:43.717 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-02-09T23:58:43.718 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-02-09T23:58:43.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.724 DEBUG:teuthology.orchestra.run.smithi164:> stat --file-system '--printf=%T 2024-02-09T23:58:43.724 DEBUG:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:43.746 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2024-02-09T23:58:43.746 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:43.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:43.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.821 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-02-09T23:58:43.821 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:43.840 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-02-09T23:58:43.840 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:43.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-09T23:58:43.840 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:48.772 INFO:teuthology.run_tasks:Running task print... 2024-02-09T23:58:48.782 INFO:teuthology.task.print:**** done octopus client 2024-02-09T23:58:48.782 INFO:teuthology.run_tasks:Running task workunit... 2024-02-09T23:58:48.794 INFO:tasks.workunit:Pulling workunits from ref 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:58:48.794 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-09T23:58:48.795 INFO:tasks.workunit:timeout=3h 2024-02-09T23:58:48.795 INFO:tasks.workunit:cleanup=True 2024-02-09T23:58:48.795 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 2eh/46d Inode: 1 Links: 2 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-02-09 23:58:27.307749140 +0000 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-02-09 23:58:48.768291777 +0000 2024-02-09T23:58:48.821 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-02-09T23:58:48.822 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-09T23:58:48.822 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-09T23:58:48.902 DEBUG:teuthology.orchestra.run.smithi183:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:48.926 INFO:teuthology.orchestra.run.smithi183.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:48.926 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-09T23:58:48.926 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 2fh/47d Inode: 1 Links: 3 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-02-09 23:58:48.895012509 +0000 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-02-09 23:58:48.895012509 +0000 2024-02-09T23:58:48.927 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2024-02-09T23:58:48.927 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-09T23:58:48.927 DEBUG:teuthology.orchestra.run.smithi183:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-09T23:58:49.004 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:58:49.005 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 2024-02-09T23:58:49.026 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-09T23:58:49.065 INFO:tasks.workunit.client.1.smithi183.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-09T23:59:37.380 INFO:tasks.workunit.client.1.smithi183.stderr:Note: switching to '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'. 2024-02-09T23:59:37.380 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:state without impacting any branches by switching back to a branch. 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr: git switch -c 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.381 INFO:tasks.workunit.client.1.smithi183.stderr:Or undo this operation with: 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr: git switch - 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr: 2024-02-09T23:59:37.382 INFO:tasks.workunit.client.1.smithi183.stderr:HEAD is now at 290212a1bfd Merge pull request #53521 from xxhdx1985126/wip-62857 2024-02-09T23:59:37.384 DEBUG:teuthology.orchestra.run.smithi183:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-09T23:59:37.450 INFO:tasks.workunit.client.1.smithi183.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-09T23:59:37.452 INFO:tasks.workunit.client.1.smithi183.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-09T23:59:37.452 INFO:tasks.workunit.client.1.smithi183.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-09T23:59:38.048 INFO:tasks.workunit.client.1.smithi183.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-09T23:59:38.114 INFO:tasks.workunit.client.1.smithi183.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-09T23:59:38.153 INFO:tasks.workunit.client.1.smithi183.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-09T23:59:38.154 INFO:tasks.workunit.client.1.smithi183.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-09T23:59:38.154 INFO:tasks.workunit.client.1.smithi183.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-09T23:59:38.190 INFO:tasks.workunit.client.1.smithi183.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-09T23:59:38.194 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-09T23:59:38.194 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-09T23:59:38.252 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-09T23:59:38.253 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-09T23:59:38.254 DEBUG:teuthology.orchestra.run.smithi183:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-09T23:59:38.324 INFO:tasks.workunit.client.1.smithi183.stderr:+ mkdir -p fsstress 2024-02-09T23:59:38.326 INFO:tasks.workunit.client.1.smithi183.stderr:+ pushd fsstress 2024-02-09T23:59:38.327 INFO:tasks.workunit.client.1.smithi183.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-09T23:59:38.327 INFO:tasks.workunit.client.1.smithi183.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-09T23:59:39.145 INFO:tasks.workunit.client.1.smithi183.stderr:+ tar xzf ltp-full.tgz 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:Note: switching to '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'. 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:state without impacting any branches by switching back to a branch. 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-09T23:59:40.738 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: git switch -c 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr:Or undo this operation with: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: git switch - 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-02-09T23:59:40.739 INFO:tasks.workunit.client.0.smithi164.stderr:HEAD is now at 290212a1bfd Merge pull request #53521 from xxhdx1985126/wip-62857 2024-02-09T23:59:40.742 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-09T23:59:40.810 INFO:tasks.workunit.client.0.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-09T23:59:40.812 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-09T23:59:40.812 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-09T23:59:41.369 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-09T23:59:41.427 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-09T23:59:41.465 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-09T23:59:41.466 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-09T23:59:41.467 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-09T23:59:41.503 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-09T23:59:41.506 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-09T23:59:41.506 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-09T23:59:41.565 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-09T23:59:41.566 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-09T23:59:41.566 DEBUG:teuthology.orchestra.run.smithi164:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=290212a1bfd33563ba76ee5b7f0b944fdb6c5d90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-09T23:59:41.662 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir -p fsstress 2024-02-09T23:59:41.664 INFO:tasks.workunit.client.0.smithi164.stderr:+ pushd fsstress 2024-02-09T23:59:41.665 INFO:tasks.workunit.client.0.smithi164.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-09T23:59:41.665 INFO:tasks.workunit.client.0.smithi164.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-09T23:59:42.273 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar xzf ltp-full.tgz 2024-02-10T00:00:18.660 INFO:tasks.workunit.client.1.smithi183.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-10T00:00:18.663 INFO:tasks.workunit.client.1.smithi183.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-10T00:00:18.664 INFO:tasks.workunit.client.1.smithi183.stderr:+ make 2024-02-10T00:00:18.780 INFO:tasks.workunit.client.1.smithi183.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-10T00:00:19.088 INFO:tasks.workunit.client.1.smithi183.stderr:++ readlink -f fsstress 2024-02-10T00:00:19.089 INFO:tasks.workunit.client.1.smithi183.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-10T00:00:19.090 INFO:tasks.workunit.client.1.smithi183.stderr:+ popd 2024-02-10T00:00:19.091 INFO:tasks.workunit.client.1.smithi183.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-10T00:00:19.091 INFO:tasks.workunit.client.1.smithi183.stderr:+ popd 2024-02-10T00:00:19.091 INFO:tasks.workunit.client.1.smithi183.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-10T00:00:19.091 INFO:tasks.workunit.client.1.smithi183.stderr:++ mktemp -d -p . 2024-02-10T00:00:19.094 INFO:tasks.workunit.client.1.smithi183.stderr:+ T=./tmp.9LyH0pqMLK 2024-02-10T00:00:19.094 INFO:tasks.workunit.client.1.smithi183.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.9LyH0pqMLK -l 1 -n 1000 -p 10 -v 2024-02-10T00:00:19.097 INFO:tasks.workunit.client.1.smithi183.stdout:seed = 1707590727 2024-02-10T00:00:19.100 INFO:tasks.workunit.client.1.smithi183.stdout:0/0: dwrite - no filename 2024-02-10T00:00:19.102 INFO:tasks.workunit.client.1.smithi183.stdout:0/1: symlink l0 0 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/0: mkdir d0 0 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/1: write - no filename 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/2: truncate - no filename 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/3: rename d0 to d0/d1 22 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/4: fdatasync - no filename 2024-02-10T00:00:19.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/5: chown d0 2276484 1 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/0: truncate - no filename 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/1: unlink - no file 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/2: dwrite - no filename 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/3: dwrite - no filename 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/4: stat - no entries 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/5: dread - no filename 2024-02-10T00:00:19.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/6: dread - no filename 2024-02-10T00:00:19.107 INFO:tasks.workunit.client.1.smithi183.stdout:2/0: creat f0 x:0 0 0 2024-02-10T00:00:19.108 INFO:tasks.workunit.client.1.smithi183.stdout:1/6: symlink d0/l2 0 2024-02-10T00:00:19.112 INFO:tasks.workunit.client.1.smithi183.stdout:5/0: fdatasync - no filename 2024-02-10T00:00:19.112 INFO:tasks.workunit.client.1.smithi183.stdout:5/1: dread - no filename 2024-02-10T00:00:19.112 INFO:tasks.workunit.client.1.smithi183.stdout:5/2: dread - no filename 2024-02-10T00:00:19.112 INFO:tasks.workunit.client.1.smithi183.stdout:0/2: getdents . 0 2024-02-10T00:00:19.115 INFO:tasks.workunit.client.1.smithi183.stdout:2/1: symlink l1 0 2024-02-10T00:00:19.116 INFO:tasks.workunit.client.1.smithi183.stdout:1/7: mkdir d0/d3 0 2024-02-10T00:00:19.116 INFO:tasks.workunit.client.1.smithi183.stdout:1/8: fdatasync - no filename 2024-02-10T00:00:19.116 INFO:tasks.workunit.client.1.smithi183.stdout:1/9: write - no filename 2024-02-10T00:00:19.116 INFO:tasks.workunit.client.1.smithi183.stdout:1/10: chown d0/l2 0 1 2024-02-10T00:00:19.118 INFO:tasks.workunit.client.1.smithi183.stdout:6/0: write - no filename 2024-02-10T00:00:19.118 INFO:tasks.workunit.client.1.smithi183.stdout:6/1: readlink - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/2: dwrite - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/3: fdatasync - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/4: dread - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/5: read - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/6: rename - no filename 2024-02-10T00:00:19.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/7: write - no filename 2024-02-10T00:00:19.120 INFO:tasks.workunit.client.1.smithi183.stdout:0/3: creat f1 x:0 0 0 2024-02-10T00:00:19.120 INFO:tasks.workunit.client.1.smithi183.stdout:0/4: rmdir - no directory 2024-02-10T00:00:19.120 INFO:tasks.workunit.client.1.smithi183.stdout:4/0: creat f0 x:0 0 0 2024-02-10T00:00:19.120 INFO:tasks.workunit.client.1.smithi183.stdout:5/3: creat f0 x:0 0 0 2024-02-10T00:00:19.123 INFO:tasks.workunit.client.1.smithi183.stdout:2/2: dwrite f0 [0,4194304] 0 2024-02-10T00:00:19.125 INFO:tasks.workunit.client.1.smithi183.stdout:6/8: mknod c0 0 2024-02-10T00:00:19.125 INFO:tasks.workunit.client.1.smithi183.stdout:6/9: truncate - no filename 2024-02-10T00:00:19.129 INFO:tasks.workunit.client.1.smithi183.stdout:8/0: truncate - no filename 2024-02-10T00:00:19.129 INFO:tasks.workunit.client.1.smithi183.stdout:8/1: dread - no filename 2024-02-10T00:00:19.130 INFO:tasks.workunit.client.1.smithi183.stdout:0/5: fsync f1 0 2024-02-10T00:00:19.131 INFO:tasks.workunit.client.1.smithi183.stdout:0/6: chown l0 15 1 2024-02-10T00:00:19.132 INFO:tasks.workunit.client.1.smithi183.stdout:5/4: link f0 f1 0 2024-02-10T00:00:19.134 INFO:tasks.workunit.client.1.smithi183.stdout:2/3: mkdir d2 0 2024-02-10T00:00:19.134 INFO:tasks.workunit.client.1.smithi183.stdout:2/4: chown l1 14 1 2024-02-10T00:00:19.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/11: link d0/l2 d0/d3/l4 0 2024-02-10T00:00:19.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/12: chown d0 7685 1 2024-02-10T00:00:19.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/13: chown d0 1354 1 2024-02-10T00:00:19.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/14: dread - no filename 2024-02-10T00:00:19.136 INFO:tasks.workunit.client.1.smithi183.stdout:6/10: mknod c1 0 2024-02-10T00:00:19.136 INFO:tasks.workunit.client.1.smithi183.stdout:6/11: truncate - no filename 2024-02-10T00:00:19.136 INFO:tasks.workunit.client.1.smithi183.stdout:6/12: fdatasync - no filename 2024-02-10T00:00:19.137 INFO:tasks.workunit.client.1.smithi183.stdout:6/13: dread - no filename 2024-02-10T00:00:19.137 INFO:tasks.workunit.client.1.smithi183.stdout:7/0: mkdir d0 0 2024-02-10T00:00:19.138 INFO:tasks.workunit.client.1.smithi183.stdout:9/0: dwrite - no filename 2024-02-10T00:00:19.138 INFO:tasks.workunit.client.1.smithi183.stdout:9/1: dread - no filename 2024-02-10T00:00:19.139 INFO:tasks.workunit.client.1.smithi183.stdout:0/7: unlink l0 0 2024-02-10T00:00:19.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/15: symlink d0/l5 0 2024-02-10T00:00:19.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/16: dread - no filename 2024-02-10T00:00:19.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/17: read - no filename 2024-02-10T00:00:19.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/18: fdatasync - no filename 2024-02-10T00:00:19.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/19: dread - no filename 2024-02-10T00:00:19.142 INFO:tasks.workunit.client.1.smithi183.stdout:4/1: truncate f0 165757 0 2024-02-10T00:00:19.143 INFO:tasks.workunit.client.1.smithi183.stdout:6/14: mkdir d2 0 2024-02-10T00:00:19.143 INFO:tasks.workunit.client.1.smithi183.stdout:8/2: mkdir d0 0 2024-02-10T00:00:19.144 INFO:tasks.workunit.client.1.smithi183.stdout:8/3: dwrite - no filename 2024-02-10T00:00:19.146 INFO:tasks.workunit.client.1.smithi183.stdout:0/8: rename f1 to f2 0 2024-02-10T00:00:19.150 INFO:tasks.workunit.client.1.smithi183.stdout:4/2: mknod c1 0 2024-02-10T00:00:19.152 INFO:tasks.workunit.client.1.smithi183.stdout:7/1: creat d0/f1 x:0 0 0 2024-02-10T00:00:19.156 INFO:tasks.workunit.client.1.smithi183.stdout:9/2: getdents . 0 2024-02-10T00:00:19.156 INFO:tasks.workunit.client.1.smithi183.stdout:9/3: rename - no filename 2024-02-10T00:00:19.156 INFO:tasks.workunit.client.1.smithi183.stdout:9/4: chown . 43133966 1 2024-02-10T00:00:19.156 INFO:tasks.workunit.client.1.smithi183.stdout:9/5: dread - no filename 2024-02-10T00:00:19.157 INFO:tasks.workunit.client.1.smithi183.stdout:9/6: truncate - no filename 2024-02-10T00:00:19.157 INFO:tasks.workunit.client.1.smithi183.stdout:9/7: write - no filename 2024-02-10T00:00:19.159 INFO:tasks.workunit.client.1.smithi183.stdout:0/9: creat f3 x:0 0 0 2024-02-10T00:00:19.159 INFO:tasks.workunit.client.1.smithi183.stdout:2/5: link l1 d2/l3 0 2024-02-10T00:00:19.159 INFO:tasks.workunit.client.1.smithi183.stdout:0/10: dread - f2 zero size 2024-02-10T00:00:19.160 INFO:tasks.workunit.client.1.smithi183.stdout:0/11: fdatasync f3 0 2024-02-10T00:00:19.160 INFO:tasks.workunit.client.1.smithi183.stdout:0/12: write f3 [732045,82794] 0 2024-02-10T00:00:19.160 INFO:tasks.workunit.client.1.smithi183.stdout:1/20: symlink d0/d3/l6 0 2024-02-10T00:00:19.160 INFO:tasks.workunit.client.1.smithi183.stdout:0/13: rmdir - no directory 2024-02-10T00:00:19.161 INFO:tasks.workunit.client.1.smithi183.stdout:5/5: truncate f0 202156 0 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:7/2: mkdir d0/d2 0 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:8/4: getdents d0 0 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:8/5: write - no filename 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:8/6: truncate - no filename 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:8/7: dread - no filename 2024-02-10T00:00:19.163 INFO:tasks.workunit.client.1.smithi183.stdout:8/8: write - no filename 2024-02-10T00:00:19.165 INFO:tasks.workunit.client.1.smithi183.stdout:1/21: mkdir d0/d3/d7 0 2024-02-10T00:00:19.166 INFO:tasks.workunit.client.1.smithi183.stdout:9/8: getdents . 0 2024-02-10T00:00:19.166 INFO:tasks.workunit.client.1.smithi183.stdout:9/9: write - no filename 2024-02-10T00:00:19.167 INFO:tasks.workunit.client.1.smithi183.stdout:9/10: truncate - no filename 2024-02-10T00:00:19.167 INFO:tasks.workunit.client.1.smithi183.stdout:9/11: chown . 68682199 1 2024-02-10T00:00:19.167 INFO:tasks.workunit.client.1.smithi183.stdout:9/12: fdatasync - no filename 2024-02-10T00:00:19.168 INFO:tasks.workunit.client.1.smithi183.stdout:2/6: mknod d2/c4 0 2024-02-10T00:00:19.168 INFO:tasks.workunit.client.1.smithi183.stdout:2/7: chown f0 11213649 1 2024-02-10T00:00:19.168 INFO:tasks.workunit.client.1.smithi183.stdout:1/22: mknod d0/c8 0 2024-02-10T00:00:19.169 INFO:tasks.workunit.client.1.smithi183.stdout:4/3: link c1 c2 0 2024-02-10T00:00:19.170 INFO:tasks.workunit.client.1.smithi183.stdout:7/3: mkdir d0/d2/d3 0 2024-02-10T00:00:19.171 INFO:tasks.workunit.client.1.smithi183.stdout:8/9: creat d0/f1 x:0 0 0 2024-02-10T00:00:19.172 INFO:tasks.workunit.client.1.smithi183.stdout:2/8: mkdir d2/d5 0 2024-02-10T00:00:19.174 INFO:tasks.workunit.client.1.smithi183.stdout:1/23: mkdir d0/d9 0 2024-02-10T00:00:19.174 INFO:tasks.workunit.client.1.smithi183.stdout:4/4: creat f3 x:0 0 0 2024-02-10T00:00:19.177 INFO:tasks.workunit.client.1.smithi183.stdout:9/13: mkdir d0 0 2024-02-10T00:00:19.177 INFO:tasks.workunit.client.1.smithi183.stdout:9/14: unlink - no file 2024-02-10T00:00:19.177 INFO:tasks.workunit.client.1.smithi183.stdout:9/15: dread - no filename 2024-02-10T00:00:19.177 INFO:tasks.workunit.client.1.smithi183.stdout:9/16: dwrite - no filename 2024-02-10T00:00:19.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/17: rename d0 to d0/d1 22 2024-02-10T00:00:19.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/18: write - no filename 2024-02-10T00:00:19.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/19: stat d0 0 2024-02-10T00:00:19.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/20: rename d0 to d0/d2 22 2024-02-10T00:00:19.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/21: dwrite - no filename 2024-02-10T00:00:19.179 INFO:tasks.workunit.client.1.smithi183.stdout:7/4: mkdir d0/d2/d4 0 2024-02-10T00:00:19.180 INFO:tasks.workunit.client.1.smithi183.stdout:8/10: mknod d0/c2 0 2024-02-10T00:00:19.182 INFO:tasks.workunit.client.1.smithi183.stdout:1/24: creat d0/d3/fa x:0 0 0 2024-02-10T00:00:19.183 INFO:tasks.workunit.client.1.smithi183.stdout:4/5: stat c2 0 2024-02-10T00:00:19.186 INFO:tasks.workunit.client.1.smithi183.stdout:8/11: dwrite d0/f1 [0,4194304] 0 2024-02-10T00:00:19.186 INFO:tasks.workunit.client.1.smithi183.stdout:1/25: symlink d0/d3/lb 0 2024-02-10T00:00:19.186 INFO:tasks.workunit.client.1.smithi183.stdout:5/6: link f0 f2 0 2024-02-10T00:00:19.187 INFO:tasks.workunit.client.1.smithi183.stdout:9/22: mkdir d0/d3 0 2024-02-10T00:00:19.189 INFO:tasks.workunit.client.1.smithi183.stdout:7/5: creat d0/d2/d4/f5 x:0 0 0 2024-02-10T00:00:19.190 INFO:tasks.workunit.client.1.smithi183.stdout:7/6: fsync d0/f1 0 2024-02-10T00:00:19.190 INFO:tasks.workunit.client.1.smithi183.stdout:2/9: rmdir d2/d5 0 2024-02-10T00:00:19.192 INFO:tasks.workunit.client.1.smithi183.stdout:2/10: write f0 [1758169,90001] 0 2024-02-10T00:00:19.192 INFO:tasks.workunit.client.1.smithi183.stdout:7/7: write d0/f1 [590421,3202] 0 2024-02-10T00:00:19.193 INFO:tasks.workunit.client.1.smithi183.stdout:8/12: dwrite d0/f1 [0,4194304] 0 2024-02-10T00:00:19.194 INFO:tasks.workunit.client.1.smithi183.stdout:8/13: readlink - no filename 2024-02-10T00:00:19.196 INFO:tasks.workunit.client.1.smithi183.stdout:2/11: dread f0 [0,4194304] 0 2024-02-10T00:00:19.197 INFO:tasks.workunit.client.1.smithi183.stdout:1/26: mknod d0/d3/cc 0 2024-02-10T00:00:19.198 INFO:tasks.workunit.client.1.smithi183.stdout:5/7: chown f2 10672440 1 2024-02-10T00:00:19.204 INFO:tasks.workunit.client.1.smithi183.stdout:7/8: mknod d0/c6 0 2024-02-10T00:00:19.204 INFO:tasks.workunit.client.1.smithi183.stdout:7/9: fsync d0/f1 0 2024-02-10T00:00:19.205 INFO:tasks.workunit.client.1.smithi183.stdout:7/10: write d0/d2/d4/f5 [46074,8988] 0 2024-02-10T00:00:19.205 INFO:tasks.workunit.client.1.smithi183.stdout:2/12: creat d2/f6 x:0 0 0 2024-02-10T00:00:19.208 INFO:tasks.workunit.client.1.smithi183.stdout:1/27: mknod d0/d3/cd 0 2024-02-10T00:00:19.209 INFO:tasks.workunit.client.1.smithi183.stdout:5/8: creat f3 x:0 0 0 2024-02-10T00:00:19.209 INFO:tasks.workunit.client.1.smithi183.stdout:9/23: symlink d0/d3/l4 0 2024-02-10T00:00:19.209 INFO:tasks.workunit.client.1.smithi183.stdout:1/28: fdatasync d0/d3/fa 0 2024-02-10T00:00:19.210 INFO:tasks.workunit.client.1.smithi183.stdout:7/11: creat d0/f7 x:0 0 0 2024-02-10T00:00:19.211 INFO:tasks.workunit.client.1.smithi183.stdout:2/13: creat d2/f7 x:0 0 0 2024-02-10T00:00:19.211 INFO:tasks.workunit.client.1.smithi183.stdout:7/12: write d0/d2/d4/f5 [1012568,99069] 0 2024-02-10T00:00:19.212 INFO:tasks.workunit.client.1.smithi183.stdout:1/29: symlink d0/d3/le 0 2024-02-10T00:00:19.214 INFO:tasks.workunit.client.1.smithi183.stdout:2/14: write f0 [1483733,54527] 0 2024-02-10T00:00:19.216 INFO:tasks.workunit.client.1.smithi183.stdout:2/15: creat d2/f8 x:0 0 0 2024-02-10T00:00:19.216 INFO:tasks.workunit.client.1.smithi183.stdout:2/16: chown d2/c4 60 1 2024-02-10T00:00:19.219 INFO:tasks.workunit.client.1.smithi183.stdout:1/30: rmdir d0/d9 0 2024-02-10T00:00:19.221 INFO:tasks.workunit.client.1.smithi183.stdout:2/17: dwrite f0 [4194304,4194304] 0 2024-02-10T00:00:19.225 INFO:tasks.workunit.client.1.smithi183.stdout:1/31: dwrite d0/d3/fa [0,4194304] 0 2024-02-10T00:00:19.226 INFO:tasks.workunit.client.1.smithi183.stdout:2/18: unlink d2/c4 0 2024-02-10T00:00:19.227 INFO:tasks.workunit.client.1.smithi183.stdout:5/9: getdents . 0 2024-02-10T00:00:19.227 INFO:tasks.workunit.client.1.smithi183.stdout:2/19: chown d2/f8 29622919 1 2024-02-10T00:00:19.227 INFO:tasks.workunit.client.1.smithi183.stdout:2/20: read - d2/f6 zero size 2024-02-10T00:00:19.228 INFO:tasks.workunit.client.1.smithi183.stdout:2/21: fsync d2/f6 0 2024-02-10T00:00:19.228 INFO:tasks.workunit.client.1.smithi183.stdout:2/22: dread - d2/f7 zero size 2024-02-10T00:00:19.229 INFO:tasks.workunit.client.1.smithi183.stdout:8/14: truncate d0/f1 2882600 0 2024-02-10T00:00:19.232 INFO:tasks.workunit.client.1.smithi183.stdout:7/13: truncate d0/d2/d4/f5 1580851 0 2024-02-10T00:00:19.236 INFO:tasks.workunit.client.1.smithi183.stdout:5/10: mkdir d4 0 2024-02-10T00:00:19.237 INFO:tasks.workunit.client.1.smithi183.stdout:2/23: creat d2/f9 x:0 0 0 2024-02-10T00:00:19.242 INFO:tasks.workunit.client.1.smithi183.stdout:5/11: truncate f2 38797 0 2024-02-10T00:00:19.242 INFO:tasks.workunit.client.1.smithi183.stdout:2/24: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:19.243 INFO:tasks.workunit.client.1.smithi183.stdout:8/15: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.244 INFO:tasks.workunit.client.1.smithi183.stdout:1/32: getdents d0/d3 0 2024-02-10T00:00:19.246 INFO:tasks.workunit.client.1.smithi183.stdout:8/16: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.247 INFO:tasks.workunit.client.1.smithi183.stdout:2/25: unlink d2/f7 0 2024-02-10T00:00:19.249 INFO:tasks.workunit.client.1.smithi183.stdout:8/17: write d0/f1 [1373254,106388] 0 2024-02-10T00:00:19.250 INFO:tasks.workunit.client.1.smithi183.stdout:8/18: chown d0/c2 6 1 2024-02-10T00:00:19.250 INFO:tasks.workunit.client.1.smithi183.stdout:8/19: write d0/f1 [3772688,103078] 0 2024-02-10T00:00:19.250 INFO:tasks.workunit.client.1.smithi183.stdout:2/26: mkdir d2/da 0 2024-02-10T00:00:19.255 INFO:tasks.workunit.client.1.smithi183.stdout:8/20: symlink d0/l3 0 2024-02-10T00:00:19.258 INFO:tasks.workunit.client.1.smithi183.stdout:2/27: rename d2/f6 to d2/da/fb 0 2024-02-10T00:00:19.258 INFO:tasks.workunit.client.1.smithi183.stdout:8/21: rename d0 to d0/d4 22 2024-02-10T00:00:19.258 INFO:tasks.workunit.client.1.smithi183.stdout:2/28: rename d2 to d2/da/dc 22 2024-02-10T00:00:19.258 INFO:tasks.workunit.client.1.smithi183.stdout:7/14: rmdir d0/d2/d4 39 2024-02-10T00:00:19.259 INFO:tasks.workunit.client.1.smithi183.stdout:7/15: chown d0/f7 117805631 1 2024-02-10T00:00:19.260 INFO:tasks.workunit.client.1.smithi183.stdout:8/22: mknod d0/c5 0 2024-02-10T00:00:19.261 INFO:tasks.workunit.client.1.smithi183.stdout:2/29: creat d2/fd x:0 0 0 2024-02-10T00:00:19.262 INFO:tasks.workunit.client.1.smithi183.stdout:2/30: fdatasync d2/f9 0 2024-02-10T00:00:19.266 INFO:tasks.workunit.client.1.smithi183.stdout:7/16: mkdir d0/d2/d4/d8 0 2024-02-10T00:00:19.267 INFO:tasks.workunit.client.1.smithi183.stdout:2/31: mknod d2/da/ce 0 2024-02-10T00:00:19.269 INFO:tasks.workunit.client.1.smithi183.stdout:2/32: rmdir d2/da 39 2024-02-10T00:00:19.271 INFO:tasks.workunit.client.1.smithi183.stdout:7/17: mknod d0/d2/c9 0 2024-02-10T00:00:19.271 INFO:tasks.workunit.client.1.smithi183.stdout:1/33: truncate d0/d3/fa 303989 0 2024-02-10T00:00:19.272 INFO:tasks.workunit.client.1.smithi183.stdout:8/23: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.274 INFO:tasks.workunit.client.1.smithi183.stdout:2/33: dwrite d2/fd [0,4194304] 0 2024-02-10T00:00:19.275 INFO:tasks.workunit.client.1.smithi183.stdout:5/12: write f0 [886967,107873] 0 2024-02-10T00:00:19.277 INFO:tasks.workunit.client.1.smithi183.stdout:1/34: creat d0/d3/ff x:0 0 0 2024-02-10T00:00:19.277 INFO:tasks.workunit.client.1.smithi183.stdout:8/24: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.278 INFO:tasks.workunit.client.1.smithi183.stdout:7/18: symlink d0/d2/d4/d8/la 0 2024-02-10T00:00:19.279 INFO:tasks.workunit.client.1.smithi183.stdout:2/34: symlink d2/da/lf 0 2024-02-10T00:00:19.279 INFO:tasks.workunit.client.1.smithi183.stdout:5/13: mknod d4/c5 0 2024-02-10T00:00:19.280 INFO:tasks.workunit.client.1.smithi183.stdout:5/14: fdatasync f3 0 2024-02-10T00:00:19.281 INFO:tasks.workunit.client.1.smithi183.stdout:8/25: fdatasync d0/f1 0 2024-02-10T00:00:19.283 INFO:tasks.workunit.client.1.smithi183.stdout:8/26: write d0/f1 [443662,39282] 0 2024-02-10T00:00:19.284 INFO:tasks.workunit.client.1.smithi183.stdout:1/35: dwrite d0/d3/ff [0,4194304] 0 2024-02-10T00:00:19.285 INFO:tasks.workunit.client.1.smithi183.stdout:7/19: creat d0/d2/d3/fb x:0 0 0 2024-02-10T00:00:19.286 INFO:tasks.workunit.client.1.smithi183.stdout:7/20: write d0/f1 [429281,67385] 0 2024-02-10T00:00:19.287 INFO:tasks.workunit.client.1.smithi183.stdout:7/21: write d0/f1 [1005041,108874] 0 2024-02-10T00:00:19.289 INFO:tasks.workunit.client.1.smithi183.stdout:8/27: mknod d0/c6 0 2024-02-10T00:00:19.289 INFO:tasks.workunit.client.1.smithi183.stdout:5/15: dread f0 [0,4194304] 0 2024-02-10T00:00:19.290 INFO:tasks.workunit.client.1.smithi183.stdout:7/22: write d0/d2/d4/f5 [1753953,41226] 0 2024-02-10T00:00:19.292 INFO:tasks.workunit.client.1.smithi183.stdout:8/28: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.292 INFO:tasks.workunit.client.1.smithi183.stdout:8/29: chown d0/l3 863 1 2024-02-10T00:00:19.294 INFO:tasks.workunit.client.1.smithi183.stdout:5/16: creat d4/f6 x:0 0 0 2024-02-10T00:00:19.297 INFO:tasks.workunit.client.1.smithi183.stdout:8/30: write d0/f1 [336332,74095] 0 2024-02-10T00:00:19.299 INFO:tasks.workunit.client.1.smithi183.stdout:1/36: link d0/d3/l4 d0/d3/d7/l10 0 2024-02-10T00:00:19.302 INFO:tasks.workunit.client.1.smithi183.stdout:5/17: dwrite f0 [0,4194304] 0 2024-02-10T00:00:19.304 INFO:tasks.workunit.client.1.smithi183.stdout:1/37: rename d0/c8 to d0/d3/d7/c11 0 2024-02-10T00:00:19.304 INFO:tasks.workunit.client.1.smithi183.stdout:1/38: chown d0 796144902 1 2024-02-10T00:00:19.307 INFO:tasks.workunit.client.1.smithi183.stdout:5/18: symlink d4/l7 0 2024-02-10T00:00:19.307 INFO:tasks.workunit.client.1.smithi183.stdout:5/19: readlink d4/l7 0 2024-02-10T00:00:19.307 INFO:tasks.workunit.client.1.smithi183.stdout:5/20: readlink d4/l7 0 2024-02-10T00:00:19.308 INFO:tasks.workunit.client.1.smithi183.stdout:5/21: chown f1 214887415 1 2024-02-10T00:00:19.308 INFO:tasks.workunit.client.1.smithi183.stdout:2/35: truncate d2/fd 1722527 0 2024-02-10T00:00:19.309 INFO:tasks.workunit.client.1.smithi183.stdout:2/36: stat d2/f9 0 2024-02-10T00:00:19.309 INFO:tasks.workunit.client.1.smithi183.stdout:8/31: rmdir d0 39 2024-02-10T00:00:19.309 INFO:tasks.workunit.client.1.smithi183.stdout:5/22: write f1 [345902,30069] 0 2024-02-10T00:00:19.309 INFO:tasks.workunit.client.1.smithi183.stdout:2/37: fsync f0 0 2024-02-10T00:00:19.311 INFO:tasks.workunit.client.1.smithi183.stdout:7/23: dread d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:19.312 INFO:tasks.workunit.client.1.smithi183.stdout:1/39: creat d0/d3/f12 x:0 0 0 2024-02-10T00:00:19.314 INFO:tasks.workunit.client.1.smithi183.stdout:1/40: chown d0/d3/le 1277836 1 2024-02-10T00:00:19.314 INFO:tasks.workunit.client.1.smithi183.stdout:8/32: fdatasync d0/f1 0 2024-02-10T00:00:19.315 INFO:tasks.workunit.client.1.smithi183.stdout:5/23: dwrite f1 [0,4194304] 0 2024-02-10T00:00:19.315 INFO:tasks.workunit.client.1.smithi183.stdout:1/41: read d0/d3/ff [1751992,74266] 0 2024-02-10T00:00:19.316 INFO:tasks.workunit.client.1.smithi183.stdout:1/42: read d0/d3/ff [1131644,105] 0 2024-02-10T00:00:19.316 INFO:tasks.workunit.client.1.smithi183.stdout:7/24: rmdir d0 39 2024-02-10T00:00:19.318 INFO:tasks.workunit.client.1.smithi183.stdout:2/38: symlink d2/l10 0 2024-02-10T00:00:19.318 INFO:tasks.workunit.client.1.smithi183.stdout:8/33: mknod d0/c7 0 2024-02-10T00:00:19.319 INFO:tasks.workunit.client.1.smithi183.stdout:5/24: symlink d4/l8 0 2024-02-10T00:00:19.323 INFO:tasks.workunit.client.1.smithi183.stdout:2/39: creat d2/da/f11 x:0 0 0 2024-02-10T00:00:19.324 INFO:tasks.workunit.client.1.smithi183.stdout:8/34: symlink d0/l8 0 2024-02-10T00:00:19.325 INFO:tasks.workunit.client.1.smithi183.stdout:7/25: mknod d0/d2/d3/cc 0 2024-02-10T00:00:19.325 INFO:tasks.workunit.client.1.smithi183.stdout:8/35: write d0/f1 [668364,33244] 0 2024-02-10T00:00:19.326 INFO:tasks.workunit.client.1.smithi183.stdout:1/43: dwrite d0/d3/fa [0,4194304] 0 2024-02-10T00:00:19.327 INFO:tasks.workunit.client.1.smithi183.stdout:1/44: chown d0/l5 29919 1 2024-02-10T00:00:19.328 INFO:tasks.workunit.client.1.smithi183.stdout:2/40: unlink f0 0 2024-02-10T00:00:19.330 INFO:tasks.workunit.client.1.smithi183.stdout:8/36: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:19.332 INFO:tasks.workunit.client.1.smithi183.stdout:7/26: rename d0/f7 to d0/fd 0 2024-02-10T00:00:19.338 INFO:tasks.workunit.client.1.smithi183.stdout:8/37: creat d0/f9 x:0 0 0 2024-02-10T00:00:19.339 INFO:tasks.workunit.client.1.smithi183.stdout:2/41: mknod d2/c12 0 2024-02-10T00:00:19.339 INFO:tasks.workunit.client.1.smithi183.stdout:2/42: chown d2/f8 14 1 2024-02-10T00:00:19.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/38: unlink d0/l3 0 2024-02-10T00:00:19.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/39: stat d0 0 2024-02-10T00:00:19.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/40: fdatasync d0/f9 0 2024-02-10T00:00:19.349 INFO:tasks.workunit.client.1.smithi183.stdout:1/45: truncate d0/d3/ff 3727277 0 2024-02-10T00:00:19.351 INFO:tasks.workunit.client.1.smithi183.stdout:1/46: creat d0/f13 x:0 0 0 2024-02-10T00:00:19.353 INFO:tasks.workunit.client.1.smithi183.stdout:5/25: truncate f1 4805282 0 2024-02-10T00:00:19.356 INFO:tasks.workunit.client.1.smithi183.stdout:2/43: getdents d2 0 2024-02-10T00:00:19.357 INFO:tasks.workunit.client.1.smithi183.stdout:1/47: chown d0/d3/l4 146 1 2024-02-10T00:00:19.358 INFO:tasks.workunit.client.1.smithi183.stdout:8/41: rmdir d0 39 2024-02-10T00:00:19.359 INFO:tasks.workunit.client.1.smithi183.stdout:5/26: unlink d4/l8 0 2024-02-10T00:00:19.362 INFO:tasks.workunit.client.1.smithi183.stdout:5/27: creat d4/f9 x:0 0 0 2024-02-10T00:00:19.363 INFO:tasks.workunit.client.1.smithi183.stdout:8/42: creat d0/fa x:0 0 0 2024-02-10T00:00:19.363 INFO:tasks.workunit.client.1.smithi183.stdout:2/44: truncate d2/f9 194050 0 2024-02-10T00:00:19.364 INFO:tasks.workunit.client.1.smithi183.stdout:1/48: fdatasync d0/d3/ff 0 2024-02-10T00:00:19.365 INFO:tasks.workunit.client.1.smithi183.stdout:2/45: write d2/fd [2082075,36839] 0 2024-02-10T00:00:19.369 INFO:tasks.workunit.client.1.smithi183.stdout:2/46: dwrite d2/fd [0,4194304] 0 2024-02-10T00:00:19.370 INFO:tasks.workunit.client.1.smithi183.stdout:5/28: truncate f3 582505 0 2024-02-10T00:00:19.371 INFO:tasks.workunit.client.1.smithi183.stdout:5/29: chown f0 118 1 2024-02-10T00:00:19.373 INFO:tasks.workunit.client.1.smithi183.stdout:8/43: getdents d0 0 2024-02-10T00:00:19.373 INFO:tasks.workunit.client.1.smithi183.stdout:5/30: creat d4/fa x:0 0 0 2024-02-10T00:00:19.374 INFO:tasks.workunit.client.1.smithi183.stdout:5/31: dread - d4/fa zero size 2024-02-10T00:00:19.375 INFO:tasks.workunit.client.1.smithi183.stdout:8/44: write d0/f1 [2923469,32120] 0 2024-02-10T00:00:19.375 INFO:tasks.workunit.client.1.smithi183.stdout:2/47: getdents d2 0 2024-02-10T00:00:19.375 INFO:tasks.workunit.client.1.smithi183.stdout:5/32: dread - d4/f9 zero size 2024-02-10T00:00:19.376 INFO:tasks.workunit.client.1.smithi183.stdout:2/48: readlink l1 0 2024-02-10T00:00:19.376 INFO:tasks.workunit.client.1.smithi183.stdout:8/45: fsync d0/f9 0 2024-02-10T00:00:19.376 INFO:tasks.workunit.client.1.smithi183.stdout:2/49: chown d2/da/f11 13135180 1 2024-02-10T00:00:19.376 INFO:tasks.workunit.client.1.smithi183.stdout:2/50: chown l1 94850 1 2024-02-10T00:00:19.378 INFO:tasks.workunit.client.1.smithi183.stdout:8/46: creat d0/fb x:0 0 0 2024-02-10T00:00:19.380 INFO:tasks.workunit.client.1.smithi183.stdout:2/51: write d2/da/fb [278891,79343] 0 2024-02-10T00:00:19.381 INFO:tasks.workunit.client.1.smithi183.stdout:5/33: dwrite d4/f6 [0,4194304] 0 2024-02-10T00:00:19.381 INFO:tasks.workunit.client.1.smithi183.stdout:5/34: chown f1 6046 1 2024-02-10T00:00:19.383 INFO:tasks.workunit.client.1.smithi183.stdout:2/52: creat d2/f13 x:0 0 0 2024-02-10T00:00:19.384 INFO:tasks.workunit.client.1.smithi183.stdout:5/35: mknod d4/cb 0 2024-02-10T00:00:19.384 INFO:tasks.workunit.client.1.smithi183.stdout:8/47: link d0/c2 d0/cc 0 2024-02-10T00:00:19.387 INFO:tasks.workunit.client.1.smithi183.stdout:8/48: rename d0/fa to d0/fd 0 2024-02-10T00:00:19.388 INFO:tasks.workunit.client.1.smithi183.stdout:2/53: unlink d2/da/f11 0 2024-02-10T00:00:19.390 INFO:tasks.workunit.client.1.smithi183.stdout:5/36: link f1 d4/fc 0 2024-02-10T00:00:19.393 INFO:tasks.workunit.client.1.smithi183.stdout:2/54: dwrite d2/da/fb [0,4194304] 0 2024-02-10T00:00:19.396 INFO:tasks.workunit.client.1.smithi183.stdout:8/49: unlink d0/c7 0 2024-02-10T00:00:19.397 INFO:tasks.workunit.client.1.smithi183.stdout:8/50: read - d0/f9 zero size 2024-02-10T00:00:19.398 INFO:tasks.workunit.client.1.smithi183.stdout:5/37: mkdir d4/dd 0 2024-02-10T00:00:19.398 INFO:tasks.workunit.client.1.smithi183.stdout:8/51: read - d0/f9 zero size 2024-02-10T00:00:19.399 INFO:tasks.workunit.client.1.smithi183.stdout:2/55: dwrite d2/da/fb [0,4194304] 0 2024-02-10T00:00:19.400 INFO:tasks.workunit.client.1.smithi183.stdout:8/52: fdatasync d0/fd 0 2024-02-10T00:00:19.404 INFO:tasks.workunit.client.1.smithi183.stdout:5/38: dwrite d4/f6 [0,4194304] 0 2024-02-10T00:00:19.404 INFO:tasks.workunit.client.1.smithi183.stdout:8/53: truncate d0/f9 515965 0 2024-02-10T00:00:19.405 INFO:tasks.workunit.client.1.smithi183.stdout:8/54: read d0/f1 [2240902,11812] 0 2024-02-10T00:00:19.406 INFO:tasks.workunit.client.1.smithi183.stdout:5/39: mknod d4/ce 0 2024-02-10T00:00:19.412 INFO:tasks.workunit.client.1.smithi183.stdout:8/55: truncate d0/fb 424291 0 2024-02-10T00:00:19.412 INFO:tasks.workunit.client.1.smithi183.stdout:8/56: mknod d0/ce 0 2024-02-10T00:00:19.433 INFO:tasks.workunit.client.1.smithi183.stdout:5/40: getdents d4 0 2024-02-10T00:00:19.434 INFO:tasks.workunit.client.1.smithi183.stdout:5/41: write d4/f9 [643799,14581] 0 2024-02-10T00:00:19.434 INFO:tasks.workunit.client.1.smithi183.stdout:2/56: dwrite d2/f9 [0,4194304] 0 2024-02-10T00:00:19.441 INFO:tasks.workunit.client.1.smithi183.stdout:8/57: truncate d0/fb 836915 0 2024-02-10T00:00:19.442 INFO:tasks.workunit.client.1.smithi183.stdout:2/57: write d2/da/fb [4281303,16260] 0 2024-02-10T00:00:19.442 INFO:tasks.workunit.client.1.smithi183.stdout:8/58: readlink d0/l8 0 2024-02-10T00:00:19.512 INFO:tasks.workunit.client.1.smithi183.stdout:5/42: truncate f3 1254079 0 2024-02-10T00:00:19.512 INFO:tasks.workunit.client.1.smithi183.stdout:2/58: read d2/fd [2380358,128385] 0 2024-02-10T00:00:19.515 INFO:tasks.workunit.client.1.smithi183.stdout:2/59: chown d2/l3 14 1 2024-02-10T00:00:19.515 INFO:tasks.workunit.client.1.smithi183.stdout:5/43: getdents d4/dd 0 2024-02-10T00:00:19.519 INFO:tasks.workunit.client.1.smithi183.stdout:2/60: link d2/f8 d2/da/f14 0 2024-02-10T00:00:19.520 INFO:tasks.workunit.client.1.smithi183.stdout:5/44: dwrite d4/f9 [0,4194304] 0 2024-02-10T00:00:19.521 INFO:tasks.workunit.client.1.smithi183.stdout:2/61: fdatasync d2/da/fb 0 2024-02-10T00:00:19.555 INFO:tasks.workunit.client.1.smithi183.stdout:2/62: creat d2/f15 x:0 0 0 2024-02-10T00:00:19.556 INFO:tasks.workunit.client.1.smithi183.stdout:5/45: link f0 d4/dd/ff 0 2024-02-10T00:00:19.556 INFO:tasks.workunit.client.1.smithi183.stdout:2/63: stat d2/da/lf 0 2024-02-10T00:00:19.558 INFO:tasks.workunit.client.1.smithi183.stdout:5/46: creat d4/dd/f10 x:0 0 0 2024-02-10T00:00:19.559 INFO:tasks.workunit.client.1.smithi183.stdout:8/59: dwrite d0/f1 [0,4194304] 0 2024-02-10T00:00:19.560 INFO:tasks.workunit.client.1.smithi183.stdout:2/64: rename d2/l3 to d2/da/l16 0 2024-02-10T00:00:19.561 INFO:tasks.workunit.client.1.smithi183.stdout:5/47: mkdir d4/d11 0 2024-02-10T00:00:19.564 INFO:tasks.workunit.client.1.smithi183.stdout:2/65: rename d2/f9 to d2/da/f17 0 2024-02-10T00:00:19.566 INFO:tasks.workunit.client.1.smithi183.stdout:5/48: symlink d4/d11/l12 0 2024-02-10T00:00:19.567 INFO:tasks.workunit.client.1.smithi183.stdout:5/49: readlink d4/d11/l12 0 2024-02-10T00:00:19.567 INFO:tasks.workunit.client.1.smithi183.stdout:2/66: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:19.568 INFO:tasks.workunit.client.1.smithi183.stdout:2/67: read d2/da/f17 [1658625,24452] 0 2024-02-10T00:00:19.570 INFO:tasks.workunit.client.1.smithi183.stdout:5/50: creat d4/f13 x:0 0 0 2024-02-10T00:00:19.575 INFO:tasks.workunit.client.1.smithi183.stdout:5/51: creat d4/dd/f14 x:0 0 0 2024-02-10T00:00:19.577 INFO:tasks.workunit.client.1.smithi183.stdout:8/60: truncate d0/fb 222707 0 2024-02-10T00:00:19.578 INFO:tasks.workunit.client.1.smithi183.stdout:5/52: mknod d4/c15 0 2024-02-10T00:00:19.578 INFO:tasks.workunit.client.1.smithi183.stdout:8/61: creat d0/ff x:0 0 0 2024-02-10T00:00:19.581 INFO:tasks.workunit.client.1.smithi183.stdout:5/53: dread d4/f6 [0,4194304] 0 2024-02-10T00:00:19.582 INFO:tasks.workunit.client.1.smithi183.stdout:5/54: chown d4/dd/f14 119052615 1 2024-02-10T00:00:19.584 INFO:tasks.workunit.client.1.smithi183.stdout:5/55: symlink d4/dd/l16 0 2024-02-10T00:00:19.584 INFO:tasks.workunit.client.1.smithi183.stdout:2/68: dwrite d2/da/f14 [4194304,4194304] 0 2024-02-10T00:00:19.589 INFO:tasks.workunit.client.1.smithi183.stdout:8/62: rmdir d0 39 2024-02-10T00:00:19.592 INFO:tasks.workunit.client.1.smithi183.stdout:8/63: fdatasync d0/f1 0 2024-02-10T00:00:19.593 INFO:tasks.workunit.client.1.smithi183.stdout:5/56: dread d4/dd/ff [0,4194304] 0 2024-02-10T00:00:19.594 INFO:tasks.workunit.client.1.smithi183.stdout:8/64: mkdir d0/d10 0 2024-02-10T00:00:19.595 INFO:tasks.workunit.client.1.smithi183.stdout:5/57: mknod d4/c17 0 2024-02-10T00:00:19.596 INFO:tasks.workunit.client.1.smithi183.stdout:5/58: chown d4/dd/ff 0 1 2024-02-10T00:00:19.607 INFO:tasks.workunit.client.1.smithi183.stdout:8/65: dread d0/fb [0,4194304] 0 2024-02-10T00:00:19.612 INFO:tasks.workunit.client.1.smithi183.stdout:2/69: dwrite d2/fd [4194304,4194304] 0 2024-02-10T00:00:19.612 INFO:tasks.workunit.client.1.smithi183.stdout:8/66: rename d0/ce to d0/c11 0 2024-02-10T00:00:19.612 INFO:tasks.workunit.client.1.smithi183.stdout:5/59: dwrite d4/fc [0,4194304] 0 2024-02-10T00:00:19.612 INFO:tasks.workunit.client.1.smithi183.stdout:8/67: dread - d0/ff zero size 2024-02-10T00:00:19.613 INFO:tasks.workunit.client.1.smithi183.stdout:5/60: write d4/f13 [737306,53063] 0 2024-02-10T00:00:19.616 INFO:tasks.workunit.client.1.smithi183.stdout:5/61: symlink d4/d11/l18 0 2024-02-10T00:00:19.616 INFO:tasks.workunit.client.1.smithi183.stdout:8/68: getdents d0/d10 0 2024-02-10T00:00:19.617 INFO:tasks.workunit.client.1.smithi183.stdout:2/70: dwrite d2/da/f17 [0,4194304] 0 2024-02-10T00:00:19.618 INFO:tasks.workunit.client.1.smithi183.stdout:2/71: write d2/fd [7219829,5932] 0 2024-02-10T00:00:19.618 INFO:tasks.workunit.client.1.smithi183.stdout:5/62: mkdir d4/d11/d19 0 2024-02-10T00:00:19.620 INFO:tasks.workunit.client.1.smithi183.stdout:8/69: creat d0/d10/f12 x:0 0 0 2024-02-10T00:00:19.622 INFO:tasks.workunit.client.1.smithi183.stdout:5/63: mknod d4/c1a 0 2024-02-10T00:00:19.623 INFO:tasks.workunit.client.1.smithi183.stdout:5/64: write d4/fa [629631,43679] 0 2024-02-10T00:00:19.624 INFO:tasks.workunit.client.1.smithi183.stdout:2/72: rename d2/fd to d2/da/f18 0 2024-02-10T00:00:19.625 INFO:tasks.workunit.client.1.smithi183.stdout:8/70: symlink d0/d10/l13 0 2024-02-10T00:00:19.628 INFO:tasks.workunit.client.1.smithi183.stdout:5/65: dwrite d4/dd/f14 [0,4194304] 0 2024-02-10T00:00:19.629 INFO:tasks.workunit.client.1.smithi183.stdout:2/73: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:19.630 INFO:tasks.workunit.client.1.smithi183.stdout:8/71: link d0/d10/f12 d0/f14 0 2024-02-10T00:00:19.631 INFO:tasks.workunit.client.1.smithi183.stdout:5/66: write d4/f6 [261684,28245] 0 2024-02-10T00:00:19.632 INFO:tasks.workunit.client.1.smithi183.stdout:2/74: mkdir d2/da/d19 0 2024-02-10T00:00:19.632 INFO:tasks.workunit.client.1.smithi183.stdout:2/75: chown d2/da 12619881 1 2024-02-10T00:00:19.633 INFO:tasks.workunit.client.1.smithi183.stdout:5/67: creat d4/dd/f1b x:0 0 0 2024-02-10T00:00:19.634 INFO:tasks.workunit.client.1.smithi183.stdout:2/76: mkdir d2/d1a 0 2024-02-10T00:00:19.661 INFO:tasks.workunit.client.1.smithi183.stdout:2/77: rmdir d2/da 39 2024-02-10T00:00:19.662 INFO:tasks.workunit.client.1.smithi183.stdout:2/78: write d2/f13 [798386,31109] 0 2024-02-10T00:00:19.662 INFO:tasks.workunit.client.1.smithi183.stdout:2/79: chown d2 8077215 1 2024-02-10T00:00:19.663 INFO:tasks.workunit.client.1.smithi183.stdout:2/80: chown d2/da/d19 92078 1 2024-02-10T00:00:19.664 INFO:tasks.workunit.client.1.smithi183.stdout:2/81: write d2/da/f17 [1366283,115355] 0 2024-02-10T00:00:19.667 INFO:tasks.workunit.client.1.smithi183.stdout:2/82: getdents d2/da 0 2024-02-10T00:00:19.670 INFO:tasks.workunit.client.1.smithi183.stdout:2/83: link d2/c12 d2/da/c1b 0 2024-02-10T00:00:19.674 INFO:tasks.workunit.client.1.smithi183.stdout:2/84: dread d2/f13 [0,4194304] 0 2024-02-10T00:00:19.675 INFO:tasks.workunit.client.1.smithi183.stdout:2/85: getdents d2/d1a 0 2024-02-10T00:00:19.679 INFO:tasks.workunit.client.1.smithi183.stdout:2/86: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:19.681 INFO:tasks.workunit.client.1.smithi183.stdout:2/87: write d2/f13 [1691656,34578] 0 2024-02-10T00:00:19.683 INFO:tasks.workunit.client.1.smithi183.stdout:2/88: readlink d2/da/l16 0 2024-02-10T00:00:19.684 INFO:tasks.workunit.client.1.smithi183.stdout:2/89: getdents d2/da/d19 0 2024-02-10T00:00:19.688 INFO:tasks.workunit.client.1.smithi183.stdout:2/90: unlink d2/da/f18 0 2024-02-10T00:00:19.690 INFO:tasks.workunit.client.1.smithi183.stdout:2/91: symlink d2/l1c 0 2024-02-10T00:00:19.691 INFO:tasks.workunit.client.1.smithi183.stdout:2/92: write d2/f15 [584310,34668] 0 2024-02-10T00:00:19.697 INFO:tasks.workunit.client.1.smithi183.stdout:2/93: fdatasync d2/f15 0 2024-02-10T00:00:19.698 INFO:tasks.workunit.client.1.smithi183.stdout:2/94: creat d2/da/f1d x:0 0 0 2024-02-10T00:00:19.699 INFO:tasks.workunit.client.1.smithi183.stdout:2/95: write d2/da/f17 [3129391,25425] 0 2024-02-10T00:00:19.702 INFO:tasks.workunit.client.1.smithi183.stdout:2/96: dread d2/da/f14 [4194304,4194304] 0 2024-02-10T00:00:19.706 INFO:tasks.workunit.client.1.smithi183.stdout:2/97: dwrite d2/f13 [0,4194304] 0 2024-02-10T00:00:19.718 INFO:tasks.workunit.client.1.smithi183.stdout:2/98: truncate d2/f8 114484 0 2024-02-10T00:00:19.719 INFO:tasks.workunit.client.1.smithi183.stdout:2/99: write d2/da/f1d [419407,117379] 0 2024-02-10T00:00:19.720 INFO:tasks.workunit.client.1.smithi183.stdout:2/100: getdents d2/da/d19 0 2024-02-10T00:00:19.723 INFO:tasks.workunit.client.1.smithi183.stdout:2/101: truncate d2/da/fb 4889531 0 2024-02-10T00:00:19.728 INFO:tasks.workunit.client.1.smithi183.stdout:2/102: truncate d2/da/f14 1141088 0 2024-02-10T00:00:19.736 INFO:tasks.workunit.client.1.smithi183.stdout:2/103: rename d2/da/f14 to d2/f1e 0 2024-02-10T00:00:19.737 INFO:tasks.workunit.client.1.smithi183.stdout:2/104: write d2/f15 [110297,40236] 0 2024-02-10T00:00:19.743 INFO:tasks.workunit.client.1.smithi183.stdout:2/105: dwrite d2/f13 [4194304,4194304] 0 2024-02-10T00:00:19.745 INFO:tasks.workunit.client.1.smithi183.stdout:2/106: creat d2/da/f1f x:0 0 0 2024-02-10T00:00:19.748 INFO:tasks.workunit.client.1.smithi183.stdout:2/107: mkdir d2/da/d20 0 2024-02-10T00:00:19.751 INFO:tasks.workunit.client.1.smithi183.stdout:2/108: rename d2/d1a to d2/da/d20/d21 0 2024-02-10T00:00:19.753 INFO:tasks.workunit.client.1.smithi183.stdout:2/109: mknod d2/c22 0 2024-02-10T00:00:19.755 INFO:tasks.workunit.client.1.smithi183.stdout:2/110: chown d2/da/fb 302675209 1 2024-02-10T00:00:19.756 INFO:tasks.workunit.client.1.smithi183.stdout:2/111: chown d2/c12 869808547 1 2024-02-10T00:00:19.757 INFO:tasks.workunit.client.1.smithi183.stdout:2/112: creat d2/da/d20/d21/f23 x:0 0 0 2024-02-10T00:00:19.758 INFO:tasks.workunit.client.1.smithi183.stdout:2/113: read d2/da/f1d [295465,58960] 0 2024-02-10T00:00:19.763 INFO:tasks.workunit.client.1.smithi183.stdout:2/114: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:19.765 INFO:tasks.workunit.client.1.smithi183.stdout:2/115: creat d2/da/d19/f24 x:0 0 0 2024-02-10T00:00:19.766 INFO:tasks.workunit.client.1.smithi183.stdout:2/116: truncate d2/f1e 2116627 0 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:2/117: sync 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:7/27: sync 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:5/68: sync 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:9/24: sync 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:8/72: sync 2024-02-10T00:00:21.869 INFO:tasks.workunit.client.1.smithi183.stdout:9/25: write - no filename 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:9/26: dread - no filename 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:1/49: sync 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:4/6: sync 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:3/7: sync 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:0/14: sync 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:6/15: sync 2024-02-10T00:00:21.870 INFO:tasks.workunit.client.1.smithi183.stdout:0/15: stat f3 0 2024-02-10T00:00:21.871 INFO:tasks.workunit.client.1.smithi183.stdout:8/73: chown d0/l8 1 1 2024-02-10T00:00:21.872 INFO:tasks.workunit.client.1.smithi183.stdout:5/69: read d4/dd/ff [3477115,9993] 0 2024-02-10T00:00:21.872 INFO:tasks.workunit.client.1.smithi183.stdout:4/7: creat f4 x:0 0 0 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/8: mknod c0 0 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/9: dread - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/10: dwrite - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/11: dread - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/12: fsync - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/13: truncate - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/14: fsync - no filename 2024-02-10T00:00:21.873 INFO:tasks.workunit.client.1.smithi183.stdout:6/16: chown c1 959 1 2024-02-10T00:00:21.874 INFO:tasks.workunit.client.1.smithi183.stdout:7/28: write d0/f1 [1269042,89615] 0 2024-02-10T00:00:21.874 INFO:tasks.workunit.client.1.smithi183.stdout:3/15: stat c0 0 2024-02-10T00:00:21.874 INFO:tasks.workunit.client.1.smithi183.stdout:3/16: dread - no filename 2024-02-10T00:00:21.874 INFO:tasks.workunit.client.1.smithi183.stdout:3/17: readlink - no filename 2024-02-10T00:00:21.875 INFO:tasks.workunit.client.1.smithi183.stdout:3/18: rmdir - no directory 2024-02-10T00:00:21.875 INFO:tasks.workunit.client.1.smithi183.stdout:3/19: write - no filename 2024-02-10T00:00:21.876 INFO:tasks.workunit.client.1.smithi183.stdout:7/29: chown d0/fd 1914434590 1 2024-02-10T00:00:21.876 INFO:tasks.workunit.client.1.smithi183.stdout:3/20: stat c0 0 2024-02-10T00:00:21.876 INFO:tasks.workunit.client.1.smithi183.stdout:3/21: dread - no filename 2024-02-10T00:00:21.876 INFO:tasks.workunit.client.1.smithi183.stdout:5/70: mknod d4/c1c 0 2024-02-10T00:00:21.879 INFO:tasks.workunit.client.1.smithi183.stdout:2/118: link d2/da/d19/f24 d2/da/f25 0 2024-02-10T00:00:21.880 INFO:tasks.workunit.client.1.smithi183.stdout:0/16: dwrite f3 [0,4194304] 0 2024-02-10T00:00:21.883 INFO:tasks.workunit.client.1.smithi183.stdout:3/22: symlink l1 0 2024-02-10T00:00:21.883 INFO:tasks.workunit.client.1.smithi183.stdout:3/23: chown l1 0 1 2024-02-10T00:00:21.883 INFO:tasks.workunit.client.1.smithi183.stdout:3/24: write - no filename 2024-02-10T00:00:21.884 INFO:tasks.workunit.client.1.smithi183.stdout:3/25: readlink l1 0 2024-02-10T00:00:21.884 INFO:tasks.workunit.client.1.smithi183.stdout:3/26: truncate - no filename 2024-02-10T00:00:21.885 INFO:tasks.workunit.client.1.smithi183.stdout:6/17: symlink d2/l3 0 2024-02-10T00:00:21.885 INFO:tasks.workunit.client.1.smithi183.stdout:6/18: write - no filename 2024-02-10T00:00:21.885 INFO:tasks.workunit.client.1.smithi183.stdout:6/19: dwrite - no filename 2024-02-10T00:00:21.889 INFO:tasks.workunit.client.1.smithi183.stdout:7/30: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:21.889 INFO:tasks.workunit.client.1.smithi183.stdout:0/17: rename f2 to f4 0 2024-02-10T00:00:21.889 INFO:tasks.workunit.client.1.smithi183.stdout:9/27: getdents d0/d3 0 2024-02-10T00:00:21.890 INFO:tasks.workunit.client.1.smithi183.stdout:7/31: chown d0/d2/d4/f5 95206 1 2024-02-10T00:00:21.891 INFO:tasks.workunit.client.1.smithi183.stdout:3/27: creat f2 x:0 0 0 2024-02-10T00:00:21.893 INFO:tasks.workunit.client.1.smithi183.stdout:6/20: creat d2/f4 x:0 0 0 2024-02-10T00:00:21.894 INFO:tasks.workunit.client.1.smithi183.stdout:4/8: truncate f3 708584 0 2024-02-10T00:00:21.897 INFO:tasks.workunit.client.1.smithi183.stdout:7/32: dwrite d0/d2/d3/fb [0,4194304] 0 2024-02-10T00:00:21.912 INFO:tasks.workunit.client.1.smithi183.stdout:9/28: creat d0/f5 x:0 0 0 2024-02-10T00:00:21.955 INFO:tasks.workunit.client.1.smithi183.stdout:6/21: unlink c0 0 2024-02-10T00:00:21.961 INFO:tasks.workunit.client.1.smithi183.stdout:6/22: dwrite d2/f4 [0,4194304] 0 2024-02-10T00:00:21.962 INFO:tasks.workunit.client.1.smithi183.stdout:6/23: write d2/f4 [3844375,122484] 0 2024-02-10T00:00:22.019 INFO:tasks.workunit.client.1.smithi183.stdout:7/33: mknod d0/d2/d4/ce 0 2024-02-10T00:00:22.025 INFO:tasks.workunit.client.1.smithi183.stdout:7/34: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:22.026 INFO:tasks.workunit.client.1.smithi183.stdout:7/35: fsync d0/d2/d3/fb 0 2024-02-10T00:00:22.061 INFO:tasks.workunit.client.1.smithi183.stdout:1/50: truncate d0/d3/fa 571119 0 2024-02-10T00:00:22.063 INFO:tasks.workunit.client.1.smithi183.stdout:0/18: rename f4 to f5 0 2024-02-10T00:00:22.064 INFO:tasks.workunit.client.1.smithi183.stdout:8/74: dwrite d0/f9 [0,4194304] 0 2024-02-10T00:00:22.064 INFO:tasks.workunit.client.1.smithi183.stdout:5/71: truncate d4/f9 2966959 0 2024-02-10T00:00:22.065 INFO:tasks.workunit.client.1.smithi183.stdout:5/72: fsync d4/dd/f14 0 2024-02-10T00:00:22.068 INFO:tasks.workunit.client.1.smithi183.stdout:9/29: rmdir d0 39 2024-02-10T00:00:22.075 INFO:tasks.workunit.client.1.smithi183.stdout:7/36: symlink d0/lf 0 2024-02-10T00:00:22.075 INFO:tasks.workunit.client.1.smithi183.stdout:6/24: dwrite d2/f4 [4194304,4194304] 0 2024-02-10T00:00:22.075 INFO:tasks.workunit.client.1.smithi183.stdout:5/73: dread d4/f13 [0,4194304] 0 2024-02-10T00:00:22.075 INFO:tasks.workunit.client.1.smithi183.stdout:5/74: chown d4/dd 43323 1 2024-02-10T00:00:22.076 INFO:tasks.workunit.client.1.smithi183.stdout:6/25: read d2/f4 [687068,125377] 0 2024-02-10T00:00:22.076 INFO:tasks.workunit.client.1.smithi183.stdout:3/28: truncate f2 452224 0 2024-02-10T00:00:22.077 INFO:tasks.workunit.client.1.smithi183.stdout:1/51: mkdir d0/d3/d14 0 2024-02-10T00:00:22.078 INFO:tasks.workunit.client.1.smithi183.stdout:6/26: write d2/f4 [2028992,13188] 0 2024-02-10T00:00:22.079 INFO:tasks.workunit.client.1.smithi183.stdout:7/37: dread d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:22.080 INFO:tasks.workunit.client.1.smithi183.stdout:8/75: symlink d0/l15 0 2024-02-10T00:00:22.082 INFO:tasks.workunit.client.1.smithi183.stdout:4/9: link c1 c5 0 2024-02-10T00:00:22.083 INFO:tasks.workunit.client.1.smithi183.stdout:9/30: dread - d0/f5 zero size 2024-02-10T00:00:22.083 INFO:tasks.workunit.client.1.smithi183.stdout:2/119: dread d2/f1e [0,4194304] 0 2024-02-10T00:00:22.085 INFO:tasks.workunit.client.1.smithi183.stdout:7/38: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:22.086 INFO:tasks.workunit.client.1.smithi183.stdout:5/75: mkdir d4/d1d 0 2024-02-10T00:00:22.086 INFO:tasks.workunit.client.1.smithi183.stdout:5/76: fdatasync d4/f6 0 2024-02-10T00:00:22.088 INFO:tasks.workunit.client.1.smithi183.stdout:3/29: symlink l3 0 2024-02-10T00:00:22.089 INFO:tasks.workunit.client.1.smithi183.stdout:6/27: symlink d2/l5 0 2024-02-10T00:00:22.092 INFO:tasks.workunit.client.1.smithi183.stdout:8/76: unlink d0/d10/l13 0 2024-02-10T00:00:22.095 INFO:tasks.workunit.client.1.smithi183.stdout:9/31: mknod d0/c6 0 2024-02-10T00:00:22.101 INFO:tasks.workunit.client.1.smithi183.stdout:7/39: mknod d0/d2/d3/c10 0 2024-02-10T00:00:22.101 INFO:tasks.workunit.client.1.smithi183.stdout:0/19: dwrite f3 [4194304,4194304] 0 2024-02-10T00:00:22.105 INFO:tasks.workunit.client.1.smithi183.stdout:2/120: write d2/f1e [1223069,50292] 0 2024-02-10T00:00:22.105 INFO:tasks.workunit.client.1.smithi183.stdout:5/77: creat d4/f1e x:0 0 0 2024-02-10T00:00:22.107 INFO:tasks.workunit.client.1.smithi183.stdout:6/28: mknod d2/c6 0 2024-02-10T00:00:22.107 INFO:tasks.workunit.client.1.smithi183.stdout:6/29: chown c1 157687 1 2024-02-10T00:00:22.107 INFO:tasks.workunit.client.1.smithi183.stdout:6/30: chown d2/l5 3617201 1 2024-02-10T00:00:22.108 INFO:tasks.workunit.client.1.smithi183.stdout:6/31: chown c1 1 1 2024-02-10T00:00:22.110 INFO:tasks.workunit.client.1.smithi183.stdout:7/40: mkdir d0/d11 0 2024-02-10T00:00:22.112 INFO:tasks.workunit.client.1.smithi183.stdout:1/52: truncate d0/d3/ff 3851625 0 2024-02-10T00:00:22.112 INFO:tasks.workunit.client.1.smithi183.stdout:2/121: mknod d2/da/d20/c26 0 2024-02-10T00:00:22.113 INFO:tasks.workunit.client.1.smithi183.stdout:8/77: truncate d0/f14 391308 0 2024-02-10T00:00:22.118 INFO:tasks.workunit.client.1.smithi183.stdout:6/32: rename d2/f4 to d2/f7 0 2024-02-10T00:00:22.118 INFO:tasks.workunit.client.1.smithi183.stdout:7/41: fdatasync d0/d2/d4/f5 0 2024-02-10T00:00:22.120 INFO:tasks.workunit.client.1.smithi183.stdout:2/122: mknod d2/da/d20/d21/c27 0 2024-02-10T00:00:22.121 INFO:tasks.workunit.client.1.smithi183.stdout:8/78: rename d0/l15 to d0/d10/l16 0 2024-02-10T00:00:22.122 INFO:tasks.workunit.client.1.smithi183.stdout:4/10: link c1 c6 0 2024-02-10T00:00:22.122 INFO:tasks.workunit.client.1.smithi183.stdout:9/32: truncate d0/f5 838863 0 2024-02-10T00:00:22.126 INFO:tasks.workunit.client.1.smithi183.stdout:6/33: rename d2/l5 to d2/l8 0 2024-02-10T00:00:22.126 INFO:tasks.workunit.client.1.smithi183.stdout:2/123: dwrite d2/da/d20/d21/f23 [0,4194304] 0 2024-02-10T00:00:22.128 INFO:tasks.workunit.client.1.smithi183.stdout:0/20: getdents . 0 2024-02-10T00:00:22.132 INFO:tasks.workunit.client.1.smithi183.stdout:2/124: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:22.134 INFO:tasks.workunit.client.1.smithi183.stdout:7/42: write d0/f1 [874540,13258] 0 2024-02-10T00:00:22.134 INFO:tasks.workunit.client.1.smithi183.stdout:7/43: chown d0/c6 3329 1 2024-02-10T00:00:22.137 INFO:tasks.workunit.client.1.smithi183.stdout:8/79: mknod d0/d10/c17 0 2024-02-10T00:00:22.137 INFO:tasks.workunit.client.1.smithi183.stdout:1/53: truncate d0/d3/f12 508437 0 2024-02-10T00:00:22.138 INFO:tasks.workunit.client.1.smithi183.stdout:9/33: symlink d0/d3/l7 0 2024-02-10T00:00:22.138 INFO:tasks.workunit.client.1.smithi183.stdout:6/34: symlink d2/l9 0 2024-02-10T00:00:22.139 INFO:tasks.workunit.client.1.smithi183.stdout:9/34: readlink d0/d3/l4 0 2024-02-10T00:00:22.140 INFO:tasks.workunit.client.1.smithi183.stdout:4/11: rename f3 to f7 0 2024-02-10T00:00:22.141 INFO:tasks.workunit.client.1.smithi183.stdout:4/12: dread - f4 zero size 2024-02-10T00:00:22.142 INFO:tasks.workunit.client.1.smithi183.stdout:7/44: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:22.142 INFO:tasks.workunit.client.1.smithi183.stdout:0/21: rename f5 to f6 0 2024-02-10T00:00:22.143 INFO:tasks.workunit.client.1.smithi183.stdout:0/22: read f3 [1808748,77213] 0 2024-02-10T00:00:22.143 INFO:tasks.workunit.client.1.smithi183.stdout:7/45: write d0/f1 [194767,75747] 0 2024-02-10T00:00:22.143 INFO:tasks.workunit.client.1.smithi183.stdout:2/125: mknod d2/da/d19/c28 0 2024-02-10T00:00:22.149 INFO:tasks.workunit.client.1.smithi183.stdout:8/80: rename d0/f1 to d0/f18 0 2024-02-10T00:00:22.149 INFO:tasks.workunit.client.1.smithi183.stdout:3/30: sync 2024-02-10T00:00:22.151 INFO:tasks.workunit.client.1.smithi183.stdout:6/35: rename c1 to d2/ca 0 2024-02-10T00:00:22.152 INFO:tasks.workunit.client.1.smithi183.stdout:9/35: mkdir d0/d8 0 2024-02-10T00:00:22.152 INFO:tasks.workunit.client.1.smithi183.stdout:9/36: readlink d0/d3/l4 0 2024-02-10T00:00:22.154 INFO:tasks.workunit.client.1.smithi183.stdout:0/23: creat f7 x:0 0 0 2024-02-10T00:00:22.155 INFO:tasks.workunit.client.1.smithi183.stdout:6/36: dread d2/f7 [4194304,4194304] 0 2024-02-10T00:00:22.155 INFO:tasks.workunit.client.1.smithi183.stdout:2/126: fdatasync d2/da/f1d 0 2024-02-10T00:00:22.156 INFO:tasks.workunit.client.1.smithi183.stdout:2/127: chown d2/da/f25 7 1 2024-02-10T00:00:22.157 INFO:tasks.workunit.client.1.smithi183.stdout:8/81: creat d0/d10/f19 x:0 0 0 2024-02-10T00:00:22.159 INFO:tasks.workunit.client.1.smithi183.stdout:1/54: rmdir d0/d3 39 2024-02-10T00:00:22.161 INFO:tasks.workunit.client.1.smithi183.stdout:7/46: mknod d0/d11/c12 0 2024-02-10T00:00:22.162 INFO:tasks.workunit.client.1.smithi183.stdout:0/24: symlink l8 0 2024-02-10T00:00:22.162 INFO:tasks.workunit.client.1.smithi183.stdout:6/37: creat d2/fb x:0 0 0 2024-02-10T00:00:22.163 INFO:tasks.workunit.client.1.smithi183.stdout:2/128: readlink d2/l10 0 2024-02-10T00:00:22.164 INFO:tasks.workunit.client.1.smithi183.stdout:3/31: fdatasync f2 0 2024-02-10T00:00:22.165 INFO:tasks.workunit.client.1.smithi183.stdout:2/129: write d2/f13 [9185557,116724] 0 2024-02-10T00:00:22.165 INFO:tasks.workunit.client.1.smithi183.stdout:8/82: creat d0/d10/f1a x:0 0 0 2024-02-10T00:00:22.166 INFO:tasks.workunit.client.1.smithi183.stdout:3/32: chown l1 89078 1 2024-02-10T00:00:22.167 INFO:tasks.workunit.client.1.smithi183.stdout:7/47: unlink d0/d2/c9 0 2024-02-10T00:00:22.167 INFO:tasks.workunit.client.1.smithi183.stdout:1/55: chown d0/d3/d7/l10 47 1 2024-02-10T00:00:22.168 INFO:tasks.workunit.client.1.smithi183.stdout:0/25: symlink l9 0 2024-02-10T00:00:22.169 INFO:tasks.workunit.client.1.smithi183.stdout:3/33: dread f2 [0,4194304] 0 2024-02-10T00:00:22.169 INFO:tasks.workunit.client.1.smithi183.stdout:7/48: write d0/fd [866994,129007] 0 2024-02-10T00:00:22.171 INFO:tasks.workunit.client.1.smithi183.stdout:6/38: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:22.171 INFO:tasks.workunit.client.1.smithi183.stdout:8/83: creat d0/f1b x:0 0 0 2024-02-10T00:00:22.173 INFO:tasks.workunit.client.1.smithi183.stdout:7/49: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:22.173 INFO:tasks.workunit.client.1.smithi183.stdout:7/50: chown d0/d2/d4/ce 10861918 1 2024-02-10T00:00:22.174 INFO:tasks.workunit.client.1.smithi183.stdout:0/26: creat fa x:0 0 0 2024-02-10T00:00:22.174 INFO:tasks.workunit.client.1.smithi183.stdout:7/51: chown d0/d2/d3/c10 54916869 1 2024-02-10T00:00:22.174 INFO:tasks.workunit.client.1.smithi183.stdout:0/27: readlink l8 0 2024-02-10T00:00:22.174 INFO:tasks.workunit.client.1.smithi183.stdout:5/78: sync 2024-02-10T00:00:22.175 INFO:tasks.workunit.client.1.smithi183.stdout:3/34: mknod c4 0 2024-02-10T00:00:22.177 INFO:tasks.workunit.client.1.smithi183.stdout:3/35: dread f2 [0,4194304] 0 2024-02-10T00:00:22.184 INFO:tasks.workunit.client.1.smithi183.stdout:6/39: creat d2/fc x:0 0 0 2024-02-10T00:00:22.186 INFO:tasks.workunit.client.1.smithi183.stdout:0/28: rename fa to fb 0 2024-02-10T00:00:22.187 INFO:tasks.workunit.client.1.smithi183.stdout:6/40: dread d2/fb [0,4194304] 0 2024-02-10T00:00:22.190 INFO:tasks.workunit.client.1.smithi183.stdout:6/41: dread d2/f7 [4194304,4194304] 0 2024-02-10T00:00:22.192 INFO:tasks.workunit.client.1.smithi183.stdout:5/79: dread d4/fc [0,4194304] 0 2024-02-10T00:00:22.205 INFO:tasks.workunit.client.1.smithi183.stdout:1/56: creat d0/f15 x:0 0 0 2024-02-10T00:00:22.206 INFO:tasks.workunit.client.1.smithi183.stdout:3/36: creat f5 x:0 0 0 2024-02-10T00:00:22.206 INFO:tasks.workunit.client.1.smithi183.stdout:5/80: dread d4/fc [0,4194304] 0 2024-02-10T00:00:22.206 INFO:tasks.workunit.client.1.smithi183.stdout:4/13: unlink f7 0 2024-02-10T00:00:22.207 INFO:tasks.workunit.client.1.smithi183.stdout:3/37: dread - f5 zero size 2024-02-10T00:00:22.208 INFO:tasks.workunit.client.1.smithi183.stdout:5/81: chown d4/d1d 515152 1 2024-02-10T00:00:22.210 INFO:tasks.workunit.client.1.smithi183.stdout:9/37: write d0/f5 [816905,45184] 0 2024-02-10T00:00:22.210 INFO:tasks.workunit.client.1.smithi183.stdout:5/82: chown d4/c15 316 1 2024-02-10T00:00:22.210 INFO:tasks.workunit.client.1.smithi183.stdout:2/130: getdents d2/da/d20/d21 0 2024-02-10T00:00:22.213 INFO:tasks.workunit.client.1.smithi183.stdout:3/38: creat f6 x:0 0 0 2024-02-10T00:00:22.213 INFO:tasks.workunit.client.1.smithi183.stdout:8/84: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:22.213 INFO:tasks.workunit.client.1.smithi183.stdout:1/57: mknod d0/d3/d14/c16 0 2024-02-10T00:00:22.214 INFO:tasks.workunit.client.1.smithi183.stdout:5/83: fsync f0 0 2024-02-10T00:00:22.216 INFO:tasks.workunit.client.1.smithi183.stdout:2/131: creat d2/da/d20/d21/f29 x:0 0 0 2024-02-10T00:00:22.217 INFO:tasks.workunit.client.1.smithi183.stdout:6/42: dwrite d2/f7 [4194304,4194304] 0 2024-02-10T00:00:22.218 INFO:tasks.workunit.client.1.smithi183.stdout:3/39: mkdir d7 0 2024-02-10T00:00:22.218 INFO:tasks.workunit.client.1.smithi183.stdout:7/52: truncate d0/d2/d4/f5 577965 0 2024-02-10T00:00:22.219 INFO:tasks.workunit.client.1.smithi183.stdout:3/40: dread - f5 zero size 2024-02-10T00:00:22.220 INFO:tasks.workunit.client.1.smithi183.stdout:8/85: symlink d0/l1c 0 2024-02-10T00:00:22.221 INFO:tasks.workunit.client.1.smithi183.stdout:2/132: dread d2/f13 [4194304,4194304] 0 2024-02-10T00:00:22.223 INFO:tasks.workunit.client.1.smithi183.stdout:4/14: write f0 [580193,115788] 0 2024-02-10T00:00:22.224 INFO:tasks.workunit.client.1.smithi183.stdout:8/86: dread d0/fb [0,4194304] 0 2024-02-10T00:00:22.225 INFO:tasks.workunit.client.1.smithi183.stdout:8/87: write d0/fb [5160583,119681] 0 2024-02-10T00:00:22.226 INFO:tasks.workunit.client.1.smithi183.stdout:6/43: symlink d2/ld 0 2024-02-10T00:00:22.228 INFO:tasks.workunit.client.1.smithi183.stdout:7/53: creat d0/d2/d4/d8/f13 x:0 0 0 2024-02-10T00:00:22.230 INFO:tasks.workunit.client.1.smithi183.stdout:2/133: mkdir d2/da/d19/d2a 0 2024-02-10T00:00:22.230 INFO:tasks.workunit.client.1.smithi183.stdout:9/38: link d0/c6 d0/c9 0 2024-02-10T00:00:22.232 INFO:tasks.workunit.client.1.smithi183.stdout:8/88: mkdir d0/d1d 0 2024-02-10T00:00:22.232 INFO:tasks.workunit.client.1.smithi183.stdout:4/15: dwrite f4 [0,4194304] 0 2024-02-10T00:00:22.232 INFO:tasks.workunit.client.1.smithi183.stdout:4/16: rmdir - no directory 2024-02-10T00:00:22.233 INFO:tasks.workunit.client.1.smithi183.stdout:5/84: dwrite d4/dd/ff [0,4194304] 0 2024-02-10T00:00:22.233 INFO:tasks.workunit.client.1.smithi183.stdout:1/58: creat d0/f17 x:0 0 0 2024-02-10T00:00:22.233 INFO:tasks.workunit.client.1.smithi183.stdout:9/39: write d0/f5 [664632,107315] 0 2024-02-10T00:00:22.234 INFO:tasks.workunit.client.1.smithi183.stdout:1/59: fsync d0/f15 0 2024-02-10T00:00:22.235 INFO:tasks.workunit.client.1.smithi183.stdout:3/41: creat d7/f8 x:0 0 0 2024-02-10T00:00:22.235 INFO:tasks.workunit.client.1.smithi183.stdout:1/60: write d0/f15 [493225,62597] 0 2024-02-10T00:00:22.237 INFO:tasks.workunit.client.1.smithi183.stdout:7/54: mknod d0/d11/c14 0 2024-02-10T00:00:22.239 INFO:tasks.workunit.client.1.smithi183.stdout:4/17: symlink l8 0 2024-02-10T00:00:22.240 INFO:tasks.workunit.client.1.smithi183.stdout:4/18: write f4 [2765263,1644] 0 2024-02-10T00:00:22.242 INFO:tasks.workunit.client.1.smithi183.stdout:2/134: rename d2/da/lf to d2/da/d20/l2b 0 2024-02-10T00:00:22.243 INFO:tasks.workunit.client.1.smithi183.stdout:8/89: rename d0/f9 to d0/f1e 0 2024-02-10T00:00:22.244 INFO:tasks.workunit.client.1.smithi183.stdout:7/55: dwrite d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:22.245 INFO:tasks.workunit.client.1.smithi183.stdout:7/56: stat d0/f1 0 2024-02-10T00:00:22.245 INFO:tasks.workunit.client.1.smithi183.stdout:8/90: dread - d0/d10/f1a zero size 2024-02-10T00:00:22.245 INFO:tasks.workunit.client.1.smithi183.stdout:5/85: read d4/f13 [16287,96321] 0 2024-02-10T00:00:22.246 INFO:tasks.workunit.client.1.smithi183.stdout:9/40: creat d0/fa x:0 0 0 2024-02-10T00:00:22.248 INFO:tasks.workunit.client.1.smithi183.stdout:9/41: write d0/fa [869517,72588] 0 2024-02-10T00:00:22.249 INFO:tasks.workunit.client.1.smithi183.stdout:4/19: dwrite f4 [0,4194304] 0 2024-02-10T00:00:22.250 INFO:tasks.workunit.client.1.smithi183.stdout:0/29: sync 2024-02-10T00:00:22.251 INFO:tasks.workunit.client.1.smithi183.stdout:0/30: chown l8 0 1 2024-02-10T00:00:22.252 INFO:tasks.workunit.client.1.smithi183.stdout:3/42: rename f2 to d7/f9 0 2024-02-10T00:00:22.254 INFO:tasks.workunit.client.1.smithi183.stdout:8/91: creat d0/f1f x:0 0 0 2024-02-10T00:00:22.255 INFO:tasks.workunit.client.1.smithi183.stdout:1/61: fsync d0/d3/f12 0 2024-02-10T00:00:22.256 INFO:tasks.workunit.client.1.smithi183.stdout:4/20: dread f4 [0,4194304] 0 2024-02-10T00:00:22.256 INFO:tasks.workunit.client.1.smithi183.stdout:9/42: dwrite d0/f5 [0,4194304] 0 2024-02-10T00:00:22.258 INFO:tasks.workunit.client.1.smithi183.stdout:2/135: mkdir d2/d2c 0 2024-02-10T00:00:22.259 INFO:tasks.workunit.client.1.smithi183.stdout:0/31: symlink lc 0 2024-02-10T00:00:22.260 INFO:tasks.workunit.client.1.smithi183.stdout:8/92: dread d0/f1e [0,4194304] 0 2024-02-10T00:00:22.263 INFO:tasks.workunit.client.1.smithi183.stdout:4/21: dread f4 [0,4194304] 0 2024-02-10T00:00:22.264 INFO:tasks.workunit.client.1.smithi183.stdout:9/43: creat d0/fb x:0 0 0 2024-02-10T00:00:22.265 INFO:tasks.workunit.client.1.smithi183.stdout:4/22: fsync f0 0 2024-02-10T00:00:22.266 INFO:tasks.workunit.client.1.smithi183.stdout:0/32: symlink ld 0 2024-02-10T00:00:22.266 INFO:tasks.workunit.client.1.smithi183.stdout:4/23: fdatasync f0 0 2024-02-10T00:00:22.270 INFO:tasks.workunit.client.1.smithi183.stdout:9/44: mknod d0/d3/cc 0 2024-02-10T00:00:22.274 INFO:tasks.workunit.client.1.smithi183.stdout:7/57: rename d0/d2/d4/d8/la to d0/d2/l15 0 2024-02-10T00:00:22.275 INFO:tasks.workunit.client.1.smithi183.stdout:8/93: truncate d0/d10/f12 675481 0 2024-02-10T00:00:22.276 INFO:tasks.workunit.client.1.smithi183.stdout:9/45: creat d0/d3/fd x:0 0 0 2024-02-10T00:00:22.277 INFO:tasks.workunit.client.1.smithi183.stdout:2/136: truncate d2/da/d20/d21/f29 668777 0 2024-02-10T00:00:22.277 INFO:tasks.workunit.client.1.smithi183.stdout:9/46: read - d0/d3/fd zero size 2024-02-10T00:00:22.278 INFO:tasks.workunit.client.1.smithi183.stdout:7/58: mknod d0/d11/c16 0 2024-02-10T00:00:22.279 INFO:tasks.workunit.client.1.smithi183.stdout:8/94: readlink d0/d10/l16 0 2024-02-10T00:00:22.280 INFO:tasks.workunit.client.1.smithi183.stdout:8/95: read - d0/d10/f1a zero size 2024-02-10T00:00:22.282 INFO:tasks.workunit.client.1.smithi183.stdout:9/47: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:22.282 INFO:tasks.workunit.client.1.smithi183.stdout:9/48: read - d0/d3/fd zero size 2024-02-10T00:00:22.283 INFO:tasks.workunit.client.1.smithi183.stdout:8/96: mknod d0/c20 0 2024-02-10T00:00:22.283 INFO:tasks.workunit.client.1.smithi183.stdout:8/97: fsync d0/d10/f1a 0 2024-02-10T00:00:22.292 INFO:tasks.workunit.client.1.smithi183.stdout:9/49: chown d0/c6 246 1 2024-02-10T00:00:22.293 INFO:tasks.workunit.client.1.smithi183.stdout:9/50: chown d0/d3/cc 526 1 2024-02-10T00:00:22.294 INFO:tasks.workunit.client.1.smithi183.stdout:8/98: link d0/f18 d0/d1d/f21 0 2024-02-10T00:00:22.296 INFO:tasks.workunit.client.1.smithi183.stdout:8/99: write d0/d10/f19 [26554,121354] 0 2024-02-10T00:00:22.298 INFO:tasks.workunit.client.1.smithi183.stdout:8/100: write d0/f1f [611278,4956] 0 2024-02-10T00:00:22.298 INFO:tasks.workunit.client.1.smithi183.stdout:9/51: dwrite d0/d3/fd [0,4194304] 0 2024-02-10T00:00:22.299 INFO:tasks.workunit.client.1.smithi183.stdout:9/52: rename d0/d8 to d0/d8/de 22 2024-02-10T00:00:22.299 INFO:tasks.workunit.client.1.smithi183.stdout:9/53: stat d0/d3/l4 0 2024-02-10T00:00:22.300 INFO:tasks.workunit.client.1.smithi183.stdout:9/54: write d0/d3/fd [75311,48467] 0 2024-02-10T00:00:22.305 INFO:tasks.workunit.client.1.smithi183.stdout:9/55: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:22.306 INFO:tasks.workunit.client.1.smithi183.stdout:9/56: write d0/fa [1527792,10547] 0 2024-02-10T00:00:22.307 INFO:tasks.workunit.client.1.smithi183.stdout:4/24: fdatasync f4 0 2024-02-10T00:00:22.307 INFO:tasks.workunit.client.1.smithi183.stdout:4/25: chown f4 717 1 2024-02-10T00:00:22.308 INFO:tasks.workunit.client.1.smithi183.stdout:4/26: write f0 [36561,68911] 0 2024-02-10T00:00:22.310 INFO:tasks.workunit.client.1.smithi183.stdout:6/44: truncate d2/f7 1713122 0 2024-02-10T00:00:22.310 INFO:tasks.workunit.client.1.smithi183.stdout:9/57: dread d0/fb [0,4194304] 0 2024-02-10T00:00:22.313 INFO:tasks.workunit.client.1.smithi183.stdout:4/27: dwrite f0 [0,4194304] 0 2024-02-10T00:00:22.313 INFO:tasks.workunit.client.1.smithi183.stdout:4/28: write f4 [3204274,12159] 0 2024-02-10T00:00:22.315 INFO:tasks.workunit.client.1.smithi183.stdout:5/86: truncate d4/dd/ff 1279171 0 2024-02-10T00:00:22.317 INFO:tasks.workunit.client.1.smithi183.stdout:1/62: write d0/d3/fa [67585,100096] 0 2024-02-10T00:00:22.317 INFO:tasks.workunit.client.1.smithi183.stdout:0/33: write f3 [5729145,44021] 0 2024-02-10T00:00:22.318 INFO:tasks.workunit.client.1.smithi183.stdout:1/63: chown d0/d3/lb 18937 1 2024-02-10T00:00:22.322 INFO:tasks.workunit.client.1.smithi183.stdout:3/43: rmdir d7 39 2024-02-10T00:00:22.331 INFO:tasks.workunit.client.1.smithi183.stdout:9/58: creat d0/ff x:0 0 0 2024-02-10T00:00:22.332 INFO:tasks.workunit.client.1.smithi183.stdout:4/29: symlink l9 0 2024-02-10T00:00:22.334 INFO:tasks.workunit.client.1.smithi183.stdout:3/44: read - d7/f8 zero size 2024-02-10T00:00:22.334 INFO:tasks.workunit.client.1.smithi183.stdout:9/59: dread d0/d3/fd [0,4194304] 0 2024-02-10T00:00:22.335 INFO:tasks.workunit.client.1.smithi183.stdout:4/30: chown c5 54957853 1 2024-02-10T00:00:22.337 INFO:tasks.workunit.client.1.smithi183.stdout:3/45: chown d7/f9 6705138 1 2024-02-10T00:00:22.340 INFO:tasks.workunit.client.1.smithi183.stdout:1/64: link d0/d3/f12 d0/d3/d7/f18 0 2024-02-10T00:00:22.341 INFO:tasks.workunit.client.1.smithi183.stdout:9/60: unlink d0/c9 0 2024-02-10T00:00:22.342 INFO:tasks.workunit.client.1.smithi183.stdout:3/46: dwrite d7/f8 [0,4194304] 0 2024-02-10T00:00:22.343 INFO:tasks.workunit.client.1.smithi183.stdout:0/34: getdents . 0 2024-02-10T00:00:22.346 INFO:tasks.workunit.client.1.smithi183.stdout:3/47: creat d7/fa x:0 0 0 2024-02-10T00:00:22.347 INFO:tasks.workunit.client.1.smithi183.stdout:0/35: mknod ce 0 2024-02-10T00:00:22.349 INFO:tasks.workunit.client.1.smithi183.stdout:1/65: link d0/f17 d0/d3/d7/f19 0 2024-02-10T00:00:22.349 INFO:tasks.workunit.client.1.smithi183.stdout:8/101: sync 2024-02-10T00:00:22.349 INFO:tasks.workunit.client.1.smithi183.stdout:2/137: sync 2024-02-10T00:00:22.349 INFO:tasks.workunit.client.1.smithi183.stdout:7/59: sync 2024-02-10T00:00:22.349 INFO:tasks.workunit.client.1.smithi183.stdout:2/138: read - d2/da/f1f zero size 2024-02-10T00:00:22.352 INFO:tasks.workunit.client.1.smithi183.stdout:3/48: mkdir d7/db 0 2024-02-10T00:00:22.352 INFO:tasks.workunit.client.1.smithi183.stdout:9/61: rmdir d0/d8 0 2024-02-10T00:00:22.355 INFO:tasks.workunit.client.1.smithi183.stdout:2/139: rmdir d2/da/d20/d21 39 2024-02-10T00:00:22.357 INFO:tasks.workunit.client.1.smithi183.stdout:1/66: fdatasync d0/d3/ff 0 2024-02-10T00:00:22.359 INFO:tasks.workunit.client.1.smithi183.stdout:9/62: mkdir d0/d10 0 2024-02-10T00:00:22.359 INFO:tasks.workunit.client.1.smithi183.stdout:8/102: mknod d0/d1d/c22 0 2024-02-10T00:00:22.359 INFO:tasks.workunit.client.1.smithi183.stdout:2/140: stat d2/da/d20/d21/c27 0 2024-02-10T00:00:22.360 INFO:tasks.workunit.client.1.smithi183.stdout:2/141: dread - d2/da/f25 zero size 2024-02-10T00:00:22.361 INFO:tasks.workunit.client.1.smithi183.stdout:3/49: creat d7/db/fc x:0 0 0 2024-02-10T00:00:22.362 INFO:tasks.workunit.client.1.smithi183.stdout:1/67: symlink d0/d3/l1a 0 2024-02-10T00:00:22.363 INFO:tasks.workunit.client.1.smithi183.stdout:1/68: readlink d0/d3/l4 0 2024-02-10T00:00:22.363 INFO:tasks.workunit.client.1.smithi183.stdout:9/63: write d0/d3/fd [1527558,115317] 0 2024-02-10T00:00:22.367 INFO:tasks.workunit.client.1.smithi183.stdout:3/50: dwrite d7/db/fc [0,4194304] 0 2024-02-10T00:00:22.368 INFO:tasks.workunit.client.1.smithi183.stdout:2/142: mkdir d2/d2c/d2d 0 2024-02-10T00:00:22.370 INFO:tasks.workunit.client.1.smithi183.stdout:9/64: rename d0/d3/fd to d0/d3/f11 0 2024-02-10T00:00:22.371 INFO:tasks.workunit.client.1.smithi183.stdout:1/69: dwrite d0/d3/fa [0,4194304] 0 2024-02-10T00:00:22.372 INFO:tasks.workunit.client.1.smithi183.stdout:9/65: read d0/d3/f11 [1706689,36790] 0 2024-02-10T00:00:22.372 INFO:tasks.workunit.client.1.smithi183.stdout:2/143: fdatasync d2/da/fb 0 2024-02-10T00:00:22.373 INFO:tasks.workunit.client.1.smithi183.stdout:3/51: dread d7/f8 [0,4194304] 0 2024-02-10T00:00:22.374 INFO:tasks.workunit.client.1.smithi183.stdout:0/36: sync 2024-02-10T00:00:22.374 INFO:tasks.workunit.client.1.smithi183.stdout:0/37: chown l8 9 1 2024-02-10T00:00:22.377 INFO:tasks.workunit.client.1.smithi183.stdout:5/87: fsync d4/fc 0 2024-02-10T00:00:22.378 INFO:tasks.workunit.client.1.smithi183.stdout:0/38: dread f3 [0,4194304] 0 2024-02-10T00:00:22.379 INFO:tasks.workunit.client.1.smithi183.stdout:0/39: chown ld 66497598 1 2024-02-10T00:00:22.381 INFO:tasks.workunit.client.1.smithi183.stdout:6/45: dwrite d2/f7 [0,4194304] 0 2024-02-10T00:00:22.381 INFO:tasks.workunit.client.1.smithi183.stdout:4/31: truncate f0 3405503 0 2024-02-10T00:00:22.384 INFO:tasks.workunit.client.1.smithi183.stdout:6/46: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:22.392 INFO:tasks.workunit.client.1.smithi183.stdout:8/103: truncate d0/fb 6305615 0 2024-02-10T00:00:22.393 INFO:tasks.workunit.client.1.smithi183.stdout:9/66: rename d0/fa to d0/f12 0 2024-02-10T00:00:22.396 INFO:tasks.workunit.client.1.smithi183.stdout:9/67: dread d0/fb [0,4194304] 0 2024-02-10T00:00:22.409 INFO:tasks.workunit.client.1.smithi183.stdout:7/60: fdatasync d0/d2/d4/f5 0 2024-02-10T00:00:22.409 INFO:tasks.workunit.client.1.smithi183.stdout:0/40: creat ff x:0 0 0 2024-02-10T00:00:22.410 INFO:tasks.workunit.client.1.smithi183.stdout:8/104: mkdir d0/d23 0 2024-02-10T00:00:22.410 INFO:tasks.workunit.client.1.smithi183.stdout:6/47: creat d2/fe x:0 0 0 2024-02-10T00:00:22.411 INFO:tasks.workunit.client.1.smithi183.stdout:1/70: write d0/f17 [249519,10179] 0 2024-02-10T00:00:22.411 INFO:tasks.workunit.client.1.smithi183.stdout:6/48: chown d2/f7 181814 1 2024-02-10T00:00:22.412 INFO:tasks.workunit.client.1.smithi183.stdout:7/61: read d0/d2/d4/d8/f13 [2910485,3302] 0 2024-02-10T00:00:22.412 INFO:tasks.workunit.client.1.smithi183.stdout:1/71: write d0/f13 [98185,66527] 0 2024-02-10T00:00:22.414 INFO:tasks.workunit.client.1.smithi183.stdout:6/49: write d2/fc [458678,27201] 0 2024-02-10T00:00:22.416 INFO:tasks.workunit.client.1.smithi183.stdout:9/68: mknod d0/c13 0 2024-02-10T00:00:22.417 INFO:tasks.workunit.client.1.smithi183.stdout:0/41: write fb [135209,56452] 0 2024-02-10T00:00:22.419 INFO:tasks.workunit.client.1.smithi183.stdout:9/69: write d0/f5 [2031694,82116] 0 2024-02-10T00:00:22.420 INFO:tasks.workunit.client.1.smithi183.stdout:8/105: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:22.420 INFO:tasks.workunit.client.1.smithi183.stdout:6/50: creat d2/ff x:0 0 0 2024-02-10T00:00:22.422 INFO:tasks.workunit.client.1.smithi183.stdout:1/72: dread d0/d3/f12 [0,4194304] 0 2024-02-10T00:00:22.422 INFO:tasks.workunit.client.1.smithi183.stdout:5/88: dwrite f3 [0,4194304] 0 2024-02-10T00:00:22.424 INFO:tasks.workunit.client.1.smithi183.stdout:2/144: sync 2024-02-10T00:00:22.425 INFO:tasks.workunit.client.1.smithi183.stdout:6/51: write d2/f7 [1644881,47509] 0 2024-02-10T00:00:22.425 INFO:tasks.workunit.client.1.smithi183.stdout:5/89: readlink d4/d11/l18 0 2024-02-10T00:00:22.426 INFO:tasks.workunit.client.1.smithi183.stdout:7/62: rename d0/d2/d3/fb to d0/d2/f17 0 2024-02-10T00:00:22.426 INFO:tasks.workunit.client.1.smithi183.stdout:6/52: fsync d2/fc 0 2024-02-10T00:00:22.427 INFO:tasks.workunit.client.1.smithi183.stdout:2/145: chown d2/f15 36203 1 2024-02-10T00:00:22.430 INFO:tasks.workunit.client.1.smithi183.stdout:0/42: dwrite ff [0,4194304] 0 2024-02-10T00:00:22.431 INFO:tasks.workunit.client.1.smithi183.stdout:2/146: fsync d2/da/d20/d21/f23 0 2024-02-10T00:00:22.433 INFO:tasks.workunit.client.1.smithi183.stdout:8/106: dread d0/d10/f12 [0,4194304] 0 2024-02-10T00:00:22.434 INFO:tasks.workunit.client.1.smithi183.stdout:5/90: dwrite f0 [0,4194304] 0 2024-02-10T00:00:22.443 INFO:tasks.workunit.client.1.smithi183.stdout:7/63: symlink d0/d2/d4/d8/l18 0 2024-02-10T00:00:22.444 INFO:tasks.workunit.client.1.smithi183.stdout:0/43: mknod c10 0 2024-02-10T00:00:22.444 INFO:tasks.workunit.client.1.smithi183.stdout:2/147: fsync d2/f13 0 2024-02-10T00:00:22.449 INFO:tasks.workunit.client.1.smithi183.stdout:2/148: dwrite d2/da/f1f [0,4194304] 0 2024-02-10T00:00:22.451 INFO:tasks.workunit.client.1.smithi183.stdout:3/52: sync 2024-02-10T00:00:22.452 INFO:tasks.workunit.client.1.smithi183.stdout:3/53: fdatasync d7/fa 0 2024-02-10T00:00:22.455 INFO:tasks.workunit.client.1.smithi183.stdout:2/149: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:22.458 INFO:tasks.workunit.client.1.smithi183.stdout:2/150: dread d2/f1e [0,4194304] 0 2024-02-10T00:00:22.467 INFO:tasks.workunit.client.1.smithi183.stdout:1/73: truncate d0/f15 381815 0 2024-02-10T00:00:22.491 INFO:tasks.workunit.client.1.smithi183.stdout:4/32: sync 2024-02-10T00:00:22.491 INFO:tasks.workunit.client.1.smithi183.stdout:9/70: sync 2024-02-10T00:00:22.491 INFO:tasks.workunit.client.1.smithi183.stdout:4/33: fsync f4 0 2024-02-10T00:00:22.494 INFO:tasks.workunit.client.1.smithi183.stdout:4/34: dread f4 [0,4194304] 0 2024-02-10T00:00:22.495 INFO:tasks.workunit.client.1.smithi183.stdout:4/35: rmdir - no directory 2024-02-10T00:00:22.499 INFO:tasks.workunit.client.1.smithi183.stdout:4/36: dwrite f4 [0,4194304] 0 2024-02-10T00:00:22.584 INFO:tasks.workunit.client.1.smithi183.stdout:6/53: link d2/f7 d2/f10 0 2024-02-10T00:00:22.585 INFO:tasks.workunit.client.1.smithi183.stdout:6/54: write d2/fe [117731,97234] 0 2024-02-10T00:00:22.585 INFO:tasks.workunit.client.1.smithi183.stdout:5/91: link d4/dd/f14 d4/d11/f1f 0 2024-02-10T00:00:22.588 INFO:tasks.workunit.client.1.smithi183.stdout:0/44: symlink l11 0 2024-02-10T00:00:22.588 INFO:tasks.workunit.client.1.smithi183.stdout:0/45: chown ff 6 1 2024-02-10T00:00:22.588 INFO:tasks.workunit.client.1.smithi183.stdout:0/46: fdatasync fb 0 2024-02-10T00:00:22.589 INFO:tasks.workunit.client.1.smithi183.stdout:7/64: truncate d0/d2/d4/d8/f13 1112692 0 2024-02-10T00:00:22.590 INFO:tasks.workunit.client.1.smithi183.stdout:3/54: creat d7/fd x:0 0 0 2024-02-10T00:00:22.592 INFO:tasks.workunit.client.1.smithi183.stdout:2/151: creat d2/da/d19/f2e x:0 0 0 2024-02-10T00:00:22.627 INFO:tasks.workunit.client.1.smithi183.stdout:9/71: mkdir d0/d3/d14 0 2024-02-10T00:00:22.632 INFO:tasks.workunit.client.1.smithi183.stdout:4/37: mknod ca 0 2024-02-10T00:00:22.658 INFO:tasks.workunit.client.1.smithi183.stdout:8/107: write d0/fb [3854341,52505] 0 2024-02-10T00:00:22.658 INFO:tasks.workunit.client.1.smithi183.stdout:6/55: symlink d2/l11 0 2024-02-10T00:00:22.660 INFO:tasks.workunit.client.1.smithi183.stdout:8/108: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:22.661 INFO:tasks.workunit.client.1.smithi183.stdout:8/109: write d0/fd [1219476,54681] 0 2024-02-10T00:00:22.665 INFO:tasks.workunit.client.1.smithi183.stdout:1/74: dwrite d0/d3/f12 [0,4194304] 0 2024-02-10T00:00:22.666 INFO:tasks.workunit.client.1.smithi183.stdout:1/75: chown d0/d3/ff 194448 1 2024-02-10T00:00:22.666 INFO:tasks.workunit.client.1.smithi183.stdout:0/47: unlink l8 0 2024-02-10T00:00:22.666 INFO:tasks.workunit.client.1.smithi183.stdout:1/76: stat d0/f17 0 2024-02-10T00:00:22.666 INFO:tasks.workunit.client.1.smithi183.stdout:1/77: write d0/f13 [175574,14308] 0 2024-02-10T00:00:22.667 INFO:tasks.workunit.client.1.smithi183.stdout:3/55: rename d7/fa to d7/fe 0 2024-02-10T00:00:22.669 INFO:tasks.workunit.client.1.smithi183.stdout:2/152: mkdir d2/d2c/d2f 0 2024-02-10T00:00:22.670 INFO:tasks.workunit.client.1.smithi183.stdout:9/72: symlink d0/d3/l15 0 2024-02-10T00:00:22.670 INFO:tasks.workunit.client.1.smithi183.stdout:4/38: creat fb x:0 0 0 2024-02-10T00:00:22.671 INFO:tasks.workunit.client.1.smithi183.stdout:6/56: readlink d2/l8 0 2024-02-10T00:00:22.675 INFO:tasks.workunit.client.1.smithi183.stdout:8/110: mkdir d0/d1d/d24 0 2024-02-10T00:00:22.678 INFO:tasks.workunit.client.1.smithi183.stdout:0/48: symlink l12 0 2024-02-10T00:00:22.678 INFO:tasks.workunit.client.1.smithi183.stdout:7/65: mknod d0/d2/c19 0 2024-02-10T00:00:22.679 INFO:tasks.workunit.client.1.smithi183.stdout:1/78: symlink d0/d3/d14/l1b 0 2024-02-10T00:00:22.679 INFO:tasks.workunit.client.1.smithi183.stdout:2/153: truncate d2/da/f1d 1367831 0 2024-02-10T00:00:22.681 INFO:tasks.workunit.client.1.smithi183.stdout:6/57: symlink d2/l12 0 2024-02-10T00:00:22.682 INFO:tasks.workunit.client.1.smithi183.stdout:5/92: link d4/dd/f14 d4/f20 0 2024-02-10T00:00:22.682 INFO:tasks.workunit.client.1.smithi183.stdout:8/111: rmdir d0/d1d 39 2024-02-10T00:00:22.684 INFO:tasks.workunit.client.1.smithi183.stdout:0/49: rename lc to l13 0 2024-02-10T00:00:22.686 INFO:tasks.workunit.client.1.smithi183.stdout:7/66: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:22.688 INFO:tasks.workunit.client.1.smithi183.stdout:4/39: fsync fb 0 2024-02-10T00:00:22.691 INFO:tasks.workunit.client.1.smithi183.stdout:4/40: dread f4 [0,4194304] 0 2024-02-10T00:00:22.694 INFO:tasks.workunit.client.1.smithi183.stdout:9/73: creat d0/d3/d14/f16 x:0 0 0 2024-02-10T00:00:22.695 INFO:tasks.workunit.client.1.smithi183.stdout:2/154: unlink d2/da/d19/f24 0 2024-02-10T00:00:22.695 INFO:tasks.workunit.client.1.smithi183.stdout:2/155: readlink d2/da/l16 0 2024-02-10T00:00:22.696 INFO:tasks.workunit.client.1.smithi183.stdout:6/58: mkdir d2/d13 0 2024-02-10T00:00:22.697 INFO:tasks.workunit.client.1.smithi183.stdout:8/112: symlink d0/d10/l25 0 2024-02-10T00:00:22.698 INFO:tasks.workunit.client.1.smithi183.stdout:0/50: mkdir d14 0 2024-02-10T00:00:22.699 INFO:tasks.workunit.client.1.smithi183.stdout:4/41: write f0 [935745,126024] 0 2024-02-10T00:00:22.700 INFO:tasks.workunit.client.1.smithi183.stdout:9/74: mknod d0/c17 0 2024-02-10T00:00:22.701 INFO:tasks.workunit.client.1.smithi183.stdout:9/75: chown d0/c17 4 1 2024-02-10T00:00:22.701 INFO:tasks.workunit.client.1.smithi183.stdout:2/156: write d2/f1e [1621695,78503] 0 2024-02-10T00:00:22.702 INFO:tasks.workunit.client.1.smithi183.stdout:6/59: unlink d2/fe 0 2024-02-10T00:00:22.703 INFO:tasks.workunit.client.1.smithi183.stdout:9/76: read d0/f5 [2487838,42049] 0 2024-02-10T00:00:22.703 INFO:tasks.workunit.client.1.smithi183.stdout:0/51: dwrite fb [0,4194304] 0 2024-02-10T00:00:22.706 INFO:tasks.workunit.client.1.smithi183.stdout:1/79: creat d0/f1c x:0 0 0 2024-02-10T00:00:22.707 INFO:tasks.workunit.client.1.smithi183.stdout:1/80: rename d0/d3 to d0/d3/d14/d1d 22 2024-02-10T00:00:22.708 INFO:tasks.workunit.client.1.smithi183.stdout:4/42: symlink lc 0 2024-02-10T00:00:22.709 INFO:tasks.workunit.client.1.smithi183.stdout:1/81: stat d0/d3/l6 0 2024-02-10T00:00:22.710 INFO:tasks.workunit.client.1.smithi183.stdout:9/77: dread d0/d3/f11 [0,4194304] 0 2024-02-10T00:00:22.711 INFO:tasks.workunit.client.1.smithi183.stdout:0/52: dwrite f7 [0,4194304] 0 2024-02-10T00:00:22.713 INFO:tasks.workunit.client.1.smithi183.stdout:5/93: write d4/f9 [2364814,25715] 0 2024-02-10T00:00:22.717 INFO:tasks.workunit.client.1.smithi183.stdout:8/113: truncate d0/f18 1225531 0 2024-02-10T00:00:22.718 INFO:tasks.workunit.client.1.smithi183.stdout:3/56: sync 2024-02-10T00:00:22.720 INFO:tasks.workunit.client.1.smithi183.stdout:7/67: creat d0/d2/f1a x:0 0 0 2024-02-10T00:00:22.722 INFO:tasks.workunit.client.1.smithi183.stdout:4/43: rename c2 to cd 0 2024-02-10T00:00:22.723 INFO:tasks.workunit.client.1.smithi183.stdout:4/44: dread - fb zero size 2024-02-10T00:00:22.723 INFO:tasks.workunit.client.1.smithi183.stdout:4/45: write f0 [797398,130864] 0 2024-02-10T00:00:22.724 INFO:tasks.workunit.client.1.smithi183.stdout:4/46: write fb [697335,23557] 0 2024-02-10T00:00:22.725 INFO:tasks.workunit.client.1.smithi183.stdout:9/78: rmdir d0 39 2024-02-10T00:00:22.727 INFO:tasks.workunit.client.1.smithi183.stdout:5/94: truncate d4/f13 155075 0 2024-02-10T00:00:22.728 INFO:tasks.workunit.client.1.smithi183.stdout:4/47: dwrite f0 [0,4194304] 0 2024-02-10T00:00:22.729 INFO:tasks.workunit.client.1.smithi183.stdout:4/48: write fb [1491408,114535] 0 2024-02-10T00:00:22.730 INFO:tasks.workunit.client.1.smithi183.stdout:4/49: rmdir - no directory 2024-02-10T00:00:22.733 INFO:tasks.workunit.client.1.smithi183.stdout:4/50: read fb [1421403,111111] 0 2024-02-10T00:00:22.734 INFO:tasks.workunit.client.1.smithi183.stdout:4/51: chown lc 38 1 2024-02-10T00:00:22.737 INFO:tasks.workunit.client.1.smithi183.stdout:4/52: dread f0 [0,4194304] 0 2024-02-10T00:00:22.738 INFO:tasks.workunit.client.1.smithi183.stdout:4/53: write fb [1334712,123207] 0 2024-02-10T00:00:22.739 INFO:tasks.workunit.client.1.smithi183.stdout:4/54: stat fb 0 2024-02-10T00:00:22.739 INFO:tasks.workunit.client.1.smithi183.stdout:3/57: mknod d7/cf 0 2024-02-10T00:00:22.741 INFO:tasks.workunit.client.1.smithi183.stdout:4/55: dread f0 [0,4194304] 0 2024-02-10T00:00:22.742 INFO:tasks.workunit.client.1.smithi183.stdout:1/82: mknod d0/c1e 0 2024-02-10T00:00:22.743 INFO:tasks.workunit.client.1.smithi183.stdout:1/83: write d0/f17 [761245,65926] 0 2024-02-10T00:00:22.744 INFO:tasks.workunit.client.1.smithi183.stdout:0/53: mknod d14/c15 0 2024-02-10T00:00:22.745 INFO:tasks.workunit.client.1.smithi183.stdout:5/95: rmdir d4/dd 39 2024-02-10T00:00:22.746 INFO:tasks.workunit.client.1.smithi183.stdout:4/56: fsync f0 0 2024-02-10T00:00:22.752 INFO:tasks.workunit.client.1.smithi183.stdout:2/157: link l1 d2/d2c/d2f/l30 0 2024-02-10T00:00:22.754 INFO:tasks.workunit.client.1.smithi183.stdout:8/114: creat d0/d23/f26 x:0 0 0 2024-02-10T00:00:22.756 INFO:tasks.workunit.client.1.smithi183.stdout:6/60: rmdir d2/d13 0 2024-02-10T00:00:22.758 INFO:tasks.workunit.client.1.smithi183.stdout:6/61: write d2/fc [1127279,65731] 0 2024-02-10T00:00:22.758 INFO:tasks.workunit.client.1.smithi183.stdout:3/58: symlink d7/db/l10 0 2024-02-10T00:00:22.760 INFO:tasks.workunit.client.1.smithi183.stdout:0/54: mknod d14/c16 0 2024-02-10T00:00:22.762 INFO:tasks.workunit.client.1.smithi183.stdout:4/57: read f4 [1785496,58201] 0 2024-02-10T00:00:22.765 INFO:tasks.workunit.client.1.smithi183.stdout:9/79: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:22.765 INFO:tasks.workunit.client.1.smithi183.stdout:6/62: dwrite d2/ff [0,4194304] 0 2024-02-10T00:00:22.767 INFO:tasks.workunit.client.1.smithi183.stdout:1/84: write d0/d3/ff [4167446,39152] 0 2024-02-10T00:00:22.768 INFO:tasks.workunit.client.1.smithi183.stdout:0/55: dread fb [0,4194304] 0 2024-02-10T00:00:22.770 INFO:tasks.workunit.client.1.smithi183.stdout:1/85: chown d0/d3/f12 123040011 1 2024-02-10T00:00:22.770 INFO:tasks.workunit.client.1.smithi183.stdout:3/59: unlink l3 0 2024-02-10T00:00:22.770 INFO:tasks.workunit.client.1.smithi183.stdout:0/56: chown d14/c15 358980925 1 2024-02-10T00:00:22.771 INFO:tasks.workunit.client.1.smithi183.stdout:5/96: creat d4/d11/d19/f21 x:0 0 0 2024-02-10T00:00:22.772 INFO:tasks.workunit.client.1.smithi183.stdout:7/68: dwrite d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:22.773 INFO:tasks.workunit.client.1.smithi183.stdout:5/97: read d4/f9 [290936,50056] 0 2024-02-10T00:00:22.774 INFO:tasks.workunit.client.1.smithi183.stdout:6/63: dread d2/ff [0,4194304] 0 2024-02-10T00:00:22.775 INFO:tasks.workunit.client.1.smithi183.stdout:4/58: mkdir de 0 2024-02-10T00:00:22.776 INFO:tasks.workunit.client.1.smithi183.stdout:7/69: dread d0/fd [0,4194304] 0 2024-02-10T00:00:22.780 INFO:tasks.workunit.client.1.smithi183.stdout:3/60: rmdir d7/db 39 2024-02-10T00:00:22.781 INFO:tasks.workunit.client.1.smithi183.stdout:9/80: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:22.781 INFO:tasks.workunit.client.1.smithi183.stdout:3/61: stat d7/fe 0 2024-02-10T00:00:22.783 INFO:tasks.workunit.client.1.smithi183.stdout:1/86: mkdir d0/d3/d14/d1f 0 2024-02-10T00:00:22.784 INFO:tasks.workunit.client.1.smithi183.stdout:0/57: truncate f3 6813465 0 2024-02-10T00:00:22.784 INFO:tasks.workunit.client.1.smithi183.stdout:2/158: dread d2/da/f1d [0,4194304] 0 2024-02-10T00:00:22.785 INFO:tasks.workunit.client.1.smithi183.stdout:5/98: stat d4/d11/f1f 0 2024-02-10T00:00:22.786 INFO:tasks.workunit.client.1.smithi183.stdout:5/99: chown d4/d11/l18 605691 1 2024-02-10T00:00:22.786 INFO:tasks.workunit.client.1.smithi183.stdout:5/100: fsync f1 0 2024-02-10T00:00:22.787 INFO:tasks.workunit.client.1.smithi183.stdout:6/64: creat d2/f14 x:0 0 0 2024-02-10T00:00:22.787 INFO:tasks.workunit.client.1.smithi183.stdout:5/101: chown d4/f20 2383560 1 2024-02-10T00:00:22.788 INFO:tasks.workunit.client.1.smithi183.stdout:5/102: fdatasync d4/f6 0 2024-02-10T00:00:22.788 INFO:tasks.workunit.client.1.smithi183.stdout:7/70: truncate d0/d2/d4/f5 518143 0 2024-02-10T00:00:22.788 INFO:tasks.workunit.client.1.smithi183.stdout:7/71: stat d0/c6 0 2024-02-10T00:00:22.789 INFO:tasks.workunit.client.1.smithi183.stdout:8/115: truncate d0/f18 836674 0 2024-02-10T00:00:22.791 INFO:tasks.workunit.client.1.smithi183.stdout:3/62: stat d7/db/l10 0 2024-02-10T00:00:22.791 INFO:tasks.workunit.client.1.smithi183.stdout:3/63: readlink l1 0 2024-02-10T00:00:22.793 INFO:tasks.workunit.client.1.smithi183.stdout:1/87: rename d0/l5 to d0/d3/d7/l20 0 2024-02-10T00:00:22.793 INFO:tasks.workunit.client.1.smithi183.stdout:0/58: creat d14/f17 x:0 0 0 2024-02-10T00:00:22.794 INFO:tasks.workunit.client.1.smithi183.stdout:0/59: stat l9 0 2024-02-10T00:00:22.795 INFO:tasks.workunit.client.1.smithi183.stdout:0/60: read f7 [853655,88938] 0 2024-02-10T00:00:22.795 INFO:tasks.workunit.client.1.smithi183.stdout:9/81: dwrite d0/d3/f11 [0,4194304] 0 2024-02-10T00:00:22.796 INFO:tasks.workunit.client.1.smithi183.stdout:9/82: read d0/fb [711353,22865] 0 2024-02-10T00:00:22.800 INFO:tasks.workunit.client.1.smithi183.stdout:4/59: creat de/ff x:0 0 0 2024-02-10T00:00:22.801 INFO:tasks.workunit.client.1.smithi183.stdout:6/65: rename d2/fb to d2/f15 0 2024-02-10T00:00:22.805 INFO:tasks.workunit.client.1.smithi183.stdout:3/64: unlink d7/db/l10 0 2024-02-10T00:00:22.805 INFO:tasks.workunit.client.1.smithi183.stdout:7/72: dread d0/fd [0,4194304] 0 2024-02-10T00:00:22.806 INFO:tasks.workunit.client.1.smithi183.stdout:7/73: chown d0 12 1 2024-02-10T00:00:22.806 INFO:tasks.workunit.client.1.smithi183.stdout:1/88: creat d0/d3/f21 x:0 0 0 2024-02-10T00:00:22.806 INFO:tasks.workunit.client.1.smithi183.stdout:7/74: chown d0/d2/d3 1060145503 1 2024-02-10T00:00:22.808 INFO:tasks.workunit.client.1.smithi183.stdout:0/61: mkdir d14/d18 0 2024-02-10T00:00:22.810 INFO:tasks.workunit.client.1.smithi183.stdout:9/83: mknod d0/d3/c18 0 2024-02-10T00:00:22.810 INFO:tasks.workunit.client.1.smithi183.stdout:2/159: mkdir d2/da/d19/d31 0 2024-02-10T00:00:22.814 INFO:tasks.workunit.client.1.smithi183.stdout:8/116: mkdir d0/d27 0 2024-02-10T00:00:22.815 INFO:tasks.workunit.client.1.smithi183.stdout:0/62: dwrite ff [4194304,4194304] 0 2024-02-10T00:00:22.817 INFO:tasks.workunit.client.1.smithi183.stdout:7/75: readlink d0/d2/l15 0 2024-02-10T00:00:22.828 INFO:tasks.workunit.client.1.smithi183.stdout:4/60: write f4 [4305578,114717] 0 2024-02-10T00:00:22.830 INFO:tasks.workunit.client.1.smithi183.stdout:3/65: write d7/f9 [1198341,65903] 0 2024-02-10T00:00:22.830 INFO:tasks.workunit.client.1.smithi183.stdout:3/66: stat d7 0 2024-02-10T00:00:22.833 INFO:tasks.workunit.client.1.smithi183.stdout:5/103: link d4/c5 d4/d11/c22 0 2024-02-10T00:00:22.834 INFO:tasks.workunit.client.1.smithi183.stdout:2/160: chown d2/da/l16 107 1 2024-02-10T00:00:22.834 INFO:tasks.workunit.client.1.smithi183.stdout:6/66: dwrite d2/f10 [4194304,4194304] 0 2024-02-10T00:00:22.835 INFO:tasks.workunit.client.1.smithi183.stdout:1/89: mknod d0/c22 0 2024-02-10T00:00:22.836 INFO:tasks.workunit.client.1.smithi183.stdout:5/104: chown d4/d11/l12 32549285 1 2024-02-10T00:00:22.837 INFO:tasks.workunit.client.1.smithi183.stdout:6/67: fsync d2/f14 0 2024-02-10T00:00:22.837 INFO:tasks.workunit.client.1.smithi183.stdout:0/63: rename d14/c16 to d14/d18/c19 0 2024-02-10T00:00:22.838 INFO:tasks.workunit.client.1.smithi183.stdout:7/76: truncate d0/f1 511487 0 2024-02-10T00:00:22.840 INFO:tasks.workunit.client.1.smithi183.stdout:0/64: dread - d14/f17 zero size 2024-02-10T00:00:22.842 INFO:tasks.workunit.client.1.smithi183.stdout:9/84: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:22.846 INFO:tasks.workunit.client.1.smithi183.stdout:1/90: dwrite d0/d3/f12 [4194304,4194304] 0 2024-02-10T00:00:22.846 INFO:tasks.workunit.client.1.smithi183.stdout:6/68: creat d2/f16 x:0 0 0 2024-02-10T00:00:22.846 INFO:tasks.workunit.client.1.smithi183.stdout:8/117: creat d0/d1d/d24/f28 x:0 0 0 2024-02-10T00:00:22.846 INFO:tasks.workunit.client.1.smithi183.stdout:7/77: unlink d0/d11/c12 0 2024-02-10T00:00:22.848 INFO:tasks.workunit.client.1.smithi183.stdout:7/78: dread - d0/d2/f1a zero size 2024-02-10T00:00:22.849 INFO:tasks.workunit.client.1.smithi183.stdout:9/85: dread d0/d3/f11 [0,4194304] 0 2024-02-10T00:00:22.849 INFO:tasks.workunit.client.1.smithi183.stdout:4/61: write f0 [627617,94959] 0 2024-02-10T00:00:22.849 INFO:tasks.workunit.client.1.smithi183.stdout:4/62: chown fb 4412468 1 2024-02-10T00:00:22.851 INFO:tasks.workunit.client.1.smithi183.stdout:6/69: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:22.851 INFO:tasks.workunit.client.1.smithi183.stdout:0/65: mkdir d14/d18/d1a 0 2024-02-10T00:00:22.853 INFO:tasks.workunit.client.1.smithi183.stdout:2/161: symlink d2/d2c/d2d/l32 0 2024-02-10T00:00:22.853 INFO:tasks.workunit.client.1.smithi183.stdout:8/118: fsync d0/f14 0 2024-02-10T00:00:22.855 INFO:tasks.workunit.client.1.smithi183.stdout:1/91: creat d0/d3/d7/f23 x:0 0 0 2024-02-10T00:00:22.856 INFO:tasks.workunit.client.1.smithi183.stdout:1/92: readlink d0/d3/l1a 0 2024-02-10T00:00:22.868 INFO:tasks.workunit.client.1.smithi183.stdout:7/79: mknod d0/c1b 0 2024-02-10T00:00:22.868 INFO:tasks.workunit.client.1.smithi183.stdout:4/63: stat c5 0 2024-02-10T00:00:22.869 INFO:tasks.workunit.client.1.smithi183.stdout:3/67: creat d7/f11 x:0 0 0 2024-02-10T00:00:22.871 INFO:tasks.workunit.client.1.smithi183.stdout:2/162: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:22.871 INFO:tasks.workunit.client.1.smithi183.stdout:5/105: rename d4/d11/d19 to d4/d23 0 2024-02-10T00:00:22.872 INFO:tasks.workunit.client.1.smithi183.stdout:3/68: write d7/db/fc [2062225,108103] 0 2024-02-10T00:00:22.876 INFO:tasks.workunit.client.1.smithi183.stdout:1/93: mkdir d0/d3/d7/d24 0 2024-02-10T00:00:22.876 INFO:tasks.workunit.client.1.smithi183.stdout:4/64: dread f4 [0,4194304] 0 2024-02-10T00:00:22.879 INFO:tasks.workunit.client.1.smithi183.stdout:0/66: creat d14/d18/d1a/f1b x:0 0 0 2024-02-10T00:00:22.879 INFO:tasks.workunit.client.1.smithi183.stdout:5/106: symlink d4/d11/l24 0 2024-02-10T00:00:22.880 INFO:tasks.workunit.client.1.smithi183.stdout:4/65: mknod de/c10 0 2024-02-10T00:00:22.881 INFO:tasks.workunit.client.1.smithi183.stdout:5/107: readlink d4/l7 0 2024-02-10T00:00:22.905 INFO:tasks.workunit.client.1.smithi183.stdout:4/66: chown ca 0 1 2024-02-10T00:00:22.906 INFO:tasks.workunit.client.1.smithi183.stdout:2/163: dwrite d2/da/d19/f2e [0,4194304] 0 2024-02-10T00:00:22.907 INFO:tasks.workunit.client.1.smithi183.stdout:6/70: rmdir d2 39 2024-02-10T00:00:22.908 INFO:tasks.workunit.client.1.smithi183.stdout:7/80: dread d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:22.908 INFO:tasks.workunit.client.1.smithi183.stdout:0/67: mknod d14/d18/c1c 0 2024-02-10T00:00:22.908 INFO:tasks.workunit.client.1.smithi183.stdout:8/119: write d0/d10/f19 [215179,21440] 0 2024-02-10T00:00:22.910 INFO:tasks.workunit.client.1.smithi183.stdout:7/81: chown d0/d2/d3/c10 0 1 2024-02-10T00:00:22.910 INFO:tasks.workunit.client.1.smithi183.stdout:4/67: creat de/f11 x:0 0 0 2024-02-10T00:00:22.911 INFO:tasks.workunit.client.1.smithi183.stdout:3/69: link d7/f8 d7/f12 0 2024-02-10T00:00:22.914 INFO:tasks.workunit.client.1.smithi183.stdout:6/71: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:22.916 INFO:tasks.workunit.client.1.smithi183.stdout:2/164: unlink d2/da/f1f 0 2024-02-10T00:00:22.917 INFO:tasks.workunit.client.1.smithi183.stdout:4/68: creat de/f12 x:0 0 0 2024-02-10T00:00:22.919 INFO:tasks.workunit.client.1.smithi183.stdout:5/108: write d4/f13 [320791,49562] 0 2024-02-10T00:00:22.919 INFO:tasks.workunit.client.1.smithi183.stdout:8/120: getdents d0/d27 0 2024-02-10T00:00:22.921 INFO:tasks.workunit.client.1.smithi183.stdout:6/72: dwrite d2/fc [0,4194304] 0 2024-02-10T00:00:22.922 INFO:tasks.workunit.client.1.smithi183.stdout:3/70: link d7/fe d7/db/f13 0 2024-02-10T00:00:22.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/71: stat d7/f11 0 2024-02-10T00:00:22.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/72: rename d7 to d7/db/d14 22 2024-02-10T00:00:22.925 INFO:tasks.workunit.client.1.smithi183.stdout:7/82: truncate d0/d2/f1a 945967 0 2024-02-10T00:00:22.926 INFO:tasks.workunit.client.1.smithi183.stdout:2/165: mkdir d2/d33 0 2024-02-10T00:00:22.927 INFO:tasks.workunit.client.1.smithi183.stdout:8/121: truncate d0/f14 810625 0 2024-02-10T00:00:22.929 INFO:tasks.workunit.client.1.smithi183.stdout:3/73: fdatasync d7/f12 0 2024-02-10T00:00:22.929 INFO:tasks.workunit.client.1.smithi183.stdout:0/68: getdents d14 0 2024-02-10T00:00:22.931 INFO:tasks.workunit.client.1.smithi183.stdout:5/109: creat d4/dd/f25 x:0 0 0 2024-02-10T00:00:22.933 INFO:tasks.workunit.client.1.smithi183.stdout:9/86: sync 2024-02-10T00:00:22.934 INFO:tasks.workunit.client.1.smithi183.stdout:2/166: write d2/da/d20/d21/f23 [2703408,117934] 0 2024-02-10T00:00:22.934 INFO:tasks.workunit.client.1.smithi183.stdout:0/69: unlink ce 0 2024-02-10T00:00:22.936 INFO:tasks.workunit.client.1.smithi183.stdout:6/73: link d2/l11 d2/l17 0 2024-02-10T00:00:22.938 INFO:tasks.workunit.client.1.smithi183.stdout:9/87: unlink d0/d3/cc 0 2024-02-10T00:00:22.940 INFO:tasks.workunit.client.1.smithi183.stdout:0/70: truncate fb 3178119 0 2024-02-10T00:00:22.945 INFO:tasks.workunit.client.1.smithi183.stdout:4/69: truncate f0 1709281 0 2024-02-10T00:00:22.945 INFO:tasks.workunit.client.1.smithi183.stdout:4/70: readlink l9 0 2024-02-10T00:00:22.949 INFO:tasks.workunit.client.1.smithi183.stdout:8/122: truncate d0/fb 1358952 0 2024-02-10T00:00:22.950 INFO:tasks.workunit.client.1.smithi183.stdout:3/74: dwrite d7/f8 [0,4194304] 0 2024-02-10T00:00:22.951 INFO:tasks.workunit.client.1.smithi183.stdout:4/71: dwrite de/f12 [0,4194304] 0 2024-02-10T00:00:22.952 INFO:tasks.workunit.client.1.smithi183.stdout:6/74: creat d2/f18 x:0 0 0 2024-02-10T00:00:22.953 INFO:tasks.workunit.client.1.smithi183.stdout:9/88: fsync d0/f5 0 2024-02-10T00:00:22.956 INFO:tasks.workunit.client.1.smithi183.stdout:0/71: mkdir d14/d1d 0 2024-02-10T00:00:22.957 INFO:tasks.workunit.client.1.smithi183.stdout:7/83: getdents d0/d2/d4/d8 0 2024-02-10T00:00:22.959 INFO:tasks.workunit.client.1.smithi183.stdout:3/75: dwrite f5 [0,4194304] 0 2024-02-10T00:00:22.959 INFO:tasks.workunit.client.1.smithi183.stdout:1/94: sync 2024-02-10T00:00:22.959 INFO:tasks.workunit.client.1.smithi183.stdout:3/76: dread - f6 zero size 2024-02-10T00:00:22.960 INFO:tasks.workunit.client.1.smithi183.stdout:3/77: write d7/db/fc [2875029,98817] 0 2024-02-10T00:00:22.963 INFO:tasks.workunit.client.1.smithi183.stdout:4/72: symlink de/l13 0 2024-02-10T00:00:22.964 INFO:tasks.workunit.client.1.smithi183.stdout:6/75: creat d2/f19 x:0 0 0 2024-02-10T00:00:22.965 INFO:tasks.workunit.client.1.smithi183.stdout:6/76: read - d2/f14 zero size 2024-02-10T00:00:22.967 INFO:tasks.workunit.client.1.smithi183.stdout:0/72: symlink d14/d18/d1a/l1e 0 2024-02-10T00:00:22.967 INFO:tasks.workunit.client.1.smithi183.stdout:0/73: chown d14/d18/c1c 2083663 1 2024-02-10T00:00:22.972 INFO:tasks.workunit.client.1.smithi183.stdout:4/73: mkdir de/d14 0 2024-02-10T00:00:22.973 INFO:tasks.workunit.client.1.smithi183.stdout:2/167: link d2/da/fb d2/d2c/d2d/f34 0 2024-02-10T00:00:22.988 INFO:tasks.workunit.client.1.smithi183.stdout:9/89: creat d0/d10/f19 x:0 0 0 2024-02-10T00:00:22.988 INFO:tasks.workunit.client.1.smithi183.stdout:6/77: mkdir d2/d1a 0 2024-02-10T00:00:22.989 INFO:tasks.workunit.client.1.smithi183.stdout:3/78: symlink d7/l15 0 2024-02-10T00:00:22.989 INFO:tasks.workunit.client.1.smithi183.stdout:8/123: link d0/l8 d0/d27/l29 0 2024-02-10T00:00:22.990 INFO:tasks.workunit.client.1.smithi183.stdout:9/90: write d0/fb [330763,18892] 0 2024-02-10T00:00:22.992 INFO:tasks.workunit.client.1.smithi183.stdout:0/74: mknod d14/d1d/c1f 0 2024-02-10T00:00:22.992 INFO:tasks.workunit.client.1.smithi183.stdout:8/124: rmdir d0/d23 39 2024-02-10T00:00:22.995 INFO:tasks.workunit.client.1.smithi183.stdout:4/74: dwrite de/f11 [0,4194304] 0 2024-02-10T00:00:22.997 INFO:tasks.workunit.client.1.smithi183.stdout:6/78: dread d2/ff [0,4194304] 0 2024-02-10T00:00:22.997 INFO:tasks.workunit.client.1.smithi183.stdout:9/91: unlink d0/d3/l15 0 2024-02-10T00:00:23.000 INFO:tasks.workunit.client.1.smithi183.stdout:4/75: read f4 [4419308,120786] 0 2024-02-10T00:00:23.005 INFO:tasks.workunit.client.1.smithi183.stdout:9/92: truncate d0/f5 3035870 0 2024-02-10T00:00:23.005 INFO:tasks.workunit.client.1.smithi183.stdout:5/110: sync 2024-02-10T00:00:23.006 INFO:tasks.workunit.client.1.smithi183.stdout:5/111: chown d4/d11/l12 10 1 2024-02-10T00:00:23.006 INFO:tasks.workunit.client.1.smithi183.stdout:5/112: dread - d4/d23/f21 zero size 2024-02-10T00:00:23.007 INFO:tasks.workunit.client.1.smithi183.stdout:0/75: link d14/d18/d1a/f1b d14/f20 0 2024-02-10T00:00:23.007 INFO:tasks.workunit.client.1.smithi183.stdout:5/113: fdatasync d4/dd/f1b 0 2024-02-10T00:00:23.008 INFO:tasks.workunit.client.1.smithi183.stdout:6/79: mkdir d2/d1a/d1b 0 2024-02-10T00:00:23.009 INFO:tasks.workunit.client.1.smithi183.stdout:2/168: write d2/da/f25 [1043909,24715] 0 2024-02-10T00:00:23.010 INFO:tasks.workunit.client.1.smithi183.stdout:3/79: truncate d7/f8 3374856 0 2024-02-10T00:00:23.012 INFO:tasks.workunit.client.1.smithi183.stdout:3/80: dread - d7/fd zero size 2024-02-10T00:00:23.012 INFO:tasks.workunit.client.1.smithi183.stdout:8/125: link d0/d10/f19 d0/d23/f2a 0 2024-02-10T00:00:23.013 INFO:tasks.workunit.client.1.smithi183.stdout:0/76: mknod d14/d18/d1a/c21 0 2024-02-10T00:00:23.014 INFO:tasks.workunit.client.1.smithi183.stdout:7/84: dwrite d0/d2/f1a [0,4194304] 0 2024-02-10T00:00:23.014 INFO:tasks.workunit.client.1.smithi183.stdout:4/76: mknod de/d14/c15 0 2024-02-10T00:00:23.016 INFO:tasks.workunit.client.1.smithi183.stdout:7/85: chown d0/lf 33 1 2024-02-10T00:00:23.018 INFO:tasks.workunit.client.1.smithi183.stdout:5/114: dwrite f0 [0,4194304] 0 2024-02-10T00:00:23.018 INFO:tasks.workunit.client.1.smithi183.stdout:8/126: chown d0/f14 0 1 2024-02-10T00:00:23.018 INFO:tasks.workunit.client.1.smithi183.stdout:7/86: chown d0/fd 415276 1 2024-02-10T00:00:23.019 INFO:tasks.workunit.client.1.smithi183.stdout:6/80: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:23.022 INFO:tasks.workunit.client.1.smithi183.stdout:2/169: truncate d2/f13 7594489 0 2024-02-10T00:00:23.024 INFO:tasks.workunit.client.1.smithi183.stdout:5/115: rename d4/dd/ff to d4/d23/f26 0 2024-02-10T00:00:23.025 INFO:tasks.workunit.client.1.smithi183.stdout:7/87: dread d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:23.025 INFO:tasks.workunit.client.1.smithi183.stdout:8/127: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:23.027 INFO:tasks.workunit.client.1.smithi183.stdout:4/77: link de/f12 de/d14/f16 0 2024-02-10T00:00:23.028 INFO:tasks.workunit.client.1.smithi183.stdout:9/93: getdents d0 0 2024-02-10T00:00:23.028 INFO:tasks.workunit.client.1.smithi183.stdout:4/78: chown cd 31 1 2024-02-10T00:00:23.029 INFO:tasks.workunit.client.1.smithi183.stdout:4/79: write de/f11 [3292072,14369] 0 2024-02-10T00:00:23.031 INFO:tasks.workunit.client.1.smithi183.stdout:7/88: unlink d0/fd 0 2024-02-10T00:00:23.034 INFO:tasks.workunit.client.1.smithi183.stdout:8/128: creat d0/d23/f2b x:0 0 0 2024-02-10T00:00:23.034 INFO:tasks.workunit.client.1.smithi183.stdout:8/129: chown d0/f14 2014947 1 2024-02-10T00:00:23.035 INFO:tasks.workunit.client.1.smithi183.stdout:9/94: mknod d0/d3/c1a 0 2024-02-10T00:00:23.035 INFO:tasks.workunit.client.1.smithi183.stdout:1/95: sync 2024-02-10T00:00:23.035 INFO:tasks.workunit.client.1.smithi183.stdout:8/130: read - d0/f1b zero size 2024-02-10T00:00:23.035 INFO:tasks.workunit.client.1.smithi183.stdout:7/89: dread d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:23.036 INFO:tasks.workunit.client.1.smithi183.stdout:4/80: creat de/f17 x:0 0 0 2024-02-10T00:00:23.038 INFO:tasks.workunit.client.1.smithi183.stdout:6/81: getdents d2 0 2024-02-10T00:00:23.040 INFO:tasks.workunit.client.1.smithi183.stdout:0/77: fsync d14/d18/d1a/f1b 0 2024-02-10T00:00:23.042 INFO:tasks.workunit.client.1.smithi183.stdout:3/81: fsync d7/f8 0 2024-02-10T00:00:23.052 INFO:tasks.workunit.client.1.smithi183.stdout:7/90: creat d0/d11/f1c x:0 0 0 2024-02-10T00:00:23.054 INFO:tasks.workunit.client.1.smithi183.stdout:8/131: rename d0/ff to d0/d1d/f2c 0 2024-02-10T00:00:23.055 INFO:tasks.workunit.client.1.smithi183.stdout:4/81: fdatasync fb 0 2024-02-10T00:00:23.056 INFO:tasks.workunit.client.1.smithi183.stdout:5/116: truncate f1 3228877 0 2024-02-10T00:00:23.057 INFO:tasks.workunit.client.1.smithi183.stdout:6/82: mknod d2/d1a/c1c 0 2024-02-10T00:00:23.059 INFO:tasks.workunit.client.1.smithi183.stdout:6/83: chown d2/d1a/d1b 3684936 1 2024-02-10T00:00:23.059 INFO:tasks.workunit.client.1.smithi183.stdout:9/95: rmdir d0/d3 39 2024-02-10T00:00:23.062 INFO:tasks.workunit.client.1.smithi183.stdout:8/132: dwrite d0/f1b [0,4194304] 0 2024-02-10T00:00:23.064 INFO:tasks.workunit.client.1.smithi183.stdout:3/82: mknod d7/db/c16 0 2024-02-10T00:00:23.064 INFO:tasks.workunit.client.1.smithi183.stdout:2/170: dwrite d2/da/f1d [0,4194304] 0 2024-02-10T00:00:23.064 INFO:tasks.workunit.client.1.smithi183.stdout:0/78: write d14/f20 [1014590,108828] 0 2024-02-10T00:00:23.066 INFO:tasks.workunit.client.1.smithi183.stdout:4/82: mkdir de/d18 0 2024-02-10T00:00:23.069 INFO:tasks.workunit.client.1.smithi183.stdout:2/171: write d2/f8 [2485131,13083] 0 2024-02-10T00:00:23.070 INFO:tasks.workunit.client.1.smithi183.stdout:2/172: chown d2 28598 1 2024-02-10T00:00:23.072 INFO:tasks.workunit.client.1.smithi183.stdout:3/83: dread d7/f9 [0,4194304] 0 2024-02-10T00:00:23.074 INFO:tasks.workunit.client.1.smithi183.stdout:6/84: dwrite d2/f18 [0,4194304] 0 2024-02-10T00:00:23.074 INFO:tasks.workunit.client.1.smithi183.stdout:9/96: dwrite d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:23.079 INFO:tasks.workunit.client.1.smithi183.stdout:5/117: mkdir d4/d1d/d27 0 2024-02-10T00:00:23.080 INFO:tasks.workunit.client.1.smithi183.stdout:4/83: mkdir de/d19 0 2024-02-10T00:00:23.080 INFO:tasks.workunit.client.1.smithi183.stdout:1/96: link d0/f15 d0/d3/d7/d24/f25 0 2024-02-10T00:00:23.080 INFO:tasks.workunit.client.1.smithi183.stdout:1/97: dread - d0/d3/f21 zero size 2024-02-10T00:00:23.081 INFO:tasks.workunit.client.1.smithi183.stdout:9/97: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:23.083 INFO:tasks.workunit.client.1.smithi183.stdout:2/173: unlink d2/da/d19/f2e 0 2024-02-10T00:00:23.084 INFO:tasks.workunit.client.1.smithi183.stdout:2/174: chown d2/da/d19 165452 1 2024-02-10T00:00:23.085 INFO:tasks.workunit.client.1.smithi183.stdout:5/118: dread d4/fa [0,4194304] 0 2024-02-10T00:00:23.095 INFO:tasks.workunit.client.1.smithi183.stdout:4/84: mknod de/d18/c1a 0 2024-02-10T00:00:23.095 INFO:tasks.workunit.client.1.smithi183.stdout:2/175: chown d2/da/c1b 1803 1 2024-02-10T00:00:23.096 INFO:tasks.workunit.client.1.smithi183.stdout:4/85: stat de/d18/c1a 0 2024-02-10T00:00:23.097 INFO:tasks.workunit.client.1.smithi183.stdout:3/84: link d7/fe d7/db/f17 0 2024-02-10T00:00:23.098 INFO:tasks.workunit.client.1.smithi183.stdout:5/119: dread d4/f9 [0,4194304] 0 2024-02-10T00:00:23.098 INFO:tasks.workunit.client.1.smithi183.stdout:4/86: unlink f4 0 2024-02-10T00:00:23.099 INFO:tasks.workunit.client.1.smithi183.stdout:5/120: stat d4/c1a 0 2024-02-10T00:00:23.099 INFO:tasks.workunit.client.1.smithi183.stdout:4/87: fsync de/f17 0 2024-02-10T00:00:23.099 INFO:tasks.workunit.client.1.smithi183.stdout:4/88: chown ca 29486 1 2024-02-10T00:00:23.100 INFO:tasks.workunit.client.1.smithi183.stdout:2/176: rename d2/da/d19/d2a to d2/d33/d35 0 2024-02-10T00:00:23.102 INFO:tasks.workunit.client.1.smithi183.stdout:5/121: symlink d4/dd/l28 0 2024-02-10T00:00:23.103 INFO:tasks.workunit.client.1.smithi183.stdout:4/89: read f0 [1038826,40186] 0 2024-02-10T00:00:23.103 INFO:tasks.workunit.client.1.smithi183.stdout:5/122: write d4/dd/f1b [376367,70202] 0 2024-02-10T00:00:23.104 INFO:tasks.workunit.client.1.smithi183.stdout:2/177: mkdir d2/da/d20/d21/d36 0 2024-02-10T00:00:23.104 INFO:tasks.workunit.client.1.smithi183.stdout:5/123: chown d4/dd/f10 3502 1 2024-02-10T00:00:23.105 INFO:tasks.workunit.client.1.smithi183.stdout:9/98: getdents d0/d3/d14 0 2024-02-10T00:00:23.106 INFO:tasks.workunit.client.1.smithi183.stdout:4/90: unlink c6 0 2024-02-10T00:00:23.107 INFO:tasks.workunit.client.1.smithi183.stdout:5/124: creat d4/d11/f29 x:0 0 0 2024-02-10T00:00:23.109 INFO:tasks.workunit.client.1.smithi183.stdout:5/125: fdatasync d4/d23/f26 0 2024-02-10T00:00:23.111 INFO:tasks.workunit.client.1.smithi183.stdout:9/99: truncate d0/d3/d14/f16 1003026 0 2024-02-10T00:00:23.111 INFO:tasks.workunit.client.1.smithi183.stdout:4/91: link de/d14/f16 de/d18/f1b 0 2024-02-10T00:00:23.112 INFO:tasks.workunit.client.1.smithi183.stdout:5/126: dread d4/fa [0,4194304] 0 2024-02-10T00:00:23.113 INFO:tasks.workunit.client.1.smithi183.stdout:5/127: dread d4/fa [0,4194304] 0 2024-02-10T00:00:23.113 INFO:tasks.workunit.client.1.smithi183.stdout:2/178: rename d2/d2c/d2d/f34 to d2/da/d20/f37 0 2024-02-10T00:00:23.115 INFO:tasks.workunit.client.1.smithi183.stdout:9/100: creat d0/d10/f1b x:0 0 0 2024-02-10T00:00:23.117 INFO:tasks.workunit.client.1.smithi183.stdout:6/85: sync 2024-02-10T00:00:23.120 INFO:tasks.workunit.client.1.smithi183.stdout:7/91: write d0/f1 [111713,90601] 0 2024-02-10T00:00:23.121 INFO:tasks.workunit.client.1.smithi183.stdout:8/133: write d0/fb [567587,120297] 0 2024-02-10T00:00:23.121 INFO:tasks.workunit.client.1.smithi183.stdout:0/79: truncate d14/f20 2059537 0 2024-02-10T00:00:23.124 INFO:tasks.workunit.client.1.smithi183.stdout:1/98: truncate d0/d3/fa 139758 0 2024-02-10T00:00:23.129 INFO:tasks.workunit.client.1.smithi183.stdout:3/85: dwrite d7/fe [0,4194304] 0 2024-02-10T00:00:23.133 INFO:tasks.workunit.client.1.smithi183.stdout:4/92: dwrite fb [0,4194304] 0 2024-02-10T00:00:23.134 INFO:tasks.workunit.client.1.smithi183.stdout:5/128: rmdir d4 39 2024-02-10T00:00:23.136 INFO:tasks.workunit.client.1.smithi183.stdout:9/101: mkdir d0/d3/d14/d1c 0 2024-02-10T00:00:23.138 INFO:tasks.workunit.client.1.smithi183.stdout:5/129: dread f0 [0,4194304] 0 2024-02-10T00:00:23.138 INFO:tasks.workunit.client.1.smithi183.stdout:7/92: unlink d0/d2/d4/ce 0 2024-02-10T00:00:23.141 INFO:tasks.workunit.client.1.smithi183.stdout:0/80: mkdir d14/d18/d1a/d22 0 2024-02-10T00:00:23.144 INFO:tasks.workunit.client.1.smithi183.stdout:1/99: read d0/d3/d7/d24/f25 [203441,23359] 0 2024-02-10T00:00:23.146 INFO:tasks.workunit.client.1.smithi183.stdout:0/81: dwrite ff [4194304,4194304] 0 2024-02-10T00:00:23.149 INFO:tasks.workunit.client.1.smithi183.stdout:7/93: creat d0/d2/d4/d8/f1d x:0 0 0 2024-02-10T00:00:23.151 INFO:tasks.workunit.client.1.smithi183.stdout:1/100: dwrite d0/d3/ff [0,4194304] 0 2024-02-10T00:00:23.151 INFO:tasks.workunit.client.1.smithi183.stdout:7/94: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:23.155 INFO:tasks.workunit.client.1.smithi183.stdout:5/130: mkdir d4/d23/d2a 0 2024-02-10T00:00:23.155 INFO:tasks.workunit.client.1.smithi183.stdout:5/131: dread - d4/d11/f29 zero size 2024-02-10T00:00:23.157 INFO:tasks.workunit.client.1.smithi183.stdout:3/86: rename d7/db/c16 to d7/c18 0 2024-02-10T00:00:23.159 INFO:tasks.workunit.client.1.smithi183.stdout:1/101: symlink d0/d3/l26 0 2024-02-10T00:00:23.160 INFO:tasks.workunit.client.1.smithi183.stdout:1/102: dread - d0/d3/d7/f23 zero size 2024-02-10T00:00:23.160 INFO:tasks.workunit.client.1.smithi183.stdout:5/132: dwrite f2 [0,4194304] 0 2024-02-10T00:00:23.162 INFO:tasks.workunit.client.1.smithi183.stdout:3/87: mkdir d7/d19 0 2024-02-10T00:00:23.167 INFO:tasks.workunit.client.1.smithi183.stdout:3/88: dwrite f6 [0,4194304] 0 2024-02-10T00:00:23.169 INFO:tasks.workunit.client.1.smithi183.stdout:2/179: truncate d2/da/d20/d21/f23 987193 0 2024-02-10T00:00:23.169 INFO:tasks.workunit.client.1.smithi183.stdout:2/180: fsync d2/f8 0 2024-02-10T00:00:23.170 INFO:tasks.workunit.client.1.smithi183.stdout:6/86: truncate d2/f7 8590105 0 2024-02-10T00:00:23.171 INFO:tasks.workunit.client.1.smithi183.stdout:5/133: link d4/f20 d4/d1d/d27/f2b 0 2024-02-10T00:00:23.173 INFO:tasks.workunit.client.1.smithi183.stdout:8/134: dwrite d0/f18 [0,4194304] 0 2024-02-10T00:00:23.174 INFO:tasks.workunit.client.1.smithi183.stdout:8/135: chown d0/f1e 497 1 2024-02-10T00:00:23.175 INFO:tasks.workunit.client.1.smithi183.stdout:2/181: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:23.176 INFO:tasks.workunit.client.1.smithi183.stdout:6/87: rmdir d2 39 2024-02-10T00:00:23.178 INFO:tasks.workunit.client.1.smithi183.stdout:5/134: mknod d4/d23/c2c 0 2024-02-10T00:00:23.182 INFO:tasks.workunit.client.1.smithi183.stdout:3/89: truncate d7/f11 868647 0 2024-02-10T00:00:23.182 INFO:tasks.workunit.client.1.smithi183.stdout:5/135: symlink d4/d1d/l2d 0 2024-02-10T00:00:23.183 INFO:tasks.workunit.client.1.smithi183.stdout:5/136: dread - d4/f1e zero size 2024-02-10T00:00:23.185 INFO:tasks.workunit.client.1.smithi183.stdout:8/136: getdents d0/d27 0 2024-02-10T00:00:23.185 INFO:tasks.workunit.client.1.smithi183.stdout:8/137: fsync d0/d1d/d24/f28 0 2024-02-10T00:00:23.186 INFO:tasks.workunit.client.1.smithi183.stdout:3/90: symlink d7/d19/l1a 0 2024-02-10T00:00:23.186 INFO:tasks.workunit.client.1.smithi183.stdout:3/91: chown c0 260795296 1 2024-02-10T00:00:23.187 INFO:tasks.workunit.client.1.smithi183.stdout:4/93: write de/d14/f16 [5064187,16470] 0 2024-02-10T00:00:23.188 INFO:tasks.workunit.client.1.smithi183.stdout:8/138: readlink d0/d27/l29 0 2024-02-10T00:00:23.188 INFO:tasks.workunit.client.1.smithi183.stdout:4/94: read de/f11 [2974123,57194] 0 2024-02-10T00:00:23.189 INFO:tasks.workunit.client.1.smithi183.stdout:4/95: read f0 [1675827,109199] 0 2024-02-10T00:00:23.189 INFO:tasks.workunit.client.1.smithi183.stdout:8/139: chown d0/d1d/d24/f28 23523 1 2024-02-10T00:00:23.190 INFO:tasks.workunit.client.1.smithi183.stdout:5/137: creat d4/f2e x:0 0 0 2024-02-10T00:00:23.190 INFO:tasks.workunit.client.1.smithi183.stdout:4/96: read de/f11 [553935,61892] 0 2024-02-10T00:00:23.190 INFO:tasks.workunit.client.1.smithi183.stdout:8/140: dread - d0/d1d/f2c zero size 2024-02-10T00:00:23.191 INFO:tasks.workunit.client.1.smithi183.stdout:5/138: write d4/fa [710929,56518] 0 2024-02-10T00:00:23.194 INFO:tasks.workunit.client.1.smithi183.stdout:8/141: rename d0/d1d to d0/d23/d2d 0 2024-02-10T00:00:23.195 INFO:tasks.workunit.client.1.smithi183.stdout:6/88: truncate d2/f7 627768 0 2024-02-10T00:00:23.196 INFO:tasks.workunit.client.1.smithi183.stdout:5/139: dwrite d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:23.198 INFO:tasks.workunit.client.1.smithi183.stdout:8/142: creat d0/d27/f2e x:0 0 0 2024-02-10T00:00:23.201 INFO:tasks.workunit.client.1.smithi183.stdout:4/97: getdents de 0 2024-02-10T00:00:23.202 INFO:tasks.workunit.client.1.smithi183.stdout:9/102: truncate d0/fb 2775422 0 2024-02-10T00:00:23.202 INFO:tasks.workunit.client.1.smithi183.stdout:4/98: stat l9 0 2024-02-10T00:00:23.204 INFO:tasks.workunit.client.1.smithi183.stdout:4/99: chown de/f12 64274 1 2024-02-10T00:00:23.204 INFO:tasks.workunit.client.1.smithi183.stdout:5/140: dwrite d4/d11/f29 [0,4194304] 0 2024-02-10T00:00:23.206 INFO:tasks.workunit.client.1.smithi183.stdout:4/100: write fb [1935558,111753] 0 2024-02-10T00:00:23.207 INFO:tasks.workunit.client.1.smithi183.stdout:8/143: dwrite d0/f18 [0,4194304] 0 2024-02-10T00:00:23.210 INFO:tasks.workunit.client.1.smithi183.stdout:0/82: write d14/d18/d1a/f1b [1083509,64606] 0 2024-02-10T00:00:23.225 INFO:tasks.workunit.client.1.smithi183.stdout:7/95: sync 2024-02-10T00:00:23.229 INFO:tasks.workunit.client.1.smithi183.stdout:9/103: dread d0/f12 [0,4194304] 0 2024-02-10T00:00:23.230 INFO:tasks.workunit.client.1.smithi183.stdout:8/144: rmdir d0/d23/d2d/d24 39 2024-02-10T00:00:23.232 INFO:tasks.workunit.client.1.smithi183.stdout:4/101: dwrite de/f17 [0,4194304] 0 2024-02-10T00:00:23.233 INFO:tasks.workunit.client.1.smithi183.stdout:6/89: dread d2/f10 [0,4194304] 0 2024-02-10T00:00:23.235 INFO:tasks.workunit.client.1.smithi183.stdout:1/103: dwrite d0/f15 [0,4194304] 0 2024-02-10T00:00:23.239 INFO:tasks.workunit.client.1.smithi183.stdout:5/141: write d4/f9 [2998666,75101] 0 2024-02-10T00:00:23.241 INFO:tasks.workunit.client.1.smithi183.stdout:6/90: write d2/ff [4138775,92708] 0 2024-02-10T00:00:23.241 INFO:tasks.workunit.client.1.smithi183.stdout:0/83: dwrite ff [4194304,4194304] 0 2024-02-10T00:00:23.241 INFO:tasks.workunit.client.1.smithi183.stdout:7/96: dread d0/d2/f1a [0,4194304] 0 2024-02-10T00:00:23.242 INFO:tasks.workunit.client.1.smithi183.stdout:4/102: mkdir de/d19/d1c 0 2024-02-10T00:00:23.243 INFO:tasks.workunit.client.1.smithi183.stdout:8/145: creat d0/f2f x:0 0 0 2024-02-10T00:00:23.243 INFO:tasks.workunit.client.1.smithi183.stdout:9/104: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:23.247 INFO:tasks.workunit.client.1.smithi183.stdout:5/142: rename d4/c15 to d4/d23/c2f 0 2024-02-10T00:00:23.247 INFO:tasks.workunit.client.1.smithi183.stdout:0/84: truncate f7 1079310 0 2024-02-10T00:00:23.248 INFO:tasks.workunit.client.1.smithi183.stdout:0/85: write d14/d18/d1a/f1b [2710857,103221] 0 2024-02-10T00:00:23.249 INFO:tasks.workunit.client.1.smithi183.stdout:0/86: dread - f6 zero size 2024-02-10T00:00:23.249 INFO:tasks.workunit.client.1.smithi183.stdout:4/103: mkdir de/d14/d1d 0 2024-02-10T00:00:23.250 INFO:tasks.workunit.client.1.smithi183.stdout:5/143: dread d4/f6 [0,4194304] 0 2024-02-10T00:00:23.253 INFO:tasks.workunit.client.1.smithi183.stdout:7/97: mknod d0/d2/d4/c1e 0 2024-02-10T00:00:23.254 INFO:tasks.workunit.client.1.smithi183.stdout:1/104: link d0/d3/l1a d0/d3/d7/d24/l27 0 2024-02-10T00:00:23.254 INFO:tasks.workunit.client.1.smithi183.stdout:1/105: dread - d0/d3/d7/f23 zero size 2024-02-10T00:00:23.254 INFO:tasks.workunit.client.1.smithi183.stdout:0/87: symlink d14/d1d/l23 0 2024-02-10T00:00:23.255 INFO:tasks.workunit.client.1.smithi183.stdout:0/88: chown d14/d18/d1a/l1e 17 1 2024-02-10T00:00:23.258 INFO:tasks.workunit.client.1.smithi183.stdout:9/105: unlink d0/d3/d14/f16 0 2024-02-10T00:00:23.260 INFO:tasks.workunit.client.1.smithi183.stdout:2/182: sync 2024-02-10T00:00:23.260 INFO:tasks.workunit.client.1.smithi183.stdout:5/144: truncate d4/d1d/d27/f2b 96718 0 2024-02-10T00:00:23.264 INFO:tasks.workunit.client.1.smithi183.stdout:5/145: fsync f3 0 2024-02-10T00:00:23.264 INFO:tasks.workunit.client.1.smithi183.stdout:1/106: creat d0/d3/d14/d1f/f28 x:0 0 0 2024-02-10T00:00:23.264 INFO:tasks.workunit.client.1.smithi183.stdout:0/89: fdatasync d14/d18/d1a/f1b 0 2024-02-10T00:00:23.265 INFO:tasks.workunit.client.1.smithi183.stdout:5/146: chown d4/d11/f29 690 1 2024-02-10T00:00:23.265 INFO:tasks.workunit.client.1.smithi183.stdout:0/90: readlink l11 0 2024-02-10T00:00:23.266 INFO:tasks.workunit.client.1.smithi183.stdout:2/183: mknod d2/da/d20/c38 0 2024-02-10T00:00:23.269 INFO:tasks.workunit.client.1.smithi183.stdout:4/104: getdents de/d19 0 2024-02-10T00:00:23.269 INFO:tasks.workunit.client.1.smithi183.stdout:4/105: fdatasync de/f12 0 2024-02-10T00:00:23.273 INFO:tasks.workunit.client.1.smithi183.stdout:4/106: dread fb [0,4194304] 0 2024-02-10T00:00:23.273 INFO:tasks.workunit.client.1.smithi183.stdout:4/107: write de/f12 [2269755,25262] 0 2024-02-10T00:00:23.275 INFO:tasks.workunit.client.1.smithi183.stdout:6/91: truncate d2/f15 4444037 0 2024-02-10T00:00:23.276 INFO:tasks.workunit.client.1.smithi183.stdout:8/146: dwrite d0/d10/f12 [0,4194304] 0 2024-02-10T00:00:23.277 INFO:tasks.workunit.client.1.smithi183.stdout:8/147: write d0/fd [4841765,62355] 0 2024-02-10T00:00:23.278 INFO:tasks.workunit.client.1.smithi183.stdout:8/148: chown d0/c5 11 1 2024-02-10T00:00:23.278 INFO:tasks.workunit.client.1.smithi183.stdout:9/106: link d0/d3/f11 d0/f1d 0 2024-02-10T00:00:23.282 INFO:tasks.workunit.client.1.smithi183.stdout:1/107: rename d0/d3/d14 to d0/d3/d29 0 2024-02-10T00:00:23.283 INFO:tasks.workunit.client.1.smithi183.stdout:0/91: mknod d14/d18/d1a/d22/c24 0 2024-02-10T00:00:23.284 INFO:tasks.workunit.client.1.smithi183.stdout:8/149: dread d0/d23/d2d/f21 [0,4194304] 0 2024-02-10T00:00:23.285 INFO:tasks.workunit.client.1.smithi183.stdout:9/107: dwrite d0/d10/f1b [0,4194304] 0 2024-02-10T00:00:23.287 INFO:tasks.workunit.client.1.smithi183.stdout:4/108: symlink de/l1e 0 2024-02-10T00:00:23.292 INFO:tasks.workunit.client.1.smithi183.stdout:1/108: mkdir d0/d3/d7/d2a 0 2024-02-10T00:00:23.293 INFO:tasks.workunit.client.1.smithi183.stdout:8/150: mknod d0/d27/c30 0 2024-02-10T00:00:23.294 INFO:tasks.workunit.client.1.smithi183.stdout:8/151: dread - d0/d27/f2e zero size 2024-02-10T00:00:23.294 INFO:tasks.workunit.client.1.smithi183.stdout:8/152: chown d0/l8 551 1 2024-02-10T00:00:23.296 INFO:tasks.workunit.client.1.smithi183.stdout:8/153: write d0/f2f [977389,87419] 0 2024-02-10T00:00:23.297 INFO:tasks.workunit.client.1.smithi183.stdout:5/147: getdents d4/d1d 0 2024-02-10T00:00:23.297 INFO:tasks.workunit.client.1.smithi183.stdout:8/154: dread d0/d23/f2a [0,4194304] 0 2024-02-10T00:00:23.298 INFO:tasks.workunit.client.1.smithi183.stdout:1/109: creat d0/d3/d7/f2b x:0 0 0 2024-02-10T00:00:23.299 INFO:tasks.workunit.client.1.smithi183.stdout:1/110: fsync d0/d3/d7/f23 0 2024-02-10T00:00:23.299 INFO:tasks.workunit.client.1.smithi183.stdout:1/111: read d0/f15 [3019511,101325] 0 2024-02-10T00:00:23.300 INFO:tasks.workunit.client.1.smithi183.stdout:6/92: rmdir d2/d1a/d1b 0 2024-02-10T00:00:23.301 INFO:tasks.workunit.client.1.smithi183.stdout:6/93: stat d2/f7 0 2024-02-10T00:00:23.302 INFO:tasks.workunit.client.1.smithi183.stdout:3/92: sync 2024-02-10T00:00:23.304 INFO:tasks.workunit.client.1.smithi183.stdout:1/112: dwrite d0/f1c [0,4194304] 0 2024-02-10T00:00:23.306 INFO:tasks.workunit.client.1.smithi183.stdout:3/93: dread d7/db/f17 [0,4194304] 0 2024-02-10T00:00:23.307 INFO:tasks.workunit.client.1.smithi183.stdout:2/184: write d2/da/d20/d21/f29 [835025,70773] 0 2024-02-10T00:00:23.307 INFO:tasks.workunit.client.1.smithi183.stdout:3/94: readlink l1 0 2024-02-10T00:00:23.312 INFO:tasks.workunit.client.1.smithi183.stdout:3/95: dwrite d7/db/f17 [4194304,4194304] 0 2024-02-10T00:00:23.312 INFO:tasks.workunit.client.1.smithi183.stdout:9/108: write d0/f1d [3146335,80642] 0 2024-02-10T00:00:23.315 INFO:tasks.workunit.client.1.smithi183.stdout:8/155: mkdir d0/d31 0 2024-02-10T00:00:23.315 INFO:tasks.workunit.client.1.smithi183.stdout:8/156: dread - d0/d23/f26 zero size 2024-02-10T00:00:23.316 INFO:tasks.workunit.client.1.smithi183.stdout:8/157: stat d0/d10 0 2024-02-10T00:00:23.317 INFO:tasks.workunit.client.1.smithi183.stdout:9/109: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:23.317 INFO:tasks.workunit.client.1.smithi183.stdout:5/148: link f3 d4/d23/d2a/f30 0 2024-02-10T00:00:23.319 INFO:tasks.workunit.client.1.smithi183.stdout:4/109: getdents de 0 2024-02-10T00:00:23.322 INFO:tasks.workunit.client.1.smithi183.stdout:1/113: readlink d0/d3/d7/l20 0 2024-02-10T00:00:23.322 INFO:tasks.workunit.client.1.smithi183.stdout:5/149: dwrite d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:23.323 INFO:tasks.workunit.client.1.smithi183.stdout:1/114: write d0/f17 [477966,66661] 0 2024-02-10T00:00:23.323 INFO:tasks.workunit.client.1.smithi183.stdout:6/94: rename d2/l17 to d2/l1d 0 2024-02-10T00:00:23.324 INFO:tasks.workunit.client.1.smithi183.stdout:6/95: dread - d2/f16 zero size 2024-02-10T00:00:23.327 INFO:tasks.workunit.client.1.smithi183.stdout:4/110: creat de/f1f x:0 0 0 2024-02-10T00:00:23.329 INFO:tasks.workunit.client.1.smithi183.stdout:4/111: write de/ff [870809,62143] 0 2024-02-10T00:00:23.329 INFO:tasks.workunit.client.1.smithi183.stdout:1/115: dwrite d0/d3/d7/f2b [0,4194304] 0 2024-02-10T00:00:23.329 INFO:tasks.workunit.client.1.smithi183.stdout:5/150: mkdir d4/dd/d31 0 2024-02-10T00:00:23.330 INFO:tasks.workunit.client.1.smithi183.stdout:6/96: rmdir d2/d1a 39 2024-02-10T00:00:23.331 INFO:tasks.workunit.client.1.smithi183.stdout:6/97: fsync d2/f18 0 2024-02-10T00:00:23.333 INFO:tasks.workunit.client.1.smithi183.stdout:9/110: unlink d0/fb 0 2024-02-10T00:00:23.333 INFO:tasks.workunit.client.1.smithi183.stdout:9/111: write d0/d3/f11 [4269592,41902] 0 2024-02-10T00:00:23.333 INFO:tasks.workunit.client.1.smithi183.stdout:7/98: sync 2024-02-10T00:00:23.334 INFO:tasks.workunit.client.1.smithi183.stdout:8/158: creat d0/d23/d2d/d24/f32 x:0 0 0 2024-02-10T00:00:23.336 INFO:tasks.workunit.client.1.smithi183.stdout:8/159: dread d0/d23/f2a [0,4194304] 0 2024-02-10T00:00:23.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/112: mkdir de/d19/d20 0 2024-02-10T00:00:23.340 INFO:tasks.workunit.client.1.smithi183.stdout:9/112: dwrite d0/f1d [0,4194304] 0 2024-02-10T00:00:23.342 INFO:tasks.workunit.client.1.smithi183.stdout:7/99: rename d0/lf to d0/d11/l1f 0 2024-02-10T00:00:23.343 INFO:tasks.workunit.client.1.smithi183.stdout:4/113: dwrite de/f12 [0,4194304] 0 2024-02-10T00:00:23.344 INFO:tasks.workunit.client.1.smithi183.stdout:4/114: write de/ff [1234363,86720] 0 2024-02-10T00:00:23.344 INFO:tasks.workunit.client.1.smithi183.stdout:7/100: write d0/d11/f1c [45683,79048] 0 2024-02-10T00:00:23.345 INFO:tasks.workunit.client.1.smithi183.stdout:8/160: truncate d0/d23/d2d/f21 4263321 0 2024-02-10T00:00:23.347 INFO:tasks.workunit.client.1.smithi183.stdout:9/113: mknod d0/d3/c1e 0 2024-02-10T00:00:23.347 INFO:tasks.workunit.client.1.smithi183.stdout:2/185: link d2/da/d20/l2b d2/l39 0 2024-02-10T00:00:23.348 INFO:tasks.workunit.client.1.smithi183.stdout:7/101: dread d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:23.350 INFO:tasks.workunit.client.1.smithi183.stdout:3/96: fdatasync d7/fe 0 2024-02-10T00:00:23.351 INFO:tasks.workunit.client.1.smithi183.stdout:6/98: rename d2/f10 to d2/f1e 0 2024-02-10T00:00:23.355 INFO:tasks.workunit.client.1.smithi183.stdout:0/92: write f7 [1227366,74924] 0 2024-02-10T00:00:23.355 INFO:tasks.workunit.client.1.smithi183.stdout:0/93: dread - d14/f17 zero size 2024-02-10T00:00:23.356 INFO:tasks.workunit.client.1.smithi183.stdout:8/161: symlink d0/d23/d2d/d24/l33 0 2024-02-10T00:00:23.357 INFO:tasks.workunit.client.1.smithi183.stdout:8/162: chown d0/f14 1790 1 2024-02-10T00:00:23.357 INFO:tasks.workunit.client.1.smithi183.stdout:8/163: write d0/f2f [1887357,59936] 0 2024-02-10T00:00:23.361 INFO:tasks.workunit.client.1.smithi183.stdout:0/94: creat d14/d18/f25 x:0 0 0 2024-02-10T00:00:23.365 INFO:tasks.workunit.client.1.smithi183.stdout:9/114: creat d0/d3/d14/d1c/f1f x:0 0 0 2024-02-10T00:00:23.366 INFO:tasks.workunit.client.1.smithi183.stdout:0/95: dwrite f7 [0,4194304] 0 2024-02-10T00:00:23.368 INFO:tasks.workunit.client.1.smithi183.stdout:7/102: link d0/d11/f1c d0/d2/d3/f20 0 2024-02-10T00:00:23.370 INFO:tasks.workunit.client.1.smithi183.stdout:2/186: creat d2/f3a x:0 0 0 2024-02-10T00:00:23.371 INFO:tasks.workunit.client.1.smithi183.stdout:4/115: fdatasync de/d14/f16 0 2024-02-10T00:00:23.372 INFO:tasks.workunit.client.1.smithi183.stdout:8/164: symlink d0/d31/l34 0 2024-02-10T00:00:23.373 INFO:tasks.workunit.client.1.smithi183.stdout:4/116: read de/d14/f16 [3421116,68211] 0 2024-02-10T00:00:23.375 INFO:tasks.workunit.client.1.smithi183.stdout:0/96: dwrite d14/f20 [0,4194304] 0 2024-02-10T00:00:23.375 INFO:tasks.workunit.client.1.smithi183.stdout:5/151: write d4/d1d/d27/f2b [986319,74570] 0 2024-02-10T00:00:23.378 INFO:tasks.workunit.client.1.smithi183.stdout:9/115: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:23.379 INFO:tasks.workunit.client.1.smithi183.stdout:3/97: write d7/f9 [1363946,74903] 0 2024-02-10T00:00:23.381 INFO:tasks.workunit.client.1.smithi183.stdout:8/165: symlink d0/d27/l35 0 2024-02-10T00:00:23.383 INFO:tasks.workunit.client.1.smithi183.stdout:6/99: getdents d2 0 2024-02-10T00:00:23.383 INFO:tasks.workunit.client.1.smithi183.stdout:5/152: creat d4/dd/f32 x:0 0 0 2024-02-10T00:00:23.384 INFO:tasks.workunit.client.1.smithi183.stdout:5/153: write d4/f6 [883592,30752] 0 2024-02-10T00:00:23.385 INFO:tasks.workunit.client.1.smithi183.stdout:0/97: rename d14/d18/c1c to d14/c26 0 2024-02-10T00:00:23.386 INFO:tasks.workunit.client.1.smithi183.stdout:5/154: write d4/dd/f32 [807700,119621] 0 2024-02-10T00:00:23.387 INFO:tasks.workunit.client.1.smithi183.stdout:6/100: dread d2/f18 [0,4194304] 0 2024-02-10T00:00:23.389 INFO:tasks.workunit.client.1.smithi183.stdout:7/103: write d0/d2/d4/f5 [1290374,26381] 0 2024-02-10T00:00:23.390 INFO:tasks.workunit.client.1.smithi183.stdout:2/187: creat d2/d2c/d2f/f3b x:0 0 0 2024-02-10T00:00:23.390 INFO:tasks.workunit.client.1.smithi183.stdout:6/101: dread d2/ff [0,4194304] 0 2024-02-10T00:00:23.391 INFO:tasks.workunit.client.1.smithi183.stdout:3/98: creat d7/db/f1b x:0 0 0 2024-02-10T00:00:23.392 INFO:tasks.workunit.client.1.smithi183.stdout:8/166: mkdir d0/d27/d36 0 2024-02-10T00:00:23.392 INFO:tasks.workunit.client.1.smithi183.stdout:0/98: creat d14/d18/d1a/f27 x:0 0 0 2024-02-10T00:00:23.395 INFO:tasks.workunit.client.1.smithi183.stdout:9/116: link d0/d10/f1b d0/d3/d14/f20 0 2024-02-10T00:00:23.395 INFO:tasks.workunit.client.1.smithi183.stdout:7/104: fdatasync d0/d2/f1a 0 2024-02-10T00:00:23.396 INFO:tasks.workunit.client.1.smithi183.stdout:2/188: mknod d2/d33/d35/c3c 0 2024-02-10T00:00:23.398 INFO:tasks.workunit.client.1.smithi183.stdout:3/99: mkdir d7/d19/d1c 0 2024-02-10T00:00:23.399 INFO:tasks.workunit.client.1.smithi183.stdout:8/167: creat d0/d23/f37 x:0 0 0 2024-02-10T00:00:23.399 INFO:tasks.workunit.client.1.smithi183.stdout:3/100: chown d7/db/f17 316 1 2024-02-10T00:00:23.400 INFO:tasks.workunit.client.1.smithi183.stdout:4/117: truncate de/d14/f16 2765023 0 2024-02-10T00:00:23.401 INFO:tasks.workunit.client.1.smithi183.stdout:3/101: fsync d7/fe 0 2024-02-10T00:00:23.401 INFO:tasks.workunit.client.1.smithi183.stdout:4/118: fsync de/f1f 0 2024-02-10T00:00:23.401 INFO:tasks.workunit.client.1.smithi183.stdout:9/117: dwrite d0/d3/d14/d1c/f1f [0,4194304] 0 2024-02-10T00:00:23.402 INFO:tasks.workunit.client.1.smithi183.stdout:7/105: creat d0/f21 x:0 0 0 2024-02-10T00:00:23.403 INFO:tasks.workunit.client.1.smithi183.stdout:3/102: write f6 [680325,22281] 0 2024-02-10T00:00:23.403 INFO:tasks.workunit.client.1.smithi183.stdout:6/102: link d2/f14 d2/d1a/f1f 0 2024-02-10T00:00:23.403 INFO:tasks.workunit.client.1.smithi183.stdout:7/106: dread - d0/d2/d4/d8/f1d zero size 2024-02-10T00:00:23.404 INFO:tasks.workunit.client.1.smithi183.stdout:7/107: dread - d0/f21 zero size 2024-02-10T00:00:23.405 INFO:tasks.workunit.client.1.smithi183.stdout:2/189: mkdir d2/d3d 0 2024-02-10T00:00:23.407 INFO:tasks.workunit.client.1.smithi183.stdout:7/108: read d0/d2/d4/f5 [646711,60633] 0 2024-02-10T00:00:23.407 INFO:tasks.workunit.client.1.smithi183.stdout:4/119: creat de/d18/f21 x:0 0 0 2024-02-10T00:00:23.407 INFO:tasks.workunit.client.1.smithi183.stdout:9/118: mknod d0/d10/c21 0 2024-02-10T00:00:23.408 INFO:tasks.workunit.client.1.smithi183.stdout:9/119: fsync d0/ff 0 2024-02-10T00:00:23.410 INFO:tasks.workunit.client.1.smithi183.stdout:7/109: dread d0/d2/f1a [0,4194304] 0 2024-02-10T00:00:23.410 INFO:tasks.workunit.client.1.smithi183.stdout:6/103: unlink d2/d1a/c1c 0 2024-02-10T00:00:23.420 INFO:tasks.workunit.client.1.smithi183.stdout:8/168: symlink d0/d27/d36/l38 0 2024-02-10T00:00:23.426 INFO:tasks.workunit.client.1.smithi183.stdout:6/104: creat d2/d1a/f20 x:0 0 0 2024-02-10T00:00:23.427 INFO:tasks.workunit.client.1.smithi183.stdout:6/105: dread - d2/d1a/f1f zero size 2024-02-10T00:00:23.428 INFO:tasks.workunit.client.1.smithi183.stdout:0/99: getdents d14/d1d 0 2024-02-10T00:00:23.428 INFO:tasks.workunit.client.1.smithi183.stdout:8/169: mknod d0/d27/c39 0 2024-02-10T00:00:23.430 INFO:tasks.workunit.client.1.smithi183.stdout:8/170: read d0/f1b [1360585,108845] 0 2024-02-10T00:00:23.462 INFO:tasks.workunit.client.1.smithi183.stdout:1/116: sync 2024-02-10T00:00:23.463 INFO:tasks.workunit.client.1.smithi183.stdout:9/120: dwrite d0/d10/f1b [4194304,4194304] 0 2024-02-10T00:00:23.477 INFO:tasks.workunit.client.1.smithi183.stdout:0/100: creat d14/f28 x:0 0 0 2024-02-10T00:00:23.477 INFO:tasks.workunit.client.1.smithi183.stdout:2/190: creat d2/f3e x:0 0 0 2024-02-10T00:00:23.478 INFO:tasks.workunit.client.1.smithi183.stdout:6/106: dread d2/fc [0,4194304] 0 2024-02-10T00:00:23.478 INFO:tasks.workunit.client.1.smithi183.stdout:7/110: truncate d0/d2/d4/d8/f1d 545910 0 2024-02-10T00:00:23.480 INFO:tasks.workunit.client.1.smithi183.stdout:8/171: creat d0/d27/f3a x:0 0 0 2024-02-10T00:00:23.480 INFO:tasks.workunit.client.1.smithi183.stdout:7/111: chown d0/d11 1475762431 1 2024-02-10T00:00:23.483 INFO:tasks.workunit.client.1.smithi183.stdout:6/107: dread d2/f18 [0,4194304] 0 2024-02-10T00:00:23.517 INFO:tasks.workunit.client.1.smithi183.stdout:5/155: sync 2024-02-10T00:00:23.544 INFO:tasks.workunit.client.1.smithi183.stdout:3/103: sync 2024-02-10T00:00:23.544 INFO:tasks.workunit.client.1.smithi183.stdout:3/104: fsync d7/f8 0 2024-02-10T00:00:23.576 INFO:tasks.workunit.client.1.smithi183.stdout:8/172: sync 2024-02-10T00:00:23.631 INFO:tasks.workunit.client.1.smithi183.stdout:9/121: unlink d0/d3/c18 0 2024-02-10T00:00:23.632 INFO:tasks.workunit.client.1.smithi183.stdout:2/191: write d2/da/f17 [3316158,49489] 0 2024-02-10T00:00:23.632 INFO:tasks.workunit.client.1.smithi183.stdout:9/122: write d0/d3/f11 [359795,98024] 0 2024-02-10T00:00:23.632 INFO:tasks.workunit.client.1.smithi183.stdout:0/101: mknod d14/d18/d1a/d22/c29 0 2024-02-10T00:00:23.633 INFO:tasks.workunit.client.1.smithi183.stdout:4/120: truncate de/f12 283708 0 2024-02-10T00:00:23.633 INFO:tasks.workunit.client.1.smithi183.stdout:2/192: write d2/da/f17 [3961003,1209] 0 2024-02-10T00:00:23.634 INFO:tasks.workunit.client.1.smithi183.stdout:7/112: symlink d0/l22 0 2024-02-10T00:00:23.635 INFO:tasks.workunit.client.1.smithi183.stdout:6/108: symlink d2/l21 0 2024-02-10T00:00:23.636 INFO:tasks.workunit.client.1.smithi183.stdout:7/113: readlink d0/d2/d4/d8/l18 0 2024-02-10T00:00:23.638 INFO:tasks.workunit.client.1.smithi183.stdout:8/173: mknod d0/d27/d36/c3b 0 2024-02-10T00:00:23.638 INFO:tasks.workunit.client.1.smithi183.stdout:1/117: dwrite d0/d3/d7/d24/f25 [0,4194304] 0 2024-02-10T00:00:23.638 INFO:tasks.workunit.client.1.smithi183.stdout:7/114: chown d0/d2/d4/d8/f13 25177 1 2024-02-10T00:00:23.638 INFO:tasks.workunit.client.1.smithi183.stdout:8/174: readlink d0/l8 0 2024-02-10T00:00:23.640 INFO:tasks.workunit.client.1.smithi183.stdout:9/123: mknod d0/d10/c22 0 2024-02-10T00:00:23.641 INFO:tasks.workunit.client.1.smithi183.stdout:9/124: write d0/ff [729130,22689] 0 2024-02-10T00:00:23.644 INFO:tasks.workunit.client.1.smithi183.stdout:5/156: symlink d4/d23/d2a/l33 0 2024-02-10T00:00:23.646 INFO:tasks.workunit.client.1.smithi183.stdout:9/125: dwrite d0/ff [0,4194304] 0 2024-02-10T00:00:23.649 INFO:tasks.workunit.client.1.smithi183.stdout:1/118: rename d0/d3/d7/d2a to d0/d3/d7/d2c 0 2024-02-10T00:00:23.652 INFO:tasks.workunit.client.1.smithi183.stdout:3/105: link c0 d7/d19/c1d 0 2024-02-10T00:00:23.652 INFO:tasks.workunit.client.1.smithi183.stdout:3/106: chown c4 3 1 2024-02-10T00:00:23.653 INFO:tasks.workunit.client.1.smithi183.stdout:5/157: dread d4/f13 [0,4194304] 0 2024-02-10T00:00:23.653 INFO:tasks.workunit.client.1.smithi183.stdout:8/175: mkdir d0/d3c 0 2024-02-10T00:00:23.659 INFO:tasks.workunit.client.1.smithi183.stdout:0/102: getdents d14/d18 0 2024-02-10T00:00:23.659 INFO:tasks.workunit.client.1.smithi183.stdout:0/103: fdatasync d14/f17 0 2024-02-10T00:00:23.660 INFO:tasks.workunit.client.1.smithi183.stdout:1/119: link d0/d3/d7/f18 d0/d3/f2d 0 2024-02-10T00:00:23.661 INFO:tasks.workunit.client.1.smithi183.stdout:3/107: creat d7/d19/d1c/f1e x:0 0 0 2024-02-10T00:00:23.661 INFO:tasks.workunit.client.1.smithi183.stdout:0/104: write d14/d18/d1a/f27 [567533,96917] 0 2024-02-10T00:00:23.662 INFO:tasks.workunit.client.1.smithi183.stdout:8/176: dwrite d0/f1b [0,4194304] 0 2024-02-10T00:00:23.662 INFO:tasks.workunit.client.1.smithi183.stdout:1/120: write d0/f1c [1506809,29417] 0 2024-02-10T00:00:23.663 INFO:tasks.workunit.client.1.smithi183.stdout:9/126: rename d0/d3/c1e to d0/c23 0 2024-02-10T00:00:23.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/177: dread - d0/d27/f2e zero size 2024-02-10T00:00:23.668 INFO:tasks.workunit.client.1.smithi183.stdout:5/158: getdents d4/d1d 0 2024-02-10T00:00:23.691 INFO:tasks.workunit.client.1.smithi183.stdout:3/108: symlink d7/d19/d1c/l1f 0 2024-02-10T00:00:23.696 INFO:tasks.workunit.client.1.smithi183.stdout:1/121: symlink d0/d3/d7/d2c/l2e 0 2024-02-10T00:00:23.698 INFO:tasks.workunit.client.1.smithi183.stdout:9/127: write d0/f12 [1004209,23710] 0 2024-02-10T00:00:23.698 INFO:tasks.workunit.client.1.smithi183.stdout:9/128: chown d0/d3/l7 11845544 1 2024-02-10T00:00:23.702 INFO:tasks.workunit.client.1.smithi183.stdout:9/129: dwrite d0/f1d [0,4194304] 0 2024-02-10T00:00:23.706 INFO:tasks.workunit.client.1.smithi183.stdout:9/130: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:23.707 INFO:tasks.workunit.client.1.smithi183.stdout:9/131: write d0/d3/f11 [4859562,10248] 0 2024-02-10T00:00:23.710 INFO:tasks.workunit.client.1.smithi183.stdout:5/159: rmdir d4/d1d 39 2024-02-10T00:00:23.714 INFO:tasks.workunit.client.1.smithi183.stdout:5/160: dwrite d4/d23/f21 [0,4194304] 0 2024-02-10T00:00:23.715 INFO:tasks.workunit.client.1.smithi183.stdout:3/109: unlink d7/cf 0 2024-02-10T00:00:23.716 INFO:tasks.workunit.client.0.smithi164.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-10T00:00:23.720 INFO:tasks.workunit.client.1.smithi183.stdout:5/161: dwrite d4/dd/f32 [0,4194304] 0 2024-02-10T00:00:23.758 INFO:tasks.workunit.client.1.smithi183.stdout:9/132: creat d0/d3/f24 x:0 0 0 2024-02-10T00:00:23.762 INFO:tasks.workunit.client.1.smithi183.stdout:4/121: write f0 [413737,129425] 0 2024-02-10T00:00:23.765 INFO:tasks.workunit.client.1.smithi183.stdout:2/193: write d2/da/d20/f37 [2497647,120097] 0 2024-02-10T00:00:23.766 INFO:tasks.workunit.client.1.smithi183.stdout:2/194: write d2/f3e [948473,120951] 0 2024-02-10T00:00:23.771 INFO:tasks.workunit.client.1.smithi183.stdout:8/178: write d0/d23/d2d/f21 [2532376,76115] 0 2024-02-10T00:00:23.775 INFO:tasks.workunit.client.1.smithi183.stdout:5/162: unlink d4/c17 0 2024-02-10T00:00:23.775 INFO:tasks.workunit.client.1.smithi183.stdout:0/105: link d14/d18/d1a/d22/c29 d14/d18/d1a/d22/c2a 0 2024-02-10T00:00:23.779 INFO:tasks.workunit.client.1.smithi183.stdout:2/195: mknod d2/d33/d35/c3f 0 2024-02-10T00:00:23.780 INFO:tasks.workunit.client.1.smithi183.stdout:9/133: dwrite d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:23.780 INFO:tasks.workunit.client.1.smithi183.stdout:7/115: write d0/d2/d4/d8/f1d [1051648,43376] 0 2024-02-10T00:00:23.783 INFO:tasks.workunit.client.1.smithi183.stdout:0/106: creat d14/d1d/f2b x:0 0 0 2024-02-10T00:00:23.784 INFO:tasks.workunit.client.0.smithi164.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-10T00:00:23.784 INFO:tasks.workunit.client.0.smithi164.stderr:+ make 2024-02-10T00:00:23.785 INFO:tasks.workunit.client.1.smithi183.stdout:5/163: rename d4/f9 to d4/dd/d31/f34 0 2024-02-10T00:00:23.787 INFO:tasks.workunit.client.1.smithi183.stdout:6/109: rmdir d2/d1a 39 2024-02-10T00:00:23.790 INFO:tasks.workunit.client.1.smithi183.stdout:5/164: dwrite d4/f6 [0,4194304] 0 2024-02-10T00:00:23.799 INFO:tasks.workunit.client.1.smithi183.stdout:5/165: dread d4/d11/f1f [0,4194304] 0 2024-02-10T00:00:23.799 INFO:tasks.workunit.client.1.smithi183.stdout:5/166: stat d4/d23/c2c 0 2024-02-10T00:00:23.802 INFO:tasks.workunit.client.1.smithi183.stdout:5/167: dread f3 [0,4194304] 0 2024-02-10T00:00:23.806 INFO:tasks.workunit.client.1.smithi183.stdout:2/196: creat d2/da/d20/d21/f40 x:0 0 0 2024-02-10T00:00:23.829 INFO:tasks.workunit.client.1.smithi183.stdout:1/122: getdents d0/d3/d29/d1f 0 2024-02-10T00:00:23.833 INFO:tasks.workunit.client.1.smithi183.stdout:7/116: readlink d0/d11/l1f 0 2024-02-10T00:00:23.847 INFO:tasks.workunit.client.1.smithi183.stdout:9/134: mknod d0/d3/d14/c25 0 2024-02-10T00:00:23.869 INFO:tasks.workunit.client.1.smithi183.stdout:3/110: creat d7/f20 x:0 0 0 2024-02-10T00:00:23.871 INFO:tasks.workunit.client.1.smithi183.stdout:3/111: dread d7/db/f17 [0,4194304] 0 2024-02-10T00:00:23.872 INFO:tasks.workunit.client.1.smithi183.stdout:0/107: rename d14/d18 to d14/d1d/d2c 0 2024-02-10T00:00:23.875 INFO:tasks.workunit.client.1.smithi183.stdout:0/108: dread d14/f20 [0,4194304] 0 2024-02-10T00:00:23.875 INFO:tasks.workunit.client.1.smithi183.stdout:0/109: readlink l9 0 2024-02-10T00:00:23.876 INFO:tasks.workunit.client.1.smithi183.stdout:0/110: fdatasync d14/d1d/d2c/d1a/f27 0 2024-02-10T00:00:23.878 INFO:tasks.workunit.client.1.smithi183.stdout:5/168: mknod d4/d11/c35 0 2024-02-10T00:00:23.881 INFO:tasks.workunit.client.1.smithi183.stdout:7/117: fsync d0/d2/d3/f20 0 2024-02-10T00:00:23.883 INFO:tasks.workunit.client.1.smithi183.stdout:3/112: creat d7/d19/d1c/f21 x:0 0 0 2024-02-10T00:00:23.885 INFO:tasks.workunit.client.1.smithi183.stdout:4/122: dread de/f12 [0,4194304] 0 2024-02-10T00:00:23.885 INFO:tasks.workunit.client.1.smithi183.stdout:7/118: dread d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:23.886 INFO:tasks.workunit.client.1.smithi183.stdout:4/123: dread de/d14/f16 [0,4194304] 0 2024-02-10T00:00:23.889 INFO:tasks.workunit.client.1.smithi183.stdout:0/111: mkdir d14/d1d/d2d 0 2024-02-10T00:00:23.893 INFO:tasks.workunit.client.1.smithi183.stdout:9/135: unlink d0/c6 0 2024-02-10T00:00:23.894 INFO:tasks.workunit.client.1.smithi183.stdout:2/197: truncate d2/da/fb 61839 0 2024-02-10T00:00:23.895 INFO:tasks.workunit.client.1.smithi183.stdout:1/123: truncate d0/f15 1527372 0 2024-02-10T00:00:23.895 INFO:tasks.workunit.client.1.smithi183.stdout:2/198: write d2/f1e [4586379,36752] 0 2024-02-10T00:00:23.895 INFO:tasks.workunit.client.1.smithi183.stdout:8/179: link d0/cc d0/d3c/c3d 0 2024-02-10T00:00:23.900 INFO:tasks.workunit.client.1.smithi183.stdout:2/199: write d2/d2c/d2f/f3b [260337,27819] 0 2024-02-10T00:00:23.900 INFO:tasks.workunit.client.1.smithi183.stdout:4/124: mkdir de/d22 0 2024-02-10T00:00:23.900 INFO:tasks.workunit.client.1.smithi183.stdout:0/112: mknod d14/d1d/d2c/d1a/d22/c2e 0 2024-02-10T00:00:23.900 INFO:tasks.workunit.client.1.smithi183.stdout:6/110: dwrite d2/fc [0,4194304] 0 2024-02-10T00:00:23.901 INFO:tasks.workunit.client.1.smithi183.stdout:9/136: unlink d0/d3/f11 0 2024-02-10T00:00:23.905 INFO:tasks.workunit.client.1.smithi183.stdout:5/169: truncate f0 71710 0 2024-02-10T00:00:23.906 INFO:tasks.workunit.client.1.smithi183.stdout:8/180: creat d0/d27/f3e x:0 0 0 2024-02-10T00:00:23.906 INFO:tasks.workunit.client.1.smithi183.stdout:8/181: chown d0/f2f 39007 1 2024-02-10T00:00:23.907 INFO:tasks.workunit.client.1.smithi183.stdout:2/200: rmdir d2/d2c/d2d 39 2024-02-10T00:00:23.912 INFO:tasks.workunit.client.1.smithi183.stdout:9/137: unlink d0/ff 0 2024-02-10T00:00:23.914 INFO:tasks.workunit.client.1.smithi183.stdout:9/138: dread d0/f12 [0,4194304] 0 2024-02-10T00:00:23.914 INFO:tasks.workunit.client.1.smithi183.stdout:3/113: rename d7/d19/d1c/l1f to d7/l22 0 2024-02-10T00:00:23.916 INFO:tasks.workunit.client.1.smithi183.stdout:4/125: creat de/d19/d20/f23 x:0 0 0 2024-02-10T00:00:23.918 INFO:tasks.workunit.client.1.smithi183.stdout:6/111: mkdir d2/d22 0 2024-02-10T00:00:23.920 INFO:tasks.workunit.client.1.smithi183.stdout:0/113: write f7 [5195178,25162] 0 2024-02-10T00:00:23.923 INFO:tasks.workunit.client.1.smithi183.stdout:5/170: fdatasync f1 0 2024-02-10T00:00:23.925 INFO:tasks.workunit.client.1.smithi183.stdout:9/139: unlink d0/d10/f19 0 2024-02-10T00:00:23.929 INFO:tasks.workunit.client.1.smithi183.stdout:7/119: getdents d0/d2/d3 0 2024-02-10T00:00:23.930 INFO:tasks.workunit.client.1.smithi183.stdout:8/182: mkdir d0/d3f 0 2024-02-10T00:00:23.930 INFO:tasks.workunit.client.1.smithi183.stdout:2/201: symlink d2/l41 0 2024-02-10T00:00:23.932 INFO:tasks.workunit.client.1.smithi183.stdout:0/114: write d14/d1d/d2c/d1a/f1b [4564485,9596] 0 2024-02-10T00:00:23.934 INFO:tasks.workunit.client.1.smithi183.stdout:4/126: write de/f12 [1098502,125586] 0 2024-02-10T00:00:23.938 INFO:tasks.workunit.client.1.smithi183.stdout:4/127: dwrite de/f1f [0,4194304] 0 2024-02-10T00:00:23.940 INFO:tasks.workunit.client.1.smithi183.stdout:5/171: mkdir d4/d11/d36 0 2024-02-10T00:00:23.942 INFO:tasks.workunit.client.1.smithi183.stdout:1/124: rename d0/f15 to d0/d3/d7/d2c/f2f 0 2024-02-10T00:00:23.943 INFO:tasks.workunit.client.1.smithi183.stdout:7/120: symlink d0/d2/d4/d8/l23 0 2024-02-10T00:00:23.943 INFO:tasks.workunit.client.1.smithi183.stdout:1/125: chown d0/d3/d29/d1f/f28 928733 1 2024-02-10T00:00:23.944 INFO:tasks.workunit.client.1.smithi183.stdout:1/126: stat d0/d3/d7/f18 0 2024-02-10T00:00:23.945 INFO:tasks.workunit.client.1.smithi183.stdout:6/112: creat d2/d1a/f23 x:0 0 0 2024-02-10T00:00:23.945 INFO:tasks.workunit.client.1.smithi183.stdout:1/127: chown d0/d3/d7/f18 2051459 1 2024-02-10T00:00:23.947 INFO:tasks.workunit.client.1.smithi183.stdout:9/140: fdatasync d0/d3/d14/f20 0 2024-02-10T00:00:23.950 INFO:tasks.workunit.client.1.smithi183.stdout:8/183: rename d0/d27/f3e to d0/d27/d36/f40 0 2024-02-10T00:00:23.950 INFO:tasks.workunit.client.1.smithi183.stdout:2/202: creat d2/d3d/f42 x:0 0 0 2024-02-10T00:00:23.951 INFO:tasks.workunit.client.1.smithi183.stdout:7/121: mknod d0/d2/d4/c24 0 2024-02-10T00:00:23.954 INFO:tasks.workunit.client.1.smithi183.stdout:3/114: getdents d7 0 2024-02-10T00:00:23.955 INFO:tasks.workunit.client.1.smithi183.stdout:3/115: write d7/f20 [581470,25155] 0 2024-02-10T00:00:23.959 INFO:tasks.workunit.client.1.smithi183.stdout:8/184: mkdir d0/d10/d41 0 2024-02-10T00:00:23.962 INFO:tasks.workunit.client.1.smithi183.stdout:2/203: mkdir d2/da/d20/d21/d43 0 2024-02-10T00:00:23.962 INFO:tasks.workunit.client.1.smithi183.stdout:9/141: dread d0/f1d [4194304,4194304] 0 2024-02-10T00:00:23.962 INFO:tasks.workunit.client.1.smithi183.stdout:1/128: write d0/d3/d7/f18 [9192538,117936] 0 2024-02-10T00:00:23.963 INFO:tasks.workunit.client.1.smithi183.stdout:0/115: getdents d14/d1d/d2c 0 2024-02-10T00:00:23.964 INFO:tasks.workunit.client.1.smithi183.stdout:1/129: chown d0/l2 9 1 2024-02-10T00:00:23.964 INFO:tasks.workunit.client.1.smithi183.stdout:8/185: dread d0/d23/d2d/f21 [0,4194304] 0 2024-02-10T00:00:23.965 INFO:tasks.workunit.client.1.smithi183.stdout:5/172: mkdir d4/d1d/d27/d37 0 2024-02-10T00:00:23.965 INFO:tasks.workunit.client.1.smithi183.stdout:8/186: write d0/f1f [785759,101939] 0 2024-02-10T00:00:23.967 INFO:tasks.workunit.client.1.smithi183.stdout:9/142: mkdir d0/d3/d14/d26 0 2024-02-10T00:00:23.968 INFO:tasks.workunit.client.1.smithi183.stdout:9/143: fdatasync d0/d3/f24 0 2024-02-10T00:00:23.969 INFO:tasks.workunit.client.1.smithi183.stdout:6/113: rename d2/fc to d2/f24 0 2024-02-10T00:00:23.971 INFO:tasks.workunit.client.1.smithi183.stdout:1/130: creat d0/d3/d7/d2c/f30 x:0 0 0 2024-02-10T00:00:23.972 INFO:tasks.workunit.client.1.smithi183.stdout:1/131: write d0/d3/f2d [4114484,128052] 0 2024-02-10T00:00:23.973 INFO:tasks.workunit.client.1.smithi183.stdout:5/173: mkdir d4/d1d/d27/d38 0 2024-02-10T00:00:23.975 INFO:tasks.workunit.client.1.smithi183.stdout:2/204: truncate d2/da/d20/f37 817055 0 2024-02-10T00:00:23.977 INFO:tasks.workunit.client.1.smithi183.stdout:5/174: dread d4/dd/d31/f34 [0,4194304] 0 2024-02-10T00:00:23.977 INFO:tasks.workunit.client.1.smithi183.stdout:1/132: dwrite d0/d3/f12 [0,4194304] 0 2024-02-10T00:00:23.978 INFO:tasks.workunit.client.1.smithi183.stdout:7/122: rename d0/d2/d4/c24 to d0/d2/c25 0 2024-02-10T00:00:23.979 INFO:tasks.workunit.client.1.smithi183.stdout:0/116: mknod d14/d1d/d2d/c2f 0 2024-02-10T00:00:23.979 INFO:tasks.workunit.client.1.smithi183.stdout:5/175: write d4/d23/f21 [1910394,19100] 0 2024-02-10T00:00:23.979 INFO:tasks.workunit.client.1.smithi183.stdout:6/114: mkdir d2/d1a/d25 0 2024-02-10T00:00:23.981 INFO:tasks.workunit.client.1.smithi183.stdout:5/176: write d4/d11/f29 [2767522,22529] 0 2024-02-10T00:00:23.982 INFO:tasks.workunit.client.1.smithi183.stdout:5/177: write d4/dd/f1b [787875,78437] 0 2024-02-10T00:00:23.982 INFO:tasks.workunit.client.1.smithi183.stdout:8/187: symlink d0/d3f/l42 0 2024-02-10T00:00:23.983 INFO:tasks.workunit.client.1.smithi183.stdout:8/188: write d0/d23/d2d/d24/f32 [612641,23038] 0 2024-02-10T00:00:23.983 INFO:tasks.workunit.client.1.smithi183.stdout:8/189: chown d0/f14 258 1 2024-02-10T00:00:23.983 INFO:tasks.workunit.client.1.smithi183.stdout:8/190: chown d0/d31/l34 0 1 2024-02-10T00:00:23.984 INFO:tasks.workunit.client.1.smithi183.stdout:8/191: read - d0/d23/f2b zero size 2024-02-10T00:00:23.985 INFO:tasks.workunit.client.1.smithi183.stdout:8/192: write d0/f1f [1044003,93609] 0 2024-02-10T00:00:23.987 INFO:tasks.workunit.client.1.smithi183.stdout:0/117: mknod d14/d1d/d2c/d1a/c30 0 2024-02-10T00:00:23.989 INFO:tasks.workunit.client.1.smithi183.stdout:5/178: creat d4/d1d/f39 x:0 0 0 2024-02-10T00:00:23.993 INFO:tasks.workunit.client.1.smithi183.stdout:8/193: unlink d0/f14 0 2024-02-10T00:00:23.993 INFO:tasks.workunit.client.1.smithi183.stdout:5/179: dwrite d4/fc [0,4194304] 0 2024-02-10T00:00:23.994 INFO:tasks.workunit.client.1.smithi183.stdout:8/194: dread - d0/d10/f1a zero size 2024-02-10T00:00:23.994 INFO:tasks.workunit.client.1.smithi183.stdout:9/144: rmdir d0/d3/d14/d26 0 2024-02-10T00:00:23.998 INFO:tasks.workunit.client.1.smithi183.stdout:1/133: mknod d0/c31 0 2024-02-10T00:00:23.998 INFO:tasks.workunit.client.1.smithi183.stdout:6/115: mkdir d2/d26 0 2024-02-10T00:00:23.999 INFO:tasks.workunit.client.1.smithi183.stdout:5/180: stat d4/d1d/d27/f2b 0 2024-02-10T00:00:23.999 INFO:tasks.workunit.client.1.smithi183.stdout:8/195: write d0/d23/f26 [494803,67178] 0 2024-02-10T00:00:24.001 INFO:tasks.workunit.client.1.smithi183.stdout:8/196: write d0/f2f [2648286,34800] 0 2024-02-10T00:00:24.003 INFO:tasks.workunit.client.1.smithi183.stdout:9/145: dwrite d0/d3/f24 [0,4194304] 0 2024-02-10T00:00:24.006 INFO:tasks.workunit.client.0.smithi164.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-10T00:00:24.009 INFO:tasks.workunit.client.1.smithi183.stdout:7/123: dwrite d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:24.012 INFO:tasks.workunit.client.1.smithi183.stdout:2/205: dwrite d2/f13 [4194304,4194304] 0 2024-02-10T00:00:24.012 INFO:tasks.workunit.client.1.smithi183.stdout:5/181: symlink d4/l3a 0 2024-02-10T00:00:24.012 INFO:tasks.workunit.client.1.smithi183.stdout:9/146: chown d0/d10 1515 1 2024-02-10T00:00:24.013 INFO:tasks.workunit.client.1.smithi183.stdout:6/116: getdents d2/d1a/d25 0 2024-02-10T00:00:24.016 INFO:tasks.workunit.client.1.smithi183.stdout:9/147: mknod d0/d3/d14/d1c/c27 0 2024-02-10T00:00:24.017 INFO:tasks.workunit.client.1.smithi183.stdout:3/116: sync 2024-02-10T00:00:24.017 INFO:tasks.workunit.client.1.smithi183.stdout:4/128: sync 2024-02-10T00:00:24.018 INFO:tasks.workunit.client.1.smithi183.stdout:6/117: rename d2/d22 to d2/d1a/d27 0 2024-02-10T00:00:24.019 INFO:tasks.workunit.client.1.smithi183.stdout:2/206: dwrite d2/f3e [0,4194304] 0 2024-02-10T00:00:24.020 INFO:tasks.workunit.client.1.smithi183.stdout:7/124: creat d0/d2/f26 x:0 0 0 2024-02-10T00:00:24.020 INFO:tasks.workunit.client.1.smithi183.stdout:2/207: stat d2/da/d20/d21/d36 0 2024-02-10T00:00:24.023 INFO:tasks.workunit.client.1.smithi183.stdout:3/117: creat d7/d19/f23 x:0 0 0 2024-02-10T00:00:24.027 INFO:tasks.workunit.client.1.smithi183.stdout:6/118: unlink d2/ff 0 2024-02-10T00:00:24.027 INFO:tasks.workunit.client.1.smithi183.stdout:2/208: fsync d2/da/d20/d21/f23 0 2024-02-10T00:00:24.029 INFO:tasks.workunit.client.1.smithi183.stdout:3/118: dread d7/f11 [0,4194304] 0 2024-02-10T00:00:24.029 INFO:tasks.workunit.client.1.smithi183.stdout:2/209: mknod d2/d3d/c44 0 2024-02-10T00:00:24.038 INFO:tasks.workunit.client.1.smithi183.stdout:2/210: read d2/da/f25 [482566,120748] 0 2024-02-10T00:00:24.039 INFO:tasks.workunit.client.1.smithi183.stdout:4/129: dread de/d18/f1b [0,4194304] 0 2024-02-10T00:00:24.041 INFO:tasks.workunit.client.1.smithi183.stdout:6/119: dwrite d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:24.043 INFO:tasks.workunit.client.1.smithi183.stdout:2/211: unlink d2/da/d20/c38 0 2024-02-10T00:00:24.045 INFO:tasks.workunit.client.1.smithi183.stdout:2/212: write d2/f8 [3518749,129890] 0 2024-02-10T00:00:24.045 INFO:tasks.workunit.client.1.smithi183.stdout:3/119: dwrite d7/db/f1b [0,4194304] 0 2024-02-10T00:00:24.046 INFO:tasks.workunit.client.1.smithi183.stdout:4/130: rename de/f17 to de/d19/d1c/f24 0 2024-02-10T00:00:24.051 INFO:tasks.workunit.client.1.smithi183.stdout:0/118: sync 2024-02-10T00:00:24.052 INFO:tasks.workunit.client.1.smithi183.stdout:8/197: dwrite d0/f18 [0,4194304] 0 2024-02-10T00:00:24.052 INFO:tasks.workunit.client.1.smithi183.stdout:5/182: truncate d4/f13 479510 0 2024-02-10T00:00:24.053 INFO:tasks.workunit.client.1.smithi183.stdout:9/148: write d0/f1d [3458449,57019] 0 2024-02-10T00:00:24.053 INFO:tasks.workunit.client.1.smithi183.stdout:1/134: dwrite d0/d3/d7/d24/f25 [0,4194304] 0 2024-02-10T00:00:24.058 INFO:tasks.workunit.client.1.smithi183.stdout:3/120: creat d7/db/f24 x:0 0 0 2024-02-10T00:00:24.061 INFO:tasks.workunit.client.1.smithi183.stdout:8/198: creat d0/d3f/f43 x:0 0 0 2024-02-10T00:00:24.062 INFO:tasks.workunit.client.1.smithi183.stdout:8/199: dread - d0/d27/f3a zero size 2024-02-10T00:00:24.062 INFO:tasks.workunit.client.1.smithi183.stdout:5/183: creat d4/d23/f3b x:0 0 0 2024-02-10T00:00:24.063 INFO:tasks.workunit.client.1.smithi183.stdout:1/135: creat d0/d3/d7/f32 x:0 0 0 2024-02-10T00:00:24.064 INFO:tasks.workunit.client.1.smithi183.stdout:9/149: symlink d0/d3/d14/l28 0 2024-02-10T00:00:24.067 INFO:tasks.workunit.client.1.smithi183.stdout:4/131: creat de/d22/f25 x:0 0 0 2024-02-10T00:00:24.068 INFO:tasks.workunit.client.1.smithi183.stdout:9/150: dread d0/d3/f24 [0,4194304] 0 2024-02-10T00:00:24.068 INFO:tasks.workunit.client.1.smithi183.stdout:3/121: mknod d7/d19/d1c/c25 0 2024-02-10T00:00:24.070 INFO:tasks.workunit.client.1.smithi183.stdout:8/200: creat d0/d27/f44 x:0 0 0 2024-02-10T00:00:24.072 INFO:tasks.workunit.client.1.smithi183.stdout:2/213: link d2/f15 d2/da/d20/d21/d43/f45 0 2024-02-10T00:00:24.072 INFO:tasks.workunit.client.1.smithi183.stdout:4/132: creat de/d19/d20/f26 x:0 0 0 2024-02-10T00:00:24.073 INFO:tasks.workunit.client.1.smithi183.stdout:3/122: symlink d7/d19/l26 0 2024-02-10T00:00:24.074 INFO:tasks.workunit.client.1.smithi183.stdout:9/151: creat d0/d3/f29 x:0 0 0 2024-02-10T00:00:24.074 INFO:tasks.workunit.client.1.smithi183.stdout:3/123: fdatasync d7/db/f24 0 2024-02-10T00:00:24.076 INFO:tasks.workunit.client.1.smithi183.stdout:6/120: rename d2/ld to d2/l28 0 2024-02-10T00:00:24.078 INFO:tasks.workunit.client.1.smithi183.stdout:4/133: rename de/d18 to de/d14/d27 0 2024-02-10T00:00:24.079 INFO:tasks.workunit.client.1.smithi183.stdout:1/136: dread d0/d3/fa [0,4194304] 0 2024-02-10T00:00:24.079 INFO:tasks.workunit.client.1.smithi183.stdout:8/201: mkdir d0/d45 0 2024-02-10T00:00:24.079 INFO:tasks.workunit.client.1.smithi183.stdout:5/184: fdatasync d4/f13 0 2024-02-10T00:00:24.080 INFO:tasks.workunit.client.1.smithi183.stdout:8/202: readlink d0/d10/l25 0 2024-02-10T00:00:24.081 INFO:tasks.workunit.client.1.smithi183.stdout:4/134: write f0 [2496168,45978] 0 2024-02-10T00:00:24.083 INFO:tasks.workunit.client.1.smithi183.stdout:6/121: rename d2/d1a/d27 to d2/d26/d29 0 2024-02-10T00:00:24.083 INFO:tasks.workunit.client.1.smithi183.stdout:9/152: dwrite d0/f1d [0,4194304] 0 2024-02-10T00:00:24.083 INFO:tasks.workunit.client.1.smithi183.stdout:4/135: readlink lc 0 2024-02-10T00:00:24.083 INFO:tasks.workunit.client.1.smithi183.stdout:1/137: read d0/d3/d7/f19 [112428,15895] 0 2024-02-10T00:00:24.083 INFO:tasks.workunit.client.1.smithi183.stdout:5/185: chown d4/d23/c2c 3422989 1 2024-02-10T00:00:24.084 INFO:tasks.workunit.client.1.smithi183.stdout:3/124: dwrite d7/fe [4194304,4194304] 0 2024-02-10T00:00:24.085 INFO:tasks.workunit.client.1.smithi183.stdout:6/122: chown d2/d26/d29 1956 1 2024-02-10T00:00:24.086 INFO:tasks.workunit.client.1.smithi183.stdout:8/203: write d0/d23/f37 [533211,24266] 0 2024-02-10T00:00:24.086 INFO:tasks.workunit.client.1.smithi183.stdout:9/153: rename d0 to d0/d3/d14/d2a 22 2024-02-10T00:00:24.087 INFO:tasks.workunit.client.1.smithi183.stdout:4/136: write de/d22/f25 [219241,98231] 0 2024-02-10T00:00:24.092 INFO:tasks.workunit.client.1.smithi183.stdout:3/125: dread f6 [0,4194304] 0 2024-02-10T00:00:24.092 INFO:tasks.workunit.client.1.smithi183.stdout:0/119: dread ff [0,4194304] 0 2024-02-10T00:00:24.093 INFO:tasks.workunit.client.1.smithi183.stdout:8/204: dread d0/f1b [0,4194304] 0 2024-02-10T00:00:24.093 INFO:tasks.workunit.client.1.smithi183.stdout:9/154: dread d0/d10/f1b [4194304,4194304] 0 2024-02-10T00:00:24.094 INFO:tasks.workunit.client.1.smithi183.stdout:0/120: read - d14/f28 zero size 2024-02-10T00:00:24.094 INFO:tasks.workunit.client.1.smithi183.stdout:8/205: fsync d0/d3f/f43 0 2024-02-10T00:00:24.095 INFO:tasks.workunit.client.1.smithi183.stdout:8/206: fdatasync d0/d27/f3a 0 2024-02-10T00:00:24.097 INFO:tasks.workunit.client.1.smithi183.stdout:6/123: mknod d2/d26/d29/c2a 0 2024-02-10T00:00:24.098 INFO:tasks.workunit.client.1.smithi183.stdout:4/137: creat de/d22/f28 x:0 0 0 2024-02-10T00:00:24.100 INFO:tasks.workunit.client.1.smithi183.stdout:8/207: dwrite d0/d23/d2d/d24/f28 [0,4194304] 0 2024-02-10T00:00:24.104 INFO:tasks.workunit.client.1.smithi183.stdout:8/208: stat d0/d23/d2d/d24/f32 0 2024-02-10T00:00:24.104 INFO:tasks.workunit.client.1.smithi183.stdout:3/126: creat d7/d19/d1c/f27 x:0 0 0 2024-02-10T00:00:24.104 INFO:tasks.workunit.client.1.smithi183.stdout:0/121: mkdir d14/d1d/d2d/d31 0 2024-02-10T00:00:24.107 INFO:tasks.workunit.client.1.smithi183.stdout:0/122: dwrite d14/f20 [4194304,4194304] 0 2024-02-10T00:00:24.107 INFO:tasks.workunit.client.1.smithi183.stdout:4/138: mknod de/d14/c29 0 2024-02-10T00:00:24.108 INFO:tasks.workunit.client.1.smithi183.stdout:3/127: symlink d7/l28 0 2024-02-10T00:00:24.110 INFO:tasks.workunit.client.1.smithi183.stdout:1/138: link d0/d3/l26 d0/d3/d7/d24/l33 0 2024-02-10T00:00:24.112 INFO:tasks.workunit.client.1.smithi183.stdout:6/124: rename d2/l8 to d2/d1a/l2b 0 2024-02-10T00:00:24.113 INFO:tasks.workunit.client.1.smithi183.stdout:0/123: readlink l13 0 2024-02-10T00:00:24.113 INFO:tasks.workunit.client.1.smithi183.stdout:0/124: fdatasync d14/f28 0 2024-02-10T00:00:24.115 INFO:tasks.workunit.client.1.smithi183.stdout:1/139: rmdir d0/d3/d29 39 2024-02-10T00:00:24.117 INFO:tasks.workunit.client.1.smithi183.stdout:6/125: write d2/f16 [434715,277] 0 2024-02-10T00:00:24.118 INFO:tasks.workunit.client.1.smithi183.stdout:8/209: rename d0/d10/d41 to d0/d45/d46 0 2024-02-10T00:00:24.118 INFO:tasks.workunit.client.1.smithi183.stdout:7/125: sync 2024-02-10T00:00:24.119 INFO:tasks.workunit.client.1.smithi183.stdout:0/125: creat d14/d1d/f32 x:0 0 0 2024-02-10T00:00:24.119 INFO:tasks.workunit.client.1.smithi183.stdout:9/155: link d0/d3/f24 d0/f2b 0 2024-02-10T00:00:24.121 INFO:tasks.workunit.client.1.smithi183.stdout:1/140: dwrite d0/d3/d7/f2b [0,4194304] 0 2024-02-10T00:00:24.123 INFO:tasks.workunit.client.1.smithi183.stdout:9/156: creat d0/d10/f2c x:0 0 0 2024-02-10T00:00:24.124 INFO:tasks.workunit.client.1.smithi183.stdout:6/126: creat d2/d1a/d25/f2c x:0 0 0 2024-02-10T00:00:24.125 INFO:tasks.workunit.client.1.smithi183.stdout:8/210: dwrite d0/d23/f37 [0,4194304] 0 2024-02-10T00:00:24.126 INFO:tasks.workunit.client.1.smithi183.stdout:8/211: readlink d0/d10/l16 0 2024-02-10T00:00:24.128 INFO:tasks.workunit.client.1.smithi183.stdout:6/127: chown d2/f1e 1 1 2024-02-10T00:00:24.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/141: symlink d0/d3/d29/d1f/l34 0 2024-02-10T00:00:24.139 INFO:tasks.workunit.client.1.smithi183.stdout:0/126: link d14/d1d/l23 d14/d1d/l33 0 2024-02-10T00:00:24.141 INFO:tasks.workunit.client.1.smithi183.stdout:4/139: truncate de/f1f 5237851 0 2024-02-10T00:00:24.142 INFO:tasks.workunit.client.1.smithi183.stdout:7/126: getdents d0/d2/d4/d8 0 2024-02-10T00:00:24.142 INFO:tasks.workunit.client.1.smithi183.stdout:4/140: write de/d22/f28 [600486,97354] 0 2024-02-10T00:00:24.144 INFO:tasks.workunit.client.1.smithi183.stdout:1/142: creat d0/d3/d29/d1f/f35 x:0 0 0 2024-02-10T00:00:24.149 INFO:tasks.workunit.client.1.smithi183.stdout:4/141: mknod de/d19/d20/c2a 0 2024-02-10T00:00:24.149 INFO:tasks.workunit.client.1.smithi183.stdout:4/142: chown de/d14/d27/f1b 387 1 2024-02-10T00:00:24.150 INFO:tasks.workunit.client.1.smithi183.stdout:9/157: truncate d0/d3/d14/d1c/f1f 740817 0 2024-02-10T00:00:24.150 INFO:tasks.workunit.client.1.smithi183.stdout:9/158: chown d0/d10/c21 31973974 1 2024-02-10T00:00:24.151 INFO:tasks.workunit.client.1.smithi183.stdout:6/128: truncate d2/f24 496409 0 2024-02-10T00:00:24.153 INFO:tasks.workunit.client.1.smithi183.stdout:1/143: rename d0/d3/d7/d24 to d0/d3/d7/d36 0 2024-02-10T00:00:24.154 INFO:tasks.workunit.client.1.smithi183.stdout:1/144: chown d0/d3/l6 30 1 2024-02-10T00:00:24.155 INFO:tasks.workunit.client.1.smithi183.stdout:9/159: dwrite d0/d10/f1b [4194304,4194304] 0 2024-02-10T00:00:24.155 INFO:tasks.workunit.client.1.smithi183.stdout:4/143: truncate fb 3775020 0 2024-02-10T00:00:24.157 INFO:tasks.workunit.client.1.smithi183.stdout:9/160: write d0/d3/f29 [318127,96486] 0 2024-02-10T00:00:24.157 INFO:tasks.workunit.client.1.smithi183.stdout:9/161: chown d0/d3/l7 14 1 2024-02-10T00:00:24.159 INFO:tasks.workunit.client.1.smithi183.stdout:0/127: write fb [3776830,12508] 0 2024-02-10T00:00:24.163 INFO:tasks.workunit.client.1.smithi183.stdout:1/145: creat d0/d3/d29/f37 x:0 0 0 2024-02-10T00:00:24.163 INFO:tasks.workunit.client.1.smithi183.stdout:1/146: read d0/f1c [2976013,88060] 0 2024-02-10T00:00:24.164 INFO:tasks.workunit.client.1.smithi183.stdout:4/144: creat de/d19/d1c/f2b x:0 0 0 2024-02-10T00:00:24.165 INFO:tasks.workunit.client.1.smithi183.stdout:9/162: rmdir d0/d10 39 2024-02-10T00:00:24.166 INFO:tasks.workunit.client.1.smithi183.stdout:9/163: read d0/d3/d14/f20 [3951392,103026] 0 2024-02-10T00:00:24.167 INFO:tasks.workunit.client.1.smithi183.stdout:7/127: truncate d0/d2/d3/f20 345761 0 2024-02-10T00:00:24.168 INFO:tasks.workunit.client.1.smithi183.stdout:2/214: sync 2024-02-10T00:00:24.168 INFO:tasks.workunit.client.1.smithi183.stdout:7/128: chown d0/d11/l1f 43 1 2024-02-10T00:00:24.170 INFO:tasks.workunit.client.1.smithi183.stdout:1/147: mkdir d0/d3/d29/d38 0 2024-02-10T00:00:24.173 INFO:tasks.workunit.client.1.smithi183.stdout:3/128: link d7/d19/l1a d7/l29 0 2024-02-10T00:00:24.173 INFO:tasks.workunit.client.1.smithi183.stdout:7/129: dwrite d0/d2/d4/d8/f1d [0,4194304] 0 2024-02-10T00:00:24.174 INFO:tasks.workunit.client.1.smithi183.stdout:2/215: symlink d2/da/d20/d21/l46 0 2024-02-10T00:00:24.175 INFO:tasks.workunit.client.1.smithi183.stdout:7/130: write d0/d2/d4/d8/f1d [1087801,104139] 0 2024-02-10T00:00:24.180 INFO:tasks.workunit.client.1.smithi183.stdout:4/145: stat fb 0 2024-02-10T00:00:24.183 INFO:tasks.workunit.client.1.smithi183.stdout:9/164: write d0/d10/f1b [6371750,25702] 0 2024-02-10T00:00:24.183 INFO:tasks.workunit.client.1.smithi183.stdout:3/129: chown d7/f20 70411 1 2024-02-10T00:00:24.184 INFO:tasks.workunit.client.1.smithi183.stdout:0/128: dread fb [0,4194304] 0 2024-02-10T00:00:24.184 INFO:tasks.workunit.client.1.smithi183.stdout:7/131: fdatasync d0/d2/d4/f5 0 2024-02-10T00:00:24.185 INFO:tasks.workunit.client.1.smithi183.stdout:0/129: chown d14/f20 1775080 1 2024-02-10T00:00:24.185 INFO:tasks.workunit.client.1.smithi183.stdout:6/129: truncate d2/f24 1171333 0 2024-02-10T00:00:24.186 INFO:tasks.workunit.client.1.smithi183.stdout:6/130: rename d2/d26 to d2/d26/d2d 22 2024-02-10T00:00:24.187 INFO:tasks.workunit.client.1.smithi183.stdout:2/216: creat d2/da/d19/d31/f47 x:0 0 0 2024-02-10T00:00:24.189 INFO:tasks.workunit.client.1.smithi183.stdout:7/132: symlink d0/d11/l27 0 2024-02-10T00:00:24.190 INFO:tasks.workunit.client.1.smithi183.stdout:7/133: read d0/d2/d4/d8/f13 [1942794,20953] 0 2024-02-10T00:00:24.191 INFO:tasks.workunit.client.1.smithi183.stdout:0/130: symlink d14/d1d/d2c/l34 0 2024-02-10T00:00:24.193 INFO:tasks.workunit.client.1.smithi183.stdout:9/165: truncate d0/f12 953556 0 2024-02-10T00:00:24.194 INFO:tasks.workunit.client.1.smithi183.stdout:5/186: sync 2024-02-10T00:00:24.196 INFO:tasks.workunit.client.1.smithi183.stdout:1/148: link d0/d3/d7/l10 d0/l39 0 2024-02-10T00:00:24.197 INFO:tasks.workunit.client.1.smithi183.stdout:0/131: creat d14/d1d/d2c/d1a/d22/f35 x:0 0 0 2024-02-10T00:00:24.198 INFO:tasks.workunit.client.1.smithi183.stdout:1/149: dread - d0/d3/f21 zero size 2024-02-10T00:00:24.198 INFO:tasks.workunit.client.1.smithi183.stdout:7/134: dread d0/d11/f1c [0,4194304] 0 2024-02-10T00:00:24.198 INFO:tasks.workunit.client.1.smithi183.stdout:4/146: dwrite de/f1f [0,4194304] 0 2024-02-10T00:00:24.199 INFO:tasks.workunit.client.1.smithi183.stdout:6/131: rename d2/f14 to d2/d26/f2e 0 2024-02-10T00:00:24.200 INFO:tasks.workunit.client.1.smithi183.stdout:9/166: mkdir d0/d3/d14/d1c/d2d 0 2024-02-10T00:00:24.201 INFO:tasks.workunit.client.1.smithi183.stdout:1/150: dread - d0/d3/d29/d1f/f35 zero size 2024-02-10T00:00:24.203 INFO:tasks.workunit.client.1.smithi183.stdout:4/147: creat de/f2c x:0 0 0 2024-02-10T00:00:24.203 INFO:tasks.workunit.client.1.smithi183.stdout:2/217: truncate d2/da/d19/d31/f47 333755 0 2024-02-10T00:00:24.204 INFO:tasks.workunit.client.1.smithi183.stdout:4/148: chown de/l1e 158303030 1 2024-02-10T00:00:24.205 INFO:tasks.workunit.client.1.smithi183.stdout:4/149: write f0 [1843530,87111] 0 2024-02-10T00:00:24.205 INFO:tasks.workunit.client.1.smithi183.stdout:0/132: dwrite d14/d1d/d2c/f25 [0,4194304] 0 2024-02-10T00:00:24.206 INFO:tasks.workunit.client.1.smithi183.stdout:7/135: creat d0/d2/d3/f28 x:0 0 0 2024-02-10T00:00:24.207 INFO:tasks.workunit.client.1.smithi183.stdout:0/133: read - f6 zero size 2024-02-10T00:00:24.210 INFO:tasks.workunit.client.1.smithi183.stdout:3/130: rename d7/d19 to d7/db/d2a 0 2024-02-10T00:00:24.210 INFO:tasks.workunit.client.1.smithi183.stdout:6/132: rename d2/d1a/d25 to d2/d1a/d25/d2f 22 2024-02-10T00:00:24.210 INFO:tasks.workunit.client.1.smithi183.stdout:0/134: dread fb [0,4194304] 0 2024-02-10T00:00:24.212 INFO:tasks.workunit.client.1.smithi183.stdout:0/135: write d14/d1d/d2c/d1a/d22/f35 [466781,129260] 0 2024-02-10T00:00:24.212 INFO:tasks.workunit.client.1.smithi183.stdout:1/151: mkdir d0/d3a 0 2024-02-10T00:00:24.214 INFO:tasks.workunit.client.1.smithi183.stdout:9/167: creat d0/f2e x:0 0 0 2024-02-10T00:00:24.215 INFO:tasks.workunit.client.1.smithi183.stdout:9/168: stat d0/d10/f1b 0 2024-02-10T00:00:24.216 INFO:tasks.workunit.client.1.smithi183.stdout:0/136: dread d14/f20 [0,4194304] 0 2024-02-10T00:00:24.216 INFO:tasks.workunit.client.1.smithi183.stdout:9/169: chown d0/d3/d14/d1c/d2d 23695 1 2024-02-10T00:00:24.216 INFO:tasks.workunit.client.1.smithi183.stdout:9/170: write d0/f2e [216937,87292] 0 2024-02-10T00:00:24.218 INFO:tasks.workunit.client.1.smithi183.stdout:1/152: rmdir d0/d3/d7/d2c 39 2024-02-10T00:00:24.227 INFO:tasks.workunit.client.1.smithi183.stdout:8/212: sync 2024-02-10T00:00:24.227 INFO:tasks.workunit.client.1.smithi183.stdout:5/187: truncate d4/f6 6918 0 2024-02-10T00:00:24.227 INFO:tasks.workunit.client.1.smithi183.stdout:4/150: link de/d14/d27/c1a de/d19/d1c/c2d 0 2024-02-10T00:00:24.228 INFO:tasks.workunit.client.1.smithi183.stdout:8/213: chown d0/d23/d2d/d24/f28 223559 1 2024-02-10T00:00:24.233 INFO:tasks.workunit.client.1.smithi183.stdout:2/218: dwrite d2/da/d20/d21/f23 [0,4194304] 0 2024-02-10T00:00:24.233 INFO:tasks.workunit.client.1.smithi183.stdout:7/136: rename d0/d2/d3/cc to d0/d2/c29 0 2024-02-10T00:00:24.234 INFO:tasks.workunit.client.1.smithi183.stdout:6/133: creat d2/f30 x:0 0 0 2024-02-10T00:00:24.234 INFO:tasks.workunit.client.1.smithi183.stdout:0/137: mknod d14/d1d/d2d/d31/c36 0 2024-02-10T00:00:24.234 INFO:tasks.workunit.client.1.smithi183.stdout:5/188: symlink d4/d11/l3c 0 2024-02-10T00:00:24.235 INFO:tasks.workunit.client.1.smithi183.stdout:3/131: truncate d7/db/f17 8703418 0 2024-02-10T00:00:24.236 INFO:tasks.workunit.client.1.smithi183.stdout:4/151: mkdir de/d14/d27/d2e 0 2024-02-10T00:00:24.237 INFO:tasks.workunit.client.1.smithi183.stdout:1/153: write d0/d3/d7/f19 [72825,59296] 0 2024-02-10T00:00:24.242 INFO:tasks.workunit.client.1.smithi183.stdout:1/154: fsync d0/f17 0 2024-02-10T00:00:24.242 INFO:tasks.workunit.client.1.smithi183.stdout:8/214: dread d0/f1b [0,4194304] 0 2024-02-10T00:00:24.242 INFO:tasks.workunit.client.1.smithi183.stdout:2/219: mknod d2/da/d20/d21/c48 0 2024-02-10T00:00:24.242 INFO:tasks.workunit.client.1.smithi183.stdout:6/134: readlink d2/l28 0 2024-02-10T00:00:24.242 INFO:tasks.workunit.client.1.smithi183.stdout:2/220: readlink d2/d2c/d2f/l30 0 2024-02-10T00:00:24.243 INFO:tasks.workunit.client.1.smithi183.stdout:0/138: unlink ff 0 2024-02-10T00:00:24.243 INFO:tasks.workunit.client.1.smithi183.stdout:2/221: write d2/da/d20/d21/f23 [492279,54164] 0 2024-02-10T00:00:24.247 INFO:tasks.workunit.client.1.smithi183.stdout:3/132: creat d7/db/d2a/f2b x:0 0 0 2024-02-10T00:00:24.248 INFO:tasks.workunit.client.1.smithi183.stdout:9/171: creat d0/f2f x:0 0 0 2024-02-10T00:00:24.249 INFO:tasks.workunit.client.1.smithi183.stdout:7/137: dwrite d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:24.251 INFO:tasks.workunit.client.1.smithi183.stdout:7/138: chown d0/d11/c16 7576 1 2024-02-10T00:00:24.251 INFO:tasks.workunit.client.1.smithi183.stdout:1/155: rename d0/d3/d7/f18 to d0/d3/d29/d38/f3b 0 2024-02-10T00:00:24.252 INFO:tasks.workunit.client.1.smithi183.stdout:6/135: mkdir d2/d26/d29/d31 0 2024-02-10T00:00:24.253 INFO:tasks.workunit.client.1.smithi183.stdout:3/133: dwrite f5 [0,4194304] 0 2024-02-10T00:00:24.253 INFO:tasks.workunit.client.1.smithi183.stdout:5/189: symlink d4/d1d/d27/d37/l3d 0 2024-02-10T00:00:24.254 INFO:tasks.workunit.client.1.smithi183.stdout:4/152: mkdir de/d14/d1d/d2f 0 2024-02-10T00:00:24.255 INFO:tasks.workunit.client.1.smithi183.stdout:1/156: fsync d0/d3/d29/d1f/f35 0 2024-02-10T00:00:24.258 INFO:tasks.workunit.client.1.smithi183.stdout:7/139: dwrite d0/d2/f1a [0,4194304] 0 2024-02-10T00:00:24.260 INFO:tasks.workunit.client.1.smithi183.stdout:5/190: dwrite d4/dd/f25 [0,4194304] 0 2024-02-10T00:00:24.263 INFO:tasks.workunit.client.1.smithi183.stdout:2/222: symlink d2/d2c/l49 0 2024-02-10T00:00:24.264 INFO:tasks.workunit.client.1.smithi183.stdout:2/223: dread - d2/f3a zero size 2024-02-10T00:00:24.266 INFO:tasks.workunit.client.1.smithi183.stdout:7/140: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:24.267 INFO:tasks.workunit.client.1.smithi183.stdout:9/172: mkdir d0/d30 0 2024-02-10T00:00:24.267 INFO:tasks.workunit.client.1.smithi183.stdout:5/191: mkdir d4/d23/d3e 0 2024-02-10T00:00:24.268 INFO:tasks.workunit.client.1.smithi183.stdout:0/139: truncate d14/d1d/f2b 212222 0 2024-02-10T00:00:24.269 INFO:tasks.workunit.client.1.smithi183.stdout:6/136: mkdir d2/d32 0 2024-02-10T00:00:24.269 INFO:tasks.workunit.client.1.smithi183.stdout:6/137: write d2/d1a/d25/f2c [491411,50137] 0 2024-02-10T00:00:24.270 INFO:tasks.workunit.client.1.smithi183.stdout:1/157: mkdir d0/d3c 0 2024-02-10T00:00:24.272 INFO:tasks.workunit.client.1.smithi183.stdout:7/141: symlink d0/d2/d4/l2a 0 2024-02-10T00:00:24.273 INFO:tasks.workunit.client.1.smithi183.stdout:7/142: read d0/d2/d3/f20 [224485,3580] 0 2024-02-10T00:00:24.274 INFO:tasks.workunit.client.1.smithi183.stdout:5/192: rename d4/dd/f10 to d4/d1d/f3f 0 2024-02-10T00:00:24.287 INFO:tasks.workunit.client.1.smithi183.stdout:1/158: mkdir d0/d3/d7/d3d 0 2024-02-10T00:00:24.288 INFO:tasks.workunit.client.1.smithi183.stdout:7/143: fsync d0/f1 0 2024-02-10T00:00:24.288 INFO:tasks.workunit.client.1.smithi183.stdout:5/193: unlink d4/d11/f29 0 2024-02-10T00:00:24.288 INFO:tasks.workunit.client.1.smithi183.stdout:2/224: creat d2/f4a x:0 0 0 2024-02-10T00:00:24.289 INFO:tasks.workunit.client.1.smithi183.stdout:2/225: fdatasync d2/f3a 0 2024-02-10T00:00:24.292 INFO:tasks.workunit.client.1.smithi183.stdout:9/173: link d0/c17 d0/d30/c31 0 2024-02-10T00:00:24.292 INFO:tasks.workunit.client.1.smithi183.stdout:1/159: dread d0/d3/ff [0,4194304] 0 2024-02-10T00:00:24.293 INFO:tasks.workunit.client.1.smithi183.stdout:5/194: dread d4/d23/f21 [0,4194304] 0 2024-02-10T00:00:24.293 INFO:tasks.workunit.client.1.smithi183.stdout:5/195: read f1 [3485954,105268] 0 2024-02-10T00:00:24.294 INFO:tasks.workunit.client.1.smithi183.stdout:8/215: truncate d0/d27/d36/f40 810750 0 2024-02-10T00:00:24.294 INFO:tasks.workunit.client.1.smithi183.stdout:1/160: write d0/d3/d29/d1f/f35 [933012,49535] 0 2024-02-10T00:00:24.294 INFO:tasks.workunit.client.1.smithi183.stdout:5/196: readlink d4/l3a 0 2024-02-10T00:00:24.298 INFO:tasks.workunit.client.1.smithi183.stdout:2/226: chown d2/d2c/d2d/l32 154 1 2024-02-10T00:00:24.298 INFO:tasks.workunit.client.1.smithi183.stdout:4/153: truncate de/f1f 5808445 0 2024-02-10T00:00:24.300 INFO:tasks.workunit.client.1.smithi183.stdout:2/227: write d2/f3a [369754,12694] 0 2024-02-10T00:00:24.300 INFO:tasks.workunit.client.1.smithi183.stdout:5/197: dwrite d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:24.302 INFO:tasks.workunit.client.1.smithi183.stdout:6/138: truncate d2/d1a/f23 1405760 0 2024-02-10T00:00:24.303 INFO:tasks.workunit.client.1.smithi183.stdout:3/134: dread d7/f8 [0,4194304] 0 2024-02-10T00:00:24.304 INFO:tasks.workunit.client.1.smithi183.stdout:3/135: fsync d7/db/f1b 0 2024-02-10T00:00:24.304 INFO:tasks.workunit.client.1.smithi183.stdout:7/144: write d0/d2/d4/f5 [464766,126946] 0 2024-02-10T00:00:24.305 INFO:tasks.workunit.client.1.smithi183.stdout:3/136: chown f5 1023 1 2024-02-10T00:00:24.306 INFO:tasks.workunit.client.1.smithi183.stdout:1/161: read - d0/d3/d7/d2c/f30 zero size 2024-02-10T00:00:24.307 INFO:tasks.workunit.client.1.smithi183.stdout:4/154: creat de/d19/f30 x:0 0 0 2024-02-10T00:00:24.311 INFO:tasks.workunit.client.1.smithi183.stdout:5/198: creat d4/d23/d2a/f40 x:0 0 0 2024-02-10T00:00:24.311 INFO:tasks.workunit.client.1.smithi183.stdout:5/199: dread d4/fa [0,4194304] 0 2024-02-10T00:00:24.312 INFO:tasks.workunit.client.1.smithi183.stdout:3/137: creat d7/db/d2a/f2c x:0 0 0 2024-02-10T00:00:24.313 INFO:tasks.workunit.client.1.smithi183.stdout:3/138: dread - d7/db/d2a/f2c zero size 2024-02-10T00:00:24.314 INFO:tasks.workunit.client.1.smithi183.stdout:2/228: creat d2/da/d20/d21/d36/f4b x:0 0 0 2024-02-10T00:00:24.315 INFO:tasks.workunit.client.1.smithi183.stdout:4/155: creat de/d19/f31 x:0 0 0 2024-02-10T00:00:24.316 INFO:tasks.workunit.client.1.smithi183.stdout:9/174: creat d0/f32 x:0 0 0 2024-02-10T00:00:24.317 INFO:tasks.workunit.client.1.smithi183.stdout:6/139: chown d2/d1a/f23 173952 1 2024-02-10T00:00:24.319 INFO:tasks.workunit.client.1.smithi183.stdout:0/140: sync 2024-02-10T00:00:24.320 INFO:tasks.workunit.client.1.smithi183.stdout:8/216: truncate d0/d23/d2d/d24/f28 3526223 0 2024-02-10T00:00:24.322 INFO:tasks.workunit.client.1.smithi183.stdout:1/162: symlink d0/l3e 0 2024-02-10T00:00:24.323 INFO:tasks.workunit.client.1.smithi183.stdout:2/229: unlink d2/l1c 0 2024-02-10T00:00:24.326 INFO:tasks.workunit.client.1.smithi183.stdout:7/145: truncate d0/d2/f17 4053863 0 2024-02-10T00:00:24.327 INFO:tasks.workunit.client.1.smithi183.stdout:7/146: write d0/d2/d4/d8/f13 [501778,68952] 0 2024-02-10T00:00:24.329 INFO:tasks.workunit.client.1.smithi183.stdout:5/200: mknod d4/c41 0 2024-02-10T00:00:24.330 INFO:tasks.workunit.client.1.smithi183.stdout:7/147: dread d0/f1 [0,4194304] 0 2024-02-10T00:00:24.332 INFO:tasks.workunit.client.1.smithi183.stdout:0/141: read f3 [1476049,77084] 0 2024-02-10T00:00:24.332 INFO:tasks.workunit.client.1.smithi183.stdout:6/140: mknod d2/c33 0 2024-02-10T00:00:24.332 INFO:tasks.workunit.client.1.smithi183.stdout:7/148: chown d0/d2/d3/f20 1851 1 2024-02-10T00:00:24.333 INFO:tasks.workunit.client.1.smithi183.stdout:4/156: dwrite de/d19/d1c/f24 [0,4194304] 0 2024-02-10T00:00:24.334 INFO:tasks.workunit.client.1.smithi183.stdout:5/201: unlink d4/d23/c2c 0 2024-02-10T00:00:24.335 INFO:tasks.workunit.client.1.smithi183.stdout:6/141: write d2/d1a/d25/f2c [1046927,1151] 0 2024-02-10T00:00:24.335 INFO:tasks.workunit.client.1.smithi183.stdout:9/175: dread d0/d3/f24 [0,4194304] 0 2024-02-10T00:00:24.335 INFO:tasks.workunit.client.1.smithi183.stdout:5/202: stat d4/d23/d3e 0 2024-02-10T00:00:24.336 INFO:tasks.workunit.client.1.smithi183.stdout:2/230: symlink d2/l4c 0 2024-02-10T00:00:24.337 INFO:tasks.workunit.client.1.smithi183.stdout:8/217: truncate d0/d27/f44 485982 0 2024-02-10T00:00:24.338 INFO:tasks.workunit.client.1.smithi183.stdout:3/139: getdents d7/db/d2a/d1c 0 2024-02-10T00:00:24.340 INFO:tasks.workunit.client.1.smithi183.stdout:6/142: mkdir d2/d26/d34 0 2024-02-10T00:00:24.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/218: chown d0/d23/d2d/f21 1 1 2024-02-10T00:00:24.341 INFO:tasks.workunit.client.1.smithi183.stdout:1/163: getdents d0/d3/d29 0 2024-02-10T00:00:24.342 INFO:tasks.workunit.client.1.smithi183.stdout:2/231: read d2/da/d20/d21/f29 [337898,100767] 0 2024-02-10T00:00:24.346 INFO:tasks.workunit.client.1.smithi183.stdout:7/149: dwrite d0/d2/f26 [0,4194304] 0 2024-02-10T00:00:24.347 INFO:tasks.workunit.client.1.smithi183.stdout:3/140: mkdir d7/db/d2a/d2d 0 2024-02-10T00:00:24.349 INFO:tasks.workunit.client.1.smithi183.stdout:4/157: dwrite de/d19/d1c/f2b [0,4194304] 0 2024-02-10T00:00:24.350 INFO:tasks.workunit.client.1.smithi183.stdout:0/142: dread d14/f20 [4194304,4194304] 0 2024-02-10T00:00:24.352 INFO:tasks.workunit.client.1.smithi183.stdout:9/176: dread d0/f2b [0,4194304] 0 2024-02-10T00:00:24.353 INFO:tasks.workunit.client.1.smithi183.stdout:5/203: dread d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:24.353 INFO:tasks.workunit.client.1.smithi183.stdout:0/143: chown l11 299341 1 2024-02-10T00:00:24.356 INFO:tasks.workunit.client.1.smithi183.stdout:1/164: rename d0/l39 to d0/d3a/l3f 0 2024-02-10T00:00:24.356 INFO:tasks.workunit.client.1.smithi183.stdout:8/219: dread d0/d27/d36/f40 [0,4194304] 0 2024-02-10T00:00:24.356 INFO:tasks.workunit.client.1.smithi183.stdout:6/143: dwrite d2/f30 [0,4194304] 0 2024-02-10T00:00:24.357 INFO:tasks.workunit.client.0.smithi164.stderr:++ readlink -f fsstress 2024-02-10T00:00:24.357 INFO:tasks.workunit.client.1.smithi183.stdout:2/232: dread d2/f13 [4194304,4194304] 0 2024-02-10T00:00:24.357 INFO:tasks.workunit.client.1.smithi183.stdout:6/144: stat d2/c33 0 2024-02-10T00:00:24.358 INFO:tasks.workunit.client.0.smithi164.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-10T00:00:24.358 INFO:tasks.workunit.client.0.smithi164.stderr:+ popd 2024-02-10T00:00:24.359 INFO:tasks.workunit.client.1.smithi183.stdout:0/144: fdatasync f3 0 2024-02-10T00:00:24.360 INFO:tasks.workunit.client.0.smithi164.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-10T00:00:24.360 INFO:tasks.workunit.client.0.smithi164.stderr:+ popd 2024-02-10T00:00:24.361 INFO:tasks.workunit.client.0.smithi164.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-10T00:00:24.361 INFO:tasks.workunit.client.0.smithi164.stderr:++ mktemp -d -p . 2024-02-10T00:00:24.366 INFO:tasks.workunit.client.0.smithi164.stderr:+ T=./tmp.IMFJ2Wyv3x 2024-02-10T00:00:24.366 INFO:tasks.workunit.client.0.smithi164.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.IMFJ2Wyv3x -l 1 -n 1000 -p 10 -v 2024-02-10T00:00:24.367 INFO:tasks.workunit.client.1.smithi183.stdout:6/145: mkdir d2/d26/d35 0 2024-02-10T00:00:24.367 INFO:tasks.workunit.client.1.smithi183.stdout:9/177: dwrite d0/f32 [0,4194304] 0 2024-02-10T00:00:24.368 INFO:tasks.workunit.client.1.smithi183.stdout:5/204: write d4/d1d/f3f [615796,73947] 0 2024-02-10T00:00:24.368 INFO:tasks.workunit.client.1.smithi183.stdout:4/158: mknod de/d14/d27/d2e/c32 0 2024-02-10T00:00:24.369 INFO:tasks.workunit.client.1.smithi183.stdout:6/146: stat d2/f16 0 2024-02-10T00:00:24.369 INFO:tasks.workunit.client.0.smithi164.stdout:seed = 1707287065 2024-02-10T00:00:24.370 INFO:tasks.workunit.client.1.smithi183.stdout:7/150: getdents d0/d2 0 2024-02-10T00:00:24.370 INFO:tasks.workunit.client.1.smithi183.stdout:9/178: read d0/d3/f24 [4141009,22342] 0 2024-02-10T00:00:24.371 INFO:tasks.workunit.client.1.smithi183.stdout:2/233: fdatasync d2/da/d20/d21/d43/f45 0 2024-02-10T00:00:24.372 INFO:tasks.workunit.client.1.smithi183.stdout:3/141: link d7/db/d2a/l1a d7/db/d2a/l2e 0 2024-02-10T00:00:24.372 INFO:tasks.workunit.client.1.smithi183.stdout:9/179: read d0/f1d [4091557,34605] 0 2024-02-10T00:00:24.372 INFO:tasks.workunit.client.1.smithi183.stdout:7/151: chown d0/d2/f1a 899461842 1 2024-02-10T00:00:24.373 INFO:tasks.workunit.client.0.smithi164.stdout:0/0: chown . 416743 1 2024-02-10T00:00:24.373 INFO:tasks.workunit.client.0.smithi164.stdout:0/1: fdatasync - no filename 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.1.smithi183.stdout:7/152: chown d0/d2 8 1 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/0: write - no filename 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/1: truncate - no filename 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/2: dread - no filename 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/3: write - no filename 2024-02-10T00:00:24.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/4: fsync - no filename 2024-02-10T00:00:24.375 INFO:tasks.workunit.client.1.smithi183.stdout:6/147: creat d2/d1a/d25/f36 x:0 0 0 2024-02-10T00:00:24.375 INFO:tasks.workunit.client.0.smithi164.stdout:0/2: creat f0 x:0 0 0 2024-02-10T00:00:24.376 INFO:tasks.workunit.client.1.smithi183.stdout:5/205: dread d4/d1d/d27/f2b [0,4194304] 0 2024-02-10T00:00:24.376 INFO:tasks.workunit.client.0.smithi164.stdout:2/0: dwrite - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/1: fsync - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/2: write - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/3: fdatasync - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/4: fsync - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/5: dread - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:2/6: write - no filename 2024-02-10T00:00:24.377 INFO:tasks.workunit.client.0.smithi164.stdout:0/3: creat f1 x:0 0 0 2024-02-10T00:00:24.378 INFO:tasks.workunit.client.1.smithi183.stdout:4/159: dwrite f0 [0,4194304] 0 2024-02-10T00:00:24.378 INFO:tasks.workunit.client.0.smithi164.stdout:1/5: symlink l0 0 2024-02-10T00:00:24.379 INFO:tasks.workunit.client.0.smithi164.stdout:3/0: dwrite - no filename 2024-02-10T00:00:24.380 INFO:tasks.workunit.client.1.smithi183.stdout:3/142: unlink d7/db/d2a/d1c/c25 0 2024-02-10T00:00:24.380 INFO:tasks.workunit.client.1.smithi183.stdout:4/160: dread - de/d19/d20/f23 zero size 2024-02-10T00:00:24.380 INFO:tasks.workunit.client.0.smithi164.stdout:0/4: symlink l2 0 2024-02-10T00:00:24.381 INFO:tasks.workunit.client.0.smithi164.stdout:1/6: mkdir d1 0 2024-02-10T00:00:24.381 INFO:tasks.workunit.client.0.smithi164.stdout:1/7: rename d1 to d1/d2 22 2024-02-10T00:00:24.382 INFO:tasks.workunit.client.0.smithi164.stdout:1/8: chown l0 117166 1 2024-02-10T00:00:24.382 INFO:tasks.workunit.client.0.smithi164.stdout:2/7: creat f0 x:0 0 0 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.0.smithi164.stdout:1/9: rename d1 to d1/d3 22 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.0.smithi164.stdout:1/10: dread - no filename 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.1.smithi183.stdout:9/180: dwrite d0/f1d [0,4194304] 0 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.1.smithi183.stdout:3/143: write d7/db/d2a/f23 [757494,17898] 0 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.1.smithi183.stdout:0/145: link d14/d1d/f2b d14/f37 0 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.1.smithi183.stdout:4/161: write de/d19/f31 [655370,75454] 0 2024-02-10T00:00:24.383 INFO:tasks.workunit.client.1.smithi183.stdout:9/181: stat d0/f2e 0 2024-02-10T00:00:24.384 INFO:tasks.workunit.client.1.smithi183.stdout:7/153: truncate d0/d2/d3/f20 336857 0 2024-02-10T00:00:24.384 INFO:tasks.workunit.client.1.smithi183.stdout:4/162: read - de/d14/d27/f21 zero size 2024-02-10T00:00:24.384 INFO:tasks.workunit.client.0.smithi164.stdout:4/0: dwrite - no filename 2024-02-10T00:00:24.384 INFO:tasks.workunit.client.0.smithi164.stdout:4/1: fsync - no filename 2024-02-10T00:00:24.384 INFO:tasks.workunit.client.0.smithi164.stdout:4/2: chown . 1597 1 2024-02-10T00:00:24.385 INFO:tasks.workunit.client.1.smithi183.stdout:3/144: read d7/f20 [520286,30233] 0 2024-02-10T00:00:24.385 INFO:tasks.workunit.client.1.smithi183.stdout:5/206: symlink d4/d1d/d27/l42 0 2024-02-10T00:00:24.385 INFO:tasks.workunit.client.0.smithi164.stdout:2/8: symlink l1 0 2024-02-10T00:00:24.385 INFO:tasks.workunit.client.0.smithi164.stdout:0/5: creat f3 x:0 0 0 2024-02-10T00:00:24.386 INFO:tasks.workunit.client.0.smithi164.stdout:3/1: mkdir d0 0 2024-02-10T00:00:24.387 INFO:tasks.workunit.client.1.smithi183.stdout:0/146: mknod d14/c38 0 2024-02-10T00:00:24.388 INFO:tasks.workunit.client.1.smithi183.stdout:7/154: creat d0/d2/f2b x:0 0 0 2024-02-10T00:00:24.390 INFO:tasks.workunit.client.1.smithi183.stdout:4/163: mknod de/c33 0 2024-02-10T00:00:24.390 INFO:tasks.workunit.client.1.smithi183.stdout:2/234: getdents d2/d2c/d2d 0 2024-02-10T00:00:24.391 INFO:tasks.workunit.client.0.smithi164.stdout:1/11: creat d1/f4 x:0 0 0 2024-02-10T00:00:24.391 INFO:tasks.workunit.client.0.smithi164.stdout:2/9: creat f2 x:0 0 0 2024-02-10T00:00:24.392 INFO:tasks.workunit.client.0.smithi164.stdout:5/0: chown . 201 1 2024-02-10T00:00:24.392 INFO:tasks.workunit.client.0.smithi164.stdout:5/1: dread - no filename 2024-02-10T00:00:24.392 INFO:tasks.workunit.client.0.smithi164.stdout:2/10: dread - f0 zero size 2024-02-10T00:00:24.393 INFO:tasks.workunit.client.0.smithi164.stdout:4/3: creat f0 x:0 0 0 2024-02-10T00:00:24.394 INFO:tasks.workunit.client.1.smithi183.stdout:8/220: dread d0/f1e [0,4194304] 0 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.1.smithi183.stdout:8/221: stat d0/f2f 0 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/0: dread - no filename 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/1: write - no filename 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/2: chown . 51524 1 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/3: readlink - no filename 2024-02-10T00:00:24.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/4: truncate - no filename 2024-02-10T00:00:24.396 INFO:tasks.workunit.client.1.smithi183.stdout:8/222: read - d0/d10/f1a zero size 2024-02-10T00:00:24.396 INFO:tasks.workunit.client.0.smithi164.stdout:3/2: mkdir d0/d1 0 2024-02-10T00:00:24.399 INFO:tasks.workunit.client.0.smithi164.stdout:2/11: mkdir d3 0 2024-02-10T00:00:24.401 INFO:tasks.workunit.client.0.smithi164.stdout:5/2: creat f0 x:0 0 0 2024-02-10T00:00:24.401 INFO:tasks.workunit.client.1.smithi183.stdout:2/235: unlink d2/da/d20/c26 0 2024-02-10T00:00:24.402 INFO:tasks.workunit.client.0.smithi164.stdout:5/3: stat f0 0 2024-02-10T00:00:24.402 INFO:tasks.workunit.client.0.smithi164.stdout:6/5: mkdir d0 0 2024-02-10T00:00:24.402 INFO:tasks.workunit.client.0.smithi164.stdout:6/6: read - no filename 2024-02-10T00:00:24.402 INFO:tasks.workunit.client.0.smithi164.stdout:6/7: write - no filename 2024-02-10T00:00:24.403 INFO:tasks.workunit.client.0.smithi164.stdout:5/4: stat f0 0 2024-02-10T00:00:24.403 INFO:tasks.workunit.client.0.smithi164.stdout:5/5: readlink - no filename 2024-02-10T00:00:24.403 INFO:tasks.workunit.client.1.smithi183.stdout:1/165: sync 2024-02-10T00:00:24.403 INFO:tasks.workunit.client.0.smithi164.stdout:5/6: read - f0 zero size 2024-02-10T00:00:24.404 INFO:tasks.workunit.client.0.smithi164.stdout:3/3: mkdir d0/d1/d2 0 2024-02-10T00:00:24.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/0: write - no filename 2024-02-10T00:00:24.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/1: dread - no filename 2024-02-10T00:00:24.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/2: chown . 3029829 1 2024-02-10T00:00:24.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/3: dwrite - no filename 2024-02-10T00:00:24.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/4: rename - no filename 2024-02-10T00:00:24.406 INFO:tasks.workunit.client.0.smithi164.stdout:1/12: truncate d1/f4 900902 0 2024-02-10T00:00:24.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/12: dwrite f2 [0,4194304] 0 2024-02-10T00:00:24.406 INFO:tasks.workunit.client.0.smithi164.stdout:4/4: truncate f0 573590 0 2024-02-10T00:00:24.406 INFO:tasks.workunit.client.1.smithi183.stdout:6/148: rmdir d2 39 2024-02-10T00:00:24.407 INFO:tasks.workunit.client.0.smithi164.stdout:2/13: write f2 [3167324,26864] 0 2024-02-10T00:00:24.409 INFO:tasks.workunit.client.0.smithi164.stdout:5/7: creat f1 x:0 0 0 2024-02-10T00:00:24.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/0: truncate - no filename 2024-02-10T00:00:24.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/1: unlink - no file 2024-02-10T00:00:24.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/2: chown . 55629694 1 2024-02-10T00:00:24.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/3: link - no file 2024-02-10T00:00:24.411 INFO:tasks.workunit.client.1.smithi183.stdout:9/182: write d0/f5 [1381566,50310] 0 2024-02-10T00:00:24.412 INFO:tasks.workunit.client.1.smithi183.stdout:8/223: creat d0/d45/d46/f47 x:0 0 0 2024-02-10T00:00:24.412 INFO:tasks.workunit.client.1.smithi183.stdout:4/164: write de/f11 [1787162,26089] 0 2024-02-10T00:00:24.414 INFO:tasks.workunit.client.1.smithi183.stdout:4/165: dread - de/d19/f30 zero size 2024-02-10T00:00:24.415 INFO:tasks.workunit.client.1.smithi183.stdout:5/207: truncate f2 616987 0 2024-02-10T00:00:24.416 INFO:tasks.workunit.client.1.smithi183.stdout:4/166: write de/d19/d20/f23 [974963,127317] 0 2024-02-10T00:00:24.416 INFO:tasks.workunit.client.1.smithi183.stdout:3/145: dwrite d7/db/f17 [0,4194304] 0 2024-02-10T00:00:24.417 INFO:tasks.workunit.client.0.smithi164.stdout:9/4: chown . 96010217 1 2024-02-10T00:00:24.418 INFO:tasks.workunit.client.0.smithi164.stdout:7/0: mknod c0 0 2024-02-10T00:00:24.418 INFO:tasks.workunit.client.0.smithi164.stdout:7/1: write - no filename 2024-02-10T00:00:24.418 INFO:tasks.workunit.client.1.smithi183.stdout:0/147: link d14/d1d/f2b d14/d1d/d2d/f39 0 2024-02-10T00:00:24.419 INFO:tasks.workunit.client.1.smithi183.stdout:1/166: chown d0/d3/d7/d36/l33 7010554 1 2024-02-10T00:00:24.419 INFO:tasks.workunit.client.0.smithi164.stdout:2/14: dwrite f0 [0,4194304] 0 2024-02-10T00:00:24.419 INFO:tasks.workunit.client.1.smithi183.stdout:1/167: readlink d0/d3/l26 0 2024-02-10T00:00:24.422 INFO:tasks.workunit.client.1.smithi183.stdout:8/224: creat d0/d27/d36/f48 x:0 0 0 2024-02-10T00:00:24.423 INFO:tasks.workunit.client.1.smithi183.stdout:0/148: dwrite d14/d1d/d2c/d1a/f27 [0,4194304] 0 2024-02-10T00:00:24.424 INFO:tasks.workunit.client.1.smithi183.stdout:4/167: symlink de/d14/d1d/l34 0 2024-02-10T00:00:24.424 INFO:tasks.workunit.client.0.smithi164.stdout:2/15: dwrite f2 [0,4194304] 0 2024-02-10T00:00:24.425 INFO:tasks.workunit.client.0.smithi164.stdout:0/6: getdents . 0 2024-02-10T00:00:24.425 INFO:tasks.workunit.client.0.smithi164.stdout:0/7: dread - f0 zero size 2024-02-10T00:00:24.426 INFO:tasks.workunit.client.1.smithi183.stdout:1/168: fsync d0/d3/fa 0 2024-02-10T00:00:24.426 INFO:tasks.workunit.client.1.smithi183.stdout:7/155: dread d0/d11/f1c [0,4194304] 0 2024-02-10T00:00:24.426 INFO:tasks.workunit.client.1.smithi183.stdout:9/183: mknod d0/c33 0 2024-02-10T00:00:24.432 INFO:tasks.workunit.client.1.smithi183.stdout:2/236: truncate d2/da/d20/d21/d36/f4b 61274 0 2024-02-10T00:00:24.433 INFO:tasks.workunit.client.1.smithi183.stdout:0/149: creat d14/d1d/d2d/d31/f3a x:0 0 0 2024-02-10T00:00:24.434 INFO:tasks.workunit.client.1.smithi183.stdout:3/146: creat d7/db/d2a/d2d/f2f x:0 0 0 2024-02-10T00:00:24.434 INFO:tasks.workunit.client.0.smithi164.stdout:6/8: creat d0/f1 x:0 0 0 2024-02-10T00:00:24.435 INFO:tasks.workunit.client.0.smithi164.stdout:6/9: read - d0/f1 zero size 2024-02-10T00:00:24.436 INFO:tasks.workunit.client.0.smithi164.stdout:5/8: symlink l2 0 2024-02-10T00:00:24.436 INFO:tasks.workunit.client.1.smithi183.stdout:2/237: dwrite d2/da/f1d [0,4194304] 0 2024-02-10T00:00:24.437 INFO:tasks.workunit.client.1.smithi183.stdout:9/184: symlink d0/d3/d14/d1c/l34 0 2024-02-10T00:00:24.439 INFO:tasks.workunit.client.1.smithi183.stdout:6/149: rename d2/l11 to d2/d26/d34/l37 0 2024-02-10T00:00:24.440 INFO:tasks.workunit.client.0.smithi164.stdout:5/9: dwrite f1 [0,4194304] 0 2024-02-10T00:00:24.445 INFO:tasks.workunit.client.0.smithi164.stdout:5/10: dwrite f0 [0,4194304] 0 2024-02-10T00:00:24.445 INFO:tasks.workunit.client.1.smithi183.stdout:5/208: dwrite d4/f6 [0,4194304] 0 2024-02-10T00:00:24.446 INFO:tasks.workunit.client.1.smithi183.stdout:5/209: chown d4/d11/c22 354 1 2024-02-10T00:00:24.447 INFO:tasks.workunit.client.1.smithi183.stdout:0/150: fsync d14/d1d/f2b 0 2024-02-10T00:00:24.449 INFO:tasks.workunit.client.0.smithi164.stdout:5/11: dwrite f1 [0,4194304] 0 2024-02-10T00:00:24.452 INFO:tasks.workunit.client.1.smithi183.stdout:3/147: chown d7/db/d2a/l1a 9 1 2024-02-10T00:00:24.452 INFO:tasks.workunit.client.1.smithi183.stdout:7/156: readlink d0/d2/d4/l2a 0 2024-02-10T00:00:24.455 INFO:tasks.workunit.client.1.smithi183.stdout:0/151: mknod d14/d1d/d2d/d31/c3b 0 2024-02-10T00:00:24.457 INFO:tasks.workunit.client.1.smithi183.stdout:9/185: symlink d0/l35 0 2024-02-10T00:00:24.457 INFO:tasks.workunit.client.1.smithi183.stdout:7/157: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:24.459 INFO:tasks.workunit.client.1.smithi183.stdout:0/152: dread d14/d1d/d2c/d1a/f27 [0,4194304] 0 2024-02-10T00:00:24.461 INFO:tasks.workunit.client.1.smithi183.stdout:6/150: fsync d2/d1a/f23 0 2024-02-10T00:00:24.464 INFO:tasks.workunit.client.1.smithi183.stdout:7/158: write d0/d2/f1a [4601462,51061] 0 2024-02-10T00:00:24.470 INFO:tasks.workunit.client.1.smithi183.stdout:4/168: sync 2024-02-10T00:00:24.470 INFO:tasks.workunit.client.1.smithi183.stdout:0/153: mkdir d14/d1d/d2c/d3c 0 2024-02-10T00:00:24.470 INFO:tasks.workunit.client.1.smithi183.stdout:5/210: link d4/fa d4/d1d/f43 0 2024-02-10T00:00:24.470 INFO:tasks.workunit.client.1.smithi183.stdout:1/169: rename d0/d3/d7/c11 to d0/c40 0 2024-02-10T00:00:24.477 INFO:tasks.workunit.client.1.smithi183.stdout:7/159: rename d0/l22 to d0/l2c 0 2024-02-10T00:00:24.478 INFO:tasks.workunit.client.1.smithi183.stdout:6/151: mkdir d2/d26/d29/d31/d38 0 2024-02-10T00:00:24.481 INFO:tasks.workunit.client.1.smithi183.stdout:1/170: symlink d0/d3/d29/d38/l41 0 2024-02-10T00:00:24.482 INFO:tasks.workunit.client.1.smithi183.stdout:1/171: fsync d0/d3/d7/f23 0 2024-02-10T00:00:24.482 INFO:tasks.workunit.client.1.smithi183.stdout:0/154: unlink d14/d1d/d2c/d1a/d22/c29 0 2024-02-10T00:00:24.482 INFO:tasks.workunit.client.1.smithi183.stdout:4/169: dread de/f1f [0,4194304] 0 2024-02-10T00:00:24.484 INFO:tasks.workunit.client.1.smithi183.stdout:9/186: link d0/d10/f1b d0/f36 0 2024-02-10T00:00:24.484 INFO:tasks.workunit.client.1.smithi183.stdout:7/160: fdatasync d0/d2/f26 0 2024-02-10T00:00:24.484 INFO:tasks.workunit.client.1.smithi183.stdout:6/152: fdatasync d2/f18 0 2024-02-10T00:00:24.485 INFO:tasks.workunit.client.1.smithi183.stdout:5/211: getdents d4/d23/d3e 0 2024-02-10T00:00:24.486 INFO:tasks.workunit.client.1.smithi183.stdout:4/170: rename l9 to de/d14/d1d/l35 0 2024-02-10T00:00:24.487 INFO:tasks.workunit.client.1.smithi183.stdout:0/155: mknod d14/d1d/d2c/d1a/c3d 0 2024-02-10T00:00:24.489 INFO:tasks.workunit.client.1.smithi183.stdout:1/172: dwrite d0/d3/d29/d38/f3b [4194304,4194304] 0 2024-02-10T00:00:24.489 INFO:tasks.workunit.client.1.smithi183.stdout:7/161: symlink d0/d2/d4/l2d 0 2024-02-10T00:00:24.491 INFO:tasks.workunit.client.1.smithi183.stdout:6/153: symlink d2/d1a/l39 0 2024-02-10T00:00:24.492 INFO:tasks.workunit.client.1.smithi183.stdout:4/171: creat de/d19/d1c/f36 x:0 0 0 2024-02-10T00:00:24.493 INFO:tasks.workunit.client.1.smithi183.stdout:0/156: mkdir d14/d3e 0 2024-02-10T00:00:24.494 INFO:tasks.workunit.client.1.smithi183.stdout:4/172: chown de/d22/f25 92997 1 2024-02-10T00:00:24.494 INFO:tasks.workunit.client.1.smithi183.stdout:0/157: stat d14/d1d/d2c/d3c 0 2024-02-10T00:00:24.494 INFO:tasks.workunit.client.1.smithi183.stdout:0/158: chown l9 3864075 1 2024-02-10T00:00:24.494 INFO:tasks.workunit.client.1.smithi183.stdout:1/173: symlink d0/d3/d29/l42 0 2024-02-10T00:00:24.496 INFO:tasks.workunit.client.1.smithi183.stdout:7/162: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:24.496 INFO:tasks.workunit.client.1.smithi183.stdout:6/154: mkdir d2/d1a/d3a 0 2024-02-10T00:00:24.500 INFO:tasks.workunit.client.1.smithi183.stdout:0/159: mkdir d14/d1d/d2c/d3c/d3f 0 2024-02-10T00:00:24.502 INFO:tasks.workunit.client.1.smithi183.stdout:1/174: dread d0/d3/d29/d38/f3b [0,4194304] 0 2024-02-10T00:00:24.504 INFO:tasks.workunit.client.1.smithi183.stdout:6/155: dwrite d2/f30 [4194304,4194304] 0 2024-02-10T00:00:24.504 INFO:tasks.workunit.client.1.smithi183.stdout:7/163: dwrite d0/d2/f26 [0,4194304] 0 2024-02-10T00:00:24.504 INFO:tasks.workunit.client.1.smithi183.stdout:1/175: dread - d0/d3/f21 zero size 2024-02-10T00:00:24.506 INFO:tasks.workunit.client.1.smithi183.stdout:6/156: chown d2/l12 12 1 2024-02-10T00:00:24.507 INFO:tasks.workunit.client.1.smithi183.stdout:0/160: dread d14/d1d/d2c/d1a/f1b [4194304,4194304] 0 2024-02-10T00:00:24.509 INFO:tasks.workunit.client.1.smithi183.stdout:7/164: dread - d0/d2/d3/f28 zero size 2024-02-10T00:00:24.510 INFO:tasks.workunit.client.1.smithi183.stdout:0/161: creat d14/f40 x:0 0 0 2024-02-10T00:00:24.512 INFO:tasks.workunit.client.1.smithi183.stdout:1/176: rename d0/d3/d7/l10 to d0/d3/d7/d3d/l43 0 2024-02-10T00:00:24.517 INFO:tasks.workunit.client.1.smithi183.stdout:7/165: symlink d0/d11/l2e 0 2024-02-10T00:00:24.517 INFO:tasks.workunit.client.1.smithi183.stdout:0/162: creat d14/d1d/d2c/d1a/d22/f41 x:0 0 0 2024-02-10T00:00:24.517 INFO:tasks.workunit.client.1.smithi183.stdout:0/163: stat d14 0 2024-02-10T00:00:24.518 INFO:tasks.workunit.client.1.smithi183.stdout:7/166: write d0/f21 [289355,60876] 0 2024-02-10T00:00:24.522 INFO:tasks.workunit.client.1.smithi183.stdout:1/177: symlink d0/d3/d29/d1f/l44 0 2024-02-10T00:00:24.522 INFO:tasks.workunit.client.1.smithi183.stdout:7/167: mkdir d0/d11/d2f 0 2024-02-10T00:00:24.523 INFO:tasks.workunit.client.1.smithi183.stdout:1/178: write d0/d3/d7/f19 [104743,29649] 0 2024-02-10T00:00:24.523 INFO:tasks.workunit.client.1.smithi183.stdout:0/164: truncate d14/d1d/d2c/d1a/f1b 4816538 0 2024-02-10T00:00:24.526 INFO:tasks.workunit.client.1.smithi183.stdout:1/179: creat d0/d3c/f45 x:0 0 0 2024-02-10T00:00:24.526 INFO:tasks.workunit.client.1.smithi183.stdout:8/225: write d0/d23/f2a [536052,94535] 0 2024-02-10T00:00:24.527 INFO:tasks.workunit.client.1.smithi183.stdout:8/226: readlink d0/l1c 0 2024-02-10T00:00:24.528 INFO:tasks.workunit.client.1.smithi183.stdout:0/165: rename f7 to d14/d1d/d2c/d3c/d3f/f42 0 2024-02-10T00:00:24.528 INFO:tasks.workunit.client.1.smithi183.stdout:7/168: dwrite d0/d2/f2b [0,4194304] 0 2024-02-10T00:00:24.531 INFO:tasks.workunit.client.1.smithi183.stdout:8/227: dread d0/f1e [0,4194304] 0 2024-02-10T00:00:24.536 INFO:tasks.workunit.client.1.smithi183.stdout:0/166: mkdir d14/d43 0 2024-02-10T00:00:24.538 INFO:tasks.workunit.client.0.smithi164.stdout:5/12: fsync f0 0 2024-02-10T00:00:24.538 INFO:tasks.workunit.client.0.smithi164.stdout:5/13: fdatasync f0 0 2024-02-10T00:00:24.541 INFO:tasks.workunit.client.1.smithi183.stdout:8/228: creat d0/d45/f49 x:0 0 0 2024-02-10T00:00:24.541 INFO:tasks.workunit.client.1.smithi183.stdout:0/167: creat d14/d1d/d2c/d1a/d22/f44 x:0 0 0 2024-02-10T00:00:24.545 INFO:tasks.workunit.client.1.smithi183.stdout:8/229: dwrite d0/d23/f37 [0,4194304] 0 2024-02-10T00:00:24.545 INFO:tasks.workunit.client.1.smithi183.stdout:7/169: dread d0/f21 [0,4194304] 0 2024-02-10T00:00:24.546 INFO:tasks.workunit.client.1.smithi183.stdout:8/230: write d0/fb [1651954,117148] 0 2024-02-10T00:00:24.546 INFO:tasks.workunit.client.1.smithi183.stdout:8/231: stat d0/d10/l16 0 2024-02-10T00:00:24.551 INFO:tasks.workunit.client.1.smithi183.stdout:2/238: truncate d2/f3e 4286572 0 2024-02-10T00:00:24.552 INFO:tasks.workunit.client.1.smithi183.stdout:2/239: stat d2/da/f17 0 2024-02-10T00:00:24.555 INFO:tasks.workunit.client.1.smithi183.stdout:3/148: truncate d7/db/fc 742156 0 2024-02-10T00:00:24.555 INFO:tasks.workunit.client.1.smithi183.stdout:2/240: dread d2/da/d20/d21/f23 [0,4194304] 0 2024-02-10T00:00:24.561 INFO:tasks.workunit.client.1.smithi183.stdout:8/232: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:24.564 INFO:tasks.workunit.client.1.smithi183.stdout:8/233: dwrite d0/d45/f49 [0,4194304] 0 2024-02-10T00:00:24.566 INFO:tasks.workunit.client.1.smithi183.stdout:8/234: write d0/d27/d36/f48 [909242,19617] 0 2024-02-10T00:00:24.567 INFO:tasks.workunit.client.1.smithi183.stdout:8/235: write d0/d45/d46/f47 [914885,61081] 0 2024-02-10T00:00:24.567 INFO:tasks.workunit.client.1.smithi183.stdout:9/187: truncate d0/f1d 1978369 0 2024-02-10T00:00:24.570 INFO:tasks.workunit.client.1.smithi183.stdout:4/173: truncate de/d19/d1c/f2b 566012 0 2024-02-10T00:00:24.571 INFO:tasks.workunit.client.1.smithi183.stdout:4/174: dread - de/d19/d1c/f36 zero size 2024-02-10T00:00:24.571 INFO:tasks.workunit.client.1.smithi183.stdout:6/157: truncate d2/f30 5186949 0 2024-02-10T00:00:24.572 INFO:tasks.workunit.client.1.smithi183.stdout:9/188: dwrite d0/f2f [0,4194304] 0 2024-02-10T00:00:24.572 INFO:tasks.workunit.client.1.smithi183.stdout:0/168: fsync d14/d1d/d2c/d1a/d22/f41 0 2024-02-10T00:00:24.578 INFO:tasks.workunit.client.1.smithi183.stdout:1/180: truncate d0/f17 541562 0 2024-02-10T00:00:24.581 INFO:tasks.workunit.client.1.smithi183.stdout:1/181: dread d0/d3/d7/d2c/f2f [0,4194304] 0 2024-02-10T00:00:24.582 INFO:tasks.workunit.client.1.smithi183.stdout:1/182: chown d0/d3/fa 186 1 2024-02-10T00:00:24.583 INFO:tasks.workunit.client.1.smithi183.stdout:7/170: creat d0/f30 x:0 0 0 2024-02-10T00:00:24.586 INFO:tasks.workunit.client.1.smithi183.stdout:2/241: mknod d2/da/d19/d31/c4d 0 2024-02-10T00:00:24.590 INFO:tasks.workunit.client.1.smithi183.stdout:5/212: write f2 [1102453,92612] 0 2024-02-10T00:00:24.592 INFO:tasks.workunit.client.1.smithi183.stdout:8/236: rmdir d0/d45/d46 39 2024-02-10T00:00:24.595 INFO:tasks.workunit.client.1.smithi183.stdout:4/175: rename fb to de/d14/d27/f37 0 2024-02-10T00:00:24.596 INFO:tasks.workunit.client.1.smithi183.stdout:0/169: symlink d14/d1d/l45 0 2024-02-10T00:00:24.607 INFO:tasks.workunit.client.1.smithi183.stdout:1/183: symlink d0/d3c/l46 0 2024-02-10T00:00:24.607 INFO:tasks.workunit.client.1.smithi183.stdout:1/184: chown d0/d3c 3 1 2024-02-10T00:00:24.611 INFO:tasks.workunit.client.1.smithi183.stdout:7/171: dread d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:24.612 INFO:tasks.workunit.client.1.smithi183.stdout:5/213: rmdir d4/dd 39 2024-02-10T00:00:24.612 INFO:tasks.workunit.client.1.smithi183.stdout:5/214: stat d4/d11/c35 0 2024-02-10T00:00:24.613 INFO:tasks.workunit.client.1.smithi183.stdout:5/215: write d4/d1d/f3f [136764,124511] 0 2024-02-10T00:00:24.615 INFO:tasks.workunit.client.1.smithi183.stdout:6/158: rename d2/l28 to d2/d26/d34/l3b 0 2024-02-10T00:00:24.615 INFO:tasks.workunit.client.1.smithi183.stdout:4/176: rmdir de/d14/d27 39 2024-02-10T00:00:24.617 INFO:tasks.workunit.client.1.smithi183.stdout:9/189: symlink d0/d3/d14/d1c/d2d/l37 0 2024-02-10T00:00:24.618 INFO:tasks.workunit.client.1.smithi183.stdout:9/190: chown d0/d3/d14/d1c/c27 98584 1 2024-02-10T00:00:24.619 INFO:tasks.workunit.client.1.smithi183.stdout:3/149: creat d7/f30 x:0 0 0 2024-02-10T00:00:24.621 INFO:tasks.workunit.client.1.smithi183.stdout:8/237: mknod d0/d45/c4a 0 2024-02-10T00:00:24.622 INFO:tasks.workunit.client.1.smithi183.stdout:8/238: chown d0/d3f 326868046 1 2024-02-10T00:00:24.622 INFO:tasks.workunit.client.1.smithi183.stdout:5/216: mknod d4/d1d/d27/d37/c44 0 2024-02-10T00:00:24.624 INFO:tasks.workunit.client.1.smithi183.stdout:5/217: stat d4/d23/f21 0 2024-02-10T00:00:24.624 INFO:tasks.workunit.client.0.smithi164.stdout:7/2: mknod c1 0 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/5: symlink l0 0 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/6: chown l0 281 1 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/7: readlink l0 0 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/8: chown l0 28397228 1 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/9: write - no filename 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/10: fdatasync - no filename 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:8/11: write - no filename 2024-02-10T00:00:24.625 INFO:tasks.workunit.client.0.smithi164.stdout:0/8: mkdir d4 0 2024-02-10T00:00:24.626 INFO:tasks.workunit.client.0.smithi164.stdout:3/4: getdents d0/d1/d2 0 2024-02-10T00:00:24.626 INFO:tasks.workunit.client.1.smithi183.stdout:0/170: rename d14/d1d/d2c to d14/d46 0 2024-02-10T00:00:24.628 INFO:tasks.workunit.client.1.smithi183.stdout:9/191: unlink d0/d3/d14/d1c/l34 0 2024-02-10T00:00:24.628 INFO:tasks.workunit.client.1.smithi183.stdout:0/171: write d14/d1d/f32 [215335,1626] 0 2024-02-10T00:00:24.628 INFO:tasks.workunit.client.1.smithi183.stdout:7/172: dwrite d0/f1 [0,4194304] 0 2024-02-10T00:00:24.628 INFO:tasks.workunit.client.1.smithi183.stdout:2/242: truncate d2/da/d20/d21/f40 489066 0 2024-02-10T00:00:24.629 INFO:tasks.workunit.client.0.smithi164.stdout:0/9: dwrite f3 [0,4194304] 0 2024-02-10T00:00:24.630 INFO:tasks.workunit.client.1.smithi183.stdout:7/173: dread - d0/d2/d3/f28 zero size 2024-02-10T00:00:24.631 INFO:tasks.workunit.client.0.smithi164.stdout:5/14: symlink l3 0 2024-02-10T00:00:24.631 INFO:tasks.workunit.client.0.smithi164.stdout:9/5: mknod c0 0 2024-02-10T00:00:24.633 INFO:tasks.workunit.client.1.smithi183.stdout:1/185: rename d0/d3/d29/f37 to d0/d3/d7/d36/f47 0 2024-02-10T00:00:24.634 INFO:tasks.workunit.client.0.smithi164.stdout:2/16: getdents d3 0 2024-02-10T00:00:24.638 INFO:tasks.workunit.client.1.smithi183.stdout:8/239: dread d0/fb [0,4194304] 0 2024-02-10T00:00:24.640 INFO:tasks.workunit.client.1.smithi183.stdout:6/159: rename d2/d26/d29 to d2/d1a/d25/d3c 0 2024-02-10T00:00:24.641 INFO:tasks.workunit.client.1.smithi183.stdout:0/172: write d14/d46/d1a/d22/f41 [340439,42427] 0 2024-02-10T00:00:24.643 INFO:tasks.workunit.client.0.smithi164.stdout:5/15: creat f4 x:0 0 0 2024-02-10T00:00:24.645 INFO:tasks.workunit.client.0.smithi164.stdout:9/6: rename c0 to c1 0 2024-02-10T00:00:24.645 INFO:tasks.workunit.client.0.smithi164.stdout:9/7: dwrite - no filename 2024-02-10T00:00:24.646 INFO:tasks.workunit.client.0.smithi164.stdout:1/13: dread d1/f4 [0,4194304] 0 2024-02-10T00:00:24.646 INFO:tasks.workunit.client.1.smithi183.stdout:3/150: truncate f5 2794227 0 2024-02-10T00:00:24.647 INFO:tasks.workunit.client.1.smithi183.stdout:3/151: read d7/db/f1b [2398291,7185] 0 2024-02-10T00:00:24.647 INFO:tasks.workunit.client.1.smithi183.stdout:5/218: creat d4/f45 x:0 0 0 2024-02-10T00:00:24.648 INFO:tasks.workunit.client.0.smithi164.stdout:2/17: rename l1 to d3/l4 0 2024-02-10T00:00:24.648 INFO:tasks.workunit.client.0.smithi164.stdout:1/14: rename d1 to d1/d5 22 2024-02-10T00:00:24.649 INFO:tasks.workunit.client.0.smithi164.stdout:3/5: symlink d0/d1/d2/l3 0 2024-02-10T00:00:24.649 INFO:tasks.workunit.client.1.smithi183.stdout:4/177: getdents de/d19 0 2024-02-10T00:00:24.649 INFO:tasks.workunit.client.1.smithi183.stdout:3/152: dread - d7/db/d2a/f2b zero size 2024-02-10T00:00:24.649 INFO:tasks.workunit.client.0.smithi164.stdout:5/16: creat f5 x:0 0 0 2024-02-10T00:00:24.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/3: link c1 c2 0 2024-02-10T00:00:24.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/4: fdatasync - no filename 2024-02-10T00:00:24.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/5: truncate - no filename 2024-02-10T00:00:24.651 INFO:tasks.workunit.client.1.smithi183.stdout:6/160: symlink d2/d26/d35/l3d 0 2024-02-10T00:00:24.651 INFO:tasks.workunit.client.1.smithi183.stdout:2/243: dwrite d2/da/d20/d21/d43/f45 [0,4194304] 0 2024-02-10T00:00:24.651 INFO:tasks.workunit.client.1.smithi183.stdout:4/178: write de/d19/d20/f23 [1836626,129509] 0 2024-02-10T00:00:24.651 INFO:tasks.workunit.client.0.smithi164.stdout:1/15: creat d1/f6 x:0 0 0 2024-02-10T00:00:24.651 INFO:tasks.workunit.client.1.smithi183.stdout:4/179: chown de/d19 6 1 2024-02-10T00:00:24.652 INFO:tasks.workunit.client.1.smithi183.stdout:2/244: read - d2/f4a zero size 2024-02-10T00:00:24.652 INFO:tasks.workunit.client.0.smithi164.stdout:3/6: creat d0/f4 x:0 0 0 2024-02-10T00:00:24.652 INFO:tasks.workunit.client.0.smithi164.stdout:4/5: dwrite f0 [0,4194304] 0 2024-02-10T00:00:24.655 INFO:tasks.workunit.client.1.smithi183.stdout:6/161: chown d2/d1a/d25/f36 3928663 1 2024-02-10T00:00:24.655 INFO:tasks.workunit.client.0.smithi164.stdout:7/6: mkdir d3 0 2024-02-10T00:00:24.656 INFO:tasks.workunit.client.1.smithi183.stdout:9/192: rename d0/f12 to d0/d3/d14/f38 0 2024-02-10T00:00:24.656 INFO:tasks.workunit.client.1.smithi183.stdout:5/219: truncate d4/d11/f1f 815657 0 2024-02-10T00:00:24.656 INFO:tasks.workunit.client.0.smithi164.stdout:1/16: creat d1/f7 x:0 0 0 2024-02-10T00:00:24.658 INFO:tasks.workunit.client.0.smithi164.stdout:4/6: rename f0 to f1 0 2024-02-10T00:00:24.658 INFO:tasks.workunit.client.1.smithi183.stdout:4/180: symlink de/d19/l38 0 2024-02-10T00:00:24.659 INFO:tasks.workunit.client.1.smithi183.stdout:2/245: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:24.660 INFO:tasks.workunit.client.1.smithi183.stdout:7/174: dwrite d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:24.661 INFO:tasks.workunit.client.0.smithi164.stdout:1/17: dwrite d1/f6 [0,4194304] 0 2024-02-10T00:00:24.661 INFO:tasks.workunit.client.1.smithi183.stdout:7/175: chown d0/f1 902 1 2024-02-10T00:00:24.661 INFO:tasks.workunit.client.1.smithi183.stdout:3/153: write d7/f20 [659854,65970] 0 2024-02-10T00:00:24.662 INFO:tasks.workunit.client.0.smithi164.stdout:6/10: truncate d0/f1 83447 0 2024-02-10T00:00:24.662 INFO:tasks.workunit.client.0.smithi164.stdout:9/8: chown c1 13300 1 2024-02-10T00:00:24.663 INFO:tasks.workunit.client.1.smithi183.stdout:1/186: rename d0/d3 to d0/d3/d7/d48 22 2024-02-10T00:00:24.664 INFO:tasks.workunit.client.1.smithi183.stdout:1/187: chown d0/d3/d7/d3d 39 1 2024-02-10T00:00:24.665 INFO:tasks.workunit.client.1.smithi183.stdout:1/188: dread - d0/d3/d7/d2c/f30 zero size 2024-02-10T00:00:24.666 INFO:tasks.workunit.client.1.smithi183.stdout:5/220: mkdir d4/d1d/d27/d37/d46 0 2024-02-10T00:00:24.666 INFO:tasks.workunit.client.1.smithi183.stdout:3/154: dwrite d7/f20 [0,4194304] 0 2024-02-10T00:00:24.667 INFO:tasks.workunit.client.1.smithi183.stdout:5/221: readlink d4/d11/l18 0 2024-02-10T00:00:24.667 INFO:tasks.workunit.client.1.smithi183.stdout:4/181: write de/d14/f16 [784948,106628] 0 2024-02-10T00:00:24.668 INFO:tasks.workunit.client.1.smithi183.stdout:3/155: chown d7/db/d2a/d2d 28 1 2024-02-10T00:00:24.669 INFO:tasks.workunit.client.1.smithi183.stdout:6/162: creat d2/d1a/d25/d3c/d31/d38/f3e x:0 0 0 2024-02-10T00:00:24.670 INFO:tasks.workunit.client.0.smithi164.stdout:4/7: write f1 [3968547,101052] 0 2024-02-10T00:00:24.671 INFO:tasks.workunit.client.0.smithi164.stdout:4/8: chown f1 943 1 2024-02-10T00:00:24.672 INFO:tasks.workunit.client.1.smithi183.stdout:9/193: creat d0/d30/f39 x:0 0 0 2024-02-10T00:00:24.672 INFO:tasks.workunit.client.0.smithi164.stdout:1/18: symlink d1/l8 0 2024-02-10T00:00:24.673 INFO:tasks.workunit.client.1.smithi183.stdout:9/194: readlink d0/d3/l4 0 2024-02-10T00:00:24.674 INFO:tasks.workunit.client.1.smithi183.stdout:4/182: creat de/d19/d1c/f39 x:0 0 0 2024-02-10T00:00:24.674 INFO:tasks.workunit.client.0.smithi164.stdout:9/9: creat f2 x:0 0 0 2024-02-10T00:00:24.675 INFO:tasks.workunit.client.1.smithi183.stdout:7/176: dwrite d0/d2/d3/f20 [0,4194304] 0 2024-02-10T00:00:24.676 INFO:tasks.workunit.client.0.smithi164.stdout:4/9: dwrite f1 [0,4194304] 0 2024-02-10T00:00:24.678 INFO:tasks.workunit.client.1.smithi183.stdout:7/177: dread d0/d2/f2b [0,4194304] 0 2024-02-10T00:00:24.682 INFO:tasks.workunit.client.0.smithi164.stdout:7/7: creat d3/f4 x:0 0 0 2024-02-10T00:00:24.684 INFO:tasks.workunit.client.1.smithi183.stdout:4/183: chown de/d14/d27/f21 2 1 2024-02-10T00:00:24.685 INFO:tasks.workunit.client.0.smithi164.stdout:4/10: mkdir d2 0 2024-02-10T00:00:24.685 INFO:tasks.workunit.client.0.smithi164.stdout:2/18: link d3/l4 d3/l5 0 2024-02-10T00:00:24.686 INFO:tasks.workunit.client.1.smithi183.stdout:7/178: symlink d0/d11/l31 0 2024-02-10T00:00:24.687 INFO:tasks.workunit.client.1.smithi183.stdout:8/240: rename d0/d3c/c3d to d0/d23/d2d/c4b 0 2024-02-10T00:00:24.688 INFO:tasks.workunit.client.1.smithi183.stdout:8/241: write d0/d27/f3a [941862,39466] 0 2024-02-10T00:00:24.688 INFO:tasks.workunit.client.0.smithi164.stdout:7/8: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:24.688 INFO:tasks.workunit.client.0.smithi164.stdout:9/10: truncate f2 554695 0 2024-02-10T00:00:24.689 INFO:tasks.workunit.client.1.smithi183.stdout:4/184: chown de/d19/d1c/c2d 5747 1 2024-02-10T00:00:24.691 INFO:tasks.workunit.client.1.smithi183.stdout:7/179: creat d0/f32 x:0 0 0 2024-02-10T00:00:24.692 INFO:tasks.workunit.client.0.smithi164.stdout:4/11: symlink d2/l3 0 2024-02-10T00:00:24.692 INFO:tasks.workunit.client.1.smithi183.stdout:8/242: dwrite d0/d27/f3a [0,4194304] 0 2024-02-10T00:00:24.694 INFO:tasks.workunit.client.1.smithi183.stdout:0/173: rename l9 to d14/d1d/d2d/d31/l47 0 2024-02-10T00:00:24.694 INFO:tasks.workunit.client.1.smithi183.stdout:6/163: getdents d2/d1a 0 2024-02-10T00:00:24.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/17: truncate f1 1102835 0 2024-02-10T00:00:24.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/18: fdatasync f0 0 2024-02-10T00:00:24.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/19: rmdir - no directory 2024-02-10T00:00:24.696 INFO:tasks.workunit.client.1.smithi183.stdout:4/185: mknod de/d14/d1d/c3a 0 2024-02-10T00:00:24.697 INFO:tasks.workunit.client.0.smithi164.stdout:9/11: mknod c3 0 2024-02-10T00:00:24.697 INFO:tasks.workunit.client.1.smithi183.stdout:8/243: fsync d0/d23/f2a 0 2024-02-10T00:00:24.697 INFO:tasks.workunit.client.1.smithi183.stdout:7/180: dwrite d0/d2/d3/f28 [0,4194304] 0 2024-02-10T00:00:24.698 INFO:tasks.workunit.client.0.smithi164.stdout:2/19: chown d3/l4 1107 1 2024-02-10T00:00:24.698 INFO:tasks.workunit.client.0.smithi164.stdout:2/20: write f2 [3147435,50861] 0 2024-02-10T00:00:24.699 INFO:tasks.workunit.client.1.smithi183.stdout:1/189: rename d0/d3/cd to d0/d3/d29/d38/c49 0 2024-02-10T00:00:24.699 INFO:tasks.workunit.client.0.smithi164.stdout:4/12: mknod d2/c4 0 2024-02-10T00:00:24.699 INFO:tasks.workunit.client.0.smithi164.stdout:4/13: readlink d2/l3 0 2024-02-10T00:00:24.700 INFO:tasks.workunit.client.1.smithi183.stdout:6/164: mkdir d2/d1a/d25/d3c/d31/d38/d3f 0 2024-02-10T00:00:24.701 INFO:tasks.workunit.client.1.smithi183.stdout:6/165: readlink d2/l21 0 2024-02-10T00:00:24.702 INFO:tasks.workunit.client.1.smithi183.stdout:6/166: chown d2/d1a/d25/d3c/d31/d38/f3e 7 1 2024-02-10T00:00:24.702 INFO:tasks.workunit.client.0.smithi164.stdout:5/20: unlink f4 0 2024-02-10T00:00:24.703 INFO:tasks.workunit.client.1.smithi183.stdout:6/167: dread - d2/d1a/d25/f36 zero size 2024-02-10T00:00:24.703 INFO:tasks.workunit.client.1.smithi183.stdout:6/168: dread - d2/d1a/d25/f36 zero size 2024-02-10T00:00:24.704 INFO:tasks.workunit.client.0.smithi164.stdout:4/14: symlink d2/l5 0 2024-02-10T00:00:24.705 INFO:tasks.workunit.client.1.smithi183.stdout:8/244: symlink d0/d23/d2d/l4c 0 2024-02-10T00:00:24.705 INFO:tasks.workunit.client.0.smithi164.stdout:4/15: write f1 [1661705,54730] 0 2024-02-10T00:00:24.706 INFO:tasks.workunit.client.1.smithi183.stdout:6/169: fsync d2/d1a/f20 0 2024-02-10T00:00:24.706 INFO:tasks.workunit.client.1.smithi183.stdout:4/186: dread de/d19/d20/f23 [0,4194304] 0 2024-02-10T00:00:24.707 INFO:tasks.workunit.client.0.smithi164.stdout:5/21: symlink l6 0 2024-02-10T00:00:24.707 INFO:tasks.workunit.client.1.smithi183.stdout:3/156: rename d7/f11 to d7/db/d2a/d2d/f31 0 2024-02-10T00:00:24.708 INFO:tasks.workunit.client.0.smithi164.stdout:4/16: dread f1 [0,4194304] 0 2024-02-10T00:00:24.709 INFO:tasks.workunit.client.0.smithi164.stdout:5/22: mkdir d7 0 2024-02-10T00:00:24.709 INFO:tasks.workunit.client.0.smithi164.stdout:5/23: readlink l2 0 2024-02-10T00:00:24.710 INFO:tasks.workunit.client.0.smithi164.stdout:5/24: write f0 [2053121,90179] 0 2024-02-10T00:00:24.710 INFO:tasks.workunit.client.1.smithi183.stdout:7/181: dwrite d0/d2/f2b [4194304,4194304] 0 2024-02-10T00:00:24.710 INFO:tasks.workunit.client.1.smithi183.stdout:3/157: fsync d7/f9 0 2024-02-10T00:00:24.711 INFO:tasks.workunit.client.0.smithi164.stdout:4/17: unlink d2/l5 0 2024-02-10T00:00:24.712 INFO:tasks.workunit.client.1.smithi183.stdout:7/182: creat d0/d2/d3/f33 x:0 0 0 2024-02-10T00:00:24.712 INFO:tasks.workunit.client.1.smithi183.stdout:7/183: dread - d0/f32 zero size 2024-02-10T00:00:24.712 INFO:tasks.workunit.client.1.smithi183.stdout:7/184: chown d0/f21 432980479 1 2024-02-10T00:00:24.713 INFO:tasks.workunit.client.0.smithi164.stdout:4/18: write f1 [3730470,100993] 0 2024-02-10T00:00:24.714 INFO:tasks.workunit.client.1.smithi183.stdout:9/195: rename d0/d10/f2c to d0/f3a 0 2024-02-10T00:00:24.714 INFO:tasks.workunit.client.0.smithi164.stdout:5/25: dwrite f5 [0,4194304] 0 2024-02-10T00:00:24.720 INFO:tasks.workunit.client.0.smithi164.stdout:4/19: dread f1 [0,4194304] 0 2024-02-10T00:00:24.720 INFO:tasks.workunit.client.0.smithi164.stdout:5/26: dwrite f0 [0,4194304] 0 2024-02-10T00:00:24.721 INFO:tasks.workunit.client.1.smithi183.stdout:7/185: dread d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:24.721 INFO:tasks.workunit.client.1.smithi183.stdout:1/190: rename d0/d3/d29/d1f/f35 to d0/d3/d7/f4a 0 2024-02-10T00:00:24.721 INFO:tasks.workunit.client.1.smithi183.stdout:7/186: write d0/d2/d4/f5 [4633208,63557] 0 2024-02-10T00:00:24.721 INFO:tasks.workunit.client.1.smithi183.stdout:7/187: write d0/d2/f2b [6667050,76839] 0 2024-02-10T00:00:24.722 INFO:tasks.workunit.client.1.smithi183.stdout:7/188: read d0/d11/f1c [974709,46313] 0 2024-02-10T00:00:24.723 INFO:tasks.workunit.client.0.smithi164.stdout:5/27: creat d7/f8 x:0 0 0 2024-02-10T00:00:24.723 INFO:tasks.workunit.client.1.smithi183.stdout:1/191: creat d0/f4b x:0 0 0 2024-02-10T00:00:24.724 INFO:tasks.workunit.client.0.smithi164.stdout:4/20: dwrite f1 [0,4194304] 0 2024-02-10T00:00:24.724 INFO:tasks.workunit.client.0.smithi164.stdout:4/21: chown f1 3965604 1 2024-02-10T00:00:24.725 INFO:tasks.workunit.client.0.smithi164.stdout:4/22: write f1 [3438940,45444] 0 2024-02-10T00:00:24.725 INFO:tasks.workunit.client.0.smithi164.stdout:5/28: symlink d7/l9 0 2024-02-10T00:00:24.726 INFO:tasks.workunit.client.1.smithi183.stdout:7/189: dwrite d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:24.726 INFO:tasks.workunit.client.0.smithi164.stdout:4/23: write f1 [3544755,126182] 0 2024-02-10T00:00:24.726 INFO:tasks.workunit.client.1.smithi183.stdout:1/192: creat d0/d3/d29/f4c x:0 0 0 2024-02-10T00:00:24.727 INFO:tasks.workunit.client.0.smithi164.stdout:4/24: write f1 [1940007,108693] 0 2024-02-10T00:00:24.728 INFO:tasks.workunit.client.1.smithi183.stdout:7/190: chown d0/d2/c19 948814069 1 2024-02-10T00:00:24.729 INFO:tasks.workunit.client.1.smithi183.stdout:1/193: creat d0/d3/d7/d36/f4d x:0 0 0 2024-02-10T00:00:24.729 INFO:tasks.workunit.client.0.smithi164.stdout:5/29: link d7/l9 d7/la 0 2024-02-10T00:00:24.730 INFO:tasks.workunit.client.0.smithi164.stdout:4/25: dread f1 [0,4194304] 0 2024-02-10T00:00:24.731 INFO:tasks.workunit.client.0.smithi164.stdout:5/30: mkdir d7/db 0 2024-02-10T00:00:24.732 INFO:tasks.workunit.client.0.smithi164.stdout:4/26: symlink d2/l6 0 2024-02-10T00:00:24.734 INFO:tasks.workunit.client.1.smithi183.stdout:1/194: dread d0/d3/d7/d36/f25 [0,4194304] 0 2024-02-10T00:00:24.734 INFO:tasks.workunit.client.1.smithi183.stdout:7/191: dwrite d0/d2/d3/f20 [0,4194304] 0 2024-02-10T00:00:24.734 INFO:tasks.workunit.client.0.smithi164.stdout:5/31: truncate d7/f8 791538 0 2024-02-10T00:00:24.736 INFO:tasks.workunit.client.0.smithi164.stdout:5/32: creat d7/fc x:0 0 0 2024-02-10T00:00:24.736 INFO:tasks.workunit.client.1.smithi183.stdout:1/195: mknod d0/d3/d29/c4e 0 2024-02-10T00:00:24.739 INFO:tasks.workunit.client.1.smithi183.stdout:1/196: unlink d0/d3/d29/d1f/l44 0 2024-02-10T00:00:24.744 INFO:tasks.workunit.client.1.smithi183.stdout:1/197: dwrite d0/d3/d7/f23 [0,4194304] 0 2024-02-10T00:00:24.744 INFO:tasks.workunit.client.1.smithi183.stdout:1/198: stat d0/d3/le 0 2024-02-10T00:00:24.745 INFO:tasks.workunit.client.1.smithi183.stdout:4/187: fsync de/d14/f16 0 2024-02-10T00:00:24.747 INFO:tasks.workunit.client.1.smithi183.stdout:1/199: creat d0/d3/d7/d3d/f4f x:0 0 0 2024-02-10T00:00:24.747 INFO:tasks.workunit.client.1.smithi183.stdout:1/200: chown d0/d3c/l46 462 1 2024-02-10T00:00:24.749 INFO:tasks.workunit.client.1.smithi183.stdout:1/201: creat d0/d3/d7/d36/f50 x:0 0 0 2024-02-10T00:00:24.751 INFO:tasks.workunit.client.1.smithi183.stdout:5/222: dread f3 [0,4194304] 0 2024-02-10T00:00:24.752 INFO:tasks.workunit.client.1.smithi183.stdout:1/202: rename d0/d3c/f45 to d0/d3/d29/f51 0 2024-02-10T00:00:24.754 INFO:tasks.workunit.client.0.smithi164.stdout:7/9: fdatasync d3/f4 0 2024-02-10T00:00:24.758 INFO:tasks.workunit.client.0.smithi164.stdout:7/10: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:24.759 INFO:tasks.workunit.client.0.smithi164.stdout:7/11: chown d3 76 1 2024-02-10T00:00:24.761 INFO:tasks.workunit.client.0.smithi164.stdout:7/12: dread d3/f4 [0,4194304] 0 2024-02-10T00:00:24.776 INFO:tasks.workunit.client.1.smithi183.stdout:8/245: dread d0/d23/d2d/d24/f32 [0,4194304] 0 2024-02-10T00:00:24.780 INFO:tasks.workunit.client.1.smithi183.stdout:8/246: dwrite d0/d27/d36/f48 [0,4194304] 0 2024-02-10T00:00:24.820 INFO:tasks.workunit.client.0.smithi164.stdout:1/19: getdents d1 0 2024-02-10T00:00:24.821 INFO:tasks.workunit.client.1.smithi183.stdout:5/223: read d4/dd/f14 [82457,130549] 0 2024-02-10T00:00:24.821 INFO:tasks.workunit.client.1.smithi183.stdout:0/174: sync 2024-02-10T00:00:24.821 INFO:tasks.workunit.client.0.smithi164.stdout:1/20: write d1/f6 [3755575,85685] 0 2024-02-10T00:00:24.822 INFO:tasks.workunit.client.0.smithi164.stdout:1/21: chown d1/l8 4092888 1 2024-02-10T00:00:24.822 INFO:tasks.workunit.client.1.smithi183.stdout:2/246: read d2/da/d20/d21/f40 [240694,362] 0 2024-02-10T00:00:24.825 INFO:tasks.workunit.client.0.smithi164.stdout:9/12: dread f2 [0,4194304] 0 2024-02-10T00:00:24.825 INFO:tasks.workunit.client.0.smithi164.stdout:6/11: write d0/f1 [282360,92871] 0 2024-02-10T00:00:24.826 INFO:tasks.workunit.client.0.smithi164.stdout:9/13: dread f2 [0,4194304] 0 2024-02-10T00:00:24.826 INFO:tasks.workunit.client.0.smithi164.stdout:9/14: chown c1 15292 1 2024-02-10T00:00:24.827 INFO:tasks.workunit.client.0.smithi164.stdout:9/15: dread f2 [0,4194304] 0 2024-02-10T00:00:24.831 INFO:tasks.workunit.client.0.smithi164.stdout:1/22: creat d1/f9 x:0 0 0 2024-02-10T00:00:24.832 INFO:tasks.workunit.client.1.smithi183.stdout:5/224: creat d4/d1d/d27/d38/f47 x:0 0 0 2024-02-10T00:00:24.832 INFO:tasks.workunit.client.0.smithi164.stdout:6/12: unlink d0/f1 0 2024-02-10T00:00:24.832 INFO:tasks.workunit.client.0.smithi164.stdout:6/13: dwrite - no filename 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/14: chown d0 6149 1 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/15: dread - no filename 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/16: dread - no filename 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/17: write - no filename 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/18: dread - no filename 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:6/19: unlink - no file 2024-02-10T00:00:24.833 INFO:tasks.workunit.client.0.smithi164.stdout:9/16: creat f4 x:0 0 0 2024-02-10T00:00:24.834 INFO:tasks.workunit.client.1.smithi183.stdout:0/175: creat d14/d46/d1a/d22/f48 x:0 0 0 2024-02-10T00:00:24.834 INFO:tasks.workunit.client.0.smithi164.stdout:1/23: mkdir d1/da 0 2024-02-10T00:00:24.835 INFO:tasks.workunit.client.1.smithi183.stdout:5/225: rename d4/d23/d2a/f30 to d4/d1d/d27/d38/f48 0 2024-02-10T00:00:24.835 INFO:tasks.workunit.client.1.smithi183.stdout:0/176: dread d14/d1d/d2d/f39 [0,4194304] 0 2024-02-10T00:00:24.837 INFO:tasks.workunit.client.0.smithi164.stdout:6/20: symlink d0/l2 0 2024-02-10T00:00:24.837 INFO:tasks.workunit.client.0.smithi164.stdout:6/21: stat d0 0 2024-02-10T00:00:24.837 INFO:tasks.workunit.client.0.smithi164.stdout:6/22: mknod d0/c3 0 2024-02-10T00:00:24.837 INFO:tasks.workunit.client.0.smithi164.stdout:6/23: dwrite - no filename 2024-02-10T00:00:24.838 INFO:tasks.workunit.client.1.smithi183.stdout:5/226: rename d4/f2e to d4/d23/d2a/f49 0 2024-02-10T00:00:24.840 INFO:tasks.workunit.client.0.smithi164.stdout:7/13: fsync d3/f4 0 2024-02-10T00:00:24.840 INFO:tasks.workunit.client.0.smithi164.stdout:6/24: unlink d0/l2 0 2024-02-10T00:00:24.840 INFO:tasks.workunit.client.0.smithi164.stdout:6/25: write - no filename 2024-02-10T00:00:24.840 INFO:tasks.workunit.client.0.smithi164.stdout:6/26: dread - no filename 2024-02-10T00:00:24.841 INFO:tasks.workunit.client.0.smithi164.stdout:6/27: truncate - no filename 2024-02-10T00:00:24.842 INFO:tasks.workunit.client.1.smithi183.stdout:0/177: rename d14/d1d/d2d/d31/c36 to d14/d43/c49 0 2024-02-10T00:00:24.845 INFO:tasks.workunit.client.1.smithi183.stdout:5/227: rename d4/d11 to d4/d23/d4a 0 2024-02-10T00:00:24.847 INFO:tasks.workunit.client.1.smithi183.stdout:9/196: truncate d0/d3/f29 1244387 0 2024-02-10T00:00:24.850 INFO:tasks.workunit.client.0.smithi164.stdout:5/33: dread d7/f8 [0,4194304] 0 2024-02-10T00:00:24.851 INFO:tasks.workunit.client.0.smithi164.stdout:5/34: write f0 [1774540,90937] 0 2024-02-10T00:00:24.851 INFO:tasks.workunit.client.0.smithi164.stdout:5/35: fdatasync f5 0 2024-02-10T00:00:24.851 INFO:tasks.workunit.client.0.smithi164.stdout:6/28: rename d0/c3 to d0/c4 0 2024-02-10T00:00:24.851 INFO:tasks.workunit.client.0.smithi164.stdout:6/29: dwrite - no filename 2024-02-10T00:00:24.852 INFO:tasks.workunit.client.0.smithi164.stdout:6/30: dread - no filename 2024-02-10T00:00:24.852 INFO:tasks.workunit.client.0.smithi164.stdout:6/31: write - no filename 2024-02-10T00:00:24.852 INFO:tasks.workunit.client.1.smithi183.stdout:9/197: dwrite d0/f2e [0,4194304] 0 2024-02-10T00:00:24.852 INFO:tasks.workunit.client.1.smithi183.stdout:7/192: getdents d0/d2/d3 0 2024-02-10T00:00:24.854 INFO:tasks.workunit.client.0.smithi164.stdout:9/17: truncate f2 61799 0 2024-02-10T00:00:24.856 INFO:tasks.workunit.client.1.smithi183.stdout:8/247: truncate d0/d45/f49 4887334 0 2024-02-10T00:00:24.856 INFO:tasks.workunit.client.1.smithi183.stdout:8/248: write d0/d27/f2e [414632,48313] 0 2024-02-10T00:00:24.857 INFO:tasks.workunit.client.1.smithi183.stdout:1/203: getdents d0/d3/d7/d3d 0 2024-02-10T00:00:24.858 INFO:tasks.workunit.client.0.smithi164.stdout:9/18: dwrite f4 [0,4194304] 0 2024-02-10T00:00:24.858 INFO:tasks.workunit.client.0.smithi164.stdout:1/24: getdents d1 0 2024-02-10T00:00:24.858 INFO:tasks.workunit.client.0.smithi164.stdout:1/25: write d1/f7 [87235,24152] 0 2024-02-10T00:00:24.859 INFO:tasks.workunit.client.0.smithi164.stdout:1/26: fdatasync d1/f9 0 2024-02-10T00:00:24.859 INFO:tasks.workunit.client.1.smithi183.stdout:2/247: write d2/f3e [2647265,93442] 0 2024-02-10T00:00:24.864 INFO:tasks.workunit.client.0.smithi164.stdout:5/36: unlink d7/f8 0 2024-02-10T00:00:24.864 INFO:tasks.workunit.client.0.smithi164.stdout:5/37: chown d7 146609 1 2024-02-10T00:00:24.865 INFO:tasks.workunit.client.0.smithi164.stdout:5/38: dread - d7/fc zero size 2024-02-10T00:00:24.865 INFO:tasks.workunit.client.0.smithi164.stdout:5/39: write f5 [2725258,49631] 0 2024-02-10T00:00:24.865 INFO:tasks.workunit.client.1.smithi183.stdout:1/204: unlink d0/d3/ff 0 2024-02-10T00:00:24.866 INFO:tasks.workunit.client.0.smithi164.stdout:1/27: fdatasync d1/f4 0 2024-02-10T00:00:24.867 INFO:tasks.workunit.client.1.smithi183.stdout:6/170: sync 2024-02-10T00:00:24.867 INFO:tasks.workunit.client.1.smithi183.stdout:3/158: sync 2024-02-10T00:00:24.867 INFO:tasks.workunit.client.0.smithi164.stdout:7/14: getdents d3 0 2024-02-10T00:00:24.867 INFO:tasks.workunit.client.1.smithi183.stdout:3/159: chown d7/db/d2a/f23 583880 1 2024-02-10T00:00:24.868 INFO:tasks.workunit.client.1.smithi183.stdout:7/193: creat d0/d11/d2f/f34 x:0 0 0 2024-02-10T00:00:24.869 INFO:tasks.workunit.client.1.smithi183.stdout:9/198: creat d0/f3b x:0 0 0 2024-02-10T00:00:24.870 INFO:tasks.workunit.client.0.smithi164.stdout:7/15: stat c2 0 2024-02-10T00:00:24.872 INFO:tasks.workunit.client.0.smithi164.stdout:7/16: mkdir d3/d5 0 2024-02-10T00:00:24.873 INFO:tasks.workunit.client.0.smithi164.stdout:7/17: chown d3/f4 1 1 2024-02-10T00:00:24.873 INFO:tasks.workunit.client.1.smithi183.stdout:0/178: getdents d14 0 2024-02-10T00:00:24.873 INFO:tasks.workunit.client.1.smithi183.stdout:3/160: dwrite d7/f30 [0,4194304] 0 2024-02-10T00:00:24.874 INFO:tasks.workunit.client.1.smithi183.stdout:6/171: readlink d2/l1d 0 2024-02-10T00:00:24.874 INFO:tasks.workunit.client.0.smithi164.stdout:5/40: rmdir d7/db 0 2024-02-10T00:00:24.875 INFO:tasks.workunit.client.0.smithi164.stdout:5/41: stat l3 0 2024-02-10T00:00:24.876 INFO:tasks.workunit.client.1.smithi183.stdout:3/161: dread - d7/db/f24 zero size 2024-02-10T00:00:24.876 INFO:tasks.workunit.client.1.smithi183.stdout:0/179: stat d14/d46/d1a/d22/f41 0 2024-02-10T00:00:24.877 INFO:tasks.workunit.client.1.smithi183.stdout:7/194: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2024-02-10T00:00:24.877 INFO:tasks.workunit.client.1.smithi183.stdout:3/162: chown d7/f9 80008081 1 2024-02-10T00:00:24.877 INFO:tasks.workunit.client.1.smithi183.stdout:6/172: chown d2/d1a/d25/d3c/d31/d38/f3e 712874187 1 2024-02-10T00:00:24.877 INFO:tasks.workunit.client.0.smithi164.stdout:7/18: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:24.878 INFO:tasks.workunit.client.0.smithi164.stdout:7/19: rename d3 to d3/d5/d6 22 2024-02-10T00:00:24.878 INFO:tasks.workunit.client.0.smithi164.stdout:5/42: dread f0 [0,4194304] 0 2024-02-10T00:00:24.878 INFO:tasks.workunit.client.0.smithi164.stdout:7/20: write d3/f4 [4974858,86949] 0 2024-02-10T00:00:24.881 INFO:tasks.workunit.client.1.smithi183.stdout:3/163: dread d7/f12 [0,4194304] 0 2024-02-10T00:00:24.881 INFO:tasks.workunit.client.0.smithi164.stdout:5/43: creat d7/fd x:0 0 0 2024-02-10T00:00:24.882 INFO:tasks.workunit.client.1.smithi183.stdout:7/195: mkdir d0/d11/d35 0 2024-02-10T00:00:24.882 INFO:tasks.workunit.client.1.smithi183.stdout:6/173: write d2/f1e [694121,117511] 0 2024-02-10T00:00:24.882 INFO:tasks.workunit.client.1.smithi183.stdout:6/174: chown d2 55 1 2024-02-10T00:00:24.884 INFO:tasks.workunit.client.0.smithi164.stdout:7/21: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:24.885 INFO:tasks.workunit.client.1.smithi183.stdout:1/205: rmdir d0/d3 39 2024-02-10T00:00:24.887 INFO:tasks.workunit.client.1.smithi183.stdout:2/248: truncate d2/f1e 2794841 0 2024-02-10T00:00:24.888 INFO:tasks.workunit.client.0.smithi164.stdout:5/44: dwrite d7/fd [0,4194304] 0 2024-02-10T00:00:24.888 INFO:tasks.workunit.client.1.smithi183.stdout:2/249: read d2/da/d20/d21/f40 [179477,56157] 0 2024-02-10T00:00:24.890 INFO:tasks.workunit.client.0.smithi164.stdout:6/32: unlink d0/c4 0 2024-02-10T00:00:24.890 INFO:tasks.workunit.client.0.smithi164.stdout:6/33: readlink - no filename 2024-02-10T00:00:24.891 INFO:tasks.workunit.client.1.smithi183.stdout:3/164: symlink d7/l32 0 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:7/22: creat d3/d5/f7 x:0 0 0 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:5/45: dwrite d7/fd [0,4194304] 0 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:6/34: creat d0/f5 x:0 0 0 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:5/46: dread - d7/fc zero size 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:7/23: dread - d3/d5/f7 zero size 2024-02-10T00:00:24.896 INFO:tasks.workunit.client.0.smithi164.stdout:6/35: write d0/f5 [319460,18154] 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:2/250: creat d2/d33/d35/f4e x:0 0 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:3/165: stat d7/fd 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:3/166: readlink l1 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:1/206: symlink d0/d3/d7/d36/l52 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:3/167: write d7/db/d2a/f23 [1257801,62078] 0 2024-02-10T00:00:24.898 INFO:tasks.workunit.client.1.smithi183.stdout:1/207: chown d0/d3/d29/f51 1 1 2024-02-10T00:00:24.899 INFO:tasks.workunit.client.0.smithi164.stdout:7/24: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:24.900 INFO:tasks.workunit.client.1.smithi183.stdout:2/251: rename d2/da/d20/d21/f40 to d2/d2c/d2d/f4f 0 2024-02-10T00:00:24.901 INFO:tasks.workunit.client.0.smithi164.stdout:6/36: mkdir d0/d6 0 2024-02-10T00:00:24.902 INFO:tasks.workunit.client.1.smithi183.stdout:3/168: rmdir d7/db 39 2024-02-10T00:00:24.903 INFO:tasks.workunit.client.1.smithi183.stdout:5/228: sync 2024-02-10T00:00:24.903 INFO:tasks.workunit.client.1.smithi183.stdout:4/188: sync 2024-02-10T00:00:24.905 INFO:tasks.workunit.client.1.smithi183.stdout:1/208: symlink d0/d3/d7/d2c/l53 0 2024-02-10T00:00:24.906 INFO:tasks.workunit.client.0.smithi164.stdout:6/37: link d0/f5 d0/d6/f7 0 2024-02-10T00:00:24.907 INFO:tasks.workunit.client.1.smithi183.stdout:3/169: fsync d7/db/d2a/d1c/f21 0 2024-02-10T00:00:24.909 INFO:tasks.workunit.client.1.smithi183.stdout:1/209: mknod d0/d3/d29/d1f/c54 0 2024-02-10T00:00:24.910 INFO:tasks.workunit.client.0.smithi164.stdout:6/38: creat d0/d6/f8 x:0 0 0 2024-02-10T00:00:24.912 INFO:tasks.workunit.client.1.smithi183.stdout:3/170: dwrite d7/db/d2a/f23 [0,4194304] 0 2024-02-10T00:00:24.912 INFO:tasks.workunit.client.1.smithi183.stdout:9/199: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:24.913 INFO:tasks.workunit.client.0.smithi164.stdout:6/39: symlink d0/l9 0 2024-02-10T00:00:24.913 INFO:tasks.workunit.client.1.smithi183.stdout:9/200: stat d0/f2e 0 2024-02-10T00:00:24.916 INFO:tasks.workunit.client.0.smithi164.stdout:6/40: rename d0/l9 to d0/la 0 2024-02-10T00:00:24.916 INFO:tasks.workunit.client.0.smithi164.stdout:6/41: dread - d0/d6/f8 zero size 2024-02-10T00:00:24.917 INFO:tasks.workunit.client.1.smithi183.stdout:4/189: getdents de 0 2024-02-10T00:00:24.917 INFO:tasks.workunit.client.0.smithi164.stdout:6/42: write d0/d6/f7 [470749,26908] 0 2024-02-10T00:00:24.918 INFO:tasks.workunit.client.1.smithi183.stdout:9/201: dwrite d0/f2f [0,4194304] 0 2024-02-10T00:00:24.918 INFO:tasks.workunit.client.0.smithi164.stdout:6/43: chown d0/f5 723 1 2024-02-10T00:00:24.925 INFO:tasks.workunit.client.0.smithi164.stdout:6/44: link d0/f5 d0/fb 0 2024-02-10T00:00:24.925 INFO:tasks.workunit.client.0.smithi164.stdout:9/19: truncate f4 1777475 0 2024-02-10T00:00:24.927 INFO:tasks.workunit.client.0.smithi164.stdout:6/45: creat d0/fc x:0 0 0 2024-02-10T00:00:24.927 INFO:tasks.workunit.client.0.smithi164.stdout:9/20: truncate f4 2167986 0 2024-02-10T00:00:24.927 INFO:tasks.workunit.client.0.smithi164.stdout:9/21: rmdir - no directory 2024-02-10T00:00:24.931 INFO:tasks.workunit.client.0.smithi164.stdout:6/46: dwrite d0/d6/f8 [0,4194304] 0 2024-02-10T00:00:24.933 INFO:tasks.workunit.client.0.smithi164.stdout:6/47: mknod d0/cd 0 2024-02-10T00:00:24.934 INFO:tasks.workunit.client.1.smithi183.stdout:9/202: getdents d0/d3 0 2024-02-10T00:00:24.936 INFO:tasks.workunit.client.1.smithi183.stdout:4/190: dwrite de/d22/f25 [0,4194304] 0 2024-02-10T00:00:24.936 INFO:tasks.workunit.client.1.smithi183.stdout:4/191: readlink de/d19/l38 0 2024-02-10T00:00:24.937 INFO:tasks.workunit.client.1.smithi183.stdout:4/192: chown de/d19/f31 1 1 2024-02-10T00:00:24.942 INFO:tasks.workunit.client.1.smithi183.stdout:4/193: rename c1 to de/d19/c3b 0 2024-02-10T00:00:24.946 INFO:tasks.workunit.client.1.smithi183.stdout:4/194: rename de/d19/d1c/f24 to de/f3c 0 2024-02-10T00:00:24.952 INFO:tasks.workunit.client.1.smithi183.stdout:0/180: write d14/d46/d1a/f1b [2984036,4165] 0 2024-02-10T00:00:24.952 INFO:tasks.workunit.client.1.smithi183.stdout:8/249: sync 2024-02-10T00:00:24.953 INFO:tasks.workunit.client.1.smithi183.stdout:8/250: mknod d0/d23/c4d 0 2024-02-10T00:00:24.957 INFO:tasks.workunit.client.1.smithi183.stdout:0/181: dwrite d14/d1d/d2d/d31/f3a [0,4194304] 0 2024-02-10T00:00:24.957 INFO:tasks.workunit.client.1.smithi183.stdout:8/251: getdents d0/d27 0 2024-02-10T00:00:24.963 INFO:tasks.workunit.client.0.smithi164.stdout:7/25: getdents d3 0 2024-02-10T00:00:24.964 INFO:tasks.workunit.client.0.smithi164.stdout:7/26: chown d3/f4 131 1 2024-02-10T00:00:24.965 INFO:tasks.workunit.client.0.smithi164.stdout:7/27: symlink d3/d5/l8 0 2024-02-10T00:00:24.967 INFO:tasks.workunit.client.0.smithi164.stdout:5/47: getdents d7 0 2024-02-10T00:00:24.968 INFO:tasks.workunit.client.0.smithi164.stdout:7/28: creat d3/f9 x:0 0 0 2024-02-10T00:00:24.969 INFO:tasks.workunit.client.0.smithi164.stdout:7/29: readlink d3/d5/l8 0 2024-02-10T00:00:24.969 INFO:tasks.workunit.client.0.smithi164.stdout:7/30: dread - d3/d5/f7 zero size 2024-02-10T00:00:24.969 INFO:tasks.workunit.client.0.smithi164.stdout:7/31: chown c1 236315351 1 2024-02-10T00:00:24.971 INFO:tasks.workunit.client.1.smithi183.stdout:7/196: truncate d0/d2/d3/f33 3311651 0 2024-02-10T00:00:24.971 INFO:tasks.workunit.client.0.smithi164.stdout:5/48: mknod d7/ce 0 2024-02-10T00:00:24.972 INFO:tasks.workunit.client.0.smithi164.stdout:7/32: creat d3/fa x:0 0 0 2024-02-10T00:00:24.973 INFO:tasks.workunit.client.1.smithi183.stdout:6/175: truncate d2/f7 266389 0 2024-02-10T00:00:24.975 INFO:tasks.workunit.client.0.smithi164.stdout:5/49: write f0 [1970208,94032] 0 2024-02-10T00:00:24.977 INFO:tasks.workunit.client.0.smithi164.stdout:7/33: dwrite d3/d5/f7 [0,4194304] 0 2024-02-10T00:00:24.977 INFO:tasks.workunit.client.0.smithi164.stdout:7/34: stat d3/f4 0 2024-02-10T00:00:24.978 INFO:tasks.workunit.client.1.smithi183.stdout:1/210: truncate d0/d3/d29/d38/f3b 1317148 0 2024-02-10T00:00:24.978 INFO:tasks.workunit.client.0.smithi164.stdout:7/35: chown c2 93722552 1 2024-02-10T00:00:24.979 INFO:tasks.workunit.client.1.smithi183.stdout:6/176: dwrite d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:24.980 INFO:tasks.workunit.client.0.smithi164.stdout:6/48: rmdir d0 39 2024-02-10T00:00:24.981 INFO:tasks.workunit.client.1.smithi183.stdout:8/252: write d0/d10/f19 [283435,74529] 0 2024-02-10T00:00:24.983 INFO:tasks.workunit.client.1.smithi183.stdout:6/177: chown d2/f1e 226 1 2024-02-10T00:00:24.984 INFO:tasks.workunit.client.1.smithi183.stdout:5/229: dwrite d4/f13 [0,4194304] 0 2024-02-10T00:00:24.984 INFO:tasks.workunit.client.1.smithi183.stdout:7/197: getdents d0/d2/d3 0 2024-02-10T00:00:24.986 INFO:tasks.workunit.client.1.smithi183.stdout:4/195: dread de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:24.986 INFO:tasks.workunit.client.1.smithi183.stdout:3/171: sync 2024-02-10T00:00:24.987 INFO:tasks.workunit.client.1.smithi183.stdout:5/230: chown d4/d1d/d27/d37 748453188 1 2024-02-10T00:00:24.987 INFO:tasks.workunit.client.1.smithi183.stdout:9/203: dwrite d0/f36 [0,4194304] 0 2024-02-10T00:00:24.988 INFO:tasks.workunit.client.1.smithi183.stdout:5/231: dread - d4/f45 zero size 2024-02-10T00:00:24.989 INFO:tasks.workunit.client.1.smithi183.stdout:7/198: creat d0/d11/f36 x:0 0 0 2024-02-10T00:00:24.990 INFO:tasks.workunit.client.1.smithi183.stdout:3/172: mkdir d7/db/d2a/d33 0 2024-02-10T00:00:24.991 INFO:tasks.workunit.client.1.smithi183.stdout:6/178: creat d2/d1a/d3a/f40 x:0 0 0 2024-02-10T00:00:24.993 INFO:tasks.workunit.client.1.smithi183.stdout:9/204: mkdir d0/d3/d14/d3c 0 2024-02-10T00:00:24.995 INFO:tasks.workunit.client.1.smithi183.stdout:2/252: dread d2/da/f17 [0,4194304] 0 2024-02-10T00:00:24.995 INFO:tasks.workunit.client.1.smithi183.stdout:5/232: dwrite d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:24.996 INFO:tasks.workunit.client.1.smithi183.stdout:5/233: read d4/d23/f26 [694347,91329] 0 2024-02-10T00:00:24.997 INFO:tasks.workunit.client.1.smithi183.stdout:4/196: rename de/ff to de/d14/d27/f3d 0 2024-02-10T00:00:24.997 INFO:tasks.workunit.client.1.smithi183.stdout:8/253: rename d0/d3c to d0/d4e 0 2024-02-10T00:00:24.998 INFO:tasks.workunit.client.1.smithi183.stdout:5/234: dread - d4/d1d/d27/d38/f47 zero size 2024-02-10T00:00:25.000 INFO:tasks.workunit.client.1.smithi183.stdout:7/199: unlink d0/d2/d4/d8/l23 0 2024-02-10T00:00:25.000 INFO:tasks.workunit.client.1.smithi183.stdout:7/200: chown d0/d2/f2b 28 1 2024-02-10T00:00:25.003 INFO:tasks.workunit.client.0.smithi164.stdout:5/50: dwrite f1 [0,4194304] 0 2024-02-10T00:00:25.003 INFO:tasks.workunit.client.1.smithi183.stdout:2/253: mknod d2/d33/d35/c50 0 2024-02-10T00:00:25.004 INFO:tasks.workunit.client.0.smithi164.stdout:5/51: rename d7 to d7/df 22 2024-02-10T00:00:25.005 INFO:tasks.workunit.client.1.smithi183.stdout:7/201: dwrite d0/d2/f26 [0,4194304] 0 2024-02-10T00:00:25.005 INFO:tasks.workunit.client.1.smithi183.stdout:3/173: rename l1 to d7/db/d2a/d33/l34 0 2024-02-10T00:00:25.006 INFO:tasks.workunit.client.1.smithi183.stdout:3/174: fsync d7/db/d2a/d1c/f21 0 2024-02-10T00:00:25.007 INFO:tasks.workunit.client.1.smithi183.stdout:3/175: readlink d7/l29 0 2024-02-10T00:00:25.007 INFO:tasks.workunit.client.1.smithi183.stdout:5/235: fsync d4/d23/f21 0 2024-02-10T00:00:25.008 INFO:tasks.workunit.client.1.smithi183.stdout:5/236: chown f1 35990790 1 2024-02-10T00:00:25.008 INFO:tasks.workunit.client.1.smithi183.stdout:6/179: creat d2/d32/f41 x:0 0 0 2024-02-10T00:00:25.009 INFO:tasks.workunit.client.1.smithi183.stdout:7/202: mknod d0/d11/d2f/c37 0 2024-02-10T00:00:25.011 INFO:tasks.workunit.client.1.smithi183.stdout:4/197: creat de/d14/d1d/d2f/f3e x:0 0 0 2024-02-10T00:00:25.012 INFO:tasks.workunit.client.1.smithi183.stdout:4/198: chown de/d14/d27/c1a 5283691 1 2024-02-10T00:00:25.012 INFO:tasks.workunit.client.1.smithi183.stdout:0/182: sync 2024-02-10T00:00:25.013 INFO:tasks.workunit.client.1.smithi183.stdout:4/199: fsync de/d14/d27/f21 0 2024-02-10T00:00:25.014 INFO:tasks.workunit.client.1.smithi183.stdout:6/180: unlink d2/d1a/l2b 0 2024-02-10T00:00:25.014 INFO:tasks.workunit.client.1.smithi183.stdout:7/203: readlink d0/d2/l15 0 2024-02-10T00:00:25.015 INFO:tasks.workunit.client.1.smithi183.stdout:7/204: fsync d0/d2/d3/f28 0 2024-02-10T00:00:25.015 INFO:tasks.workunit.client.1.smithi183.stdout:7/205: read d0/f21 [223596,18995] 0 2024-02-10T00:00:25.016 INFO:tasks.workunit.client.1.smithi183.stdout:9/205: rename d0/c13 to d0/d3/d14/d1c/c3d 0 2024-02-10T00:00:25.017 INFO:tasks.workunit.client.1.smithi183.stdout:4/200: rmdir de/d14 39 2024-02-10T00:00:25.020 INFO:tasks.workunit.client.1.smithi183.stdout:7/206: dwrite d0/d2/d4/f5 [8388608,4194304] 0 2024-02-10T00:00:25.022 INFO:tasks.workunit.client.1.smithi183.stdout:9/206: stat d0/d3/d14/f38 0 2024-02-10T00:00:25.027 INFO:tasks.workunit.client.1.smithi183.stdout:3/176: rename c0 to d7/db/d2a/d1c/c35 0 2024-02-10T00:00:25.027 INFO:tasks.workunit.client.1.smithi183.stdout:3/177: write d7/f12 [2574653,100416] 0 2024-02-10T00:00:25.028 INFO:tasks.workunit.client.1.smithi183.stdout:4/201: read de/f11 [857,39367] 0 2024-02-10T00:00:25.029 INFO:tasks.workunit.client.1.smithi183.stdout:6/181: truncate d2/f18 1577722 0 2024-02-10T00:00:25.030 INFO:tasks.workunit.client.1.smithi183.stdout:4/202: write de/f2c [804825,36389] 0 2024-02-10T00:00:25.032 INFO:tasks.workunit.client.1.smithi183.stdout:3/178: dread d7/f20 [0,4194304] 0 2024-02-10T00:00:25.033 INFO:tasks.workunit.client.0.smithi164.stdout:7/36: fsync d3/d5/f7 0 2024-02-10T00:00:25.033 INFO:tasks.workunit.client.0.smithi164.stdout:7/37: read d3/d5/f7 [846022,41160] 0 2024-02-10T00:00:25.034 INFO:tasks.workunit.client.1.smithi183.stdout:4/203: read - de/d14/d27/f21 zero size 2024-02-10T00:00:25.034 INFO:tasks.workunit.client.1.smithi183.stdout:9/207: link d0/c23 d0/d3/d14/d3c/c3e 0 2024-02-10T00:00:25.035 INFO:tasks.workunit.client.0.smithi164.stdout:9/22: truncate f4 394371 0 2024-02-10T00:00:25.035 INFO:tasks.workunit.client.0.smithi164.stdout:7/38: dread - d3/f9 zero size 2024-02-10T00:00:25.036 INFO:tasks.workunit.client.0.smithi164.stdout:7/39: creat d3/d5/fb x:0 0 0 2024-02-10T00:00:25.036 INFO:tasks.workunit.client.0.smithi164.stdout:9/23: stat f4 0 2024-02-10T00:00:25.036 INFO:tasks.workunit.client.0.smithi164.stdout:7/40: chown d3/f9 507076 1 2024-02-10T00:00:25.037 INFO:tasks.workunit.client.1.smithi183.stdout:3/179: dwrite d7/f30 [4194304,4194304] 0 2024-02-10T00:00:25.037 INFO:tasks.workunit.client.1.smithi183.stdout:3/180: fsync d7/db/f13 0 2024-02-10T00:00:25.039 INFO:tasks.workunit.client.0.smithi164.stdout:7/41: dwrite d3/f4 [0,4194304] 0 2024-02-10T00:00:25.042 INFO:tasks.workunit.client.1.smithi183.stdout:3/181: truncate d7/db/fc 1790502 0 2024-02-10T00:00:25.043 INFO:tasks.workunit.client.0.smithi164.stdout:7/42: symlink d3/lc 0 2024-02-10T00:00:25.043 INFO:tasks.workunit.client.0.smithi164.stdout:6/49: truncate d0/fb 366180 0 2024-02-10T00:00:25.046 INFO:tasks.workunit.client.1.smithi183.stdout:3/182: rename f5 to d7/db/d2a/d33/f36 0 2024-02-10T00:00:25.046 INFO:tasks.workunit.client.1.smithi183.stdout:3/183: chown c4 37410 1 2024-02-10T00:00:25.047 INFO:tasks.workunit.client.0.smithi164.stdout:7/43: dwrite d3/d5/fb [0,4194304] 0 2024-02-10T00:00:25.048 INFO:tasks.workunit.client.1.smithi183.stdout:3/184: chown d7/db/f17 14 1 2024-02-10T00:00:25.050 INFO:tasks.workunit.client.0.smithi164.stdout:7/44: dread d3/d5/fb [0,4194304] 0 2024-02-10T00:00:25.051 INFO:tasks.workunit.client.1.smithi183.stdout:3/185: creat d7/db/d2a/d33/f37 x:0 0 0 2024-02-10T00:00:25.052 INFO:tasks.workunit.client.0.smithi164.stdout:7/45: mknod d3/cd 0 2024-02-10T00:00:25.052 INFO:tasks.workunit.client.0.smithi164.stdout:7/46: stat d3/d5 0 2024-02-10T00:00:25.054 INFO:tasks.workunit.client.0.smithi164.stdout:7/47: creat d3/d5/fe x:0 0 0 2024-02-10T00:00:25.058 INFO:tasks.workunit.client.0.smithi164.stdout:7/48: dwrite d3/f4 [4194304,4194304] 0 2024-02-10T00:00:25.061 INFO:tasks.workunit.client.1.smithi183.stdout:7/207: dread d0/d2/d4/d8/f1d [0,4194304] 0 2024-02-10T00:00:25.061 INFO:tasks.workunit.client.1.smithi183.stdout:5/237: truncate f1 3965093 0 2024-02-10T00:00:25.062 INFO:tasks.workunit.client.1.smithi183.stdout:8/254: write d0/d23/d2d/d24/f28 [2571914,31493] 0 2024-02-10T00:00:25.066 INFO:tasks.workunit.client.1.smithi183.stdout:0/183: truncate d14/d1d/d2d/d31/f3a 184939 0 2024-02-10T00:00:25.069 INFO:tasks.workunit.client.1.smithi183.stdout:6/182: write d2/f24 [990699,76172] 0 2024-02-10T00:00:25.070 INFO:tasks.workunit.client.1.smithi183.stdout:4/204: write de/d19/d1c/f2b [1359936,115232] 0 2024-02-10T00:00:25.070 INFO:tasks.workunit.client.1.smithi183.stdout:6/183: chown d2/d1a/d25 0 1 2024-02-10T00:00:25.070 INFO:tasks.workunit.client.1.smithi183.stdout:6/184: stat d2/d1a/l39 0 2024-02-10T00:00:25.071 INFO:tasks.workunit.client.1.smithi183.stdout:4/205: chown de/d19/d20/f23 198479096 1 2024-02-10T00:00:25.071 INFO:tasks.workunit.client.1.smithi183.stdout:6/185: chown d2/d26 158491 1 2024-02-10T00:00:25.072 INFO:tasks.workunit.client.1.smithi183.stdout:7/208: mkdir d0/d2/d3/d38 0 2024-02-10T00:00:25.072 INFO:tasks.workunit.client.1.smithi183.stdout:7/209: chown d0/d11 8 1 2024-02-10T00:00:25.074 INFO:tasks.workunit.client.1.smithi183.stdout:4/206: fdatasync de/f3c 0 2024-02-10T00:00:25.074 INFO:tasks.workunit.client.0.smithi164.stdout:5/52: truncate f1 2318899 0 2024-02-10T00:00:25.076 INFO:tasks.workunit.client.0.smithi164.stdout:9/24: write f2 [943167,55245] 0 2024-02-10T00:00:25.078 INFO:tasks.workunit.client.0.smithi164.stdout:5/53: dread f5 [0,4194304] 0 2024-02-10T00:00:25.079 INFO:tasks.workunit.client.1.smithi183.stdout:5/238: mkdir d4/d4b 0 2024-02-10T00:00:25.080 INFO:tasks.workunit.client.1.smithi183.stdout:3/186: truncate d7/db/d2a/d1c/f21 450009 0 2024-02-10T00:00:25.081 INFO:tasks.workunit.client.0.smithi164.stdout:9/25: link f2 f5 0 2024-02-10T00:00:25.081 INFO:tasks.workunit.client.0.smithi164.stdout:5/54: rmdir d7 39 2024-02-10T00:00:25.081 INFO:tasks.workunit.client.1.smithi183.stdout:8/255: unlink d0/d45/d46/f47 0 2024-02-10T00:00:25.081 INFO:tasks.workunit.client.1.smithi183.stdout:4/207: dread - de/d19/d1c/f36 zero size 2024-02-10T00:00:25.082 INFO:tasks.workunit.client.0.smithi164.stdout:7/49: write d3/d5/fb [4692720,86140] 0 2024-02-10T00:00:25.083 INFO:tasks.workunit.client.1.smithi183.stdout:5/239: mknod d4/d23/d2a/c4c 0 2024-02-10T00:00:25.083 INFO:tasks.workunit.client.0.smithi164.stdout:7/50: dread - d3/f9 zero size 2024-02-10T00:00:25.083 INFO:tasks.workunit.client.0.smithi164.stdout:7/51: stat d3/lc 0 2024-02-10T00:00:25.084 INFO:tasks.workunit.client.1.smithi183.stdout:7/210: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-02-10T00:00:25.084 INFO:tasks.workunit.client.1.smithi183.stdout:8/256: rmdir d0/d10 39 2024-02-10T00:00:25.085 INFO:tasks.workunit.client.0.smithi164.stdout:9/26: mkdir d6 0 2024-02-10T00:00:25.086 INFO:tasks.workunit.client.1.smithi183.stdout:3/187: mknod d7/db/d2a/d33/c38 0 2024-02-10T00:00:25.086 INFO:tasks.workunit.client.0.smithi164.stdout:6/50: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:25.088 INFO:tasks.workunit.client.0.smithi164.stdout:5/55: write f1 [2096899,72245] 0 2024-02-10T00:00:25.089 INFO:tasks.workunit.client.0.smithi164.stdout:7/52: dwrite d3/f4 [8388608,4194304] 0 2024-02-10T00:00:25.089 INFO:tasks.workunit.client.1.smithi183.stdout:4/208: rmdir de/d19 39 2024-02-10T00:00:25.091 INFO:tasks.workunit.client.1.smithi183.stdout:5/240: creat d4/dd/d31/f4d x:0 0 0 2024-02-10T00:00:25.091 INFO:tasks.workunit.client.1.smithi183.stdout:6/186: dread d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:25.092 INFO:tasks.workunit.client.1.smithi183.stdout:9/208: dwrite d0/d3/d14/d1c/f1f [0,4194304] 0 2024-02-10T00:00:25.095 INFO:tasks.workunit.client.0.smithi164.stdout:6/51: dwrite d0/d6/f8 [0,4194304] 0 2024-02-10T00:00:25.097 INFO:tasks.workunit.client.0.smithi164.stdout:9/27: dwrite f2 [0,4194304] 0 2024-02-10T00:00:25.097 INFO:tasks.workunit.client.0.smithi164.stdout:6/52: stat d0/fb 0 2024-02-10T00:00:25.097 INFO:tasks.workunit.client.1.smithi183.stdout:3/188: dwrite d7/db/f1b [0,4194304] 0 2024-02-10T00:00:25.097 INFO:tasks.workunit.client.1.smithi183.stdout:1/211: dwrite d0/d3/d29/d38/f3b [0,4194304] 0 2024-02-10T00:00:25.099 INFO:tasks.workunit.client.1.smithi183.stdout:3/189: fdatasync d7/db/d2a/d1c/f27 0 2024-02-10T00:00:25.099 INFO:tasks.workunit.client.0.smithi164.stdout:5/56: dwrite d7/fd [0,4194304] 0 2024-02-10T00:00:25.100 INFO:tasks.workunit.client.0.smithi164.stdout:5/57: fdatasync d7/fc 0 2024-02-10T00:00:25.100 INFO:tasks.workunit.client.1.smithi183.stdout:2/254: dwrite d2/f1e [0,4194304] 0 2024-02-10T00:00:25.100 INFO:tasks.workunit.client.0.smithi164.stdout:7/53: getdents d3/d5 0 2024-02-10T00:00:25.101 INFO:tasks.workunit.client.1.smithi183.stdout:3/190: write d7/db/d2a/f23 [671592,100503] 0 2024-02-10T00:00:25.102 INFO:tasks.workunit.client.1.smithi183.stdout:8/257: link d0/d27/f3a d0/d4e/f4f 0 2024-02-10T00:00:25.103 INFO:tasks.workunit.client.0.smithi164.stdout:5/58: dread f1 [0,4194304] 0 2024-02-10T00:00:25.103 INFO:tasks.workunit.client.1.smithi183.stdout:8/258: fdatasync d0/d27/f2e 0 2024-02-10T00:00:25.104 INFO:tasks.workunit.client.1.smithi183.stdout:6/187: write d2/f1e [1089237,97391] 0 2024-02-10T00:00:25.105 INFO:tasks.workunit.client.0.smithi164.stdout:7/54: dwrite d3/d5/fb [0,4194304] 0 2024-02-10T00:00:25.107 INFO:tasks.workunit.client.0.smithi164.stdout:9/28: read f4 [156878,13091] 0 2024-02-10T00:00:25.108 INFO:tasks.workunit.client.1.smithi183.stdout:9/209: rename d0/d10/c21 to d0/d30/c3f 0 2024-02-10T00:00:25.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/55: rmdir d3/d5 39 2024-02-10T00:00:25.111 INFO:tasks.workunit.client.1.smithi183.stdout:4/209: unlink de/d19/f31 0 2024-02-10T00:00:25.112 INFO:tasks.workunit.client.1.smithi183.stdout:0/184: sync 2024-02-10T00:00:25.115 INFO:tasks.workunit.client.1.smithi183.stdout:8/259: symlink d0/d4e/l50 0 2024-02-10T00:00:25.116 INFO:tasks.workunit.client.0.smithi164.stdout:9/29: getdents d6 0 2024-02-10T00:00:25.116 INFO:tasks.workunit.client.0.smithi164.stdout:5/59: link l2 d7/l10 0 2024-02-10T00:00:25.116 INFO:tasks.workunit.client.0.smithi164.stdout:5/60: chown d7/ce 113436462 1 2024-02-10T00:00:25.117 INFO:tasks.workunit.client.0.smithi164.stdout:7/56: creat d3/ff x:0 0 0 2024-02-10T00:00:25.118 INFO:tasks.workunit.client.0.smithi164.stdout:9/30: creat d6/f7 x:0 0 0 2024-02-10T00:00:25.120 INFO:tasks.workunit.client.0.smithi164.stdout:7/57: dread - d3/d5/fe zero size 2024-02-10T00:00:25.120 INFO:tasks.workunit.client.0.smithi164.stdout:5/61: dread f5 [0,4194304] 0 2024-02-10T00:00:25.121 INFO:tasks.workunit.client.1.smithi183.stdout:6/188: creat d2/d1a/d25/d3c/f42 x:0 0 0 2024-02-10T00:00:25.121 INFO:tasks.workunit.client.1.smithi183.stdout:5/241: mkdir d4/d1d/d27/d37/d46/d4e 0 2024-02-10T00:00:25.122 INFO:tasks.workunit.client.1.smithi183.stdout:5/242: write d4/d1d/f3f [198711,111397] 0 2024-02-10T00:00:25.123 INFO:tasks.workunit.client.0.smithi164.stdout:9/31: dwrite f2 [0,4194304] 0 2024-02-10T00:00:25.124 INFO:tasks.workunit.client.0.smithi164.stdout:9/32: chown d6/f7 3 1 2024-02-10T00:00:25.127 INFO:tasks.workunit.client.1.smithi183.stdout:2/255: fdatasync d2/d2c/d2d/f4f 0 2024-02-10T00:00:25.128 INFO:tasks.workunit.client.0.smithi164.stdout:7/58: symlink d3/l10 0 2024-02-10T00:00:25.129 INFO:tasks.workunit.client.1.smithi183.stdout:8/260: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:25.129 INFO:tasks.workunit.client.1.smithi183.stdout:2/256: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:25.129 INFO:tasks.workunit.client.1.smithi183.stdout:5/243: mkdir d4/d1d/d27/d38/d4f 0 2024-02-10T00:00:25.130 INFO:tasks.workunit.client.0.smithi164.stdout:5/62: link d7/l10 d7/l11 0 2024-02-10T00:00:25.131 INFO:tasks.workunit.client.0.smithi164.stdout:7/59: mkdir d3/d11 0 2024-02-10T00:00:25.132 INFO:tasks.workunit.client.1.smithi183.stdout:0/185: symlink d14/d46/d1a/d22/l4a 0 2024-02-10T00:00:25.134 INFO:tasks.workunit.client.0.smithi164.stdout:5/63: dwrite f0 [4194304,4194304] 0 2024-02-10T00:00:25.134 INFO:tasks.workunit.client.0.smithi164.stdout:7/60: mknod d3/d11/c12 0 2024-02-10T00:00:25.135 INFO:tasks.workunit.client.0.smithi164.stdout:7/61: chown d3/d11 36 1 2024-02-10T00:00:25.135 INFO:tasks.workunit.client.0.smithi164.stdout:7/62: write d3/f4 [4226327,114738] 0 2024-02-10T00:00:25.137 INFO:tasks.workunit.client.0.smithi164.stdout:5/64: symlink d7/l12 0 2024-02-10T00:00:25.138 INFO:tasks.workunit.client.1.smithi183.stdout:8/261: unlink d0/fb 0 2024-02-10T00:00:25.140 INFO:tasks.workunit.client.1.smithi183.stdout:2/257: rename d2/l41 to d2/da/d19/l51 0 2024-02-10T00:00:25.141 INFO:tasks.workunit.client.0.smithi164.stdout:5/65: mknod d7/c13 0 2024-02-10T00:00:25.142 INFO:tasks.workunit.client.1.smithi183.stdout:5/244: mknod d4/d1d/d27/d38/c50 0 2024-02-10T00:00:25.142 INFO:tasks.workunit.client.1.smithi183.stdout:5/245: fdatasync d4/dd/f1b 0 2024-02-10T00:00:25.143 INFO:tasks.workunit.client.1.smithi183.stdout:3/191: getdents d7/db 0 2024-02-10T00:00:25.144 INFO:tasks.workunit.client.0.smithi164.stdout:7/63: creat d3/f13 x:0 0 0 2024-02-10T00:00:25.144 INFO:tasks.workunit.client.1.smithi183.stdout:3/192: write d7/fd [1001392,111657] 0 2024-02-10T00:00:25.144 INFO:tasks.workunit.client.0.smithi164.stdout:7/64: chown d3/l10 15979673 1 2024-02-10T00:00:25.146 INFO:tasks.workunit.client.1.smithi183.stdout:8/262: mkdir d0/d23/d51 0 2024-02-10T00:00:25.147 INFO:tasks.workunit.client.0.smithi164.stdout:7/65: creat d3/d11/f14 x:0 0 0 2024-02-10T00:00:25.148 INFO:tasks.workunit.client.1.smithi183.stdout:5/246: rename d4/f1e to d4/d1d/d27/d37/f51 0 2024-02-10T00:00:25.150 INFO:tasks.workunit.client.1.smithi183.stdout:2/258: dwrite d2/da/f17 [0,4194304] 0 2024-02-10T00:00:25.150 INFO:tasks.workunit.client.0.smithi164.stdout:7/66: creat d3/f15 x:0 0 0 2024-02-10T00:00:25.151 INFO:tasks.workunit.client.1.smithi183.stdout:2/259: write d2/d2c/d2f/f3b [720431,53741] 0 2024-02-10T00:00:25.151 INFO:tasks.workunit.client.1.smithi183.stdout:8/263: unlink d0/d3f/l42 0 2024-02-10T00:00:25.152 INFO:tasks.workunit.client.1.smithi183.stdout:8/264: dread - d0/d3f/f43 zero size 2024-02-10T00:00:25.152 INFO:tasks.workunit.client.1.smithi183.stdout:8/265: chown d0/f1e 8681 1 2024-02-10T00:00:25.154 INFO:tasks.workunit.client.1.smithi183.stdout:5/247: unlink d4/f6 0 2024-02-10T00:00:25.158 INFO:tasks.workunit.client.1.smithi183.stdout:2/260: dread d2/da/d20/d21/f23 [0,4194304] 0 2024-02-10T00:00:25.160 INFO:tasks.workunit.client.1.smithi183.stdout:3/193: link d7/db/d2a/l1a d7/l39 0 2024-02-10T00:00:25.162 INFO:tasks.workunit.client.1.smithi183.stdout:5/248: symlink d4/l52 0 2024-02-10T00:00:25.162 INFO:tasks.workunit.client.1.smithi183.stdout:8/266: creat d0/f52 x:0 0 0 2024-02-10T00:00:25.164 INFO:tasks.workunit.client.1.smithi183.stdout:8/267: mkdir d0/d4e/d53 0 2024-02-10T00:00:25.166 INFO:tasks.workunit.client.1.smithi183.stdout:3/194: getdents d7/db/d2a/d1c 0 2024-02-10T00:00:25.167 INFO:tasks.workunit.client.1.smithi183.stdout:5/249: dwrite d4/d1d/d27/d38/f47 [0,4194304] 0 2024-02-10T00:00:25.167 INFO:tasks.workunit.client.1.smithi183.stdout:8/268: creat d0/d23/d2d/d24/f54 x:0 0 0 2024-02-10T00:00:25.169 INFO:tasks.workunit.client.1.smithi183.stdout:8/269: symlink d0/d4e/l55 0 2024-02-10T00:00:25.171 INFO:tasks.workunit.client.1.smithi183.stdout:3/195: dread d7/db/f13 [0,4194304] 0 2024-02-10T00:00:25.175 INFO:tasks.workunit.client.1.smithi183.stdout:7/211: truncate d0/d2/f1a 1889329 0 2024-02-10T00:00:25.175 INFO:tasks.workunit.client.1.smithi183.stdout:7/212: readlink d0/d11/l31 0 2024-02-10T00:00:25.178 INFO:tasks.workunit.client.1.smithi183.stdout:7/213: rename d0/d2/l15 to d0/d2/d3/l39 0 2024-02-10T00:00:25.183 INFO:tasks.workunit.client.1.smithi183.stdout:7/214: dwrite d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:25.185 INFO:tasks.workunit.client.1.smithi183.stdout:7/215: creat d0/d11/f3a x:0 0 0 2024-02-10T00:00:25.206 INFO:tasks.workunit.client.1.smithi183.stdout:3/196: dread d7/db/f17 [4194304,4194304] 0 2024-02-10T00:00:25.208 INFO:tasks.workunit.client.1.smithi183.stdout:3/197: creat d7/db/d2a/f3a x:0 0 0 2024-02-10T00:00:25.209 INFO:tasks.workunit.client.1.smithi183.stdout:3/198: write d7/db/d2a/d33/f37 [131572,105156] 0 2024-02-10T00:00:25.209 INFO:tasks.workunit.client.1.smithi183.stdout:3/199: chown d7 9783 1 2024-02-10T00:00:25.212 INFO:tasks.workunit.client.1.smithi183.stdout:3/200: dread d7/db/f1b [0,4194304] 0 2024-02-10T00:00:25.216 INFO:tasks.workunit.client.1.smithi183.stdout:3/201: link d7/l29 d7/db/d2a/l3b 0 2024-02-10T00:00:25.216 INFO:tasks.workunit.client.1.smithi183.stdout:3/202: write d7/f9 [1416341,122632] 0 2024-02-10T00:00:25.217 INFO:tasks.workunit.client.1.smithi183.stdout:3/203: chown d7/db/d2a/f23 107 1 2024-02-10T00:00:25.217 INFO:tasks.workunit.client.1.smithi183.stdout:3/204: write d7/f8 [2867115,103520] 0 2024-02-10T00:00:25.222 INFO:tasks.workunit.client.0.smithi164.stdout:6/53: truncate d0/d6/f8 3293557 0 2024-02-10T00:00:25.223 INFO:tasks.workunit.client.0.smithi164.stdout:9/33: fsync f5 0 2024-02-10T00:00:25.224 INFO:tasks.workunit.client.0.smithi164.stdout:9/34: stat f4 0 2024-02-10T00:00:25.224 INFO:tasks.workunit.client.0.smithi164.stdout:9/35: chown f4 61963 1 2024-02-10T00:00:25.226 INFO:tasks.workunit.client.1.smithi183.stdout:4/210: write de/f1f [4257684,7754] 0 2024-02-10T00:00:25.226 INFO:tasks.workunit.client.1.smithi183.stdout:6/189: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:25.229 INFO:tasks.workunit.client.1.smithi183.stdout:4/211: readlink de/d14/d1d/l34 0 2024-02-10T00:00:25.229 INFO:tasks.workunit.client.1.smithi183.stdout:0/186: getdents d14/d46/d1a/d22 0 2024-02-10T00:00:25.229 INFO:tasks.workunit.client.1.smithi183.stdout:1/212: dwrite d0/d3/fa [0,4194304] 0 2024-02-10T00:00:25.230 INFO:tasks.workunit.client.0.smithi164.stdout:5/66: truncate f0 1892421 0 2024-02-10T00:00:25.231 INFO:tasks.workunit.client.1.smithi183.stdout:9/210: dwrite d0/d3/f24 [0,4194304] 0 2024-02-10T00:00:25.232 INFO:tasks.workunit.client.1.smithi183.stdout:1/213: dread - d0/d3/d29/f51 zero size 2024-02-10T00:00:25.232 INFO:tasks.workunit.client.0.smithi164.stdout:7/67: rmdir d3/d11 39 2024-02-10T00:00:25.235 INFO:tasks.workunit.client.1.smithi183.stdout:0/187: dread d14/d46/d1a/f27 [0,4194304] 0 2024-02-10T00:00:25.236 INFO:tasks.workunit.client.0.smithi164.stdout:6/54: dwrite d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:25.239 INFO:tasks.workunit.client.1.smithi183.stdout:2/261: truncate d2/d2c/d2f/f3b 638106 0 2024-02-10T00:00:25.240 INFO:tasks.workunit.client.0.smithi164.stdout:7/68: creat d3/f16 x:0 0 0 2024-02-10T00:00:25.240 INFO:tasks.workunit.client.1.smithi183.stdout:5/250: write d4/dd/f14 [823466,77403] 0 2024-02-10T00:00:25.244 INFO:tasks.workunit.client.1.smithi183.stdout:3/205: dread f6 [0,4194304] 0 2024-02-10T00:00:25.244 INFO:tasks.workunit.client.1.smithi183.stdout:8/270: truncate d0/d23/d2d/d24/f32 626501 0 2024-02-10T00:00:25.244 INFO:tasks.workunit.client.0.smithi164.stdout:7/69: dwrite d3/f13 [0,4194304] 0 2024-02-10T00:00:25.245 INFO:tasks.workunit.client.1.smithi183.stdout:8/271: write d0/d23/d2d/f21 [1351230,18034] 0 2024-02-10T00:00:25.245 INFO:tasks.workunit.client.1.smithi183.stdout:8/272: chown d0/d27 914247 1 2024-02-10T00:00:25.246 INFO:tasks.workunit.client.1.smithi183.stdout:8/273: readlink d0/d10/l16 0 2024-02-10T00:00:25.247 INFO:tasks.workunit.client.0.smithi164.stdout:7/70: truncate d3/fa 44307 0 2024-02-10T00:00:25.248 INFO:tasks.workunit.client.1.smithi183.stdout:6/190: creat d2/d1a/f43 x:0 0 0 2024-02-10T00:00:25.248 INFO:tasks.workunit.client.1.smithi183.stdout:3/206: dwrite d7/db/d2a/f2b [0,4194304] 0 2024-02-10T00:00:25.250 INFO:tasks.workunit.client.0.smithi164.stdout:7/71: creat d3/d5/f17 x:0 0 0 2024-02-10T00:00:25.250 INFO:tasks.workunit.client.0.smithi164.stdout:7/72: write d3/f4 [3940328,46292] 0 2024-02-10T00:00:25.251 INFO:tasks.workunit.client.1.smithi183.stdout:1/214: creat d0/d3/d29/d1f/f55 x:0 0 0 2024-02-10T00:00:25.253 INFO:tasks.workunit.client.1.smithi183.stdout:0/188: symlink d14/l4b 0 2024-02-10T00:00:25.254 INFO:tasks.workunit.client.1.smithi183.stdout:0/189: fsync d14/d46/d1a/d22/f48 0 2024-02-10T00:00:25.254 INFO:tasks.workunit.client.1.smithi183.stdout:6/191: dwrite d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:25.256 INFO:tasks.workunit.client.0.smithi164.stdout:7/73: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:25.257 INFO:tasks.workunit.client.1.smithi183.stdout:8/274: mknod d0/d23/d2d/d24/c56 0 2024-02-10T00:00:25.257 INFO:tasks.workunit.client.1.smithi183.stdout:8/275: readlink d0/d31/l34 0 2024-02-10T00:00:25.258 INFO:tasks.workunit.client.1.smithi183.stdout:3/207: write d7/db/f1b [701626,116471] 0 2024-02-10T00:00:25.258 INFO:tasks.workunit.client.0.smithi164.stdout:7/74: write d3/d11/f14 [890264,89717] 0 2024-02-10T00:00:25.261 INFO:tasks.workunit.client.1.smithi183.stdout:1/215: symlink d0/d3c/l56 0 2024-02-10T00:00:25.261 INFO:tasks.workunit.client.1.smithi183.stdout:1/216: chown d0/d3a 128135727 1 2024-02-10T00:00:25.261 INFO:tasks.workunit.client.1.smithi183.stdout:0/190: dwrite d14/f17 [0,4194304] 0 2024-02-10T00:00:25.262 INFO:tasks.workunit.client.1.smithi183.stdout:0/191: stat d14/d46/d1a/c30 0 2024-02-10T00:00:25.264 INFO:tasks.workunit.client.1.smithi183.stdout:0/192: write d14/d46/d1a/d22/f44 [928471,103462] 0 2024-02-10T00:00:25.266 INFO:tasks.workunit.client.1.smithi183.stdout:6/192: dwrite d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:25.268 INFO:tasks.workunit.client.1.smithi183.stdout:6/193: write d2/f16 [99965,9282] 0 2024-02-10T00:00:25.268 INFO:tasks.workunit.client.1.smithi183.stdout:6/194: stat d2/d1a/d25/f36 0 2024-02-10T00:00:25.270 INFO:tasks.workunit.client.1.smithi183.stdout:3/208: dread d7/fd [0,4194304] 0 2024-02-10T00:00:25.271 INFO:tasks.workunit.client.1.smithi183.stdout:2/262: creat d2/d2c/f52 x:0 0 0 2024-02-10T00:00:25.271 INFO:tasks.workunit.client.1.smithi183.stdout:5/251: dread d4/f20 [0,4194304] 0 2024-02-10T00:00:25.274 INFO:tasks.workunit.client.0.smithi164.stdout:9/36: truncate f5 4274519 0 2024-02-10T00:00:25.274 INFO:tasks.workunit.client.0.smithi164.stdout:5/67: write f1 [566813,84961] 0 2024-02-10T00:00:25.274 INFO:tasks.workunit.client.1.smithi183.stdout:9/211: dread d0/f32 [0,4194304] 0 2024-02-10T00:00:25.275 INFO:tasks.workunit.client.1.smithi183.stdout:1/217: unlink d0/d3/l6 0 2024-02-10T00:00:25.275 INFO:tasks.workunit.client.0.smithi164.stdout:6/55: truncate d0/fb 381634 0 2024-02-10T00:00:25.276 INFO:tasks.workunit.client.1.smithi183.stdout:9/212: readlink d0/d3/l7 0 2024-02-10T00:00:25.276 INFO:tasks.workunit.client.1.smithi183.stdout:6/195: dwrite d2/d1a/f20 [0,4194304] 0 2024-02-10T00:00:25.276 INFO:tasks.workunit.client.1.smithi183.stdout:1/218: chown d0/d3/d7/l20 196 1 2024-02-10T00:00:25.276 INFO:tasks.workunit.client.0.smithi164.stdout:9/37: mknod d6/c8 0 2024-02-10T00:00:25.277 INFO:tasks.workunit.client.1.smithi183.stdout:6/196: write d2/d1a/f43 [650189,100319] 0 2024-02-10T00:00:25.278 INFO:tasks.workunit.client.1.smithi183.stdout:4/212: sync 2024-02-10T00:00:25.280 INFO:tasks.workunit.client.0.smithi164.stdout:6/56: fdatasync d0/d6/f7 0 2024-02-10T00:00:25.281 INFO:tasks.workunit.client.1.smithi183.stdout:2/263: creat d2/da/d20/d21/d36/f53 x:0 0 0 2024-02-10T00:00:25.282 INFO:tasks.workunit.client.1.smithi183.stdout:9/213: dread d0/f2b [0,4194304] 0 2024-02-10T00:00:25.282 INFO:tasks.workunit.client.0.smithi164.stdout:5/68: truncate d7/fc 746009 0 2024-02-10T00:00:25.283 INFO:tasks.workunit.client.1.smithi183.stdout:1/219: dwrite d0/d3/fa [4194304,4194304] 0 2024-02-10T00:00:25.283 INFO:tasks.workunit.client.1.smithi183.stdout:6/197: write d2/f30 [5272972,4456] 0 2024-02-10T00:00:25.285 INFO:tasks.workunit.client.1.smithi183.stdout:3/209: unlink d7/db/d2a/l2e 0 2024-02-10T00:00:25.286 INFO:tasks.workunit.client.0.smithi164.stdout:6/57: getdents d0/d6 0 2024-02-10T00:00:25.286 INFO:tasks.workunit.client.1.smithi183.stdout:4/213: creat de/d14/d27/d2e/f3f x:0 0 0 2024-02-10T00:00:25.288 INFO:tasks.workunit.client.1.smithi183.stdout:5/252: link d4/dd/d31/f4d d4/d23/d4a/f53 0 2024-02-10T00:00:25.291 INFO:tasks.workunit.client.1.smithi183.stdout:6/198: dwrite d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:25.291 INFO:tasks.workunit.client.1.smithi183.stdout:8/276: getdents d0/d45/d46 0 2024-02-10T00:00:25.291 INFO:tasks.workunit.client.1.smithi183.stdout:6/199: chown d2/d32 62328582 1 2024-02-10T00:00:25.291 INFO:tasks.workunit.client.1.smithi183.stdout:5/253: chown d4/d23/f21 855 1 2024-02-10T00:00:25.291 INFO:tasks.workunit.client.0.smithi164.stdout:6/58: dwrite d0/fc [0,4194304] 0 2024-02-10T00:00:25.293 INFO:tasks.workunit.client.1.smithi183.stdout:4/214: write de/d19/d20/f23 [1386475,119189] 0 2024-02-10T00:00:25.293 INFO:tasks.workunit.client.1.smithi183.stdout:2/264: creat d2/da/f54 x:0 0 0 2024-02-10T00:00:25.293 INFO:tasks.workunit.client.1.smithi183.stdout:5/254: chown d4/d1d/d27/d37/d46 597392421 1 2024-02-10T00:00:25.297 INFO:tasks.workunit.client.1.smithi183.stdout:1/220: dwrite d0/f17 [0,4194304] 0 2024-02-10T00:00:25.299 INFO:tasks.workunit.client.1.smithi183.stdout:6/200: dread d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:25.299 INFO:tasks.workunit.client.1.smithi183.stdout:8/277: rename d0/d23/f37 to d0/d3f/f57 0 2024-02-10T00:00:25.301 INFO:tasks.workunit.client.1.smithi183.stdout:2/265: dread d2/da/f17 [0,4194304] 0 2024-02-10T00:00:25.302 INFO:tasks.workunit.client.1.smithi183.stdout:4/215: mkdir de/d14/d27/d40 0 2024-02-10T00:00:25.303 INFO:tasks.workunit.client.1.smithi183.stdout:6/201: dread d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:25.303 INFO:tasks.workunit.client.1.smithi183.stdout:5/255: creat d4/dd/f54 x:0 0 0 2024-02-10T00:00:25.304 INFO:tasks.workunit.client.1.smithi183.stdout:4/216: chown de/d19/d1c/c2d 1580 1 2024-02-10T00:00:25.305 INFO:tasks.workunit.client.1.smithi183.stdout:1/221: dwrite d0/d3/d7/f23 [0,4194304] 0 2024-02-10T00:00:25.308 INFO:tasks.workunit.client.1.smithi183.stdout:1/222: write d0/d3/d7/d36/f4d [79115,67318] 0 2024-02-10T00:00:25.308 INFO:tasks.workunit.client.1.smithi183.stdout:9/214: link d0/d30/c3f d0/d3/d14/d1c/d2d/c40 0 2024-02-10T00:00:25.308 INFO:tasks.workunit.client.1.smithi183.stdout:2/266: mkdir d2/da/d19/d31/d55 0 2024-02-10T00:00:25.310 INFO:tasks.workunit.client.1.smithi183.stdout:2/267: chown d2/d2c/l49 23358 1 2024-02-10T00:00:25.310 INFO:tasks.workunit.client.1.smithi183.stdout:6/202: dwrite d2/f30 [4194304,4194304] 0 2024-02-10T00:00:25.311 INFO:tasks.workunit.client.1.smithi183.stdout:6/203: readlink d2/l1d 0 2024-02-10T00:00:25.311 INFO:tasks.workunit.client.1.smithi183.stdout:4/217: symlink de/d14/d1d/d2f/l41 0 2024-02-10T00:00:25.313 INFO:tasks.workunit.client.1.smithi183.stdout:9/215: rename d0/d3/d14/d1c/c27 to d0/d3/d14/d1c/c41 0 2024-02-10T00:00:25.313 INFO:tasks.workunit.client.1.smithi183.stdout:4/218: write de/d14/d27/d2e/f3f [95914,42497] 0 2024-02-10T00:00:25.314 INFO:tasks.workunit.client.1.smithi183.stdout:4/219: fdatasync de/f1f 0 2024-02-10T00:00:25.314 INFO:tasks.workunit.client.1.smithi183.stdout:2/268: mkdir d2/da/d20/d21/d36/d56 0 2024-02-10T00:00:25.318 INFO:tasks.workunit.client.1.smithi183.stdout:4/220: readlink de/d14/d1d/l35 0 2024-02-10T00:00:25.319 INFO:tasks.workunit.client.1.smithi183.stdout:2/269: chown d2/da/d19/l51 37598 1 2024-02-10T00:00:25.320 INFO:tasks.workunit.client.1.smithi183.stdout:4/221: fdatasync de/d14/d27/f3d 0 2024-02-10T00:00:25.321 INFO:tasks.workunit.client.1.smithi183.stdout:2/270: symlink d2/da/d19/d31/l57 0 2024-02-10T00:00:25.321 INFO:tasks.workunit.client.1.smithi183.stdout:6/204: truncate d2/d1a/d3a/f40 305136 0 2024-02-10T00:00:25.322 INFO:tasks.workunit.client.1.smithi183.stdout:4/222: symlink de/d22/l42 0 2024-02-10T00:00:25.322 INFO:tasks.workunit.client.1.smithi183.stdout:2/271: read d2/f3a [212834,24323] 0 2024-02-10T00:00:25.326 INFO:tasks.workunit.client.1.smithi183.stdout:4/223: dread de/d22/f25 [0,4194304] 0 2024-02-10T00:00:25.327 INFO:tasks.workunit.client.1.smithi183.stdout:2/272: dread d2/f1e [0,4194304] 0 2024-02-10T00:00:25.327 INFO:tasks.workunit.client.1.smithi183.stdout:6/205: getdents d2/d1a/d25/d3c/d31/d38 0 2024-02-10T00:00:25.328 INFO:tasks.workunit.client.1.smithi183.stdout:0/193: dread d14/f20 [0,4194304] 0 2024-02-10T00:00:25.328 INFO:tasks.workunit.client.1.smithi183.stdout:0/194: chown c10 491846 1 2024-02-10T00:00:25.329 INFO:tasks.workunit.client.1.smithi183.stdout:2/273: unlink d2/da/f54 0 2024-02-10T00:00:25.330 INFO:tasks.workunit.client.1.smithi183.stdout:6/206: mknod d2/d26/d35/c44 0 2024-02-10T00:00:25.331 INFO:tasks.workunit.client.1.smithi183.stdout:0/195: symlink d14/d46/l4c 0 2024-02-10T00:00:25.332 INFO:tasks.workunit.client.1.smithi183.stdout:2/274: unlink l1 0 2024-02-10T00:00:25.335 INFO:tasks.workunit.client.1.smithi183.stdout:4/224: dwrite de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:25.336 INFO:tasks.workunit.client.1.smithi183.stdout:6/207: mkdir d2/d1a/d3a/d45 0 2024-02-10T00:00:25.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/225: creat de/d22/f43 x:0 0 0 2024-02-10T00:00:25.336 INFO:tasks.workunit.client.1.smithi183.stdout:2/275: mkdir d2/da/d20/d21/d43/d58 0 2024-02-10T00:00:25.337 INFO:tasks.workunit.client.1.smithi183.stdout:4/226: write de/d19/d20/f23 [1790153,1254] 0 2024-02-10T00:00:25.338 INFO:tasks.workunit.client.1.smithi183.stdout:4/227: write de/d19/d1c/f2b [56968,30127] 0 2024-02-10T00:00:25.339 INFO:tasks.workunit.client.1.smithi183.stdout:4/228: fdatasync de/d19/d1c/f39 0 2024-02-10T00:00:25.339 INFO:tasks.workunit.client.1.smithi183.stdout:6/208: unlink d2/l9 0 2024-02-10T00:00:25.340 INFO:tasks.workunit.client.1.smithi183.stdout:2/276: write d2/da/f25 [602428,74777] 0 2024-02-10T00:00:25.341 INFO:tasks.workunit.client.1.smithi183.stdout:2/277: dread - d2/da/d20/d21/d36/f53 zero size 2024-02-10T00:00:25.345 INFO:tasks.workunit.client.1.smithi183.stdout:4/229: dwrite de/d19/d20/f23 [0,4194304] 0 2024-02-10T00:00:25.345 INFO:tasks.workunit.client.1.smithi183.stdout:2/278: rmdir d2/da/d20/d21/d36/d56 0 2024-02-10T00:00:25.346 INFO:tasks.workunit.client.1.smithi183.stdout:2/279: stat d2/d33/d35 0 2024-02-10T00:00:25.346 INFO:tasks.workunit.client.1.smithi183.stdout:2/280: dread - d2/f4a zero size 2024-02-10T00:00:25.349 INFO:tasks.workunit.client.1.smithi183.stdout:2/281: mknod d2/da/d19/c59 0 2024-02-10T00:00:25.350 INFO:tasks.workunit.client.1.smithi183.stdout:4/230: dwrite de/d19/d20/f26 [0,4194304] 0 2024-02-10T00:00:25.351 INFO:tasks.workunit.client.1.smithi183.stdout:4/231: fdatasync de/d19/f30 0 2024-02-10T00:00:25.353 INFO:tasks.workunit.client.1.smithi183.stdout:2/282: mkdir d2/da/d20/d21/d43/d5a 0 2024-02-10T00:00:25.355 INFO:tasks.workunit.client.1.smithi183.stdout:2/283: mkdir d2/da/d5b 0 2024-02-10T00:00:25.360 INFO:tasks.workunit.client.1.smithi183.stdout:2/284: dwrite d2/da/d20/d21/d43/f45 [4194304,4194304] 0 2024-02-10T00:00:25.365 INFO:tasks.workunit.client.1.smithi183.stdout:2/285: symlink d2/da/d20/l5c 0 2024-02-10T00:00:25.366 INFO:tasks.workunit.client.0.smithi164.stdout:6/59: write d0/fb [573754,112389] 0 2024-02-10T00:00:25.367 INFO:tasks.workunit.client.0.smithi164.stdout:6/60: chown d0/d6 24196782 1 2024-02-10T00:00:25.369 INFO:tasks.workunit.client.0.smithi164.stdout:9/38: dread f5 [0,4194304] 0 2024-02-10T00:00:25.369 INFO:tasks.workunit.client.1.smithi183.stdout:2/286: fdatasync d2/f3a 0 2024-02-10T00:00:25.369 INFO:tasks.workunit.client.0.smithi164.stdout:6/61: symlink d0/d6/le 0 2024-02-10T00:00:25.371 INFO:tasks.workunit.client.1.smithi183.stdout:5/256: dread d4/dd/d31/f34 [0,4194304] 0 2024-02-10T00:00:25.371 INFO:tasks.workunit.client.0.smithi164.stdout:6/62: symlink d0/lf 0 2024-02-10T00:00:25.372 INFO:tasks.workunit.client.1.smithi183.stdout:5/257: chown d4/d23/d4a/l3c 187 1 2024-02-10T00:00:25.372 INFO:tasks.workunit.client.0.smithi164.stdout:9/39: dread f2 [0,4194304] 0 2024-02-10T00:00:25.373 INFO:tasks.workunit.client.1.smithi183.stdout:5/258: mknod d4/d1d/d27/c55 0 2024-02-10T00:00:25.374 INFO:tasks.workunit.client.0.smithi164.stdout:6/63: creat d0/d6/f10 x:0 0 0 2024-02-10T00:00:25.374 INFO:tasks.workunit.client.1.smithi183.stdout:5/259: chown d4/d23/d3e 13812 1 2024-02-10T00:00:25.375 INFO:tasks.workunit.client.0.smithi164.stdout:9/40: fsync f4 0 2024-02-10T00:00:25.376 INFO:tasks.workunit.client.0.smithi164.stdout:6/64: creat d0/f11 x:0 0 0 2024-02-10T00:00:25.377 INFO:tasks.workunit.client.0.smithi164.stdout:6/65: write d0/f5 [767931,39578] 0 2024-02-10T00:00:25.379 INFO:tasks.workunit.client.0.smithi164.stdout:9/41: rmdir d6 39 2024-02-10T00:00:25.382 INFO:tasks.workunit.client.0.smithi164.stdout:6/66: mkdir d0/d6/d12 0 2024-02-10T00:00:25.382 INFO:tasks.workunit.client.1.smithi183.stdout:5/260: mknod d4/d23/d3e/c56 0 2024-02-10T00:00:25.382 INFO:tasks.workunit.client.0.smithi164.stdout:6/67: creat d0/d6/f13 x:0 0 0 2024-02-10T00:00:25.384 INFO:tasks.workunit.client.0.smithi164.stdout:9/42: link f2 d6/f9 0 2024-02-10T00:00:25.386 INFO:tasks.workunit.client.0.smithi164.stdout:9/43: unlink d6/c8 0 2024-02-10T00:00:25.395 INFO:tasks.workunit.client.1.smithi183.stdout:7/216: truncate d0/d2/f17 5173239 0 2024-02-10T00:00:25.401 INFO:tasks.workunit.client.0.smithi164.stdout:9/44: dwrite f4 [0,4194304] 0 2024-02-10T00:00:25.401 INFO:tasks.workunit.client.0.smithi164.stdout:9/45: readlink - no filename 2024-02-10T00:00:25.402 INFO:tasks.workunit.client.1.smithi183.stdout:3/210: truncate d7/db/f1b 4283835 0 2024-02-10T00:00:25.402 INFO:tasks.workunit.client.1.smithi183.stdout:3/211: chown d7/f12 170 1 2024-02-10T00:00:25.403 INFO:tasks.workunit.client.1.smithi183.stdout:4/232: dread de/d19/d1c/f2b [0,4194304] 0 2024-02-10T00:00:25.403 INFO:tasks.workunit.client.1.smithi183.stdout:2/287: dread d2/da/f1d [0,4194304] 0 2024-02-10T00:00:25.405 INFO:tasks.workunit.client.1.smithi183.stdout:3/212: fsync d7/f20 0 2024-02-10T00:00:25.406 INFO:tasks.workunit.client.1.smithi183.stdout:3/213: chown d7/f9 8053 1 2024-02-10T00:00:25.406 INFO:tasks.workunit.client.1.smithi183.stdout:9/216: rmdir d0/d30 39 2024-02-10T00:00:25.407 INFO:tasks.workunit.client.1.smithi183.stdout:3/214: stat d7/db/d2a/d1c/f27 0 2024-02-10T00:00:25.407 INFO:tasks.workunit.client.1.smithi183.stdout:9/217: fdatasync d0/f2f 0 2024-02-10T00:00:25.408 INFO:tasks.workunit.client.0.smithi164.stdout:9/46: dwrite d6/f7 [0,4194304] 0 2024-02-10T00:00:25.408 INFO:tasks.workunit.client.1.smithi183.stdout:3/215: fsync d7/db/d2a/f2c 0 2024-02-10T00:00:25.409 INFO:tasks.workunit.client.1.smithi183.stdout:9/218: chown d0/d3/d14/d1c/d2d/l37 361 1 2024-02-10T00:00:25.409 INFO:tasks.workunit.client.1.smithi183.stdout:8/278: write d0/f1b [4940744,115381] 0 2024-02-10T00:00:25.409 INFO:tasks.workunit.client.1.smithi183.stdout:8/279: read - d0/d23/d2d/f2c zero size 2024-02-10T00:00:25.410 INFO:tasks.workunit.client.1.smithi183.stdout:8/280: write d0/f2f [323790,58933] 0 2024-02-10T00:00:25.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/47: dread d6/f9 [0,4194304] 0 2024-02-10T00:00:25.411 INFO:tasks.workunit.client.1.smithi183.stdout:2/288: unlink d2/d2c/f52 0 2024-02-10T00:00:25.415 INFO:tasks.workunit.client.1.smithi183.stdout:1/223: truncate d0/d3/d29/f51 983620 0 2024-02-10T00:00:25.423 INFO:tasks.workunit.client.1.smithi183.stdout:0/196: dwrite d14/d1d/f2b [0,4194304] 0 2024-02-10T00:00:25.427 INFO:tasks.workunit.client.1.smithi183.stdout:6/209: dwrite d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:25.429 INFO:tasks.workunit.client.1.smithi183.stdout:5/261: write d4/d1d/d27/d38/f48 [1150895,79457] 0 2024-02-10T00:00:25.429 INFO:tasks.workunit.client.1.smithi183.stdout:3/216: creat d7/db/d2a/f3c x:0 0 0 2024-02-10T00:00:25.430 INFO:tasks.workunit.client.1.smithi183.stdout:5/262: write d4/dd/f1b [469363,26884] 0 2024-02-10T00:00:25.431 INFO:tasks.workunit.client.1.smithi183.stdout:5/263: dread - d4/d23/f3b zero size 2024-02-10T00:00:25.431 INFO:tasks.workunit.client.1.smithi183.stdout:5/264: chown d4/l3a 909330849 1 2024-02-10T00:00:25.433 INFO:tasks.workunit.client.1.smithi183.stdout:7/217: truncate d0/f1 5063088 0 2024-02-10T00:00:25.434 INFO:tasks.workunit.client.1.smithi183.stdout:7/218: dread - d0/d11/f3a zero size 2024-02-10T00:00:25.434 INFO:tasks.workunit.client.1.smithi183.stdout:9/219: creat d0/d10/f42 x:0 0 0 2024-02-10T00:00:25.438 INFO:tasks.workunit.client.1.smithi183.stdout:1/224: creat d0/d3/d7/d2c/f57 x:0 0 0 2024-02-10T00:00:25.440 INFO:tasks.workunit.client.1.smithi183.stdout:0/197: symlink d14/d46/d3c/d3f/l4d 0 2024-02-10T00:00:25.442 INFO:tasks.workunit.client.1.smithi183.stdout:6/210: symlink d2/d1a/d3a/l46 0 2024-02-10T00:00:25.443 INFO:tasks.workunit.client.1.smithi183.stdout:6/211: write d2/d1a/f43 [2702891,15508] 0 2024-02-10T00:00:25.447 INFO:tasks.workunit.client.1.smithi183.stdout:5/265: creat d4/d1d/d27/f57 x:0 0 0 2024-02-10T00:00:25.448 INFO:tasks.workunit.client.1.smithi183.stdout:7/219: symlink d0/l3b 0 2024-02-10T00:00:25.449 INFO:tasks.workunit.client.1.smithi183.stdout:9/220: mknod d0/d10/c43 0 2024-02-10T00:00:25.450 INFO:tasks.workunit.client.1.smithi183.stdout:4/233: link de/d22/l42 de/l44 0 2024-02-10T00:00:25.459 INFO:tasks.workunit.client.1.smithi183.stdout:3/217: rmdir d7/db/d2a 39 2024-02-10T00:00:25.460 INFO:tasks.workunit.client.1.smithi183.stdout:6/212: dread - d2/d1a/f1f zero size 2024-02-10T00:00:25.461 INFO:tasks.workunit.client.1.smithi183.stdout:6/213: chown d2/d26 10199516 1 2024-02-10T00:00:25.463 INFO:tasks.workunit.client.1.smithi183.stdout:9/221: chown d0/c17 128574 1 2024-02-10T00:00:25.464 INFO:tasks.workunit.client.1.smithi183.stdout:9/222: stat d0/d10/c43 0 2024-02-10T00:00:25.464 INFO:tasks.workunit.client.1.smithi183.stdout:4/234: creat de/d14/d27/f45 x:0 0 0 2024-02-10T00:00:25.467 INFO:tasks.workunit.client.1.smithi183.stdout:7/220: creat d0/d2/d4/f3c x:0 0 0 2024-02-10T00:00:25.469 INFO:tasks.workunit.client.1.smithi183.stdout:6/214: rename d2/d1a/d25/d3c/d31/d38/f3e to d2/d26/d34/f47 0 2024-02-10T00:00:25.470 INFO:tasks.workunit.client.1.smithi183.stdout:8/281: getdents d0/d23 0 2024-02-10T00:00:25.470 INFO:tasks.workunit.client.1.smithi183.stdout:2/289: getdents d2/d33 0 2024-02-10T00:00:25.471 INFO:tasks.workunit.client.1.smithi183.stdout:1/225: creat d0/d3/d7/f58 x:0 0 0 2024-02-10T00:00:25.472 INFO:tasks.workunit.client.1.smithi183.stdout:6/215: chown d2/d1a/d25/d3c/d31/d38 0 1 2024-02-10T00:00:25.472 INFO:tasks.workunit.client.1.smithi183.stdout:8/282: write d0/f2f [1145609,117082] 0 2024-02-10T00:00:25.472 INFO:tasks.workunit.client.1.smithi183.stdout:0/198: dwrite d14/d1d/d2d/d31/f3a [0,4194304] 0 2024-02-10T00:00:25.473 INFO:tasks.workunit.client.1.smithi183.stdout:3/218: mknod d7/c3d 0 2024-02-10T00:00:25.474 INFO:tasks.workunit.client.1.smithi183.stdout:0/199: stat d14/d46/d1a/c30 0 2024-02-10T00:00:25.474 INFO:tasks.workunit.client.1.smithi183.stdout:7/221: chown d0/d2/f17 13147 1 2024-02-10T00:00:25.475 INFO:tasks.workunit.client.1.smithi183.stdout:0/200: dread - d14/d46/d1a/d22/f48 zero size 2024-02-10T00:00:25.476 INFO:tasks.workunit.client.1.smithi183.stdout:0/201: chown d14/d46/d3c/d3f/l4d 964867207 1 2024-02-10T00:00:25.476 INFO:tasks.workunit.client.1.smithi183.stdout:4/235: dread de/f12 [0,4194304] 0 2024-02-10T00:00:25.478 INFO:tasks.workunit.client.1.smithi183.stdout:9/223: symlink d0/l44 0 2024-02-10T00:00:25.479 INFO:tasks.workunit.client.1.smithi183.stdout:5/266: getdents d4/dd/d31 0 2024-02-10T00:00:25.479 INFO:tasks.workunit.client.1.smithi183.stdout:7/222: dwrite d0/f32 [0,4194304] 0 2024-02-10T00:00:25.481 INFO:tasks.workunit.client.1.smithi183.stdout:1/226: chown d0/d3/d7/d36/l27 8656226 1 2024-02-10T00:00:25.482 INFO:tasks.workunit.client.1.smithi183.stdout:8/283: mknod d0/d27/d36/c58 0 2024-02-10T00:00:25.487 INFO:tasks.workunit.client.1.smithi183.stdout:9/224: dwrite d0/f3a [0,4194304] 0 2024-02-10T00:00:25.488 INFO:tasks.workunit.client.1.smithi183.stdout:7/223: rmdir d0 39 2024-02-10T00:00:25.491 INFO:tasks.workunit.client.1.smithi183.stdout:2/290: unlink d2/da/d19/c59 0 2024-02-10T00:00:25.495 INFO:tasks.workunit.client.1.smithi183.stdout:9/225: creat d0/d3/d14/d1c/f45 x:0 0 0 2024-02-10T00:00:25.495 INFO:tasks.workunit.client.1.smithi183.stdout:9/226: chown d0/f36 1041 1 2024-02-10T00:00:25.498 INFO:tasks.workunit.client.1.smithi183.stdout:3/219: link d7/f9 d7/f3e 0 2024-02-10T00:00:25.500 INFO:tasks.workunit.client.1.smithi183.stdout:7/224: write d0/d2/d3/f28 [4866504,127140] 0 2024-02-10T00:00:25.500 INFO:tasks.workunit.client.1.smithi183.stdout:9/227: rmdir d0/d3/d14/d3c 39 2024-02-10T00:00:25.501 INFO:tasks.workunit.client.1.smithi183.stdout:2/291: creat d2/da/d19/d31/d55/f5d x:0 0 0 2024-02-10T00:00:25.504 INFO:tasks.workunit.client.1.smithi183.stdout:7/225: unlink d0/d2/d4/d8/f1d 0 2024-02-10T00:00:25.506 INFO:tasks.workunit.client.1.smithi183.stdout:2/292: rename d2/da/d20/d21/d43 to d2/da/d20/d21/d43/d5e 22 2024-02-10T00:00:25.508 INFO:tasks.workunit.client.1.smithi183.stdout:7/226: mknod d0/d11/c3d 0 2024-02-10T00:00:25.510 INFO:tasks.workunit.client.1.smithi183.stdout:9/228: creat d0/d3/d14/f46 x:0 0 0 2024-02-10T00:00:25.513 INFO:tasks.workunit.client.1.smithi183.stdout:2/293: symlink d2/d2c/d2f/l5f 0 2024-02-10T00:00:25.514 INFO:tasks.workunit.client.1.smithi183.stdout:1/227: write d0/f1c [1369238,82387] 0 2024-02-10T00:00:25.515 INFO:tasks.workunit.client.1.smithi183.stdout:4/236: truncate de/d14/d27/d2e/f3f 74118 0 2024-02-10T00:00:25.515 INFO:tasks.workunit.client.1.smithi183.stdout:9/229: dwrite d0/f36 [0,4194304] 0 2024-02-10T00:00:25.515 INFO:tasks.workunit.client.1.smithi183.stdout:2/294: write d2/f3a [1374288,25998] 0 2024-02-10T00:00:25.516 INFO:tasks.workunit.client.1.smithi183.stdout:4/237: fsync de/d19/f30 0 2024-02-10T00:00:25.517 INFO:tasks.workunit.client.1.smithi183.stdout:5/267: truncate d4/d23/d4a/f1f 742264 0 2024-02-10T00:00:25.517 INFO:tasks.workunit.client.1.smithi183.stdout:8/284: write d0/d10/f12 [1007475,42872] 0 2024-02-10T00:00:25.518 INFO:tasks.workunit.client.1.smithi183.stdout:4/238: write f0 [1862276,95409] 0 2024-02-10T00:00:25.519 INFO:tasks.workunit.client.1.smithi183.stdout:4/239: readlink de/d14/d1d/d2f/l41 0 2024-02-10T00:00:25.523 INFO:tasks.workunit.client.1.smithi183.stdout:1/228: unlink d0/d3/d29/d1f/f55 0 2024-02-10T00:00:25.523 INFO:tasks.workunit.client.1.smithi183.stdout:1/229: fsync d0/f1c 0 2024-02-10T00:00:25.524 INFO:tasks.workunit.client.1.smithi183.stdout:9/230: mknod d0/d3/d14/d3c/c47 0 2024-02-10T00:00:25.527 INFO:tasks.workunit.client.1.smithi183.stdout:3/220: link d7/db/d2a/d1c/c35 d7/db/d2a/d1c/c3f 0 2024-02-10T00:00:25.530 INFO:tasks.workunit.client.1.smithi183.stdout:8/285: rename d0/d10/f12 to d0/d23/d2d/d24/f59 0 2024-02-10T00:00:25.530 INFO:tasks.workunit.client.1.smithi183.stdout:4/240: mknod de/d14/d27/d2e/c46 0 2024-02-10T00:00:25.531 INFO:tasks.workunit.client.1.smithi183.stdout:8/286: write d0/d23/d2d/f21 [1504515,20668] 0 2024-02-10T00:00:25.543 INFO:tasks.workunit.client.1.smithi183.stdout:5/268: link d4/dd/f54 d4/d23/d2a/f58 0 2024-02-10T00:00:25.543 INFO:tasks.workunit.client.1.smithi183.stdout:3/221: mknod d7/db/d2a/d33/c40 0 2024-02-10T00:00:25.544 INFO:tasks.workunit.client.1.smithi183.stdout:5/269: dread - d4/d23/f3b zero size 2024-02-10T00:00:25.544 INFO:tasks.workunit.client.1.smithi183.stdout:7/227: rmdir d0/d2/d4/d8 39 2024-02-10T00:00:25.545 INFO:tasks.workunit.client.1.smithi183.stdout:9/231: mkdir d0/d3/d14/d48 0 2024-02-10T00:00:25.545 INFO:tasks.workunit.client.1.smithi183.stdout:4/241: write de/d22/f25 [2772603,46281] 0 2024-02-10T00:00:25.546 INFO:tasks.workunit.client.1.smithi183.stdout:8/287: write d0/d23/d2d/d24/f59 [1936291,87912] 0 2024-02-10T00:00:25.546 INFO:tasks.workunit.client.1.smithi183.stdout:3/222: write d7/db/d2a/f3a [30622,129001] 0 2024-02-10T00:00:25.548 INFO:tasks.workunit.client.1.smithi183.stdout:3/223: dread - d7/db/d2a/d2d/f2f zero size 2024-02-10T00:00:25.550 INFO:tasks.workunit.client.1.smithi183.stdout:4/242: dread de/f12 [0,4194304] 0 2024-02-10T00:00:25.550 INFO:tasks.workunit.client.1.smithi183.stdout:3/224: write d7/f30 [9022831,60814] 0 2024-02-10T00:00:25.552 INFO:tasks.workunit.client.1.smithi183.stdout:1/230: rename d0/d3a/l3f to d0/d3/d29/l59 0 2024-02-10T00:00:25.553 INFO:tasks.workunit.client.1.smithi183.stdout:5/270: dwrite d4/d1d/d27/d38/f47 [0,4194304] 0 2024-02-10T00:00:25.554 INFO:tasks.workunit.client.1.smithi183.stdout:1/231: stat d0/c1e 0 2024-02-10T00:00:25.554 INFO:tasks.workunit.client.1.smithi183.stdout:4/243: dread de/d14/d27/f1b [0,4194304] 0 2024-02-10T00:00:25.557 INFO:tasks.workunit.client.1.smithi183.stdout:7/228: mkdir d0/d11/d3e 0 2024-02-10T00:00:25.557 INFO:tasks.workunit.client.1.smithi183.stdout:7/229: chown d0/d11/c14 195333 1 2024-02-10T00:00:25.558 INFO:tasks.workunit.client.1.smithi183.stdout:7/230: fsync d0/d11/f1c 0 2024-02-10T00:00:25.560 INFO:tasks.workunit.client.1.smithi183.stdout:9/232: mknod d0/d3/d14/d1c/d2d/c49 0 2024-02-10T00:00:25.561 INFO:tasks.workunit.client.1.smithi183.stdout:2/295: getdents d2/da/d20/d21/d43 0 2024-02-10T00:00:25.562 INFO:tasks.workunit.client.1.smithi183.stdout:2/296: chown d2/d2c/d2f 357578 1 2024-02-10T00:00:25.562 INFO:tasks.workunit.client.1.smithi183.stdout:2/297: chown d2/l4c 42357 1 2024-02-10T00:00:25.562 INFO:tasks.workunit.client.1.smithi183.stdout:2/298: stat d2/d2c/l49 0 2024-02-10T00:00:25.563 INFO:tasks.workunit.client.1.smithi183.stdout:5/271: mknod d4/d23/d2a/c59 0 2024-02-10T00:00:25.563 INFO:tasks.workunit.client.1.smithi183.stdout:8/288: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:25.566 INFO:tasks.workunit.client.1.smithi183.stdout:9/233: symlink d0/d3/d14/d1c/l4a 0 2024-02-10T00:00:25.566 INFO:tasks.workunit.client.1.smithi183.stdout:3/225: truncate d7/f3e 2248759 0 2024-02-10T00:00:25.568 INFO:tasks.workunit.client.1.smithi183.stdout:2/299: mkdir d2/d2c/d2f/d60 0 2024-02-10T00:00:25.571 INFO:tasks.workunit.client.1.smithi183.stdout:5/272: symlink d4/d1d/d27/d37/d46/l5a 0 2024-02-10T00:00:25.571 INFO:tasks.workunit.client.1.smithi183.stdout:5/273: fsync d4/dd/f32 0 2024-02-10T00:00:25.575 INFO:tasks.workunit.client.1.smithi183.stdout:5/274: dwrite d4/dd/f32 [0,4194304] 0 2024-02-10T00:00:25.576 INFO:tasks.workunit.client.1.smithi183.stdout:7/231: write d0/f1 [5764223,46] 0 2024-02-10T00:00:25.576 INFO:tasks.workunit.client.1.smithi183.stdout:5/275: read - d4/f45 zero size 2024-02-10T00:00:25.576 INFO:tasks.workunit.client.1.smithi183.stdout:5/276: fdatasync f3 0 2024-02-10T00:00:25.578 INFO:tasks.workunit.client.1.smithi183.stdout:3/226: unlink d7/db/d2a/f23 0 2024-02-10T00:00:25.579 INFO:tasks.workunit.client.1.smithi183.stdout:6/216: sync 2024-02-10T00:00:25.579 INFO:tasks.workunit.client.1.smithi183.stdout:1/232: rename d0/d3/d7/d2c/f57 to d0/f5a 0 2024-02-10T00:00:25.582 INFO:tasks.workunit.client.1.smithi183.stdout:4/244: link de/f3c de/d14/f47 0 2024-02-10T00:00:25.585 INFO:tasks.workunit.client.1.smithi183.stdout:7/232: creat d0/d2/d3/f3f x:0 0 0 2024-02-10T00:00:25.587 INFO:tasks.workunit.client.1.smithi183.stdout:4/245: dread de/f2c [0,4194304] 0 2024-02-10T00:00:25.588 INFO:tasks.workunit.client.1.smithi183.stdout:5/277: mkdir d4/d23/d2a/d5b 0 2024-02-10T00:00:25.588 INFO:tasks.workunit.client.1.smithi183.stdout:5/278: chown d4/d23/d4a/l12 561 1 2024-02-10T00:00:25.591 INFO:tasks.workunit.client.1.smithi183.stdout:1/233: creat d0/d3/d7/d3d/f5b x:0 0 0 2024-02-10T00:00:25.593 INFO:tasks.workunit.client.1.smithi183.stdout:3/227: dwrite d7/fe [0,4194304] 0 2024-02-10T00:00:25.600 INFO:tasks.workunit.client.1.smithi183.stdout:2/300: rmdir d2/da/d20/d21/d43/d5a 0 2024-02-10T00:00:25.600 INFO:tasks.workunit.client.1.smithi183.stdout:8/289: dwrite d0/d23/d2d/d24/f32 [0,4194304] 0 2024-02-10T00:00:25.602 INFO:tasks.workunit.client.1.smithi183.stdout:1/234: write d0/d3/d7/f4a [429955,119680] 0 2024-02-10T00:00:25.604 INFO:tasks.workunit.client.1.smithi183.stdout:4/246: symlink de/d14/d27/d40/l48 0 2024-02-10T00:00:25.605 INFO:tasks.workunit.client.1.smithi183.stdout:5/279: creat d4/d4b/f5c x:0 0 0 2024-02-10T00:00:25.605 INFO:tasks.workunit.client.1.smithi183.stdout:4/247: fdatasync de/d22/f28 0 2024-02-10T00:00:25.606 INFO:tasks.workunit.client.1.smithi183.stdout:7/233: dread d0/d2/f2b [0,4194304] 0 2024-02-10T00:00:25.607 INFO:tasks.workunit.client.1.smithi183.stdout:8/290: mknod d0/d23/d2d/d24/c5a 0 2024-02-10T00:00:25.608 INFO:tasks.workunit.client.1.smithi183.stdout:7/234: stat d0/d2/d3/f3f 0 2024-02-10T00:00:25.608 INFO:tasks.workunit.client.1.smithi183.stdout:1/235: dread d0/d3/f2d [0,4194304] 0 2024-02-10T00:00:25.608 INFO:tasks.workunit.client.1.smithi183.stdout:9/234: getdents d0/d30 0 2024-02-10T00:00:25.610 INFO:tasks.workunit.client.1.smithi183.stdout:6/217: getdents d2 0 2024-02-10T00:00:25.610 INFO:tasks.workunit.client.1.smithi183.stdout:1/236: read d0/d3/d7/d36/f4d [116980,56762] 0 2024-02-10T00:00:25.611 INFO:tasks.workunit.client.1.smithi183.stdout:3/228: truncate d7/db/d2a/d33/f36 3145100 0 2024-02-10T00:00:25.611 INFO:tasks.workunit.client.1.smithi183.stdout:0/202: sync 2024-02-10T00:00:25.612 INFO:tasks.workunit.client.1.smithi183.stdout:5/280: mkdir d4/d1d/d27/d5d 0 2024-02-10T00:00:25.612 INFO:tasks.workunit.client.1.smithi183.stdout:2/301: mkdir d2/da/d20/d61 0 2024-02-10T00:00:25.613 INFO:tasks.workunit.client.1.smithi183.stdout:2/302: stat d2/l4c 0 2024-02-10T00:00:25.613 INFO:tasks.workunit.client.1.smithi183.stdout:7/235: mknod d0/d11/c40 0 2024-02-10T00:00:25.615 INFO:tasks.workunit.client.1.smithi183.stdout:6/218: creat d2/d1a/d3a/f48 x:0 0 0 2024-02-10T00:00:25.618 INFO:tasks.workunit.client.1.smithi183.stdout:0/203: rename d14/d1d/l45 to d14/l4e 0 2024-02-10T00:00:25.619 INFO:tasks.workunit.client.1.smithi183.stdout:8/291: mkdir d0/d23/d51/d5b 0 2024-02-10T00:00:25.622 INFO:tasks.workunit.client.0.smithi164.stdout:9/48: mknod d6/ca 0 2024-02-10T00:00:25.624 INFO:tasks.workunit.client.1.smithi183.stdout:7/236: write d0/d2/d4/d8/f13 [5060395,81992] 0 2024-02-10T00:00:25.625 INFO:tasks.workunit.client.0.smithi164.stdout:9/49: rename f4 to d6/fb 0 2024-02-10T00:00:25.626 INFO:tasks.workunit.client.1.smithi183.stdout:1/237: link d0/f5a d0/d3/d29/d1f/f5c 0 2024-02-10T00:00:25.627 INFO:tasks.workunit.client.0.smithi164.stdout:9/50: creat d6/fc x:0 0 0 2024-02-10T00:00:25.628 INFO:tasks.workunit.client.1.smithi183.stdout:5/281: creat d4/d23/d4a/d36/f5e x:0 0 0 2024-02-10T00:00:25.629 INFO:tasks.workunit.client.1.smithi183.stdout:8/292: symlink d0/d23/d51/l5c 0 2024-02-10T00:00:25.629 INFO:tasks.workunit.client.1.smithi183.stdout:9/235: getdents d0/d3 0 2024-02-10T00:00:25.633 INFO:tasks.workunit.client.0.smithi164.stdout:9/51: dwrite d6/f7 [0,4194304] 0 2024-02-10T00:00:25.638 INFO:tasks.workunit.client.0.smithi164.stdout:9/52: dread d6/fb [0,4194304] 0 2024-02-10T00:00:25.639 INFO:tasks.workunit.client.1.smithi183.stdout:3/229: creat d7/db/f41 x:0 0 0 2024-02-10T00:00:25.640 INFO:tasks.workunit.client.1.smithi183.stdout:4/248: getdents de/d14/d27 0 2024-02-10T00:00:25.641 INFO:tasks.workunit.client.0.smithi164.stdout:9/53: creat d6/fd x:0 0 0 2024-02-10T00:00:25.643 INFO:tasks.workunit.client.1.smithi183.stdout:2/303: truncate d2/d2c/d2f/f3b 771038 0 2024-02-10T00:00:25.645 INFO:tasks.workunit.client.1.smithi183.stdout:9/236: mkdir d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:25.646 INFO:tasks.workunit.client.1.smithi183.stdout:9/237: chown d0/d30/f39 93 1 2024-02-10T00:00:25.646 INFO:tasks.workunit.client.1.smithi183.stdout:5/282: dread f0 [0,4194304] 0 2024-02-10T00:00:25.646 INFO:tasks.workunit.client.1.smithi183.stdout:0/204: truncate fb 3135655 0 2024-02-10T00:00:25.647 INFO:tasks.workunit.client.1.smithi183.stdout:0/205: write d14/d1d/f32 [287989,65137] 0 2024-02-10T00:00:25.648 INFO:tasks.workunit.client.1.smithi183.stdout:8/293: rename d0/d27/d36/f48 to d0/d23/d51/d5b/f5d 0 2024-02-10T00:00:25.649 INFO:tasks.workunit.client.1.smithi183.stdout:3/230: mknod d7/db/d2a/d2d/c42 0 2024-02-10T00:00:25.650 INFO:tasks.workunit.client.1.smithi183.stdout:4/249: symlink de/d14/d27/d2e/l49 0 2024-02-10T00:00:25.650 INFO:tasks.workunit.client.1.smithi183.stdout:4/250: chown de/d14/d1d/c3a 539331216 1 2024-02-10T00:00:25.651 INFO:tasks.workunit.client.1.smithi183.stdout:2/304: write d2/f8 [2826142,79022] 0 2024-02-10T00:00:25.651 INFO:tasks.workunit.client.1.smithi183.stdout:2/305: stat d2/f8 0 2024-02-10T00:00:25.651 INFO:tasks.workunit.client.1.smithi183.stdout:4/251: chown de/d14/d27/d2e 10 1 2024-02-10T00:00:25.653 INFO:tasks.workunit.client.1.smithi183.stdout:5/283: creat d4/d23/d4a/f5f x:0 0 0 2024-02-10T00:00:25.654 INFO:tasks.workunit.client.1.smithi183.stdout:0/206: creat d14/d46/d1a/d22/f4f x:0 0 0 2024-02-10T00:00:25.655 INFO:tasks.workunit.client.1.smithi183.stdout:0/207: dread - f6 zero size 2024-02-10T00:00:25.655 INFO:tasks.workunit.client.1.smithi183.stdout:7/237: creat d0/d2/f41 x:0 0 0 2024-02-10T00:00:25.657 INFO:tasks.workunit.client.1.smithi183.stdout:9/238: rename d0/d3/l7 to d0/d3/d14/d1c/d4b/l4c 0 2024-02-10T00:00:25.661 INFO:tasks.workunit.client.1.smithi183.stdout:3/231: rmdir d7/db/d2a/d2d 39 2024-02-10T00:00:25.663 INFO:tasks.workunit.client.1.smithi183.stdout:1/238: sync 2024-02-10T00:00:25.663 INFO:tasks.workunit.client.1.smithi183.stdout:6/219: sync 2024-02-10T00:00:25.664 INFO:tasks.workunit.client.1.smithi183.stdout:1/239: write d0/d3/d7/f58 [1005966,27579] 0 2024-02-10T00:00:25.666 INFO:tasks.workunit.client.1.smithi183.stdout:5/284: creat d4/d4b/f60 x:0 0 0 2024-02-10T00:00:25.667 INFO:tasks.workunit.client.1.smithi183.stdout:0/208: symlink d14/d43/l50 0 2024-02-10T00:00:25.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/220: dwrite d2/f1e [0,4194304] 0 2024-02-10T00:00:25.668 INFO:tasks.workunit.client.1.smithi183.stdout:0/209: readlink d14/d43/l50 0 2024-02-10T00:00:25.669 INFO:tasks.workunit.client.1.smithi183.stdout:6/221: dread - d2/d1a/d3a/f48 zero size 2024-02-10T00:00:25.670 INFO:tasks.workunit.client.1.smithi183.stdout:1/240: symlink d0/d3a/l5d 0 2024-02-10T00:00:25.671 INFO:tasks.workunit.client.1.smithi183.stdout:1/241: readlink d0/d3/d7/l20 0 2024-02-10T00:00:25.671 INFO:tasks.workunit.client.1.smithi183.stdout:5/285: creat d4/d1d/d27/d38/f61 x:0 0 0 2024-02-10T00:00:25.672 INFO:tasks.workunit.client.1.smithi183.stdout:1/242: fsync d0/d3/d7/d3d/f5b 0 2024-02-10T00:00:25.673 INFO:tasks.workunit.client.1.smithi183.stdout:2/306: creat d2/da/f62 x:0 0 0 2024-02-10T00:00:25.674 INFO:tasks.workunit.client.1.smithi183.stdout:2/307: chown d2/da/d20/d21/d43/d58 570 1 2024-02-10T00:00:25.675 INFO:tasks.workunit.client.1.smithi183.stdout:2/308: write d2/d3d/f42 [353013,89203] 0 2024-02-10T00:00:25.676 INFO:tasks.workunit.client.1.smithi183.stdout:3/232: symlink d7/db/d2a/d2d/l43 0 2024-02-10T00:00:25.679 INFO:tasks.workunit.client.1.smithi183.stdout:6/222: creat d2/d1a/f49 x:0 0 0 2024-02-10T00:00:25.679 INFO:tasks.workunit.client.1.smithi183.stdout:8/294: getdents d0/d23/d51 0 2024-02-10T00:00:25.681 INFO:tasks.workunit.client.1.smithi183.stdout:1/243: symlink d0/d3/d7/d36/l5e 0 2024-02-10T00:00:25.681 INFO:tasks.workunit.client.1.smithi183.stdout:8/295: dread - d0/d23/d2d/d24/f54 zero size 2024-02-10T00:00:25.684 INFO:tasks.workunit.client.1.smithi183.stdout:3/233: stat d7/db/d2a/d2d/f31 0 2024-02-10T00:00:25.684 INFO:tasks.workunit.client.1.smithi183.stdout:7/238: dread d0/d2/f1a [0,4194304] 0 2024-02-10T00:00:25.684 INFO:tasks.workunit.client.1.smithi183.stdout:4/252: getdents de/d14/d27/d40 0 2024-02-10T00:00:25.685 INFO:tasks.workunit.client.1.smithi183.stdout:9/239: dwrite d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:25.686 INFO:tasks.workunit.client.1.smithi183.stdout:5/286: creat d4/d1d/d27/d37/d46/d4e/f62 x:0 0 0 2024-02-10T00:00:25.687 INFO:tasks.workunit.client.1.smithi183.stdout:6/223: dread d2/f16 [0,4194304] 0 2024-02-10T00:00:25.687 INFO:tasks.workunit.client.1.smithi183.stdout:9/240: dread - d0/d3/d14/f46 zero size 2024-02-10T00:00:25.689 INFO:tasks.workunit.client.1.smithi183.stdout:8/296: creat d0/d10/f5e x:0 0 0 2024-02-10T00:00:25.689 INFO:tasks.workunit.client.1.smithi183.stdout:6/224: write d2/d1a/d25/f36 [311685,122944] 0 2024-02-10T00:00:25.692 INFO:tasks.workunit.client.1.smithi183.stdout:9/241: dread d0/d3/d14/d1c/f1f [0,4194304] 0 2024-02-10T00:00:25.693 INFO:tasks.workunit.client.1.smithi183.stdout:2/309: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:25.695 INFO:tasks.workunit.client.1.smithi183.stdout:6/225: read d2/d1a/d3a/f40 [268983,70393] 0 2024-02-10T00:00:25.696 INFO:tasks.workunit.client.1.smithi183.stdout:0/210: dread d14/d46/f25 [0,4194304] 0 2024-02-10T00:00:25.697 INFO:tasks.workunit.client.1.smithi183.stdout:8/297: mknod d0/d45/d46/c5f 0 2024-02-10T00:00:25.700 INFO:tasks.workunit.client.1.smithi183.stdout:4/253: creat de/d14/f4a x:0 0 0 2024-02-10T00:00:25.701 INFO:tasks.workunit.client.1.smithi183.stdout:9/242: creat d0/d3/d14/d1c/d2d/f4d x:0 0 0 2024-02-10T00:00:25.701 INFO:tasks.workunit.client.1.smithi183.stdout:2/310: mknod d2/da/d20/d21/d43/c63 0 2024-02-10T00:00:25.702 INFO:tasks.workunit.client.1.smithi183.stdout:6/226: mknod d2/d1a/c4a 0 2024-02-10T00:00:25.704 INFO:tasks.workunit.client.1.smithi183.stdout:5/287: write d4/f20 [1397563,76506] 0 2024-02-10T00:00:25.705 INFO:tasks.workunit.client.1.smithi183.stdout:8/298: symlink d0/d4e/l60 0 2024-02-10T00:00:25.706 INFO:tasks.workunit.client.1.smithi183.stdout:3/234: truncate d7/db/d2a/d1c/f1e 600220 0 2024-02-10T00:00:25.707 INFO:tasks.workunit.client.1.smithi183.stdout:1/244: getdents d0/d3/d29/d38 0 2024-02-10T00:00:25.710 INFO:tasks.workunit.client.1.smithi183.stdout:6/227: creat d2/f4b x:0 0 0 2024-02-10T00:00:25.711 INFO:tasks.workunit.client.1.smithi183.stdout:5/288: symlink d4/d1d/d27/d37/d46/d4e/l63 0 2024-02-10T00:00:25.711 INFO:tasks.workunit.client.1.smithi183.stdout:8/299: rmdir d0/d27 39 2024-02-10T00:00:25.713 INFO:tasks.workunit.client.1.smithi183.stdout:3/235: read d7/db/d2a/d1c/f21 [226502,3046] 0 2024-02-10T00:00:25.714 INFO:tasks.workunit.client.1.smithi183.stdout:9/243: fdatasync d0/f1d 0 2024-02-10T00:00:25.716 INFO:tasks.workunit.client.1.smithi183.stdout:7/239: truncate d0/d2/d3/f28 4044413 0 2024-02-10T00:00:25.718 INFO:tasks.workunit.client.1.smithi183.stdout:0/211: dwrite f3 [0,4194304] 0 2024-02-10T00:00:25.721 INFO:tasks.workunit.client.1.smithi183.stdout:9/244: creat d0/d3/f4e x:0 0 0 2024-02-10T00:00:25.722 INFO:tasks.workunit.client.1.smithi183.stdout:2/311: rmdir d2/da/d20/d61 0 2024-02-10T00:00:25.722 INFO:tasks.workunit.client.1.smithi183.stdout:2/312: chown d2 31548 1 2024-02-10T00:00:25.722 INFO:tasks.workunit.client.1.smithi183.stdout:9/245: chown d0/d3/d14/d1c/d2d/c49 3 1 2024-02-10T00:00:25.723 INFO:tasks.workunit.client.1.smithi183.stdout:0/212: mkdir d14/d46/d1a/d51 0 2024-02-10T00:00:25.723 INFO:tasks.workunit.client.1.smithi183.stdout:9/246: chown d0/f3b 30 1 2024-02-10T00:00:25.723 INFO:tasks.workunit.client.1.smithi183.stdout:8/300: dwrite d0/d23/d51/d5b/f5d [0,4194304] 0 2024-02-10T00:00:25.726 INFO:tasks.workunit.client.1.smithi183.stdout:7/240: symlink d0/d2/l42 0 2024-02-10T00:00:25.726 INFO:tasks.workunit.client.1.smithi183.stdout:8/301: mkdir d0/d4e/d61 0 2024-02-10T00:00:25.727 INFO:tasks.workunit.client.1.smithi183.stdout:9/247: mkdir d0/d3/d14/d1c/d2d/d4f 0 2024-02-10T00:00:25.728 INFO:tasks.workunit.client.1.smithi183.stdout:0/213: dread d14/d46/d1a/f1b [0,4194304] 0 2024-02-10T00:00:25.728 INFO:tasks.workunit.client.0.smithi164.stdout:9/54: dwrite f5 [0,4194304] 0 2024-02-10T00:00:25.731 INFO:tasks.workunit.client.1.smithi183.stdout:5/289: truncate d4/d23/d2a/f49 261378 0 2024-02-10T00:00:25.733 INFO:tasks.workunit.client.1.smithi183.stdout:9/248: creat d0/d10/f50 x:0 0 0 2024-02-10T00:00:25.735 INFO:tasks.workunit.client.1.smithi183.stdout:8/302: dwrite d0/d3f/f57 [0,4194304] 0 2024-02-10T00:00:25.736 INFO:tasks.workunit.client.0.smithi164.stdout:9/55: truncate d6/f7 1214203 0 2024-02-10T00:00:25.736 INFO:tasks.workunit.client.1.smithi183.stdout:8/303: write d0/d10/f1a [754263,32464] 0 2024-02-10T00:00:25.737 INFO:tasks.workunit.client.0.smithi164.stdout:9/56: write d6/fc [826238,67216] 0 2024-02-10T00:00:25.738 INFO:tasks.workunit.client.1.smithi183.stdout:7/241: rename d0/d2/d3/f28 to d0/d2/d3/f43 0 2024-02-10T00:00:25.738 INFO:tasks.workunit.client.1.smithi183.stdout:7/242: readlink d0/l3b 0 2024-02-10T00:00:25.739 INFO:tasks.workunit.client.0.smithi164.stdout:9/57: mkdir d6/de 0 2024-02-10T00:00:25.739 INFO:tasks.workunit.client.1.smithi183.stdout:9/249: mkdir d0/d3/d14/d1c/d4b/d51 0 2024-02-10T00:00:25.740 INFO:tasks.workunit.client.1.smithi183.stdout:8/304: mkdir d0/d23/d62 0 2024-02-10T00:00:25.741 INFO:tasks.workunit.client.1.smithi183.stdout:7/243: creat d0/f44 x:0 0 0 2024-02-10T00:00:25.742 INFO:tasks.workunit.client.1.smithi183.stdout:0/214: dwrite d14/f20 [4194304,4194304] 0 2024-02-10T00:00:25.743 INFO:tasks.workunit.client.1.smithi183.stdout:0/215: readlink ld 0 2024-02-10T00:00:25.743 INFO:tasks.workunit.client.1.smithi183.stdout:9/250: getdents d0/d3/d14/d1c/d2d/d4f 0 2024-02-10T00:00:25.744 INFO:tasks.workunit.client.1.smithi183.stdout:5/290: dread d4/dd/f1b [0,4194304] 0 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:9/251: chown d0/d3/d14/f20 144410603 1 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/216: chown d14/d46/d1a/d22/l4a 31971724 1 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/217: stat d14/d46/d1a/c30 0 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:5/291: creat d4/dd/d31/f64 x:0 0 0 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:7/244: read d0/f21 [229599,130242] 0 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/218: read fb [2176593,84545] 0 2024-02-10T00:00:25.750 INFO:tasks.workunit.client.1.smithi183.stdout:5/292: unlink d4/dd/d31/f64 0 2024-02-10T00:00:25.752 INFO:tasks.workunit.client.1.smithi183.stdout:7/245: write d0/d2/f26 [1560360,126560] 0 2024-02-10T00:00:25.752 INFO:tasks.workunit.client.1.smithi183.stdout:0/219: rename d14/d46/l34 to d14/d46/d3c/l52 0 2024-02-10T00:00:25.754 INFO:tasks.workunit.client.1.smithi183.stdout:5/293: dwrite d4/f20 [0,4194304] 0 2024-02-10T00:00:25.756 INFO:tasks.workunit.client.1.smithi183.stdout:0/220: mknod d14/d3e/c53 0 2024-02-10T00:00:25.756 INFO:tasks.workunit.client.1.smithi183.stdout:5/294: readlink d4/l3a 0 2024-02-10T00:00:25.756 INFO:tasks.workunit.client.1.smithi183.stdout:0/221: fdatasync d14/d46/d1a/d22/f4f 0 2024-02-10T00:00:25.757 INFO:tasks.workunit.client.1.smithi183.stdout:0/222: write d14/d1d/f2b [1787741,38909] 0 2024-02-10T00:00:25.760 INFO:tasks.workunit.client.1.smithi183.stdout:5/295: dwrite d4/f20 [0,4194304] 0 2024-02-10T00:00:25.761 INFO:tasks.workunit.client.1.smithi183.stdout:7/246: getdents d0/d2/d4 0 2024-02-10T00:00:25.761 INFO:tasks.workunit.client.1.smithi183.stdout:7/247: write d0/f44 [559156,28808] 0 2024-02-10T00:00:25.762 INFO:tasks.workunit.client.1.smithi183.stdout:0/223: symlink d14/d46/d1a/d22/l54 0 2024-02-10T00:00:25.764 INFO:tasks.workunit.client.1.smithi183.stdout:0/224: dread - d14/d46/d1a/d22/f48 zero size 2024-02-10T00:00:25.765 INFO:tasks.workunit.client.1.smithi183.stdout:0/225: chown d14/d1d/f2b 6836627 1 2024-02-10T00:00:25.767 INFO:tasks.workunit.client.1.smithi183.stdout:0/226: mkdir d14/d1d/d55 0 2024-02-10T00:00:25.779 INFO:tasks.workunit.client.1.smithi183.stdout:7/248: dread d0/f44 [0,4194304] 0 2024-02-10T00:00:25.780 INFO:tasks.workunit.client.0.smithi164.stdout:9/58: truncate f5 367414 0 2024-02-10T00:00:25.783 INFO:tasks.workunit.client.1.smithi183.stdout:7/249: dwrite d0/f1 [0,4194304] 0 2024-02-10T00:00:25.785 INFO:tasks.workunit.client.0.smithi164.stdout:9/59: dread d6/fc [0,4194304] 0 2024-02-10T00:00:25.789 INFO:tasks.workunit.client.1.smithi183.stdout:7/250: creat d0/d2/d3/f45 x:0 0 0 2024-02-10T00:00:25.790 INFO:tasks.workunit.client.1.smithi183.stdout:7/251: dread - d0/d2/d3/f3f zero size 2024-02-10T00:00:25.790 INFO:tasks.workunit.client.1.smithi183.stdout:7/252: chown d0/d11/l31 100328933 1 2024-02-10T00:00:25.791 INFO:tasks.workunit.client.1.smithi183.stdout:9/252: dread d0/d10/f1b [4194304,4194304] 0 2024-02-10T00:00:25.794 INFO:tasks.workunit.client.0.smithi164.stdout:9/60: link d6/f7 d6/ff 0 2024-02-10T00:00:25.794 INFO:tasks.workunit.client.1.smithi183.stdout:5/296: write d4/dd/d31/f4d [903210,99506] 0 2024-02-10T00:00:25.795 INFO:tasks.workunit.client.1.smithi183.stdout:9/253: stat d0/d3/d14/d3c/c3e 0 2024-02-10T00:00:25.796 INFO:tasks.workunit.client.0.smithi164.stdout:9/61: creat d6/f10 x:0 0 0 2024-02-10T00:00:25.798 INFO:tasks.workunit.client.1.smithi183.stdout:5/297: creat d4/d23/d2a/d5b/f65 x:0 0 0 2024-02-10T00:00:25.799 INFO:tasks.workunit.client.1.smithi183.stdout:7/253: getdents d0 0 2024-02-10T00:00:25.799 INFO:tasks.workunit.client.0.smithi164.stdout:9/62: creat d6/de/f11 x:0 0 0 2024-02-10T00:00:25.800 INFO:tasks.workunit.client.1.smithi183.stdout:5/298: stat d4/d23/d4a/f5f 0 2024-02-10T00:00:25.801 INFO:tasks.workunit.client.1.smithi183.stdout:9/254: dwrite d0/d3/d14/f46 [0,4194304] 0 2024-02-10T00:00:25.801 INFO:tasks.workunit.client.0.smithi164.stdout:9/63: mknod d6/de/c12 0 2024-02-10T00:00:25.801 INFO:tasks.workunit.client.1.smithi183.stdout:5/299: chown d4/d1d/d27/d37/d46 80488532 1 2024-02-10T00:00:25.802 INFO:tasks.workunit.client.1.smithi183.stdout:9/255: fsync d0/d3/d14/d1c/d2d/f4d 0 2024-02-10T00:00:25.802 INFO:tasks.workunit.client.0.smithi164.stdout:9/64: mknod d6/c13 0 2024-02-10T00:00:25.803 INFO:tasks.workunit.client.0.smithi164.stdout:9/65: fdatasync d6/f9 0 2024-02-10T00:00:25.804 INFO:tasks.workunit.client.0.smithi164.stdout:9/66: chown d6/de/c12 77 1 2024-02-10T00:00:25.804 INFO:tasks.workunit.client.1.smithi183.stdout:7/254: rename d0/d11/c14 to d0/d2/d4/d8/c46 0 2024-02-10T00:00:25.806 INFO:tasks.workunit.client.1.smithi183.stdout:9/256: rmdir d0/d10 39 2024-02-10T00:00:25.808 INFO:tasks.workunit.client.1.smithi183.stdout:9/257: mkdir d0/d30/d52 0 2024-02-10T00:00:25.809 INFO:tasks.workunit.client.1.smithi183.stdout:9/258: readlink d0/l35 0 2024-02-10T00:00:25.809 INFO:tasks.workunit.client.1.smithi183.stdout:5/300: dwrite f1 [4194304,4194304] 0 2024-02-10T00:00:25.811 INFO:tasks.workunit.client.1.smithi183.stdout:5/301: fsync d4/dd/f14 0 2024-02-10T00:00:25.812 INFO:tasks.workunit.client.1.smithi183.stdout:7/255: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:25.813 INFO:tasks.workunit.client.1.smithi183.stdout:5/302: mknod d4/d1d/d27/d38/c66 0 2024-02-10T00:00:25.815 INFO:tasks.workunit.client.1.smithi183.stdout:9/259: creat d0/d10/f53 x:0 0 0 2024-02-10T00:00:25.816 INFO:tasks.workunit.client.1.smithi183.stdout:9/260: fsync d0/d10/f42 0 2024-02-10T00:00:25.817 INFO:tasks.workunit.client.1.smithi183.stdout:9/261: dread - d0/d3/f4e zero size 2024-02-10T00:00:25.819 INFO:tasks.workunit.client.1.smithi183.stdout:7/256: dwrite d0/d2/f41 [0,4194304] 0 2024-02-10T00:00:25.820 INFO:tasks.workunit.client.1.smithi183.stdout:5/303: dwrite d4/f20 [0,4194304] 0 2024-02-10T00:00:25.822 INFO:tasks.workunit.client.1.smithi183.stdout:9/262: unlink d0/f32 0 2024-02-10T00:00:25.822 INFO:tasks.workunit.client.0.smithi164.stdout:9/67: getdents d6/de 0 2024-02-10T00:00:25.824 INFO:tasks.workunit.client.0.smithi164.stdout:9/68: creat d6/de/f14 x:0 0 0 2024-02-10T00:00:25.825 INFO:tasks.workunit.client.1.smithi183.stdout:7/257: rename d0/d2/d3/f45 to d0/d11/f47 0 2024-02-10T00:00:25.826 INFO:tasks.workunit.client.1.smithi183.stdout:7/258: chown d0/d11/c3d 952030 1 2024-02-10T00:00:25.826 INFO:tasks.workunit.client.0.smithi164.stdout:9/69: mknod d6/de/c15 0 2024-02-10T00:00:25.826 INFO:tasks.workunit.client.1.smithi183.stdout:5/304: dwrite d4/d4b/f60 [0,4194304] 0 2024-02-10T00:00:25.827 INFO:tasks.workunit.client.0.smithi164.stdout:9/70: write d6/de/f11 [415264,120144] 0 2024-02-10T00:00:25.827 INFO:tasks.workunit.client.1.smithi183.stdout:9/263: mknod d0/c54 0 2024-02-10T00:00:25.828 INFO:tasks.workunit.client.1.smithi183.stdout:5/305: chown d4/f20 1022 1 2024-02-10T00:00:25.828 INFO:tasks.workunit.client.1.smithi183.stdout:5/306: write d4/d23/d4a/f5f [433495,8005] 0 2024-02-10T00:00:25.832 INFO:tasks.workunit.client.1.smithi183.stdout:3/236: sync 2024-02-10T00:00:25.832 INFO:tasks.workunit.client.1.smithi183.stdout:6/228: sync 2024-02-10T00:00:25.832 INFO:tasks.workunit.client.1.smithi183.stdout:1/245: sync 2024-02-10T00:00:25.832 INFO:tasks.workunit.client.1.smithi183.stdout:4/254: sync 2024-02-10T00:00:25.833 INFO:tasks.workunit.client.0.smithi164.stdout:9/71: dwrite d6/f9 [0,4194304] 0 2024-02-10T00:00:25.833 INFO:tasks.workunit.client.1.smithi183.stdout:7/259: rename d0/d2/c25 to d0/d2/d4/d8/c48 0 2024-02-10T00:00:25.833 INFO:tasks.workunit.client.1.smithi183.stdout:5/307: mknod d4/d23/d3e/c67 0 2024-02-10T00:00:25.838 INFO:tasks.workunit.client.1.smithi183.stdout:4/255: readlink de/l44 0 2024-02-10T00:00:25.838 INFO:tasks.workunit.client.1.smithi183.stdout:3/237: stat d7/c18 0 2024-02-10T00:00:25.839 INFO:tasks.workunit.client.1.smithi183.stdout:1/246: mknod d0/d3a/c5f 0 2024-02-10T00:00:25.842 INFO:tasks.workunit.client.1.smithi183.stdout:7/260: unlink d0/d2/f1a 0 2024-02-10T00:00:25.843 INFO:tasks.workunit.client.1.smithi183.stdout:3/238: dwrite d7/db/f41 [0,4194304] 0 2024-02-10T00:00:25.844 INFO:tasks.workunit.client.1.smithi183.stdout:1/247: dwrite d0/f17 [0,4194304] 0 2024-02-10T00:00:25.845 INFO:tasks.workunit.client.1.smithi183.stdout:7/261: write d0/d2/d3/f3f [565152,30853] 0 2024-02-10T00:00:25.846 INFO:tasks.workunit.client.1.smithi183.stdout:0/227: sync 2024-02-10T00:00:25.846 INFO:tasks.workunit.client.1.smithi183.stdout:2/313: sync 2024-02-10T00:00:25.846 INFO:tasks.workunit.client.1.smithi183.stdout:5/308: rename d4/l7 to d4/d23/l68 0 2024-02-10T00:00:25.846 INFO:tasks.workunit.client.1.smithi183.stdout:8/305: sync 2024-02-10T00:00:25.848 INFO:tasks.workunit.client.1.smithi183.stdout:4/256: unlink de/d14/d27/c1a 0 2024-02-10T00:00:25.849 INFO:tasks.workunit.client.1.smithi183.stdout:2/314: stat d2/da/d19/d31/l57 0 2024-02-10T00:00:25.850 INFO:tasks.workunit.client.1.smithi183.stdout:4/257: write de/d19/d1c/f39 [905340,91393] 0 2024-02-10T00:00:25.850 INFO:tasks.workunit.client.1.smithi183.stdout:9/264: getdents d0/d3/d14/d1c/d2d 0 2024-02-10T00:00:25.850 INFO:tasks.workunit.client.1.smithi183.stdout:5/309: read d4/d1d/d27/f2b [731135,24197] 0 2024-02-10T00:00:25.851 INFO:tasks.workunit.client.1.smithi183.stdout:4/258: chown de/f1f 1645 1 2024-02-10T00:00:25.851 INFO:tasks.workunit.client.1.smithi183.stdout:1/248: mkdir d0/d3/d7/d3d/d60 0 2024-02-10T00:00:25.852 INFO:tasks.workunit.client.1.smithi183.stdout:9/265: write d0/d3/d14/d1c/d2d/f4d [908497,19162] 0 2024-02-10T00:00:25.855 INFO:tasks.workunit.client.1.smithi183.stdout:0/228: creat d14/d46/d1a/f56 x:0 0 0 2024-02-10T00:00:25.855 INFO:tasks.workunit.client.1.smithi183.stdout:0/229: readlink d14/d43/l50 0 2024-02-10T00:00:25.858 INFO:tasks.workunit.client.1.smithi183.stdout:7/262: creat d0/d11/d3e/f49 x:0 0 0 2024-02-10T00:00:25.862 INFO:tasks.workunit.client.1.smithi183.stdout:1/249: creat d0/d3/d7/d2c/f61 x:0 0 0 2024-02-10T00:00:25.863 INFO:tasks.workunit.client.1.smithi183.stdout:0/230: mknod d14/d1d/d2d/d31/c57 0 2024-02-10T00:00:25.864 INFO:tasks.workunit.client.1.smithi183.stdout:2/315: mknod d2/c64 0 2024-02-10T00:00:25.864 INFO:tasks.workunit.client.1.smithi183.stdout:2/316: fdatasync d2/da/d20/d21/d43/f45 0 2024-02-10T00:00:25.865 INFO:tasks.workunit.client.1.smithi183.stdout:3/239: creat d7/db/d2a/f44 x:0 0 0 2024-02-10T00:00:25.866 INFO:tasks.workunit.client.1.smithi183.stdout:7/263: chown d0/d2/c29 61226 1 2024-02-10T00:00:25.867 INFO:tasks.workunit.client.1.smithi183.stdout:7/264: write d0/d11/d2f/f34 [2909235,18814] 0 2024-02-10T00:00:25.867 INFO:tasks.workunit.client.1.smithi183.stdout:7/265: dread - d0/d11/f36 zero size 2024-02-10T00:00:25.868 INFO:tasks.workunit.client.1.smithi183.stdout:7/266: fdatasync d0/d11/f36 0 2024-02-10T00:00:25.869 INFO:tasks.workunit.client.1.smithi183.stdout:4/259: creat de/d14/f4b x:0 0 0 2024-02-10T00:00:25.870 INFO:tasks.workunit.client.1.smithi183.stdout:3/240: unlink d7/db/f1b 0 2024-02-10T00:00:25.871 INFO:tasks.workunit.client.1.smithi183.stdout:5/310: truncate d4/d1d/d27/d38/f48 2257769 0 2024-02-10T00:00:25.872 INFO:tasks.workunit.client.1.smithi183.stdout:0/231: dread d14/d46/d1a/d22/f41 [0,4194304] 0 2024-02-10T00:00:25.873 INFO:tasks.workunit.client.1.smithi183.stdout:1/250: symlink d0/d3/l62 0 2024-02-10T00:00:25.873 INFO:tasks.workunit.client.1.smithi183.stdout:6/229: link d2/f15 d2/d1a/d25/d3c/d31/d38/d3f/f4c 0 2024-02-10T00:00:25.874 INFO:tasks.workunit.client.1.smithi183.stdout:6/230: stat d2/d1a/d25 0 2024-02-10T00:00:25.875 INFO:tasks.workunit.client.1.smithi183.stdout:4/260: mknod de/d22/c4c 0 2024-02-10T00:00:25.876 INFO:tasks.workunit.client.1.smithi183.stdout:5/311: dwrite d4/d23/d4a/f5f [0,4194304] 0 2024-02-10T00:00:25.878 INFO:tasks.workunit.client.1.smithi183.stdout:0/232: creat d14/d46/d3c/d3f/f58 x:0 0 0 2024-02-10T00:00:25.879 INFO:tasks.workunit.client.1.smithi183.stdout:0/233: dread - d14/d46/d3c/d3f/f58 zero size 2024-02-10T00:00:25.880 INFO:tasks.workunit.client.1.smithi183.stdout:0/234: stat d14/d1d/f32 0 2024-02-10T00:00:25.882 INFO:tasks.workunit.client.1.smithi183.stdout:5/312: unlink d4/dd/l28 0 2024-02-10T00:00:25.883 INFO:tasks.workunit.client.1.smithi183.stdout:5/313: chown d4/c1c 1180250 1 2024-02-10T00:00:25.884 INFO:tasks.workunit.client.1.smithi183.stdout:4/261: unlink c5 0 2024-02-10T00:00:25.885 INFO:tasks.workunit.client.1.smithi183.stdout:3/241: creat d7/db/f45 x:0 0 0 2024-02-10T00:00:25.889 INFO:tasks.workunit.client.1.smithi183.stdout:5/314: dwrite d4/d1d/d27/d38/f61 [0,4194304] 0 2024-02-10T00:00:25.890 INFO:tasks.workunit.client.0.smithi164.stdout:9/72: write d6/f7 [709553,46378] 0 2024-02-10T00:00:25.890 INFO:tasks.workunit.client.0.smithi164.stdout:9/73: write d6/de/f11 [943142,18118] 0 2024-02-10T00:00:25.891 INFO:tasks.workunit.client.1.smithi183.stdout:5/315: dread - d4/dd/f54 zero size 2024-02-10T00:00:25.892 INFO:tasks.workunit.client.1.smithi183.stdout:5/316: chown d4/d4b/f5c 3 1 2024-02-10T00:00:25.892 INFO:tasks.workunit.client.1.smithi183.stdout:3/242: dwrite d7/db/d2a/f3a [0,4194304] 0 2024-02-10T00:00:25.893 INFO:tasks.workunit.client.0.smithi164.stdout:9/74: rmdir d6 39 2024-02-10T00:00:25.895 INFO:tasks.workunit.client.1.smithi183.stdout:6/231: creat d2/d1a/d25/d3c/d31/d38/d3f/f4d x:0 0 0 2024-02-10T00:00:25.896 INFO:tasks.workunit.client.1.smithi183.stdout:9/266: truncate d0/f2b 2705941 0 2024-02-10T00:00:25.897 INFO:tasks.workunit.client.1.smithi183.stdout:8/306: dwrite d0/d45/f49 [0,4194304] 0 2024-02-10T00:00:25.898 INFO:tasks.workunit.client.0.smithi164.stdout:9/75: dwrite f2 [0,4194304] 0 2024-02-10T00:00:25.898 INFO:tasks.workunit.client.1.smithi183.stdout:5/317: dread d4/d1d/d27/d38/f47 [0,4194304] 0 2024-02-10T00:00:25.899 INFO:tasks.workunit.client.1.smithi183.stdout:2/317: truncate d2/da/d20/d21/d43/f45 6950726 0 2024-02-10T00:00:25.899 INFO:tasks.workunit.client.1.smithi183.stdout:2/318: chown d2/f8 910 1 2024-02-10T00:00:25.906 INFO:tasks.workunit.client.0.smithi164.stdout:9/76: unlink d6/fd 0 2024-02-10T00:00:25.911 INFO:tasks.workunit.client.1.smithi183.stdout:8/307: mknod d0/d3f/c63 0 2024-02-10T00:00:25.912 INFO:tasks.workunit.client.1.smithi183.stdout:1/251: dread d0/d3/d7/d36/f25 [0,4194304] 0 2024-02-10T00:00:25.913 INFO:tasks.workunit.client.1.smithi183.stdout:5/318: creat d4/d1d/d27/d37/d46/f69 x:0 0 0 2024-02-10T00:00:25.914 INFO:tasks.workunit.client.1.smithi183.stdout:5/319: read d4/d1d/d27/d38/f61 [1898336,60957] 0 2024-02-10T00:00:25.914 INFO:tasks.workunit.client.1.smithi183.stdout:1/252: write d0/d3/d7/d3d/f5b [791942,120651] 0 2024-02-10T00:00:25.915 INFO:tasks.workunit.client.1.smithi183.stdout:1/253: dread - d0/d3/d7/d36/f50 zero size 2024-02-10T00:00:25.915 INFO:tasks.workunit.client.1.smithi183.stdout:2/319: unlink d2/f1e 0 2024-02-10T00:00:25.916 INFO:tasks.workunit.client.0.smithi164.stdout:9/77: link d6/ca d6/de/c16 0 2024-02-10T00:00:25.917 INFO:tasks.workunit.client.0.smithi164.stdout:9/78: write f2 [2814677,118111] 0 2024-02-10T00:00:25.918 INFO:tasks.workunit.client.1.smithi183.stdout:4/262: dread de/d14/f47 [0,4194304] 0 2024-02-10T00:00:25.920 INFO:tasks.workunit.client.1.smithi183.stdout:5/320: unlink d4/fc 0 2024-02-10T00:00:25.921 INFO:tasks.workunit.client.1.smithi183.stdout:7/267: sync 2024-02-10T00:00:25.922 INFO:tasks.workunit.client.1.smithi183.stdout:8/308: creat d0/d4e/d53/f64 x:0 0 0 2024-02-10T00:00:25.922 INFO:tasks.workunit.client.1.smithi183.stdout:3/243: dread d7/f3e [0,4194304] 0 2024-02-10T00:00:25.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/244: chown d7/db 372 1 2024-02-10T00:00:25.923 INFO:tasks.workunit.client.1.smithi183.stdout:4/263: creat de/d14/d27/d2e/f4d x:0 0 0 2024-02-10T00:00:25.923 INFO:tasks.workunit.client.1.smithi183.stdout:8/309: chown d0/d4e/d53/f64 12 1 2024-02-10T00:00:25.925 INFO:tasks.workunit.client.1.smithi183.stdout:3/245: stat d7/db/d2a/d2d 0 2024-02-10T00:00:25.926 INFO:tasks.workunit.client.1.smithi183.stdout:3/246: chown d7/db/d2a/d33/f37 49342 1 2024-02-10T00:00:25.927 INFO:tasks.workunit.client.1.smithi183.stdout:8/310: unlink d0/l1c 0 2024-02-10T00:00:25.928 INFO:tasks.workunit.client.1.smithi183.stdout:1/254: truncate d0/d3/d7/d36/f50 1013316 0 2024-02-10T00:00:25.928 INFO:tasks.workunit.client.1.smithi183.stdout:7/268: dwrite d0/f30 [0,4194304] 0 2024-02-10T00:00:25.928 INFO:tasks.workunit.client.1.smithi183.stdout:5/321: fdatasync d4/d1d/f43 0 2024-02-10T00:00:25.929 INFO:tasks.workunit.client.1.smithi183.stdout:2/320: dread d2/da/f25 [0,4194304] 0 2024-02-10T00:00:25.930 INFO:tasks.workunit.client.1.smithi183.stdout:4/264: mkdir de/d14/d4e 0 2024-02-10T00:00:25.932 INFO:tasks.workunit.client.1.smithi183.stdout:5/322: stat d4/d1d/d27/d37/d46/f69 0 2024-02-10T00:00:25.932 INFO:tasks.workunit.client.1.smithi183.stdout:4/265: write de/f1f [2235208,60704] 0 2024-02-10T00:00:25.933 INFO:tasks.workunit.client.1.smithi183.stdout:7/269: creat d0/d2/d4/f4a x:0 0 0 2024-02-10T00:00:25.934 INFO:tasks.workunit.client.1.smithi183.stdout:2/321: unlink d2/da/d20/d21/l46 0 2024-02-10T00:00:25.938 INFO:tasks.workunit.client.1.smithi183.stdout:7/270: readlink d0/d2/d3/l39 0 2024-02-10T00:00:25.939 INFO:tasks.workunit.client.1.smithi183.stdout:1/255: creat d0/d3/d7/f63 x:0 0 0 2024-02-10T00:00:25.940 INFO:tasks.workunit.client.1.smithi183.stdout:2/322: creat d2/da/d20/d21/d43/f65 x:0 0 0 2024-02-10T00:00:25.943 INFO:tasks.workunit.client.1.smithi183.stdout:3/247: fsync d7/db/f45 0 2024-02-10T00:00:25.946 INFO:tasks.workunit.client.1.smithi183.stdout:0/235: rename d14/d46 to d14/d1d/d59 0 2024-02-10T00:00:25.947 INFO:tasks.workunit.client.1.smithi183.stdout:0/236: write d14/f17 [5087737,115419] 0 2024-02-10T00:00:25.959 INFO:tasks.workunit.client.1.smithi183.stdout:7/271: dread d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:25.960 INFO:tasks.workunit.client.1.smithi183.stdout:8/311: truncate d0/d45/f49 3511244 0 2024-02-10T00:00:25.964 INFO:tasks.workunit.client.1.smithi183.stdout:5/323: dwrite d4/d23/d2a/f49 [0,4194304] 0 2024-02-10T00:00:25.964 INFO:tasks.workunit.client.1.smithi183.stdout:3/248: rmdir d7/db 39 2024-02-10T00:00:25.964 INFO:tasks.workunit.client.1.smithi183.stdout:3/249: write d7/fe [2699656,36593] 0 2024-02-10T00:00:25.965 INFO:tasks.workunit.client.1.smithi183.stdout:5/324: read - d4/d1d/d27/d37/f51 zero size 2024-02-10T00:00:25.969 INFO:tasks.workunit.client.1.smithi183.stdout:5/325: dread d4/dd/d31/f4d [0,4194304] 0 2024-02-10T00:00:25.970 INFO:tasks.workunit.client.1.smithi183.stdout:1/256: creat d0/d3/d7/d3d/d60/f64 x:0 0 0 2024-02-10T00:00:25.971 INFO:tasks.workunit.client.1.smithi183.stdout:7/272: write d0/d11/d2f/f34 [689105,43002] 0 2024-02-10T00:00:25.974 INFO:tasks.workunit.client.1.smithi183.stdout:1/257: dread d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:25.974 INFO:tasks.workunit.client.1.smithi183.stdout:3/250: write d7/db/d2a/d2d/f2f [498269,109254] 0 2024-02-10T00:00:25.975 INFO:tasks.workunit.client.1.smithi183.stdout:6/232: rename d2/l3 to d2/d1a/l4e 0 2024-02-10T00:00:25.975 INFO:tasks.workunit.client.1.smithi183.stdout:4/266: link ca de/d14/c4f 0 2024-02-10T00:00:25.976 INFO:tasks.workunit.client.1.smithi183.stdout:4/267: fdatasync f0 0 2024-02-10T00:00:25.976 INFO:tasks.workunit.client.1.smithi183.stdout:0/237: link d14/f40 d14/d1d/d55/f5a 0 2024-02-10T00:00:25.977 INFO:tasks.workunit.client.1.smithi183.stdout:8/312: symlink d0/d45/l65 0 2024-02-10T00:00:25.978 INFO:tasks.workunit.client.1.smithi183.stdout:8/313: fdatasync d0/d23/d2d/d24/f54 0 2024-02-10T00:00:25.978 INFO:tasks.workunit.client.1.smithi183.stdout:8/314: readlink d0/d31/l34 0 2024-02-10T00:00:25.979 INFO:tasks.workunit.client.1.smithi183.stdout:2/323: creat d2/da/d20/f66 x:0 0 0 2024-02-10T00:00:25.985 INFO:tasks.workunit.client.1.smithi183.stdout:9/267: rename d0/l44 to d0/d3/d14/d3c/l55 0 2024-02-10T00:00:25.990 INFO:tasks.workunit.client.1.smithi183.stdout:5/326: write f0 [3276767,77003] 0 2024-02-10T00:00:25.991 INFO:tasks.workunit.client.1.smithi183.stdout:7/273: mknod d0/d11/d35/c4b 0 2024-02-10T00:00:25.992 INFO:tasks.workunit.client.1.smithi183.stdout:3/251: mknod d7/db/d2a/c46 0 2024-02-10T00:00:25.993 INFO:tasks.workunit.client.1.smithi183.stdout:0/238: dwrite d14/d1d/d59/f25 [0,4194304] 0 2024-02-10T00:00:25.994 INFO:tasks.workunit.client.1.smithi183.stdout:1/258: link d0/d3/d7/d2c/f2f d0/d3/d7/d36/f65 0 2024-02-10T00:00:25.995 INFO:tasks.workunit.client.1.smithi183.stdout:9/268: write d0/d10/f1b [5503587,130402] 0 2024-02-10T00:00:25.998 INFO:tasks.workunit.client.1.smithi183.stdout:5/327: rename d4/d23/d4a/l12 to d4/d23/d4a/l6a 0 2024-02-10T00:00:26.000 INFO:tasks.workunit.client.1.smithi183.stdout:5/328: chown d4/d23/d4a/c22 1274517 1 2024-02-10T00:00:26.000 INFO:tasks.workunit.client.1.smithi183.stdout:7/274: rmdir d0/d11/d3e 39 2024-02-10T00:00:26.000 INFO:tasks.workunit.client.1.smithi183.stdout:3/252: dwrite d7/db/d2a/f3a [0,4194304] 0 2024-02-10T00:00:26.001 INFO:tasks.workunit.client.1.smithi183.stdout:5/329: write d4/d1d/f3f [1273478,56767] 0 2024-02-10T00:00:26.005 INFO:tasks.workunit.client.1.smithi183.stdout:2/324: write d2/d2c/d2f/f3b [1579092,117094] 0 2024-02-10T00:00:26.005 INFO:tasks.workunit.client.1.smithi183.stdout:8/315: truncate d0/d23/d2d/f21 2510257 0 2024-02-10T00:00:26.006 INFO:tasks.workunit.client.1.smithi183.stdout:8/316: readlink d0/d31/l34 0 2024-02-10T00:00:26.006 INFO:tasks.workunit.client.1.smithi183.stdout:2/325: write d2/da/d20/d21/d36/f53 [194182,127758] 0 2024-02-10T00:00:26.007 INFO:tasks.workunit.client.1.smithi183.stdout:6/233: truncate d2/d26/f2e 388782 0 2024-02-10T00:00:26.011 INFO:tasks.workunit.client.1.smithi183.stdout:5/330: readlink d4/d23/d4a/l6a 0 2024-02-10T00:00:26.012 INFO:tasks.workunit.client.1.smithi183.stdout:0/239: mknod d14/d1d/d59/d1a/d22/c5b 0 2024-02-10T00:00:26.014 INFO:tasks.workunit.client.1.smithi183.stdout:1/259: dread d0/d3/d29/f51 [0,4194304] 0 2024-02-10T00:00:26.015 INFO:tasks.workunit.client.1.smithi183.stdout:9/269: rename d0/d3/d14/d1c/c3d to d0/d3/d14/d1c/d4b/c56 0 2024-02-10T00:00:26.015 INFO:tasks.workunit.client.1.smithi183.stdout:9/270: fsync d0/f36 0 2024-02-10T00:00:26.016 INFO:tasks.workunit.client.1.smithi183.stdout:7/275: chown d0/d2/d4/d8/l18 0 1 2024-02-10T00:00:26.016 INFO:tasks.workunit.client.1.smithi183.stdout:5/331: creat d4/d4b/f6b x:0 0 0 2024-02-10T00:00:26.017 INFO:tasks.workunit.client.1.smithi183.stdout:7/276: dread - d0/d11/f36 zero size 2024-02-10T00:00:26.017 INFO:tasks.workunit.client.1.smithi183.stdout:5/332: stat d4/d23/d4a/l24 0 2024-02-10T00:00:26.020 INFO:tasks.workunit.client.1.smithi183.stdout:0/240: rename d14/c38 to d14/d1d/d59/d1a/d51/c5c 0 2024-02-10T00:00:26.021 INFO:tasks.workunit.client.1.smithi183.stdout:4/268: sync 2024-02-10T00:00:26.022 INFO:tasks.workunit.client.1.smithi183.stdout:1/260: fdatasync d0/d3/d7/d36/f50 0 2024-02-10T00:00:26.022 INFO:tasks.workunit.client.1.smithi183.stdout:4/269: chown de/d22/c4c 943277977 1 2024-02-10T00:00:26.023 INFO:tasks.workunit.client.1.smithi183.stdout:5/333: dwrite d4/dd/f25 [0,4194304] 0 2024-02-10T00:00:26.023 INFO:tasks.workunit.client.1.smithi183.stdout:7/277: symlink d0/d11/d2f/l4c 0 2024-02-10T00:00:26.024 INFO:tasks.workunit.client.1.smithi183.stdout:4/270: write de/d14/f16 [940386,92508] 0 2024-02-10T00:00:26.025 INFO:tasks.workunit.client.1.smithi183.stdout:3/253: getdents d7/db/d2a/d1c 0 2024-02-10T00:00:26.026 INFO:tasks.workunit.client.1.smithi183.stdout:9/271: mknod d0/c57 0 2024-02-10T00:00:26.026 INFO:tasks.workunit.client.1.smithi183.stdout:9/272: read - d0/d3/f4e zero size 2024-02-10T00:00:26.027 INFO:tasks.workunit.client.1.smithi183.stdout:9/273: write d0/f2f [3058756,6300] 0 2024-02-10T00:00:26.028 INFO:tasks.workunit.client.1.smithi183.stdout:8/317: write d0/d27/f3a [4321223,19467] 0 2024-02-10T00:00:26.030 INFO:tasks.workunit.client.1.smithi183.stdout:0/241: rename d14/d1d/d59/d1a/c21 to d14/d43/c5d 0 2024-02-10T00:00:26.031 INFO:tasks.workunit.client.1.smithi183.stdout:0/242: write f3 [2126582,32819] 0 2024-02-10T00:00:26.032 INFO:tasks.workunit.client.1.smithi183.stdout:5/334: creat d4/d1d/d27/d37/d46/f6c x:0 0 0 2024-02-10T00:00:26.032 INFO:tasks.workunit.client.1.smithi183.stdout:2/326: write d2/f15 [7298558,9767] 0 2024-02-10T00:00:26.033 INFO:tasks.workunit.client.1.smithi183.stdout:7/278: creat d0/d2/d4/d8/f4d x:0 0 0 2024-02-10T00:00:26.034 INFO:tasks.workunit.client.1.smithi183.stdout:6/234: write d2/d1a/d25/d3c/d31/d38/d3f/f4c [4942882,107172] 0 2024-02-10T00:00:26.035 INFO:tasks.workunit.client.1.smithi183.stdout:3/254: fsync d7/db/fc 0 2024-02-10T00:00:26.039 INFO:tasks.workunit.client.1.smithi183.stdout:1/261: rename d0/d3/d7/d36/l27 to d0/d3/d7/d3d/l66 0 2024-02-10T00:00:26.040 INFO:tasks.workunit.client.1.smithi183.stdout:2/327: symlink d2/da/d19/l67 0 2024-02-10T00:00:26.041 INFO:tasks.workunit.client.1.smithi183.stdout:7/279: mknod d0/c4e 0 2024-02-10T00:00:26.042 INFO:tasks.workunit.client.1.smithi183.stdout:4/271: mknod de/d14/c50 0 2024-02-10T00:00:26.044 INFO:tasks.workunit.client.1.smithi183.stdout:9/274: mkdir d0/d3/d14/d1c/d2d/d4f/d58 0 2024-02-10T00:00:26.046 INFO:tasks.workunit.client.1.smithi183.stdout:5/335: mkdir d4/d1d/d27/d5d/d6d 0 2024-02-10T00:00:26.048 INFO:tasks.workunit.client.1.smithi183.stdout:9/275: mknod d0/d3/d14/d1c/c59 0 2024-02-10T00:00:26.049 INFO:tasks.workunit.client.1.smithi183.stdout:3/255: unlink d7/db/fc 0 2024-02-10T00:00:26.049 INFO:tasks.workunit.client.1.smithi183.stdout:8/318: creat d0/d45/f66 x:0 0 0 2024-02-10T00:00:26.050 INFO:tasks.workunit.client.1.smithi183.stdout:8/319: write d0/d23/f2b [109527,18148] 0 2024-02-10T00:00:26.051 INFO:tasks.workunit.client.1.smithi183.stdout:8/320: chown d0/d23/d2d 17 1 2024-02-10T00:00:26.051 INFO:tasks.workunit.client.1.smithi183.stdout:6/235: rename d2/f1e to d2/d26/d35/f4f 0 2024-02-10T00:00:26.052 INFO:tasks.workunit.client.1.smithi183.stdout:8/321: fdatasync d0/f1b 0 2024-02-10T00:00:26.052 INFO:tasks.workunit.client.1.smithi183.stdout:4/272: getdents de/d14/d4e 0 2024-02-10T00:00:26.053 INFO:tasks.workunit.client.1.smithi183.stdout:4/273: stat de/d14/d1d/l35 0 2024-02-10T00:00:26.053 INFO:tasks.workunit.client.1.smithi183.stdout:4/274: fsync f0 0 2024-02-10T00:00:26.053 INFO:tasks.workunit.client.1.smithi183.stdout:1/262: truncate d0/f1c 2842908 0 2024-02-10T00:00:26.054 INFO:tasks.workunit.client.1.smithi183.stdout:4/275: write de/d22/f43 [989893,55563] 0 2024-02-10T00:00:26.054 INFO:tasks.workunit.client.1.smithi183.stdout:1/263: chown d0/d3/d7/f63 3535 1 2024-02-10T00:00:26.055 INFO:tasks.workunit.client.1.smithi183.stdout:4/276: write de/d14/d1d/d2f/f3e [289839,23382] 0 2024-02-10T00:00:26.056 INFO:tasks.workunit.client.1.smithi183.stdout:7/280: link d0/d11/f1c d0/d11/f4f 0 2024-02-10T00:00:26.063 INFO:tasks.workunit.client.1.smithi183.stdout:5/336: symlink d4/d1d/d27/d38/d4f/l6e 0 2024-02-10T00:00:26.066 INFO:tasks.workunit.client.1.smithi183.stdout:8/322: unlink d0/d23/d2d/d24/c56 0 2024-02-10T00:00:26.066 INFO:tasks.workunit.client.1.smithi183.stdout:8/323: chown d0/d27/d36/c3b 1578 1 2024-02-10T00:00:26.067 INFO:tasks.workunit.client.1.smithi183.stdout:4/277: mknod de/d22/c51 0 2024-02-10T00:00:26.068 INFO:tasks.workunit.client.1.smithi183.stdout:5/337: fsync d4/d23/d4a/f1f 0 2024-02-10T00:00:26.069 INFO:tasks.workunit.client.1.smithi183.stdout:5/338: write d4/dd/f14 [3748538,117316] 0 2024-02-10T00:00:26.070 INFO:tasks.workunit.client.1.smithi183.stdout:3/256: creat d7/db/f47 x:0 0 0 2024-02-10T00:00:26.071 INFO:tasks.workunit.client.1.smithi183.stdout:8/324: dread d0/d23/d51/d5b/f5d [0,4194304] 0 2024-02-10T00:00:26.071 INFO:tasks.workunit.client.1.smithi183.stdout:2/328: rename d2/da/d20/d21/c27 to d2/da/c68 0 2024-02-10T00:00:26.074 INFO:tasks.workunit.client.1.smithi183.stdout:7/281: mkdir d0/d2/d50 0 2024-02-10T00:00:26.074 INFO:tasks.workunit.client.1.smithi183.stdout:7/282: write d0/f21 [1754893,95404] 0 2024-02-10T00:00:26.075 INFO:tasks.workunit.client.1.smithi183.stdout:4/278: rmdir de/d19/d20 39 2024-02-10T00:00:26.075 INFO:tasks.workunit.client.1.smithi183.stdout:4/279: stat de/d14/d1d/c3a 0 2024-02-10T00:00:26.077 INFO:tasks.workunit.client.1.smithi183.stdout:6/236: unlink d2/d26/d34/f47 0 2024-02-10T00:00:26.078 INFO:tasks.workunit.client.1.smithi183.stdout:9/276: getdents d0/d3 0 2024-02-10T00:00:26.080 INFO:tasks.workunit.client.1.smithi183.stdout:5/339: symlink d4/d1d/d27/d37/l6f 0 2024-02-10T00:00:26.080 INFO:tasks.workunit.client.1.smithi183.stdout:8/325: unlink d0/f1f 0 2024-02-10T00:00:26.082 INFO:tasks.workunit.client.1.smithi183.stdout:8/326: write d0/d23/d2d/d24/f28 [2553925,94836] 0 2024-02-10T00:00:26.085 INFO:tasks.workunit.client.1.smithi183.stdout:4/280: truncate de/f2c 572017 0 2024-02-10T00:00:26.088 INFO:tasks.workunit.client.1.smithi183.stdout:4/281: fsync de/d14/d1d/d2f/f3e 0 2024-02-10T00:00:26.089 INFO:tasks.workunit.client.1.smithi183.stdout:5/340: dwrite d4/d1d/d27/d37/d46/d4e/f62 [0,4194304] 0 2024-02-10T00:00:26.090 INFO:tasks.workunit.client.1.smithi183.stdout:2/329: dwrite d2/da/d20/d21/f29 [0,4194304] 0 2024-02-10T00:00:26.090 INFO:tasks.workunit.client.1.smithi183.stdout:1/264: getdents d0/d3/d29/d1f 0 2024-02-10T00:00:26.092 INFO:tasks.workunit.client.1.smithi183.stdout:5/341: write d4/dd/f32 [3909408,86001] 0 2024-02-10T00:00:26.093 INFO:tasks.workunit.client.1.smithi183.stdout:3/257: truncate d7/db/d2a/d33/f37 1032676 0 2024-02-10T00:00:26.093 INFO:tasks.workunit.client.1.smithi183.stdout:8/327: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:26.097 INFO:tasks.workunit.client.1.smithi183.stdout:7/283: dread d0/d2/d3/f20 [0,4194304] 0 2024-02-10T00:00:26.098 INFO:tasks.workunit.client.1.smithi183.stdout:9/277: link d0/d30/f39 d0/d3/d14/d1c/d2d/d4f/f5a 0 2024-02-10T00:00:26.100 INFO:tasks.workunit.client.1.smithi183.stdout:6/237: mknod d2/d1a/d3a/c50 0 2024-02-10T00:00:26.101 INFO:tasks.workunit.client.1.smithi183.stdout:2/330: dwrite d2/da/d20/d21/d43/f45 [4194304,4194304] 0 2024-02-10T00:00:26.102 INFO:tasks.workunit.client.1.smithi183.stdout:4/282: fdatasync de/d19/d20/f23 0 2024-02-10T00:00:26.104 INFO:tasks.workunit.client.1.smithi183.stdout:5/342: mkdir d4/d1d/d27/d5d/d70 0 2024-02-10T00:00:26.104 INFO:tasks.workunit.client.1.smithi183.stdout:3/258: dwrite d7/db/d2a/f3c [0,4194304] 0 2024-02-10T00:00:26.104 INFO:tasks.workunit.client.1.smithi183.stdout:0/243: sync 2024-02-10T00:00:26.107 INFO:tasks.workunit.client.1.smithi183.stdout:8/328: dwrite d0/d4e/d53/f64 [0,4194304] 0 2024-02-10T00:00:26.107 INFO:tasks.workunit.client.1.smithi183.stdout:7/284: creat d0/d11/d35/f51 x:0 0 0 2024-02-10T00:00:26.107 INFO:tasks.workunit.client.1.smithi183.stdout:0/244: fdatasync d14/d1d/d59/d1a/d22/f4f 0 2024-02-10T00:00:26.109 INFO:tasks.workunit.client.1.smithi183.stdout:3/259: read d7/fe [6612812,60788] 0 2024-02-10T00:00:26.115 INFO:tasks.workunit.client.1.smithi183.stdout:5/343: dwrite d4/d1d/f39 [0,4194304] 0 2024-02-10T00:00:26.115 INFO:tasks.workunit.client.1.smithi183.stdout:6/238: mknod d2/d1a/d3a/d45/c51 0 2024-02-10T00:00:26.115 INFO:tasks.workunit.client.1.smithi183.stdout:0/245: rmdir d14/d1d/d59/d1a/d22 39 2024-02-10T00:00:26.116 INFO:tasks.workunit.client.1.smithi183.stdout:7/285: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:26.120 INFO:tasks.workunit.client.1.smithi183.stdout:8/329: dread d0/d23/d51/d5b/f5d [0,4194304] 0 2024-02-10T00:00:26.122 INFO:tasks.workunit.client.1.smithi183.stdout:9/278: creat d0/f5b x:0 0 0 2024-02-10T00:00:26.123 INFO:tasks.workunit.client.1.smithi183.stdout:5/344: rmdir d4/d1d/d27/d38/d4f 39 2024-02-10T00:00:26.123 INFO:tasks.workunit.client.1.smithi183.stdout:5/345: dread - d4/dd/f54 zero size 2024-02-10T00:00:26.124 INFO:tasks.workunit.client.1.smithi183.stdout:5/346: write d4/d23/d4a/f1f [4228979,41888] 0 2024-02-10T00:00:26.124 INFO:tasks.workunit.client.1.smithi183.stdout:0/246: creat d14/d1d/d59/f5e x:0 0 0 2024-02-10T00:00:26.124 INFO:tasks.workunit.client.1.smithi183.stdout:7/286: fdatasync d0/d11/f1c 0 2024-02-10T00:00:26.126 INFO:tasks.workunit.client.1.smithi183.stdout:2/331: creat d2/da/d5b/f69 x:0 0 0 2024-02-10T00:00:26.126 INFO:tasks.workunit.client.1.smithi183.stdout:6/239: truncate d2/d1a/d3a/f40 1326776 0 2024-02-10T00:00:26.127 INFO:tasks.workunit.client.1.smithi183.stdout:2/332: write d2/d3d/f42 [1349853,50180] 0 2024-02-10T00:00:26.127 INFO:tasks.workunit.client.1.smithi183.stdout:8/330: write d0/f1e [2625367,13737] 0 2024-02-10T00:00:26.129 INFO:tasks.workunit.client.1.smithi183.stdout:0/247: rmdir d14 39 2024-02-10T00:00:26.130 INFO:tasks.workunit.client.1.smithi183.stdout:5/347: dwrite d4/d23/d2a/d5b/f65 [0,4194304] 0 2024-02-10T00:00:26.132 INFO:tasks.workunit.client.1.smithi183.stdout:3/260: getdents d7/db/d2a 0 2024-02-10T00:00:26.134 INFO:tasks.workunit.client.1.smithi183.stdout:7/287: mknod d0/d2/d4/c52 0 2024-02-10T00:00:26.136 INFO:tasks.workunit.client.1.smithi183.stdout:5/348: unlink d4/dd/f32 0 2024-02-10T00:00:26.138 INFO:tasks.workunit.client.1.smithi183.stdout:5/349: stat d4/d23/d2a/d5b/f65 0 2024-02-10T00:00:26.139 INFO:tasks.workunit.client.1.smithi183.stdout:7/288: dwrite d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:26.139 INFO:tasks.workunit.client.1.smithi183.stdout:5/350: write d4/d23/d2a/f49 [1474340,50764] 0 2024-02-10T00:00:26.141 INFO:tasks.workunit.client.1.smithi183.stdout:0/248: mkdir d14/d3e/d5f 0 2024-02-10T00:00:26.142 INFO:tasks.workunit.client.1.smithi183.stdout:0/249: write d14/f20 [5717692,30486] 0 2024-02-10T00:00:26.145 INFO:tasks.workunit.client.1.smithi183.stdout:5/351: dwrite d4/d23/d4a/d36/f5e [0,4194304] 0 2024-02-10T00:00:26.145 INFO:tasks.workunit.client.1.smithi183.stdout:8/331: rmdir d0/d4e/d61 0 2024-02-10T00:00:26.150 INFO:tasks.workunit.client.1.smithi183.stdout:7/289: rename d0/d2/d3/f3f to d0/f53 0 2024-02-10T00:00:26.155 INFO:tasks.workunit.client.1.smithi183.stdout:0/250: readlink d14/d1d/d59/d3c/l52 0 2024-02-10T00:00:26.156 INFO:tasks.workunit.client.1.smithi183.stdout:0/251: chown d14/d1d/d55 472191101 1 2024-02-10T00:00:26.156 INFO:tasks.workunit.client.1.smithi183.stdout:2/333: getdents d2/d2c 0 2024-02-10T00:00:26.156 INFO:tasks.workunit.client.1.smithi183.stdout:5/352: stat f3 0 2024-02-10T00:00:26.156 INFO:tasks.workunit.client.1.smithi183.stdout:5/353: chown d4/d23/d3e 99 1 2024-02-10T00:00:26.157 INFO:tasks.workunit.client.1.smithi183.stdout:3/261: write d7/db/d2a/d33/f37 [707073,41325] 0 2024-02-10T00:00:26.157 INFO:tasks.workunit.client.1.smithi183.stdout:3/262: write d7/db/f45 [244473,55022] 0 2024-02-10T00:00:26.157 INFO:tasks.workunit.client.1.smithi183.stdout:0/252: write d14/d1d/d59/d1a/d22/f4f [431258,80683] 0 2024-02-10T00:00:26.157 INFO:tasks.workunit.client.1.smithi183.stdout:8/332: mknod d0/d23/d62/c67 0 2024-02-10T00:00:26.158 INFO:tasks.workunit.client.1.smithi183.stdout:2/334: fdatasync d2/da/d19/d31/f47 0 2024-02-10T00:00:26.158 INFO:tasks.workunit.client.1.smithi183.stdout:0/253: write d14/f20 [2345639,50768] 0 2024-02-10T00:00:26.159 INFO:tasks.workunit.client.1.smithi183.stdout:7/290: truncate d0/d11/d35/f51 287875 0 2024-02-10T00:00:26.160 INFO:tasks.workunit.client.1.smithi183.stdout:0/254: stat d14/d1d/d2d/d31/c3b 0 2024-02-10T00:00:26.162 INFO:tasks.workunit.client.1.smithi183.stdout:8/333: dread d0/d4e/d53/f64 [0,4194304] 0 2024-02-10T00:00:26.164 INFO:tasks.workunit.client.1.smithi183.stdout:5/354: getdents d4/d23/d2a/d5b 0 2024-02-10T00:00:26.165 INFO:tasks.workunit.client.1.smithi183.stdout:3/263: rename d7/db/f17 to d7/f48 0 2024-02-10T00:00:26.167 INFO:tasks.workunit.client.1.smithi183.stdout:2/335: link d2/da/d19/d31/f47 d2/d2c/d2f/f6a 0 2024-02-10T00:00:26.169 INFO:tasks.workunit.client.1.smithi183.stdout:5/355: mkdir d4/dd/d71 0 2024-02-10T00:00:26.169 INFO:tasks.workunit.client.1.smithi183.stdout:5/356: stat d4/dd/d31/f4d 0 2024-02-10T00:00:26.170 INFO:tasks.workunit.client.1.smithi183.stdout:3/264: symlink d7/db/d2a/l49 0 2024-02-10T00:00:26.172 INFO:tasks.workunit.client.1.smithi183.stdout:2/336: dwrite d2/da/d20/d21/d36/f53 [0,4194304] 0 2024-02-10T00:00:26.173 INFO:tasks.workunit.client.1.smithi183.stdout:2/337: write d2/da/d20/f66 [597794,96130] 0 2024-02-10T00:00:26.176 INFO:tasks.workunit.client.1.smithi183.stdout:2/338: symlink d2/da/d20/d21/d43/d58/l6b 0 2024-02-10T00:00:26.184 INFO:tasks.workunit.client.1.smithi183.stdout:1/265: dread d0/d3/d7/f2b [0,4194304] 0 2024-02-10T00:00:26.188 INFO:tasks.workunit.client.1.smithi183.stdout:5/357: rmdir d4/d1d/d27 39 2024-02-10T00:00:26.193 INFO:tasks.workunit.client.1.smithi183.stdout:6/240: dread d2/f24 [0,4194304] 0 2024-02-10T00:00:26.193 INFO:tasks.workunit.client.1.smithi183.stdout:1/266: rename d0/d3/d7/d2c to d0/d3/d67 0 2024-02-10T00:00:26.193 INFO:tasks.workunit.client.1.smithi183.stdout:6/241: chown d2/d26 179 1 2024-02-10T00:00:26.197 INFO:tasks.workunit.client.1.smithi183.stdout:6/242: symlink d2/d32/l52 0 2024-02-10T00:00:26.200 INFO:tasks.workunit.client.1.smithi183.stdout:6/243: dwrite d2/f4b [0,4194304] 0 2024-02-10T00:00:26.203 INFO:tasks.workunit.client.1.smithi183.stdout:6/244: unlink d2/d1a/l39 0 2024-02-10T00:00:26.207 INFO:tasks.workunit.client.1.smithi183.stdout:8/334: dread d0/d4e/f4f [0,4194304] 0 2024-02-10T00:00:26.207 INFO:tasks.workunit.client.1.smithi183.stdout:4/283: truncate de/f11 4020429 0 2024-02-10T00:00:26.212 INFO:tasks.workunit.client.1.smithi183.stdout:9/279: dwrite d0/d3/d14/d1c/f1f [0,4194304] 0 2024-02-10T00:00:26.215 INFO:tasks.workunit.client.1.smithi183.stdout:2/339: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:26.219 INFO:tasks.workunit.client.1.smithi183.stdout:7/291: rmdir d0/d11/d35 39 2024-02-10T00:00:26.224 INFO:tasks.workunit.client.1.smithi183.stdout:0/255: dwrite fb [0,4194304] 0 2024-02-10T00:00:26.225 INFO:tasks.workunit.client.1.smithi183.stdout:0/256: write d14/f28 [1014673,70859] 0 2024-02-10T00:00:26.226 INFO:tasks.workunit.client.1.smithi183.stdout:9/280: creat d0/d3/d14/d1c/f5c x:0 0 0 2024-02-10T00:00:26.227 INFO:tasks.workunit.client.1.smithi183.stdout:0/257: read d14/d1d/d59/d1a/f1b [7846512,105804] 0 2024-02-10T00:00:26.227 INFO:tasks.workunit.client.1.smithi183.stdout:5/358: truncate d4/d23/d4a/f1f 5316815 0 2024-02-10T00:00:26.228 INFO:tasks.workunit.client.1.smithi183.stdout:1/267: truncate d0/f13 997855 0 2024-02-10T00:00:26.234 INFO:tasks.workunit.client.1.smithi183.stdout:7/292: unlink d0/d11/c40 0 2024-02-10T00:00:26.235 INFO:tasks.workunit.client.1.smithi183.stdout:3/265: fsync d7/db/d2a/f44 0 2024-02-10T00:00:26.237 INFO:tasks.workunit.client.1.smithi183.stdout:6/245: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:26.237 INFO:tasks.workunit.client.1.smithi183.stdout:2/340: link d2/d3d/f42 d2/da/d19/d31/f6c 0 2024-02-10T00:00:26.238 INFO:tasks.workunit.client.1.smithi183.stdout:0/258: mknod d14/d1d/d59/d3c/d3f/c60 0 2024-02-10T00:00:26.240 INFO:tasks.workunit.client.1.smithi183.stdout:4/284: dwrite de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:26.243 INFO:tasks.workunit.client.1.smithi183.stdout:9/281: symlink d0/d30/d52/l5d 0 2024-02-10T00:00:26.244 INFO:tasks.workunit.client.1.smithi183.stdout:7/293: dwrite d0/d2/f41 [0,4194304] 0 2024-02-10T00:00:26.245 INFO:tasks.workunit.client.1.smithi183.stdout:6/246: mkdir d2/d1a/d3a/d45/d53 0 2024-02-10T00:00:26.246 INFO:tasks.workunit.client.1.smithi183.stdout:8/335: dwrite d0/d23/d2d/f21 [0,4194304] 0 2024-02-10T00:00:26.248 INFO:tasks.workunit.client.1.smithi183.stdout:0/259: rmdir d14 39 2024-02-10T00:00:26.250 INFO:tasks.workunit.client.1.smithi183.stdout:1/268: stat d0/f13 0 2024-02-10T00:00:26.251 INFO:tasks.workunit.client.1.smithi183.stdout:8/336: dwrite d0/d27/f2e [0,4194304] 0 2024-02-10T00:00:26.252 INFO:tasks.workunit.client.1.smithi183.stdout:1/269: write d0/d3/d29/f4c [88971,119580] 0 2024-02-10T00:00:26.252 INFO:tasks.workunit.client.1.smithi183.stdout:3/266: write d7/db/f13 [278251,10649] 0 2024-02-10T00:00:26.253 INFO:tasks.workunit.client.1.smithi183.stdout:1/270: read d0/d3/d7/f2b [1264131,86042] 0 2024-02-10T00:00:26.255 INFO:tasks.workunit.client.1.smithi183.stdout:4/285: rename lc to de/d14/d27/l52 0 2024-02-10T00:00:26.255 INFO:tasks.workunit.client.1.smithi183.stdout:2/341: mkdir d2/da/d20/d6d 0 2024-02-10T00:00:26.256 INFO:tasks.workunit.client.1.smithi183.stdout:9/282: chown d0/f2b 106303679 1 2024-02-10T00:00:26.256 INFO:tasks.workunit.client.1.smithi183.stdout:5/359: mkdir d4/d1d/d27/d5d/d70/d72 0 2024-02-10T00:00:26.260 INFO:tasks.workunit.client.1.smithi183.stdout:4/286: dwrite de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:26.262 INFO:tasks.workunit.client.1.smithi183.stdout:4/287: write de/d14/d27/f3d [535231,80685] 0 2024-02-10T00:00:26.262 INFO:tasks.workunit.client.1.smithi183.stdout:3/267: stat d7/db/d2a/d2d/c42 0 2024-02-10T00:00:26.263 INFO:tasks.workunit.client.1.smithi183.stdout:8/337: rename d0/f1b to d0/d27/f68 0 2024-02-10T00:00:26.264 INFO:tasks.workunit.client.1.smithi183.stdout:5/360: dwrite d4/d4b/f60 [0,4194304] 0 2024-02-10T00:00:26.264 INFO:tasks.workunit.client.1.smithi183.stdout:8/338: chown d0/d10/f19 10633 1 2024-02-10T00:00:26.265 INFO:tasks.workunit.client.1.smithi183.stdout:8/339: chown d0/d4e/l60 11775 1 2024-02-10T00:00:26.266 INFO:tasks.workunit.client.1.smithi183.stdout:6/247: fdatasync d2/d1a/f1f 0 2024-02-10T00:00:26.267 INFO:tasks.workunit.client.1.smithi183.stdout:6/248: chown d2/d1a/d3a/c50 1368200341 1 2024-02-10T00:00:26.270 INFO:tasks.workunit.client.1.smithi183.stdout:5/361: mkdir d4/dd/d31/d73 0 2024-02-10T00:00:26.270 INFO:tasks.workunit.client.1.smithi183.stdout:9/283: creat d0/d3/d14/d48/f5e x:0 0 0 2024-02-10T00:00:26.270 INFO:tasks.workunit.client.1.smithi183.stdout:9/284: dread - d0/f5b zero size 2024-02-10T00:00:26.272 INFO:tasks.workunit.client.1.smithi183.stdout:8/340: fsync d0/d23/d51/d5b/f5d 0 2024-02-10T00:00:26.273 INFO:tasks.workunit.client.1.smithi183.stdout:6/249: write d2/f19 [300830,54724] 0 2024-02-10T00:00:26.276 INFO:tasks.workunit.client.1.smithi183.stdout:8/341: creat d0/d23/d2d/d24/f69 x:0 0 0 2024-02-10T00:00:26.277 INFO:tasks.workunit.client.1.smithi183.stdout:3/268: creat d7/db/d2a/f4a x:0 0 0 2024-02-10T00:00:26.278 INFO:tasks.workunit.client.1.smithi183.stdout:1/271: dread d0/d3/d7/d36/f4d [0,4194304] 0 2024-02-10T00:00:26.278 INFO:tasks.workunit.client.1.smithi183.stdout:6/250: dwrite d2/f4b [4194304,4194304] 0 2024-02-10T00:00:26.279 INFO:tasks.workunit.client.1.smithi183.stdout:5/362: mkdir d4/d74 0 2024-02-10T00:00:26.280 INFO:tasks.workunit.client.1.smithi183.stdout:9/285: truncate d0/d3/d14/d1c/d2d/d4f/f5a 449530 0 2024-02-10T00:00:26.281 INFO:tasks.workunit.client.1.smithi183.stdout:1/272: fdatasync d0/d3/d7/d36/f65 0 2024-02-10T00:00:26.282 INFO:tasks.workunit.client.1.smithi183.stdout:6/251: symlink d2/d1a/d25/d3c/d31/d38/d3f/l54 0 2024-02-10T00:00:26.283 INFO:tasks.workunit.client.1.smithi183.stdout:6/252: write d2/d1a/f43 [5080462,38336] 0 2024-02-10T00:00:26.284 INFO:tasks.workunit.client.1.smithi183.stdout:8/342: link d0/f52 d0/d4e/f6a 0 2024-02-10T00:00:26.285 INFO:tasks.workunit.client.1.smithi183.stdout:8/343: dread - d0/d3f/f43 zero size 2024-02-10T00:00:26.285 INFO:tasks.workunit.client.1.smithi183.stdout:9/286: creat d0/d10/f5f x:0 0 0 2024-02-10T00:00:26.286 INFO:tasks.workunit.client.1.smithi183.stdout:3/269: mkdir d7/d4b 0 2024-02-10T00:00:26.286 INFO:tasks.workunit.client.1.smithi183.stdout:9/287: write d0/f3b [1025653,114576] 0 2024-02-10T00:00:26.289 INFO:tasks.workunit.client.1.smithi183.stdout:9/288: readlink d0/d3/d14/d3c/l55 0 2024-02-10T00:00:26.290 INFO:tasks.workunit.client.1.smithi183.stdout:3/270: symlink d7/db/d2a/l4c 0 2024-02-10T00:00:26.290 INFO:tasks.workunit.client.1.smithi183.stdout:9/289: getdents d0/d3/d14/d1c/d2d/d4f/d58 0 2024-02-10T00:00:26.291 INFO:tasks.workunit.client.1.smithi183.stdout:9/290: write d0/f3a [4792478,123821] 0 2024-02-10T00:00:26.293 INFO:tasks.workunit.client.1.smithi183.stdout:3/271: mkdir d7/db/d2a/d4d 0 2024-02-10T00:00:26.294 INFO:tasks.workunit.client.1.smithi183.stdout:9/291: creat d0/d3/d14/d3c/f60 x:0 0 0 2024-02-10T00:00:26.295 INFO:tasks.workunit.client.1.smithi183.stdout:1/273: read d0/d3/d29/d38/f3b [4188450,100494] 0 2024-02-10T00:00:26.295 INFO:tasks.workunit.client.1.smithi183.stdout:3/272: truncate d7/f3e 2368806 0 2024-02-10T00:00:26.296 INFO:tasks.workunit.client.1.smithi183.stdout:3/273: write d7/f8 [3299852,46203] 0 2024-02-10T00:00:26.297 INFO:tasks.workunit.client.1.smithi183.stdout:9/292: creat d0/d3/d14/d1c/d2d/d4f/d58/f61 x:0 0 0 2024-02-10T00:00:26.298 INFO:tasks.workunit.client.1.smithi183.stdout:1/274: symlink d0/d3/d7/d3d/l68 0 2024-02-10T00:00:26.299 INFO:tasks.workunit.client.1.smithi183.stdout:1/275: read - d0/d3/f21 zero size 2024-02-10T00:00:26.299 INFO:tasks.workunit.client.1.smithi183.stdout:9/293: symlink d0/d3/d14/d1c/d2d/l62 0 2024-02-10T00:00:26.300 INFO:tasks.workunit.client.1.smithi183.stdout:3/274: creat d7/db/d2a/d33/f4e x:0 0 0 2024-02-10T00:00:26.303 INFO:tasks.workunit.client.1.smithi183.stdout:3/275: stat d7/db/d2a/d1c/c35 0 2024-02-10T00:00:26.304 INFO:tasks.workunit.client.1.smithi183.stdout:9/294: truncate d0/d3/d14/d1c/d2d/d4f/d58/f61 836761 0 2024-02-10T00:00:26.304 INFO:tasks.workunit.client.1.smithi183.stdout:9/295: chown d0/d3/d14/d1c/d2d/d4f 11761 1 2024-02-10T00:00:26.305 INFO:tasks.workunit.client.1.smithi183.stdout:9/296: write d0/d3/d14/d1c/f45 [682062,30580] 0 2024-02-10T00:00:26.306 INFO:tasks.workunit.client.1.smithi183.stdout:3/276: getdents d7/db 0 2024-02-10T00:00:26.307 INFO:tasks.workunit.client.1.smithi183.stdout:3/277: stat d7/db/d2a/d1c/f27 0 2024-02-10T00:00:26.307 INFO:tasks.workunit.client.1.smithi183.stdout:9/297: symlink d0/d3/d14/d1c/d4b/d51/l63 0 2024-02-10T00:00:26.308 INFO:tasks.workunit.client.1.smithi183.stdout:3/278: mknod d7/db/d2a/d4d/c4f 0 2024-02-10T00:00:26.309 INFO:tasks.workunit.client.1.smithi183.stdout:9/298: symlink d0/d3/d14/d3c/l64 0 2024-02-10T00:00:26.310 INFO:tasks.workunit.client.1.smithi183.stdout:9/299: fsync d0/d3/f4e 0 2024-02-10T00:00:26.310 INFO:tasks.workunit.client.1.smithi183.stdout:3/279: chown d7/l22 0 1 2024-02-10T00:00:26.311 INFO:tasks.workunit.client.1.smithi183.stdout:4/288: fsync de/d14/d27/f3d 0 2024-02-10T00:00:26.311 INFO:tasks.workunit.client.1.smithi183.stdout:3/280: readlink d7/l29 0 2024-02-10T00:00:26.312 INFO:tasks.workunit.client.1.smithi183.stdout:4/289: chown de/d19/d20 156498 1 2024-02-10T00:00:26.313 INFO:tasks.workunit.client.1.smithi183.stdout:9/300: creat d0/d3/d14/d1c/d4b/f65 x:0 0 0 2024-02-10T00:00:26.319 INFO:tasks.workunit.client.1.smithi183.stdout:2/342: write d2/da/f17 [2463517,41203] 0 2024-02-10T00:00:26.320 INFO:tasks.workunit.client.1.smithi183.stdout:4/290: symlink de/d14/d4e/l53 0 2024-02-10T00:00:26.322 INFO:tasks.workunit.client.1.smithi183.stdout:6/253: truncate d2/d26/f2e 1377004 0 2024-02-10T00:00:26.322 INFO:tasks.workunit.client.1.smithi183.stdout:7/294: truncate d0/d2/d4/f5 13377550 0 2024-02-10T00:00:26.323 INFO:tasks.workunit.client.1.smithi183.stdout:8/344: write d0/d23/d51/d5b/f5d [4852350,41493] 0 2024-02-10T00:00:26.323 INFO:tasks.workunit.client.1.smithi183.stdout:0/260: truncate d14/d1d/d59/d1a/f27 238824 0 2024-02-10T00:00:26.325 INFO:tasks.workunit.client.1.smithi183.stdout:8/345: chown d0/d31 405 1 2024-02-10T00:00:26.326 INFO:tasks.workunit.client.1.smithi183.stdout:5/363: write d4/d23/d2a/f58 [942061,26655] 0 2024-02-10T00:00:26.326 INFO:tasks.workunit.client.1.smithi183.stdout:7/295: write d0/d11/f1c [3955155,11857] 0 2024-02-10T00:00:26.327 INFO:tasks.workunit.client.1.smithi183.stdout:1/276: dread d0/d3/f2d [0,4194304] 0 2024-02-10T00:00:26.329 INFO:tasks.workunit.client.1.smithi183.stdout:1/277: read - d0/d3/d67/f30 zero size 2024-02-10T00:00:26.329 INFO:tasks.workunit.client.1.smithi183.stdout:4/291: dwrite de/d14/d27/f1b [0,4194304] 0 2024-02-10T00:00:26.330 INFO:tasks.workunit.client.1.smithi183.stdout:3/281: rename d7/db/d2a/f3c to d7/db/d2a/d2d/f50 0 2024-02-10T00:00:26.333 INFO:tasks.workunit.client.1.smithi183.stdout:2/343: creat d2/da/d20/d21/d36/f6e x:0 0 0 2024-02-10T00:00:26.334 INFO:tasks.workunit.client.1.smithi183.stdout:4/292: dread de/f3c [0,4194304] 0 2024-02-10T00:00:26.334 INFO:tasks.workunit.client.1.smithi183.stdout:2/344: stat d2/d33/d35/c50 0 2024-02-10T00:00:26.335 INFO:tasks.workunit.client.1.smithi183.stdout:6/254: rmdir d2/d1a/d3a/d45 39 2024-02-10T00:00:26.338 INFO:tasks.workunit.client.1.smithi183.stdout:8/346: mkdir d0/d4e/d6b 0 2024-02-10T00:00:26.341 INFO:tasks.workunit.client.1.smithi183.stdout:9/301: write d0/d3/d14/f38 [1244185,69189] 0 2024-02-10T00:00:26.342 INFO:tasks.workunit.client.1.smithi183.stdout:4/293: dread de/d14/d1d/d2f/f3e [0,4194304] 0 2024-02-10T00:00:26.342 INFO:tasks.workunit.client.1.smithi183.stdout:5/364: creat d4/dd/f75 x:0 0 0 2024-02-10T00:00:26.345 INFO:tasks.workunit.client.1.smithi183.stdout:0/261: dread f3 [0,4194304] 0 2024-02-10T00:00:26.345 INFO:tasks.workunit.client.1.smithi183.stdout:8/347: dwrite d0/fd [0,4194304] 0 2024-02-10T00:00:26.345 INFO:tasks.workunit.client.1.smithi183.stdout:8/348: chown d0/d23 5335 1 2024-02-10T00:00:26.346 INFO:tasks.workunit.client.1.smithi183.stdout:8/349: chown d0/d10/c17 208718 1 2024-02-10T00:00:26.347 INFO:tasks.workunit.client.1.smithi183.stdout:3/282: chown d7/db/d2a/c1d 11647243 1 2024-02-10T00:00:26.348 INFO:tasks.workunit.client.1.smithi183.stdout:2/345: write d2/f13 [7072003,7309] 0 2024-02-10T00:00:26.349 INFO:tasks.workunit.client.1.smithi183.stdout:6/255: rmdir d2/d1a/d3a 39 2024-02-10T00:00:26.352 INFO:tasks.workunit.client.1.smithi183.stdout:7/296: unlink d0/d2/d3/f43 0 2024-02-10T00:00:26.354 INFO:tasks.workunit.client.1.smithi183.stdout:7/297: dread - d0/d2/d4/f4a zero size 2024-02-10T00:00:26.354 INFO:tasks.workunit.client.1.smithi183.stdout:2/346: dwrite d2/da/d19/d31/d55/f5d [0,4194304] 0 2024-02-10T00:00:26.355 INFO:tasks.workunit.client.1.smithi183.stdout:3/283: dread d7/fd [0,4194304] 0 2024-02-10T00:00:26.356 INFO:tasks.workunit.client.1.smithi183.stdout:9/302: creat d0/d30/d52/f66 x:0 0 0 2024-02-10T00:00:26.359 INFO:tasks.workunit.client.1.smithi183.stdout:5/365: creat d4/d23/d3e/f76 x:0 0 0 2024-02-10T00:00:26.360 INFO:tasks.workunit.client.1.smithi183.stdout:1/278: mknod d0/d3/c69 0 2024-02-10T00:00:26.360 INFO:tasks.workunit.client.1.smithi183.stdout:6/256: rmdir d2/d26 39 2024-02-10T00:00:26.360 INFO:tasks.workunit.client.1.smithi183.stdout:2/347: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:26.360 INFO:tasks.workunit.client.1.smithi183.stdout:7/298: fdatasync d0/d11/f47 0 2024-02-10T00:00:26.361 INFO:tasks.workunit.client.1.smithi183.stdout:4/294: mknod de/c54 0 2024-02-10T00:00:26.362 INFO:tasks.workunit.client.1.smithi183.stdout:3/284: unlink d7/db/d2a/c1d 0 2024-02-10T00:00:26.362 INFO:tasks.workunit.client.1.smithi183.stdout:7/299: fsync d0/d11/f3a 0 2024-02-10T00:00:26.362 INFO:tasks.workunit.client.1.smithi183.stdout:0/262: symlink d14/d3e/d5f/l61 0 2024-02-10T00:00:26.363 INFO:tasks.workunit.client.1.smithi183.stdout:9/303: dwrite d0/f5b [0,4194304] 0 2024-02-10T00:00:26.364 INFO:tasks.workunit.client.1.smithi183.stdout:8/350: creat d0/d4e/d6b/f6c x:0 0 0 2024-02-10T00:00:26.369 INFO:tasks.workunit.client.1.smithi183.stdout:2/348: dread d2/da/d20/d21/f29 [0,4194304] 0 2024-02-10T00:00:26.371 INFO:tasks.workunit.client.1.smithi183.stdout:7/300: dwrite d0/d11/f47 [0,4194304] 0 2024-02-10T00:00:26.371 INFO:tasks.workunit.client.1.smithi183.stdout:7/301: stat d0/d2/d3/d38 0 2024-02-10T00:00:26.372 INFO:tasks.workunit.client.1.smithi183.stdout:7/302: stat d0/d11/d2f/f34 0 2024-02-10T00:00:26.372 INFO:tasks.workunit.client.1.smithi183.stdout:0/263: creat d14/d1d/d59/d1a/d51/f62 x:0 0 0 2024-02-10T00:00:26.373 INFO:tasks.workunit.client.1.smithi183.stdout:8/351: dread d0/d10/f1a [0,4194304] 0 2024-02-10T00:00:26.374 INFO:tasks.workunit.client.1.smithi183.stdout:0/264: write d14/d1d/d59/d1a/f56 [764503,31032] 0 2024-02-10T00:00:26.375 INFO:tasks.workunit.client.1.smithi183.stdout:0/265: dread - d14/d1d/d59/d3c/d3f/f58 zero size 2024-02-10T00:00:26.376 INFO:tasks.workunit.client.1.smithi183.stdout:2/349: creat d2/d2c/f6f x:0 0 0 2024-02-10T00:00:26.379 INFO:tasks.workunit.client.1.smithi183.stdout:0/266: dread d14/d1d/d59/d1a/d22/f4f [0,4194304] 0 2024-02-10T00:00:26.379 INFO:tasks.workunit.client.1.smithi183.stdout:8/352: symlink d0/d45/d46/l6d 0 2024-02-10T00:00:26.381 INFO:tasks.workunit.client.1.smithi183.stdout:7/303: dwrite d0/f44 [0,4194304] 0 2024-02-10T00:00:26.386 INFO:tasks.workunit.client.1.smithi183.stdout:1/279: getdents d0/d3 0 2024-02-10T00:00:26.388 INFO:tasks.workunit.client.1.smithi183.stdout:0/267: dread d14/f28 [0,4194304] 0 2024-02-10T00:00:26.389 INFO:tasks.workunit.client.1.smithi183.stdout:8/353: rename d0/c20 to d0/d23/c6e 0 2024-02-10T00:00:26.390 INFO:tasks.workunit.client.1.smithi183.stdout:8/354: readlink d0/d4e/l50 0 2024-02-10T00:00:26.390 INFO:tasks.workunit.client.1.smithi183.stdout:8/355: chown d0/d45/c4a 0 1 2024-02-10T00:00:26.391 INFO:tasks.workunit.client.1.smithi183.stdout:9/304: getdents d0/d3/d14/d1c/d4b/d51 0 2024-02-10T00:00:26.391 INFO:tasks.workunit.client.1.smithi183.stdout:9/305: chown d0/d30/c31 15 1 2024-02-10T00:00:26.392 INFO:tasks.workunit.client.1.smithi183.stdout:1/280: mknod d0/d3/c6a 0 2024-02-10T00:00:26.393 INFO:tasks.workunit.client.1.smithi183.stdout:0/268: mkdir d14/d1d/d59/d1a/d51/d63 0 2024-02-10T00:00:26.393 INFO:tasks.workunit.client.1.smithi183.stdout:7/304: symlink d0/d2/d4/l54 0 2024-02-10T00:00:26.394 INFO:tasks.workunit.client.1.smithi183.stdout:8/356: creat d0/d3f/f6f x:0 0 0 2024-02-10T00:00:26.394 INFO:tasks.workunit.client.1.smithi183.stdout:5/366: dread d4/d23/f26 [4194304,4194304] 0 2024-02-10T00:00:26.395 INFO:tasks.workunit.client.1.smithi183.stdout:9/306: mknod d0/d3/d14/d1c/d2d/d4f/c67 0 2024-02-10T00:00:26.455 INFO:tasks.workunit.client.1.smithi183.stdout:1/281: truncate d0/f5a 939110 0 2024-02-10T00:00:26.456 INFO:tasks.workunit.client.1.smithi183.stdout:6/257: link d2/d26/d35/l3d d2/d1a/d3a/l55 0 2024-02-10T00:00:26.456 INFO:tasks.workunit.client.1.smithi183.stdout:3/285: rmdir d7 39 2024-02-10T00:00:26.458 INFO:tasks.workunit.client.1.smithi183.stdout:7/305: creat d0/d2/d3/d38/f55 x:0 0 0 2024-02-10T00:00:26.458 INFO:tasks.workunit.client.1.smithi183.stdout:5/367: dwrite d4/f45 [0,4194304] 0 2024-02-10T00:00:26.458 INFO:tasks.workunit.client.1.smithi183.stdout:9/307: dwrite d0/d3/d14/d1c/f5c [0,4194304] 0 2024-02-10T00:00:26.459 INFO:tasks.workunit.client.1.smithi183.stdout:4/295: truncate de/d14/d27/f21 1573256 0 2024-02-10T00:00:26.460 INFO:tasks.workunit.client.1.smithi183.stdout:2/350: rmdir d2 39 2024-02-10T00:00:26.461 INFO:tasks.workunit.client.1.smithi183.stdout:4/296: readlink de/d14/d1d/l34 0 2024-02-10T00:00:26.463 INFO:tasks.workunit.client.1.smithi183.stdout:8/357: truncate d0/d23/d2d/d24/f32 3434923 0 2024-02-10T00:00:26.463 INFO:tasks.workunit.client.1.smithi183.stdout:4/297: fdatasync de/f1f 0 2024-02-10T00:00:26.463 INFO:tasks.workunit.client.1.smithi183.stdout:6/258: fdatasync d2/d32/f41 0 2024-02-10T00:00:26.465 INFO:tasks.workunit.client.1.smithi183.stdout:8/358: fdatasync d0/d23/d2d/d24/f28 0 2024-02-10T00:00:26.467 INFO:tasks.workunit.client.1.smithi183.stdout:7/306: dread d0/d2/f41 [0,4194304] 0 2024-02-10T00:00:26.468 INFO:tasks.workunit.client.1.smithi183.stdout:7/307: chown d0/f32 7 1 2024-02-10T00:00:26.468 INFO:tasks.workunit.client.1.smithi183.stdout:2/351: dread d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:26.468 INFO:tasks.workunit.client.1.smithi183.stdout:3/286: dread d7/f9 [0,4194304] 0 2024-02-10T00:00:26.471 INFO:tasks.workunit.client.1.smithi183.stdout:4/298: creat de/d14/d27/f55 x:0 0 0 2024-02-10T00:00:26.472 INFO:tasks.workunit.client.1.smithi183.stdout:6/259: mknod d2/d26/c56 0 2024-02-10T00:00:26.474 INFO:tasks.workunit.client.1.smithi183.stdout:2/352: dwrite d2/d33/d35/f4e [0,4194304] 0 2024-02-10T00:00:26.476 INFO:tasks.workunit.client.1.smithi183.stdout:3/287: mkdir d7/db/d2a/d2d/d51 0 2024-02-10T00:00:26.476 INFO:tasks.workunit.client.1.smithi183.stdout:2/353: chown d2/da/d20/d21/d43/d58 6 1 2024-02-10T00:00:26.477 INFO:tasks.workunit.client.1.smithi183.stdout:9/308: creat d0/f68 x:0 0 0 2024-02-10T00:00:26.478 INFO:tasks.workunit.client.1.smithi183.stdout:5/368: getdents d4/d23/d2a 0 2024-02-10T00:00:26.479 INFO:tasks.workunit.client.1.smithi183.stdout:1/282: dread d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:26.480 INFO:tasks.workunit.client.1.smithi183.stdout:8/359: dwrite d0/d4e/d53/f64 [0,4194304] 0 2024-02-10T00:00:26.480 INFO:tasks.workunit.client.1.smithi183.stdout:5/369: fsync d4/d4b/f60 0 2024-02-10T00:00:26.481 INFO:tasks.workunit.client.1.smithi183.stdout:3/288: mkdir d7/d4b/d52 0 2024-02-10T00:00:26.482 INFO:tasks.workunit.client.1.smithi183.stdout:2/354: rmdir d2/d2c 39 2024-02-10T00:00:26.483 INFO:tasks.workunit.client.1.smithi183.stdout:8/360: read - d0/d4e/d6b/f6c zero size 2024-02-10T00:00:26.483 INFO:tasks.workunit.client.1.smithi183.stdout:3/289: stat d7/db/d2a/d33 0 2024-02-10T00:00:26.483 INFO:tasks.workunit.client.1.smithi183.stdout:4/299: mkdir de/d19/d1c/d56 0 2024-02-10T00:00:26.485 INFO:tasks.workunit.client.1.smithi183.stdout:6/260: truncate d2/d26/f2e 1331061 0 2024-02-10T00:00:26.485 INFO:tasks.workunit.client.1.smithi183.stdout:4/300: dread - de/d14/d27/f45 zero size 2024-02-10T00:00:26.485 INFO:tasks.workunit.client.1.smithi183.stdout:4/301: readlink de/d22/l42 0 2024-02-10T00:00:26.487 INFO:tasks.workunit.client.1.smithi183.stdout:5/370: symlink d4/d23/d4a/d36/l77 0 2024-02-10T00:00:26.488 INFO:tasks.workunit.client.1.smithi183.stdout:8/361: dwrite d0/d23/d51/d5b/f5d [0,4194304] 0 2024-02-10T00:00:26.490 INFO:tasks.workunit.client.1.smithi183.stdout:9/309: creat d0/d3/d14/f69 x:0 0 0 2024-02-10T00:00:26.492 INFO:tasks.workunit.client.1.smithi183.stdout:2/355: mknod d2/da/c70 0 2024-02-10T00:00:26.494 INFO:tasks.workunit.client.1.smithi183.stdout:3/290: rename d7/db/d2a/l1a to d7/db/d2a/d33/l53 0 2024-02-10T00:00:26.497 INFO:tasks.workunit.client.1.smithi183.stdout:8/362: symlink d0/d4e/l70 0 2024-02-10T00:00:26.499 INFO:tasks.workunit.client.1.smithi183.stdout:4/302: link de/d22/f28 de/d14/d27/d40/f57 0 2024-02-10T00:00:26.501 INFO:tasks.workunit.client.1.smithi183.stdout:9/310: mkdir d0/d3/d14/d1c/d4b/d51/d6a 0 2024-02-10T00:00:26.502 INFO:tasks.workunit.client.1.smithi183.stdout:9/311: dread - d0/d3/d14/d3c/f60 zero size 2024-02-10T00:00:26.502 INFO:tasks.workunit.client.1.smithi183.stdout:9/312: fsync d0/f2f 0 2024-02-10T00:00:26.504 INFO:tasks.workunit.client.1.smithi183.stdout:5/371: rename d4/dd/d31/f34 to d4/d1d/d27/d38/d4f/f78 0 2024-02-10T00:00:26.504 INFO:tasks.workunit.client.1.smithi183.stdout:0/269: sync 2024-02-10T00:00:26.506 INFO:tasks.workunit.client.1.smithi183.stdout:8/363: mknod d0/d23/d51/d5b/c71 0 2024-02-10T00:00:26.513 INFO:tasks.workunit.client.1.smithi183.stdout:5/372: dread d4/d23/d4a/f53 [0,4194304] 0 2024-02-10T00:00:26.516 INFO:tasks.workunit.client.1.smithi183.stdout:3/291: truncate d7/db/d2a/d1c/f27 411853 0 2024-02-10T00:00:26.516 INFO:tasks.workunit.client.1.smithi183.stdout:9/313: dread d0/d10/f1b [4194304,4194304] 0 2024-02-10T00:00:26.518 INFO:tasks.workunit.client.1.smithi183.stdout:9/314: dread - d0/d30/d52/f66 zero size 2024-02-10T00:00:26.518 INFO:tasks.workunit.client.1.smithi183.stdout:5/373: dread d4/d23/d4a/d36/f5e [0,4194304] 0 2024-02-10T00:00:26.525 INFO:tasks.workunit.client.1.smithi183.stdout:1/283: dwrite d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:26.529 INFO:tasks.workunit.client.1.smithi183.stdout:7/308: sync 2024-02-10T00:00:26.533 INFO:tasks.workunit.client.1.smithi183.stdout:2/356: rename d2/d2c/l49 to d2/da/d19/l71 0 2024-02-10T00:00:26.533 INFO:tasks.workunit.client.1.smithi183.stdout:7/309: dread d0/d2/d3/f20 [0,4194304] 0 2024-02-10T00:00:26.534 INFO:tasks.workunit.client.1.smithi183.stdout:0/270: dread d14/d1d/f2b [0,4194304] 0 2024-02-10T00:00:26.534 INFO:tasks.workunit.client.1.smithi183.stdout:0/271: chown d14/d43 815527694 1 2024-02-10T00:00:26.535 INFO:tasks.workunit.client.1.smithi183.stdout:2/357: chown d2/da/d19/d31 386 1 2024-02-10T00:00:26.535 INFO:tasks.workunit.client.1.smithi183.stdout:6/261: dread d2/f30 [4194304,4194304] 0 2024-02-10T00:00:26.536 INFO:tasks.workunit.client.1.smithi183.stdout:3/292: chown d7/db/d2a/f2c 15204824 1 2024-02-10T00:00:26.537 INFO:tasks.workunit.client.1.smithi183.stdout:9/315: write d0/f5 [3148573,46470] 0 2024-02-10T00:00:26.540 INFO:tasks.workunit.client.1.smithi183.stdout:6/262: dwrite d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:26.544 INFO:tasks.workunit.client.1.smithi183.stdout:4/303: rename de/d19/d1c/d56 to de/d14/d4e/d58 0 2024-02-10T00:00:26.549 INFO:tasks.workunit.client.1.smithi183.stdout:3/293: dread - d7/db/d2a/f44 zero size 2024-02-10T00:00:26.549 INFO:tasks.workunit.client.1.smithi183.stdout:0/272: truncate d14/d1d/d59/d1a/d22/f4f 946372 0 2024-02-10T00:00:26.550 INFO:tasks.workunit.client.1.smithi183.stdout:1/284: mknod d0/c6b 0 2024-02-10T00:00:26.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/263: rmdir d2/d1a/d3a 39 2024-02-10T00:00:26.552 INFO:tasks.workunit.client.1.smithi183.stdout:9/316: dread d0/d3/d14/d1c/d2d/d4f/d58/f61 [0,4194304] 0 2024-02-10T00:00:26.553 INFO:tasks.workunit.client.1.smithi183.stdout:9/317: chown d0/f36 70519 1 2024-02-10T00:00:26.556 INFO:tasks.workunit.client.1.smithi183.stdout:4/304: creat de/d14/d1d/f59 x:0 0 0 2024-02-10T00:00:26.556 INFO:tasks.workunit.client.1.smithi183.stdout:4/305: dread - de/d14/f4a zero size 2024-02-10T00:00:26.557 INFO:tasks.workunit.client.1.smithi183.stdout:4/306: chown de/d14/d27/f1b 8913 1 2024-02-10T00:00:26.557 INFO:tasks.workunit.client.1.smithi183.stdout:2/358: mkdir d2/d2c/d2f/d72 0 2024-02-10T00:00:26.558 INFO:tasks.workunit.client.1.smithi183.stdout:8/364: getdents d0/d45 0 2024-02-10T00:00:26.558 INFO:tasks.workunit.client.1.smithi183.stdout:5/374: creat d4/f79 x:0 0 0 2024-02-10T00:00:26.559 INFO:tasks.workunit.client.1.smithi183.stdout:3/294: symlink d7/db/l54 0 2024-02-10T00:00:26.564 INFO:tasks.workunit.client.1.smithi183.stdout:4/307: mknod de/d14/d1d/d2f/c5a 0 2024-02-10T00:00:26.564 INFO:tasks.workunit.client.1.smithi183.stdout:2/359: symlink d2/d33/d35/l73 0 2024-02-10T00:00:26.565 INFO:tasks.workunit.client.1.smithi183.stdout:8/365: creat d0/d45/d46/f72 x:0 0 0 2024-02-10T00:00:26.570 INFO:tasks.workunit.client.1.smithi183.stdout:4/308: mknod de/d14/d1d/c5b 0 2024-02-10T00:00:26.570 INFO:tasks.workunit.client.1.smithi183.stdout:7/310: dwrite d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:26.571 INFO:tasks.workunit.client.1.smithi183.stdout:2/360: mkdir d2/da/d20/d21/d43/d58/d74 0 2024-02-10T00:00:26.572 INFO:tasks.workunit.client.1.smithi183.stdout:8/366: rmdir d0/d27 39 2024-02-10T00:00:26.572 INFO:tasks.workunit.client.1.smithi183.stdout:5/375: creat d4/dd/d31/d73/f7a x:0 0 0 2024-02-10T00:00:26.574 INFO:tasks.workunit.client.1.smithi183.stdout:1/285: creat d0/d3/d7/f6c x:0 0 0 2024-02-10T00:00:26.575 INFO:tasks.workunit.client.1.smithi183.stdout:9/318: dwrite d0/d3/d14/d1c/d2d/d4f/d58/f61 [0,4194304] 0 2024-02-10T00:00:26.575 INFO:tasks.workunit.client.1.smithi183.stdout:4/309: creat de/d14/d1d/d2f/f5c x:0 0 0 2024-02-10T00:00:26.581 INFO:tasks.workunit.client.1.smithi183.stdout:6/264: dwrite d2/f16 [0,4194304] 0 2024-02-10T00:00:26.582 INFO:tasks.workunit.client.1.smithi183.stdout:7/311: rename d0/d2/l42 to d0/d2/d50/l56 0 2024-02-10T00:00:26.583 INFO:tasks.workunit.client.1.smithi183.stdout:8/367: creat d0/d10/f73 x:0 0 0 2024-02-10T00:00:26.585 INFO:tasks.workunit.client.1.smithi183.stdout:4/310: creat de/d19/d20/f5d x:0 0 0 2024-02-10T00:00:26.586 INFO:tasks.workunit.client.1.smithi183.stdout:6/265: chown d2/f4b 420814 1 2024-02-10T00:00:26.586 INFO:tasks.workunit.client.1.smithi183.stdout:7/312: chown d0/f21 24 1 2024-02-10T00:00:26.588 INFO:tasks.workunit.client.1.smithi183.stdout:1/286: dwrite d0/d3/d7/f4a [0,4194304] 0 2024-02-10T00:00:26.588 INFO:tasks.workunit.client.1.smithi183.stdout:9/319: dwrite d0/d10/f50 [0,4194304] 0 2024-02-10T00:00:26.589 INFO:tasks.workunit.client.1.smithi183.stdout:5/376: dread d4/d1d/d27/d38/d4f/f78 [0,4194304] 0 2024-02-10T00:00:26.589 INFO:tasks.workunit.client.1.smithi183.stdout:9/320: write d0/f3b [638899,24521] 0 2024-02-10T00:00:26.590 INFO:tasks.workunit.client.1.smithi183.stdout:2/361: rename d2/d33 to d2/da/d19/d31/d75 0 2024-02-10T00:00:26.590 INFO:tasks.workunit.client.1.smithi183.stdout:8/368: symlink d0/d45/l74 0 2024-02-10T00:00:26.593 INFO:tasks.workunit.client.1.smithi183.stdout:8/369: chown d0/d4e/f4f 51228125 1 2024-02-10T00:00:26.593 INFO:tasks.workunit.client.1.smithi183.stdout:1/287: chown d0/d3/d29/d1f 21207 1 2024-02-10T00:00:26.594 INFO:tasks.workunit.client.1.smithi183.stdout:2/362: symlink d2/da/d20/d21/l76 0 2024-02-10T00:00:26.596 INFO:tasks.workunit.client.1.smithi183.stdout:5/377: creat d4/d1d/d27/d5d/d6d/f7b x:0 0 0 2024-02-10T00:00:26.599 INFO:tasks.workunit.client.1.smithi183.stdout:7/313: creat d0/d11/f57 x:0 0 0 2024-02-10T00:00:26.602 INFO:tasks.workunit.client.1.smithi183.stdout:2/363: unlink d2/da/d19/d31/l57 0 2024-02-10T00:00:26.604 INFO:tasks.workunit.client.1.smithi183.stdout:6/266: creat d2/d1a/d3a/f57 x:0 0 0 2024-02-10T00:00:26.605 INFO:tasks.workunit.client.1.smithi183.stdout:0/273: sync 2024-02-10T00:00:26.605 INFO:tasks.workunit.client.1.smithi183.stdout:1/288: rename d0/d3/l62 to d0/d3/d29/d1f/l6d 0 2024-02-10T00:00:26.606 INFO:tasks.workunit.client.1.smithi183.stdout:7/314: truncate d0/d11/f1c 4551690 0 2024-02-10T00:00:26.609 INFO:tasks.workunit.client.1.smithi183.stdout:8/370: rename d0/d23/d51 to d0/d27/d75 0 2024-02-10T00:00:26.609 INFO:tasks.workunit.client.1.smithi183.stdout:6/267: read d2/d26/d35/f4f [4068173,48222] 0 2024-02-10T00:00:26.609 INFO:tasks.workunit.client.1.smithi183.stdout:1/289: readlink d0/d3/d67/l53 0 2024-02-10T00:00:26.610 INFO:tasks.workunit.client.1.smithi183.stdout:8/371: mknod d0/d4e/d53/c76 0 2024-02-10T00:00:26.612 INFO:tasks.workunit.client.1.smithi183.stdout:1/290: creat d0/d3/d29/d38/f6e x:0 0 0 2024-02-10T00:00:26.614 INFO:tasks.workunit.client.1.smithi183.stdout:2/364: rename d2/d2c/d2d to d2/da/d77 0 2024-02-10T00:00:26.615 INFO:tasks.workunit.client.1.smithi183.stdout:2/365: stat d2/f15 0 2024-02-10T00:00:26.616 INFO:tasks.workunit.client.1.smithi183.stdout:1/291: truncate d0/d3/d67/f30 981635 0 2024-02-10T00:00:26.616 INFO:tasks.workunit.client.1.smithi183.stdout:8/372: dwrite d0/d4e/d53/f64 [0,4194304] 0 2024-02-10T00:00:26.617 INFO:tasks.workunit.client.1.smithi183.stdout:2/366: read d2/f3a [670659,91766] 0 2024-02-10T00:00:26.619 INFO:tasks.workunit.client.1.smithi183.stdout:6/268: dwrite d2/d1a/d25/d3c/d31/d38/d3f/f4c [0,4194304] 0 2024-02-10T00:00:26.621 INFO:tasks.workunit.client.1.smithi183.stdout:2/367: symlink d2/da/d19/d31/l78 0 2024-02-10T00:00:26.621 INFO:tasks.workunit.client.1.smithi183.stdout:8/373: truncate d0/d27/d36/f40 470244 0 2024-02-10T00:00:26.622 INFO:tasks.workunit.client.1.smithi183.stdout:6/269: mknod d2/d26/c58 0 2024-02-10T00:00:26.623 INFO:tasks.workunit.client.1.smithi183.stdout:2/368: chown d2/d2c/d2f/f3b 3 1 2024-02-10T00:00:26.623 INFO:tasks.workunit.client.1.smithi183.stdout:3/295: dwrite d7/db/d2a/d2d/f31 [0,4194304] 0 2024-02-10T00:00:26.627 INFO:tasks.workunit.client.1.smithi183.stdout:4/311: dread de/f11 [0,4194304] 0 2024-02-10T00:00:26.628 INFO:tasks.workunit.client.1.smithi183.stdout:2/369: mkdir d2/da/d19/d31/d55/d79 0 2024-02-10T00:00:26.629 INFO:tasks.workunit.client.1.smithi183.stdout:2/370: chown d2/da/d20/l5c 731289 1 2024-02-10T00:00:26.634 INFO:tasks.workunit.client.1.smithi183.stdout:4/312: creat de/d19/d20/f5e x:0 0 0 2024-02-10T00:00:26.635 INFO:tasks.workunit.client.1.smithi183.stdout:4/313: write de/d22/f25 [2722710,72922] 0 2024-02-10T00:00:26.635 INFO:tasks.workunit.client.1.smithi183.stdout:4/314: chown de 278208498 1 2024-02-10T00:00:26.636 INFO:tasks.workunit.client.1.smithi183.stdout:9/321: truncate d0/d10/f50 1787714 0 2024-02-10T00:00:26.637 INFO:tasks.workunit.client.1.smithi183.stdout:9/322: chown d0/d3/f29 1309895 1 2024-02-10T00:00:26.641 INFO:tasks.workunit.client.1.smithi183.stdout:2/371: creat d2/da/d19/f7a x:0 0 0 2024-02-10T00:00:26.642 INFO:tasks.workunit.client.1.smithi183.stdout:5/378: truncate d4/dd/f25 2878602 0 2024-02-10T00:00:26.642 INFO:tasks.workunit.client.1.smithi183.stdout:0/274: write d14/d1d/d59/d1a/d22/f41 [443764,110530] 0 2024-02-10T00:00:26.642 INFO:tasks.workunit.client.1.smithi183.stdout:0/275: stat d14/d1d/d59/c19 0 2024-02-10T00:00:26.643 INFO:tasks.workunit.client.1.smithi183.stdout:9/323: mknod d0/d3/d14/d1c/d4b/d51/c6b 0 2024-02-10T00:00:26.643 INFO:tasks.workunit.client.1.smithi183.stdout:5/379: write f0 [131013,93966] 0 2024-02-10T00:00:26.645 INFO:tasks.workunit.client.1.smithi183.stdout:5/380: chown d4/d1d/d27/d37/d46/d4e/l63 146196 1 2024-02-10T00:00:26.645 INFO:tasks.workunit.client.1.smithi183.stdout:4/315: link de/d14/c29 de/d14/d1d/d2f/c5f 0 2024-02-10T00:00:26.647 INFO:tasks.workunit.client.1.smithi183.stdout:2/372: truncate d2/f4a 177458 0 2024-02-10T00:00:26.648 INFO:tasks.workunit.client.1.smithi183.stdout:9/324: unlink d0/d3/d14/d1c/d4b/c56 0 2024-02-10T00:00:26.649 INFO:tasks.workunit.client.1.smithi183.stdout:0/276: link d14/f20 d14/d1d/d59/d3c/d3f/f64 0 2024-02-10T00:00:26.651 INFO:tasks.workunit.client.1.smithi183.stdout:9/325: creat d0/d30/d52/f6c x:0 0 0 2024-02-10T00:00:26.652 INFO:tasks.workunit.client.1.smithi183.stdout:2/373: mkdir d2/d2c/d2f/d72/d7b 0 2024-02-10T00:00:26.653 INFO:tasks.workunit.client.1.smithi183.stdout:6/270: dread d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:26.654 INFO:tasks.workunit.client.1.smithi183.stdout:5/381: creat d4/d1d/f7c x:0 0 0 2024-02-10T00:00:26.655 INFO:tasks.workunit.client.1.smithi183.stdout:8/374: getdents d0/d23 0 2024-02-10T00:00:26.656 INFO:tasks.workunit.client.1.smithi183.stdout:2/374: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:26.656 INFO:tasks.workunit.client.1.smithi183.stdout:5/382: write d4/d23/d2a/f58 [143127,8643] 0 2024-02-10T00:00:26.662 INFO:tasks.workunit.client.1.smithi183.stdout:9/326: symlink d0/d3/d14/d48/l6d 0 2024-02-10T00:00:26.663 INFO:tasks.workunit.client.1.smithi183.stdout:7/315: sync 2024-02-10T00:00:26.664 INFO:tasks.workunit.client.1.smithi183.stdout:0/277: creat d14/d1d/d59/d1a/d51/d63/f65 x:0 0 0 2024-02-10T00:00:26.665 INFO:tasks.workunit.client.1.smithi183.stdout:3/296: dwrite d7/db/d2a/d33/f36 [0,4194304] 0 2024-02-10T00:00:26.673 INFO:tasks.workunit.client.1.smithi183.stdout:8/375: mknod d0/d4e/d53/c77 0 2024-02-10T00:00:26.691 INFO:tasks.workunit.client.1.smithi183.stdout:2/375: fdatasync d2/da/d19/d31/f47 0 2024-02-10T00:00:26.692 INFO:tasks.workunit.client.1.smithi183.stdout:0/278: symlink d14/d1d/d59/d3c/d3f/l66 0 2024-02-10T00:00:26.692 INFO:tasks.workunit.client.1.smithi183.stdout:3/297: write d7/fd [1328324,21373] 0 2024-02-10T00:00:26.693 INFO:tasks.workunit.client.1.smithi183.stdout:4/316: dread de/d22/f25 [0,4194304] 0 2024-02-10T00:00:26.694 INFO:tasks.workunit.client.1.smithi183.stdout:6/271: symlink d2/d1a/d3a/d45/d53/l59 0 2024-02-10T00:00:26.695 INFO:tasks.workunit.client.1.smithi183.stdout:2/376: chown d2/da/d19/d31/d75/d35/c3f 220 1 2024-02-10T00:00:26.697 INFO:tasks.workunit.client.1.smithi183.stdout:7/316: link d0/f30 d0/d11/d3e/f58 0 2024-02-10T00:00:26.698 INFO:tasks.workunit.client.1.smithi183.stdout:5/383: dwrite f3 [0,4194304] 0 2024-02-10T00:00:26.701 INFO:tasks.workunit.client.1.smithi183.stdout:7/317: readlink d0/d2/d4/l2d 0 2024-02-10T00:00:26.702 INFO:tasks.workunit.client.1.smithi183.stdout:4/317: dread - de/d19/d1c/f36 zero size 2024-02-10T00:00:26.703 INFO:tasks.workunit.client.1.smithi183.stdout:5/384: creat d4/d1d/d27/d5d/d70/f7d x:0 0 0 2024-02-10T00:00:26.704 INFO:tasks.workunit.client.1.smithi183.stdout:1/292: sync 2024-02-10T00:00:26.704 INFO:tasks.workunit.client.1.smithi183.stdout:2/377: dread d2/da/d20/d21/f29 [0,4194304] 0 2024-02-10T00:00:26.704 INFO:tasks.workunit.client.1.smithi183.stdout:8/376: dwrite d0/d23/d2d/d24/f32 [0,4194304] 0 2024-02-10T00:00:26.706 INFO:tasks.workunit.client.1.smithi183.stdout:0/279: getdents d14/d1d/d59/d1a/d51 0 2024-02-10T00:00:26.706 INFO:tasks.workunit.client.1.smithi183.stdout:2/378: stat d2/d2c/d2f/f6a 0 2024-02-10T00:00:26.707 INFO:tasks.workunit.client.1.smithi183.stdout:4/318: symlink de/d14/d4e/l60 0 2024-02-10T00:00:26.708 INFO:tasks.workunit.client.1.smithi183.stdout:1/293: symlink d0/d3a/l6f 0 2024-02-10T00:00:26.708 INFO:tasks.workunit.client.1.smithi183.stdout:5/385: creat d4/d74/f7e x:0 0 0 2024-02-10T00:00:26.709 INFO:tasks.workunit.client.1.smithi183.stdout:2/379: rename d2 to d2/da/d19/d31/d75/d7c 22 2024-02-10T00:00:26.709 INFO:tasks.workunit.client.1.smithi183.stdout:0/280: fsync d14/d1d/d59/d3c/d3f/f58 0 2024-02-10T00:00:26.710 INFO:tasks.workunit.client.1.smithi183.stdout:4/319: readlink de/d14/d27/d40/l48 0 2024-02-10T00:00:26.710 INFO:tasks.workunit.client.1.smithi183.stdout:7/318: mkdir d0/d2/d4/d8/d59 0 2024-02-10T00:00:26.710 INFO:tasks.workunit.client.1.smithi183.stdout:8/377: fsync d0/d27/d36/f40 0 2024-02-10T00:00:26.711 INFO:tasks.workunit.client.1.smithi183.stdout:4/320: chown de/d14/d1d/d2f/c5a 2099405556 1 2024-02-10T00:00:26.711 INFO:tasks.workunit.client.1.smithi183.stdout:5/386: write d4/d23/d2a/f49 [1041330,70423] 0 2024-02-10T00:00:26.712 INFO:tasks.workunit.client.1.smithi183.stdout:4/321: readlink de/d14/d1d/d2f/l41 0 2024-02-10T00:00:26.713 INFO:tasks.workunit.client.1.smithi183.stdout:0/281: stat d14/d1d/d59/d1a/d22/c2e 0 2024-02-10T00:00:26.714 INFO:tasks.workunit.client.1.smithi183.stdout:4/322: write de/d14/d27/d2e/f4d [463179,91154] 0 2024-02-10T00:00:26.715 INFO:tasks.workunit.client.1.smithi183.stdout:4/323: fdatasync de/d14/f4b 0 2024-02-10T00:00:26.715 INFO:tasks.workunit.client.1.smithi183.stdout:2/380: unlink d2/da/d20/d21/d36/f53 0 2024-02-10T00:00:26.718 INFO:tasks.workunit.client.1.smithi183.stdout:0/282: write f6 [317901,122107] 0 2024-02-10T00:00:26.718 INFO:tasks.workunit.client.1.smithi183.stdout:7/319: fsync d0/d11/d35/f51 0 2024-02-10T00:00:26.718 INFO:tasks.workunit.client.1.smithi183.stdout:8/378: truncate d0/d4e/f6a 347259 0 2024-02-10T00:00:26.719 INFO:tasks.workunit.client.1.smithi183.stdout:5/387: dwrite d4/d1d/d27/d37/d46/f69 [0,4194304] 0 2024-02-10T00:00:26.721 INFO:tasks.workunit.client.1.smithi183.stdout:7/320: readlink d0/d2/d4/l2d 0 2024-02-10T00:00:26.721 INFO:tasks.workunit.client.1.smithi183.stdout:3/298: dread d7/db/d2a/d2d/f50 [0,4194304] 0 2024-02-10T00:00:26.721 INFO:tasks.workunit.client.1.smithi183.stdout:0/283: rmdir d14/d3e 39 2024-02-10T00:00:26.721 INFO:tasks.workunit.client.1.smithi183.stdout:8/379: rmdir d0/d23/d2d 39 2024-02-10T00:00:26.723 INFO:tasks.workunit.client.1.smithi183.stdout:0/284: write fb [2844234,100800] 0 2024-02-10T00:00:26.726 INFO:tasks.workunit.client.1.smithi183.stdout:4/324: dwrite de/f12 [0,4194304] 0 2024-02-10T00:00:26.727 INFO:tasks.workunit.client.1.smithi183.stdout:2/381: rename d2/da/d5b/f69 to d2/da/f7d 0 2024-02-10T00:00:26.729 INFO:tasks.workunit.client.1.smithi183.stdout:7/321: dwrite d0/f32 [0,4194304] 0 2024-02-10T00:00:26.729 INFO:tasks.workunit.client.1.smithi183.stdout:8/380: mknod d0/d10/c78 0 2024-02-10T00:00:26.735 INFO:tasks.workunit.client.1.smithi183.stdout:0/285: symlink d14/d1d/d2d/d31/l67 0 2024-02-10T00:00:26.736 INFO:tasks.workunit.client.1.smithi183.stdout:2/382: mknod d2/da/d19/c7e 0 2024-02-10T00:00:26.737 INFO:tasks.workunit.client.1.smithi183.stdout:7/322: read d0/f53 [216243,79315] 0 2024-02-10T00:00:26.738 INFO:tasks.workunit.client.1.smithi183.stdout:4/325: mkdir de/d19/d1c/d61 0 2024-02-10T00:00:26.738 INFO:tasks.workunit.client.1.smithi183.stdout:7/323: write d0/f32 [4509134,87493] 0 2024-02-10T00:00:26.739 INFO:tasks.workunit.client.1.smithi183.stdout:5/388: dread f0 [0,4194304] 0 2024-02-10T00:00:26.740 INFO:tasks.workunit.client.1.smithi183.stdout:0/286: mkdir d14/d1d/d2d/d31/d68 0 2024-02-10T00:00:26.741 INFO:tasks.workunit.client.1.smithi183.stdout:0/287: write d14/d1d/d59/d1a/d22/f48 [638798,83592] 0 2024-02-10T00:00:26.741 INFO:tasks.workunit.client.1.smithi183.stdout:3/299: link d7/db/d2a/d2d/f31 d7/f55 0 2024-02-10T00:00:26.742 INFO:tasks.workunit.client.1.smithi183.stdout:3/300: fdatasync d7/f8 0 2024-02-10T00:00:26.742 INFO:tasks.workunit.client.1.smithi183.stdout:0/288: readlink d14/d1d/d59/d1a/l1e 0 2024-02-10T00:00:26.744 INFO:tasks.workunit.client.1.smithi183.stdout:7/324: symlink d0/d11/d3e/l5a 0 2024-02-10T00:00:26.744 INFO:tasks.workunit.client.1.smithi183.stdout:3/301: write d7/fd [803274,87523] 0 2024-02-10T00:00:26.745 INFO:tasks.workunit.client.1.smithi183.stdout:5/389: dread d4/d1d/d27/d37/d46/f69 [0,4194304] 0 2024-02-10T00:00:26.745 INFO:tasks.workunit.client.1.smithi183.stdout:0/289: chown d14/d1d/d59/d1a/d22/f48 81 1 2024-02-10T00:00:26.745 INFO:tasks.workunit.client.1.smithi183.stdout:0/290: stat d14/d1d 0 2024-02-10T00:00:26.746 INFO:tasks.workunit.client.1.smithi183.stdout:9/327: sync 2024-02-10T00:00:26.747 INFO:tasks.workunit.client.1.smithi183.stdout:4/326: unlink de/d19/d1c/f2b 0 2024-02-10T00:00:26.748 INFO:tasks.workunit.client.1.smithi183.stdout:8/381: getdents d0/d27 0 2024-02-10T00:00:26.748 INFO:tasks.workunit.client.1.smithi183.stdout:4/327: chown de/d22/c4c 28998213 1 2024-02-10T00:00:26.748 INFO:tasks.workunit.client.1.smithi183.stdout:3/302: chown d7/l15 15119028 1 2024-02-10T00:00:26.749 INFO:tasks.workunit.client.1.smithi183.stdout:7/325: mknod d0/d11/d35/c5b 0 2024-02-10T00:00:26.751 INFO:tasks.workunit.client.1.smithi183.stdout:9/328: rename d0/d3/d14/d1c/d4b/d51/d6a to d0/d3/d6e 0 2024-02-10T00:00:26.760 INFO:tasks.workunit.client.1.smithi183.stdout:5/390: fsync d4/dd/f25 0 2024-02-10T00:00:26.761 INFO:tasks.workunit.client.1.smithi183.stdout:3/303: rename d7/db/d2a/d33/f4e to d7/db/d2a/d33/f56 0 2024-02-10T00:00:26.761 INFO:tasks.workunit.client.1.smithi183.stdout:4/328: dwrite de/d14/f4a [0,4194304] 0 2024-02-10T00:00:26.761 INFO:tasks.workunit.client.1.smithi183.stdout:0/291: creat d14/d3e/f69 x:0 0 0 2024-02-10T00:00:26.762 INFO:tasks.workunit.client.1.smithi183.stdout:5/391: readlink d4/l3a 0 2024-02-10T00:00:26.764 INFO:tasks.workunit.client.1.smithi183.stdout:2/383: write d2/d3d/f42 [1094569,124187] 0 2024-02-10T00:00:26.766 INFO:tasks.workunit.client.1.smithi183.stdout:7/326: write d0/d11/f1c [5193359,50047] 0 2024-02-10T00:00:26.767 INFO:tasks.workunit.client.1.smithi183.stdout:4/329: rename de/c54 to de/d14/d1d/d2f/c62 0 2024-02-10T00:00:26.769 INFO:tasks.workunit.client.1.smithi183.stdout:2/384: symlink d2/da/d20/d21/l7f 0 2024-02-10T00:00:26.770 INFO:tasks.workunit.client.1.smithi183.stdout:3/304: dwrite d7/db/d2a/f44 [0,4194304] 0 2024-02-10T00:00:26.770 INFO:tasks.workunit.client.1.smithi183.stdout:9/329: link d0/d3/d14/d3c/f60 d0/d3/d14/d3c/f6f 0 2024-02-10T00:00:26.774 INFO:tasks.workunit.client.1.smithi183.stdout:4/330: creat de/d22/f63 x:0 0 0 2024-02-10T00:00:26.774 INFO:tasks.workunit.client.1.smithi183.stdout:2/385: creat d2/da/d19/d31/f80 x:0 0 0 2024-02-10T00:00:26.775 INFO:tasks.workunit.client.1.smithi183.stdout:0/292: dwrite d14/d1d/d59/d1a/d22/f35 [0,4194304] 0 2024-02-10T00:00:26.775 INFO:tasks.workunit.client.1.smithi183.stdout:9/330: mknod d0/d3/d14/d1c/d2d/d4f/c70 0 2024-02-10T00:00:26.775 INFO:tasks.workunit.client.1.smithi183.stdout:5/392: getdents d4/d23/d4a/d36 0 2024-02-10T00:00:26.776 INFO:tasks.workunit.client.1.smithi183.stdout:2/386: write d2/da/d19/d31/d55/f5d [1512689,85380] 0 2024-02-10T00:00:26.777 INFO:tasks.workunit.client.1.smithi183.stdout:7/327: truncate d0/d11/d3e/f49 913158 0 2024-02-10T00:00:26.779 INFO:tasks.workunit.client.1.smithi183.stdout:3/305: truncate d7/db/d2a/d2d/f31 2901497 0 2024-02-10T00:00:26.780 INFO:tasks.workunit.client.1.smithi183.stdout:9/331: stat d0/d3/d14/d1c/c41 0 2024-02-10T00:00:26.780 INFO:tasks.workunit.client.1.smithi183.stdout:3/306: write d7/f8 [3777392,53936] 0 2024-02-10T00:00:26.782 INFO:tasks.workunit.client.1.smithi183.stdout:7/328: mknod d0/d2/d4/d8/c5c 0 2024-02-10T00:00:26.783 INFO:tasks.workunit.client.1.smithi183.stdout:0/293: creat d14/d1d/d2d/d31/d68/f6a x:0 0 0 2024-02-10T00:00:26.784 INFO:tasks.workunit.client.1.smithi183.stdout:2/387: fsync d2/da/f1d 0 2024-02-10T00:00:26.785 INFO:tasks.workunit.client.1.smithi183.stdout:4/331: getdents de/d14/d4e 0 2024-02-10T00:00:26.786 INFO:tasks.workunit.client.1.smithi183.stdout:5/393: dwrite d4/dd/f25 [0,4194304] 0 2024-02-10T00:00:26.788 INFO:tasks.workunit.client.1.smithi183.stdout:1/294: sync 2024-02-10T00:00:26.789 INFO:tasks.workunit.client.1.smithi183.stdout:6/272: sync 2024-02-10T00:00:26.790 INFO:tasks.workunit.client.1.smithi183.stdout:0/294: mknod d14/d3e/c6b 0 2024-02-10T00:00:26.792 INFO:tasks.workunit.client.1.smithi183.stdout:2/388: dwrite d2/da/d19/d31/f80 [0,4194304] 0 2024-02-10T00:00:26.792 INFO:tasks.workunit.client.1.smithi183.stdout:5/394: mknod d4/d1d/d27/d5d/c7f 0 2024-02-10T00:00:26.792 INFO:tasks.workunit.client.1.smithi183.stdout:0/295: chown d14/d1d/d59/d3c 28405 1 2024-02-10T00:00:26.794 INFO:tasks.workunit.client.1.smithi183.stdout:5/395: write d4/d1d/d27/d37/d46/f6c [492806,84205] 0 2024-02-10T00:00:26.795 INFO:tasks.workunit.client.1.smithi183.stdout:6/273: dread d2/f4b [4194304,4194304] 0 2024-02-10T00:00:26.796 INFO:tasks.workunit.client.1.smithi183.stdout:1/295: mkdir d0/d3/d67/d70 0 2024-02-10T00:00:26.799 INFO:tasks.workunit.client.1.smithi183.stdout:2/389: rename d2/c22 to d2/d2c/d2f/d72/d7b/c81 0 2024-02-10T00:00:26.804 INFO:tasks.workunit.client.1.smithi183.stdout:2/390: mknod d2/d2c/d2f/d72/c82 0 2024-02-10T00:00:26.805 INFO:tasks.workunit.client.1.smithi183.stdout:6/274: truncate d2/d1a/d3a/f40 163169 0 2024-02-10T00:00:26.808 INFO:tasks.workunit.client.1.smithi183.stdout:2/391: rmdir d2/da/d19 39 2024-02-10T00:00:26.809 INFO:tasks.workunit.client.1.smithi183.stdout:6/275: rmdir d2/d1a/d3a/d45/d53 39 2024-02-10T00:00:26.810 INFO:tasks.workunit.client.1.smithi183.stdout:2/392: write d2/f3a [2271065,97488] 0 2024-02-10T00:00:26.811 INFO:tasks.workunit.client.1.smithi183.stdout:2/393: write d2/da/d20/d21/d43/f45 [7675636,33112] 0 2024-02-10T00:00:26.812 INFO:tasks.workunit.client.1.smithi183.stdout:6/276: getdents d2/d1a 0 2024-02-10T00:00:26.813 INFO:tasks.workunit.client.1.smithi183.stdout:3/307: dread d7/f20 [0,4194304] 0 2024-02-10T00:00:26.816 INFO:tasks.workunit.client.1.smithi183.stdout:9/332: truncate d0/d3/d14/d1c/d2d/d4f/d58/f61 2121749 0 2024-02-10T00:00:26.817 INFO:tasks.workunit.client.1.smithi183.stdout:6/277: dwrite d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:26.820 INFO:tasks.workunit.client.1.smithi183.stdout:9/333: mknod d0/d3/d14/d3c/c71 0 2024-02-10T00:00:26.821 INFO:tasks.workunit.client.1.smithi183.stdout:4/332: truncate de/d19/d20/f26 114158 0 2024-02-10T00:00:26.821 INFO:tasks.workunit.client.1.smithi183.stdout:9/334: fdatasync d0/f2e 0 2024-02-10T00:00:26.823 INFO:tasks.workunit.client.1.smithi183.stdout:6/278: dwrite d2/f16 [0,4194304] 0 2024-02-10T00:00:26.823 INFO:tasks.workunit.client.1.smithi183.stdout:9/335: chown d0/d3/l4 41427 1 2024-02-10T00:00:26.824 INFO:tasks.workunit.client.1.smithi183.stdout:9/336: chown d0/d30/d52 921118 1 2024-02-10T00:00:26.825 INFO:tasks.workunit.client.1.smithi183.stdout:9/337: fdatasync d0/f3b 0 2024-02-10T00:00:26.827 INFO:tasks.workunit.client.1.smithi183.stdout:4/333: unlink de/d14/f4b 0 2024-02-10T00:00:26.827 INFO:tasks.workunit.client.1.smithi183.stdout:0/296: dwrite d14/f40 [0,4194304] 0 2024-02-10T00:00:26.833 INFO:tasks.workunit.client.1.smithi183.stdout:1/296: dwrite d0/d3/d67/f30 [0,4194304] 0 2024-02-10T00:00:26.833 INFO:tasks.workunit.client.1.smithi183.stdout:5/396: dread d4/d1d/d27/d38/f47 [0,4194304] 0 2024-02-10T00:00:26.834 INFO:tasks.workunit.client.1.smithi183.stdout:5/397: readlink d4/d1d/d27/d37/l6f 0 2024-02-10T00:00:26.837 INFO:tasks.workunit.client.1.smithi183.stdout:2/394: truncate d2/da/d19/d31/d55/f5d 3759293 0 2024-02-10T00:00:26.837 INFO:tasks.workunit.client.1.smithi183.stdout:9/338: unlink d0/d3/d14/d3c/c3e 0 2024-02-10T00:00:26.838 INFO:tasks.workunit.client.1.smithi183.stdout:1/297: dwrite d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:26.839 INFO:tasks.workunit.client.1.smithi183.stdout:8/382: sync 2024-02-10T00:00:26.840 INFO:tasks.workunit.client.1.smithi183.stdout:9/339: fsync d0/d3/d14/f46 0 2024-02-10T00:00:26.841 INFO:tasks.workunit.client.1.smithi183.stdout:0/297: mkdir d14/d1d/d2d/d31/d6c 0 2024-02-10T00:00:26.841 INFO:tasks.workunit.client.1.smithi183.stdout:1/298: write d0/d3/d7/f63 [612031,77232] 0 2024-02-10T00:00:26.842 INFO:tasks.workunit.client.1.smithi183.stdout:1/299: write d0/d3/d7/d3d/d60/f64 [974823,28430] 0 2024-02-10T00:00:26.844 INFO:tasks.workunit.client.1.smithi183.stdout:5/398: mkdir d4/d23/d3e/d80 0 2024-02-10T00:00:26.848 INFO:tasks.workunit.client.1.smithi183.stdout:6/279: creat d2/f5a x:0 0 0 2024-02-10T00:00:26.849 INFO:tasks.workunit.client.1.smithi183.stdout:9/340: mknod d0/d3/d14/d1c/c72 0 2024-02-10T00:00:26.849 INFO:tasks.workunit.client.1.smithi183.stdout:6/280: write d2/d1a/d25/d3c/d31/d38/d3f/f4d [550298,46176] 0 2024-02-10T00:00:26.850 INFO:tasks.workunit.client.1.smithi183.stdout:0/298: rmdir d14/d1d/d59/d1a/d22 39 2024-02-10T00:00:26.851 INFO:tasks.workunit.client.1.smithi183.stdout:1/300: write d0/d3/d29/d38/f3b [2974464,105868] 0 2024-02-10T00:00:26.852 INFO:tasks.workunit.client.1.smithi183.stdout:1/301: chown d0/d3/d7/d3d/l68 469 1 2024-02-10T00:00:26.852 INFO:tasks.workunit.client.1.smithi183.stdout:2/395: mkdir d2/da/d20/d21/d43/d58/d74/d83 0 2024-02-10T00:00:26.854 INFO:tasks.workunit.client.1.smithi183.stdout:9/341: symlink d0/d30/l73 0 2024-02-10T00:00:26.854 INFO:tasks.workunit.client.1.smithi183.stdout:9/342: chown d0/d3/d14/d1c/d2d/d4f 53 1 2024-02-10T00:00:26.854 INFO:tasks.workunit.client.1.smithi183.stdout:6/281: mknod d2/d26/d35/c5b 0 2024-02-10T00:00:26.855 INFO:tasks.workunit.client.1.smithi183.stdout:4/334: dread de/d19/d1c/f39 [0,4194304] 0 2024-02-10T00:00:26.855 INFO:tasks.workunit.client.1.smithi183.stdout:6/282: readlink d2/d32/l52 0 2024-02-10T00:00:26.859 INFO:tasks.workunit.client.1.smithi183.stdout:8/383: rename d0/d45/d46/f72 to d0/d3f/f79 0 2024-02-10T00:00:26.861 INFO:tasks.workunit.client.1.smithi183.stdout:5/399: link d4/c41 d4/d1d/d27/d5d/d70/d72/c81 0 2024-02-10T00:00:26.861 INFO:tasks.workunit.client.1.smithi183.stdout:1/302: mknod d0/d3/d67/d70/c71 0 2024-02-10T00:00:26.864 INFO:tasks.workunit.client.1.smithi183.stdout:5/400: symlink d4/dd/d31/l82 0 2024-02-10T00:00:26.864 INFO:tasks.workunit.client.1.smithi183.stdout:9/343: truncate d0/d10/f1b 2530775 0 2024-02-10T00:00:26.867 INFO:tasks.workunit.client.1.smithi183.stdout:1/303: dwrite d0/d3/d29/d1f/f28 [0,4194304] 0 2024-02-10T00:00:26.867 INFO:tasks.workunit.client.1.smithi183.stdout:5/401: creat d4/dd/d31/f83 x:0 0 0 2024-02-10T00:00:26.869 INFO:tasks.workunit.client.1.smithi183.stdout:0/299: dread d14/f20 [0,4194304] 0 2024-02-10T00:00:26.869 INFO:tasks.workunit.client.1.smithi183.stdout:9/344: mkdir d0/d3/d14/d74 0 2024-02-10T00:00:26.871 INFO:tasks.workunit.client.1.smithi183.stdout:5/402: write d4/d23/f26 [8182112,62429] 0 2024-02-10T00:00:26.872 INFO:tasks.workunit.client.1.smithi183.stdout:1/304: write d0/d3/d7/d36/f47 [852101,95416] 0 2024-02-10T00:00:26.872 INFO:tasks.workunit.client.1.smithi183.stdout:5/403: write d4/f45 [1893368,71971] 0 2024-02-10T00:00:26.875 INFO:tasks.workunit.client.1.smithi183.stdout:3/308: read d7/f55 [677843,3297] 0 2024-02-10T00:00:26.876 INFO:tasks.workunit.client.1.smithi183.stdout:3/309: chown d7/c3d 76070804 1 2024-02-10T00:00:26.877 INFO:tasks.workunit.client.1.smithi183.stdout:9/345: dwrite d0/d3/d14/d1c/f45 [0,4194304] 0 2024-02-10T00:00:26.879 INFO:tasks.workunit.client.1.smithi183.stdout:9/346: stat d0/d3/d14/d48/l6d 0 2024-02-10T00:00:26.880 INFO:tasks.workunit.client.1.smithi183.stdout:9/347: fdatasync d0/d3/d14/f69 0 2024-02-10T00:00:26.880 INFO:tasks.workunit.client.1.smithi183.stdout:1/305: dwrite d0/d3/d7/f32 [0,4194304] 0 2024-02-10T00:00:26.886 INFO:tasks.workunit.client.1.smithi183.stdout:4/335: write de/f2c [1498473,32209] 0 2024-02-10T00:00:26.891 INFO:tasks.workunit.client.1.smithi183.stdout:1/306: dwrite d0/d3/d7/d36/f47 [0,4194304] 0 2024-02-10T00:00:26.891 INFO:tasks.workunit.client.1.smithi183.stdout:5/404: creat d4/dd/d71/f84 x:0 0 0 2024-02-10T00:00:26.892 INFO:tasks.workunit.client.1.smithi183.stdout:2/396: dwrite d2/da/d20/d21/f23 [0,4194304] 0 2024-02-10T00:00:26.893 INFO:tasks.workunit.client.1.smithi183.stdout:5/405: read - d4/d74/f7e zero size 2024-02-10T00:00:26.894 INFO:tasks.workunit.client.1.smithi183.stdout:4/336: rename de/d19/d20/f23 to de/d19/d1c/d61/f64 0 2024-02-10T00:00:26.894 INFO:tasks.workunit.client.1.smithi183.stdout:6/283: dwrite d2/d26/f2e [0,4194304] 0 2024-02-10T00:00:26.896 INFO:tasks.workunit.client.1.smithi183.stdout:5/406: chown d4/c5 1 1 2024-02-10T00:00:26.896 INFO:tasks.workunit.client.1.smithi183.stdout:8/384: truncate d0/d23/d2d/d24/f59 2545378 0 2024-02-10T00:00:26.896 INFO:tasks.workunit.client.1.smithi183.stdout:3/310: dread f6 [0,4194304] 0 2024-02-10T00:00:26.900 INFO:tasks.workunit.client.1.smithi183.stdout:9/348: dread d0/f3b [0,4194304] 0 2024-02-10T00:00:26.902 INFO:tasks.workunit.client.1.smithi183.stdout:5/407: dwrite d4/d1d/d27/d5d/d70/f7d [0,4194304] 0 2024-02-10T00:00:26.904 INFO:tasks.workunit.client.1.smithi183.stdout:0/300: dwrite d14/d1d/d59/d1a/f1b [0,4194304] 0 2024-02-10T00:00:26.904 INFO:tasks.workunit.client.1.smithi183.stdout:3/311: fsync d7/db/f45 0 2024-02-10T00:00:26.906 INFO:tasks.workunit.client.1.smithi183.stdout:8/385: creat d0/d23/d2d/d24/f7a x:0 0 0 2024-02-10T00:00:26.908 INFO:tasks.workunit.client.1.smithi183.stdout:7/329: sync 2024-02-10T00:00:26.909 INFO:tasks.workunit.client.1.smithi183.stdout:5/408: dwrite d4/dd/f25 [0,4194304] 0 2024-02-10T00:00:26.911 INFO:tasks.workunit.client.1.smithi183.stdout:0/301: creat d14/d1d/d2d/d31/f6d x:0 0 0 2024-02-10T00:00:26.913 INFO:tasks.workunit.client.1.smithi183.stdout:5/409: creat d4/dd/d31/d73/f85 x:0 0 0 2024-02-10T00:00:26.915 INFO:tasks.workunit.client.1.smithi183.stdout:7/330: fsync d0/d11/d3e/f49 0 2024-02-10T00:00:26.916 INFO:tasks.workunit.client.1.smithi183.stdout:7/331: chown d0/f44 24 1 2024-02-10T00:00:26.916 INFO:tasks.workunit.client.1.smithi183.stdout:8/386: creat d0/d23/d2d/f7b x:0 0 0 2024-02-10T00:00:26.917 INFO:tasks.workunit.client.1.smithi183.stdout:5/410: creat d4/d23/f86 x:0 0 0 2024-02-10T00:00:26.917 INFO:tasks.workunit.client.1.smithi183.stdout:0/302: dwrite d14/d1d/f32 [0,4194304] 0 2024-02-10T00:00:26.920 INFO:tasks.workunit.client.1.smithi183.stdout:3/312: link d7/db/d2a/d33/l34 d7/d4b/l57 0 2024-02-10T00:00:26.922 INFO:tasks.workunit.client.1.smithi183.stdout:3/313: chown d7/db/d2a/d33/f37 12032 1 2024-02-10T00:00:26.922 INFO:tasks.workunit.client.1.smithi183.stdout:3/314: read f6 [149075,84076] 0 2024-02-10T00:00:26.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/315: stat d7/f30 0 2024-02-10T00:00:26.923 INFO:tasks.workunit.client.1.smithi183.stdout:5/411: read d4/dd/f14 [2835488,125942] 0 2024-02-10T00:00:26.940 INFO:tasks.workunit.client.1.smithi183.stdout:0/303: dwrite d14/f37 [0,4194304] 0 2024-02-10T00:00:26.942 INFO:tasks.workunit.client.1.smithi183.stdout:3/316: mknod d7/db/d2a/d4d/c58 0 2024-02-10T00:00:26.943 INFO:tasks.workunit.client.1.smithi183.stdout:5/412: rmdir d4/d1d/d27/d37 39 2024-02-10T00:00:26.949 INFO:tasks.workunit.client.1.smithi183.stdout:3/317: dwrite d7/db/f13 [8388608,4194304] 0 2024-02-10T00:00:26.951 INFO:tasks.workunit.client.1.smithi183.stdout:5/413: link d4/d1d/d27/d37/f51 d4/d1d/d27/d5d/d6d/f87 0 2024-02-10T00:00:26.956 INFO:tasks.workunit.client.1.smithi183.stdout:5/414: dwrite d4/d23/f26 [4194304,4194304] 0 2024-02-10T00:00:26.956 INFO:tasks.workunit.client.1.smithi183.stdout:5/415: chown d4/d23/d4a/d36/l77 4 1 2024-02-10T00:00:26.959 INFO:tasks.workunit.client.1.smithi183.stdout:5/416: creat d4/d1d/d27/d38/f88 x:0 0 0 2024-02-10T00:00:26.962 INFO:tasks.workunit.client.1.smithi183.stdout:1/307: dread d0/d3/d7/f23 [0,4194304] 0 2024-02-10T00:00:26.962 INFO:tasks.workunit.client.1.smithi183.stdout:5/417: mkdir d4/d1d/d89 0 2024-02-10T00:00:26.962 INFO:tasks.workunit.client.1.smithi183.stdout:5/418: fsync d4/dd/f75 0 2024-02-10T00:00:26.963 INFO:tasks.workunit.client.1.smithi183.stdout:1/308: chown d0/d3/lb 12519188 1 2024-02-10T00:00:26.963 INFO:tasks.workunit.client.1.smithi183.stdout:5/419: write d4/dd/f54 [1393106,86525] 0 2024-02-10T00:00:26.965 INFO:tasks.workunit.client.1.smithi183.stdout:5/420: creat d4/d4b/f8a x:0 0 0 2024-02-10T00:00:26.967 INFO:tasks.workunit.client.1.smithi183.stdout:2/397: write d2/da/fb [662431,26285] 0 2024-02-10T00:00:26.967 INFO:tasks.workunit.client.1.smithi183.stdout:4/337: write de/d14/f47 [50865,88805] 0 2024-02-10T00:00:26.969 INFO:tasks.workunit.client.1.smithi183.stdout:6/284: write d2/d1a/d3a/f40 [515653,94071] 0 2024-02-10T00:00:26.972 INFO:tasks.workunit.client.1.smithi183.stdout:5/421: dwrite d4/d4b/f60 [0,4194304] 0 2024-02-10T00:00:26.975 INFO:tasks.workunit.client.1.smithi183.stdout:9/349: dwrite d0/d3/d14/d3c/f6f [0,4194304] 0 2024-02-10T00:00:26.975 INFO:tasks.workunit.client.1.smithi183.stdout:5/422: write d4/d23/d2a/d5b/f65 [1478014,53436] 0 2024-02-10T00:00:26.976 INFO:tasks.workunit.client.1.smithi183.stdout:9/350: readlink d0/d30/d52/l5d 0 2024-02-10T00:00:26.977 INFO:tasks.workunit.client.1.smithi183.stdout:2/398: dwrite d2/da/d20/f66 [0,4194304] 0 2024-02-10T00:00:26.977 INFO:tasks.workunit.client.1.smithi183.stdout:5/423: stat d4/d23/d2a 0 2024-02-10T00:00:26.979 INFO:tasks.workunit.client.1.smithi183.stdout:6/285: dread d2/f24 [0,4194304] 0 2024-02-10T00:00:26.983 INFO:tasks.workunit.client.1.smithi183.stdout:7/332: sync 2024-02-10T00:00:26.984 INFO:tasks.workunit.client.1.smithi183.stdout:6/286: creat d2/d32/f5c x:0 0 0 2024-02-10T00:00:26.987 INFO:tasks.workunit.client.1.smithi183.stdout:3/318: rename d7/d4b to d7/db/d2a/d33/d59 0 2024-02-10T00:00:26.988 INFO:tasks.workunit.client.1.smithi183.stdout:8/387: write d0/d27/d36/f40 [771954,18718] 0 2024-02-10T00:00:26.989 INFO:tasks.workunit.client.1.smithi183.stdout:0/304: write d14/d1d/d59/d1a/f27 [897946,57126] 0 2024-02-10T00:00:26.990 INFO:tasks.workunit.client.1.smithi183.stdout:2/399: dread d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:26.990 INFO:tasks.workunit.client.1.smithi183.stdout:8/388: write d0/f18 [678678,98684] 0 2024-02-10T00:00:26.990 INFO:tasks.workunit.client.1.smithi183.stdout:6/287: dwrite d2/d1a/f23 [4194304,4194304] 0 2024-02-10T00:00:26.993 INFO:tasks.workunit.client.1.smithi183.stdout:2/400: dread d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:26.993 INFO:tasks.workunit.client.1.smithi183.stdout:7/333: unlink d0/l3b 0 2024-02-10T00:00:26.995 INFO:tasks.workunit.client.1.smithi183.stdout:4/338: write de/d22/f28 [421999,5233] 0 2024-02-10T00:00:26.996 INFO:tasks.workunit.client.1.smithi183.stdout:6/288: dwrite d2/d1a/f49 [0,4194304] 0 2024-02-10T00:00:26.997 INFO:tasks.workunit.client.1.smithi183.stdout:1/309: rename d0/d3/d7/l20 to d0/d3/d7/d3d/l72 0 2024-02-10T00:00:26.997 INFO:tasks.workunit.client.1.smithi183.stdout:6/289: chown d2/f4b 38 1 2024-02-10T00:00:27.003 INFO:tasks.workunit.client.1.smithi183.stdout:8/389: dread d0/d27/f3a [0,4194304] 0 2024-02-10T00:00:27.003 INFO:tasks.workunit.client.1.smithi183.stdout:8/390: write d0/f1e [1738104,53393] 0 2024-02-10T00:00:27.004 INFO:tasks.workunit.client.1.smithi183.stdout:4/339: rename f0 to de/d14/d4e/f65 0 2024-02-10T00:00:27.004 INFO:tasks.workunit.client.1.smithi183.stdout:1/310: rmdir d0/d3/d67 39 2024-02-10T00:00:27.007 INFO:tasks.workunit.client.1.smithi183.stdout:6/290: creat d2/d1a/d25/d3c/d31/d38/f5d x:0 0 0 2024-02-10T00:00:27.007 INFO:tasks.workunit.client.1.smithi183.stdout:2/401: symlink d2/da/d20/d6d/l84 0 2024-02-10T00:00:27.009 INFO:tasks.workunit.client.1.smithi183.stdout:8/391: creat d0/d31/f7c x:0 0 0 2024-02-10T00:00:27.011 INFO:tasks.workunit.client.1.smithi183.stdout:2/402: symlink d2/da/d5b/l85 0 2024-02-10T00:00:27.012 INFO:tasks.workunit.client.1.smithi183.stdout:8/392: mkdir d0/d3f/d7d 0 2024-02-10T00:00:27.014 INFO:tasks.workunit.client.1.smithi183.stdout:1/311: rename d0/d3/d67/f30 to d0/d3c/f73 0 2024-02-10T00:00:27.015 INFO:tasks.workunit.client.1.smithi183.stdout:1/312: write d0/d3/d7/f32 [1625028,39821] 0 2024-02-10T00:00:27.016 INFO:tasks.workunit.client.1.smithi183.stdout:1/313: chown d0/c31 81773951 1 2024-02-10T00:00:27.017 INFO:tasks.workunit.client.1.smithi183.stdout:8/393: rename d0/d31/f7c to d0/d27/d75/f7e 0 2024-02-10T00:00:27.018 INFO:tasks.workunit.client.1.smithi183.stdout:4/340: link de/d19/d20/f26 de/d14/d27/d40/f66 0 2024-02-10T00:00:27.019 INFO:tasks.workunit.client.1.smithi183.stdout:2/403: creat d2/d2c/f86 x:0 0 0 2024-02-10T00:00:27.021 INFO:tasks.workunit.client.1.smithi183.stdout:8/394: mkdir d0/d27/d36/d7f 0 2024-02-10T00:00:27.021 INFO:tasks.workunit.client.1.smithi183.stdout:5/424: sync 2024-02-10T00:00:27.023 INFO:tasks.workunit.client.1.smithi183.stdout:1/314: mknod d0/c74 0 2024-02-10T00:00:27.023 INFO:tasks.workunit.client.1.smithi183.stdout:4/341: dwrite de/f12 [0,4194304] 0 2024-02-10T00:00:27.026 INFO:tasks.workunit.client.1.smithi183.stdout:1/315: fsync d0/d3/d29/d38/f3b 0 2024-02-10T00:00:27.026 INFO:tasks.workunit.client.1.smithi183.stdout:9/351: truncate d0/d3/d14/d3c/f60 1625931 0 2024-02-10T00:00:27.029 INFO:tasks.workunit.client.1.smithi183.stdout:3/319: write d7/db/d2a/d1c/f1e [1366767,76957] 0 2024-02-10T00:00:27.030 INFO:tasks.workunit.client.1.smithi183.stdout:5/425: dwrite d4/d23/d2a/f58 [0,4194304] 0 2024-02-10T00:00:27.031 INFO:tasks.workunit.client.1.smithi183.stdout:0/305: dread d14/f17 [0,4194304] 0 2024-02-10T00:00:27.031 INFO:tasks.workunit.client.1.smithi183.stdout:5/426: dread - d4/d23/d3e/f76 zero size 2024-02-10T00:00:27.032 INFO:tasks.workunit.client.1.smithi183.stdout:5/427: read - d4/d1d/f7c zero size 2024-02-10T00:00:27.033 INFO:tasks.workunit.client.1.smithi183.stdout:5/428: stat d4/d1d/d27/d38/c50 0 2024-02-10T00:00:27.035 INFO:tasks.workunit.client.1.smithi183.stdout:2/404: rename d2/da/c68 to d2/da/d20/d21/d36/c87 0 2024-02-10T00:00:27.036 INFO:tasks.workunit.client.1.smithi183.stdout:2/405: readlink d2/da/d20/d6d/l84 0 2024-02-10T00:00:27.036 INFO:tasks.workunit.client.1.smithi183.stdout:6/291: dwrite d2/f4b [8388608,4194304] 0 2024-02-10T00:00:27.040 INFO:tasks.workunit.client.1.smithi183.stdout:4/342: symlink de/d14/d4e/l67 0 2024-02-10T00:00:27.041 INFO:tasks.workunit.client.1.smithi183.stdout:4/343: chown de/d14/d27/f55 15058 1 2024-02-10T00:00:27.042 INFO:tasks.workunit.client.1.smithi183.stdout:4/344: write de/d19/d20/f5d [1037023,25353] 0 2024-02-10T00:00:27.042 INFO:tasks.workunit.client.1.smithi183.stdout:9/352: creat d0/d3/d14/d1c/d4b/d51/f75 x:0 0 0 2024-02-10T00:00:27.044 INFO:tasks.workunit.client.1.smithi183.stdout:1/316: rename d0/d3/d7/d36/l52 to d0/d3/d7/d3d/l75 0 2024-02-10T00:00:27.046 INFO:tasks.workunit.client.1.smithi183.stdout:6/292: mkdir d2/d1a/d25/d3c/d31/d38/d3f/d5e 0 2024-02-10T00:00:27.046 INFO:tasks.workunit.client.1.smithi183.stdout:2/406: dread d2/f4a [0,4194304] 0 2024-02-10T00:00:27.047 INFO:tasks.workunit.client.1.smithi183.stdout:8/395: getdents d0/d27/d75/d5b 0 2024-02-10T00:00:27.047 INFO:tasks.workunit.client.1.smithi183.stdout:4/345: fsync de/f11 0 2024-02-10T00:00:27.048 INFO:tasks.workunit.client.1.smithi183.stdout:4/346: readlink de/d14/d1d/l35 0 2024-02-10T00:00:27.048 INFO:tasks.workunit.client.1.smithi183.stdout:0/306: mkdir d14/d1d/d55/d6e 0 2024-02-10T00:00:27.049 INFO:tasks.workunit.client.1.smithi183.stdout:4/347: read de/d14/f4a [3948814,1256] 0 2024-02-10T00:00:27.049 INFO:tasks.workunit.client.1.smithi183.stdout:1/317: rename d0/d3/d29/d1f/l34 to d0/d3a/l76 0 2024-02-10T00:00:27.051 INFO:tasks.workunit.client.1.smithi183.stdout:2/407: creat d2/da/d5b/f88 x:0 0 0 2024-02-10T00:00:27.051 INFO:tasks.workunit.client.1.smithi183.stdout:9/353: symlink d0/d3/d14/d74/l76 0 2024-02-10T00:00:27.053 INFO:tasks.workunit.client.1.smithi183.stdout:2/408: fdatasync d2/d2c/d2f/f3b 0 2024-02-10T00:00:27.053 INFO:tasks.workunit.client.1.smithi183.stdout:8/396: write d0/d4e/f4f [787252,82898] 0 2024-02-10T00:00:27.053 INFO:tasks.workunit.client.1.smithi183.stdout:3/320: creat d7/f5a x:0 0 0 2024-02-10T00:00:27.055 INFO:tasks.workunit.client.1.smithi183.stdout:7/334: sync 2024-02-10T00:00:27.056 INFO:tasks.workunit.client.1.smithi183.stdout:6/293: dwrite d2/d1a/d25/d3c/d31/d38/d3f/f4c [4194304,4194304] 0 2024-02-10T00:00:27.056 INFO:tasks.workunit.client.1.smithi183.stdout:1/318: fdatasync d0/d3/f12 0 2024-02-10T00:00:27.057 INFO:tasks.workunit.client.1.smithi183.stdout:8/397: chown d0/d27/l29 81 1 2024-02-10T00:00:27.061 INFO:tasks.workunit.client.1.smithi183.stdout:9/354: stat d0/d3/d14/d1c/d2d/d4f/d58/f61 0 2024-02-10T00:00:27.062 INFO:tasks.workunit.client.1.smithi183.stdout:1/319: unlink d0/f17 0 2024-02-10T00:00:27.062 INFO:tasks.workunit.client.1.smithi183.stdout:4/348: dwrite de/d22/f43 [0,4194304] 0 2024-02-10T00:00:27.062 INFO:tasks.workunit.client.1.smithi183.stdout:6/294: creat d2/d32/f5f x:0 0 0 2024-02-10T00:00:27.062 INFO:tasks.workunit.client.1.smithi183.stdout:9/355: dread - d0/f68 zero size 2024-02-10T00:00:27.065 INFO:tasks.workunit.client.1.smithi183.stdout:8/398: creat d0/d27/d36/f80 x:0 0 0 2024-02-10T00:00:27.066 INFO:tasks.workunit.client.1.smithi183.stdout:8/399: readlink d0/d4e/l50 0 2024-02-10T00:00:27.067 INFO:tasks.workunit.client.1.smithi183.stdout:6/295: dread d2/d1a/f1f [0,4194304] 0 2024-02-10T00:00:27.070 INFO:tasks.workunit.client.1.smithi183.stdout:6/296: dread d2/d26/f2e [0,4194304] 0 2024-02-10T00:00:27.070 INFO:tasks.workunit.client.1.smithi183.stdout:6/297: write d2/d26/f2e [2775311,105708] 0 2024-02-10T00:00:27.072 INFO:tasks.workunit.client.1.smithi183.stdout:7/335: rename d0/d2/d3/d38 to d0/d2/d50/d5d 0 2024-02-10T00:00:27.073 INFO:tasks.workunit.client.1.smithi183.stdout:0/307: truncate d14/d1d/d59/d1a/d22/f4f 529678 0 2024-02-10T00:00:27.078 INFO:tasks.workunit.client.1.smithi183.stdout:2/409: rename d2/da/d19/l67 to d2/da/d20/d21/d43/d58/d74/l89 0 2024-02-10T00:00:27.080 INFO:tasks.workunit.client.1.smithi183.stdout:4/349: symlink de/l68 0 2024-02-10T00:00:27.080 INFO:tasks.workunit.client.1.smithi183.stdout:4/350: write de/d14/f16 [3483822,102635] 0 2024-02-10T00:00:27.082 INFO:tasks.workunit.client.1.smithi183.stdout:6/298: symlink d2/d1a/d3a/l60 0 2024-02-10T00:00:27.085 INFO:tasks.workunit.client.1.smithi183.stdout:0/308: mknod d14/d1d/d59/d1a/d22/c6f 0 2024-02-10T00:00:27.086 INFO:tasks.workunit.client.1.smithi183.stdout:6/299: dwrite d2/d1a/f20 [0,4194304] 0 2024-02-10T00:00:27.088 INFO:tasks.workunit.client.1.smithi183.stdout:5/429: sync 2024-02-10T00:00:27.090 INFO:tasks.workunit.client.1.smithi183.stdout:3/321: truncate d7/db/d2a/d2d/f2f 789150 0 2024-02-10T00:00:27.091 INFO:tasks.workunit.client.1.smithi183.stdout:8/400: truncate d0/f1e 3592517 0 2024-02-10T00:00:27.092 INFO:tasks.workunit.client.1.smithi183.stdout:0/309: dwrite fb [0,4194304] 0 2024-02-10T00:00:27.092 INFO:tasks.workunit.client.1.smithi183.stdout:3/322: write d7/f48 [12574680,64675] 0 2024-02-10T00:00:27.093 INFO:tasks.workunit.client.1.smithi183.stdout:6/300: dread d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:27.094 INFO:tasks.workunit.client.1.smithi183.stdout:9/356: rmdir d0/d3/d6e 0 2024-02-10T00:00:27.098 INFO:tasks.workunit.client.1.smithi183.stdout:5/430: dwrite d4/d23/d2a/f40 [0,4194304] 0 2024-02-10T00:00:27.106 INFO:tasks.workunit.client.1.smithi183.stdout:8/401: rename d0/d3f/d7d to d0/d45/d46/d81 0 2024-02-10T00:00:27.107 INFO:tasks.workunit.client.1.smithi183.stdout:6/301: read d2/f7 [1831719,84862] 0 2024-02-10T00:00:27.107 INFO:tasks.workunit.client.1.smithi183.stdout:3/323: dread d7/db/d2a/d33/f37 [0,4194304] 0 2024-02-10T00:00:27.108 INFO:tasks.workunit.client.1.smithi183.stdout:7/336: getdents d0/d2/d4/d8 0 2024-02-10T00:00:27.109 INFO:tasks.workunit.client.1.smithi183.stdout:9/357: truncate d0/d3/d14/d1c/d2d/d4f/d58/f61 303220 0 2024-02-10T00:00:27.112 INFO:tasks.workunit.client.1.smithi183.stdout:0/310: mkdir d14/d1d/d2d/d31/d6c/d70 0 2024-02-10T00:00:27.113 INFO:tasks.workunit.client.1.smithi183.stdout:7/337: rmdir d0/d2/d50 39 2024-02-10T00:00:27.114 INFO:tasks.workunit.client.1.smithi183.stdout:5/431: symlink d4/d1d/d27/d5d/d70/d72/l8b 0 2024-02-10T00:00:27.115 INFO:tasks.workunit.client.1.smithi183.stdout:9/358: chown d0/c23 480678176 1 2024-02-10T00:00:27.115 INFO:tasks.workunit.client.1.smithi183.stdout:1/320: sync 2024-02-10T00:00:27.115 INFO:tasks.workunit.client.1.smithi183.stdout:8/402: symlink d0/d23/d2d/l82 0 2024-02-10T00:00:27.117 INFO:tasks.workunit.client.1.smithi183.stdout:0/311: rename d14/d1d/d59/d1a to d14/d1d/d59/d71 0 2024-02-10T00:00:27.119 INFO:tasks.workunit.client.1.smithi183.stdout:9/359: dwrite d0/f68 [0,4194304] 0 2024-02-10T00:00:27.120 INFO:tasks.workunit.client.1.smithi183.stdout:7/338: unlink d0/d11/d35/c5b 0 2024-02-10T00:00:27.120 INFO:tasks.workunit.client.1.smithi183.stdout:5/432: mknod d4/d23/c8c 0 2024-02-10T00:00:27.122 INFO:tasks.workunit.client.1.smithi183.stdout:7/339: stat d0/d2/d4/d8/f4d 0 2024-02-10T00:00:27.124 INFO:tasks.workunit.client.1.smithi183.stdout:0/312: dwrite d14/d1d/d59/f25 [0,4194304] 0 2024-02-10T00:00:27.124 INFO:tasks.workunit.client.1.smithi183.stdout:2/410: write d2/da/d19/d31/d55/f5d [3433230,121513] 0 2024-02-10T00:00:27.125 INFO:tasks.workunit.client.1.smithi183.stdout:2/411: stat d2/da/d20/l5c 0 2024-02-10T00:00:27.131 INFO:tasks.workunit.client.1.smithi183.stdout:5/433: mknod d4/d23/d2a/d5b/c8d 0 2024-02-10T00:00:27.136 INFO:tasks.workunit.client.1.smithi183.stdout:0/313: mkdir d14/d1d/d59/d3c/d72 0 2024-02-10T00:00:27.137 INFO:tasks.workunit.client.1.smithi183.stdout:6/302: truncate d2/d1a/d25/d3c/d31/d38/d3f/f4c 5993774 0 2024-02-10T00:00:27.141 INFO:tasks.workunit.client.1.smithi183.stdout:2/412: getdents d2/da/d19/d31/d55/d79 0 2024-02-10T00:00:27.142 INFO:tasks.workunit.client.1.smithi183.stdout:6/303: mkdir d2/d26/d34/d61 0 2024-02-10T00:00:27.143 INFO:tasks.workunit.client.1.smithi183.stdout:8/403: dwrite d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:27.143 INFO:tasks.workunit.client.1.smithi183.stdout:9/360: link d0/d3/d14/d1c/f5c d0/d3/d14/f77 0 2024-02-10T00:00:27.149 INFO:tasks.workunit.client.1.smithi183.stdout:8/404: dwrite d0/d23/f2a [0,4194304] 0 2024-02-10T00:00:27.150 INFO:tasks.workunit.client.1.smithi183.stdout:3/324: dread d7/f30 [4194304,4194304] 0 2024-02-10T00:00:27.154 INFO:tasks.workunit.client.1.smithi183.stdout:0/314: link d14/d1d/d59/d71/d22/c24 d14/d1d/d59/d3c/d72/c73 0 2024-02-10T00:00:27.156 INFO:tasks.workunit.client.1.smithi183.stdout:5/434: dwrite d4/d1d/d27/d38/f47 [0,4194304] 0 2024-02-10T00:00:27.157 INFO:tasks.workunit.client.1.smithi183.stdout:8/405: rmdir d0/d4e/d53 39 2024-02-10T00:00:27.160 INFO:tasks.workunit.client.1.smithi183.stdout:1/321: dwrite d0/d3/d7/d36/f50 [0,4194304] 0 2024-02-10T00:00:27.161 INFO:tasks.workunit.client.1.smithi183.stdout:2/413: getdents d2/da/d20/d21/d36 0 2024-02-10T00:00:27.162 INFO:tasks.workunit.client.1.smithi183.stdout:8/406: write d0/d27/f68 [5838984,35097] 0 2024-02-10T00:00:27.163 INFO:tasks.workunit.client.1.smithi183.stdout:4/351: sync 2024-02-10T00:00:27.163 INFO:tasks.workunit.client.1.smithi183.stdout:5/435: mknod d4/d1d/c8e 0 2024-02-10T00:00:27.164 INFO:tasks.workunit.client.1.smithi183.stdout:4/352: readlink de/l44 0 2024-02-10T00:00:27.165 INFO:tasks.workunit.client.1.smithi183.stdout:1/322: symlink d0/d3c/l77 0 2024-02-10T00:00:27.167 INFO:tasks.workunit.client.1.smithi183.stdout:2/414: rename d2/da/d20/d21/f23 to d2/da/d5b/f8a 0 2024-02-10T00:00:27.169 INFO:tasks.workunit.client.1.smithi183.stdout:0/315: dread d14/d1d/d59/d71/d22/f48 [0,4194304] 0 2024-02-10T00:00:27.170 INFO:tasks.workunit.client.1.smithi183.stdout:8/407: fsync d0/d27/d75/f7e 0 2024-02-10T00:00:27.170 INFO:tasks.workunit.client.1.smithi183.stdout:5/436: creat d4/d4b/f8f x:0 0 0 2024-02-10T00:00:27.176 INFO:tasks.workunit.client.1.smithi183.stdout:6/304: truncate d2/f7 3885729 0 2024-02-10T00:00:27.176 INFO:tasks.workunit.client.1.smithi183.stdout:3/325: write f6 [2456739,80721] 0 2024-02-10T00:00:27.177 INFO:tasks.workunit.client.1.smithi183.stdout:0/316: mkdir d14/d1d/d55/d6e/d74 0 2024-02-10T00:00:27.178 INFO:tasks.workunit.client.1.smithi183.stdout:4/353: creat de/d19/f69 x:0 0 0 2024-02-10T00:00:27.178 INFO:tasks.workunit.client.1.smithi183.stdout:9/361: dwrite d0/d3/d14/d1c/d2d/d4f/f5a [0,4194304] 0 2024-02-10T00:00:27.179 INFO:tasks.workunit.client.1.smithi183.stdout:1/323: creat d0/f78 x:0 0 0 2024-02-10T00:00:27.179 INFO:tasks.workunit.client.1.smithi183.stdout:8/408: dwrite d0/d23/f26 [0,4194304] 0 2024-02-10T00:00:27.180 INFO:tasks.workunit.client.1.smithi183.stdout:5/437: creat d4/d1d/d89/f90 x:0 0 0 2024-02-10T00:00:27.182 INFO:tasks.workunit.client.1.smithi183.stdout:0/317: symlink d14/d1d/d55/d6e/d74/l75 0 2024-02-10T00:00:27.182 INFO:tasks.workunit.client.1.smithi183.stdout:5/438: write d4/d4b/f6b [122483,91344] 0 2024-02-10T00:00:27.184 INFO:tasks.workunit.client.1.smithi183.stdout:3/326: getdents d7/db 0 2024-02-10T00:00:27.185 INFO:tasks.workunit.client.1.smithi183.stdout:4/354: symlink de/d14/d1d/d2f/l6a 0 2024-02-10T00:00:27.185 INFO:tasks.workunit.client.1.smithi183.stdout:5/439: write d4/d1d/d27/d38/f88 [818239,96647] 0 2024-02-10T00:00:27.185 INFO:tasks.workunit.client.1.smithi183.stdout:9/362: mknod d0/d3/d14/d1c/d2d/d4f/c78 0 2024-02-10T00:00:27.187 INFO:tasks.workunit.client.1.smithi183.stdout:0/318: creat d14/d1d/d2d/d31/d6c/f76 x:0 0 0 2024-02-10T00:00:27.190 INFO:tasks.workunit.client.1.smithi183.stdout:0/319: dread d14/d1d/d2d/f39 [0,4194304] 0 2024-02-10T00:00:27.192 INFO:tasks.workunit.client.1.smithi183.stdout:4/355: creat de/d19/d20/f6b x:0 0 0 2024-02-10T00:00:27.196 INFO:tasks.workunit.client.1.smithi183.stdout:5/440: mkdir d4/d1d/d27/d5d/d91 0 2024-02-10T00:00:27.196 INFO:tasks.workunit.client.1.smithi183.stdout:2/415: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:27.197 INFO:tasks.workunit.client.1.smithi183.stdout:9/363: mkdir d0/d3/d14/d1c/d2d/d4f/d79 0 2024-02-10T00:00:27.199 INFO:tasks.workunit.client.1.smithi183.stdout:8/409: rename d0/d4e/l55 to d0/d23/d2d/l83 0 2024-02-10T00:00:27.200 INFO:tasks.workunit.client.1.smithi183.stdout:4/356: mknod de/d14/d1d/c6c 0 2024-02-10T00:00:27.200 INFO:tasks.workunit.client.1.smithi183.stdout:5/441: creat d4/d1d/d89/f92 x:0 0 0 2024-02-10T00:00:27.202 INFO:tasks.workunit.client.1.smithi183.stdout:1/324: truncate d0/d3/d7/f6c 469187 0 2024-02-10T00:00:27.203 INFO:tasks.workunit.client.1.smithi183.stdout:8/410: fsync d0/d23/d2d/f2c 0 2024-02-10T00:00:27.204 INFO:tasks.workunit.client.1.smithi183.stdout:4/357: rmdir de/d14/d27/d2e 39 2024-02-10T00:00:27.204 INFO:tasks.workunit.client.1.smithi183.stdout:8/411: read - d0/d23/d2d/f2c zero size 2024-02-10T00:00:27.205 INFO:tasks.workunit.client.1.smithi183.stdout:4/358: stat de/d14/d1d/l35 0 2024-02-10T00:00:27.205 INFO:tasks.workunit.client.1.smithi183.stdout:9/364: symlink d0/d3/d14/d1c/d2d/d4f/d79/l7a 0 2024-02-10T00:00:27.205 INFO:tasks.workunit.client.1.smithi183.stdout:7/340: sync 2024-02-10T00:00:27.205 INFO:tasks.workunit.client.1.smithi183.stdout:2/416: dwrite d2/da/d5b/f8a [0,4194304] 0 2024-02-10T00:00:27.206 INFO:tasks.workunit.client.1.smithi183.stdout:0/320: dread d14/f28 [0,4194304] 0 2024-02-10T00:00:27.207 INFO:tasks.workunit.client.1.smithi183.stdout:5/442: rename d4/d23/d3e/c67 to d4/d1d/d27/d5d/d91/c93 0 2024-02-10T00:00:27.208 INFO:tasks.workunit.client.1.smithi183.stdout:0/321: chown d14/d1d/d59 376 1 2024-02-10T00:00:27.208 INFO:tasks.workunit.client.1.smithi183.stdout:1/325: chown d0/d3/l26 14777 1 2024-02-10T00:00:27.208 INFO:tasks.workunit.client.1.smithi183.stdout:7/341: chown d0/d2/d4/d8/c5c 1033838 1 2024-02-10T00:00:27.210 INFO:tasks.workunit.client.1.smithi183.stdout:8/412: symlink d0/d23/d2d/l84 0 2024-02-10T00:00:27.212 INFO:tasks.workunit.client.1.smithi183.stdout:5/443: creat d4/d23/f94 x:0 0 0 2024-02-10T00:00:27.214 INFO:tasks.workunit.client.1.smithi183.stdout:0/322: creat d14/d1d/d55/d6e/f77 x:0 0 0 2024-02-10T00:00:27.216 INFO:tasks.workunit.client.1.smithi183.stdout:8/413: rename d0/d23/d62 to d0/d27/d75/d5b/d85 0 2024-02-10T00:00:27.219 INFO:tasks.workunit.client.1.smithi183.stdout:4/359: rmdir de/d14/d4e/d58 0 2024-02-10T00:00:27.221 INFO:tasks.workunit.client.1.smithi183.stdout:7/342: truncate d0/f30 1214147 0 2024-02-10T00:00:27.225 INFO:tasks.workunit.client.1.smithi183.stdout:3/327: dwrite d7/db/d2a/d2d/f31 [0,4194304] 0 2024-02-10T00:00:27.229 INFO:tasks.workunit.client.1.smithi183.stdout:8/414: symlink d0/d45/l86 0 2024-02-10T00:00:27.232 INFO:tasks.workunit.client.1.smithi183.stdout:6/305: sync 2024-02-10T00:00:27.232 INFO:tasks.workunit.client.1.smithi183.stdout:4/360: dread de/d14/d27/d2e/f3f [0,4194304] 0 2024-02-10T00:00:27.234 INFO:tasks.workunit.client.1.smithi183.stdout:4/361: read de/f1f [1817684,41593] 0 2024-02-10T00:00:27.235 INFO:tasks.workunit.client.1.smithi183.stdout:3/328: rename d7/db/d2a/d1c/f21 to d7/db/d2a/d2d/f5b 0 2024-02-10T00:00:27.236 INFO:tasks.workunit.client.1.smithi183.stdout:2/417: dwrite d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:27.257 INFO:tasks.workunit.client.1.smithi183.stdout:4/362: creat de/d19/d20/f6d x:0 0 0 2024-02-10T00:00:27.257 INFO:tasks.workunit.client.1.smithi183.stdout:9/365: dread d0/d3/d14/f46 [0,4194304] 0 2024-02-10T00:00:27.259 INFO:tasks.workunit.client.1.smithi183.stdout:7/343: dread d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:27.260 INFO:tasks.workunit.client.1.smithi183.stdout:0/323: dwrite d14/f37 [0,4194304] 0 2024-02-10T00:00:27.260 INFO:tasks.workunit.client.1.smithi183.stdout:8/415: mknod d0/d45/c87 0 2024-02-10T00:00:27.262 INFO:tasks.workunit.client.1.smithi183.stdout:2/418: mkdir d2/d8b 0 2024-02-10T00:00:27.262 INFO:tasks.workunit.client.1.smithi183.stdout:9/366: unlink d0/f1d 0 2024-02-10T00:00:27.291 INFO:tasks.workunit.client.1.smithi183.stdout:5/444: dwrite d4/d1d/d27/d5d/d6d/f87 [0,4194304] 0 2024-02-10T00:00:27.293 INFO:tasks.workunit.client.1.smithi183.stdout:8/416: fdatasync d0/d23/d2d/d24/f32 0 2024-02-10T00:00:27.293 INFO:tasks.workunit.client.1.smithi183.stdout:0/324: fdatasync d14/d1d/d2d/d31/d68/f6a 0 2024-02-10T00:00:27.294 INFO:tasks.workunit.client.1.smithi183.stdout:5/445: read f2 [6461174,125002] 0 2024-02-10T00:00:27.294 INFO:tasks.workunit.client.1.smithi183.stdout:7/344: symlink d0/d2/l5e 0 2024-02-10T00:00:27.294 INFO:tasks.workunit.client.1.smithi183.stdout:1/326: dread d0/d3/fa [4194304,4194304] 0 2024-02-10T00:00:27.294 INFO:tasks.workunit.client.1.smithi183.stdout:3/329: dread d7/db/d2a/d2d/f50 [0,4194304] 0 2024-02-10T00:00:27.296 INFO:tasks.workunit.client.1.smithi183.stdout:9/367: chown d0/d3/d14/d1c/d2d/d4f/f5a 423684 1 2024-02-10T00:00:27.297 INFO:tasks.workunit.client.1.smithi183.stdout:0/325: creat d14/d43/f78 x:0 0 0 2024-02-10T00:00:27.298 INFO:tasks.workunit.client.1.smithi183.stdout:8/417: write d0/f2f [2428165,120314] 0 2024-02-10T00:00:27.300 INFO:tasks.workunit.client.1.smithi183.stdout:2/419: dwrite d2/da/f25 [0,4194304] 0 2024-02-10T00:00:27.301 INFO:tasks.workunit.client.1.smithi183.stdout:7/345: mknod d0/d2/d3/c5f 0 2024-02-10T00:00:27.302 INFO:tasks.workunit.client.1.smithi183.stdout:3/330: creat d7/db/d2a/d1c/f5c x:0 0 0 2024-02-10T00:00:27.302 INFO:tasks.workunit.client.1.smithi183.stdout:9/368: mkdir d0/d3/d14/d3c/d7b 0 2024-02-10T00:00:27.305 INFO:tasks.workunit.client.1.smithi183.stdout:6/306: sync 2024-02-10T00:00:27.306 INFO:tasks.workunit.client.1.smithi183.stdout:0/326: creat d14/d1d/d2d/f79 x:0 0 0 2024-02-10T00:00:27.306 INFO:tasks.workunit.client.1.smithi183.stdout:6/307: chown d2/d1a/d25/d3c/d31/d38/d3f 240883 1 2024-02-10T00:00:27.308 INFO:tasks.workunit.client.1.smithi183.stdout:2/420: mknod d2/da/d20/d21/c8c 0 2024-02-10T00:00:27.309 INFO:tasks.workunit.client.1.smithi183.stdout:2/421: chown d2/da/d19/d31/d75/d35/c50 79 1 2024-02-10T00:00:27.309 INFO:tasks.workunit.client.1.smithi183.stdout:1/327: mknod d0/d3/d7/d3d/d60/c79 0 2024-02-10T00:00:27.310 INFO:tasks.workunit.client.1.smithi183.stdout:3/331: mknod d7/db/c5d 0 2024-02-10T00:00:27.311 INFO:tasks.workunit.client.1.smithi183.stdout:7/346: truncate d0/d11/d3e/f49 1844634 0 2024-02-10T00:00:27.313 INFO:tasks.workunit.client.1.smithi183.stdout:2/422: readlink d2/l39 0 2024-02-10T00:00:27.313 INFO:tasks.workunit.client.1.smithi183.stdout:1/328: fdatasync d0/d3/d67/f2f 0 2024-02-10T00:00:27.314 INFO:tasks.workunit.client.1.smithi183.stdout:2/423: dread - d2/d2c/f6f zero size 2024-02-10T00:00:27.317 INFO:tasks.workunit.client.1.smithi183.stdout:1/329: chown d0/d3/f2d 3230 1 2024-02-10T00:00:27.319 INFO:tasks.workunit.client.1.smithi183.stdout:0/327: rename d14/d1d/d59/d71/d51 to d14/d7a 0 2024-02-10T00:00:27.320 INFO:tasks.workunit.client.1.smithi183.stdout:8/418: getdents d0 0 2024-02-10T00:00:27.321 INFO:tasks.workunit.client.1.smithi183.stdout:8/419: readlink d0/d27/l35 0 2024-02-10T00:00:27.323 INFO:tasks.workunit.client.1.smithi183.stdout:7/347: link d0/d2/d3/f20 d0/d2/d4/d8/f60 0 2024-02-10T00:00:27.325 INFO:tasks.workunit.client.1.smithi183.stdout:5/446: dread f3 [0,4194304] 0 2024-02-10T00:00:27.326 INFO:tasks.workunit.client.1.smithi183.stdout:5/447: stat d4/d1d/d27/d38/d4f/l6e 0 2024-02-10T00:00:27.326 INFO:tasks.workunit.client.1.smithi183.stdout:6/308: truncate d2/d1a/f20 78267 0 2024-02-10T00:00:27.328 INFO:tasks.workunit.client.1.smithi183.stdout:2/424: mkdir d2/d2c/d2f/d60/d8d 0 2024-02-10T00:00:27.328 INFO:tasks.workunit.client.1.smithi183.stdout:5/448: chown d4/d1d/d27/d37/d46 98149774 1 2024-02-10T00:00:27.329 INFO:tasks.workunit.client.1.smithi183.stdout:8/420: creat d0/d31/f88 x:0 0 0 2024-02-10T00:00:27.331 INFO:tasks.workunit.client.1.smithi183.stdout:8/421: read - d0/d3f/f43 zero size 2024-02-10T00:00:27.331 INFO:tasks.workunit.client.1.smithi183.stdout:4/363: sync 2024-02-10T00:00:27.332 INFO:tasks.workunit.client.1.smithi183.stdout:9/369: dread d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:27.332 INFO:tasks.workunit.client.1.smithi183.stdout:7/348: dwrite d0/d2/f26 [0,4194304] 0 2024-02-10T00:00:27.333 INFO:tasks.workunit.client.1.smithi183.stdout:3/332: chown d7/db/d2a/l3b 1809392 1 2024-02-10T00:00:27.336 INFO:tasks.workunit.client.1.smithi183.stdout:8/422: dread - d0/d45/f66 zero size 2024-02-10T00:00:27.336 INFO:tasks.workunit.client.1.smithi183.stdout:9/370: chown d0/d3/d14/d1c/d2d/d4f/f5a 1826 1 2024-02-10T00:00:27.336 INFO:tasks.workunit.client.1.smithi183.stdout:0/328: link d14/d7a/c5c d14/d1d/d59/d71/c7b 0 2024-02-10T00:00:27.336 INFO:tasks.workunit.client.1.smithi183.stdout:0/329: stat l11 0 2024-02-10T00:00:27.337 INFO:tasks.workunit.client.1.smithi183.stdout:4/364: symlink de/d14/d1d/l6e 0 2024-02-10T00:00:27.337 INFO:tasks.workunit.client.1.smithi183.stdout:2/425: dwrite d2/d2c/d2f/f3b [0,4194304] 0 2024-02-10T00:00:27.337 INFO:tasks.workunit.client.1.smithi183.stdout:9/371: readlink d0/d30/d52/l5d 0 2024-02-10T00:00:27.338 INFO:tasks.workunit.client.1.smithi183.stdout:8/423: dread - d0/d45/f66 zero size 2024-02-10T00:00:27.338 INFO:tasks.workunit.client.1.smithi183.stdout:4/365: chown de/c33 46 1 2024-02-10T00:00:27.339 INFO:tasks.workunit.client.1.smithi183.stdout:2/426: chown d2/d2c/f6f 0 1 2024-02-10T00:00:27.342 INFO:tasks.workunit.client.1.smithi183.stdout:5/449: write d4/d23/d4a/d36/f5e [4468176,43356] 0 2024-02-10T00:00:27.343 INFO:tasks.workunit.client.1.smithi183.stdout:1/330: truncate d0/d3/d7/f2b 1575844 0 2024-02-10T00:00:27.345 INFO:tasks.workunit.client.1.smithi183.stdout:3/333: fsync d7/db/f47 0 2024-02-10T00:00:27.346 INFO:tasks.workunit.client.1.smithi183.stdout:5/450: dread d4/d23/d2a/f40 [0,4194304] 0 2024-02-10T00:00:27.347 INFO:tasks.workunit.client.1.smithi183.stdout:0/330: creat d14/d1d/d2d/f7c x:0 0 0 2024-02-10T00:00:27.348 INFO:tasks.workunit.client.1.smithi183.stdout:8/424: creat d0/d27/d75/d5b/f89 x:0 0 0 2024-02-10T00:00:27.348 INFO:tasks.workunit.client.1.smithi183.stdout:8/425: chown d0/d27/d75/d5b/d85/c67 875782376 1 2024-02-10T00:00:27.349 INFO:tasks.workunit.client.1.smithi183.stdout:8/426: readlink d0/d23/d2d/l4c 0 2024-02-10T00:00:27.349 INFO:tasks.workunit.client.1.smithi183.stdout:8/427: chown d0/d23/d2d/f7b 142055549 1 2024-02-10T00:00:27.350 INFO:tasks.workunit.client.1.smithi183.stdout:1/331: creat d0/d3a/f7a x:0 0 0 2024-02-10T00:00:27.350 INFO:tasks.workunit.client.1.smithi183.stdout:6/309: getdents d2/d1a/d25/d3c/d31 0 2024-02-10T00:00:27.352 INFO:tasks.workunit.client.1.smithi183.stdout:3/334: unlink d7/db/d2a/l49 0 2024-02-10T00:00:27.352 INFO:tasks.workunit.client.1.smithi183.stdout:3/335: chown d7/db/d2a/d1c 0 1 2024-02-10T00:00:27.353 INFO:tasks.workunit.client.1.smithi183.stdout:5/451: mknod d4/d1d/d27/d37/d46/d4e/c95 0 2024-02-10T00:00:27.354 INFO:tasks.workunit.client.1.smithi183.stdout:5/452: chown d4/dd/f75 565 1 2024-02-10T00:00:27.354 INFO:tasks.workunit.client.1.smithi183.stdout:5/453: dread - d4/dd/f75 zero size 2024-02-10T00:00:27.355 INFO:tasks.workunit.client.1.smithi183.stdout:5/454: chown d4/l3a 718831940 1 2024-02-10T00:00:27.358 INFO:tasks.workunit.client.1.smithi183.stdout:6/310: mknod d2/d1a/d25/d3c/c62 0 2024-02-10T00:00:27.361 INFO:tasks.workunit.client.1.smithi183.stdout:0/331: rename d14/d1d/d2d/d31/l47 to d14/d3e/l7d 0 2024-02-10T00:00:27.362 INFO:tasks.workunit.client.1.smithi183.stdout:8/428: mknod d0/d4e/d53/c8a 0 2024-02-10T00:00:27.363 INFO:tasks.workunit.client.1.smithi183.stdout:6/311: dwrite d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:27.363 INFO:tasks.workunit.client.1.smithi183.stdout:8/429: chown d0/d3f/f79 64028 1 2024-02-10T00:00:27.364 INFO:tasks.workunit.client.1.smithi183.stdout:7/349: truncate d0/d2/d4/f3c 515587 0 2024-02-10T00:00:27.366 INFO:tasks.workunit.client.1.smithi183.stdout:8/430: dread d0/d27/f44 [0,4194304] 0 2024-02-10T00:00:27.367 INFO:tasks.workunit.client.1.smithi183.stdout:2/427: truncate d2/f15 2168375 0 2024-02-10T00:00:27.368 INFO:tasks.workunit.client.1.smithi183.stdout:3/336: mknod d7/db/d2a/d33/d59/d52/c5e 0 2024-02-10T00:00:27.369 INFO:tasks.workunit.client.1.smithi183.stdout:6/312: dwrite d2/d32/f5c [0,4194304] 0 2024-02-10T00:00:27.369 INFO:tasks.workunit.client.1.smithi183.stdout:2/428: dread - d2/da/d20/d21/d43/f65 zero size 2024-02-10T00:00:27.371 INFO:tasks.workunit.client.1.smithi183.stdout:9/372: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:27.372 INFO:tasks.workunit.client.1.smithi183.stdout:9/373: write d0/d30/d52/f66 [967792,91392] 0 2024-02-10T00:00:27.373 INFO:tasks.workunit.client.1.smithi183.stdout:0/332: creat d14/d7a/f7e x:0 0 0 2024-02-10T00:00:27.374 INFO:tasks.workunit.client.1.smithi183.stdout:0/333: stat d14/d1d/d59/f5e 0 2024-02-10T00:00:27.374 INFO:tasks.workunit.client.1.smithi183.stdout:7/350: fsync d0/d11/d35/f51 0 2024-02-10T00:00:27.375 INFO:tasks.workunit.client.1.smithi183.stdout:7/351: dread - d0/d2/d4/f4a zero size 2024-02-10T00:00:27.376 INFO:tasks.workunit.client.1.smithi183.stdout:8/431: creat d0/d27/f8b x:0 0 0 2024-02-10T00:00:27.377 INFO:tasks.workunit.client.1.smithi183.stdout:8/432: chown d0/d4e/d6b 528352914 1 2024-02-10T00:00:27.377 INFO:tasks.workunit.client.1.smithi183.stdout:7/352: chown d0/d2/d4/d8/c48 891068 1 2024-02-10T00:00:27.379 INFO:tasks.workunit.client.1.smithi183.stdout:3/337: mknod d7/db/d2a/d33/d59/c5f 0 2024-02-10T00:00:27.379 INFO:tasks.workunit.client.1.smithi183.stdout:8/433: write d0/d27/f2e [1396627,77412] 0 2024-02-10T00:00:27.379 INFO:tasks.workunit.client.1.smithi183.stdout:6/313: mknod d2/d26/c63 0 2024-02-10T00:00:27.380 INFO:tasks.workunit.client.1.smithi183.stdout:0/334: dwrite d14/d1d/d2d/d31/f3a [4194304,4194304] 0 2024-02-10T00:00:27.380 INFO:tasks.workunit.client.1.smithi183.stdout:2/429: mkdir d2/da/d20/d21/d43/d58/d8e 0 2024-02-10T00:00:27.381 INFO:tasks.workunit.client.1.smithi183.stdout:0/335: fdatasync d14/d7a/f7e 0 2024-02-10T00:00:27.383 INFO:tasks.workunit.client.1.smithi183.stdout:9/374: rename d0/d3/d14/d1c/f1f to d0/d10/f7c 0 2024-02-10T00:00:27.384 INFO:tasks.workunit.client.1.smithi183.stdout:1/332: getdents d0/d3/d7/d3d/d60 0 2024-02-10T00:00:27.384 INFO:tasks.workunit.client.1.smithi183.stdout:7/353: dread d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:27.385 INFO:tasks.workunit.client.1.smithi183.stdout:9/375: fsync d0/d3/d14/f46 0 2024-02-10T00:00:27.387 INFO:tasks.workunit.client.1.smithi183.stdout:2/430: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:27.388 INFO:tasks.workunit.client.1.smithi183.stdout:6/314: chown d2/c33 1731 1 2024-02-10T00:00:27.390 INFO:tasks.workunit.client.1.smithi183.stdout:0/336: dwrite d14/d1d/d59/f25 [4194304,4194304] 0 2024-02-10T00:00:27.391 INFO:tasks.workunit.client.1.smithi183.stdout:7/354: creat d0/d11/d35/f61 x:0 0 0 2024-02-10T00:00:27.393 INFO:tasks.workunit.client.1.smithi183.stdout:1/333: dwrite d0/d3/d7/d36/f50 [0,4194304] 0 2024-02-10T00:00:27.395 INFO:tasks.workunit.client.1.smithi183.stdout:5/455: truncate d4/d1d/f3f 1787348 0 2024-02-10T00:00:27.395 INFO:tasks.workunit.client.1.smithi183.stdout:5/456: chown d4/d23/d2a/f58 20574 1 2024-02-10T00:00:27.398 INFO:tasks.workunit.client.1.smithi183.stdout:4/366: sync 2024-02-10T00:00:27.401 INFO:tasks.workunit.client.1.smithi183.stdout:4/367: dread de/d14/d27/f1b [0,4194304] 0 2024-02-10T00:00:27.402 INFO:tasks.workunit.client.1.smithi183.stdout:9/376: creat d0/d3/d14/d1c/d4b/d51/f7d x:0 0 0 2024-02-10T00:00:27.402 INFO:tasks.workunit.client.1.smithi183.stdout:7/355: read d0/d2/f2b [6371753,5727] 0 2024-02-10T00:00:27.406 INFO:tasks.workunit.client.1.smithi183.stdout:2/431: unlink d2/d2c/d2f/d72/c82 0 2024-02-10T00:00:27.407 INFO:tasks.workunit.client.1.smithi183.stdout:5/457: rmdir d4/d23/d2a/d5b 39 2024-02-10T00:00:27.408 INFO:tasks.workunit.client.1.smithi183.stdout:5/458: write d4/dd/f54 [2646965,82200] 0 2024-02-10T00:00:27.409 INFO:tasks.workunit.client.1.smithi183.stdout:8/434: creat d0/d23/f8c x:0 0 0 2024-02-10T00:00:27.410 INFO:tasks.workunit.client.1.smithi183.stdout:6/315: dwrite d2/f19 [0,4194304] 0 2024-02-10T00:00:27.412 INFO:tasks.workunit.client.1.smithi183.stdout:9/377: creat d0/d3/d14/d1c/d2d/d4f/d58/f7e x:0 0 0 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:3/7: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:6/68: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:9/79: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:7/75: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:5/69: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:4/27: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:0/10: sync 2024-02-10T00:00:27.413 INFO:tasks.workunit.client.0.smithi164.stdout:2/21: sync 2024-02-10T00:00:27.414 INFO:tasks.workunit.client.0.smithi164.stdout:1/28: sync 2024-02-10T00:00:27.414 INFO:tasks.workunit.client.0.smithi164.stdout:8/12: sync 2024-02-10T00:00:27.414 INFO:tasks.workunit.client.0.smithi164.stdout:8/13: dwrite - no filename 2024-02-10T00:00:27.414 INFO:tasks.workunit.client.0.smithi164.stdout:8/14: write - no filename 2024-02-10T00:00:27.414 INFO:tasks.workunit.client.1.smithi183.stdout:1/334: dwrite d0/d3/d7/f58 [0,4194304] 0 2024-02-10T00:00:27.415 INFO:tasks.workunit.client.1.smithi183.stdout:3/338: getdents d7/db/d2a 0 2024-02-10T00:00:27.418 INFO:tasks.workunit.client.1.smithi183.stdout:5/459: dwrite d4/d23/f94 [0,4194304] 0 2024-02-10T00:00:27.421 INFO:tasks.workunit.client.1.smithi183.stdout:1/335: dwrite d0/d3/d29/f4c [0,4194304] 0 2024-02-10T00:00:27.422 INFO:tasks.workunit.client.1.smithi183.stdout:0/337: rename d14/d1d/d59/f25 to d14/d1d/d59/d71/f7f 0 2024-02-10T00:00:27.423 INFO:tasks.workunit.client.1.smithi183.stdout:9/378: creat d0/d3/d14/d74/f7f x:0 0 0 2024-02-10T00:00:27.423 INFO:tasks.workunit.client.1.smithi183.stdout:0/338: chown d14/d3e/f69 3674 1 2024-02-10T00:00:27.426 INFO:tasks.workunit.client.1.smithi183.stdout:2/432: chown d2/f15 7 1 2024-02-10T00:00:27.428 INFO:tasks.workunit.client.0.smithi164.stdout:1/29: chown d1 0 1 2024-02-10T00:00:27.428 INFO:tasks.workunit.client.1.smithi183.stdout:3/339: creat d7/db/d2a/d33/d59/d52/f60 x:0 0 0 2024-02-10T00:00:27.429 INFO:tasks.workunit.client.0.smithi164.stdout:7/76: readlink d3/l10 0 2024-02-10T00:00:27.429 INFO:tasks.workunit.client.0.smithi164.stdout:4/28: stat d2/l6 0 2024-02-10T00:00:27.429 INFO:tasks.workunit.client.0.smithi164.stdout:8/15: chown l0 17197 1 2024-02-10T00:00:27.429 INFO:tasks.workunit.client.0.smithi164.stdout:8/16: write - no filename 2024-02-10T00:00:27.429 INFO:tasks.workunit.client.0.smithi164.stdout:8/17: dread - no filename 2024-02-10T00:00:27.430 INFO:tasks.workunit.client.1.smithi183.stdout:6/316: dread d2/d1a/d25/f36 [0,4194304] 0 2024-02-10T00:00:27.430 INFO:tasks.workunit.client.1.smithi183.stdout:3/340: chown d7/db/d2a/d33/f37 1459035 1 2024-02-10T00:00:27.430 INFO:tasks.workunit.client.1.smithi183.stdout:7/356: truncate d0/d2/d4/f4a 880380 0 2024-02-10T00:00:27.430 INFO:tasks.workunit.client.0.smithi164.stdout:1/30: dread - d1/f9 zero size 2024-02-10T00:00:27.431 INFO:tasks.workunit.client.1.smithi183.stdout:7/357: write d0/d11/f47 [1740899,30868] 0 2024-02-10T00:00:27.431 INFO:tasks.workunit.client.1.smithi183.stdout:7/358: chown d0/d11/d2f 605346 1 2024-02-10T00:00:27.432 INFO:tasks.workunit.client.1.smithi183.stdout:8/435: truncate d0/d4e/f6a 531778 0 2024-02-10T00:00:27.433 INFO:tasks.workunit.client.1.smithi183.stdout:8/436: rename d0/d27 to d0/d27/d36/d8d 22 2024-02-10T00:00:27.437 INFO:tasks.workunit.client.1.smithi183.stdout:9/379: unlink d0/d3/d14/d1c/d2d/d4f/c70 0 2024-02-10T00:00:27.437 INFO:tasks.workunit.client.1.smithi183.stdout:9/380: stat d0/d3/d14/d1c/d2d/c49 0 2024-02-10T00:00:27.438 INFO:tasks.workunit.client.1.smithi183.stdout:0/339: mknod d14/d1d/d2d/d31/c80 0 2024-02-10T00:00:27.438 INFO:tasks.workunit.client.0.smithi164.stdout:5/70: dread f5 [0,4194304] 0 2024-02-10T00:00:27.438 INFO:tasks.workunit.client.0.smithi164.stdout:2/22: dwrite f2 [0,4194304] 0 2024-02-10T00:00:27.439 INFO:tasks.workunit.client.1.smithi183.stdout:9/381: write d0/d3/d14/d1c/f45 [1524998,48119] 0 2024-02-10T00:00:27.439 INFO:tasks.workunit.client.1.smithi183.stdout:9/382: chown d0/f2b 95 1 2024-02-10T00:00:27.439 INFO:tasks.workunit.client.0.smithi164.stdout:6/69: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:27.440 INFO:tasks.workunit.client.1.smithi183.stdout:9/383: chown d0/c54 3241 1 2024-02-10T00:00:27.440 INFO:tasks.workunit.client.0.smithi164.stdout:7/77: dread d3/f4 [0,4194304] 0 2024-02-10T00:00:27.440 INFO:tasks.workunit.client.0.smithi164.stdout:6/70: fsync d0/d6/f10 0 2024-02-10T00:00:27.441 INFO:tasks.workunit.client.1.smithi183.stdout:5/460: mkdir d4/d23/d3e/d80/d96 0 2024-02-10T00:00:27.441 INFO:tasks.workunit.client.1.smithi183.stdout:5/461: fdatasync d4/d1d/d27/d5d/d70/f7d 0 2024-02-10T00:00:27.443 INFO:tasks.workunit.client.1.smithi183.stdout:9/384: fdatasync d0/d10/f50 0 2024-02-10T00:00:27.445 INFO:tasks.workunit.client.1.smithi183.stdout:9/385: truncate d0/d3/f24 766273 0 2024-02-10T00:00:27.447 INFO:tasks.workunit.client.1.smithi183.stdout:6/317: getdents d2 0 2024-02-10T00:00:27.447 INFO:tasks.workunit.client.1.smithi183.stdout:5/462: creat d4/d1d/d27/f97 x:0 0 0 2024-02-10T00:00:27.449 INFO:tasks.workunit.client.1.smithi183.stdout:9/386: creat d0/d3/d14/d1c/d2d/d4f/d79/f80 x:0 0 0 2024-02-10T00:00:27.449 INFO:tasks.workunit.client.1.smithi183.stdout:9/387: chown d0/d30/d52/l5d 2141343005 1 2024-02-10T00:00:27.450 INFO:tasks.workunit.client.1.smithi183.stdout:6/318: read d2/d1a/f43 [1338893,24145] 0 2024-02-10T00:00:27.450 INFO:tasks.workunit.client.1.smithi183.stdout:5/463: creat d4/dd/d31/d73/f98 x:0 0 0 2024-02-10T00:00:27.451 INFO:tasks.workunit.client.1.smithi183.stdout:5/464: stat d4/dd/d31/d73/f7a 0 2024-02-10T00:00:27.451 INFO:tasks.workunit.client.1.smithi183.stdout:6/319: stat d2/d1a/d25/d3c/d31/d38/d3f/d5e 0 2024-02-10T00:00:27.456 INFO:tasks.workunit.client.1.smithi183.stdout:4/368: truncate de/d14/d27/f1b 1424064 0 2024-02-10T00:00:27.457 INFO:tasks.workunit.client.1.smithi183.stdout:9/388: dwrite d0/d10/f7c [0,4194304] 0 2024-02-10T00:00:27.458 INFO:tasks.workunit.client.1.smithi183.stdout:4/369: write de/d14/f47 [1460494,126561] 0 2024-02-10T00:00:27.458 INFO:tasks.workunit.client.1.smithi183.stdout:9/389: fsync d0/d10/f53 0 2024-02-10T00:00:27.459 INFO:tasks.workunit.client.1.smithi183.stdout:5/465: getdents d4/d23/d3e 0 2024-02-10T00:00:27.460 INFO:tasks.workunit.client.1.smithi183.stdout:6/320: dwrite d2/d26/f2e [0,4194304] 0 2024-02-10T00:00:27.460 INFO:tasks.workunit.client.1.smithi183.stdout:9/390: chown d0/d3/d14/d74/l76 0 1 2024-02-10T00:00:27.462 INFO:tasks.workunit.client.1.smithi183.stdout:6/321: readlink d2/d1a/d3a/l55 0 2024-02-10T00:00:27.466 INFO:tasks.workunit.client.1.smithi183.stdout:6/322: mkdir d2/d26/d64 0 2024-02-10T00:00:27.467 INFO:tasks.workunit.client.1.smithi183.stdout:6/323: fdatasync d2/f16 0 2024-02-10T00:00:27.494 INFO:tasks.workunit.client.1.smithi183.stdout:6/324: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:27.494 INFO:tasks.workunit.client.1.smithi183.stdout:4/370: rename de/d19/d1c/c2d to de/d19/d1c/c6f 0 2024-02-10T00:00:27.495 INFO:tasks.workunit.client.1.smithi183.stdout:1/336: write d0/d3/d7/d36/f47 [4927421,121513] 0 2024-02-10T00:00:27.495 INFO:tasks.workunit.client.1.smithi183.stdout:2/433: write d2/f4a [60342,88944] 0 2024-02-10T00:00:27.497 INFO:tasks.workunit.client.1.smithi183.stdout:7/359: write d0/d11/d35/f51 [728664,100267] 0 2024-02-10T00:00:27.498 INFO:tasks.workunit.client.1.smithi183.stdout:9/391: truncate d0/d10/f7c 2100539 0 2024-02-10T00:00:27.499 INFO:tasks.workunit.client.1.smithi183.stdout:1/337: mkdir d0/d3/d67/d7b 0 2024-02-10T00:00:27.500 INFO:tasks.workunit.client.1.smithi183.stdout:6/325: fdatasync d2/d1a/d25/d3c/d31/d38/d3f/f4d 0 2024-02-10T00:00:27.501 INFO:tasks.workunit.client.1.smithi183.stdout:4/371: rename de/d14/d1d/d2f/l6a to de/d14/d27/d40/l70 0 2024-02-10T00:00:27.501 INFO:tasks.workunit.client.1.smithi183.stdout:8/437: dread d0/d27/d75/d5b/f5d [0,4194304] 0 2024-02-10T00:00:27.502 INFO:tasks.workunit.client.1.smithi183.stdout:2/434: truncate d2/da/d20/d21/d43/f45 785722 0 2024-02-10T00:00:27.503 INFO:tasks.workunit.client.0.smithi164.stdout:2/23: sync 2024-02-10T00:00:27.503 INFO:tasks.workunit.client.1.smithi183.stdout:6/326: read d2/d1a/d25/d3c/d31/d38/d3f/f4d [113506,100779] 0 2024-02-10T00:00:27.503 INFO:tasks.workunit.client.1.smithi183.stdout:2/435: dread - d2/da/d19/f7a zero size 2024-02-10T00:00:27.504 INFO:tasks.workunit.client.1.smithi183.stdout:2/436: dread - d2/da/d20/d21/d36/f6e zero size 2024-02-10T00:00:27.504 INFO:tasks.workunit.client.1.smithi183.stdout:2/437: chown d2/f8 105171818 1 2024-02-10T00:00:27.506 INFO:tasks.workunit.client.1.smithi183.stdout:1/338: readlink d0/d3/d29/d1f/l6d 0 2024-02-10T00:00:27.507 INFO:tasks.workunit.client.1.smithi183.stdout:7/360: write d0/d11/d3e/f49 [1027037,37386] 0 2024-02-10T00:00:27.509 INFO:tasks.workunit.client.1.smithi183.stdout:9/392: link d0/d3/d14/d48/f5e d0/d10/f81 0 2024-02-10T00:00:27.510 INFO:tasks.workunit.client.1.smithi183.stdout:2/438: fsync d2/da/d20/d21/f29 0 2024-02-10T00:00:27.510 INFO:tasks.workunit.client.1.smithi183.stdout:2/439: chown d2/da/f1d 394 1 2024-02-10T00:00:27.511 INFO:tasks.workunit.client.1.smithi183.stdout:1/339: mkdir d0/d3/d7/d36/d7c 0 2024-02-10T00:00:27.511 INFO:tasks.workunit.client.1.smithi183.stdout:3/341: sync 2024-02-10T00:00:27.515 INFO:tasks.workunit.client.1.smithi183.stdout:6/327: link d2/d32/f5f d2/f65 0 2024-02-10T00:00:27.518 INFO:tasks.workunit.client.1.smithi183.stdout:8/438: truncate d0/fd 5691973 0 2024-02-10T00:00:27.519 INFO:tasks.workunit.client.1.smithi183.stdout:8/439: chown d0/d27/d36/d7f 22914 1 2024-02-10T00:00:27.523 INFO:tasks.workunit.client.1.smithi183.stdout:4/372: creat de/f71 x:0 0 0 2024-02-10T00:00:27.525 INFO:tasks.workunit.client.1.smithi183.stdout:2/440: mkdir d2/da/d20/d6d/d8f 0 2024-02-10T00:00:27.526 INFO:tasks.workunit.client.1.smithi183.stdout:2/441: dread - d2/d2c/f86 zero size 2024-02-10T00:00:27.526 INFO:tasks.workunit.client.1.smithi183.stdout:8/440: dread d0/d27/d36/f40 [0,4194304] 0 2024-02-10T00:00:27.526 INFO:tasks.workunit.client.1.smithi183.stdout:1/340: truncate d0/d3/d67/f2f 179853 0 2024-02-10T00:00:27.527 INFO:tasks.workunit.client.1.smithi183.stdout:2/442: chown d2/da/d20/l5c 158 1 2024-02-10T00:00:27.527 INFO:tasks.workunit.client.1.smithi183.stdout:7/361: mknod d0/d11/c62 0 2024-02-10T00:00:27.527 INFO:tasks.workunit.client.1.smithi183.stdout:8/441: read - d0/d23/d2d/d24/f7a zero size 2024-02-10T00:00:27.528 INFO:tasks.workunit.client.1.smithi183.stdout:7/362: chown d0/d11/d2f 14466278 1 2024-02-10T00:00:27.530 INFO:tasks.workunit.client.1.smithi183.stdout:3/342: fsync d7/db/d2a/d2d/f2f 0 2024-02-10T00:00:27.532 INFO:tasks.workunit.client.1.smithi183.stdout:9/393: creat d0/d3/d14/f82 x:0 0 0 2024-02-10T00:00:27.534 INFO:tasks.workunit.client.1.smithi183.stdout:6/328: dread d2/f19 [0,4194304] 0 2024-02-10T00:00:27.537 INFO:tasks.workunit.client.1.smithi183.stdout:9/394: read d0/d3/d14/d1c/f45 [40656,121675] 0 2024-02-10T00:00:27.539 INFO:tasks.workunit.client.1.smithi183.stdout:0/340: sync 2024-02-10T00:00:27.540 INFO:tasks.workunit.client.1.smithi183.stdout:7/363: dread d0/d2/d4/f4a [0,4194304] 0 2024-02-10T00:00:27.545 INFO:tasks.workunit.client.1.smithi183.stdout:4/373: creat de/f72 x:0 0 0 2024-02-10T00:00:27.545 INFO:tasks.workunit.client.1.smithi183.stdout:4/374: fdatasync de/d19/d1c/f36 0 2024-02-10T00:00:27.546 INFO:tasks.workunit.client.1.smithi183.stdout:1/341: truncate d0/d3/d7/f58 4816318 0 2024-02-10T00:00:27.547 INFO:tasks.workunit.client.1.smithi183.stdout:1/342: readlink d0/d3/d29/d1f/l6d 0 2024-02-10T00:00:27.548 INFO:tasks.workunit.client.1.smithi183.stdout:2/443: creat d2/d2c/f90 x:0 0 0 2024-02-10T00:00:27.548 INFO:tasks.workunit.client.1.smithi183.stdout:2/444: dread - d2/d2c/f86 zero size 2024-02-10T00:00:27.551 INFO:tasks.workunit.client.1.smithi183.stdout:8/442: rename d0/d27/d36/l38 to d0/d23/d2d/l8e 0 2024-02-10T00:00:27.552 INFO:tasks.workunit.client.1.smithi183.stdout:3/343: creat d7/db/f61 x:0 0 0 2024-02-10T00:00:27.553 INFO:tasks.workunit.client.1.smithi183.stdout:1/343: creat d0/d3/d67/d70/f7d x:0 0 0 2024-02-10T00:00:27.554 INFO:tasks.workunit.client.1.smithi183.stdout:9/395: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:27.556 INFO:tasks.workunit.client.1.smithi183.stdout:3/344: read - d7/db/d2a/f2c zero size 2024-02-10T00:00:27.556 INFO:tasks.workunit.client.1.smithi183.stdout:7/364: dwrite d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:27.557 INFO:tasks.workunit.client.1.smithi183.stdout:2/445: dwrite d2/da/f62 [0,4194304] 0 2024-02-10T00:00:27.561 INFO:tasks.workunit.client.1.smithi183.stdout:0/341: truncate d14/f17 5281227 0 2024-02-10T00:00:27.562 INFO:tasks.workunit.client.1.smithi183.stdout:1/344: unlink d0/d3c/l46 0 2024-02-10T00:00:27.565 INFO:tasks.workunit.client.1.smithi183.stdout:4/375: dread de/f1f [0,4194304] 0 2024-02-10T00:00:27.567 INFO:tasks.workunit.client.1.smithi183.stdout:0/342: chown d14/d1d/d59/d71/d22/c24 10 1 2024-02-10T00:00:27.567 INFO:tasks.workunit.client.1.smithi183.stdout:8/443: dwrite d0/d27/d36/f40 [0,4194304] 0 2024-02-10T00:00:27.572 INFO:tasks.workunit.client.1.smithi183.stdout:1/345: symlink d0/d3/d29/d38/l7e 0 2024-02-10T00:00:27.575 INFO:tasks.workunit.client.1.smithi183.stdout:3/345: link d7/db/l54 d7/db/d2a/d2d/d51/l62 0 2024-02-10T00:00:27.575 INFO:tasks.workunit.client.1.smithi183.stdout:7/365: dwrite d0/d2/d4/f4a [0,4194304] 0 2024-02-10T00:00:27.576 INFO:tasks.workunit.client.1.smithi183.stdout:9/396: truncate d0/d3/d14/d1c/d2d/d4f/d79/f80 745114 0 2024-02-10T00:00:27.578 INFO:tasks.workunit.client.1.smithi183.stdout:0/343: creat d14/d1d/d2d/d31/d6c/d70/f81 x:0 0 0 2024-02-10T00:00:27.579 INFO:tasks.workunit.client.1.smithi183.stdout:0/344: chown d14/d1d/d59/d71/f1b 83325 1 2024-02-10T00:00:27.579 INFO:tasks.workunit.client.1.smithi183.stdout:1/346: creat d0/d3/d7/d3d/d60/f7f x:0 0 0 2024-02-10T00:00:27.579 INFO:tasks.workunit.client.1.smithi183.stdout:1/347: fsync d0/d3a/f7a 0 2024-02-10T00:00:27.580 INFO:tasks.workunit.client.1.smithi183.stdout:1/348: readlink d0/d3/l26 0 2024-02-10T00:00:27.581 INFO:tasks.workunit.client.1.smithi183.stdout:2/446: getdents d2/da/d19 0 2024-02-10T00:00:27.583 INFO:tasks.workunit.client.1.smithi183.stdout:3/346: unlink d7/fd 0 2024-02-10T00:00:27.584 INFO:tasks.workunit.client.1.smithi183.stdout:7/366: chown d0/d11/d3e/f58 96944878 1 2024-02-10T00:00:27.586 INFO:tasks.workunit.client.1.smithi183.stdout:8/444: truncate d0/d23/d2d/d24/f7a 703541 0 2024-02-10T00:00:27.587 INFO:tasks.workunit.client.1.smithi183.stdout:1/349: creat d0/d3a/f80 x:0 0 0 2024-02-10T00:00:27.589 INFO:tasks.workunit.client.1.smithi183.stdout:2/447: mknod d2/da/d5b/c91 0 2024-02-10T00:00:27.590 INFO:tasks.workunit.client.1.smithi183.stdout:4/376: getdents de/d19/d1c 0 2024-02-10T00:00:27.591 INFO:tasks.workunit.client.1.smithi183.stdout:7/367: symlink d0/d11/d3e/l63 0 2024-02-10T00:00:27.591 INFO:tasks.workunit.client.1.smithi183.stdout:0/345: dwrite d14/d1d/d59/d71/f7f [4194304,4194304] 0 2024-02-10T00:00:27.593 INFO:tasks.workunit.client.1.smithi183.stdout:8/445: rename d0/d27/d75/d5b/d85/c67 to d0/d3f/c8f 0 2024-02-10T00:00:27.599 INFO:tasks.workunit.client.1.smithi183.stdout:1/350: rename d0/d3/d29/d38/f6e to d0/d3/d67/d70/f81 0 2024-02-10T00:00:27.600 INFO:tasks.workunit.client.1.smithi183.stdout:4/377: dwrite de/d14/d27/f3d [0,4194304] 0 2024-02-10T00:00:27.601 INFO:tasks.workunit.client.1.smithi183.stdout:7/368: dwrite d0/f1 [4194304,4194304] 0 2024-02-10T00:00:27.601 INFO:tasks.workunit.client.1.smithi183.stdout:0/346: dwrite d14/d1d/d59/d3c/d3f/f64 [4194304,4194304] 0 2024-02-10T00:00:27.605 INFO:tasks.workunit.client.1.smithi183.stdout:5/466: sync 2024-02-10T00:00:27.606 INFO:tasks.workunit.client.1.smithi183.stdout:8/446: mknod d0/d23/d2d/c90 0 2024-02-10T00:00:27.606 INFO:tasks.workunit.client.1.smithi183.stdout:8/447: symlink d0/d45/d46/d81/l91 2 2024-02-10T00:00:27.609 INFO:tasks.workunit.client.1.smithi183.stdout:2/448: rename d2/d3d/f42 to d2/d2c/d2f/d72/f92 0 2024-02-10T00:00:27.615 INFO:tasks.workunit.client.1.smithi183.stdout:9/397: write d0/d10/f1b [2652467,86467] 0 2024-02-10T00:00:27.616 INFO:tasks.workunit.client.1.smithi183.stdout:3/347: truncate d7/db/d2a/f2b 1273047 0 2024-02-10T00:00:27.617 INFO:tasks.workunit.client.1.smithi183.stdout:4/378: mknod de/d14/d27/d40/c73 0 2024-02-10T00:00:27.621 INFO:tasks.workunit.client.1.smithi183.stdout:8/448: mkdir d0/d27/d75/d5b/d92 0 2024-02-10T00:00:27.624 INFO:tasks.workunit.client.1.smithi183.stdout:0/347: dread f3 [4194304,4194304] 0 2024-02-10T00:00:27.625 INFO:tasks.workunit.client.1.smithi183.stdout:9/398: rename d0/d30/f39 to d0/d3/d14/d48/f83 0 2024-02-10T00:00:27.626 INFO:tasks.workunit.client.1.smithi183.stdout:4/379: chown de/d14/d27/d40/f66 1032 1 2024-02-10T00:00:27.629 INFO:tasks.workunit.client.0.smithi164.stdout:3/8: rmdir d0 39 2024-02-10T00:00:27.629 INFO:tasks.workunit.client.1.smithi183.stdout:0/348: creat d14/d7a/f82 x:0 0 0 2024-02-10T00:00:27.630 INFO:tasks.workunit.client.1.smithi183.stdout:9/399: dread d0/d3/d14/d1c/d2d/d4f/f5a [0,4194304] 0 2024-02-10T00:00:27.631 INFO:tasks.workunit.client.1.smithi183.stdout:5/467: truncate d4/dd/f75 488883 0 2024-02-10T00:00:27.631 INFO:tasks.workunit.client.1.smithi183.stdout:0/349: stat d14/d1d/d59/d71/d22/f35 0 2024-02-10T00:00:27.631 INFO:tasks.workunit.client.1.smithi183.stdout:8/449: dwrite d0/d27/d75/d5b/f5d [4194304,4194304] 0 2024-02-10T00:00:27.632 INFO:tasks.workunit.client.1.smithi183.stdout:9/400: readlink d0/d30/l73 0 2024-02-10T00:00:27.633 INFO:tasks.workunit.client.1.smithi183.stdout:7/369: getdents d0/d11/d35 0 2024-02-10T00:00:27.633 INFO:tasks.workunit.client.0.smithi164.stdout:8/18: symlink l1 0 2024-02-10T00:00:27.634 INFO:tasks.workunit.client.0.smithi164.stdout:8/19: stat l0 0 2024-02-10T00:00:27.634 INFO:tasks.workunit.client.0.smithi164.stdout:8/20: write - no filename 2024-02-10T00:00:27.634 INFO:tasks.workunit.client.0.smithi164.stdout:8/21: dread - no filename 2024-02-10T00:00:27.634 INFO:tasks.workunit.client.1.smithi183.stdout:5/468: fsync d4/fa 0 2024-02-10T00:00:27.634 INFO:tasks.workunit.client.1.smithi183.stdout:9/401: dread - d0/d3/d14/f82 zero size 2024-02-10T00:00:27.636 INFO:tasks.workunit.client.1.smithi183.stdout:8/450: write d0/d10/f1a [58741,40412] 0 2024-02-10T00:00:27.637 INFO:tasks.workunit.client.0.smithi164.stdout:5/71: symlink d7/l14 0 2024-02-10T00:00:27.638 INFO:tasks.workunit.client.1.smithi183.stdout:1/351: write d0/f5a [1922104,709] 0 2024-02-10T00:00:27.639 INFO:tasks.workunit.client.0.smithi164.stdout:4/29: dwrite f1 [0,4194304] 0 2024-02-10T00:00:27.639 INFO:tasks.workunit.client.1.smithi183.stdout:6/329: sync 2024-02-10T00:00:27.641 INFO:tasks.workunit.client.1.smithi183.stdout:7/370: mkdir d0/d11/d2f/d64 0 2024-02-10T00:00:27.644 INFO:tasks.workunit.client.1.smithi183.stdout:2/449: dwrite d2/da/d77/f4f [0,4194304] 0 2024-02-10T00:00:27.646 INFO:tasks.workunit.client.0.smithi164.stdout:2/24: creat d3/f6 x:0 0 0 2024-02-10T00:00:27.646 INFO:tasks.workunit.client.1.smithi183.stdout:9/402: symlink d0/d3/d14/d1c/l84 0 2024-02-10T00:00:27.648 INFO:tasks.workunit.client.1.smithi183.stdout:4/380: dwrite de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:27.652 INFO:tasks.workunit.client.0.smithi164.stdout:3/9: dwrite d0/f4 [0,4194304] 0 2024-02-10T00:00:27.654 INFO:tasks.workunit.client.1.smithi183.stdout:7/371: fsync d0/f53 0 2024-02-10T00:00:27.655 INFO:tasks.workunit.client.1.smithi183.stdout:5/469: unlink d4/d23/c2f 0 2024-02-10T00:00:27.655 INFO:tasks.workunit.client.1.smithi183.stdout:5/470: dread - d4/dd/d71/f84 zero size 2024-02-10T00:00:27.657 INFO:tasks.workunit.client.1.smithi183.stdout:2/450: dread d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:27.657 INFO:tasks.workunit.client.1.smithi183.stdout:8/451: mknod d0/d4e/c93 0 2024-02-10T00:00:27.659 INFO:tasks.workunit.client.1.smithi183.stdout:3/348: dread d7/db/f41 [0,4194304] 0 2024-02-10T00:00:27.659 INFO:tasks.workunit.client.1.smithi183.stdout:2/451: write d2/d2c/f86 [35065,8657] 0 2024-02-10T00:00:27.659 INFO:tasks.workunit.client.1.smithi183.stdout:9/403: creat d0/d3/d14/d1c/d2d/d4f/d79/f85 x:0 0 0 2024-02-10T00:00:27.660 INFO:tasks.workunit.client.1.smithi183.stdout:2/452: write d2/f3e [445290,27605] 0 2024-02-10T00:00:27.661 INFO:tasks.workunit.client.1.smithi183.stdout:2/453: stat d2/d8b 0 2024-02-10T00:00:27.662 INFO:tasks.workunit.client.1.smithi183.stdout:4/381: rename de/d14/d1d/d2f/f3e to de/d14/d27/d2e/f74 0 2024-02-10T00:00:27.662 INFO:tasks.workunit.client.1.smithi183.stdout:9/404: read d0/d3/d14/f38 [868926,9] 0 2024-02-10T00:00:27.664 INFO:tasks.workunit.client.1.smithi183.stdout:4/382: fsync de/d19/d1c/f36 0 2024-02-10T00:00:27.665 INFO:tasks.workunit.client.1.smithi183.stdout:3/349: dwrite d7/f5a [0,4194304] 0 2024-02-10T00:00:27.666 INFO:tasks.workunit.client.1.smithi183.stdout:2/454: dwrite d2/d2c/d2f/f3b [0,4194304] 0 2024-02-10T00:00:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:8/22: sync 2024-02-10T00:00:27.669 INFO:tasks.workunit.client.0.smithi164.stdout:8/23: chown l1 58554464 1 2024-02-10T00:00:27.670 INFO:tasks.workunit.client.0.smithi164.stdout:5/72: chown d7/l10 5 1 2024-02-10T00:00:27.672 INFO:tasks.workunit.client.0.smithi164.stdout:4/30: symlink d2/l7 0 2024-02-10T00:00:27.675 INFO:tasks.workunit.client.0.smithi164.stdout:4/31: dread f1 [0,4194304] 0 2024-02-10T00:00:27.676 INFO:tasks.workunit.client.1.smithi183.stdout:6/330: fsync d2/d26/d35/f4f 0 2024-02-10T00:00:27.677 INFO:tasks.workunit.client.1.smithi183.stdout:4/383: mknod de/d14/d1d/c75 0 2024-02-10T00:00:27.677 INFO:tasks.workunit.client.1.smithi183.stdout:3/350: mkdir d7/db/d2a/d4d/d63 0 2024-02-10T00:00:27.678 INFO:tasks.workunit.client.1.smithi183.stdout:1/352: link d0/d3/l26 d0/l82 0 2024-02-10T00:00:27.678 INFO:tasks.workunit.client.0.smithi164.stdout:7/78: rename d3/fa to d3/d11/f18 0 2024-02-10T00:00:27.678 INFO:tasks.workunit.client.0.smithi164.stdout:6/71: mkdir d0/d6/d12/d14 0 2024-02-10T00:00:27.679 INFO:tasks.workunit.client.0.smithi164.stdout:6/72: write d0/f11 [86501,24427] 0 2024-02-10T00:00:27.680 INFO:tasks.workunit.client.1.smithi183.stdout:7/372: creat d0/d2/f65 x:0 0 0 2024-02-10T00:00:27.681 INFO:tasks.workunit.client.1.smithi183.stdout:5/471: creat d4/d1d/f99 x:0 0 0 2024-02-10T00:00:27.682 INFO:tasks.workunit.client.0.smithi164.stdout:7/79: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:27.683 INFO:tasks.workunit.client.1.smithi183.stdout:2/455: creat d2/da/d20/d6d/d8f/f93 x:0 0 0 2024-02-10T00:00:27.687 INFO:tasks.workunit.client.1.smithi183.stdout:7/373: creat d0/d11/d2f/f66 x:0 0 0 2024-02-10T00:00:27.688 INFO:tasks.workunit.client.1.smithi183.stdout:8/452: getdents d0/d27/d75/d5b 0 2024-02-10T00:00:27.689 INFO:tasks.workunit.client.1.smithi183.stdout:8/453: dread - d0/d27/d36/f80 zero size 2024-02-10T00:00:27.691 INFO:tasks.workunit.client.1.smithi183.stdout:3/351: dwrite d7/db/d2a/d33/f56 [0,4194304] 0 2024-02-10T00:00:27.694 INFO:tasks.workunit.client.1.smithi183.stdout:6/331: dwrite d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:27.695 INFO:tasks.workunit.client.1.smithi183.stdout:8/454: mkdir d0/d3f/d94 0 2024-02-10T00:00:27.697 INFO:tasks.workunit.client.1.smithi183.stdout:5/472: link d4/c5 d4/d1d/d27/d5d/d6d/c9a 0 2024-02-10T00:00:27.698 INFO:tasks.workunit.client.1.smithi183.stdout:5/473: chown d4/dd/f54 323124 1 2024-02-10T00:00:27.698 INFO:tasks.workunit.client.1.smithi183.stdout:3/352: creat d7/db/d2a/d33/d59/d52/f64 x:0 0 0 2024-02-10T00:00:27.700 INFO:tasks.workunit.client.0.smithi164.stdout:2/25: creat d3/f7 x:0 0 0 2024-02-10T00:00:27.701 INFO:tasks.workunit.client.1.smithi183.stdout:4/384: getdents de/d19/d20 0 2024-02-10T00:00:27.702 INFO:tasks.workunit.client.1.smithi183.stdout:4/385: stat de/d19/d20/f26 0 2024-02-10T00:00:27.703 INFO:tasks.workunit.client.1.smithi183.stdout:5/474: dwrite d4/d1d/d27/f57 [0,4194304] 0 2024-02-10T00:00:27.703 INFO:tasks.workunit.client.1.smithi183.stdout:4/386: read - de/f71 zero size 2024-02-10T00:00:27.704 INFO:tasks.workunit.client.1.smithi183.stdout:2/456: getdents d2/d2c/d2f 0 2024-02-10T00:00:27.704 INFO:tasks.workunit.client.1.smithi183.stdout:3/353: write d7/f30 [6077857,76327] 0 2024-02-10T00:00:27.705 INFO:tasks.workunit.client.0.smithi164.stdout:2/26: dwrite d3/f6 [0,4194304] 0 2024-02-10T00:00:27.708 INFO:tasks.workunit.client.1.smithi183.stdout:0/350: truncate f6 412625 0 2024-02-10T00:00:27.710 INFO:tasks.workunit.client.1.smithi183.stdout:6/332: truncate d2/d1a/f20 677219 0 2024-02-10T00:00:27.710 INFO:tasks.workunit.client.1.smithi183.stdout:5/475: dwrite d4/dd/d71/f84 [0,4194304] 0 2024-02-10T00:00:27.712 INFO:tasks.workunit.client.1.smithi183.stdout:4/387: dwrite de/d22/f28 [0,4194304] 0 2024-02-10T00:00:27.712 INFO:tasks.workunit.client.0.smithi164.stdout:8/24: sync 2024-02-10T00:00:27.712 INFO:tasks.workunit.client.0.smithi164.stdout:8/25: fdatasync - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/26: dread - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/27: dread - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/28: read - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/29: write - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/30: fsync - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/31: write - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/32: fdatasync - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/33: dread - no filename 2024-02-10T00:00:27.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/34: chown l0 446 1 2024-02-10T00:00:27.714 INFO:tasks.workunit.client.0.smithi164.stdout:8/35: chown l1 65 1 2024-02-10T00:00:27.715 INFO:tasks.workunit.client.1.smithi183.stdout:4/388: write de/d14/d27/f21 [814128,96669] 0 2024-02-10T00:00:27.715 INFO:tasks.workunit.client.1.smithi183.stdout:3/354: fdatasync d7/db/f47 0 2024-02-10T00:00:27.715 INFO:tasks.workunit.client.1.smithi183.stdout:8/455: creat d0/d23/f95 x:0 0 0 2024-02-10T00:00:27.716 INFO:tasks.workunit.client.1.smithi183.stdout:2/457: symlink d2/d2c/d2f/d60/d8d/l94 0 2024-02-10T00:00:27.717 INFO:tasks.workunit.client.1.smithi183.stdout:6/333: chown d2/d1a/d3a/d45/d53/l59 400975 1 2024-02-10T00:00:27.718 INFO:tasks.workunit.client.1.smithi183.stdout:5/476: rmdir d4/dd/d31 39 2024-02-10T00:00:27.720 INFO:tasks.workunit.client.1.smithi183.stdout:0/351: dwrite d14/d1d/d59/d71/d22/f48 [0,4194304] 0 2024-02-10T00:00:27.721 INFO:tasks.workunit.client.1.smithi183.stdout:3/355: creat d7/db/d2a/f65 x:0 0 0 2024-02-10T00:00:27.724 INFO:tasks.workunit.client.0.smithi164.stdout:6/73: dread d0/f11 [0,4194304] 0 2024-02-10T00:00:27.725 INFO:tasks.workunit.client.1.smithi183.stdout:2/458: creat d2/d2c/d2f/d72/d7b/f95 x:0 0 0 2024-02-10T00:00:27.725 INFO:tasks.workunit.client.1.smithi183.stdout:9/405: sync 2024-02-10T00:00:27.726 INFO:tasks.workunit.client.1.smithi183.stdout:6/334: mkdir d2/d1a/d25/d3c/d31/d66 0 2024-02-10T00:00:27.727 INFO:tasks.workunit.client.1.smithi183.stdout:5/477: creat d4/d1d/d89/f9b x:0 0 0 2024-02-10T00:00:27.728 INFO:tasks.workunit.client.1.smithi183.stdout:7/374: dread d0/d2/f41 [0,4194304] 0 2024-02-10T00:00:27.728 INFO:tasks.workunit.client.1.smithi183.stdout:0/352: mknod d14/d1d/c83 0 2024-02-10T00:00:27.729 INFO:tasks.workunit.client.0.smithi164.stdout:6/74: dwrite d0/f11 [0,4194304] 0 2024-02-10T00:00:27.729 INFO:tasks.workunit.client.1.smithi183.stdout:0/353: fdatasync d14/d1d/d59/d3c/d3f/f58 0 2024-02-10T00:00:27.732 INFO:tasks.workunit.client.1.smithi183.stdout:9/406: symlink d0/d30/l86 0 2024-02-10T00:00:27.733 INFO:tasks.workunit.client.0.smithi164.stdout:6/75: dread d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:27.735 INFO:tasks.workunit.client.1.smithi183.stdout:5/478: unlink d4/d23/d3e/c56 0 2024-02-10T00:00:27.736 INFO:tasks.workunit.client.1.smithi183.stdout:5/479: fdatasync d4/d1d/d27/d37/d46/d4e/f62 0 2024-02-10T00:00:27.737 INFO:tasks.workunit.client.0.smithi164.stdout:3/10: symlink d0/l5 0 2024-02-10T00:00:27.737 INFO:tasks.workunit.client.1.smithi183.stdout:0/354: creat d14/d1d/d55/f84 x:0 0 0 2024-02-10T00:00:27.741 INFO:tasks.workunit.client.1.smithi183.stdout:2/459: mkdir d2/d96 0 2024-02-10T00:00:27.742 INFO:tasks.workunit.client.0.smithi164.stdout:0/11: rmdir d4 0 2024-02-10T00:00:27.743 INFO:tasks.workunit.client.0.smithi164.stdout:0/12: read - f0 zero size 2024-02-10T00:00:27.746 INFO:tasks.workunit.client.1.smithi183.stdout:6/335: creat d2/d26/d34/d61/f67 x:0 0 0 2024-02-10T00:00:27.746 INFO:tasks.workunit.client.1.smithi183.stdout:9/407: write d0/d3/d14/d3c/f60 [2362094,90225] 0 2024-02-10T00:00:27.747 INFO:tasks.workunit.client.1.smithi183.stdout:4/389: link de/d14/d1d/d2f/c5a de/c76 0 2024-02-10T00:00:27.748 INFO:tasks.workunit.client.1.smithi183.stdout:9/408: dread - d0/d3/d14/d1c/d4b/f65 zero size 2024-02-10T00:00:27.750 INFO:tasks.workunit.client.1.smithi183.stdout:5/480: fdatasync d4/d1d/d27/d38/f61 0 2024-02-10T00:00:27.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/355: creat d14/d1d/d2d/d31/d6c/d70/f85 x:0 0 0 2024-02-10T00:00:27.751 INFO:tasks.workunit.client.0.smithi164.stdout:9/80: link d6/c13 d6/de/c17 0 2024-02-10T00:00:27.752 INFO:tasks.workunit.client.1.smithi183.stdout:4/390: truncate de/d19/f30 155094 0 2024-02-10T00:00:27.753 INFO:tasks.workunit.client.1.smithi183.stdout:6/336: dwrite d2/d1a/d3a/f40 [0,4194304] 0 2024-02-10T00:00:27.754 INFO:tasks.workunit.client.0.smithi164.stdout:1/31: truncate d1/f4 1124433 0 2024-02-10T00:00:27.756 INFO:tasks.workunit.client.0.smithi164.stdout:5/73: mkdir d7/d15 0 2024-02-10T00:00:27.757 INFO:tasks.workunit.client.1.smithi183.stdout:4/391: write de/d14/d27/f3d [670,111196] 0 2024-02-10T00:00:27.758 INFO:tasks.workunit.client.1.smithi183.stdout:6/337: creat d2/d26/f68 x:0 0 0 2024-02-10T00:00:27.760 INFO:tasks.workunit.client.1.smithi183.stdout:9/409: dwrite d0/d3/d14/d1c/d2d/f4d [0,4194304] 0 2024-02-10T00:00:27.761 INFO:tasks.workunit.client.1.smithi183.stdout:2/460: dwrite d2/da/f7d [0,4194304] 0 2024-02-10T00:00:27.762 INFO:tasks.workunit.client.1.smithi183.stdout:0/356: dwrite d14/d43/f78 [0,4194304] 0 2024-02-10T00:00:27.762 INFO:tasks.workunit.client.1.smithi183.stdout:4/392: symlink de/d19/l77 0 2024-02-10T00:00:27.763 INFO:tasks.workunit.client.1.smithi183.stdout:4/393: dread - de/d22/f63 zero size 2024-02-10T00:00:27.764 INFO:tasks.workunit.client.1.smithi183.stdout:2/461: write d2/da/d20/d21/d43/f65 [931023,97088] 0 2024-02-10T00:00:27.764 INFO:tasks.workunit.client.1.smithi183.stdout:4/394: chown de/l1e 23929 1 2024-02-10T00:00:27.767 INFO:tasks.workunit.client.1.smithi183.stdout:9/410: creat d0/d3/d14/d3c/d7b/f87 x:0 0 0 2024-02-10T00:00:27.772 INFO:tasks.workunit.client.1.smithi183.stdout:0/357: getdents d14/d7a/d63 0 2024-02-10T00:00:27.776 INFO:tasks.workunit.client.1.smithi183.stdout:0/358: symlink d14/d1d/d59/l86 0 2024-02-10T00:00:27.777 INFO:tasks.workunit.client.1.smithi183.stdout:0/359: write d14/d1d/d2d/d31/d6c/d70/f81 [181596,59366] 0 2024-02-10T00:00:27.778 INFO:tasks.workunit.client.1.smithi183.stdout:0/360: chown d14/d1d/d2d/d31/c3b 6 1 2024-02-10T00:00:27.787 INFO:tasks.workunit.client.1.smithi183.stdout:9/411: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:27.788 INFO:tasks.workunit.client.1.smithi183.stdout:9/412: symlink d0/d3/l88 0 2024-02-10T00:00:27.789 INFO:tasks.workunit.client.0.smithi164.stdout:4/32: creat d2/f8 x:0 0 0 2024-02-10T00:00:27.789 INFO:tasks.workunit.client.1.smithi183.stdout:9/413: mkdir d0/d3/d14/d1c/d2d/d4f/d89 0 2024-02-10T00:00:27.792 INFO:tasks.workunit.client.1.smithi183.stdout:9/414: rename d0/d3/d14/d3c/l55 to d0/d3/d14/d74/l8a 0 2024-02-10T00:00:27.792 INFO:tasks.workunit.client.1.smithi183.stdout:9/415: chown d0/d30/l86 1 1 2024-02-10T00:00:27.797 INFO:tasks.workunit.client.1.smithi183.stdout:9/416: rename d0/d3/d14/d1c/d2d/c40 to d0/d30/c8b 0 2024-02-10T00:00:27.800 INFO:tasks.workunit.client.1.smithi183.stdout:9/417: dwrite d0/f2e [0,4194304] 0 2024-02-10T00:00:27.802 INFO:tasks.workunit.client.1.smithi183.stdout:5/481: sync 2024-02-10T00:00:27.803 INFO:tasks.workunit.client.1.smithi183.stdout:9/418: mknod d0/d3/d14/d1c/d2d/d4f/c8c 0 2024-02-10T00:00:27.804 INFO:tasks.workunit.client.1.smithi183.stdout:9/419: chown d0/d3/d14/c25 21911 1 2024-02-10T00:00:27.807 INFO:tasks.workunit.client.1.smithi183.stdout:5/482: rename d4/d1d/d27/d5d/d70 to d4/d4b/d9c 0 2024-02-10T00:00:27.810 INFO:tasks.workunit.client.1.smithi183.stdout:5/483: mkdir d4/d1d/d27/d9d 0 2024-02-10T00:00:27.812 INFO:tasks.workunit.client.1.smithi183.stdout:4/395: dread de/f3c [0,4194304] 0 2024-02-10T00:00:27.815 INFO:tasks.workunit.client.1.smithi183.stdout:5/484: getdents d4/d1d/d27/d37/d46 0 2024-02-10T00:00:27.817 INFO:tasks.workunit.client.1.smithi183.stdout:4/396: rename de/d14/c50 to de/d14/c78 0 2024-02-10T00:00:27.820 INFO:tasks.workunit.client.1.smithi183.stdout:4/397: mknod de/d19/d1c/d61/c79 0 2024-02-10T00:00:27.823 INFO:tasks.workunit.client.1.smithi183.stdout:4/398: unlink de/d14/c29 0 2024-02-10T00:00:27.824 INFO:tasks.workunit.client.1.smithi183.stdout:1/353: truncate d0/d3/d7/f32 316851 0 2024-02-10T00:00:27.831 INFO:tasks.workunit.client.1.smithi183.stdout:8/456: truncate d0/d3f/f57 2959356 0 2024-02-10T00:00:27.836 INFO:tasks.workunit.client.1.smithi183.stdout:7/375: dwrite d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:27.837 INFO:tasks.workunit.client.1.smithi183.stdout:6/338: truncate d2/d1a/d25/f36 899641 0 2024-02-10T00:00:27.840 INFO:tasks.workunit.client.1.smithi183.stdout:2/462: sync 2024-02-10T00:00:27.845 INFO:tasks.workunit.client.1.smithi183.stdout:5/485: rename d4/d1d to d4/d4b/d9e 0 2024-02-10T00:00:27.845 INFO:tasks.workunit.client.1.smithi183.stdout:4/399: rename de/d19 to de/d19/d20/d7a 22 2024-02-10T00:00:27.846 INFO:tasks.workunit.client.1.smithi183.stdout:1/354: link d0/d3/d67/d70/f7d d0/d3a/f83 0 2024-02-10T00:00:27.847 INFO:tasks.workunit.client.0.smithi164.stdout:2/27: symlink d3/l8 0 2024-02-10T00:00:27.848 INFO:tasks.workunit.client.1.smithi183.stdout:7/376: creat d0/f67 x:0 0 0 2024-02-10T00:00:27.849 INFO:tasks.workunit.client.1.smithi183.stdout:7/377: stat d0/d2/f41 0 2024-02-10T00:00:27.849 INFO:tasks.workunit.client.0.smithi164.stdout:8/36: mkdir d2 0 2024-02-10T00:00:27.849 INFO:tasks.workunit.client.0.smithi164.stdout:8/37: dwrite - no filename 2024-02-10T00:00:27.849 INFO:tasks.workunit.client.0.smithi164.stdout:8/38: dwrite - no filename 2024-02-10T00:00:27.850 INFO:tasks.workunit.client.1.smithi183.stdout:5/486: dwrite d4/d4b/d9e/d27/d37/d46/f6c [0,4194304] 0 2024-02-10T00:00:27.850 INFO:tasks.workunit.client.1.smithi183.stdout:7/378: chown d0/f44 18998 1 2024-02-10T00:00:27.854 INFO:tasks.workunit.client.1.smithi183.stdout:2/463: creat d2/d2c/d2f/d72/f97 x:0 0 0 2024-02-10T00:00:27.857 INFO:tasks.workunit.client.1.smithi183.stdout:5/487: dwrite d4/d4b/f60 [4194304,4194304] 0 2024-02-10T00:00:27.860 INFO:tasks.workunit.client.1.smithi183.stdout:4/400: dwrite de/d14/d4e/f65 [0,4194304] 0 2024-02-10T00:00:27.863 INFO:tasks.workunit.client.1.smithi183.stdout:6/339: unlink d2/d32/f5f 0 2024-02-10T00:00:27.863 INFO:tasks.workunit.client.1.smithi183.stdout:5/488: dwrite d4/d4b/d9e/f7c [0,4194304] 0 2024-02-10T00:00:27.864 INFO:tasks.workunit.client.0.smithi164.stdout:3/11: dwrite d0/f4 [4194304,4194304] 0 2024-02-10T00:00:27.866 INFO:tasks.workunit.client.1.smithi183.stdout:3/356: symlink d7/db/d2a/d2d/d51/l66 0 2024-02-10T00:00:27.867 INFO:tasks.workunit.client.0.smithi164.stdout:6/76: symlink d0/l15 0 2024-02-10T00:00:27.867 INFO:tasks.workunit.client.0.smithi164.stdout:3/12: dread d0/f4 [4194304,4194304] 0 2024-02-10T00:00:27.867 INFO:tasks.workunit.client.0.smithi164.stdout:6/77: dread - d0/d6/f10 zero size 2024-02-10T00:00:27.867 INFO:tasks.workunit.client.1.smithi183.stdout:0/361: sync 2024-02-10T00:00:27.868 INFO:tasks.workunit.client.1.smithi183.stdout:1/355: creat d0/d3/f84 x:0 0 0 2024-02-10T00:00:27.868 INFO:tasks.workunit.client.1.smithi183.stdout:4/401: dwrite de/f1f [0,4194304] 0 2024-02-10T00:00:27.869 INFO:tasks.workunit.client.1.smithi183.stdout:5/489: mkdir d4/d4b/d9e/d27/d37/d46/d9f 0 2024-02-10T00:00:27.870 INFO:tasks.workunit.client.1.smithi183.stdout:4/402: chown de/d14/d27/d40 33 1 2024-02-10T00:00:27.871 INFO:tasks.workunit.client.0.smithi164.stdout:4/33: symlink d2/l9 0 2024-02-10T00:00:27.872 INFO:tasks.workunit.client.0.smithi164.stdout:3/13: dwrite d0/f4 [0,4194304] 0 2024-02-10T00:00:27.872 INFO:tasks.workunit.client.0.smithi164.stdout:4/34: dread - d2/f8 zero size 2024-02-10T00:00:27.872 INFO:tasks.workunit.client.1.smithi183.stdout:6/340: dread d2/d32/f5c [0,4194304] 0 2024-02-10T00:00:27.872 INFO:tasks.workunit.client.1.smithi183.stdout:2/464: rename d2/da/d20/d21/l7f to d2/d2c/l98 0 2024-02-10T00:00:27.872 INFO:tasks.workunit.client.1.smithi183.stdout:6/341: stat d2/d32/l52 0 2024-02-10T00:00:27.873 INFO:tasks.workunit.client.0.smithi164.stdout:3/14: write d0/f4 [5149711,47098] 0 2024-02-10T00:00:27.873 INFO:tasks.workunit.client.1.smithi183.stdout:5/490: stat d4/d23/d4a/c22 0 2024-02-10T00:00:27.874 INFO:tasks.workunit.client.1.smithi183.stdout:4/403: rmdir de/d19/d1c 39 2024-02-10T00:00:27.875 INFO:tasks.workunit.client.0.smithi164.stdout:3/15: dread d0/f4 [4194304,4194304] 0 2024-02-10T00:00:27.876 INFO:tasks.workunit.client.0.smithi164.stdout:2/28: symlink d3/l9 0 2024-02-10T00:00:27.877 INFO:tasks.workunit.client.0.smithi164.stdout:8/39: rename l1 to d2/l3 0 2024-02-10T00:00:27.877 INFO:tasks.workunit.client.0.smithi164.stdout:8/40: write - no filename 2024-02-10T00:00:27.877 INFO:tasks.workunit.client.0.smithi164.stdout:8/41: write - no filename 2024-02-10T00:00:27.878 INFO:tasks.workunit.client.1.smithi183.stdout:2/465: dwrite d2/da/d77/f4f [0,4194304] 0 2024-02-10T00:00:27.881 INFO:tasks.workunit.client.1.smithi183.stdout:5/491: dwrite d4/d4b/f5c [0,4194304] 0 2024-02-10T00:00:27.882 INFO:tasks.workunit.client.1.smithi183.stdout:1/356: dwrite d0/d3/d7/f23 [0,4194304] 0 2024-02-10T00:00:27.883 INFO:tasks.workunit.client.0.smithi164.stdout:0/13: link f3 f5 0 2024-02-10T00:00:27.883 INFO:tasks.workunit.client.0.smithi164.stdout:1/32: link d1/f9 d1/da/fb 0 2024-02-10T00:00:27.884 INFO:tasks.workunit.client.1.smithi183.stdout:3/357: rename d7/db/d2a/d2d/d51/l62 to d7/db/d2a/d2d/l67 0 2024-02-10T00:00:27.887 INFO:tasks.workunit.client.0.smithi164.stdout:4/35: symlink d2/la 0 2024-02-10T00:00:27.889 INFO:tasks.workunit.client.1.smithi183.stdout:0/362: truncate d14/d1d/d2d/f79 602972 0 2024-02-10T00:00:27.890 INFO:tasks.workunit.client.1.smithi183.stdout:2/466: mkdir d2/d2c/d2f/d72/d7b/d99 0 2024-02-10T00:00:27.892 INFO:tasks.workunit.client.1.smithi183.stdout:5/492: unlink f3 0 2024-02-10T00:00:27.894 INFO:tasks.workunit.client.0.smithi164.stdout:3/16: mknod d0/d1/d2/c6 0 2024-02-10T00:00:27.894 INFO:tasks.workunit.client.0.smithi164.stdout:8/42: creat d2/f4 x:0 0 0 2024-02-10T00:00:27.894 INFO:tasks.workunit.client.1.smithi183.stdout:1/357: dread d0/d3/d29/d1f/f5c [0,4194304] 0 2024-02-10T00:00:27.896 INFO:tasks.workunit.client.1.smithi183.stdout:2/467: dwrite d2/da/d19/d31/d55/f5d [0,4194304] 0 2024-02-10T00:00:27.897 INFO:tasks.workunit.client.1.smithi183.stdout:4/404: truncate de/d19/d20/f6d 486141 0 2024-02-10T00:00:27.898 INFO:tasks.workunit.client.1.smithi183.stdout:8/457: sync 2024-02-10T00:00:27.898 INFO:tasks.workunit.client.1.smithi183.stdout:9/420: sync 2024-02-10T00:00:27.900 INFO:tasks.workunit.client.0.smithi164.stdout:8/43: mknod d2/c5 0 2024-02-10T00:00:27.900 INFO:tasks.workunit.client.1.smithi183.stdout:8/458: write d0/d27/f3a [2548681,58187] 0 2024-02-10T00:00:27.901 INFO:tasks.workunit.client.0.smithi164.stdout:2/29: link d3/l9 d3/la 0 2024-02-10T00:00:27.902 INFO:tasks.workunit.client.1.smithi183.stdout:8/459: dread - d0/d27/d75/f7e zero size 2024-02-10T00:00:27.902 INFO:tasks.workunit.client.0.smithi164.stdout:6/78: getdents d0/d6/d12 0 2024-02-10T00:00:27.903 INFO:tasks.workunit.client.0.smithi164.stdout:0/14: truncate f1 1008178 0 2024-02-10T00:00:27.904 INFO:tasks.workunit.client.0.smithi164.stdout:4/36: truncate d2/f8 726504 0 2024-02-10T00:00:27.905 INFO:tasks.workunit.client.1.smithi183.stdout:4/405: mkdir de/d14/d1d/d7b 0 2024-02-10T00:00:27.905 INFO:tasks.workunit.client.0.smithi164.stdout:0/15: write f0 [66388,56560] 0 2024-02-10T00:00:27.906 INFO:tasks.workunit.client.0.smithi164.stdout:3/17: dwrite d0/f4 [4194304,4194304] 0 2024-02-10T00:00:27.906 INFO:tasks.workunit.client.1.smithi183.stdout:9/421: creat d0/d10/f8d x:0 0 0 2024-02-10T00:00:27.907 INFO:tasks.workunit.client.1.smithi183.stdout:9/422: write d0/d10/f50 [622338,86573] 0 2024-02-10T00:00:27.909 INFO:tasks.workunit.client.0.smithi164.stdout:8/44: dwrite d2/f4 [0,4194304] 0 2024-02-10T00:00:27.909 INFO:tasks.workunit.client.0.smithi164.stdout:2/30: dread d3/f6 [0,4194304] 0 2024-02-10T00:00:27.910 INFO:tasks.workunit.client.0.smithi164.stdout:8/45: readlink l0 0 2024-02-10T00:00:27.910 INFO:tasks.workunit.client.1.smithi183.stdout:0/363: getdents d14/d1d/d2d/d31/d6c/d70 0 2024-02-10T00:00:27.911 INFO:tasks.workunit.client.0.smithi164.stdout:6/79: mknod d0/d6/d12/d14/c16 0 2024-02-10T00:00:27.911 INFO:tasks.workunit.client.1.smithi183.stdout:0/364: chown d14/d1d/d59/d71/c30 4963365 1 2024-02-10T00:00:27.912 INFO:tasks.workunit.client.0.smithi164.stdout:0/16: mkdir d6 0 2024-02-10T00:00:27.912 INFO:tasks.workunit.client.0.smithi164.stdout:4/37: creat d2/fb x:0 0 0 2024-02-10T00:00:27.912 INFO:tasks.workunit.client.0.smithi164.stdout:4/38: stat d2/c4 0 2024-02-10T00:00:27.913 INFO:tasks.workunit.client.1.smithi183.stdout:1/358: creat d0/d3/f85 x:0 0 0 2024-02-10T00:00:27.913 INFO:tasks.workunit.client.1.smithi183.stdout:5/493: read d4/d4b/d9e/d27/d37/d46/d4e/f62 [2268650,25609] 0 2024-02-10T00:00:27.914 INFO:tasks.workunit.client.0.smithi164.stdout:8/46: mknod d2/c6 0 2024-02-10T00:00:27.914 INFO:tasks.workunit.client.1.smithi183.stdout:8/460: rename d0/c2 to d0/c96 0 2024-02-10T00:00:27.915 INFO:tasks.workunit.client.0.smithi164.stdout:8/47: chown d2/f4 45965 1 2024-02-10T00:00:27.915 INFO:tasks.workunit.client.0.smithi164.stdout:8/48: chown l0 641667475 1 2024-02-10T00:00:27.915 INFO:tasks.workunit.client.0.smithi164.stdout:6/80: write d0/f5 [4776079,88135] 0 2024-02-10T00:00:27.915 INFO:tasks.workunit.client.1.smithi183.stdout:4/406: mknod de/d14/d1d/d7b/c7c 0 2024-02-10T00:00:27.916 INFO:tasks.workunit.client.1.smithi183.stdout:8/461: rename d0 to d0/d31/d97 22 2024-02-10T00:00:27.916 INFO:tasks.workunit.client.0.smithi164.stdout:4/39: mkdir d2/dc 0 2024-02-10T00:00:27.916 INFO:tasks.workunit.client.0.smithi164.stdout:2/31: chown d3/l9 78975697 1 2024-02-10T00:00:27.917 INFO:tasks.workunit.client.1.smithi183.stdout:3/358: dread d7/f9 [0,4194304] 0 2024-02-10T00:00:27.917 INFO:tasks.workunit.client.1.smithi183.stdout:1/359: dwrite d0/d3/d67/f61 [0,4194304] 0 2024-02-10T00:00:27.917 INFO:tasks.workunit.client.1.smithi183.stdout:9/423: rename d0/d3/d14/d1c/d2d/d4f/d79/l7a to d0/d3/d14/d1c/d2d/d4f/d79/l8e 0 2024-02-10T00:00:27.918 INFO:tasks.workunit.client.0.smithi164.stdout:0/17: mkdir d6/d7 0 2024-02-10T00:00:27.918 INFO:tasks.workunit.client.1.smithi183.stdout:0/365: mknod d14/d3e/d5f/c87 0 2024-02-10T00:00:27.918 INFO:tasks.workunit.client.1.smithi183.stdout:2/468: getdents d2/da/d20/d6d 0 2024-02-10T00:00:27.919 INFO:tasks.workunit.client.1.smithi183.stdout:1/360: chown d0/d3c 6487 1 2024-02-10T00:00:27.919 INFO:tasks.workunit.client.0.smithi164.stdout:2/32: symlink d3/lb 0 2024-02-10T00:00:27.919 INFO:tasks.workunit.client.0.smithi164.stdout:8/49: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:27.920 INFO:tasks.workunit.client.0.smithi164.stdout:4/40: getdents d2/dc 0 2024-02-10T00:00:27.920 INFO:tasks.workunit.client.0.smithi164.stdout:6/81: dread d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:27.920 INFO:tasks.workunit.client.1.smithi183.stdout:5/494: mkdir d4/d4b/d9c/d72/da0 0 2024-02-10T00:00:27.921 INFO:tasks.workunit.client.0.smithi164.stdout:8/50: creat d2/f7 x:0 0 0 2024-02-10T00:00:27.921 INFO:tasks.workunit.client.1.smithi183.stdout:2/469: fdatasync d2/da/d20/d21/d36/f6e 0 2024-02-10T00:00:27.921 INFO:tasks.workunit.client.0.smithi164.stdout:4/41: read f1 [817771,55416] 0 2024-02-10T00:00:27.924 INFO:tasks.workunit.client.1.smithi183.stdout:1/361: mkdir d0/d3/d29/d1f/d86 0 2024-02-10T00:00:27.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/42: symlink d2/dc/ld 0 2024-02-10T00:00:27.926 INFO:tasks.workunit.client.1.smithi183.stdout:3/359: dwrite d7/f48 [0,4194304] 0 2024-02-10T00:00:27.926 INFO:tasks.workunit.client.1.smithi183.stdout:4/407: dwrite de/d19/d20/f5d [0,4194304] 0 2024-02-10T00:00:27.927 INFO:tasks.workunit.client.1.smithi183.stdout:9/424: symlink d0/d3/d14/l8f 0 2024-02-10T00:00:27.929 INFO:tasks.workunit.client.1.smithi183.stdout:9/425: read - d0/d3/f4e zero size 2024-02-10T00:00:27.929 INFO:tasks.workunit.client.1.smithi183.stdout:0/366: dwrite d14/d7a/f62 [0,4194304] 0 2024-02-10T00:00:27.931 INFO:tasks.workunit.client.1.smithi183.stdout:8/462: getdents d0/d27/d36 0 2024-02-10T00:00:27.932 INFO:tasks.workunit.client.1.smithi183.stdout:7/379: write d0/f30 [573174,43356] 0 2024-02-10T00:00:27.933 INFO:tasks.workunit.client.1.smithi183.stdout:7/380: chown d0/d2/d3/l39 952559653 1 2024-02-10T00:00:27.935 INFO:tasks.workunit.client.1.smithi183.stdout:0/367: dwrite d14/f20 [0,4194304] 0 2024-02-10T00:00:27.938 INFO:tasks.workunit.client.1.smithi183.stdout:4/408: dread de/d19/f30 [0,4194304] 0 2024-02-10T00:00:27.939 INFO:tasks.workunit.client.1.smithi183.stdout:9/426: mkdir d0/d3/d14/d74/d90 0 2024-02-10T00:00:27.940 INFO:tasks.workunit.client.1.smithi183.stdout:7/381: mknod d0/d11/d2f/c68 0 2024-02-10T00:00:27.940 INFO:tasks.workunit.client.1.smithi183.stdout:7/382: fsync d0/f53 0 2024-02-10T00:00:27.943 INFO:tasks.workunit.client.1.smithi183.stdout:9/427: symlink d0/d3/d14/d3c/d7b/l91 0 2024-02-10T00:00:27.943 INFO:tasks.workunit.client.1.smithi183.stdout:7/383: fsync d0/d2/f2b 0 2024-02-10T00:00:27.947 INFO:tasks.workunit.client.1.smithi183.stdout:7/384: dwrite d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:27.956 INFO:tasks.workunit.client.1.smithi183.stdout:7/385: dread d0/d2/d3/f20 [4194304,4194304] 0 2024-02-10T00:00:27.959 INFO:tasks.workunit.client.1.smithi183.stdout:1/362: dread d0/d3/d29/d38/f3b [0,4194304] 0 2024-02-10T00:00:27.961 INFO:tasks.workunit.client.1.smithi183.stdout:7/386: dwrite d0/d2/d4/d8/f4d [0,4194304] 0 2024-02-10T00:00:27.961 INFO:tasks.workunit.client.1.smithi183.stdout:1/363: mknod d0/d3a/c87 0 2024-02-10T00:00:27.962 INFO:tasks.workunit.client.1.smithi183.stdout:7/387: write d0/d2/f26 [475438,24560] 0 2024-02-10T00:00:27.970 INFO:tasks.workunit.client.1.smithi183.stdout:1/364: creat d0/d3/f88 x:0 0 0 2024-02-10T00:00:27.975 INFO:tasks.workunit.client.1.smithi183.stdout:1/365: dwrite d0/d3/f2d [0,4194304] 0 2024-02-10T00:00:27.977 INFO:tasks.workunit.client.1.smithi183.stdout:1/366: mkdir d0/d3/d7/d3d/d60/d89 0 2024-02-10T00:00:27.986 INFO:tasks.workunit.client.0.smithi164.stdout:2/33: sync 2024-02-10T00:00:27.986 INFO:tasks.workunit.client.0.smithi164.stdout:6/82: sync 2024-02-10T00:00:27.987 INFO:tasks.workunit.client.0.smithi164.stdout:6/83: write d0/d6/f10 [625375,4333] 0 2024-02-10T00:00:27.988 INFO:tasks.workunit.client.0.smithi164.stdout:2/34: mknod d3/cc 0 2024-02-10T00:00:27.992 INFO:tasks.workunit.client.0.smithi164.stdout:6/84: creat d0/f17 x:0 0 0 2024-02-10T00:00:27.992 INFO:tasks.workunit.client.0.smithi164.stdout:6/85: creat d0/d6/d12/f18 x:0 0 0 2024-02-10T00:00:27.992 INFO:tasks.workunit.client.0.smithi164.stdout:6/86: chown d0 1287046 1 2024-02-10T00:00:27.993 INFO:tasks.workunit.client.0.smithi164.stdout:2/35: dwrite f0 [4194304,4194304] 0 2024-02-10T00:00:27.994 INFO:tasks.workunit.client.0.smithi164.stdout:2/36: fdatasync d3/f7 0 2024-02-10T00:00:27.997 INFO:tasks.workunit.client.0.smithi164.stdout:6/87: link d0/fb d0/d6/d12/d14/f19 0 2024-02-10T00:00:27.998 INFO:tasks.workunit.client.0.smithi164.stdout:6/88: write d0/d6/f13 [104861,102076] 0 2024-02-10T00:00:27.999 INFO:tasks.workunit.client.0.smithi164.stdout:6/89: creat d0/f1a x:0 0 0 2024-02-10T00:00:28.003 INFO:tasks.workunit.client.0.smithi164.stdout:6/90: link d0/f17 d0/d6/d12/f1b 0 2024-02-10T00:00:28.003 INFO:tasks.workunit.client.0.smithi164.stdout:6/91: chown d0/lf 20390 1 2024-02-10T00:00:28.006 INFO:tasks.workunit.client.0.smithi164.stdout:6/92: dread d0/fb [0,4194304] 0 2024-02-10T00:00:28.007 INFO:tasks.workunit.client.0.smithi164.stdout:6/93: creat d0/d6/f1c x:0 0 0 2024-02-10T00:00:28.008 INFO:tasks.workunit.client.0.smithi164.stdout:6/94: read d0/d6/d12/d14/f19 [3954872,60821] 0 2024-02-10T00:00:28.008 INFO:tasks.workunit.client.1.smithi183.stdout:9/428: sync 2024-02-10T00:00:28.009 INFO:tasks.workunit.client.0.smithi164.stdout:6/95: symlink d0/d6/d12/d14/l1d 0 2024-02-10T00:00:28.012 INFO:tasks.workunit.client.0.smithi164.stdout:6/96: rename d0/d6/d12/f1b to d0/d6/d12/d14/f1e 0 2024-02-10T00:00:28.013 INFO:tasks.workunit.client.0.smithi164.stdout:6/97: creat d0/d6/d12/f1f x:0 0 0 2024-02-10T00:00:28.016 INFO:tasks.workunit.client.0.smithi164.stdout:6/98: mknod d0/d6/d12/c20 0 2024-02-10T00:00:28.016 INFO:tasks.workunit.client.0.smithi164.stdout:6/99: stat d0/f5 0 2024-02-10T00:00:28.026 INFO:tasks.workunit.client.0.smithi164.stdout:7/80: truncate d3/f13 3088618 0 2024-02-10T00:00:28.027 INFO:tasks.workunit.client.1.smithi183.stdout:8/463: dread d0/d23/d2d/d24/f28 [0,4194304] 0 2024-02-10T00:00:28.027 INFO:tasks.workunit.client.0.smithi164.stdout:3/18: dwrite d0/f4 [8388608,4194304] 0 2024-02-10T00:00:28.030 INFO:tasks.workunit.client.0.smithi164.stdout:9/81: truncate d6/f7 1256231 0 2024-02-10T00:00:28.030 INFO:tasks.workunit.client.1.smithi183.stdout:8/464: rename d0/d4e/d53/c77 to d0/d27/c98 0 2024-02-10T00:00:28.031 INFO:tasks.workunit.client.0.smithi164.stdout:7/81: symlink d3/d5/l19 0 2024-02-10T00:00:28.032 INFO:tasks.workunit.client.1.smithi183.stdout:8/465: truncate d0/f1e 3618422 0 2024-02-10T00:00:28.034 INFO:tasks.workunit.client.1.smithi183.stdout:0/368: dread f6 [0,4194304] 0 2024-02-10T00:00:28.035 INFO:tasks.workunit.client.0.smithi164.stdout:7/82: unlink d3/d5/f17 0 2024-02-10T00:00:28.035 INFO:tasks.workunit.client.1.smithi183.stdout:8/466: unlink d0/d23/f2b 0 2024-02-10T00:00:28.036 INFO:tasks.workunit.client.0.smithi164.stdout:3/19: link d0/f4 d0/d1/d2/f7 0 2024-02-10T00:00:28.036 INFO:tasks.workunit.client.0.smithi164.stdout:2/37: sync 2024-02-10T00:00:28.037 INFO:tasks.workunit.client.0.smithi164.stdout:3/20: write d0/f4 [12368907,114305] 0 2024-02-10T00:00:28.038 INFO:tasks.workunit.client.0.smithi164.stdout:7/83: dread d3/d5/f7 [0,4194304] 0 2024-02-10T00:00:28.038 INFO:tasks.workunit.client.0.smithi164.stdout:7/84: rename d3 to d3/d11/d1a 22 2024-02-10T00:00:28.041 INFO:tasks.workunit.client.1.smithi183.stdout:8/467: unlink d0/d27/d36/f40 0 2024-02-10T00:00:28.041 INFO:tasks.workunit.client.1.smithi183.stdout:8/468: chown d0/d27 50 1 2024-02-10T00:00:28.042 INFO:tasks.workunit.client.0.smithi164.stdout:7/85: mknod d3/d11/c1b 0 2024-02-10T00:00:28.042 INFO:tasks.workunit.client.0.smithi164.stdout:7/86: chown d3/f16 250720837 1 2024-02-10T00:00:28.043 INFO:tasks.workunit.client.0.smithi164.stdout:3/21: getdents d0 0 2024-02-10T00:00:28.044 INFO:tasks.workunit.client.1.smithi183.stdout:8/469: creat d0/d27/d75/d5b/f99 x:0 0 0 2024-02-10T00:00:28.044 INFO:tasks.workunit.client.0.smithi164.stdout:3/22: mknod d0/d1/c8 0 2024-02-10T00:00:28.045 INFO:tasks.workunit.client.1.smithi183.stdout:5/495: dread f2 [4194304,4194304] 0 2024-02-10T00:00:28.046 INFO:tasks.workunit.client.0.smithi164.stdout:3/23: unlink d0/l5 0 2024-02-10T00:00:28.047 INFO:tasks.workunit.client.1.smithi183.stdout:8/470: rename d0/d4e/c93 to d0/d27/d36/c9a 0 2024-02-10T00:00:28.048 INFO:tasks.workunit.client.1.smithi183.stdout:5/496: fdatasync d4/d23/d4a/f53 0 2024-02-10T00:00:28.053 INFO:tasks.workunit.client.0.smithi164.stdout:5/74: truncate f0 2098292 0 2024-02-10T00:00:28.055 INFO:tasks.workunit.client.0.smithi164.stdout:6/100: fdatasync d0/f5 0 2024-02-10T00:00:28.056 INFO:tasks.workunit.client.0.smithi164.stdout:6/101: chown d0/d6/f13 8129350 1 2024-02-10T00:00:28.057 INFO:tasks.workunit.client.1.smithi183.stdout:6/342: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:28.057 INFO:tasks.workunit.client.0.smithi164.stdout:6/102: chown d0/d6/f8 147584 1 2024-02-10T00:00:28.060 INFO:tasks.workunit.client.0.smithi164.stdout:8/51: write d2/f4 [4372313,108908] 0 2024-02-10T00:00:28.060 INFO:tasks.workunit.client.0.smithi164.stdout:8/52: stat d2/c6 0 2024-02-10T00:00:28.060 INFO:tasks.workunit.client.1.smithi183.stdout:1/367: fdatasync d0/d3/d67/f61 0 2024-02-10T00:00:28.062 INFO:tasks.workunit.client.0.smithi164.stdout:0/18: getdents d6 0 2024-02-10T00:00:28.064 INFO:tasks.workunit.client.1.smithi183.stdout:9/429: rmdir d0/d3/d14/d1c/d2d/d4f/d79 39 2024-02-10T00:00:28.064 INFO:tasks.workunit.client.0.smithi164.stdout:0/19: dread f3 [0,4194304] 0 2024-02-10T00:00:28.064 INFO:tasks.workunit.client.0.smithi164.stdout:1/33: link d1/f4 d1/da/fc 0 2024-02-10T00:00:28.065 INFO:tasks.workunit.client.0.smithi164.stdout:0/20: write f0 [977858,17841] 0 2024-02-10T00:00:28.067 INFO:tasks.workunit.client.0.smithi164.stdout:2/38: getdents d3 0 2024-02-10T00:00:28.068 INFO:tasks.workunit.client.1.smithi183.stdout:3/360: dread d7/db/d2a/f3a [0,4194304] 0 2024-02-10T00:00:28.069 INFO:tasks.workunit.client.1.smithi183.stdout:2/470: truncate d2/da/d77/f4f 3565297 0 2024-02-10T00:00:28.070 INFO:tasks.workunit.client.1.smithi183.stdout:2/471: write d2/da/f25 [2249890,27046] 0 2024-02-10T00:00:28.071 INFO:tasks.workunit.client.1.smithi183.stdout:8/471: dread d0/d23/d2d/d24/f59 [0,4194304] 0 2024-02-10T00:00:28.071 INFO:tasks.workunit.client.1.smithi183.stdout:8/472: fdatasync d0/d27/f3a 0 2024-02-10T00:00:28.072 INFO:tasks.workunit.client.1.smithi183.stdout:4/409: write de/d14/d27/f1b [1490033,67928] 0 2024-02-10T00:00:28.073 INFO:tasks.workunit.client.1.smithi183.stdout:7/388: write d0/d11/f1c [4192656,104123] 0 2024-02-10T00:00:28.076 INFO:tasks.workunit.client.1.smithi183.stdout:8/473: dwrite d0/d45/f66 [0,4194304] 0 2024-02-10T00:00:28.078 INFO:tasks.workunit.client.1.smithi183.stdout:5/497: rename d4/d4b to d4/d23/d3e/d80/da1 0 2024-02-10T00:00:28.079 INFO:tasks.workunit.client.0.smithi164.stdout:9/82: rmdir d6 39 2024-02-10T00:00:28.081 INFO:tasks.workunit.client.0.smithi164.stdout:8/53: mknod d2/c8 0 2024-02-10T00:00:28.081 INFO:tasks.workunit.client.0.smithi164.stdout:8/54: dread - d2/f7 zero size 2024-02-10T00:00:28.085 INFO:tasks.workunit.client.1.smithi183.stdout:0/369: dwrite d14/d1d/d59/d71/d22/f4f [0,4194304] 0 2024-02-10T00:00:28.086 INFO:tasks.workunit.client.0.smithi164.stdout:7/87: getdents d3/d11 0 2024-02-10T00:00:28.087 INFO:tasks.workunit.client.0.smithi164.stdout:8/55: dread d2/f4 [4194304,4194304] 0 2024-02-10T00:00:28.087 INFO:tasks.workunit.client.0.smithi164.stdout:8/56: chown d2/f7 658878 1 2024-02-10T00:00:28.090 INFO:tasks.workunit.client.0.smithi164.stdout:4/43: truncate d2/f8 840247 0 2024-02-10T00:00:28.091 INFO:tasks.workunit.client.0.smithi164.stdout:4/44: readlink d2/dc/ld 0 2024-02-10T00:00:28.091 INFO:tasks.workunit.client.1.smithi183.stdout:4/410: stat de/d19/d1c/d61/c79 0 2024-02-10T00:00:28.091 INFO:tasks.workunit.client.0.smithi164.stdout:1/34: rmdir d1/da 39 2024-02-10T00:00:28.092 INFO:tasks.workunit.client.0.smithi164.stdout:1/35: fdatasync d1/f7 0 2024-02-10T00:00:28.093 INFO:tasks.workunit.client.1.smithi183.stdout:7/389: rmdir d0/d2 39 2024-02-10T00:00:28.094 INFO:tasks.workunit.client.0.smithi164.stdout:2/39: creat d3/fd x:0 0 0 2024-02-10T00:00:28.095 INFO:tasks.workunit.client.0.smithi164.stdout:2/40: dread - d3/f7 zero size 2024-02-10T00:00:28.096 INFO:tasks.workunit.client.1.smithi183.stdout:8/474: unlink d0/d27/d75/d5b/c71 0 2024-02-10T00:00:28.097 INFO:tasks.workunit.client.0.smithi164.stdout:7/88: unlink d3/f15 0 2024-02-10T00:00:28.098 INFO:tasks.workunit.client.0.smithi164.stdout:7/89: dread - d3/d5/fe zero size 2024-02-10T00:00:28.098 INFO:tasks.workunit.client.0.smithi164.stdout:8/57: symlink d2/l9 0 2024-02-10T00:00:28.101 INFO:tasks.workunit.client.1.smithi183.stdout:0/370: mknod d14/d1d/d55/c88 0 2024-02-10T00:00:28.102 INFO:tasks.workunit.client.0.smithi164.stdout:4/45: mknod d2/ce 0 2024-02-10T00:00:28.102 INFO:tasks.workunit.client.1.smithi183.stdout:9/430: mkdir d0/d92 0 2024-02-10T00:00:28.102 INFO:tasks.workunit.client.0.smithi164.stdout:9/83: creat d6/f18 x:0 0 0 2024-02-10T00:00:28.103 INFO:tasks.workunit.client.0.smithi164.stdout:7/90: dread d3/d5/fb [4194304,4194304] 0 2024-02-10T00:00:28.103 INFO:tasks.workunit.client.0.smithi164.stdout:2/41: creat d3/fe x:0 0 0 2024-02-10T00:00:28.103 INFO:tasks.workunit.client.1.smithi183.stdout:4/411: write de/f3c [1653845,44974] 0 2024-02-10T00:00:28.104 INFO:tasks.workunit.client.0.smithi164.stdout:4/46: write d2/fb [967008,105737] 0 2024-02-10T00:00:28.104 INFO:tasks.workunit.client.1.smithi183.stdout:3/361: dread d7/db/d2a/f2b [0,4194304] 0 2024-02-10T00:00:28.105 INFO:tasks.workunit.client.1.smithi183.stdout:4/412: write de/d14/d27/f1b [1589817,95570] 0 2024-02-10T00:00:28.105 INFO:tasks.workunit.client.1.smithi183.stdout:2/472: write d2/da/d19/d31/f47 [1374272,90377] 0 2024-02-10T00:00:28.105 INFO:tasks.workunit.client.1.smithi183.stdout:3/362: chown d7/db/d2a/f65 6913 1 2024-02-10T00:00:28.106 INFO:tasks.workunit.client.0.smithi164.stdout:8/58: creat d2/fa x:0 0 0 2024-02-10T00:00:28.106 INFO:tasks.workunit.client.0.smithi164.stdout:2/42: dread f0 [0,4194304] 0 2024-02-10T00:00:28.108 INFO:tasks.workunit.client.0.smithi164.stdout:9/84: mkdir d6/d19 0 2024-02-10T00:00:28.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/91: symlink d3/d5/l1c 0 2024-02-10T00:00:28.109 INFO:tasks.workunit.client.1.smithi183.stdout:7/390: dwrite d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:28.111 INFO:tasks.workunit.client.0.smithi164.stdout:4/47: rename d2/l9 to d2/dc/lf 0 2024-02-10T00:00:28.112 INFO:tasks.workunit.client.0.smithi164.stdout:1/36: creat d1/fd x:0 0 0 2024-02-10T00:00:28.113 INFO:tasks.workunit.client.0.smithi164.stdout:1/37: chown d1/f9 499 1 2024-02-10T00:00:28.113 INFO:tasks.workunit.client.0.smithi164.stdout:2/43: mknod d3/cf 0 2024-02-10T00:00:28.113 INFO:tasks.workunit.client.1.smithi183.stdout:2/473: dwrite d2/da/d20/d21/d43/f65 [0,4194304] 0 2024-02-10T00:00:28.113 INFO:tasks.workunit.client.0.smithi164.stdout:1/38: write d1/f7 [99430,59249] 0 2024-02-10T00:00:28.114 INFO:tasks.workunit.client.1.smithi183.stdout:8/475: write d0/d23/f26 [4534975,21829] 0 2024-02-10T00:00:28.114 INFO:tasks.workunit.client.0.smithi164.stdout:9/85: creat d6/f1a x:0 0 0 2024-02-10T00:00:28.115 INFO:tasks.workunit.client.0.smithi164.stdout:9/86: dread - d6/f18 zero size 2024-02-10T00:00:28.115 INFO:tasks.workunit.client.1.smithi183.stdout:2/474: fdatasync d2/da/fb 0 2024-02-10T00:00:28.116 INFO:tasks.workunit.client.1.smithi183.stdout:7/391: dwrite d0/d11/d2f/f66 [0,4194304] 0 2024-02-10T00:00:28.116 INFO:tasks.workunit.client.0.smithi164.stdout:8/59: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:28.117 INFO:tasks.workunit.client.1.smithi183.stdout:2/475: read d2/da/f1d [3002283,107623] 0 2024-02-10T00:00:28.118 INFO:tasks.workunit.client.0.smithi164.stdout:4/48: truncate f1 2211313 0 2024-02-10T00:00:28.118 INFO:tasks.workunit.client.0.smithi164.stdout:0/21: truncate f3 3540115 0 2024-02-10T00:00:28.118 INFO:tasks.workunit.client.1.smithi183.stdout:0/371: symlink d14/d1d/d55/l89 0 2024-02-10T00:00:28.121 INFO:tasks.workunit.client.0.smithi164.stdout:5/75: write f0 [148400,116732] 0 2024-02-10T00:00:28.122 INFO:tasks.workunit.client.0.smithi164.stdout:5/76: read f5 [1406575,61736] 0 2024-02-10T00:00:28.123 INFO:tasks.workunit.client.1.smithi183.stdout:5/498: link d4/d23/d3e/d80/da1/d9e/d27/c55 d4/d23/d3e/d80/da1/d9c/d72/ca2 0 2024-02-10T00:00:28.125 INFO:tasks.workunit.client.0.smithi164.stdout:4/49: dread d2/fb [0,4194304] 0 2024-02-10T00:00:28.125 INFO:tasks.workunit.client.1.smithi183.stdout:8/476: mkdir d0/d27/d36/d9b 0 2024-02-10T00:00:28.126 INFO:tasks.workunit.client.0.smithi164.stdout:2/44: rename d3/l8 to d3/l10 0 2024-02-10T00:00:28.126 INFO:tasks.workunit.client.1.smithi183.stdout:8/477: dread - d0/d27/f8b zero size 2024-02-10T00:00:28.127 INFO:tasks.workunit.client.1.smithi183.stdout:2/476: rmdir d2/da/d19/d31 39 2024-02-10T00:00:28.129 INFO:tasks.workunit.client.0.smithi164.stdout:0/22: creat d6/f8 x:0 0 0 2024-02-10T00:00:28.130 INFO:tasks.workunit.client.1.smithi183.stdout:1/368: rename d0/d3/d7/f32 to d0/f8a 0 2024-02-10T00:00:28.131 INFO:tasks.workunit.client.1.smithi183.stdout:7/392: rmdir d0/d2/d50/d5d 39 2024-02-10T00:00:28.131 INFO:tasks.workunit.client.1.smithi183.stdout:8/478: dwrite d0/d10/f5e [0,4194304] 0 2024-02-10T00:00:28.132 INFO:tasks.workunit.client.0.smithi164.stdout:4/50: symlink d2/dc/l10 0 2024-02-10T00:00:28.133 INFO:tasks.workunit.client.0.smithi164.stdout:2/45: creat d3/f11 x:0 0 0 2024-02-10T00:00:28.133 INFO:tasks.workunit.client.0.smithi164.stdout:7/92: creat d3/f1d x:0 0 0 2024-02-10T00:00:28.134 INFO:tasks.workunit.client.0.smithi164.stdout:1/39: rename d1/da/fc to d1/da/fe 0 2024-02-10T00:00:28.135 INFO:tasks.workunit.client.1.smithi183.stdout:2/477: dwrite d2/da/d20/f37 [0,4194304] 0 2024-02-10T00:00:28.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/369: mknod d0/d3c/c8b 0 2024-02-10T00:00:28.137 INFO:tasks.workunit.client.0.smithi164.stdout:5/77: fdatasync d7/fc 0 2024-02-10T00:00:28.137 INFO:tasks.workunit.client.0.smithi164.stdout:3/24: sync 2024-02-10T00:00:28.137 INFO:tasks.workunit.client.1.smithi183.stdout:9/431: rename d0/d30/c3f to d0/d3/d14/d1c/d2d/d4f/d79/c93 0 2024-02-10T00:00:28.138 INFO:tasks.workunit.client.1.smithi183.stdout:5/499: rmdir d4/d23/d3e/d80/da1/d9e/d27/d38/d4f 39 2024-02-10T00:00:28.139 INFO:tasks.workunit.client.0.smithi164.stdout:2/46: creat d3/f12 x:0 0 0 2024-02-10T00:00:28.139 INFO:tasks.workunit.client.1.smithi183.stdout:5/500: chown d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d 251 1 2024-02-10T00:00:28.139 INFO:tasks.workunit.client.1.smithi183.stdout:8/479: unlink d0/d45/c4a 0 2024-02-10T00:00:28.140 INFO:tasks.workunit.client.0.smithi164.stdout:7/93: truncate d3/f4 6176806 0 2024-02-10T00:00:28.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/370: write d0/d3/d29/d1f/f5c [2454465,36885] 0 2024-02-10T00:00:28.141 INFO:tasks.workunit.client.0.smithi164.stdout:5/78: dwrite d7/fd [4194304,4194304] 0 2024-02-10T00:00:28.142 INFO:tasks.workunit.client.1.smithi183.stdout:1/371: write d0/d3a/f7a [699679,36442] 0 2024-02-10T00:00:28.142 INFO:tasks.workunit.client.1.smithi183.stdout:7/393: rename d0/f30 to d0/d11/d2f/d64/f69 0 2024-02-10T00:00:28.143 INFO:tasks.workunit.client.1.smithi183.stdout:9/432: mkdir d0/d30/d94 0 2024-02-10T00:00:28.144 INFO:tasks.workunit.client.1.smithi183.stdout:1/372: stat d0/d3/lb 0 2024-02-10T00:00:28.145 INFO:tasks.workunit.client.1.smithi183.stdout:1/373: dread - d0/d3/f85 zero size 2024-02-10T00:00:28.145 INFO:tasks.workunit.client.1.smithi183.stdout:5/501: chown d4/dd/d31/l82 5754039 1 2024-02-10T00:00:28.146 INFO:tasks.workunit.client.1.smithi183.stdout:8/480: dwrite d0/d27/d75/d5b/f99 [0,4194304] 0 2024-02-10T00:00:28.146 INFO:tasks.workunit.client.1.smithi183.stdout:2/478: symlink d2/da/d19/d31/l9a 0 2024-02-10T00:00:28.147 INFO:tasks.workunit.client.1.smithi183.stdout:5/502: fdatasync d4/d23/f94 0 2024-02-10T00:00:28.147 INFO:tasks.workunit.client.0.smithi164.stdout:7/94: creat d3/f1e x:0 0 0 2024-02-10T00:00:28.147 INFO:tasks.workunit.client.0.smithi164.stdout:7/95: readlink d3/l10 0 2024-02-10T00:00:28.149 INFO:tasks.workunit.client.0.smithi164.stdout:5/79: dread f0 [0,4194304] 0 2024-02-10T00:00:28.150 INFO:tasks.workunit.client.0.smithi164.stdout:7/96: rename d3/cd to d3/d11/c1f 0 2024-02-10T00:00:28.151 INFO:tasks.workunit.client.1.smithi183.stdout:7/394: dwrite d0/f44 [0,4194304] 0 2024-02-10T00:00:28.151 INFO:tasks.workunit.client.1.smithi183.stdout:5/503: write d4/d23/d3e/d80/da1/d9e/d27/d37/f51 [184970,117620] 0 2024-02-10T00:00:28.151 INFO:tasks.workunit.client.1.smithi183.stdout:6/343: write d2/f65 [860803,108044] 0 2024-02-10T00:00:28.152 INFO:tasks.workunit.client.0.smithi164.stdout:7/97: symlink d3/d5/l20 0 2024-02-10T00:00:28.153 INFO:tasks.workunit.client.1.smithi183.stdout:4/413: write de/d22/f43 [4276255,1053] 0 2024-02-10T00:00:28.153 INFO:tasks.workunit.client.0.smithi164.stdout:7/98: dread - d3/d5/fe zero size 2024-02-10T00:00:28.153 INFO:tasks.workunit.client.0.smithi164.stdout:7/99: write d3/d5/f7 [560798,107843] 0 2024-02-10T00:00:28.154 INFO:tasks.workunit.client.0.smithi164.stdout:7/100: readlink d3/d5/l8 0 2024-02-10T00:00:28.154 INFO:tasks.workunit.client.1.smithi183.stdout:8/481: symlink d0/d27/d36/l9c 0 2024-02-10T00:00:28.155 INFO:tasks.workunit.client.1.smithi183.stdout:2/479: mkdir d2/da/d19/d31/d9b 0 2024-02-10T00:00:28.156 INFO:tasks.workunit.client.1.smithi183.stdout:3/363: dwrite d7/db/d2a/d2d/f2f [0,4194304] 0 2024-02-10T00:00:28.157 INFO:tasks.workunit.client.1.smithi183.stdout:0/372: sync 2024-02-10T00:00:28.162 INFO:tasks.workunit.client.1.smithi183.stdout:5/504: dwrite d4/dd/f1b [0,4194304] 0 2024-02-10T00:00:28.162 INFO:tasks.workunit.client.1.smithi183.stdout:4/414: mknod de/d19/d20/c7d 0 2024-02-10T00:00:28.163 INFO:tasks.workunit.client.1.smithi183.stdout:7/395: creat d0/d11/d3e/f6a x:0 0 0 2024-02-10T00:00:28.164 INFO:tasks.workunit.client.1.smithi183.stdout:6/344: unlink d2/d1a/d3a/d45/c51 0 2024-02-10T00:00:28.167 INFO:tasks.workunit.client.1.smithi183.stdout:7/396: dwrite d0/f53 [0,4194304] 0 2024-02-10T00:00:28.168 INFO:tasks.workunit.client.1.smithi183.stdout:3/364: mknod d7/db/c68 0 2024-02-10T00:00:28.171 INFO:tasks.workunit.client.1.smithi183.stdout:5/505: unlink d4/d23/d3e/d80/da1/d9e/d27/d37/f51 0 2024-02-10T00:00:28.173 INFO:tasks.workunit.client.1.smithi183.stdout:5/506: read - d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/f7b zero size 2024-02-10T00:00:28.174 INFO:tasks.workunit.client.1.smithi183.stdout:6/345: write d2/f16 [4086833,98409] 0 2024-02-10T00:00:28.175 INFO:tasks.workunit.client.1.smithi183.stdout:8/482: truncate d0/d23/f95 202796 0 2024-02-10T00:00:28.176 INFO:tasks.workunit.client.1.smithi183.stdout:4/415: dwrite de/d19/d1c/f39 [0,4194304] 0 2024-02-10T00:00:28.178 INFO:tasks.workunit.client.1.smithi183.stdout:4/416: chown de/d14/d1d/c6c 2200380 1 2024-02-10T00:00:28.178 INFO:tasks.workunit.client.1.smithi183.stdout:4/417: chown de/d14/d4e/f65 2094 1 2024-02-10T00:00:28.179 INFO:tasks.workunit.client.1.smithi183.stdout:6/346: unlink d2/d1a/l4e 0 2024-02-10T00:00:28.182 INFO:tasks.workunit.client.1.smithi183.stdout:8/483: symlink d0/d27/d36/l9d 0 2024-02-10T00:00:28.182 INFO:tasks.workunit.client.1.smithi183.stdout:8/484: stat d0/d27/l29 0 2024-02-10T00:00:28.184 INFO:tasks.workunit.client.1.smithi183.stdout:4/418: mknod de/d14/d4e/c7e 0 2024-02-10T00:00:28.185 INFO:tasks.workunit.client.1.smithi183.stdout:5/507: link d4/d23/d3e/f76 d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fa3 0 2024-02-10T00:00:28.192 INFO:tasks.workunit.client.0.smithi164.stdout:6/103: sync 2024-02-10T00:00:28.211 INFO:tasks.workunit.client.0.smithi164.stdout:4/51: dread f1 [0,4194304] 0 2024-02-10T00:00:28.211 INFO:tasks.workunit.client.1.smithi183.stdout:1/374: rename d0/d3c/l77 to d0/d3/d7/d36/l8c 0 2024-02-10T00:00:28.212 INFO:tasks.workunit.client.1.smithi183.stdout:1/375: write d0/d3/f88 [914315,56036] 0 2024-02-10T00:00:28.213 INFO:tasks.workunit.client.1.smithi183.stdout:1/376: fsync d0/d3c/f73 0 2024-02-10T00:00:28.217 INFO:tasks.workunit.client.0.smithi164.stdout:0/23: truncate f0 672588 0 2024-02-10T00:00:28.217 INFO:tasks.workunit.client.0.smithi164.stdout:0/24: readlink l2 0 2024-02-10T00:00:28.218 INFO:tasks.workunit.client.1.smithi183.stdout:3/365: dread d7/db/d2a/d33/f36 [0,4194304] 0 2024-02-10T00:00:28.219 INFO:tasks.workunit.client.0.smithi164.stdout:0/25: write d6/f8 [710210,65084] 0 2024-02-10T00:00:28.219 INFO:tasks.workunit.client.0.smithi164.stdout:9/87: dwrite d6/f7 [0,4194304] 0 2024-02-10T00:00:28.220 INFO:tasks.workunit.client.1.smithi183.stdout:8/485: dread d0/d27/f68 [0,4194304] 0 2024-02-10T00:00:28.220 INFO:tasks.workunit.client.1.smithi183.stdout:1/377: rename d0/d3/d7/d36/f65 to d0/d3/d7/f8d 0 2024-02-10T00:00:28.221 INFO:tasks.workunit.client.0.smithi164.stdout:4/52: creat d2/dc/f11 x:0 0 0 2024-02-10T00:00:28.221 INFO:tasks.workunit.client.0.smithi164.stdout:9/88: stat d6/de/f11 0 2024-02-10T00:00:28.221 INFO:tasks.workunit.client.0.smithi164.stdout:2/47: rename d3/l10 to d3/l13 0 2024-02-10T00:00:28.222 INFO:tasks.workunit.client.0.smithi164.stdout:1/40: truncate d1/da/fe 543422 0 2024-02-10T00:00:28.222 INFO:tasks.workunit.client.1.smithi183.stdout:8/486: mkdir d0/d10/d9e 0 2024-02-10T00:00:28.224 INFO:tasks.workunit.client.0.smithi164.stdout:0/26: creat d6/f9 x:0 0 0 2024-02-10T00:00:28.225 INFO:tasks.workunit.client.0.smithi164.stdout:9/89: write d6/fb [2293356,127015] 0 2024-02-10T00:00:28.226 INFO:tasks.workunit.client.0.smithi164.stdout:3/25: truncate d0/d1/d2/f7 10609084 0 2024-02-10T00:00:28.227 INFO:tasks.workunit.client.0.smithi164.stdout:4/53: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:28.227 INFO:tasks.workunit.client.1.smithi183.stdout:3/366: rename d7/f8 to d7/db/d2a/f69 0 2024-02-10T00:00:28.227 INFO:tasks.workunit.client.0.smithi164.stdout:4/54: readlink d2/la 0 2024-02-10T00:00:28.228 INFO:tasks.workunit.client.1.smithi183.stdout:8/487: dwrite d0/d27/f8b [0,4194304] 0 2024-02-10T00:00:28.228 INFO:tasks.workunit.client.0.smithi164.stdout:2/48: truncate f0 3494598 0 2024-02-10T00:00:28.228 INFO:tasks.workunit.client.0.smithi164.stdout:2/49: write d3/f12 [661998,59415] 0 2024-02-10T00:00:28.230 INFO:tasks.workunit.client.0.smithi164.stdout:7/101: write d3/f13 [2793125,66482] 0 2024-02-10T00:00:28.231 INFO:tasks.workunit.client.0.smithi164.stdout:7/102: write d3/f13 [2941545,10193] 0 2024-02-10T00:00:28.233 INFO:tasks.workunit.client.1.smithi183.stdout:5/508: sync 2024-02-10T00:00:28.234 INFO:tasks.workunit.client.0.smithi164.stdout:9/90: mknod d6/c1b 0 2024-02-10T00:00:28.234 INFO:tasks.workunit.client.1.smithi183.stdout:7/397: fsync d0/d11/d2f/d64/f69 0 2024-02-10T00:00:28.234 INFO:tasks.workunit.client.0.smithi164.stdout:3/26: rename d0/d1/d2/l3 to d0/l9 0 2024-02-10T00:00:28.235 INFO:tasks.workunit.client.0.smithi164.stdout:5/80: sync 2024-02-10T00:00:28.235 INFO:tasks.workunit.client.0.smithi164.stdout:8/60: sync 2024-02-10T00:00:28.236 INFO:tasks.workunit.client.0.smithi164.stdout:8/61: read d2/f4 [2339394,38894] 0 2024-02-10T00:00:28.236 INFO:tasks.workunit.client.0.smithi164.stdout:4/55: dread d2/fb [0,4194304] 0 2024-02-10T00:00:28.236 INFO:tasks.workunit.client.0.smithi164.stdout:1/41: mknod d1/cf 0 2024-02-10T00:00:28.237 INFO:tasks.workunit.client.1.smithi183.stdout:8/488: symlink d0/l9f 0 2024-02-10T00:00:28.237 INFO:tasks.workunit.client.0.smithi164.stdout:4/56: dread - d2/dc/f11 zero size 2024-02-10T00:00:28.239 INFO:tasks.workunit.client.1.smithi183.stdout:7/398: dwrite d0/d11/d2f/f66 [0,4194304] 0 2024-02-10T00:00:28.239 INFO:tasks.workunit.client.1.smithi183.stdout:9/433: truncate d0/f2e 3780891 0 2024-02-10T00:00:28.239 INFO:tasks.workunit.client.0.smithi164.stdout:8/62: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:28.244 INFO:tasks.workunit.client.0.smithi164.stdout:9/91: mkdir d6/d1c 0 2024-02-10T00:00:28.244 INFO:tasks.workunit.client.1.smithi183.stdout:3/367: mkdir d7/db/d2a/d2d/d6a 0 2024-02-10T00:00:28.245 INFO:tasks.workunit.client.0.smithi164.stdout:7/103: dread d3/d5/fb [0,4194304] 0 2024-02-10T00:00:28.248 INFO:tasks.workunit.client.1.smithi183.stdout:2/480: truncate d2/da/d20/f37 476684 0 2024-02-10T00:00:28.249 INFO:tasks.workunit.client.1.smithi183.stdout:0/373: truncate d14/d1d/f2b 498183 0 2024-02-10T00:00:28.250 INFO:tasks.workunit.client.1.smithi183.stdout:0/374: chown d14/d1d/d59/d71/d22/c6f 5708887 1 2024-02-10T00:00:28.250 INFO:tasks.workunit.client.0.smithi164.stdout:5/81: dwrite f0 [0,4194304] 0 2024-02-10T00:00:28.251 INFO:tasks.workunit.client.1.smithi183.stdout:0/375: dread - d14/d1d/d2d/f7c zero size 2024-02-10T00:00:28.251 INFO:tasks.workunit.client.0.smithi164.stdout:3/27: chown d0/d1/d2/f7 3722 1 2024-02-10T00:00:28.253 INFO:tasks.workunit.client.1.smithi183.stdout:2/481: dwrite d2/f13 [4194304,4194304] 0 2024-02-10T00:00:28.253 INFO:tasks.workunit.client.1.smithi183.stdout:0/376: chown d14/d1d/d2d/d31/f3a 863019 1 2024-02-10T00:00:28.254 INFO:tasks.workunit.client.0.smithi164.stdout:6/104: sync 2024-02-10T00:00:28.254 INFO:tasks.workunit.client.0.smithi164.stdout:5/82: dread f0 [0,4194304] 0 2024-02-10T00:00:28.254 INFO:tasks.workunit.client.1.smithi183.stdout:2/482: write d2/d2c/d2f/f6a [313549,122803] 0 2024-02-10T00:00:28.255 INFO:tasks.workunit.client.1.smithi183.stdout:2/483: write d2/da/d20/d21/d36/f6e [777490,109602] 0 2024-02-10T00:00:28.255 INFO:tasks.workunit.client.0.smithi164.stdout:9/92: creat d6/d1c/f1d x:0 0 0 2024-02-10T00:00:28.256 INFO:tasks.workunit.client.1.smithi183.stdout:6/347: truncate d2/f4b 6508271 0 2024-02-10T00:00:28.256 INFO:tasks.workunit.client.1.smithi183.stdout:2/484: stat d2/da/d20/d21/d43 0 2024-02-10T00:00:28.257 INFO:tasks.workunit.client.0.smithi164.stdout:7/104: mknod d3/c21 0 2024-02-10T00:00:28.257 INFO:tasks.workunit.client.0.smithi164.stdout:8/63: truncate d2/f7 544535 0 2024-02-10T00:00:28.257 INFO:tasks.workunit.client.0.smithi164.stdout:7/105: write d3/f1e [465069,13156] 0 2024-02-10T00:00:28.258 INFO:tasks.workunit.client.1.smithi183.stdout:4/419: dwrite de/d14/f4a [0,4194304] 0 2024-02-10T00:00:28.260 INFO:tasks.workunit.client.0.smithi164.stdout:6/105: rename d0/d6/d12/d14/f19 to d0/f21 0 2024-02-10T00:00:28.260 INFO:tasks.workunit.client.0.smithi164.stdout:9/93: rmdir d6/de 39 2024-02-10T00:00:28.262 INFO:tasks.workunit.client.1.smithi183.stdout:8/489: mknod d0/d31/ca0 0 2024-02-10T00:00:28.262 INFO:tasks.workunit.client.0.smithi164.stdout:0/27: read f0 [457266,65004] 0 2024-02-10T00:00:28.263 INFO:tasks.workunit.client.1.smithi183.stdout:8/490: readlink d0/d27/d36/l9c 0 2024-02-10T00:00:28.263 INFO:tasks.workunit.client.0.smithi164.stdout:6/106: dread d0/f11 [0,4194304] 0 2024-02-10T00:00:28.263 INFO:tasks.workunit.client.0.smithi164.stdout:5/83: symlink d7/d15/l16 0 2024-02-10T00:00:28.263 INFO:tasks.workunit.client.0.smithi164.stdout:6/107: read d0/d6/f13 [141329,49981] 0 2024-02-10T00:00:28.264 INFO:tasks.workunit.client.1.smithi183.stdout:7/399: mkdir d0/d11/d2f/d64/d6b 0 2024-02-10T00:00:28.264 INFO:tasks.workunit.client.1.smithi183.stdout:7/400: write d0/d2/f26 [562937,66712] 0 2024-02-10T00:00:28.265 INFO:tasks.workunit.client.1.smithi183.stdout:9/434: symlink d0/d3/d14/d1c/d4b/d51/l95 0 2024-02-10T00:00:28.267 INFO:tasks.workunit.client.1.smithi183.stdout:3/368: rename d7/db/d2a/d4d to d7/db/d2a/d4d/d6b 22 2024-02-10T00:00:28.268 INFO:tasks.workunit.client.0.smithi164.stdout:3/28: readlink d0/l9 0 2024-02-10T00:00:28.270 INFO:tasks.workunit.client.0.smithi164.stdout:2/50: truncate f2 3654067 0 2024-02-10T00:00:28.270 INFO:tasks.workunit.client.1.smithi183.stdout:5/509: creat d4/d23/d3e/d80/da1/d9c/d72/da0/fa4 x:0 0 0 2024-02-10T00:00:28.271 INFO:tasks.workunit.client.1.smithi183.stdout:1/378: truncate d0/d3/d7/d3d/f5b 164933 0 2024-02-10T00:00:28.271 INFO:tasks.workunit.client.0.smithi164.stdout:1/42: write d1/da/fb [798144,45402] 0 2024-02-10T00:00:28.271 INFO:tasks.workunit.client.0.smithi164.stdout:4/57: write d2/f8 [1314487,111849] 0 2024-02-10T00:00:28.272 INFO:tasks.workunit.client.1.smithi183.stdout:2/485: mkdir d2/d2c/d2f/d60/d8d/d9c 0 2024-02-10T00:00:28.273 INFO:tasks.workunit.client.1.smithi183.stdout:2/486: write d2/da/d5b/f88 [841823,57213] 0 2024-02-10T00:00:28.273 INFO:tasks.workunit.client.1.smithi183.stdout:2/487: write d2/da/d19/f7a [495104,37013] 0 2024-02-10T00:00:28.276 INFO:tasks.workunit.client.1.smithi183.stdout:9/435: creat d0/d3/d14/d1c/d4b/f96 x:0 0 0 2024-02-10T00:00:28.277 INFO:tasks.workunit.client.1.smithi183.stdout:3/369: unlink d7/f3e 0 2024-02-10T00:00:28.277 INFO:tasks.workunit.client.1.smithi183.stdout:2/488: read d2/da/d20/d21/d36/f6e [353893,97057] 0 2024-02-10T00:00:28.277 INFO:tasks.workunit.client.1.smithi183.stdout:3/370: chown d7/l29 245 1 2024-02-10T00:00:28.278 INFO:tasks.workunit.client.1.smithi183.stdout:2/489: dread - d2/d2c/d2f/d72/f97 zero size 2024-02-10T00:00:28.278 INFO:tasks.workunit.client.1.smithi183.stdout:6/348: creat d2/d26/d35/f69 x:0 0 0 2024-02-10T00:00:28.279 INFO:tasks.workunit.client.0.smithi164.stdout:2/51: readlink d3/l9 0 2024-02-10T00:00:28.280 INFO:tasks.workunit.client.0.smithi164.stdout:1/43: rmdir d1 39 2024-02-10T00:00:28.280 INFO:tasks.workunit.client.1.smithi183.stdout:5/510: rmdir d4/d23/d3e/d80 39 2024-02-10T00:00:28.281 INFO:tasks.workunit.client.0.smithi164.stdout:2/52: write d3/f11 [106105,106680] 0 2024-02-10T00:00:28.281 INFO:tasks.workunit.client.1.smithi183.stdout:9/436: dwrite d0/f3a [0,4194304] 0 2024-02-10T00:00:28.281 INFO:tasks.workunit.client.0.smithi164.stdout:8/64: link l0 d2/lb 0 2024-02-10T00:00:28.282 INFO:tasks.workunit.client.0.smithi164.stdout:7/106: truncate d3/ff 267790 0 2024-02-10T00:00:28.282 INFO:tasks.workunit.client.0.smithi164.stdout:6/108: dwrite d0/f11 [4194304,4194304] 0 2024-02-10T00:00:28.283 INFO:tasks.workunit.client.0.smithi164.stdout:6/109: stat d0/d6/d12/d14/l1d 0 2024-02-10T00:00:28.285 INFO:tasks.workunit.client.1.smithi183.stdout:2/490: mknod d2/d2c/d2f/c9d 0 2024-02-10T00:00:28.285 INFO:tasks.workunit.client.0.smithi164.stdout:1/44: readlink d1/l8 0 2024-02-10T00:00:28.286 INFO:tasks.workunit.client.0.smithi164.stdout:8/65: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:28.287 INFO:tasks.workunit.client.0.smithi164.stdout:2/53: symlink d3/l14 0 2024-02-10T00:00:28.287 INFO:tasks.workunit.client.1.smithi183.stdout:2/491: readlink d2/da/d77/l32 0 2024-02-10T00:00:28.287 INFO:tasks.workunit.client.1.smithi183.stdout:9/437: dwrite d0/d3/d14/f82 [0,4194304] 0 2024-02-10T00:00:28.287 INFO:tasks.workunit.client.1.smithi183.stdout:6/349: creat d2/d1a/d3a/d45/d53/f6a x:0 0 0 2024-02-10T00:00:28.287 INFO:tasks.workunit.client.0.smithi164.stdout:1/45: write d1/fd [640042,61466] 0 2024-02-10T00:00:28.288 INFO:tasks.workunit.client.0.smithi164.stdout:1/46: chown d1/da 42819 1 2024-02-10T00:00:28.288 INFO:tasks.workunit.client.0.smithi164.stdout:6/110: dread d0/fb [0,4194304] 0 2024-02-10T00:00:28.291 INFO:tasks.workunit.client.1.smithi183.stdout:5/511: read d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/f62 [573335,62952] 0 2024-02-10T00:00:28.291 INFO:tasks.workunit.client.0.smithi164.stdout:4/58: getdents d2 0 2024-02-10T00:00:28.292 INFO:tasks.workunit.client.0.smithi164.stdout:8/66: chown d2/lb 7689683 1 2024-02-10T00:00:28.293 INFO:tasks.workunit.client.0.smithi164.stdout:4/59: chown d2/l7 1632764 1 2024-02-10T00:00:28.294 INFO:tasks.workunit.client.0.smithi164.stdout:7/107: link d3/d11/f14 d3/f22 0 2024-02-10T00:00:28.294 INFO:tasks.workunit.client.1.smithi183.stdout:3/371: creat d7/db/d2a/d2d/d6a/f6c x:0 0 0 2024-02-10T00:00:28.294 INFO:tasks.workunit.client.0.smithi164.stdout:4/60: stat d2/dc 0 2024-02-10T00:00:28.294 INFO:tasks.workunit.client.0.smithi164.stdout:2/54: dwrite d3/fe [0,4194304] 0 2024-02-10T00:00:28.295 INFO:tasks.workunit.client.1.smithi183.stdout:1/379: creat d0/f8e x:0 0 0 2024-02-10T00:00:28.295 INFO:tasks.workunit.client.1.smithi183.stdout:1/380: readlink d0/d3/d67/l53 0 2024-02-10T00:00:28.297 INFO:tasks.workunit.client.0.smithi164.stdout:6/111: fdatasync d0/d6/d12/d14/f1e 0 2024-02-10T00:00:28.297 INFO:tasks.workunit.client.1.smithi183.stdout:6/350: creat d2/d1a/d25/d3c/d31/f6b x:0 0 0 2024-02-10T00:00:28.298 INFO:tasks.workunit.client.0.smithi164.stdout:1/47: dwrite d1/da/fb [0,4194304] 0 2024-02-10T00:00:28.299 INFO:tasks.workunit.client.1.smithi183.stdout:4/420: link de/d19/f30 de/f7f 0 2024-02-10T00:00:28.299 INFO:tasks.workunit.client.1.smithi183.stdout:4/421: dread - de/f71 zero size 2024-02-10T00:00:28.300 INFO:tasks.workunit.client.0.smithi164.stdout:7/108: creat d3/d11/f23 x:0 0 0 2024-02-10T00:00:28.300 INFO:tasks.workunit.client.0.smithi164.stdout:4/61: creat d2/f12 x:0 0 0 2024-02-10T00:00:28.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/112: chown d0/d6/f10 381 1 2024-02-10T00:00:28.301 INFO:tasks.workunit.client.1.smithi183.stdout:1/381: rmdir d0/d3/d7/d3d/d60 39 2024-02-10T00:00:28.301 INFO:tasks.workunit.client.1.smithi183.stdout:1/382: chown d0/d3/d67/l53 0 1 2024-02-10T00:00:28.304 INFO:tasks.workunit.client.0.smithi164.stdout:8/67: dwrite d2/fa [0,4194304] 0 2024-02-10T00:00:28.305 INFO:tasks.workunit.client.1.smithi183.stdout:2/492: rename d2/d2c/d2f/d72/d7b/c81 to d2/da/d20/d21/d43/d58/d8e/c9e 0 2024-02-10T00:00:28.305 INFO:tasks.workunit.client.1.smithi183.stdout:2/493: fsync d2/da/d19/d31/d75/d35/f4e 0 2024-02-10T00:00:28.306 INFO:tasks.workunit.client.0.smithi164.stdout:2/55: dwrite d3/fe [0,4194304] 0 2024-02-10T00:00:28.307 INFO:tasks.workunit.client.0.smithi164.stdout:2/56: chown d3/la 7 1 2024-02-10T00:00:28.307 INFO:tasks.workunit.client.0.smithi164.stdout:2/57: write d3/fe [3621261,100288] 0 2024-02-10T00:00:28.308 INFO:tasks.workunit.client.1.smithi183.stdout:1/383: creat d0/d3a/f8f x:0 0 0 2024-02-10T00:00:28.308 INFO:tasks.workunit.client.0.smithi164.stdout:4/62: rename d2/ce to d2/c13 0 2024-02-10T00:00:28.310 INFO:tasks.workunit.client.0.smithi164.stdout:7/109: mknod d3/c24 0 2024-02-10T00:00:28.311 INFO:tasks.workunit.client.1.smithi183.stdout:2/494: creat d2/d2c/d2f/d72/f9f x:0 0 0 2024-02-10T00:00:28.311 INFO:tasks.workunit.client.0.smithi164.stdout:8/68: truncate d2/f4 3148236 0 2024-02-10T00:00:28.312 INFO:tasks.workunit.client.1.smithi183.stdout:1/384: getdents d0/d3/d29/d1f/d86 0 2024-02-10T00:00:28.316 INFO:tasks.workunit.client.0.smithi164.stdout:7/110: unlink d3/l10 0 2024-02-10T00:00:28.316 INFO:tasks.workunit.client.1.smithi183.stdout:0/377: sync 2024-02-10T00:00:28.317 INFO:tasks.workunit.client.1.smithi183.stdout:2/495: creat d2/d3d/fa0 x:0 0 0 2024-02-10T00:00:28.318 INFO:tasks.workunit.client.1.smithi183.stdout:4/422: getdents de/d22 0 2024-02-10T00:00:28.319 INFO:tasks.workunit.client.0.smithi164.stdout:9/94: sync 2024-02-10T00:00:28.320 INFO:tasks.workunit.client.0.smithi164.stdout:8/69: link d2/c5 d2/cc 0 2024-02-10T00:00:28.324 INFO:tasks.workunit.client.0.smithi164.stdout:8/70: chown l0 261674 1 2024-02-10T00:00:28.325 INFO:tasks.workunit.client.0.smithi164.stdout:9/95: rmdir d6/d19 0 2024-02-10T00:00:28.326 INFO:tasks.workunit.client.0.smithi164.stdout:9/96: fdatasync d6/f10 0 2024-02-10T00:00:28.326 INFO:tasks.workunit.client.1.smithi183.stdout:1/385: read d0/f13 [657,120084] 0 2024-02-10T00:00:28.327 INFO:tasks.workunit.client.1.smithi183.stdout:2/496: rename d2/da/l16 to d2/d2c/d2f/d60/d8d/la1 0 2024-02-10T00:00:28.328 INFO:tasks.workunit.client.1.smithi183.stdout:4/423: link de/d22/l42 de/d19/d1c/l80 0 2024-02-10T00:00:28.330 INFO:tasks.workunit.client.1.smithi183.stdout:1/386: getdents d0/d3/d29/d1f/d86 0 2024-02-10T00:00:28.331 INFO:tasks.workunit.client.1.smithi183.stdout:4/424: mknod de/c81 0 2024-02-10T00:00:28.334 INFO:tasks.workunit.client.0.smithi164.stdout:5/84: dwrite d7/fc [0,4194304] 0 2024-02-10T00:00:28.334 INFO:tasks.workunit.client.0.smithi164.stdout:3/29: fsync d0/f4 0 2024-02-10T00:00:28.335 INFO:tasks.workunit.client.1.smithi183.stdout:1/387: symlink d0/d3/d7/d3d/d60/d89/l90 0 2024-02-10T00:00:28.335 INFO:tasks.workunit.client.0.smithi164.stdout:0/28: truncate f0 1355953 0 2024-02-10T00:00:28.336 INFO:tasks.workunit.client.0.smithi164.stdout:2/58: dread f0 [0,4194304] 0 2024-02-10T00:00:28.337 INFO:tasks.workunit.client.0.smithi164.stdout:9/97: link d6/d1c/f1d d6/f1e 0 2024-02-10T00:00:28.337 INFO:tasks.workunit.client.1.smithi183.stdout:4/425: rename de/f3c to de/d14/d27/f82 0 2024-02-10T00:00:28.338 INFO:tasks.workunit.client.0.smithi164.stdout:9/98: fdatasync d6/f1a 0 2024-02-10T00:00:28.339 INFO:tasks.workunit.client.0.smithi164.stdout:5/85: mkdir d7/d17 0 2024-02-10T00:00:28.341 INFO:tasks.workunit.client.1.smithi183.stdout:1/388: creat d0/d3/d7/d3d/f91 x:0 0 0 2024-02-10T00:00:28.342 INFO:tasks.workunit.client.1.smithi183.stdout:2/497: dread d2/f3a [0,4194304] 0 2024-02-10T00:00:28.343 INFO:tasks.workunit.client.1.smithi183.stdout:1/389: mknod d0/d3/d7/d3d/d60/d89/c92 0 2024-02-10T00:00:28.344 INFO:tasks.workunit.client.1.smithi183.stdout:1/390: fdatasync d0/d3/f85 0 2024-02-10T00:00:28.344 INFO:tasks.workunit.client.0.smithi164.stdout:6/113: sync 2024-02-10T00:00:28.345 INFO:tasks.workunit.client.1.smithi183.stdout:1/391: write d0/d3/f88 [1054553,94345] 0 2024-02-10T00:00:28.347 INFO:tasks.workunit.client.1.smithi183.stdout:2/498: rmdir d2/d96 0 2024-02-10T00:00:28.348 INFO:tasks.workunit.client.0.smithi164.stdout:2/59: dwrite d3/fe [4194304,4194304] 0 2024-02-10T00:00:28.349 INFO:tasks.workunit.client.1.smithi183.stdout:1/392: mknod d0/d3/d67/d7b/c93 0 2024-02-10T00:00:28.350 INFO:tasks.workunit.client.0.smithi164.stdout:6/114: write d0/d6/f8 [2573545,57833] 0 2024-02-10T00:00:28.351 INFO:tasks.workunit.client.1.smithi183.stdout:5/512: dread d4/d23/d3e/d80/da1/d9c/f7d [0,4194304] 0 2024-02-10T00:00:28.353 INFO:tasks.workunit.client.0.smithi164.stdout:1/48: truncate d1/f7 47897 0 2024-02-10T00:00:28.355 INFO:tasks.workunit.client.1.smithi183.stdout:1/393: unlink d0/d3/d7/f2b 0 2024-02-10T00:00:28.355 INFO:tasks.workunit.client.0.smithi164.stdout:7/111: truncate d3/d5/f7 3596020 0 2024-02-10T00:00:28.357 INFO:tasks.workunit.client.1.smithi183.stdout:5/513: unlink d4/d23/d3e/d80/da1/d9e/l2d 0 2024-02-10T00:00:28.357 INFO:tasks.workunit.client.1.smithi183.stdout:2/499: link d2/da/d20/d21/c8c d2/da/d19/d31/d55/ca2 0 2024-02-10T00:00:28.357 INFO:tasks.workunit.client.0.smithi164.stdout:2/60: creat d3/f15 x:0 0 0 2024-02-10T00:00:28.358 INFO:tasks.workunit.client.1.smithi183.stdout:5/514: write d4/dd/d71/f84 [1396551,62792] 0 2024-02-10T00:00:28.359 INFO:tasks.workunit.client.1.smithi183.stdout:1/394: creat d0/d3/d67/f94 x:0 0 0 2024-02-10T00:00:28.360 INFO:tasks.workunit.client.0.smithi164.stdout:4/63: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:28.360 INFO:tasks.workunit.client.0.smithi164.stdout:5/86: link d7/d15/l16 d7/d15/l18 0 2024-02-10T00:00:28.360 INFO:tasks.workunit.client.1.smithi183.stdout:8/491: sync 2024-02-10T00:00:28.361 INFO:tasks.workunit.client.1.smithi183.stdout:2/500: write d2/d2c/d2f/d72/f92 [1943717,43958] 0 2024-02-10T00:00:28.361 INFO:tasks.workunit.client.1.smithi183.stdout:8/492: write d0/d3f/f6f [647077,70792] 0 2024-02-10T00:00:28.362 INFO:tasks.workunit.client.0.smithi164.stdout:8/71: fdatasync d2/fa 0 2024-02-10T00:00:28.362 INFO:tasks.workunit.client.0.smithi164.stdout:1/49: dwrite d1/f9 [0,4194304] 0 2024-02-10T00:00:28.363 INFO:tasks.workunit.client.0.smithi164.stdout:1/50: chown d1/cf 25279 1 2024-02-10T00:00:28.363 INFO:tasks.workunit.client.0.smithi164.stdout:2/61: creat d3/f16 x:0 0 0 2024-02-10T00:00:28.364 INFO:tasks.workunit.client.0.smithi164.stdout:1/51: write d1/da/fb [3321508,15270] 0 2024-02-10T00:00:28.365 INFO:tasks.workunit.client.1.smithi183.stdout:2/501: dwrite d2/da/f1d [0,4194304] 0 2024-02-10T00:00:28.365 INFO:tasks.workunit.client.0.smithi164.stdout:6/115: link d0/d6/f7 d0/d6/d12/f22 0 2024-02-10T00:00:28.374 INFO:tasks.workunit.client.1.smithi183.stdout:5/515: unlink d4/d23/d4a/c22 0 2024-02-10T00:00:28.375 INFO:tasks.workunit.client.1.smithi183.stdout:5/516: chown d4/f45 6904 1 2024-02-10T00:00:28.377 INFO:tasks.workunit.client.0.smithi164.stdout:3/30: truncate d0/d1/d2/f7 11594097 0 2024-02-10T00:00:28.377 INFO:tasks.workunit.client.0.smithi164.stdout:6/116: mknod d0/d6/d12/d14/c23 0 2024-02-10T00:00:28.379 INFO:tasks.workunit.client.0.smithi164.stdout:0/29: write f5 [3614879,11970] 0 2024-02-10T00:00:28.380 INFO:tasks.workunit.client.0.smithi164.stdout:9/99: truncate d6/f9 458084 0 2024-02-10T00:00:28.380 INFO:tasks.workunit.client.0.smithi164.stdout:0/30: dread - d6/f9 zero size 2024-02-10T00:00:28.380 INFO:tasks.workunit.client.1.smithi183.stdout:6/351: truncate d2/f16 4714150 0 2024-02-10T00:00:28.382 INFO:tasks.workunit.client.0.smithi164.stdout:1/52: write d1/f7 [722176,44012] 0 2024-02-10T00:00:28.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/72: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:28.383 INFO:tasks.workunit.client.1.smithi183.stdout:0/378: truncate d14/d1d/d2d/d31/d6c/d70/f81 1235982 0 2024-02-10T00:00:28.384 INFO:tasks.workunit.client.0.smithi164.stdout:1/53: chown d1/fd 0 1 2024-02-10T00:00:28.387 INFO:tasks.workunit.client.0.smithi164.stdout:4/64: link d2/la d2/dc/l14 0 2024-02-10T00:00:28.388 INFO:tasks.workunit.client.0.smithi164.stdout:6/117: truncate d0/d6/d12/d14/f1e 694350 0 2024-02-10T00:00:28.391 INFO:tasks.workunit.client.0.smithi164.stdout:8/73: mkdir d2/dd 0 2024-02-10T00:00:28.391 INFO:tasks.workunit.client.0.smithi164.stdout:1/54: chown d1/f4 199 1 2024-02-10T00:00:28.392 INFO:tasks.workunit.client.0.smithi164.stdout:5/87: getdents d7 0 2024-02-10T00:00:28.392 INFO:tasks.workunit.client.0.smithi164.stdout:4/65: readlink d2/dc/l14 0 2024-02-10T00:00:28.394 INFO:tasks.workunit.client.0.smithi164.stdout:9/100: link d6/f10 d6/d1c/f1f 0 2024-02-10T00:00:28.394 INFO:tasks.workunit.client.1.smithi183.stdout:2/502: creat d2/d2c/d2f/d72/d7b/d99/fa3 x:0 0 0 2024-02-10T00:00:28.395 INFO:tasks.workunit.client.1.smithi183.stdout:2/503: write d2/f3e [4412451,92044] 0 2024-02-10T00:00:28.395 INFO:tasks.workunit.client.0.smithi164.stdout:5/88: dread f0 [0,4194304] 0 2024-02-10T00:00:28.396 INFO:tasks.workunit.client.0.smithi164.stdout:6/118: creat d0/d6/d12/d14/f24 x:0 0 0 2024-02-10T00:00:28.400 INFO:tasks.workunit.client.1.smithi183.stdout:3/372: sync 2024-02-10T00:00:28.400 INFO:tasks.workunit.client.1.smithi183.stdout:7/401: sync 2024-02-10T00:00:28.400 INFO:tasks.workunit.client.1.smithi183.stdout:9/438: sync 2024-02-10T00:00:28.401 INFO:tasks.workunit.client.1.smithi183.stdout:7/402: fdatasync d0/d2/d4/d8/f4d 0 2024-02-10T00:00:28.401 INFO:tasks.workunit.client.0.smithi164.stdout:7/112: write d3/d5/fb [2918327,113117] 0 2024-02-10T00:00:28.401 INFO:tasks.workunit.client.0.smithi164.stdout:4/66: creat d2/dc/f15 x:0 0 0 2024-02-10T00:00:28.401 INFO:tasks.workunit.client.0.smithi164.stdout:4/67: write d2/f8 [81594,121319] 0 2024-02-10T00:00:28.401 INFO:tasks.workunit.client.0.smithi164.stdout:5/89: creat d7/f19 x:0 0 0 2024-02-10T00:00:28.403 INFO:tasks.workunit.client.0.smithi164.stdout:1/55: symlink d1/l10 0 2024-02-10T00:00:28.403 INFO:tasks.workunit.client.0.smithi164.stdout:3/31: chown d0/f4 0 1 2024-02-10T00:00:28.404 INFO:tasks.workunit.client.1.smithi183.stdout:2/504: rename d2/c12 to d2/da/d20/d21/d43/d58/d74/d83/ca4 0 2024-02-10T00:00:28.404 INFO:tasks.workunit.client.0.smithi164.stdout:7/113: symlink d3/d5/l25 0 2024-02-10T00:00:28.404 INFO:tasks.workunit.client.0.smithi164.stdout:7/114: readlink d3/lc 0 2024-02-10T00:00:28.405 INFO:tasks.workunit.client.0.smithi164.stdout:0/31: getdents d6 0 2024-02-10T00:00:28.405 INFO:tasks.workunit.client.0.smithi164.stdout:0/32: chown f5 2953 1 2024-02-10T00:00:28.408 INFO:tasks.workunit.client.1.smithi183.stdout:1/395: truncate d0/d3/f2d 5202989 0 2024-02-10T00:00:28.409 INFO:tasks.workunit.client.0.smithi164.stdout:4/68: mkdir d2/dc/d16 0 2024-02-10T00:00:28.411 INFO:tasks.workunit.client.1.smithi183.stdout:2/505: dwrite d2/da/d19/d31/d75/d35/f4e [0,4194304] 0 2024-02-10T00:00:28.411 INFO:tasks.workunit.client.1.smithi183.stdout:9/439: mkdir d0/d3/d14/d1c/d4b/d97 0 2024-02-10T00:00:28.411 INFO:tasks.workunit.client.1.smithi183.stdout:3/373: dwrite d7/db/f24 [0,4194304] 0 2024-02-10T00:00:28.411 INFO:tasks.workunit.client.0.smithi164.stdout:8/74: rmdir d2/dd 0 2024-02-10T00:00:28.413 INFO:tasks.workunit.client.1.smithi183.stdout:9/440: write d0/d3/d14/f69 [368721,28238] 0 2024-02-10T00:00:28.415 INFO:tasks.workunit.client.1.smithi183.stdout:8/493: getdents d0/d4e/d53 0 2024-02-10T00:00:28.416 INFO:tasks.workunit.client.1.smithi183.stdout:4/426: symlink de/d19/d1c/d61/l83 0 2024-02-10T00:00:28.417 INFO:tasks.workunit.client.1.smithi183.stdout:5/517: sync 2024-02-10T00:00:28.418 INFO:tasks.workunit.client.1.smithi183.stdout:8/494: dread - d0/d27/d75/d5b/f89 zero size 2024-02-10T00:00:28.419 INFO:tasks.workunit.client.1.smithi183.stdout:6/352: rmdir d2/d26/d64 0 2024-02-10T00:00:28.420 INFO:tasks.workunit.client.0.smithi164.stdout:2/62: write f2 [1835799,110889] 0 2024-02-10T00:00:28.420 INFO:tasks.workunit.client.0.smithi164.stdout:5/90: rename d7/c13 to d7/d15/c1a 0 2024-02-10T00:00:28.420 INFO:tasks.workunit.client.0.smithi164.stdout:3/32: symlink d0/d1/d2/la 0 2024-02-10T00:00:28.421 INFO:tasks.workunit.client.0.smithi164.stdout:9/101: creat d6/f20 x:0 0 0 2024-02-10T00:00:28.421 INFO:tasks.workunit.client.1.smithi183.stdout:2/506: dwrite d2/da/d20/f66 [0,4194304] 0 2024-02-10T00:00:28.421 INFO:tasks.workunit.client.1.smithi183.stdout:5/518: chown d4/d23/d4a/f5f 3273784 1 2024-02-10T00:00:28.421 INFO:tasks.workunit.client.0.smithi164.stdout:3/33: chown d0/d1/c8 47466 1 2024-02-10T00:00:28.422 INFO:tasks.workunit.client.1.smithi183.stdout:9/441: dwrite d0/f3a [4194304,4194304] 0 2024-02-10T00:00:28.424 INFO:tasks.workunit.client.0.smithi164.stdout:8/75: truncate d2/f7 40627 0 2024-02-10T00:00:28.425 INFO:tasks.workunit.client.0.smithi164.stdout:6/119: dwrite d0/d6/f13 [0,4194304] 0 2024-02-10T00:00:28.426 INFO:tasks.workunit.client.0.smithi164.stdout:6/120: rename d0 to d0/d6/d12/d14/d25 22 2024-02-10T00:00:28.426 INFO:tasks.workunit.client.0.smithi164.stdout:6/121: read - d0/d6/f1c zero size 2024-02-10T00:00:28.427 INFO:tasks.workunit.client.0.smithi164.stdout:6/122: stat d0/f5 0 2024-02-10T00:00:28.427 INFO:tasks.workunit.client.0.smithi164.stdout:6/123: rename d0 to d0/d6/d12/d14/d26 22 2024-02-10T00:00:28.429 INFO:tasks.workunit.client.1.smithi183.stdout:3/374: dwrite d7/db/d2a/f2c [0,4194304] 0 2024-02-10T00:00:28.429 INFO:tasks.workunit.client.1.smithi183.stdout:0/379: truncate d14/d1d/d59/d71/f56 735230 0 2024-02-10T00:00:28.430 INFO:tasks.workunit.client.1.smithi183.stdout:5/519: unlink f0 0 2024-02-10T00:00:28.430 INFO:tasks.workunit.client.0.smithi164.stdout:6/124: dread d0/d6/d12/f22 [0,4194304] 0 2024-02-10T00:00:28.432 INFO:tasks.workunit.client.1.smithi183.stdout:6/353: creat d2/d26/d34/d61/f6c x:0 0 0 2024-02-10T00:00:28.435 INFO:tasks.workunit.client.1.smithi183.stdout:7/403: dread d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:28.436 INFO:tasks.workunit.client.1.smithi183.stdout:1/396: creat d0/d3/d7/d3d/f95 x:0 0 0 2024-02-10T00:00:28.437 INFO:tasks.workunit.client.1.smithi183.stdout:3/375: chown d7/db/d2a/d1c/f5c 1241 1 2024-02-10T00:00:28.438 INFO:tasks.workunit.client.1.smithi183.stdout:3/376: chown d7/db/c5d 1 1 2024-02-10T00:00:28.439 INFO:tasks.workunit.client.1.smithi183.stdout:6/354: rmdir d2/d1a/d25 39 2024-02-10T00:00:28.442 INFO:tasks.workunit.client.1.smithi183.stdout:8/495: rename d0/d10/f5e to d0/d4e/fa1 0 2024-02-10T00:00:28.443 INFO:tasks.workunit.client.1.smithi183.stdout:8/496: write d0/d4e/d53/f64 [1407033,119182] 0 2024-02-10T00:00:28.444 INFO:tasks.workunit.client.1.smithi183.stdout:8/497: write d0/d3f/f43 [959638,62551] 0 2024-02-10T00:00:28.445 INFO:tasks.workunit.client.1.smithi183.stdout:3/377: mknod d7/db/d2a/d4d/c6d 0 2024-02-10T00:00:28.446 INFO:tasks.workunit.client.1.smithi183.stdout:8/498: dread d0/d27/f44 [0,4194304] 0 2024-02-10T00:00:28.447 INFO:tasks.workunit.client.1.smithi183.stdout:7/404: mknod d0/d2/d50/c6c 0 2024-02-10T00:00:28.449 INFO:tasks.workunit.client.1.smithi183.stdout:9/442: getdents d0/d3/d14/d48 0 2024-02-10T00:00:28.450 INFO:tasks.workunit.client.0.smithi164.stdout:7/115: sync 2024-02-10T00:00:28.451 INFO:tasks.workunit.client.1.smithi183.stdout:3/378: symlink d7/db/d2a/d4d/l6e 0 2024-02-10T00:00:28.451 INFO:tasks.workunit.client.0.smithi164.stdout:7/116: dread - d3/f16 zero size 2024-02-10T00:00:28.452 INFO:tasks.workunit.client.1.smithi183.stdout:1/397: link d0/d3/d7/f63 d0/d3/d67/f96 0 2024-02-10T00:00:28.453 INFO:tasks.workunit.client.1.smithi183.stdout:1/398: readlink d0/d3a/l5d 0 2024-02-10T00:00:28.455 INFO:tasks.workunit.client.1.smithi183.stdout:7/405: fsync d0/d2/d4/f3c 0 2024-02-10T00:00:28.455 INFO:tasks.workunit.client.1.smithi183.stdout:8/499: read d0/f1e [2550440,130809] 0 2024-02-10T00:00:28.457 INFO:tasks.workunit.client.1.smithi183.stdout:8/500: write d0/d4e/d53/f64 [33527,66829] 0 2024-02-10T00:00:28.458 INFO:tasks.workunit.client.1.smithi183.stdout:1/399: symlink d0/l97 0 2024-02-10T00:00:28.459 INFO:tasks.workunit.client.1.smithi183.stdout:7/406: creat d0/d11/d3e/f6d x:0 0 0 2024-02-10T00:00:28.460 INFO:tasks.workunit.client.1.smithi183.stdout:7/407: dread - d0/d11/d35/f61 zero size 2024-02-10T00:00:28.461 INFO:tasks.workunit.client.1.smithi183.stdout:1/400: write d0/d3/d7/d36/f47 [1335833,109114] 0 2024-02-10T00:00:28.462 INFO:tasks.workunit.client.1.smithi183.stdout:8/501: symlink d0/d23/d2d/la2 0 2024-02-10T00:00:28.463 INFO:tasks.workunit.client.1.smithi183.stdout:7/408: fsync d0/d11/f36 0 2024-02-10T00:00:28.464 INFO:tasks.workunit.client.1.smithi183.stdout:0/380: dread d14/d1d/d55/f5a [0,4194304] 0 2024-02-10T00:00:28.464 INFO:tasks.workunit.client.1.smithi183.stdout:0/381: chown d14/d1d/d55/f5a 384963083 1 2024-02-10T00:00:28.466 INFO:tasks.workunit.client.1.smithi183.stdout:8/502: getdents d0/d45 0 2024-02-10T00:00:28.467 INFO:tasks.workunit.client.1.smithi183.stdout:0/382: creat d14/d1d/d2d/f8a x:0 0 0 2024-02-10T00:00:28.469 INFO:tasks.workunit.client.1.smithi183.stdout:7/409: creat d0/d2/d4/f6e x:0 0 0 2024-02-10T00:00:28.470 INFO:tasks.workunit.client.1.smithi183.stdout:7/410: write d0/d2/d3/f33 [2153335,123366] 0 2024-02-10T00:00:28.473 INFO:tasks.workunit.client.1.smithi183.stdout:0/383: link d14/d1d/d55/d6e/d74/l75 d14/d1d/l8b 0 2024-02-10T00:00:28.476 INFO:tasks.workunit.client.1.smithi183.stdout:0/384: symlink d14/d1d/d55/d6e/l8c 0 2024-02-10T00:00:28.477 INFO:tasks.workunit.client.1.smithi183.stdout:0/385: symlink d14/d1d/d59/l8d 0 2024-02-10T00:00:28.478 INFO:tasks.workunit.client.1.smithi183.stdout:0/386: chown d14/d3e/c6b 3870536 1 2024-02-10T00:00:28.485 INFO:tasks.workunit.client.1.smithi183.stdout:4/427: truncate de/d14/d27/f3d 4190107 0 2024-02-10T00:00:28.647 INFO:tasks.workunit.client.1.smithi183.stdout:1/401: dread d0/d3/f12 [0,4194304] 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:0/33: symlink d6/d7/la 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:0/34: fsync f3 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:2/63: creat d3/f17 x:0 0 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:4/69: unlink d2/dc/lf 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:4/70: dread - d2/f12 zero size 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:8/76: mknod d2/ce 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:1/56: link d1/da/fb d1/f11 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:8/77: sync 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:0/35: mknod d6/cb 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:2/64: creat d3/f18 x:0 0 0 2024-02-10T00:00:28.651 INFO:tasks.workunit.client.0.smithi164.stdout:9/102: creat d6/de/f21 x:0 0 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:6/125: write d0/fb [4425793,35804] 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:7/117: mkdir d3/d26 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:1/57: symlink d1/da/l12 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:8/78: symlink d2/lf 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:0/36: creat d6/d7/fc x:0 0 0 2024-02-10T00:00:28.652 INFO:tasks.workunit.client.0.smithi164.stdout:2/65: creat d3/f19 x:0 0 0 2024-02-10T00:00:28.654 INFO:tasks.workunit.client.0.smithi164.stdout:6/126: creat d0/d6/d12/f27 x:0 0 0 2024-02-10T00:00:28.655 INFO:tasks.workunit.client.0.smithi164.stdout:6/127: readlink d0/lf 0 2024-02-10T00:00:28.655 INFO:tasks.workunit.client.0.smithi164.stdout:4/71: mknod d2/dc/d16/c17 0 2024-02-10T00:00:28.655 INFO:tasks.workunit.client.0.smithi164.stdout:6/128: write d0/fb [2076016,40159] 0 2024-02-10T00:00:28.660 INFO:tasks.workunit.client.0.smithi164.stdout:2/66: dwrite d3/f11 [0,4194304] 0 2024-02-10T00:00:28.660 INFO:tasks.workunit.client.0.smithi164.stdout:7/118: rename d3/f1e to d3/d26/f27 0 2024-02-10T00:00:28.660 INFO:tasks.workunit.client.0.smithi164.stdout:5/91: getdents d7 0 2024-02-10T00:00:28.660 INFO:tasks.workunit.client.0.smithi164.stdout:7/119: dread - d3/f1d zero size 2024-02-10T00:00:28.660 INFO:tasks.workunit.client.0.smithi164.stdout:5/92: chown d7/l14 1 1 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:0/387: unlink d14/d1d/d2d/f7c 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:2/507: write d2/da/d20/d21/d43/f45 [328235,63133] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:4/428: write de/d14/f4a [161367,65479] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:1/402: read d0/d3c/f73 [1997683,3579] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:5/520: dread d4/dd/f54 [0,4194304] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:6/355: write d2/f18 [2356761,1947] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:9/443: dwrite d0/d3/d14/d48/f5e [0,4194304] 0 2024-02-10T00:00:28.662 INFO:tasks.workunit.client.1.smithi183.stdout:8/503: truncate d0/d45/f49 2148750 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:3/379: sync 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/504: dwrite d0/d31/f88 [0,4194304] 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/505: write d0/d27/f2e [1830456,14381] 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:0/388: symlink d14/d1d/d59/d3c/l8e 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:2/508: creat d2/da/d19/d31/d75/d35/fa5 x:0 0 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:1/403: rename d0/d3/d7/d3d/f95 to d0/d3/d67/d7b/f98 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:2/509: dread d2/da/d5b/f88 [0,4194304] 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:9/444: dread d0/d3/d14/d3c/f60 [0,4194304] 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:9/445: fsync d0/d3/f4e 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:9/446: chown d0/d3/d14/d1c/d4b/d51/l63 23780 1 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/506: creat d0/d4e/d53/fa3 x:0 0 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/507: fsync d0/d27/f8b 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:0/389: creat d14/d1d/d2d/f8f x:0 0 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:9/447: creat d0/d10/f98 x:0 0 0 2024-02-10T00:00:28.663 INFO:tasks.workunit.client.1.smithi183.stdout:7/411: sync 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:0/390: chown d14/l4e 1931 1 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:1/404: mkdir d0/d3/d7/d3d/d99 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:0/391: write d14/d1d/d59/d71/d22/f4f [627043,9646] 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:6/356: dread d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:6/357: fsync d2/d26/f2e 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:3/380: truncate d7/db/f24 1337332 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:8/508: mkdir d0/d10/d9e/da4 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:8/509: fdatasync d0/d4e/f4f 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:9/448: symlink d0/d10/l99 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:5/521: getdents d4/d23/d3e/d80/da1/d9e/d27/d5d 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:2/510: link d2/da/d20/l2b d2/d2c/d2f/d60/d8d/la6 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:6/358: unlink d2/d1a/d25/d3c/d31/d38/d3f/f4c 0 2024-02-10T00:00:28.664 INFO:tasks.workunit.client.1.smithi183.stdout:7/412: mknod d0/d2/d50/c6f 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:1/405: symlink d0/d3/d7/l9a 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:8/510: dread d0/d27/f2e [0,4194304] 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:0/392: creat d14/d1d/d59/d3c/d72/f90 x:0 0 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:8/511: chown d0/d10/f19 2582678 1 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:1/406: write d0/d3/d7/d3d/d60/f64 [1293670,48052] 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:3/381: fdatasync d7/db/d2a/d1c/f27 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:6/359: mknod d2/d26/d34/d61/c6d 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:9/449: link d0/d3/d14/f46 d0/d3/d14/d1c/d4b/d97/f9a 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:7/413: stat d0/d2/d4/f5 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:4/429: sync 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:2/511: mkdir d2/d2c/d2f/d60/d8d/d9c/da7 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:4/430: dwrite de/d22/f43 [0,4194304] 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:7/414: creat d0/d11/d3e/f70 x:0 0 0 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:7/415: dread - d0/f67 zero size 2024-02-10T00:00:28.665 INFO:tasks.workunit.client.1.smithi183.stdout:8/512: getdents d0/d27/d36/d7f 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:7/416: write d0/d11/d3e/f58 [360326,28471] 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:8/513: chown d0/d4e/d53/c76 591253 1 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:8/514: stat d0/d23/d2d/d24/f32 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:6/360: write d2/d32/f5c [168010,43017] 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:4/431: mknod de/d19/d20/c84 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:5/522: write d4/d23/d3e/d80/da1/d9e/d27/d38/f48 [1463308,103275] 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:8/515: dread d0/d4e/fa1 [0,4194304] 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:0/393: truncate d14/d3e/f69 523193 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:6/361: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:6/362: readlink d2/d32/l52 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:9/450: truncate d0/f5b 3582089 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:1/407: write d0/f1c [1497212,124069] 0 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:8/516: rmdir d0/d10 39 2024-02-10T00:00:28.666 INFO:tasks.workunit.client.1.smithi183.stdout:3/382: link d7/db/d2a/d33/l34 d7/db/d2a/d2d/d6a/l6f 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/363: dread - d2/d1a/d3a/d45/d53/f6a zero size 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:8/517: write d0/d27/d75/d5b/f5d [498064,83858] 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:1/408: unlink d0/d3/f88 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:4/432: dread de/f12 [0,4194304] 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:4/433: chown de/d14/d27/d2e/c46 14243129 1 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:3/383: creat d7/db/d2a/d4d/f70 x:0 0 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:2/512: sync 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:1/409: creat d0/d3/d7/d3d/d60/f9b x:0 0 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:2/513: write d2/d2c/d2f/d72/f92 [2205184,6292] 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:0/394: link d14/d1d/d59/d71/f1b d14/d1d/d2d/d31/f91 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:5/523: link d4/d23/f86 d4/d23/d3e/d80/da1/d9e/d27/d37/fa5 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:0/395: dwrite d14/d1d/d55/f84 [0,4194304] 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/364: rename d2/d26 to d2/d1a/d25/d3c/d31/d38/d6e 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/365: write d2/d1a/f49 [3585034,116744] 0 2024-02-10T00:00:28.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/366: fdatasync d2/d1a/d25/d3c/d31/d38/d3f/f4d 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:9/451: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:6/367: dwrite d2/d1a/d25/d3c/d31/d38/d3f/f4d [0,4194304] 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:2/514: creat d2/d2c/d2f/d60/d8d/fa8 x:0 0 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:6/368: write d2/d1a/d3a/f48 [985607,2756] 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:5/524: mkdir d4/d23/d3e/d80/da1/d9e/d27/d37/d46/da6 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:3/384: dwrite d7/db/d2a/f3a [4194304,4194304] 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:0/396: rename d14/d1d/d59/d3c/d3f to d14/d3e/d92 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:7/417: sync 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:4/434: truncate de/d14/d4e/f65 1255630 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:6/369: unlink d2/d1a/d3a/l60 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:8/518: getdents d0/d31 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:5/525: creat d4/d23/d3e/d80/da1/d9e/d89/fa7 x:0 0 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:5/526: stat d4/d23/d3e/d80/da1/d9e/d27/d37/c44 0 2024-02-10T00:00:28.668 INFO:tasks.workunit.client.1.smithi183.stdout:5/527: chown d4/d23/d3e/d80/da1/d9c 86 1 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:3/385: creat d7/db/d2a/d4d/f71 x:0 0 0 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:9/452: fdatasync d0/d3/d14/d1c/d2d/d4f/d79/f80 0 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:9/453: dread - d0/d3/d14/d1c/d2d/d4f/d58/f7e zero size 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:9/454: readlink d0/d3/d14/d3c/l64 0 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:8/519: chown d0/d10/f1a 52 1 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:1/410: truncate d0/d3/fa 8255075 0 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:8/520: dwrite d0/d10/f19 [4194304,4194304] 0 2024-02-10T00:00:28.669 INFO:tasks.workunit.client.1.smithi183.stdout:1/411: write d0/d3/d29/d1f/f5c [1412524,53235] 0 2024-02-10T00:00:28.670 INFO:tasks.workunit.client.1.smithi183.stdout:1/412: dwrite d0/d3/d7/d36/f50 [4194304,4194304] 0 2024-02-10T00:00:28.670 INFO:tasks.workunit.client.1.smithi183.stdout:4/435: dwrite de/d14/d27/d40/f66 [0,4194304] 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.1.smithi183.stdout:1/413: chown d0/l3e 317231 1 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.1.smithi183.stdout:4/436: write de/d19/d20/f6b [507346,32592] 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.1.smithi183.stdout:8/521: creat d0/d45/fa5 x:0 0 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:5/93: dread f5 [0,4194304] 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:9/103: sync 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:3/34: getdents d0/d1/d2 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:4/72: symlink d2/dc/l18 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:1/58: mkdir d1/d13 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:1/59: fsync d1/f6 0 2024-02-10T00:00:28.671 INFO:tasks.workunit.client.0.smithi164.stdout:2/67: mknod d3/c1a 0 2024-02-10T00:00:28.672 INFO:tasks.workunit.client.0.smithi164.stdout:5/94: unlink f5 0 2024-02-10T00:00:28.673 INFO:tasks.workunit.client.1.smithi183.stdout:7/418: creat d0/d2/d50/f71 x:0 0 0 2024-02-10T00:00:28.673 INFO:tasks.workunit.client.1.smithi183.stdout:5/528: symlink d4/d23/d3e/d80/da1/d9e/d27/la8 0 2024-02-10T00:00:28.674 INFO:tasks.workunit.client.0.smithi164.stdout:0/37: unlink f0 0 2024-02-10T00:00:28.675 INFO:tasks.workunit.client.1.smithi183.stdout:2/515: getdents d2/da/d20/d21/d43 0 2024-02-10T00:00:28.675 INFO:tasks.workunit.client.1.smithi183.stdout:7/419: write d0/d2/d4/d8/f13 [252169,46844] 0 2024-02-10T00:00:28.676 INFO:tasks.workunit.client.1.smithi183.stdout:9/455: getdents d0/d3/d14/d74/d90 0 2024-02-10T00:00:28.676 INFO:tasks.workunit.client.0.smithi164.stdout:8/79: truncate d2/fa 4581170 0 2024-02-10T00:00:28.678 INFO:tasks.workunit.client.0.smithi164.stdout:7/120: mkdir d3/d28 0 2024-02-10T00:00:28.678 INFO:tasks.workunit.client.0.smithi164.stdout:0/38: dwrite f5 [0,4194304] 0 2024-02-10T00:00:28.679 INFO:tasks.workunit.client.1.smithi183.stdout:2/516: dread d2/da/d19/f7a [0,4194304] 0 2024-02-10T00:00:28.679 INFO:tasks.workunit.client.0.smithi164.stdout:2/68: mkdir d3/d1b 0 2024-02-10T00:00:28.680 INFO:tasks.workunit.client.1.smithi183.stdout:0/397: getdents d14 0 2024-02-10T00:00:28.681 INFO:tasks.workunit.client.1.smithi183.stdout:1/414: symlink d0/d3/d67/d7b/l9c 0 2024-02-10T00:00:28.681 INFO:tasks.workunit.client.1.smithi183.stdout:4/437: symlink de/d19/d1c/d61/l85 0 2024-02-10T00:00:28.682 INFO:tasks.workunit.client.0.smithi164.stdout:5/95: unlink f0 0 2024-02-10T00:00:28.682 INFO:tasks.workunit.client.1.smithi183.stdout:5/529: rmdir d4/d23/d3e/d80 39 2024-02-10T00:00:28.682 INFO:tasks.workunit.client.0.smithi164.stdout:3/35: fdatasync d0/f4 0 2024-02-10T00:00:28.683 INFO:tasks.workunit.client.1.smithi183.stdout:6/370: getdents d2/d1a/d25/d3c/d31 0 2024-02-10T00:00:28.684 INFO:tasks.workunit.client.0.smithi164.stdout:1/60: creat d1/d13/f14 x:0 0 0 2024-02-10T00:00:28.685 INFO:tasks.workunit.client.0.smithi164.stdout:3/36: read d0/f4 [6839056,28970] 0 2024-02-10T00:00:28.686 INFO:tasks.workunit.client.0.smithi164.stdout:7/121: dwrite d3/d5/fe [0,4194304] 0 2024-02-10T00:00:28.686 INFO:tasks.workunit.client.1.smithi183.stdout:8/522: getdents d0/d3f/d94 0 2024-02-10T00:00:28.687 INFO:tasks.workunit.client.0.smithi164.stdout:0/39: unlink d6/f9 0 2024-02-10T00:00:28.687 INFO:tasks.workunit.client.0.smithi164.stdout:3/37: stat d0/d1/d2/f7 0 2024-02-10T00:00:28.688 INFO:tasks.workunit.client.0.smithi164.stdout:2/69: dwrite d3/f18 [0,4194304] 0 2024-02-10T00:00:28.688 INFO:tasks.workunit.client.1.smithi183.stdout:0/398: mkdir d14/d1d/d59/d3c/d93 0 2024-02-10T00:00:28.689 INFO:tasks.workunit.client.1.smithi183.stdout:0/399: readlink d14/d43/l50 0 2024-02-10T00:00:28.689 INFO:tasks.workunit.client.1.smithi183.stdout:0/400: readlink d14/d3e/d92/l66 0 2024-02-10T00:00:28.690 INFO:tasks.workunit.client.0.smithi164.stdout:5/96: creat d7/d15/f1b x:0 0 0 2024-02-10T00:00:28.691 INFO:tasks.workunit.client.1.smithi183.stdout:2/517: rename d2/da/d19/d31/f6c to d2/d2c/d2f/d60/d8d/fa9 0 2024-02-10T00:00:28.691 INFO:tasks.workunit.client.0.smithi164.stdout:3/38: dread d0/f4 [4194304,4194304] 0 2024-02-10T00:00:28.692 INFO:tasks.workunit.client.1.smithi183.stdout:4/438: creat de/d14/d27/d2e/f86 x:0 0 0 2024-02-10T00:00:28.692 INFO:tasks.workunit.client.1.smithi183.stdout:4/439: stat de/d19/d1c/d61/c79 0 2024-02-10T00:00:28.693 INFO:tasks.workunit.client.1.smithi183.stdout:4/440: chown de/d19/d1c/d61/l83 123 1 2024-02-10T00:00:28.693 INFO:tasks.workunit.client.0.smithi164.stdout:1/61: mknod d1/da/c15 0 2024-02-10T00:00:28.695 INFO:tasks.workunit.client.1.smithi183.stdout:9/456: link d0/d3/d14/d48/f5e d0/d3/d14/d1c/d2d/d4f/d89/f9b 0 2024-02-10T00:00:28.695 INFO:tasks.workunit.client.0.smithi164.stdout:7/122: unlink d3/d5/fb 0 2024-02-10T00:00:28.696 INFO:tasks.workunit.client.1.smithi183.stdout:9/457: stat d0/d3/d14/d1c/d4b/d51/c6b 0 2024-02-10T00:00:28.696 INFO:tasks.workunit.client.0.smithi164.stdout:0/40: creat d6/d7/fd x:0 0 0 2024-02-10T00:00:28.697 INFO:tasks.workunit.client.1.smithi183.stdout:9/458: dread - d0/d3/d14/d1c/d4b/f65 zero size 2024-02-10T00:00:28.697 INFO:tasks.workunit.client.0.smithi164.stdout:5/97: dwrite d7/f19 [0,4194304] 0 2024-02-10T00:00:28.698 INFO:tasks.workunit.client.1.smithi183.stdout:2/518: mknod d2/da/d20/d21/d43/d58/d74/d83/caa 0 2024-02-10T00:00:28.699 INFO:tasks.workunit.client.0.smithi164.stdout:3/39: symlink d0/d1/d2/lb 0 2024-02-10T00:00:28.699 INFO:tasks.workunit.client.0.smithi164.stdout:5/98: write d7/fd [2917988,119688] 0 2024-02-10T00:00:28.701 INFO:tasks.workunit.client.0.smithi164.stdout:1/62: truncate d1/f4 648467 0 2024-02-10T00:00:28.701 INFO:tasks.workunit.client.1.smithi183.stdout:8/523: mkdir d0/d4e/da6 0 2024-02-10T00:00:28.702 INFO:tasks.workunit.client.0.smithi164.stdout:3/40: dread d0/d1/d2/f7 [0,4194304] 0 2024-02-10T00:00:28.703 INFO:tasks.workunit.client.0.smithi164.stdout:6/129: sync 2024-02-10T00:00:28.703 INFO:tasks.workunit.client.1.smithi183.stdout:9/459: rmdir d0/d10 39 2024-02-10T00:00:28.704 INFO:tasks.workunit.client.0.smithi164.stdout:2/70: rmdir d3/d1b 0 2024-02-10T00:00:28.704 INFO:tasks.workunit.client.0.smithi164.stdout:2/71: chown d3/f11 30 1 2024-02-10T00:00:28.705 INFO:tasks.workunit.client.0.smithi164.stdout:2/72: dread - d3/f7 zero size 2024-02-10T00:00:28.705 INFO:tasks.workunit.client.0.smithi164.stdout:6/130: creat d0/d6/f28 x:0 0 0 2024-02-10T00:00:28.705 INFO:tasks.workunit.client.1.smithi183.stdout:4/441: symlink de/l87 0 2024-02-10T00:00:28.706 INFO:tasks.workunit.client.1.smithi183.stdout:4/442: chown de/d14/d1d/c3a 130245939 1 2024-02-10T00:00:28.706 INFO:tasks.workunit.client.1.smithi183.stdout:4/443: chown de/d19/d20/f5e 203 1 2024-02-10T00:00:28.707 INFO:tasks.workunit.client.1.smithi183.stdout:9/460: rmdir d0/d3/d14/d48 39 2024-02-10T00:00:28.710 INFO:tasks.workunit.client.1.smithi183.stdout:1/415: rename d0/d3/d7/d3d/f4f to d0/f9d 0 2024-02-10T00:00:28.710 INFO:tasks.workunit.client.0.smithi164.stdout:7/123: link d3/d5/l20 d3/d26/l29 0 2024-02-10T00:00:28.710 INFO:tasks.workunit.client.0.smithi164.stdout:2/73: creat d3/f1c x:0 0 0 2024-02-10T00:00:28.712 INFO:tasks.workunit.client.0.smithi164.stdout:7/124: symlink d3/d26/l2a 0 2024-02-10T00:00:28.715 INFO:tasks.workunit.client.0.smithi164.stdout:7/125: mkdir d3/d5/d2b 0 2024-02-10T00:00:28.716 INFO:tasks.workunit.client.1.smithi183.stdout:1/416: fdatasync d0/d3/d7/f8d 0 2024-02-10T00:00:28.716 INFO:tasks.workunit.client.0.smithi164.stdout:2/74: rename d3/l13 to d3/l1d 0 2024-02-10T00:00:28.718 INFO:tasks.workunit.client.0.smithi164.stdout:2/75: symlink d3/l1e 0 2024-02-10T00:00:28.719 INFO:tasks.workunit.client.0.smithi164.stdout:2/76: stat d3/fe 0 2024-02-10T00:00:28.719 INFO:tasks.workunit.client.0.smithi164.stdout:7/126: getdents d3/d11 0 2024-02-10T00:00:28.720 INFO:tasks.workunit.client.1.smithi183.stdout:2/519: rename d2/d2c/d2f/d72/d7b to d2/d2c/dab 0 2024-02-10T00:00:28.721 INFO:tasks.workunit.client.0.smithi164.stdout:4/73: getdents d2/dc/d16 0 2024-02-10T00:00:28.722 INFO:tasks.workunit.client.1.smithi183.stdout:9/461: link d0/d10/f7c d0/d3/d14/d48/f9c 0 2024-02-10T00:00:28.722 INFO:tasks.workunit.client.0.smithi164.stdout:4/74: read d2/fb [3491503,90141] 0 2024-02-10T00:00:28.723 INFO:tasks.workunit.client.1.smithi183.stdout:2/520: chown d2/da/ce 3809068 1 2024-02-10T00:00:28.723 INFO:tasks.workunit.client.1.smithi183.stdout:9/462: chown d0/d3/f29 0 1 2024-02-10T00:00:28.723 INFO:tasks.workunit.client.1.smithi183.stdout:1/417: truncate d0/f8a 821800 0 2024-02-10T00:00:28.724 INFO:tasks.workunit.client.1.smithi183.stdout:1/418: chown d0/d3/d7/d3d/d60/d89/l90 7774911 1 2024-02-10T00:00:28.725 INFO:tasks.workunit.client.1.smithi183.stdout:2/521: symlink d2/da/d20/d21/d43/d58/d74/lac 0 2024-02-10T00:00:28.725 INFO:tasks.workunit.client.1.smithi183.stdout:1/419: dread - d0/d3/d67/d70/f81 zero size 2024-02-10T00:00:28.726 INFO:tasks.workunit.client.1.smithi183.stdout:9/463: truncate d0/d3/d14/f46 4701616 0 2024-02-10T00:00:28.726 INFO:tasks.workunit.client.0.smithi164.stdout:9/104: write f2 [1077355,75966] 0 2024-02-10T00:00:28.727 INFO:tasks.workunit.client.1.smithi183.stdout:1/420: mknod d0/d3/d29/d38/c9e 0 2024-02-10T00:00:28.728 INFO:tasks.workunit.client.0.smithi164.stdout:2/77: rename d3/f1c to d3/f1f 0 2024-02-10T00:00:28.728 INFO:tasks.workunit.client.0.smithi164.stdout:2/78: chown d3/l1e 11 1 2024-02-10T00:00:28.729 INFO:tasks.workunit.client.1.smithi183.stdout:9/464: unlink d0/d3/d14/d1c/d4b/f96 0 2024-02-10T00:00:28.730 INFO:tasks.workunit.client.0.smithi164.stdout:8/80: truncate d2/f7 273421 0 2024-02-10T00:00:28.730 INFO:tasks.workunit.client.1.smithi183.stdout:2/522: dwrite d2/da/d77/f4f [0,4194304] 0 2024-02-10T00:00:28.731 INFO:tasks.workunit.client.1.smithi183.stdout:2/523: write d2/da/d19/d31/d75/d35/f4e [1506660,6526] 0 2024-02-10T00:00:28.732 INFO:tasks.workunit.client.0.smithi164.stdout:4/75: rename d2/dc to d2/d19 0 2024-02-10T00:00:28.734 INFO:tasks.workunit.client.0.smithi164.stdout:9/105: mkdir d6/de/d22 0 2024-02-10T00:00:28.735 INFO:tasks.workunit.client.0.smithi164.stdout:9/106: write d6/f20 [920704,15633] 0 2024-02-10T00:00:28.735 INFO:tasks.workunit.client.1.smithi183.stdout:9/465: mknod d0/d3/d14/d1c/d2d/d4f/c9d 0 2024-02-10T00:00:28.735 INFO:tasks.workunit.client.0.smithi164.stdout:9/107: rename d6 to d6/d1c/d23 22 2024-02-10T00:00:28.736 INFO:tasks.workunit.client.1.smithi183.stdout:9/466: write d0/f2f [2153846,4719] 0 2024-02-10T00:00:28.736 INFO:tasks.workunit.client.0.smithi164.stdout:2/79: rename d3/l9 to d3/l20 0 2024-02-10T00:00:28.737 INFO:tasks.workunit.client.0.smithi164.stdout:5/99: fdatasync d7/fd 0 2024-02-10T00:00:28.737 INFO:tasks.workunit.client.0.smithi164.stdout:7/127: mknod d3/c2c 0 2024-02-10T00:00:28.737 INFO:tasks.workunit.client.0.smithi164.stdout:0/41: sync 2024-02-10T00:00:28.737 INFO:tasks.workunit.client.0.smithi164.stdout:3/41: sync 2024-02-10T00:00:28.737 INFO:tasks.workunit.client.0.smithi164.stdout:5/100: stat f1 0 2024-02-10T00:00:28.738 INFO:tasks.workunit.client.0.smithi164.stdout:3/42: stat d0/d1/d2 0 2024-02-10T00:00:28.739 INFO:tasks.workunit.client.1.smithi183.stdout:2/524: link d2/da/d19/d31/c4d d2/da/d19/cad 0 2024-02-10T00:00:28.740 INFO:tasks.workunit.client.0.smithi164.stdout:0/42: fsync f3 0 2024-02-10T00:00:28.741 INFO:tasks.workunit.client.0.smithi164.stdout:3/43: dread d0/d1/d2/f7 [0,4194304] 0 2024-02-10T00:00:28.742 INFO:tasks.workunit.client.1.smithi183.stdout:9/467: dwrite d0/d3/d14/d48/f5e [0,4194304] 0 2024-02-10T00:00:28.744 INFO:tasks.workunit.client.1.smithi183.stdout:3/386: dwrite d7/f9 [0,4194304] 0 2024-02-10T00:00:28.745 INFO:tasks.workunit.client.1.smithi183.stdout:3/387: chown d7/f48 7739219 1 2024-02-10T00:00:28.746 INFO:tasks.workunit.client.1.smithi183.stdout:3/388: write d7/fe [13245532,33882] 0 2024-02-10T00:00:28.749 INFO:tasks.workunit.client.0.smithi164.stdout:1/63: truncate d1/fd 250121 0 2024-02-10T00:00:28.751 INFO:tasks.workunit.client.0.smithi164.stdout:1/64: write d1/f7 [257844,80190] 0 2024-02-10T00:00:28.754 INFO:tasks.workunit.client.0.smithi164.stdout:6/131: dwrite d0/d6/d12/d14/f1e [0,4194304] 0 2024-02-10T00:00:28.754 INFO:tasks.workunit.client.1.smithi183.stdout:7/420: dread d0/d11/d2f/f34 [0,4194304] 0 2024-02-10T00:00:28.758 INFO:tasks.workunit.client.1.smithi183.stdout:5/530: write d4/dd/f75 [510132,40545] 0 2024-02-10T00:00:28.758 INFO:tasks.workunit.client.1.smithi183.stdout:0/401: write d14/d1d/d59/d71/f56 [179978,47525] 0 2024-02-10T00:00:28.759 INFO:tasks.workunit.client.0.smithi164.stdout:2/80: symlink d3/l21 0 2024-02-10T00:00:28.759 INFO:tasks.workunit.client.1.smithi183.stdout:1/421: getdents d0/d3/d7/d3d 0 2024-02-10T00:00:28.760 INFO:tasks.workunit.client.0.smithi164.stdout:3/44: mkdir d0/dc 0 2024-02-10T00:00:28.761 INFO:tasks.workunit.client.1.smithi183.stdout:6/371: dread d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:28.762 INFO:tasks.workunit.client.0.smithi164.stdout:4/76: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:28.763 INFO:tasks.workunit.client.0.smithi164.stdout:1/65: mkdir d1/d13/d16 0 2024-02-10T00:00:28.767 INFO:tasks.workunit.client.1.smithi183.stdout:4/444: sync 2024-02-10T00:00:28.767 INFO:tasks.workunit.client.0.smithi164.stdout:6/132: creat d0/d6/d12/d14/f29 x:0 0 0 2024-02-10T00:00:28.767 INFO:tasks.workunit.client.0.smithi164.stdout:5/101: getdents d7/d17 0 2024-02-10T00:00:28.768 INFO:tasks.workunit.client.1.smithi183.stdout:4/445: write de/f1f [3316432,128456] 0 2024-02-10T00:00:28.768 INFO:tasks.workunit.client.1.smithi183.stdout:3/389: dread d7/fe [4194304,4194304] 0 2024-02-10T00:00:28.769 INFO:tasks.workunit.client.1.smithi183.stdout:3/390: dread - d7/db/d2a/d2d/d6a/f6c zero size 2024-02-10T00:00:28.771 INFO:tasks.workunit.client.0.smithi164.stdout:0/43: link d6/cb d6/ce 0 2024-02-10T00:00:28.772 INFO:tasks.workunit.client.0.smithi164.stdout:5/102: dwrite d7/d15/f1b [0,4194304] 0 2024-02-10T00:00:28.773 INFO:tasks.workunit.client.0.smithi164.stdout:6/133: dwrite d0/d6/f13 [0,4194304] 0 2024-02-10T00:00:28.773 INFO:tasks.workunit.client.1.smithi183.stdout:0/402: creat d14/d1d/d59/d3c/d72/f94 x:0 0 0 2024-02-10T00:00:28.776 INFO:tasks.workunit.client.0.smithi164.stdout:9/108: getdents d6 0 2024-02-10T00:00:28.776 INFO:tasks.workunit.client.0.smithi164.stdout:0/44: mkdir d6/d7/df 0 2024-02-10T00:00:28.777 INFO:tasks.workunit.client.0.smithi164.stdout:9/109: write d6/f7 [2126158,121275] 0 2024-02-10T00:00:28.777 INFO:tasks.workunit.client.0.smithi164.stdout:4/77: truncate d2/d19/f11 9230 0 2024-02-10T00:00:28.778 INFO:tasks.workunit.client.0.smithi164.stdout:0/45: write f5 [2616919,40875] 0 2024-02-10T00:00:28.778 INFO:tasks.workunit.client.0.smithi164.stdout:6/134: symlink d0/d6/d12/d14/l2a 0 2024-02-10T00:00:28.779 INFO:tasks.workunit.client.0.smithi164.stdout:6/135: chown d0/lf 35 1 2024-02-10T00:00:28.779 INFO:tasks.workunit.client.0.smithi164.stdout:6/136: dread - d0/d6/d12/f27 zero size 2024-02-10T00:00:28.780 INFO:tasks.workunit.client.1.smithi183.stdout:8/524: link d0/d4e/d53/f64 d0/d45/d46/d81/fa7 0 2024-02-10T00:00:28.781 INFO:tasks.workunit.client.0.smithi164.stdout:5/103: rename d7/d15/f1b to d7/d17/f1c 0 2024-02-10T00:00:28.781 INFO:tasks.workunit.client.1.smithi183.stdout:4/446: creat de/d14/d27/d2e/f88 x:0 0 0 2024-02-10T00:00:28.781 INFO:tasks.workunit.client.1.smithi183.stdout:3/391: rename d7/f48 to d7/db/d2a/d33/f72 0 2024-02-10T00:00:28.782 INFO:tasks.workunit.client.1.smithi183.stdout:5/531: mkdir d4/d23/d3e/d80/da1/d9c/d72/da0/da9 0 2024-02-10T00:00:28.783 INFO:tasks.workunit.client.1.smithi183.stdout:1/422: fsync d0/d3/d7/f6c 0 2024-02-10T00:00:28.784 INFO:tasks.workunit.client.1.smithi183.stdout:0/403: rename d14/d1d/d59/l4c to d14/d7a/d63/l95 0 2024-02-10T00:00:28.785 INFO:tasks.workunit.client.1.smithi183.stdout:3/392: rmdir d7/db/d2a/d1c 39 2024-02-10T00:00:28.785 INFO:tasks.workunit.client.0.smithi164.stdout:9/110: mkdir d6/d1c/d24 0 2024-02-10T00:00:28.786 INFO:tasks.workunit.client.1.smithi183.stdout:3/393: write d7/f20 [4651983,60162] 0 2024-02-10T00:00:28.786 INFO:tasks.workunit.client.0.smithi164.stdout:9/111: fsync d6/f20 0 2024-02-10T00:00:28.786 INFO:tasks.workunit.client.1.smithi183.stdout:4/447: fdatasync de/d14/d27/f1b 0 2024-02-10T00:00:28.787 INFO:tasks.workunit.client.1.smithi183.stdout:3/394: fdatasync d7/db/d2a/d33/d59/d52/f60 0 2024-02-10T00:00:28.787 INFO:tasks.workunit.client.0.smithi164.stdout:9/112: write d6/f18 [559538,74472] 0 2024-02-10T00:00:28.787 INFO:tasks.workunit.client.0.smithi164.stdout:7/128: sync 2024-02-10T00:00:28.788 INFO:tasks.workunit.client.0.smithi164.stdout:9/113: write d6/fb [1185927,80978] 0 2024-02-10T00:00:28.788 INFO:tasks.workunit.client.1.smithi183.stdout:3/395: fdatasync d7/db/d2a/d4d/f70 0 2024-02-10T00:00:28.788 INFO:tasks.workunit.client.0.smithi164.stdout:9/114: write d6/fb [1438184,18305] 0 2024-02-10T00:00:28.789 INFO:tasks.workunit.client.0.smithi164.stdout:9/115: chown d6/f7 19603 1 2024-02-10T00:00:28.789 INFO:tasks.workunit.client.0.smithi164.stdout:9/116: write d6/de/f11 [1573246,43082] 0 2024-02-10T00:00:28.790 INFO:tasks.workunit.client.1.smithi183.stdout:4/448: dwrite de/f12 [0,4194304] 0 2024-02-10T00:00:28.792 INFO:tasks.workunit.client.1.smithi183.stdout:6/372: creat d2/d1a/f6f x:0 0 0 2024-02-10T00:00:28.792 INFO:tasks.workunit.client.1.smithi183.stdout:2/525: sync 2024-02-10T00:00:28.793 INFO:tasks.workunit.client.1.smithi183.stdout:2/526: write d2/da/d19/d31/f80 [4713016,6092] 0 2024-02-10T00:00:28.793 INFO:tasks.workunit.client.1.smithi183.stdout:2/527: chown d2 15654 1 2024-02-10T00:00:28.799 INFO:tasks.workunit.client.0.smithi164.stdout:4/78: creat d2/f1a x:0 0 0 2024-02-10T00:00:28.826 INFO:tasks.workunit.client.1.smithi183.stdout:0/404: mkdir d14/d1d/d96 0 2024-02-10T00:00:28.827 INFO:tasks.workunit.client.1.smithi183.stdout:0/405: stat d14/d1d/d59/d71/c3d 0 2024-02-10T00:00:28.827 INFO:tasks.workunit.client.1.smithi183.stdout:0/406: chown d14/d1d/d59/d3c/l52 9304 1 2024-02-10T00:00:28.827 INFO:tasks.workunit.client.1.smithi183.stdout:5/532: symlink d4/d23/d3e/d80/da1/d9e/d27/d9d/laa 0 2024-02-10T00:00:28.829 INFO:tasks.workunit.client.1.smithi183.stdout:5/533: dread - d4/dd/d31/d73/f98 zero size 2024-02-10T00:00:28.831 INFO:tasks.workunit.client.1.smithi183.stdout:7/421: dwrite d0/d11/f1c [0,4194304] 0 2024-02-10T00:00:28.832 INFO:tasks.workunit.client.1.smithi183.stdout:7/422: chown d0/d2/d3 1 1 2024-02-10T00:00:28.833 INFO:tasks.workunit.client.0.smithi164.stdout:2/81: getdents d3 0 2024-02-10T00:00:28.838 INFO:tasks.workunit.client.0.smithi164.stdout:3/45: write d0/f4 [3278381,127877] 0 2024-02-10T00:00:28.838 INFO:tasks.workunit.client.0.smithi164.stdout:1/66: write d1/f11 [5031072,53717] 0 2024-02-10T00:00:28.840 INFO:tasks.workunit.client.0.smithi164.stdout:1/67: write d1/da/fb [3219815,2814] 0 2024-02-10T00:00:28.840 INFO:tasks.workunit.client.0.smithi164.stdout:3/46: write d0/d1/d2/f7 [11931015,91086] 0 2024-02-10T00:00:28.841 INFO:tasks.workunit.client.1.smithi183.stdout:9/468: sync 2024-02-10T00:00:28.842 INFO:tasks.workunit.client.0.smithi164.stdout:8/81: dwrite d2/f4 [0,4194304] 0 2024-02-10T00:00:28.843 INFO:tasks.workunit.client.1.smithi183.stdout:3/396: symlink d7/db/d2a/d2d/d51/l73 0 2024-02-10T00:00:28.844 INFO:tasks.workunit.client.0.smithi164.stdout:3/47: dread d0/d1/d2/f7 [0,4194304] 0 2024-02-10T00:00:28.845 INFO:tasks.workunit.client.1.smithi183.stdout:7/423: read d0/d11/f47 [3763709,93536] 0 2024-02-10T00:00:28.845 INFO:tasks.workunit.client.1.smithi183.stdout:7/424: fsync d0/d11/f47 0 2024-02-10T00:00:28.868 INFO:tasks.workunit.client.1.smithi183.stdout:6/373: sync 2024-02-10T00:00:28.870 INFO:tasks.workunit.client.1.smithi183.stdout:8/525: truncate d0/d31/f88 1628419 0 2024-02-10T00:00:28.873 INFO:tasks.workunit.client.1.smithi183.stdout:4/449: write de/d14/d27/f1b [4971759,78883] 0 2024-02-10T00:00:28.878 INFO:tasks.workunit.client.1.smithi183.stdout:2/528: mkdir d2/da/d19/d31/d75/d35/dae 0 2024-02-10T00:00:28.880 INFO:tasks.workunit.client.1.smithi183.stdout:5/534: write d4/d23/d4a/d36/f5e [1169314,46347] 0 2024-02-10T00:00:28.883 INFO:tasks.workunit.client.1.smithi183.stdout:3/397: mknod d7/db/d2a/d2d/c74 0 2024-02-10T00:00:28.886 INFO:tasks.workunit.client.0.smithi164.stdout:6/137: mkdir d0/d2b 0 2024-02-10T00:00:28.886 INFO:tasks.workunit.client.1.smithi183.stdout:8/526: symlink d0/d4e/d53/la8 0 2024-02-10T00:00:28.887 INFO:tasks.workunit.client.0.smithi164.stdout:5/104: creat d7/f1d x:0 0 0 2024-02-10T00:00:28.889 INFO:tasks.workunit.client.0.smithi164.stdout:7/129: rmdir d3/d11 39 2024-02-10T00:00:28.889 INFO:tasks.workunit.client.0.smithi164.stdout:7/130: fsync d3/f9 0 2024-02-10T00:00:28.890 INFO:tasks.workunit.client.0.smithi164.stdout:6/138: dread d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:28.890 INFO:tasks.workunit.client.0.smithi164.stdout:6/139: chown d0/cd 3067 1 2024-02-10T00:00:28.892 INFO:tasks.workunit.client.1.smithi183.stdout:0/407: unlink d14/d1d/d59/c19 0 2024-02-10T00:00:28.893 INFO:tasks.workunit.client.0.smithi164.stdout:9/117: unlink d6/fb 0 2024-02-10T00:00:28.893 INFO:tasks.workunit.client.0.smithi164.stdout:4/79: rename d2/f12 to d2/d19/d16/f1b 0 2024-02-10T00:00:28.894 INFO:tasks.workunit.client.1.smithi183.stdout:1/423: truncate d0/d3c/f73 1674932 0 2024-02-10T00:00:28.896 INFO:tasks.workunit.client.0.smithi164.stdout:6/140: dwrite d0/f11 [0,4194304] 0 2024-02-10T00:00:28.899 INFO:tasks.workunit.client.0.smithi164.stdout:6/141: write d0/d6/f8 [1598149,47475] 0 2024-02-10T00:00:28.899 INFO:tasks.workunit.client.0.smithi164.stdout:0/46: dwrite f1 [0,4194304] 0 2024-02-10T00:00:28.899 INFO:tasks.workunit.client.0.smithi164.stdout:8/82: creat d2/f10 x:0 0 0 2024-02-10T00:00:28.901 INFO:tasks.workunit.client.0.smithi164.stdout:6/142: readlink d0/l15 0 2024-02-10T00:00:28.901 INFO:tasks.workunit.client.0.smithi164.stdout:0/47: fdatasync f3 0 2024-02-10T00:00:28.901 INFO:tasks.workunit.client.0.smithi164.stdout:3/48: mkdir d0/d1/dd 0 2024-02-10T00:00:28.901 INFO:tasks.workunit.client.1.smithi183.stdout:5/535: chown d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/l6e 3 1 2024-02-10T00:00:28.902 INFO:tasks.workunit.client.0.smithi164.stdout:5/105: symlink d7/l1e 0 2024-02-10T00:00:28.903 INFO:tasks.workunit.client.1.smithi183.stdout:7/425: symlink d0/d2/l72 0 2024-02-10T00:00:28.906 INFO:tasks.workunit.client.0.smithi164.stdout:8/83: dwrite d2/f4 [0,4194304] 0 2024-02-10T00:00:28.909 INFO:tasks.workunit.client.1.smithi183.stdout:3/398: chown d7/db/d2a/d33/l34 1 1 2024-02-10T00:00:28.911 INFO:tasks.workunit.client.1.smithi183.stdout:0/408: mknod d14/d1d/d59/d3c/d72/c97 0 2024-02-10T00:00:28.912 INFO:tasks.workunit.client.1.smithi183.stdout:1/424: symlink d0/d3/d29/l9f 0 2024-02-10T00:00:28.912 INFO:tasks.workunit.client.1.smithi183.stdout:1/425: dread - d0/d3/d67/d70/f81 zero size 2024-02-10T00:00:28.913 INFO:tasks.workunit.client.1.smithi183.stdout:2/529: symlink d2/da/d19/d31/d9b/laf 0 2024-02-10T00:00:28.915 INFO:tasks.workunit.client.0.smithi164.stdout:6/143: unlink d0/d6/f13 0 2024-02-10T00:00:28.915 INFO:tasks.workunit.client.1.smithi183.stdout:3/399: rename c4 to d7/db/d2a/d4d/d63/c75 0 2024-02-10T00:00:28.917 INFO:tasks.workunit.client.1.smithi183.stdout:8/527: read d0/fd [4162775,104456] 0 2024-02-10T00:00:28.917 INFO:tasks.workunit.client.1.smithi183.stdout:5/536: mknod d4/d23/d3e/d80/da1/d9c/d72/da0/da9/cab 0 2024-02-10T00:00:28.917 INFO:tasks.workunit.client.0.smithi164.stdout:0/48: rename d6/d7/df to d6/d10 0 2024-02-10T00:00:28.918 INFO:tasks.workunit.client.0.smithi164.stdout:5/106: readlink d7/d15/l18 0 2024-02-10T00:00:28.918 INFO:tasks.workunit.client.1.smithi183.stdout:2/530: dwrite d2/d2c/d2f/f6a [0,4194304] 0 2024-02-10T00:00:28.919 INFO:tasks.workunit.client.0.smithi164.stdout:8/84: creat d2/f11 x:0 0 0 2024-02-10T00:00:28.920 INFO:tasks.workunit.client.1.smithi183.stdout:5/537: dread - d4/d23/d3e/d80/da1/d9e/d27/d37/fa5 zero size 2024-02-10T00:00:28.920 INFO:tasks.workunit.client.0.smithi164.stdout:6/144: dread d0/d6/f8 [0,4194304] 0 2024-02-10T00:00:28.920 INFO:tasks.workunit.client.0.smithi164.stdout:2/82: truncate d3/f7 544817 0 2024-02-10T00:00:28.920 INFO:tasks.workunit.client.0.smithi164.stdout:3/49: dwrite d0/f4 [4194304,4194304] 0 2024-02-10T00:00:28.921 INFO:tasks.workunit.client.1.smithi183.stdout:3/400: symlink d7/db/d2a/d4d/l76 0 2024-02-10T00:00:28.923 INFO:tasks.workunit.client.1.smithi183.stdout:5/538: stat d4/d23/d3e/d80/da1/d9e/d27/d37/d46 0 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.0.smithi164.stdout:0/49: creat d6/f11 x:0 0 0 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.0.smithi164.stdout:3/50: dwrite d0/d1/d2/f7 [4194304,4194304] 0 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.0.smithi164.stdout:5/107: mkdir d7/d15/d1f 0 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.0.smithi164.stdout:8/85: chown d2/l3 0 1 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.0.smithi164.stdout:2/83: creat d3/f22 x:0 0 0 2024-02-10T00:00:28.929 INFO:tasks.workunit.client.1.smithi183.stdout:8/528: dwrite d0/d23/d2d/d24/f28 [0,4194304] 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:2/531: dwrite d2/d2c/f6f [0,4194304] 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:0/409: rename d14/d1d/d59/f5e to d14/d1d/d59/d71/d22/f98 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:3/401: symlink d7/db/d2a/d33/l77 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:0/410: write d14/d7a/f82 [454898,105255] 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:8/529: rmdir d0/d10 39 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:3/402: write d7/db/d2a/d33/f56 [4980379,71648] 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.1.smithi183.stdout:8/530: read d0/d27/f68 [3641329,18408] 0 2024-02-10T00:00:28.930 INFO:tasks.workunit.client.0.smithi164.stdout:6/145: mknod d0/d6/d12/d14/c2c 0 2024-02-10T00:00:28.931 INFO:tasks.workunit.client.0.smithi164.stdout:7/131: link d3/d11/f23 d3/f2d 0 2024-02-10T00:00:28.932 INFO:tasks.workunit.client.1.smithi183.stdout:2/532: dwrite d2/d2c/f6f [0,4194304] 0 2024-02-10T00:00:28.933 INFO:tasks.workunit.client.1.smithi183.stdout:2/533: read d2/da/f1d [3739275,68883] 0 2024-02-10T00:00:28.933 INFO:tasks.workunit.client.1.smithi183.stdout:0/411: fdatasync d14/d1d/d55/f5a 0 2024-02-10T00:00:28.933 INFO:tasks.workunit.client.0.smithi164.stdout:0/50: symlink d6/d10/l12 0 2024-02-10T00:00:28.933 INFO:tasks.workunit.client.0.smithi164.stdout:0/51: readlink d6/d7/la 0 2024-02-10T00:00:28.934 INFO:tasks.workunit.client.1.smithi183.stdout:2/534: write d2/da/d19/d31/d75/d35/f4e [1544390,25469] 0 2024-02-10T00:00:28.936 INFO:tasks.workunit.client.1.smithi183.stdout:1/426: rename d0/d3/d7/d36/l33 to d0/d3/d67/d70/la0 0 2024-02-10T00:00:28.937 INFO:tasks.workunit.client.1.smithi183.stdout:8/531: mknod d0/d27/d75/ca9 0 2024-02-10T00:00:28.937 INFO:tasks.workunit.client.0.smithi164.stdout:2/84: creat d3/f23 x:0 0 0 2024-02-10T00:00:28.937 INFO:tasks.workunit.client.1.smithi183.stdout:8/532: readlink d0/d27/d36/l9d 0 2024-02-10T00:00:28.938 INFO:tasks.workunit.client.0.smithi164.stdout:8/86: dread d2/fa [0,4194304] 0 2024-02-10T00:00:28.939 INFO:tasks.workunit.client.0.smithi164.stdout:6/146: symlink d0/d6/l2d 0 2024-02-10T00:00:28.939 INFO:tasks.workunit.client.0.smithi164.stdout:6/147: stat d0 0 2024-02-10T00:00:28.942 INFO:tasks.workunit.client.0.smithi164.stdout:2/85: mkdir d3/d24 0 2024-02-10T00:00:28.942 INFO:tasks.workunit.client.0.smithi164.stdout:2/86: write d3/f15 [913189,33382] 0 2024-02-10T00:00:28.943 INFO:tasks.workunit.client.0.smithi164.stdout:2/87: chown d3/cc 62 1 2024-02-10T00:00:28.943 INFO:tasks.workunit.client.0.smithi164.stdout:3/51: rmdir d0/dc 0 2024-02-10T00:00:28.944 INFO:tasks.workunit.client.0.smithi164.stdout:6/148: creat d0/d6/d12/f2e x:0 0 0 2024-02-10T00:00:28.944 INFO:tasks.workunit.client.0.smithi164.stdout:2/88: write f0 [1292270,111172] 0 2024-02-10T00:00:28.945 INFO:tasks.workunit.client.0.smithi164.stdout:2/89: stat d3/f11 0 2024-02-10T00:00:28.945 INFO:tasks.workunit.client.0.smithi164.stdout:3/52: chown d0/l9 80701036 1 2024-02-10T00:00:28.946 INFO:tasks.workunit.client.1.smithi183.stdout:2/535: fdatasync d2/da/d20/f37 0 2024-02-10T00:00:28.946 INFO:tasks.workunit.client.0.smithi164.stdout:2/90: fsync d3/f11 0 2024-02-10T00:00:28.946 INFO:tasks.workunit.client.0.smithi164.stdout:6/149: creat d0/f2f x:0 0 0 2024-02-10T00:00:28.946 INFO:tasks.workunit.client.1.smithi183.stdout:5/539: rename d4/d23/d4a/f5f to d4/d23/d3e/d80/da1/d9e/d27/d9d/fac 0 2024-02-10T00:00:28.947 INFO:tasks.workunit.client.1.smithi183.stdout:8/533: fsync d0/d23/d2d/d24/f59 0 2024-02-10T00:00:28.951 INFO:tasks.workunit.client.1.smithi183.stdout:8/534: dwrite d0/d23/d2d/f7b [0,4194304] 0 2024-02-10T00:00:28.951 INFO:tasks.workunit.client.0.smithi164.stdout:6/150: mknod d0/d2b/c30 0 2024-02-10T00:00:28.952 INFO:tasks.workunit.client.1.smithi183.stdout:2/536: mkdir d2/d2c/dab/d99/db0 0 2024-02-10T00:00:28.952 INFO:tasks.workunit.client.0.smithi164.stdout:6/151: dread - d0/d6/f1c zero size 2024-02-10T00:00:28.952 INFO:tasks.workunit.client.0.smithi164.stdout:2/91: mkdir d3/d24/d25 0 2024-02-10T00:00:28.955 INFO:tasks.workunit.client.1.smithi183.stdout:2/537: mkdir d2/da/d19/d31/d75/d35/db1 0 2024-02-10T00:00:28.958 INFO:tasks.workunit.client.0.smithi164.stdout:2/92: dwrite d3/f15 [0,4194304] 0 2024-02-10T00:00:28.958 INFO:tasks.workunit.client.1.smithi183.stdout:8/535: rmdir d0/d27/d36/d9b 0 2024-02-10T00:00:28.958 INFO:tasks.workunit.client.0.smithi164.stdout:6/152: dwrite d0/fb [0,4194304] 0 2024-02-10T00:00:28.960 INFO:tasks.workunit.client.0.smithi164.stdout:6/153: dread d0/f5 [4194304,4194304] 0 2024-02-10T00:00:28.961 INFO:tasks.workunit.client.0.smithi164.stdout:2/93: mkdir d3/d26 0 2024-02-10T00:00:28.961 INFO:tasks.workunit.client.0.smithi164.stdout:6/154: chown d0/f11 861956 1 2024-02-10T00:00:28.962 INFO:tasks.workunit.client.0.smithi164.stdout:6/155: chown d0/d2b 185447 1 2024-02-10T00:00:28.964 INFO:tasks.workunit.client.1.smithi183.stdout:9/469: truncate d0/d10/f81 3726861 0 2024-02-10T00:00:28.967 INFO:tasks.workunit.client.1.smithi183.stdout:6/374: dwrite d2/d1a/d25/f36 [0,4194304] 0 2024-02-10T00:00:28.968 INFO:tasks.workunit.client.1.smithi183.stdout:7/426: truncate d0/d11/d3e/f58 1864768 0 2024-02-10T00:00:28.971 INFO:tasks.workunit.client.0.smithi164.stdout:2/94: mkdir d3/d24/d25/d27 0 2024-02-10T00:00:28.971 INFO:tasks.workunit.client.1.smithi183.stdout:4/450: dwrite de/f7f [0,4194304] 0 2024-02-10T00:00:28.972 INFO:tasks.workunit.client.0.smithi164.stdout:2/95: write d3/f16 [580103,112997] 0 2024-02-10T00:00:28.972 INFO:tasks.workunit.client.0.smithi164.stdout:2/96: write d3/f19 [709920,110123] 0 2024-02-10T00:00:28.973 INFO:tasks.workunit.client.0.smithi164.stdout:2/97: chown d3/fe 3 1 2024-02-10T00:00:28.974 INFO:tasks.workunit.client.1.smithi183.stdout:4/451: dread de/d14/f4a [0,4194304] 0 2024-02-10T00:00:28.975 INFO:tasks.workunit.client.1.smithi183.stdout:4/452: read - de/f71 zero size 2024-02-10T00:00:28.977 INFO:tasks.workunit.client.1.smithi183.stdout:7/427: rmdir d0/d2 39 2024-02-10T00:00:28.981 INFO:tasks.workunit.client.1.smithi183.stdout:6/375: dwrite d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:28.981 INFO:tasks.workunit.client.0.smithi164.stdout:9/118: chown d6/f1e 66451 1 2024-02-10T00:00:28.981 INFO:tasks.workunit.client.1.smithi183.stdout:6/376: readlink d2/d32/l52 0 2024-02-10T00:00:28.982 INFO:tasks.workunit.client.0.smithi164.stdout:2/98: creat d3/d24/d25/d27/f28 x:0 0 0 2024-02-10T00:00:28.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/68: dwrite d1/da/fe [0,4194304] 0 2024-02-10T00:00:28.987 INFO:tasks.workunit.client.1.smithi183.stdout:7/428: unlink d0/d2/d4/f5 0 2024-02-10T00:00:28.987 INFO:tasks.workunit.client.0.smithi164.stdout:1/69: chown d1/da/fb 67 1 2024-02-10T00:00:28.987 INFO:tasks.workunit.client.1.smithi183.stdout:4/453: rename de/d19/d1c/d61/l85 to de/d14/l89 0 2024-02-10T00:00:28.988 INFO:tasks.workunit.client.0.smithi164.stdout:0/52: sync 2024-02-10T00:00:28.989 INFO:tasks.workunit.client.1.smithi183.stdout:4/454: write de/f1f [1665161,20770] 0 2024-02-10T00:00:28.989 INFO:tasks.workunit.client.1.smithi183.stdout:7/429: mknod d0/d2/d3/c73 0 2024-02-10T00:00:28.990 INFO:tasks.workunit.client.0.smithi164.stdout:1/70: creat d1/da/f17 x:0 0 0 2024-02-10T00:00:28.991 INFO:tasks.workunit.client.0.smithi164.stdout:0/53: dread f5 [0,4194304] 0 2024-02-10T00:00:28.992 INFO:tasks.workunit.client.0.smithi164.stdout:0/54: readlink d6/d7/la 0 2024-02-10T00:00:28.992 INFO:tasks.workunit.client.1.smithi183.stdout:6/377: dwrite d2/f30 [0,4194304] 0 2024-02-10T00:00:28.996 INFO:tasks.workunit.client.1.smithi183.stdout:6/378: creat d2/d1a/d25/d3c/d31/f70 x:0 0 0 2024-02-10T00:00:28.998 INFO:tasks.workunit.client.0.smithi164.stdout:1/71: unlink d1/f4 0 2024-02-10T00:00:28.998 INFO:tasks.workunit.client.0.smithi164.stdout:9/119: getdents d6/de 0 2024-02-10T00:00:28.998 INFO:tasks.workunit.client.1.smithi183.stdout:2/538: dread d2/da/f7d [0,4194304] 0 2024-02-10T00:00:28.998 INFO:tasks.workunit.client.1.smithi183.stdout:4/455: rename de/l44 to de/d19/l8a 0 2024-02-10T00:00:29.002 INFO:tasks.workunit.client.1.smithi183.stdout:2/539: creat d2/d2c/d2f/d60/d8d/d9c/fb2 x:0 0 0 2024-02-10T00:00:29.003 INFO:tasks.workunit.client.0.smithi164.stdout:4/80: truncate d2/fb 3672262 0 2024-02-10T00:00:29.004 INFO:tasks.workunit.client.0.smithi164.stdout:4/81: chown d2/f8 209 1 2024-02-10T00:00:29.005 INFO:tasks.workunit.client.0.smithi164.stdout:9/120: getdents d6/de/d22 0 2024-02-10T00:00:29.006 INFO:tasks.workunit.client.0.smithi164.stdout:4/82: chown d2/c13 129670 1 2024-02-10T00:00:29.009 INFO:tasks.workunit.client.1.smithi183.stdout:6/379: link d2/d32/f41 d2/d1a/d25/d3c/d31/d66/f71 0 2024-02-10T00:00:29.012 INFO:tasks.workunit.client.1.smithi183.stdout:7/430: rename d0/d11/l27 to d0/d2/d4/l74 0 2024-02-10T00:00:29.012 INFO:tasks.workunit.client.0.smithi164.stdout:5/108: truncate d7/f19 661872 0 2024-02-10T00:00:29.014 INFO:tasks.workunit.client.0.smithi164.stdout:9/121: mknod d6/de/c25 0 2024-02-10T00:00:29.014 INFO:tasks.workunit.client.1.smithi183.stdout:2/540: creat d2/d8b/fb3 x:0 0 0 2024-02-10T00:00:29.015 INFO:tasks.workunit.client.0.smithi164.stdout:7/132: dwrite d3/f22 [0,4194304] 0 2024-02-10T00:00:29.015 INFO:tasks.workunit.client.0.smithi164.stdout:0/55: getdents d6 0 2024-02-10T00:00:29.017 INFO:tasks.workunit.client.0.smithi164.stdout:7/133: fsync d3/d5/fe 0 2024-02-10T00:00:29.017 INFO:tasks.workunit.client.0.smithi164.stdout:4/83: symlink d2/d19/l1c 0 2024-02-10T00:00:29.017 INFO:tasks.workunit.client.1.smithi183.stdout:7/431: creat d0/d11/d2f/d64/d6b/f75 x:0 0 0 2024-02-10T00:00:29.017 INFO:tasks.workunit.client.1.smithi183.stdout:7/432: fdatasync d0/d2/d4/d8/f13 0 2024-02-10T00:00:29.018 INFO:tasks.workunit.client.1.smithi183.stdout:2/541: creat d2/da/d19/fb4 x:0 0 0 2024-02-10T00:00:29.019 INFO:tasks.workunit.client.0.smithi164.stdout:8/87: dwrite d2/fa [0,4194304] 0 2024-02-10T00:00:29.019 INFO:tasks.workunit.client.0.smithi164.stdout:9/122: fdatasync d6/f10 0 2024-02-10T00:00:29.020 INFO:tasks.workunit.client.1.smithi183.stdout:7/433: symlink d0/d2/d4/d8/d59/l76 0 2024-02-10T00:00:29.021 INFO:tasks.workunit.client.0.smithi164.stdout:5/109: dread d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:29.021 INFO:tasks.workunit.client.0.smithi164.stdout:7/134: creat d3/d26/f2e x:0 0 0 2024-02-10T00:00:29.021 INFO:tasks.workunit.client.0.smithi164.stdout:7/135: dread - d3/f2d zero size 2024-02-10T00:00:29.022 INFO:tasks.workunit.client.1.smithi183.stdout:7/434: read d0/d2/f41 [2004,125763] 0 2024-02-10T00:00:29.024 INFO:tasks.workunit.client.0.smithi164.stdout:4/84: rename d2/d19/d16/c17 to d2/d19/c1d 0 2024-02-10T00:00:29.024 INFO:tasks.workunit.client.0.smithi164.stdout:8/88: mkdir d2/d12 0 2024-02-10T00:00:29.026 INFO:tasks.workunit.client.1.smithi183.stdout:7/435: dwrite d0/d11/d3e/f6d [0,4194304] 0 2024-02-10T00:00:29.026 INFO:tasks.workunit.client.1.smithi183.stdout:5/540: sync 2024-02-10T00:00:29.026 INFO:tasks.workunit.client.0.smithi164.stdout:9/123: dread d6/fc [0,4194304] 0 2024-02-10T00:00:29.029 INFO:tasks.workunit.client.0.smithi164.stdout:7/136: mknod d3/d26/c2f 0 2024-02-10T00:00:29.031 INFO:tasks.workunit.client.0.smithi164.stdout:4/85: creat d2/f1e x:0 0 0 2024-02-10T00:00:29.032 INFO:tasks.workunit.client.0.smithi164.stdout:0/56: getdents d6/d7 0 2024-02-10T00:00:29.032 INFO:tasks.workunit.client.0.smithi164.stdout:9/124: stat d6/d1c/f1d 0 2024-02-10T00:00:29.033 INFO:tasks.workunit.client.0.smithi164.stdout:7/137: creat d3/d5/f30 x:0 0 0 2024-02-10T00:00:29.035 INFO:tasks.workunit.client.0.smithi164.stdout:4/86: mkdir d2/d19/d16/d1f 0 2024-02-10T00:00:29.037 INFO:tasks.workunit.client.0.smithi164.stdout:0/57: symlink d6/l13 0 2024-02-10T00:00:29.039 INFO:tasks.workunit.client.0.smithi164.stdout:7/138: creat d3/d26/f31 x:0 0 0 2024-02-10T00:00:29.039 INFO:tasks.workunit.client.0.smithi164.stdout:4/87: mknod d2/d19/c20 0 2024-02-10T00:00:29.039 INFO:tasks.workunit.client.0.smithi164.stdout:7/139: write d3/f13 [3386018,41467] 0 2024-02-10T00:00:29.040 INFO:tasks.workunit.client.0.smithi164.stdout:4/88: chown d2/l6 858145190 1 2024-02-10T00:00:29.041 INFO:tasks.workunit.client.0.smithi164.stdout:0/58: mkdir d6/d7/d14 0 2024-02-10T00:00:29.041 INFO:tasks.workunit.client.0.smithi164.stdout:9/125: dread d6/f18 [0,4194304] 0 2024-02-10T00:00:29.041 INFO:tasks.workunit.client.0.smithi164.stdout:4/89: chown d2/d19/l18 3814855 1 2024-02-10T00:00:29.041 INFO:tasks.workunit.client.0.smithi164.stdout:0/59: chown d6/d10 35 1 2024-02-10T00:00:29.042 INFO:tasks.workunit.client.0.smithi164.stdout:0/60: chown d6/d7/fc 25268 1 2024-02-10T00:00:29.043 INFO:tasks.workunit.client.0.smithi164.stdout:0/61: write d6/d7/fd [289473,65139] 0 2024-02-10T00:00:29.043 INFO:tasks.workunit.client.0.smithi164.stdout:0/62: write f1 [2486634,21339] 0 2024-02-10T00:00:29.045 INFO:tasks.workunit.client.0.smithi164.stdout:9/126: creat d6/de/d22/f26 x:0 0 0 2024-02-10T00:00:29.046 INFO:tasks.workunit.client.0.smithi164.stdout:4/90: creat d2/d19/d16/d1f/f21 x:0 0 0 2024-02-10T00:00:29.046 INFO:tasks.workunit.client.0.smithi164.stdout:4/91: chown d2/d19/l18 8170 1 2024-02-10T00:00:29.047 INFO:tasks.workunit.client.0.smithi164.stdout:0/63: creat d6/f15 x:0 0 0 2024-02-10T00:00:29.048 INFO:tasks.workunit.client.0.smithi164.stdout:9/127: symlink d6/l27 0 2024-02-10T00:00:29.049 INFO:tasks.workunit.client.0.smithi164.stdout:4/92: chown d2/fb 982715 1 2024-02-10T00:00:29.049 INFO:tasks.workunit.client.0.smithi164.stdout:0/64: symlink d6/d7/d14/l16 0 2024-02-10T00:00:29.050 INFO:tasks.workunit.client.0.smithi164.stdout:9/128: fdatasync d6/f1a 0 2024-02-10T00:00:29.050 INFO:tasks.workunit.client.0.smithi164.stdout:4/93: mknod d2/d19/d16/d1f/c22 0 2024-02-10T00:00:29.051 INFO:tasks.workunit.client.0.smithi164.stdout:4/94: readlink d2/d19/l1c 0 2024-02-10T00:00:29.051 INFO:tasks.workunit.client.0.smithi164.stdout:4/95: readlink d2/d19/ld 0 2024-02-10T00:00:29.054 INFO:tasks.workunit.client.0.smithi164.stdout:0/65: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:29.058 INFO:tasks.workunit.client.0.smithi164.stdout:0/66: dread f1 [0,4194304] 0 2024-02-10T00:00:29.058 INFO:tasks.workunit.client.0.smithi164.stdout:0/67: write d6/d7/fd [406118,93947] 0 2024-02-10T00:00:29.067 INFO:tasks.workunit.client.1.smithi183.stdout:0/412: write d14/d3e/d92/f64 [2587916,47544] 0 2024-02-10T00:00:29.068 INFO:tasks.workunit.client.0.smithi164.stdout:0/68: dread d6/f8 [0,4194304] 0 2024-02-10T00:00:29.069 INFO:tasks.workunit.client.0.smithi164.stdout:6/156: truncate d0/d6/d12/f22 4686807 0 2024-02-10T00:00:29.070 INFO:tasks.workunit.client.0.smithi164.stdout:2/99: fsync d3/d24/d25/d27/f28 0 2024-02-10T00:00:29.071 INFO:tasks.workunit.client.1.smithi183.stdout:0/413: mkdir d14/d1d/d2d/d31/d6c/d70/d99 0 2024-02-10T00:00:29.072 INFO:tasks.workunit.client.0.smithi164.stdout:0/69: creat d6/d7/f17 x:0 0 0 2024-02-10T00:00:29.072 INFO:tasks.workunit.client.1.smithi183.stdout:0/414: mknod d14/d1d/d59/d3c/d72/c9a 0 2024-02-10T00:00:29.074 INFO:tasks.workunit.client.0.smithi164.stdout:6/157: rmdir d0/d6 39 2024-02-10T00:00:29.075 INFO:tasks.workunit.client.1.smithi183.stdout:8/536: dread d0/d45/f49 [0,4194304] 0 2024-02-10T00:00:29.075 INFO:tasks.workunit.client.0.smithi164.stdout:6/158: symlink d0/d2b/l31 0 2024-02-10T00:00:29.077 INFO:tasks.workunit.client.0.smithi164.stdout:3/53: fdatasync d0/d1/d2/f7 0 2024-02-10T00:00:29.078 INFO:tasks.workunit.client.0.smithi164.stdout:3/54: chown d0/d1/dd 260789184 1 2024-02-10T00:00:29.079 INFO:tasks.workunit.client.1.smithi183.stdout:3/403: truncate d7/f9 2342565 0 2024-02-10T00:00:29.079 INFO:tasks.workunit.client.1.smithi183.stdout:3/404: fsync d7/f30 0 2024-02-10T00:00:29.080 INFO:tasks.workunit.client.1.smithi183.stdout:0/415: dread d14/d1d/d59/d71/d22/f44 [0,4194304] 0 2024-02-10T00:00:29.081 INFO:tasks.workunit.client.0.smithi164.stdout:6/159: dwrite d0/d6/d12/f2e [0,4194304] 0 2024-02-10T00:00:29.081 INFO:tasks.workunit.client.0.smithi164.stdout:6/160: readlink d0/lf 0 2024-02-10T00:00:29.082 INFO:tasks.workunit.client.1.smithi183.stdout:1/427: write d0/d3/d7/f19 [1489607,34734] 0 2024-02-10T00:00:29.083 INFO:tasks.workunit.client.1.smithi183.stdout:1/428: write d0/d3/d67/f61 [61548,38574] 0 2024-02-10T00:00:29.085 INFO:tasks.workunit.client.0.smithi164.stdout:6/161: creat d0/d6/f32 x:0 0 0 2024-02-10T00:00:29.085 INFO:tasks.workunit.client.1.smithi183.stdout:4/456: dread de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:29.085 INFO:tasks.workunit.client.0.smithi164.stdout:3/55: dwrite d0/d1/d2/f7 [8388608,4194304] 0 2024-02-10T00:00:29.086 INFO:tasks.workunit.client.1.smithi183.stdout:2/542: rename d2/da/d19/d31/d75 to d2/da/d19/d31/d9b/db5 0 2024-02-10T00:00:29.087 INFO:tasks.workunit.client.1.smithi183.stdout:2/543: write d2/da/d20/f66 [5080552,102072] 0 2024-02-10T00:00:29.088 INFO:tasks.workunit.client.1.smithi183.stdout:2/544: chown d2/d3d/c44 269 1 2024-02-10T00:00:29.088 INFO:tasks.workunit.client.1.smithi183.stdout:9/470: write d0/d10/f7c [1321065,50972] 0 2024-02-10T00:00:29.088 INFO:tasks.workunit.client.0.smithi164.stdout:1/72: rmdir d1 39 2024-02-10T00:00:29.091 INFO:tasks.workunit.client.0.smithi164.stdout:3/56: dwrite d0/d1/d2/f7 [4194304,4194304] 0 2024-02-10T00:00:29.092 INFO:tasks.workunit.client.1.smithi183.stdout:2/545: dread d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:29.093 INFO:tasks.workunit.client.0.smithi164.stdout:3/57: write d0/d1/d2/f7 [10619816,4590] 0 2024-02-10T00:00:29.095 INFO:tasks.workunit.client.1.smithi183.stdout:2/546: dwrite d2/d2c/dab/f95 [0,4194304] 0 2024-02-10T00:00:29.096 INFO:tasks.workunit.client.1.smithi183.stdout:6/380: fsync d2/d32/f41 0 2024-02-10T00:00:29.097 INFO:tasks.workunit.client.0.smithi164.stdout:5/110: truncate f1 269542 0 2024-02-10T00:00:29.100 INFO:tasks.workunit.client.0.smithi164.stdout:8/89: truncate d2/fa 821646 0 2024-02-10T00:00:29.101 INFO:tasks.workunit.client.1.smithi183.stdout:0/416: rmdir d14/d7a 39 2024-02-10T00:00:29.101 INFO:tasks.workunit.client.0.smithi164.stdout:5/111: dwrite d7/fd [4194304,4194304] 0 2024-02-10T00:00:29.101 INFO:tasks.workunit.client.1.smithi183.stdout:7/436: sync 2024-02-10T00:00:29.103 INFO:tasks.workunit.client.0.smithi164.stdout:0/70: fsync d6/f15 0 2024-02-10T00:00:29.105 INFO:tasks.workunit.client.0.smithi164.stdout:7/140: dwrite d3/ff [0,4194304] 0 2024-02-10T00:00:29.108 INFO:tasks.workunit.client.1.smithi183.stdout:8/537: rename d0/d23/d2d/d24/l33 to d0/d27/d75/laa 0 2024-02-10T00:00:29.109 INFO:tasks.workunit.client.0.smithi164.stdout:4/96: rmdir d2/d19/d16/d1f 39 2024-02-10T00:00:29.109 INFO:tasks.workunit.client.1.smithi183.stdout:8/538: stat d0/c5 0 2024-02-10T00:00:29.111 INFO:tasks.workunit.client.0.smithi164.stdout:6/162: dread d0/fb [0,4194304] 0 2024-02-10T00:00:29.112 INFO:tasks.workunit.client.0.smithi164.stdout:6/163: write d0/f17 [1845502,14578] 0 2024-02-10T00:00:29.114 INFO:tasks.workunit.client.1.smithi183.stdout:5/541: dwrite d4/d23/d2a/f40 [0,4194304] 0 2024-02-10T00:00:29.116 INFO:tasks.workunit.client.1.smithi183.stdout:9/471: symlink d0/d3/d14/d1c/d2d/d4f/d79/l9e 0 2024-02-10T00:00:29.116 INFO:tasks.workunit.client.1.smithi183.stdout:5/542: dread - d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fa3 zero size 2024-02-10T00:00:29.117 INFO:tasks.workunit.client.0.smithi164.stdout:3/58: creat d0/d1/d2/fe x:0 0 0 2024-02-10T00:00:29.117 INFO:tasks.workunit.client.1.smithi183.stdout:5/543: chown d4/d23/d3e/d80/da1/d9c/d72 124 1 2024-02-10T00:00:29.118 INFO:tasks.workunit.client.1.smithi183.stdout:6/381: fsync d2/f5a 0 2024-02-10T00:00:29.118 INFO:tasks.workunit.client.0.smithi164.stdout:9/129: unlink d6/f10 0 2024-02-10T00:00:29.119 INFO:tasks.workunit.client.0.smithi164.stdout:8/90: creat d2/f13 x:0 0 0 2024-02-10T00:00:29.120 INFO:tasks.workunit.client.0.smithi164.stdout:8/91: read - d2/f10 zero size 2024-02-10T00:00:29.121 INFO:tasks.workunit.client.0.smithi164.stdout:8/92: stat d2/l3 0 2024-02-10T00:00:29.121 INFO:tasks.workunit.client.0.smithi164.stdout:3/59: dwrite d0/d1/d2/f7 [8388608,4194304] 0 2024-02-10T00:00:29.122 INFO:tasks.workunit.client.0.smithi164.stdout:0/71: mkdir d6/d10/d18 0 2024-02-10T00:00:29.124 INFO:tasks.workunit.client.0.smithi164.stdout:0/72: dread d6/f8 [0,4194304] 0 2024-02-10T00:00:29.126 INFO:tasks.workunit.client.1.smithi183.stdout:2/547: unlink d2/d2c/d2f/f6a 0 2024-02-10T00:00:29.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/472: truncate d0/d3/d14/f38 563970 0 2024-02-10T00:00:29.127 INFO:tasks.workunit.client.0.smithi164.stdout:3/60: dwrite d0/f4 [0,4194304] 0 2024-02-10T00:00:29.128 INFO:tasks.workunit.client.1.smithi183.stdout:5/544: symlink d4/d23/d3e/d80/da1/d9e/d27/d37/lad 0 2024-02-10T00:00:29.128 INFO:tasks.workunit.client.0.smithi164.stdout:6/164: creat d0/d2b/f33 x:0 0 0 2024-02-10T00:00:29.129 INFO:tasks.workunit.client.1.smithi183.stdout:5/545: write d4/d23/d3e/d80/da1/f6b [1218718,84843] 0 2024-02-10T00:00:29.131 INFO:tasks.workunit.client.0.smithi164.stdout:0/73: dwrite f5 [4194304,4194304] 0 2024-02-10T00:00:29.132 INFO:tasks.workunit.client.1.smithi183.stdout:4/457: truncate de/d19/d20/f5e 690427 0 2024-02-10T00:00:29.132 INFO:tasks.workunit.client.1.smithi183.stdout:8/539: mknod d0/d45/cab 0 2024-02-10T00:00:29.133 INFO:tasks.workunit.client.0.smithi164.stdout:0/74: write f5 [1684904,33815] 0 2024-02-10T00:00:29.133 INFO:tasks.workunit.client.0.smithi164.stdout:8/93: unlink d2/l3 0 2024-02-10T00:00:29.133 INFO:tasks.workunit.client.1.smithi183.stdout:2/548: chown d2/da/d20/d21/d43/d58/d74/l89 8 1 2024-02-10T00:00:29.133 INFO:tasks.workunit.client.1.smithi183.stdout:4/458: write de/d14/f16 [1926895,89175] 0 2024-02-10T00:00:29.134 INFO:tasks.workunit.client.1.smithi183.stdout:9/473: creat d0/d3/d14/d1c/d2d/d4f/d58/f9f x:0 0 0 2024-02-10T00:00:29.134 INFO:tasks.workunit.client.0.smithi164.stdout:0/75: chown d6/d7/d14 94 1 2024-02-10T00:00:29.135 INFO:tasks.workunit.client.1.smithi183.stdout:3/405: dread d7/db/d2a/f44 [0,4194304] 0 2024-02-10T00:00:29.136 INFO:tasks.workunit.client.1.smithi183.stdout:0/417: mkdir d14/d3e/d9b 0 2024-02-10T00:00:29.137 INFO:tasks.workunit.client.0.smithi164.stdout:0/76: dread - d6/d7/f17 zero size 2024-02-10T00:00:29.137 INFO:tasks.workunit.client.0.smithi164.stdout:6/165: dwrite d0/f1a [0,4194304] 0 2024-02-10T00:00:29.137 INFO:tasks.workunit.client.0.smithi164.stdout:3/61: creat d0/d1/ff x:0 0 0 2024-02-10T00:00:29.137 INFO:tasks.workunit.client.0.smithi164.stdout:0/77: chown l2 56196 1 2024-02-10T00:00:29.138 INFO:tasks.workunit.client.1.smithi183.stdout:8/540: dread d0/d23/d2d/f7b [0,4194304] 0 2024-02-10T00:00:29.140 INFO:tasks.workunit.client.1.smithi183.stdout:4/459: dwrite de/d19/d20/f26 [0,4194304] 0 2024-02-10T00:00:29.141 INFO:tasks.workunit.client.1.smithi183.stdout:3/406: dwrite d7/db/d2a/f2c [0,4194304] 0 2024-02-10T00:00:29.143 INFO:tasks.workunit.client.0.smithi164.stdout:6/166: unlink d0/lf 0 2024-02-10T00:00:29.143 INFO:tasks.workunit.client.1.smithi183.stdout:7/437: getdents d0 0 2024-02-10T00:00:29.144 INFO:tasks.workunit.client.0.smithi164.stdout:0/78: mknod d6/c19 0 2024-02-10T00:00:29.145 INFO:tasks.workunit.client.0.smithi164.stdout:0/79: read d6/d7/fd [294856,43615] 0 2024-02-10T00:00:29.146 INFO:tasks.workunit.client.0.smithi164.stdout:3/62: rename d0/d1/d2/f7 to d0/f10 0 2024-02-10T00:00:29.147 INFO:tasks.workunit.client.0.smithi164.stdout:8/94: symlink d2/d12/l14 0 2024-02-10T00:00:29.147 INFO:tasks.workunit.client.0.smithi164.stdout:3/63: dread - d0/d1/ff zero size 2024-02-10T00:00:29.147 INFO:tasks.workunit.client.0.smithi164.stdout:4/97: link d2/l3 d2/d19/d16/l23 0 2024-02-10T00:00:29.148 INFO:tasks.workunit.client.0.smithi164.stdout:4/98: chown d2/d19 14858 1 2024-02-10T00:00:29.148 INFO:tasks.workunit.client.1.smithi183.stdout:5/546: mknod d4/d23/d3e/d80/da1/d9e/d27/d38/cae 0 2024-02-10T00:00:29.148 INFO:tasks.workunit.client.1.smithi183.stdout:5/547: stat d4/d23/d2a/c4c 0 2024-02-10T00:00:29.149 INFO:tasks.workunit.client.1.smithi183.stdout:5/548: write d4/f45 [1256316,51862] 0 2024-02-10T00:00:29.149 INFO:tasks.workunit.client.0.smithi164.stdout:6/167: symlink d0/d6/l34 0 2024-02-10T00:00:29.150 INFO:tasks.workunit.client.1.smithi183.stdout:5/549: write d4/d23/d3e/d80/da1/d9e/d89/f90 [654892,95889] 0 2024-02-10T00:00:29.151 INFO:tasks.workunit.client.0.smithi164.stdout:3/64: dread d0/f4 [8388608,4194304] 0 2024-02-10T00:00:29.151 INFO:tasks.workunit.client.0.smithi164.stdout:3/65: write d0/d1/ff [159935,117702] 0 2024-02-10T00:00:29.153 INFO:tasks.workunit.client.1.smithi183.stdout:3/407: fsync d7/f12 0 2024-02-10T00:00:29.153 INFO:tasks.workunit.client.0.smithi164.stdout:8/95: symlink d2/l15 0 2024-02-10T00:00:29.155 INFO:tasks.workunit.client.0.smithi164.stdout:3/66: creat d0/d1/f11 x:0 0 0 2024-02-10T00:00:29.155 INFO:tasks.workunit.client.1.smithi183.stdout:9/474: mknod d0/d3/d14/d74/d90/ca0 0 2024-02-10T00:00:29.155 INFO:tasks.workunit.client.1.smithi183.stdout:0/418: mknod d14/d1d/d59/d3c/d72/c9c 0 2024-02-10T00:00:29.157 INFO:tasks.workunit.client.1.smithi183.stdout:5/550: dwrite d4/f45 [0,4194304] 0 2024-02-10T00:00:29.157 INFO:tasks.workunit.client.0.smithi164.stdout:8/96: symlink d2/l16 0 2024-02-10T00:00:29.159 INFO:tasks.workunit.client.1.smithi183.stdout:2/549: creat d2/d2c/fb6 x:0 0 0 2024-02-10T00:00:29.159 INFO:tasks.workunit.client.1.smithi183.stdout:2/550: write d2/d2c/f90 [566992,20249] 0 2024-02-10T00:00:29.161 INFO:tasks.workunit.client.0.smithi164.stdout:3/67: creat d0/d1/d2/f12 x:0 0 0 2024-02-10T00:00:29.161 INFO:tasks.workunit.client.0.smithi164.stdout:3/68: chown d0/d1 7610 1 2024-02-10T00:00:29.161 INFO:tasks.workunit.client.0.smithi164.stdout:6/168: truncate d0/d6/d12/d14/f24 204299 0 2024-02-10T00:00:29.162 INFO:tasks.workunit.client.1.smithi183.stdout:7/438: unlink d0/d2/d50/l56 0 2024-02-10T00:00:29.164 INFO:tasks.workunit.client.0.smithi164.stdout:4/99: link d2/l3 d2/d19/l24 0 2024-02-10T00:00:29.164 INFO:tasks.workunit.client.1.smithi183.stdout:4/460: creat de/d14/d27/f8b x:0 0 0 2024-02-10T00:00:29.167 INFO:tasks.workunit.client.0.smithi164.stdout:6/169: dwrite d0/d6/d12/f2e [0,4194304] 0 2024-02-10T00:00:29.167 INFO:tasks.workunit.client.1.smithi183.stdout:9/475: symlink d0/d30/la1 0 2024-02-10T00:00:29.168 INFO:tasks.workunit.client.1.smithi183.stdout:3/408: mkdir d7/db/d2a/d2d/d51/d78 0 2024-02-10T00:00:29.168 INFO:tasks.workunit.client.1.smithi183.stdout:3/409: fsync d7/db/d2a/f65 0 2024-02-10T00:00:29.168 INFO:tasks.workunit.client.1.smithi183.stdout:2/551: chown d2/l39 32363777 1 2024-02-10T00:00:29.169 INFO:tasks.workunit.client.0.smithi164.stdout:4/100: dwrite d2/f1e [0,4194304] 0 2024-02-10T00:00:29.169 INFO:tasks.workunit.client.0.smithi164.stdout:8/97: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:29.171 INFO:tasks.workunit.client.1.smithi183.stdout:0/419: creat d14/d1d/d2d/d31/d6c/d70/d99/f9d x:0 0 0 2024-02-10T00:00:29.173 INFO:tasks.workunit.client.0.smithi164.stdout:6/170: symlink d0/l35 0 2024-02-10T00:00:29.173 INFO:tasks.workunit.client.1.smithi183.stdout:9/476: dwrite d0/d3/d14/d48/f9c [0,4194304] 0 2024-02-10T00:00:29.175 INFO:tasks.workunit.client.1.smithi183.stdout:2/552: symlink d2/da/d5b/lb7 0 2024-02-10T00:00:29.175 INFO:tasks.workunit.client.0.smithi164.stdout:4/101: creat d2/d19/d16/f25 x:0 0 0 2024-02-10T00:00:29.175 INFO:tasks.workunit.client.1.smithi183.stdout:7/439: dwrite d0/d2/d50/d5d/f55 [0,4194304] 0 2024-02-10T00:00:29.176 INFO:tasks.workunit.client.0.smithi164.stdout:4/102: readlink d2/d19/ld 0 2024-02-10T00:00:29.176 INFO:tasks.workunit.client.1.smithi183.stdout:5/551: link d4/d23/d3e/d80/da1/d9e/d27/la8 d4/dd/d71/laf 0 2024-02-10T00:00:29.177 INFO:tasks.workunit.client.0.smithi164.stdout:6/171: creat d0/d2b/f36 x:0 0 0 2024-02-10T00:00:29.177 INFO:tasks.workunit.client.0.smithi164.stdout:6/172: chown d0/d6/d12/f18 5811 1 2024-02-10T00:00:29.178 INFO:tasks.workunit.client.0.smithi164.stdout:4/103: symlink d2/d19/l26 0 2024-02-10T00:00:29.179 INFO:tasks.workunit.client.0.smithi164.stdout:4/104: write d2/d19/f15 [786349,80539] 0 2024-02-10T00:00:29.179 INFO:tasks.workunit.client.1.smithi183.stdout:0/420: symlink d14/d1d/d55/d6e/d74/l9e 0 2024-02-10T00:00:29.180 INFO:tasks.workunit.client.0.smithi164.stdout:6/173: mkdir d0/d6/d12/d14/d37 0 2024-02-10T00:00:29.180 INFO:tasks.workunit.client.0.smithi164.stdout:6/174: fdatasync d0/d6/f28 0 2024-02-10T00:00:29.181 INFO:tasks.workunit.client.1.smithi183.stdout:4/461: link de/l68 de/d19/d1c/d61/l8c 0 2024-02-10T00:00:29.183 INFO:tasks.workunit.client.1.smithi183.stdout:2/553: mknod d2/da/d20/d21/d43/d58/d74/d83/cb8 0 2024-02-10T00:00:29.183 INFO:tasks.workunit.client.1.smithi183.stdout:0/421: symlink d14/d1d/d59/d3c/l9f 0 2024-02-10T00:00:29.185 INFO:tasks.workunit.client.1.smithi183.stdout:4/462: rmdir de/d14/d27/d40 39 2024-02-10T00:00:29.185 INFO:tasks.workunit.client.0.smithi164.stdout:6/175: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:29.185 INFO:tasks.workunit.client.1.smithi183.stdout:4/463: write de/d14/d27/f45 [596276,95764] 0 2024-02-10T00:00:29.186 INFO:tasks.workunit.client.1.smithi183.stdout:4/464: readlink de/d14/d4e/l67 0 2024-02-10T00:00:29.186 INFO:tasks.workunit.client.0.smithi164.stdout:6/176: write d0/d6/f7 [3059290,34815] 0 2024-02-10T00:00:29.188 INFO:tasks.workunit.client.1.smithi183.stdout:4/465: write de/d22/f25 [5207376,28205] 0 2024-02-10T00:00:29.189 INFO:tasks.workunit.client.0.smithi164.stdout:6/177: unlink d0/f11 0 2024-02-10T00:00:29.191 INFO:tasks.workunit.client.1.smithi183.stdout:0/422: dwrite d14/d43/f78 [0,4194304] 0 2024-02-10T00:00:29.192 INFO:tasks.workunit.client.1.smithi183.stdout:4/466: dread de/d19/d20/f26 [0,4194304] 0 2024-02-10T00:00:29.193 INFO:tasks.workunit.client.1.smithi183.stdout:0/423: write d14/d43/f78 [482070,64484] 0 2024-02-10T00:00:29.194 INFO:tasks.workunit.client.1.smithi183.stdout:4/467: chown de/d19/d20/f6d 24752 1 2024-02-10T00:00:29.195 INFO:tasks.workunit.client.1.smithi183.stdout:0/424: mkdir d14/d1d/d96/da0 0 2024-02-10T00:00:29.199 INFO:tasks.workunit.client.1.smithi183.stdout:4/468: dwrite de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:29.201 INFO:tasks.workunit.client.1.smithi183.stdout:0/425: dwrite d14/d1d/d59/d71/d22/f4f [0,4194304] 0 2024-02-10T00:00:29.205 INFO:tasks.workunit.client.1.smithi183.stdout:0/426: symlink d14/d1d/d59/d3c/d93/la1 0 2024-02-10T00:00:29.205 INFO:tasks.workunit.client.1.smithi183.stdout:0/427: chown d14/d1d/d2d 294 1 2024-02-10T00:00:29.207 INFO:tasks.workunit.client.1.smithi183.stdout:4/469: dwrite de/d14/f47 [4194304,4194304] 0 2024-02-10T00:00:29.220 INFO:tasks.workunit.client.1.smithi183.stdout:1/429: dwrite d0/d3/d7/f58 [0,4194304] 0 2024-02-10T00:00:29.221 INFO:tasks.workunit.client.1.smithi183.stdout:1/430: dread - d0/d3/f84 zero size 2024-02-10T00:00:29.222 INFO:tasks.workunit.client.1.smithi183.stdout:1/431: chown d0/d3a/l5d 165557154 1 2024-02-10T00:00:29.224 INFO:tasks.workunit.client.1.smithi183.stdout:1/432: creat d0/d3/d67/d70/fa1 x:0 0 0 2024-02-10T00:00:29.225 INFO:tasks.workunit.client.1.smithi183.stdout:1/433: fsync d0/d3/d7/f6c 0 2024-02-10T00:00:29.228 INFO:tasks.workunit.client.0.smithi164.stdout:0/80: sync 2024-02-10T00:00:29.229 INFO:tasks.workunit.client.1.smithi183.stdout:1/434: rename d0/d3/d7/d3d/d60/f7f to d0/d3/d7/d36/fa2 0 2024-02-10T00:00:29.230 INFO:tasks.workunit.client.1.smithi183.stdout:1/435: chown d0/d3/d67/d70 8078928 1 2024-02-10T00:00:29.231 INFO:tasks.workunit.client.0.smithi164.stdout:0/81: unlink d6/f11 0 2024-02-10T00:00:29.233 INFO:tasks.workunit.client.0.smithi164.stdout:0/82: symlink d6/l1a 0 2024-02-10T00:00:29.234 INFO:tasks.workunit.client.1.smithi183.stdout:1/436: rename d0/d3/cc to d0/d3/d29/d1f/d86/ca3 0 2024-02-10T00:00:29.234 INFO:tasks.workunit.client.0.smithi164.stdout:0/83: rmdir d6/d7/d14 39 2024-02-10T00:00:29.238 INFO:tasks.workunit.client.1.smithi183.stdout:1/437: rename d0/d3/d67/f61 to d0/d3/fa4 0 2024-02-10T00:00:29.239 INFO:tasks.workunit.client.0.smithi164.stdout:0/84: dwrite f5 [4194304,4194304] 0 2024-02-10T00:00:29.240 INFO:tasks.workunit.client.1.smithi183.stdout:1/438: fdatasync d0/d3/d29/d38/f3b 0 2024-02-10T00:00:29.240 INFO:tasks.workunit.client.1.smithi183.stdout:4/470: dread de/d14/f47 [0,4194304] 0 2024-02-10T00:00:29.242 INFO:tasks.workunit.client.1.smithi183.stdout:5/552: sync 2024-02-10T00:00:29.243 INFO:tasks.workunit.client.1.smithi183.stdout:4/471: mkdir de/d19/d8d 0 2024-02-10T00:00:29.243 INFO:tasks.workunit.client.1.smithi183.stdout:4/472: write de/d14/d27/f1b [5068982,59392] 0 2024-02-10T00:00:29.244 INFO:tasks.workunit.client.0.smithi164.stdout:0/85: dwrite d6/f15 [0,4194304] 0 2024-02-10T00:00:29.245 INFO:tasks.workunit.client.1.smithi183.stdout:5/553: chown d4/d23/d2a/d5b/f65 7536815 1 2024-02-10T00:00:29.245 INFO:tasks.workunit.client.1.smithi183.stdout:4/473: stat de/d14/d27/f8b 0 2024-02-10T00:00:29.245 INFO:tasks.workunit.client.0.smithi164.stdout:0/86: fdatasync d6/d7/fc 0 2024-02-10T00:00:29.247 INFO:tasks.workunit.client.1.smithi183.stdout:5/554: unlink d4/d23/d3e/f76 0 2024-02-10T00:00:29.248 INFO:tasks.workunit.client.1.smithi183.stdout:4/474: dwrite de/d19/d20/f6b [0,4194304] 0 2024-02-10T00:00:29.250 INFO:tasks.workunit.client.1.smithi183.stdout:5/555: creat d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/fb0 x:0 0 0 2024-02-10T00:00:29.255 INFO:tasks.workunit.client.1.smithi183.stdout:5/556: dwrite d4/d23/d3e/d80/da1/d9e/d89/fa7 [0,4194304] 0 2024-02-10T00:00:29.258 INFO:tasks.workunit.client.1.smithi183.stdout:5/557: write d4/d23/d3e/d80/da1/d9e/f7c [3625089,46567] 0 2024-02-10T00:00:29.258 INFO:tasks.workunit.client.1.smithi183.stdout:7/440: dread d0/d11/d3e/f49 [0,4194304] 0 2024-02-10T00:00:29.258 INFO:tasks.workunit.client.1.smithi183.stdout:9/477: dread d0/d3/d14/f20 [0,4194304] 0 2024-02-10T00:00:29.261 INFO:tasks.workunit.client.1.smithi183.stdout:7/441: rmdir d0/d11/d2f 39 2024-02-10T00:00:29.262 INFO:tasks.workunit.client.1.smithi183.stdout:5/558: dread d4/d23/d3e/d80/da1/d9c/f7d [0,4194304] 0 2024-02-10T00:00:29.263 INFO:tasks.workunit.client.1.smithi183.stdout:7/442: mknod d0/d2/d50/d5d/c77 0 2024-02-10T00:00:29.263 INFO:tasks.workunit.client.0.smithi164.stdout:6/178: sync 2024-02-10T00:00:29.264 INFO:tasks.workunit.client.0.smithi164.stdout:8/98: sync 2024-02-10T00:00:29.264 INFO:tasks.workunit.client.1.smithi183.stdout:7/443: write d0/d11/f36 [452718,96240] 0 2024-02-10T00:00:29.264 INFO:tasks.workunit.client.1.smithi183.stdout:9/478: mknod d0/d3/d14/ca2 0 2024-02-10T00:00:29.265 INFO:tasks.workunit.client.1.smithi183.stdout:7/444: chown d0/d2/d3/c10 993237985 1 2024-02-10T00:00:29.265 INFO:tasks.workunit.client.1.smithi183.stdout:9/479: readlink d0/d30/d52/l5d 0 2024-02-10T00:00:29.266 INFO:tasks.workunit.client.0.smithi164.stdout:8/99: creat d2/d12/f17 x:0 0 0 2024-02-10T00:00:29.266 INFO:tasks.workunit.client.0.smithi164.stdout:6/179: mknod d0/d6/d12/c38 0 2024-02-10T00:00:29.267 INFO:tasks.workunit.client.1.smithi183.stdout:1/439: sync 2024-02-10T00:00:29.268 INFO:tasks.workunit.client.1.smithi183.stdout:7/445: getdents d0/d2/d3 0 2024-02-10T00:00:29.268 INFO:tasks.workunit.client.0.smithi164.stdout:6/180: creat d0/d2b/f39 x:0 0 0 2024-02-10T00:00:29.269 INFO:tasks.workunit.client.1.smithi183.stdout:1/440: creat d0/d3a/fa5 x:0 0 0 2024-02-10T00:00:29.269 INFO:tasks.workunit.client.1.smithi183.stdout:1/441: write d0/f78 [425443,48565] 0 2024-02-10T00:00:29.270 INFO:tasks.workunit.client.1.smithi183.stdout:7/446: creat d0/d2/d50/d5d/f78 x:0 0 0 2024-02-10T00:00:29.273 INFO:tasks.workunit.client.0.smithi164.stdout:6/181: dwrite d0/f2f [0,4194304] 0 2024-02-10T00:00:29.274 INFO:tasks.workunit.client.1.smithi183.stdout:7/447: dwrite d0/f44 [0,4194304] 0 2024-02-10T00:00:29.275 INFO:tasks.workunit.client.0.smithi164.stdout:6/182: mkdir d0/d2b/d3a 0 2024-02-10T00:00:29.276 INFO:tasks.workunit.client.0.smithi164.stdout:6/183: read - d0/d6/d12/f27 zero size 2024-02-10T00:00:29.278 INFO:tasks.workunit.client.1.smithi183.stdout:7/448: truncate d0/d11/d3e/f58 1190253 0 2024-02-10T00:00:29.281 INFO:tasks.workunit.client.1.smithi183.stdout:7/449: unlink d0/d11/f47 0 2024-02-10T00:00:29.282 INFO:tasks.workunit.client.1.smithi183.stdout:7/450: write d0/d11/d3e/f6d [340156,40102] 0 2024-02-10T00:00:29.285 INFO:tasks.workunit.client.1.smithi183.stdout:7/451: dwrite d0/d2/d3/f20 [4194304,4194304] 0 2024-02-10T00:00:29.289 INFO:tasks.workunit.client.1.smithi183.stdout:7/452: symlink d0/d11/d35/l79 0 2024-02-10T00:00:29.290 INFO:tasks.workunit.client.1.smithi183.stdout:7/453: mkdir d0/d2/d4/d8/d7a 0 2024-02-10T00:00:29.292 INFO:tasks.workunit.client.1.smithi183.stdout:7/454: mknod d0/d11/d35/c7b 0 2024-02-10T00:00:29.293 INFO:tasks.workunit.client.1.smithi183.stdout:9/480: sync 2024-02-10T00:00:29.294 INFO:tasks.workunit.client.1.smithi183.stdout:7/455: creat d0/d11/d3e/f7c x:0 0 0 2024-02-10T00:00:29.296 INFO:tasks.workunit.client.0.smithi164.stdout:2/100: dread d3/f7 [0,4194304] 0 2024-02-10T00:00:29.299 INFO:tasks.workunit.client.0.smithi164.stdout:2/101: symlink d3/d26/l29 0 2024-02-10T00:00:29.299 INFO:tasks.workunit.client.0.smithi164.stdout:5/112: dwrite f1 [0,4194304] 0 2024-02-10T00:00:29.300 INFO:tasks.workunit.client.0.smithi164.stdout:1/73: mkdir d1/da/d18 0 2024-02-10T00:00:29.300 INFO:tasks.workunit.client.0.smithi164.stdout:1/74: chown d1/f11 34 1 2024-02-10T00:00:29.302 INFO:tasks.workunit.client.0.smithi164.stdout:2/102: unlink d3/cf 0 2024-02-10T00:00:29.303 INFO:tasks.workunit.client.0.smithi164.stdout:1/75: creat d1/d13/f19 x:0 0 0 2024-02-10T00:00:29.304 INFO:tasks.workunit.client.0.smithi164.stdout:2/103: mkdir d3/d24/d25/d27/d2a 0 2024-02-10T00:00:29.306 INFO:tasks.workunit.client.0.smithi164.stdout:1/76: mkdir d1/d1a 0 2024-02-10T00:00:29.309 INFO:tasks.workunit.client.0.smithi164.stdout:2/104: dwrite f0 [0,4194304] 0 2024-02-10T00:00:29.309 INFO:tasks.workunit.client.1.smithi183.stdout:9/481: mkdir d0/d3/d14/d1c/d2d/da3 0 2024-02-10T00:00:29.310 INFO:tasks.workunit.client.0.smithi164.stdout:2/105: read - d3/f1f zero size 2024-02-10T00:00:29.310 INFO:tasks.workunit.client.1.smithi183.stdout:7/456: creat d0/f7d x:0 0 0 2024-02-10T00:00:29.313 INFO:tasks.workunit.client.0.smithi164.stdout:2/106: symlink d3/d26/l2b 0 2024-02-10T00:00:29.314 INFO:tasks.workunit.client.0.smithi164.stdout:3/69: dread d0/d1/ff [0,4194304] 0 2024-02-10T00:00:29.315 INFO:tasks.workunit.client.0.smithi164.stdout:3/70: dread - d0/d1/d2/f12 zero size 2024-02-10T00:00:29.316 INFO:tasks.workunit.client.0.smithi164.stdout:4/105: dread d2/fb [0,4194304] 0 2024-02-10T00:00:29.317 INFO:tasks.workunit.client.0.smithi164.stdout:4/106: stat d2/d19/d16 0 2024-02-10T00:00:29.317 INFO:tasks.workunit.client.0.smithi164.stdout:9/130: rmdir d6 39 2024-02-10T00:00:29.319 INFO:tasks.workunit.client.1.smithi183.stdout:9/482: mkdir d0/d3/d14/d1c/d2d/d4f/da4 0 2024-02-10T00:00:29.319 INFO:tasks.workunit.client.0.smithi164.stdout:2/107: creat d3/d24/d25/d27/f2c x:0 0 0 2024-02-10T00:00:29.321 INFO:tasks.workunit.client.0.smithi164.stdout:7/141: dwrite d3/f2d [0,4194304] 0 2024-02-10T00:00:29.321 INFO:tasks.workunit.client.0.smithi164.stdout:5/113: truncate d7/f19 1311398 0 2024-02-10T00:00:29.326 INFO:tasks.workunit.client.0.smithi164.stdout:1/77: creat d1/f1b x:0 0 0 2024-02-10T00:00:29.326 INFO:tasks.workunit.client.0.smithi164.stdout:1/78: write d1/f1b [127876,5416] 0 2024-02-10T00:00:29.330 INFO:tasks.workunit.client.1.smithi183.stdout:6/382: truncate d2/f19 1847803 0 2024-02-10T00:00:29.330 INFO:tasks.workunit.client.1.smithi183.stdout:8/541: write d0/d4e/d53/f64 [3800164,49636] 0 2024-02-10T00:00:29.331 INFO:tasks.workunit.client.0.smithi164.stdout:1/79: dwrite d1/f7 [0,4194304] 0 2024-02-10T00:00:29.331 INFO:tasks.workunit.client.0.smithi164.stdout:2/108: rename d3/f12 to d3/d24/d25/d27/f2d 0 2024-02-10T00:00:29.332 INFO:tasks.workunit.client.1.smithi183.stdout:9/483: truncate d0/d3/d14/d1c/f45 2494935 0 2024-02-10T00:00:29.332 INFO:tasks.workunit.client.1.smithi183.stdout:8/542: write d0/d27/d36/f80 [1013856,61100] 0 2024-02-10T00:00:29.332 INFO:tasks.workunit.client.0.smithi164.stdout:5/114: mknod d7/d17/c20 0 2024-02-10T00:00:29.332 INFO:tasks.workunit.client.1.smithi183.stdout:8/543: read - d0/d27/d75/f7e zero size 2024-02-10T00:00:29.333 INFO:tasks.workunit.client.0.smithi164.stdout:4/107: rmdir d2/d19/d16/d1f 39 2024-02-10T00:00:29.334 INFO:tasks.workunit.client.1.smithi183.stdout:9/484: creat d0/d3/d14/d1c/d4b/d51/fa5 x:0 0 0 2024-02-10T00:00:29.334 INFO:tasks.workunit.client.1.smithi183.stdout:9/485: read d0/f36 [446690,77193] 0 2024-02-10T00:00:29.335 INFO:tasks.workunit.client.0.smithi164.stdout:7/142: rename d3 to d3/d32 22 2024-02-10T00:00:29.335 INFO:tasks.workunit.client.0.smithi164.stdout:4/108: dread d2/f1e [0,4194304] 0 2024-02-10T00:00:29.336 INFO:tasks.workunit.client.0.smithi164.stdout:7/143: write d3/f16 [442820,77042] 0 2024-02-10T00:00:29.336 INFO:tasks.workunit.client.0.smithi164.stdout:4/109: dread - d2/d19/d16/f1b zero size 2024-02-10T00:00:29.336 INFO:tasks.workunit.client.1.smithi183.stdout:9/486: mknod d0/d3/d14/d1c/d4b/d51/ca6 0 2024-02-10T00:00:29.337 INFO:tasks.workunit.client.0.smithi164.stdout:5/115: mkdir d7/d17/d21 0 2024-02-10T00:00:29.337 INFO:tasks.workunit.client.1.smithi183.stdout:8/544: symlink d0/d10/d9e/lac 0 2024-02-10T00:00:29.338 INFO:tasks.workunit.client.1.smithi183.stdout:9/487: mknod d0/d3/d14/d1c/d4b/d97/ca7 0 2024-02-10T00:00:29.339 INFO:tasks.workunit.client.1.smithi183.stdout:8/545: symlink d0/d10/d9e/lad 0 2024-02-10T00:00:29.340 INFO:tasks.workunit.client.0.smithi164.stdout:5/116: creat d7/d17/f22 x:0 0 0 2024-02-10T00:00:29.340 INFO:tasks.workunit.client.1.smithi183.stdout:8/546: dread - d0/d23/d2d/d24/f54 zero size 2024-02-10T00:00:29.341 INFO:tasks.workunit.client.0.smithi164.stdout:7/144: mknod d3/d5/d2b/c33 0 2024-02-10T00:00:29.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/547: write d0/d23/d2d/f21 [896096,49323] 0 2024-02-10T00:00:29.341 INFO:tasks.workunit.client.1.smithi183.stdout:8/548: read - d0/d45/fa5 zero size 2024-02-10T00:00:29.342 INFO:tasks.workunit.client.1.smithi183.stdout:8/549: chown d0/d45/cab 5992 1 2024-02-10T00:00:29.343 INFO:tasks.workunit.client.0.smithi164.stdout:4/110: creat d2/d19/d16/f27 x:0 0 0 2024-02-10T00:00:29.343 INFO:tasks.workunit.client.0.smithi164.stdout:5/117: mkdir d7/d17/d21/d23 0 2024-02-10T00:00:29.345 INFO:tasks.workunit.client.0.smithi164.stdout:5/118: fdatasync d7/fc 0 2024-02-10T00:00:29.345 INFO:tasks.workunit.client.0.smithi164.stdout:4/111: dread d2/f8 [0,4194304] 0 2024-02-10T00:00:29.346 INFO:tasks.workunit.client.1.smithi183.stdout:8/550: creat d0/d27/d36/d7f/fae x:0 0 0 2024-02-10T00:00:29.348 INFO:tasks.workunit.client.0.smithi164.stdout:4/112: unlink d2/d19/l1c 0 2024-02-10T00:00:29.348 INFO:tasks.workunit.client.0.smithi164.stdout:5/119: mkdir d7/d17/d21/d24 0 2024-02-10T00:00:29.349 INFO:tasks.workunit.client.1.smithi183.stdout:8/551: rename d0/d31/ca0 to d0/d23/d2d/d24/caf 0 2024-02-10T00:00:29.350 INFO:tasks.workunit.client.0.smithi164.stdout:5/120: creat d7/d15/d1f/f25 x:0 0 0 2024-02-10T00:00:29.352 INFO:tasks.workunit.client.1.smithi183.stdout:8/552: dwrite d0/d23/f26 [0,4194304] 0 2024-02-10T00:00:29.353 INFO:tasks.workunit.client.0.smithi164.stdout:4/113: dwrite d2/d19/d16/f27 [0,4194304] 0 2024-02-10T00:00:29.353 INFO:tasks.workunit.client.0.smithi164.stdout:5/121: mkdir d7/d17/d21/d24/d26 0 2024-02-10T00:00:29.356 INFO:tasks.workunit.client.1.smithi183.stdout:8/553: dread d0/d4e/fa1 [0,4194304] 0 2024-02-10T00:00:29.356 INFO:tasks.workunit.client.0.smithi164.stdout:4/114: mkdir d2/d19/d16/d1f/d28 0 2024-02-10T00:00:29.359 INFO:tasks.workunit.client.0.smithi164.stdout:5/122: dwrite d7/f1d [0,4194304] 0 2024-02-10T00:00:29.360 INFO:tasks.workunit.client.0.smithi164.stdout:5/123: rename d7/d15/d1f to d7/d15/d1f/d27 22 2024-02-10T00:00:29.360 INFO:tasks.workunit.client.1.smithi183.stdout:8/554: truncate d0/d23/d2d/d24/f54 35675 0 2024-02-10T00:00:29.362 INFO:tasks.workunit.client.0.smithi164.stdout:5/124: creat d7/d17/d21/d24/f28 x:0 0 0 2024-02-10T00:00:29.363 INFO:tasks.workunit.client.1.smithi183.stdout:8/555: mknod d0/d27/d36/cb0 0 2024-02-10T00:00:29.367 INFO:tasks.workunit.client.0.smithi164.stdout:5/125: dwrite d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:29.370 INFO:tasks.workunit.client.0.smithi164.stdout:5/126: dread f1 [0,4194304] 0 2024-02-10T00:00:29.373 INFO:tasks.workunit.client.0.smithi164.stdout:5/127: creat d7/d17/d21/f29 x:0 0 0 2024-02-10T00:00:29.383 INFO:tasks.workunit.client.0.smithi164.stdout:5/128: getdents d7 0 2024-02-10T00:00:29.384 INFO:tasks.workunit.client.1.smithi183.stdout:3/410: truncate f6 2641714 0 2024-02-10T00:00:29.385 INFO:tasks.workunit.client.0.smithi164.stdout:0/87: truncate d6/d7/fd 345630 0 2024-02-10T00:00:29.386 INFO:tasks.workunit.client.1.smithi183.stdout:3/411: creat d7/db/d2a/f79 x:0 0 0 2024-02-10T00:00:29.388 INFO:tasks.workunit.client.0.smithi164.stdout:2/109: sync 2024-02-10T00:00:29.389 INFO:tasks.workunit.client.0.smithi164.stdout:2/110: read d3/f6 [3495212,105204] 0 2024-02-10T00:00:29.389 INFO:tasks.workunit.client.0.smithi164.stdout:3/71: rmdir d0/d1 39 2024-02-10T00:00:29.390 INFO:tasks.workunit.client.0.smithi164.stdout:5/129: mkdir d7/d17/d21/d24/d26/d2a 0 2024-02-10T00:00:29.391 INFO:tasks.workunit.client.0.smithi164.stdout:3/72: write d0/d1/d2/fe [440587,60552] 0 2024-02-10T00:00:29.391 INFO:tasks.workunit.client.0.smithi164.stdout:2/111: mkdir d3/d24/d25/d27/d2e 0 2024-02-10T00:00:29.391 INFO:tasks.workunit.client.0.smithi164.stdout:3/73: stat d0/f4 0 2024-02-10T00:00:29.393 INFO:tasks.workunit.client.0.smithi164.stdout:2/112: chown d3/f11 5916 1 2024-02-10T00:00:29.394 INFO:tasks.workunit.client.0.smithi164.stdout:3/74: write d0/d1/d2/fe [70312,87570] 0 2024-02-10T00:00:29.394 INFO:tasks.workunit.client.0.smithi164.stdout:3/75: fdatasync d0/d1/f11 0 2024-02-10T00:00:29.394 INFO:tasks.workunit.client.0.smithi164.stdout:5/130: dread f1 [0,4194304] 0 2024-02-10T00:00:29.395 INFO:tasks.workunit.client.0.smithi164.stdout:3/76: chown d0/d1/d2/c6 8319 1 2024-02-10T00:00:29.395 INFO:tasks.workunit.client.0.smithi164.stdout:5/131: write d7/d17/f1c [3277125,125859] 0 2024-02-10T00:00:29.399 INFO:tasks.workunit.client.0.smithi164.stdout:2/113: dread d3/f19 [0,4194304] 0 2024-02-10T00:00:29.400 INFO:tasks.workunit.client.0.smithi164.stdout:2/114: fsync f2 0 2024-02-10T00:00:29.400 INFO:tasks.workunit.client.0.smithi164.stdout:5/132: symlink d7/d15/l2b 0 2024-02-10T00:00:29.401 INFO:tasks.workunit.client.1.smithi183.stdout:3/412: dread d7/f12 [0,4194304] 0 2024-02-10T00:00:29.405 INFO:tasks.workunit.client.1.smithi183.stdout:0/428: getdents d14/d1d/d96 0 2024-02-10T00:00:29.406 INFO:tasks.workunit.client.0.smithi164.stdout:5/133: mknod d7/d15/d1f/c2c 0 2024-02-10T00:00:29.407 INFO:tasks.workunit.client.1.smithi183.stdout:4/475: truncate de/d14/f47 6850572 0 2024-02-10T00:00:29.407 INFO:tasks.workunit.client.1.smithi183.stdout:6/383: dread d2/d1a/d25/d3c/d31/d38/d6e/f2e [0,4194304] 0 2024-02-10T00:00:29.409 INFO:tasks.workunit.client.0.smithi164.stdout:1/80: fdatasync d1/f7 0 2024-02-10T00:00:29.409 INFO:tasks.workunit.client.1.smithi183.stdout:2/554: dwrite d2/da/d19/f7a [0,4194304] 0 2024-02-10T00:00:29.412 INFO:tasks.workunit.client.1.smithi183.stdout:4/476: dread de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:29.414 INFO:tasks.workunit.client.0.smithi164.stdout:5/134: chown d7/f1d 0 1 2024-02-10T00:00:29.415 INFO:tasks.workunit.client.0.smithi164.stdout:2/115: dwrite d3/fd [0,4194304] 0 2024-02-10T00:00:29.415 INFO:tasks.workunit.client.0.smithi164.stdout:5/135: readlink d7/d15/l2b 0 2024-02-10T00:00:29.416 INFO:tasks.workunit.client.1.smithi183.stdout:5/559: write d4/dd/d31/f4d [804713,48432] 0 2024-02-10T00:00:29.416 INFO:tasks.workunit.client.0.smithi164.stdout:6/184: truncate d0/d6/d12/f2e 2217646 0 2024-02-10T00:00:29.417 INFO:tasks.workunit.client.1.smithi183.stdout:5/560: write d4/dd/f75 [208267,75991] 0 2024-02-10T00:00:29.417 INFO:tasks.workunit.client.0.smithi164.stdout:8/100: rmdir d2 39 2024-02-10T00:00:29.420 INFO:tasks.workunit.client.1.smithi183.stdout:1/442: dwrite d0/d3/d67/f96 [0,4194304] 0 2024-02-10T00:00:29.421 INFO:tasks.workunit.client.0.smithi164.stdout:6/185: dwrite d0/d6/f28 [0,4194304] 0 2024-02-10T00:00:29.421 INFO:tasks.workunit.client.1.smithi183.stdout:1/443: chown d0/d3/d7/d36/d7c 1 1 2024-02-10T00:00:29.422 INFO:tasks.workunit.client.0.smithi164.stdout:6/186: write d0/d6/f7 [5430640,62224] 0 2024-02-10T00:00:29.423 INFO:tasks.workunit.client.1.smithi183.stdout:9/488: getdents d0/d3/d14/d1c/d2d 0 2024-02-10T00:00:29.428 INFO:tasks.workunit.client.1.smithi183.stdout:9/489: dwrite d0/d10/f8d [0,4194304] 0 2024-02-10T00:00:29.431 INFO:tasks.workunit.client.1.smithi183.stdout:2/555: fsync d2/da/d19/f7a 0 2024-02-10T00:00:29.432 INFO:tasks.workunit.client.1.smithi183.stdout:2/556: write d2/da/d19/fb4 [8991,18042] 0 2024-02-10T00:00:29.432 INFO:tasks.workunit.client.0.smithi164.stdout:7/145: write d3/d11/f18 [1066994,102243] 0 2024-02-10T00:00:29.434 INFO:tasks.workunit.client.1.smithi183.stdout:6/384: symlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/l72 0 2024-02-10T00:00:29.437 INFO:tasks.workunit.client.0.smithi164.stdout:4/115: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:29.446 INFO:tasks.workunit.client.1.smithi183.stdout:5/561: truncate d4/d23/d3e/d80/da1/d9e/d27/d37/fa5 65274 0 2024-02-10T00:00:29.449 INFO:tasks.workunit.client.1.smithi183.stdout:7/457: write d0/d2/d4/d8/f60 [916190,122277] 0 2024-02-10T00:00:29.449 INFO:tasks.workunit.client.0.smithi164.stdout:3/77: truncate d0/f4 7783431 0 2024-02-10T00:00:29.449 INFO:tasks.workunit.client.0.smithi164.stdout:3/78: stat d0/d1/c8 0 2024-02-10T00:00:29.450 INFO:tasks.workunit.client.0.smithi164.stdout:3/79: write d0/d1/f11 [1022510,1880] 0 2024-02-10T00:00:29.451 INFO:tasks.workunit.client.1.smithi183.stdout:0/429: rename d14/d3e/l7d to d14/d1d/d96/da0/la2 0 2024-02-10T00:00:29.454 INFO:tasks.workunit.client.1.smithi183.stdout:2/557: creat d2/d2c/d2f/d60/fb9 x:0 0 0 2024-02-10T00:00:29.455 INFO:tasks.workunit.client.1.smithi183.stdout:6/385: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73 0 2024-02-10T00:00:29.458 INFO:tasks.workunit.client.1.smithi183.stdout:4/477: link de/d22/f43 de/d14/d27/d2e/f8e 0 2024-02-10T00:00:29.464 INFO:tasks.workunit.client.1.smithi183.stdout:6/386: mknod d2/d1a/d3a/d45/d53/c74 0 2024-02-10T00:00:29.464 INFO:tasks.workunit.client.1.smithi183.stdout:3/413: getdents d7/db/d2a/d2d/d51 0 2024-02-10T00:00:29.465 INFO:tasks.workunit.client.1.smithi183.stdout:1/444: creat d0/d3/fa6 x:0 0 0 2024-02-10T00:00:29.468 INFO:tasks.workunit.client.1.smithi183.stdout:7/458: symlink d0/d2/d4/l7e 0 2024-02-10T00:00:29.469 INFO:tasks.workunit.client.1.smithi183.stdout:0/430: rmdir d14/d7a/d63 39 2024-02-10T00:00:29.469 INFO:tasks.workunit.client.1.smithi183.stdout:4/478: dwrite de/d19/d1c/f36 [0,4194304] 0 2024-02-10T00:00:29.470 INFO:tasks.workunit.client.1.smithi183.stdout:0/431: fsync d14/d7a/f7e 0 2024-02-10T00:00:29.471 INFO:tasks.workunit.client.0.smithi164.stdout:0/88: dread d6/d7/fd [0,4194304] 0 2024-02-10T00:00:29.473 INFO:tasks.workunit.client.1.smithi183.stdout:0/432: dread - d14/d1d/d59/d71/d22/f98 zero size 2024-02-10T00:00:29.475 INFO:tasks.workunit.client.1.smithi183.stdout:0/433: fsync d14/d1d/d55/f84 0 2024-02-10T00:00:29.475 INFO:tasks.workunit.client.1.smithi183.stdout:8/556: dwrite d0/d23/d2d/d24/f54 [0,4194304] 0 2024-02-10T00:00:29.476 INFO:tasks.workunit.client.1.smithi183.stdout:4/479: dread de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:29.477 INFO:tasks.workunit.client.1.smithi183.stdout:4/480: write de/d19/f69 [718574,35184] 0 2024-02-10T00:00:29.479 INFO:tasks.workunit.client.1.smithi183.stdout:9/490: truncate d0/d3/d14/f20 1955513 0 2024-02-10T00:00:29.481 INFO:tasks.workunit.client.1.smithi183.stdout:2/558: mkdir d2/d2c/dba 0 2024-02-10T00:00:29.484 INFO:tasks.workunit.client.1.smithi183.stdout:1/445: creat d0/d3a/fa7 x:0 0 0 2024-02-10T00:00:29.484 INFO:tasks.workunit.client.1.smithi183.stdout:5/562: link d4/d23/d3e/d80/da1/d9c/d72/l8b d4/d23/d3e/d80/da1/d9c/d72/da0/da9/lb1 0 2024-02-10T00:00:29.484 INFO:tasks.workunit.client.1.smithi183.stdout:1/446: chown d0/d3/d67 96 1 2024-02-10T00:00:29.489 INFO:tasks.workunit.client.1.smithi183.stdout:0/434: mkdir d14/d1d/d2d/d31/d68/da3 0 2024-02-10T00:00:29.489 INFO:tasks.workunit.client.1.smithi183.stdout:7/459: dwrite d0/d11/f57 [0,4194304] 0 2024-02-10T00:00:29.490 INFO:tasks.workunit.client.1.smithi183.stdout:0/435: chown d14/d43 2 1 2024-02-10T00:00:29.491 INFO:tasks.workunit.client.1.smithi183.stdout:4/481: creat de/d14/d1d/d7b/f8f x:0 0 0 2024-02-10T00:00:29.491 INFO:tasks.workunit.client.1.smithi183.stdout:7/460: fdatasync d0/d11/d3e/f70 0 2024-02-10T00:00:29.492 INFO:tasks.workunit.client.1.smithi183.stdout:0/436: write d14/d1d/d59/d71/d22/f41 [831205,54339] 0 2024-02-10T00:00:29.492 INFO:tasks.workunit.client.1.smithi183.stdout:9/491: unlink d0/f68 0 2024-02-10T00:00:29.494 INFO:tasks.workunit.client.1.smithi183.stdout:0/437: dread - d14/d7a/f7e zero size 2024-02-10T00:00:29.494 INFO:tasks.workunit.client.1.smithi183.stdout:9/492: readlink d0/d30/d52/l5d 0 2024-02-10T00:00:29.494 INFO:tasks.workunit.client.1.smithi183.stdout:2/559: rename d2/d2c/dab/d99/db0 to d2/d2c/d2f/dbb 0 2024-02-10T00:00:29.495 INFO:tasks.workunit.client.1.smithi183.stdout:6/387: mknod d2/d1a/d3a/c75 0 2024-02-10T00:00:29.496 INFO:tasks.workunit.client.1.smithi183.stdout:6/388: fsync d2/d1a/f1f 0 2024-02-10T00:00:29.497 INFO:tasks.workunit.client.1.smithi183.stdout:3/414: creat d7/db/d2a/d1c/f7a x:0 0 0 2024-02-10T00:00:29.504 INFO:tasks.workunit.client.0.smithi164.stdout:2/116: creat d3/d24/d25/f2f x:0 0 0 2024-02-10T00:00:29.504 INFO:tasks.workunit.client.0.smithi164.stdout:2/117: chown d3/lb 6604230 1 2024-02-10T00:00:29.505 INFO:tasks.workunit.client.0.smithi164.stdout:2/118: dread d3/f7 [0,4194304] 0 2024-02-10T00:00:29.507 INFO:tasks.workunit.client.0.smithi164.stdout:7/146: read d3/d5/f7 [1095994,127401] 0 2024-02-10T00:00:29.508 INFO:tasks.workunit.client.1.smithi183.stdout:9/493: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:29.508 INFO:tasks.workunit.client.0.smithi164.stdout:4/116: creat d2/d19/f29 x:0 0 0 2024-02-10T00:00:29.511 INFO:tasks.workunit.client.1.smithi183.stdout:4/482: rename de/d19/d1c/d61/f64 to de/d14/d27/d2e/f90 0 2024-02-10T00:00:29.513 INFO:tasks.workunit.client.1.smithi183.stdout:0/438: dread d14/d1d/d2d/d31/d6c/d70/f81 [0,4194304] 0 2024-02-10T00:00:29.517 INFO:tasks.workunit.client.0.smithi164.stdout:5/136: creat d7/d17/d21/d23/f2d x:0 0 0 2024-02-10T00:00:29.518 INFO:tasks.workunit.client.0.smithi164.stdout:5/137: write d7/f1d [4440259,8700] 0 2024-02-10T00:00:29.518 INFO:tasks.workunit.client.0.smithi164.stdout:8/101: truncate d2/f7 70891 0 2024-02-10T00:00:29.518 INFO:tasks.workunit.client.1.smithi183.stdout:8/557: dwrite d0/d3f/f57 [0,4194304] 0 2024-02-10T00:00:29.519 INFO:tasks.workunit.client.1.smithi183.stdout:3/415: creat d7/db/d2a/d2d/d51/f7b x:0 0 0 2024-02-10T00:00:29.519 INFO:tasks.workunit.client.1.smithi183.stdout:8/558: chown d0/d4e/d6b/f6c 40 1 2024-02-10T00:00:29.519 INFO:tasks.workunit.client.0.smithi164.stdout:2/119: mknod d3/c30 0 2024-02-10T00:00:29.520 INFO:tasks.workunit.client.1.smithi183.stdout:7/461: write d0/d11/d2f/f34 [3959457,36519] 0 2024-02-10T00:00:29.522 INFO:tasks.workunit.client.0.smithi164.stdout:1/81: truncate d1/f6 2362806 0 2024-02-10T00:00:29.522 INFO:tasks.workunit.client.0.smithi164.stdout:5/138: dwrite d7/fc [0,4194304] 0 2024-02-10T00:00:29.523 INFO:tasks.workunit.client.1.smithi183.stdout:4/483: chown de/d14/c4f 2365 1 2024-02-10T00:00:29.523 INFO:tasks.workunit.client.1.smithi183.stdout:2/560: creat d2/d2c/d2f/d60/d8d/d9c/da7/fbc x:0 0 0 2024-02-10T00:00:29.525 INFO:tasks.workunit.client.1.smithi183.stdout:2/561: write d2/d2c/dab/d99/fa3 [311105,67491] 0 2024-02-10T00:00:29.527 INFO:tasks.workunit.client.0.smithi164.stdout:9/131: rename c1 to d6/d1c/c28 0 2024-02-10T00:00:29.530 INFO:tasks.workunit.client.0.smithi164.stdout:6/187: rmdir d0/d6/d12/d14/d37 0 2024-02-10T00:00:29.531 INFO:tasks.workunit.client.1.smithi183.stdout:7/462: mknod d0/d11/d35/c7f 0 2024-02-10T00:00:29.531 INFO:tasks.workunit.client.0.smithi164.stdout:7/147: mkdir d3/d34 0 2024-02-10T00:00:29.532 INFO:tasks.workunit.client.1.smithi183.stdout:4/484: creat de/d19/d1c/d61/f91 x:0 0 0 2024-02-10T00:00:29.532 INFO:tasks.workunit.client.0.smithi164.stdout:7/148: fdatasync d3/f16 0 2024-02-10T00:00:29.532 INFO:tasks.workunit.client.0.smithi164.stdout:4/117: symlink d2/d19/d16/l2a 0 2024-02-10T00:00:29.533 INFO:tasks.workunit.client.1.smithi183.stdout:4/485: read de/d19/d1c/f36 [2143352,54866] 0 2024-02-10T00:00:29.533 INFO:tasks.workunit.client.1.smithi183.stdout:5/563: creat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fb2 x:0 0 0 2024-02-10T00:00:29.534 INFO:tasks.workunit.client.1.smithi183.stdout:2/562: mkdir d2/da/d20/d6d/dbd 0 2024-02-10T00:00:29.535 INFO:tasks.workunit.client.0.smithi164.stdout:6/188: dwrite d0/d6/f10 [0,4194304] 0 2024-02-10T00:00:29.535 INFO:tasks.workunit.client.1.smithi183.stdout:2/563: chown d2/d2c/d2f 5456292 1 2024-02-10T00:00:29.536 INFO:tasks.workunit.client.1.smithi183.stdout:3/416: link d7/db/d2a/d33/d59/d52/f60 d7/db/d2a/d1c/f7c 0 2024-02-10T00:00:29.537 INFO:tasks.workunit.client.0.smithi164.stdout:6/189: dread d0/d6/d12/f2e [0,4194304] 0 2024-02-10T00:00:29.540 INFO:tasks.workunit.client.1.smithi183.stdout:4/486: mkdir de/d22/d92 0 2024-02-10T00:00:29.541 INFO:tasks.workunit.client.0.smithi164.stdout:0/89: rename d6/f8 to d6/d7/d14/f1b 0 2024-02-10T00:00:29.543 INFO:tasks.workunit.client.1.smithi183.stdout:3/417: symlink d7/db/d2a/d33/d59/d52/l7d 0 2024-02-10T00:00:29.543 INFO:tasks.workunit.client.1.smithi183.stdout:3/418: stat d7 0 2024-02-10T00:00:29.543 INFO:tasks.workunit.client.1.smithi183.stdout:0/439: getdents d14/d1d/d59/d3c/d93 0 2024-02-10T00:00:29.543 INFO:tasks.workunit.client.1.smithi183.stdout:7/463: dread d0/f32 [4194304,4194304] 0 2024-02-10T00:00:29.544 INFO:tasks.workunit.client.1.smithi183.stdout:3/419: stat d7/db/d2a/d33/d59/c5f 0 2024-02-10T00:00:29.544 INFO:tasks.workunit.client.0.smithi164.stdout:2/120: creat d3/d24/d25/d27/d2a/f31 x:0 0 0 2024-02-10T00:00:29.545 INFO:tasks.workunit.client.1.smithi183.stdout:3/420: write d7/db/d2a/d4d/f70 [494371,99493] 0 2024-02-10T00:00:29.546 INFO:tasks.workunit.client.0.smithi164.stdout:1/82: mknod d1/d13/d16/c1c 0 2024-02-10T00:00:29.549 INFO:tasks.workunit.client.1.smithi183.stdout:0/440: mknod d14/d1d/d2d/d31/d68/ca4 0 2024-02-10T00:00:29.549 INFO:tasks.workunit.client.1.smithi183.stdout:7/464: mkdir d0/d11/d2f/d64/d80 0 2024-02-10T00:00:29.549 INFO:tasks.workunit.client.0.smithi164.stdout:2/121: mkdir d3/d32 0 2024-02-10T00:00:29.551 INFO:tasks.workunit.client.0.smithi164.stdout:6/190: mkdir d0/d3b 0 2024-02-10T00:00:29.551 INFO:tasks.workunit.client.1.smithi183.stdout:7/465: dread d0/d11/d3e/f49 [0,4194304] 0 2024-02-10T00:00:29.552 INFO:tasks.workunit.client.0.smithi164.stdout:0/90: dwrite d6/d7/d14/f1b [0,4194304] 0 2024-02-10T00:00:29.555 INFO:tasks.workunit.client.0.smithi164.stdout:9/132: creat d6/d1c/f29 x:0 0 0 2024-02-10T00:00:29.555 INFO:tasks.workunit.client.1.smithi183.stdout:0/441: unlink d14/d1d/d59/d71/d22/f98 0 2024-02-10T00:00:29.555 INFO:tasks.workunit.client.1.smithi183.stdout:2/564: getdents d2/da 0 2024-02-10T00:00:29.556 INFO:tasks.workunit.client.1.smithi183.stdout:5/564: truncate d4/d23/f94 1455890 0 2024-02-10T00:00:29.556 INFO:tasks.workunit.client.1.smithi183.stdout:9/494: dread d0/d10/f81 [0,4194304] 0 2024-02-10T00:00:29.558 INFO:tasks.workunit.client.1.smithi183.stdout:3/421: rename d7/db/d2a/d4d/c58 to d7/db/c7e 0 2024-02-10T00:00:29.559 INFO:tasks.workunit.client.0.smithi164.stdout:8/102: rename l0 to d2/l18 0 2024-02-10T00:00:29.560 INFO:tasks.workunit.client.0.smithi164.stdout:3/80: dwrite d0/f4 [4194304,4194304] 0 2024-02-10T00:00:29.561 INFO:tasks.workunit.client.1.smithi183.stdout:5/565: read d4/d23/d3e/d80/da1/d9e/d27/d9d/fac [428368,38486] 0 2024-02-10T00:00:29.561 INFO:tasks.workunit.client.1.smithi183.stdout:7/466: symlink d0/d11/d2f/d64/d80/l81 0 2024-02-10T00:00:29.561 INFO:tasks.workunit.client.1.smithi183.stdout:2/565: stat d2/da/d20/d21/d43/d58/d8e/c9e 0 2024-02-10T00:00:29.563 INFO:tasks.workunit.client.0.smithi164.stdout:6/191: mknod d0/d2b/c3c 0 2024-02-10T00:00:29.564 INFO:tasks.workunit.client.1.smithi183.stdout:7/467: write d0/d11/f36 [308964,87377] 0 2024-02-10T00:00:29.564 INFO:tasks.workunit.client.1.smithi183.stdout:4/487: link de/d14/c78 de/d14/c93 0 2024-02-10T00:00:29.564 INFO:tasks.workunit.client.0.smithi164.stdout:2/122: symlink d3/d32/l33 0 2024-02-10T00:00:29.565 INFO:tasks.workunit.client.0.smithi164.stdout:2/123: chown d3/d24 21 1 2024-02-10T00:00:29.566 INFO:tasks.workunit.client.0.smithi164.stdout:8/103: creat d2/f19 x:0 0 0 2024-02-10T00:00:29.566 INFO:tasks.workunit.client.1.smithi183.stdout:7/468: dwrite d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:29.567 INFO:tasks.workunit.client.0.smithi164.stdout:8/104: write d2/f10 [251988,103408] 0 2024-02-10T00:00:29.568 INFO:tasks.workunit.client.0.smithi164.stdout:9/133: dwrite d6/de/f11 [0,4194304] 0 2024-02-10T00:00:29.568 INFO:tasks.workunit.client.1.smithi183.stdout:0/442: dread d14/d1d/d59/d71/f27 [0,4194304] 0 2024-02-10T00:00:29.569 INFO:tasks.workunit.client.0.smithi164.stdout:0/91: mkdir d6/d10/d18/d1c 0 2024-02-10T00:00:29.569 INFO:tasks.workunit.client.1.smithi183.stdout:6/389: sync 2024-02-10T00:00:29.570 INFO:tasks.workunit.client.1.smithi183.stdout:1/447: sync 2024-02-10T00:00:29.570 INFO:tasks.workunit.client.1.smithi183.stdout:0/443: dread - d14/d1d/d2d/d31/d6c/f76 zero size 2024-02-10T00:00:29.571 INFO:tasks.workunit.client.0.smithi164.stdout:0/92: dread d6/d7/fd [0,4194304] 0 2024-02-10T00:00:29.571 INFO:tasks.workunit.client.0.smithi164.stdout:5/139: rename d7/d15/c1a to d7/d17/d21/d23/c2e 0 2024-02-10T00:00:29.571 INFO:tasks.workunit.client.0.smithi164.stdout:0/93: write d6/d7/f17 [333235,115887] 0 2024-02-10T00:00:29.571 INFO:tasks.workunit.client.1.smithi183.stdout:0/444: readlink d14/d3e/d5f/l61 0 2024-02-10T00:00:29.572 INFO:tasks.workunit.client.0.smithi164.stdout:2/124: mkdir d3/d24/d25/d34 0 2024-02-10T00:00:29.573 INFO:tasks.workunit.client.0.smithi164.stdout:2/125: readlink d3/l1d 0 2024-02-10T00:00:29.574 INFO:tasks.workunit.client.0.smithi164.stdout:8/105: mknod d2/c1a 0 2024-02-10T00:00:29.575 INFO:tasks.workunit.client.0.smithi164.stdout:2/126: stat d3/d32 0 2024-02-10T00:00:29.575 INFO:tasks.workunit.client.0.smithi164.stdout:3/81: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:29.575 INFO:tasks.workunit.client.0.smithi164.stdout:6/192: mkdir d0/d2b/d3a/d3d 0 2024-02-10T00:00:29.576 INFO:tasks.workunit.client.1.smithi183.stdout:9/495: truncate d0/d3/d14/d1c/d2d/d4f/d58/f61 1170571 0 2024-02-10T00:00:29.578 INFO:tasks.workunit.client.0.smithi164.stdout:8/106: dread d2/fa [0,4194304] 0 2024-02-10T00:00:29.579 INFO:tasks.workunit.client.1.smithi183.stdout:8/559: dwrite d0/d4e/f6a [0,4194304] 0 2024-02-10T00:00:29.580 INFO:tasks.workunit.client.0.smithi164.stdout:5/140: dwrite d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:29.580 INFO:tasks.workunit.client.0.smithi164.stdout:0/94: dwrite f5 [4194304,4194304] 0 2024-02-10T00:00:29.581 INFO:tasks.workunit.client.0.smithi164.stdout:5/141: readlink d7/l1e 0 2024-02-10T00:00:29.583 INFO:tasks.workunit.client.0.smithi164.stdout:3/82: dwrite d0/f10 [4194304,4194304] 0 2024-02-10T00:00:29.584 INFO:tasks.workunit.client.1.smithi183.stdout:1/448: unlink d0/d3/d7/d3d/l72 0 2024-02-10T00:00:29.586 INFO:tasks.workunit.client.1.smithi183.stdout:5/566: truncate d4/f79 295796 0 2024-02-10T00:00:29.586 INFO:tasks.workunit.client.0.smithi164.stdout:2/127: chown d3/l4 246821 1 2024-02-10T00:00:29.587 INFO:tasks.workunit.client.0.smithi164.stdout:2/128: dread - d3/f23 zero size 2024-02-10T00:00:29.587 INFO:tasks.workunit.client.0.smithi164.stdout:3/83: dwrite d0/d1/d2/fe [0,4194304] 0 2024-02-10T00:00:29.589 INFO:tasks.workunit.client.0.smithi164.stdout:6/193: creat d0/d2b/d3a/f3e x:0 0 0 2024-02-10T00:00:29.591 INFO:tasks.workunit.client.1.smithi183.stdout:4/488: rename de/d19/d1c/f39 to de/d14/d4e/f94 0 2024-02-10T00:00:29.591 INFO:tasks.workunit.client.1.smithi183.stdout:4/489: readlink de/d14/d1d/l6e 0 2024-02-10T00:00:29.592 INFO:tasks.workunit.client.1.smithi183.stdout:4/490: chown de/d14/d27/d2e/f86 156907422 1 2024-02-10T00:00:29.592 INFO:tasks.workunit.client.1.smithi183.stdout:4/491: dread - de/d14/d27/f55 zero size 2024-02-10T00:00:29.594 INFO:tasks.workunit.client.0.smithi164.stdout:0/95: creat d6/d10/f1d x:0 0 0 2024-02-10T00:00:29.595 INFO:tasks.workunit.client.0.smithi164.stdout:0/96: chown d6/d10/d18/d1c 0 1 2024-02-10T00:00:29.595 INFO:tasks.workunit.client.0.smithi164.stdout:0/97: chown d6/f15 405151 1 2024-02-10T00:00:29.598 INFO:tasks.workunit.client.0.smithi164.stdout:5/142: symlink d7/d17/d21/l2f 0 2024-02-10T00:00:29.598 INFO:tasks.workunit.client.0.smithi164.stdout:7/149: rename d3/f4 to d3/d28/f35 0 2024-02-10T00:00:29.599 INFO:tasks.workunit.client.1.smithi183.stdout:5/567: rename d4/d23/d4a/f1f to d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/fb3 0 2024-02-10T00:00:29.600 INFO:tasks.workunit.client.1.smithi183.stdout:5/568: fdatasync d4/d23/d4a/d36/f5e 0 2024-02-10T00:00:29.602 INFO:tasks.workunit.client.0.smithi164.stdout:9/134: creat d6/d1c/d24/f2a x:0 0 0 2024-02-10T00:00:29.603 INFO:tasks.workunit.client.0.smithi164.stdout:9/135: stat d6/l27 0 2024-02-10T00:00:29.603 INFO:tasks.workunit.client.0.smithi164.stdout:9/136: dread - d6/d1c/d24/f2a zero size 2024-02-10T00:00:29.604 INFO:tasks.workunit.client.1.smithi183.stdout:2/566: dread d2/f3e [0,4194304] 0 2024-02-10T00:00:29.604 INFO:tasks.workunit.client.0.smithi164.stdout:9/137: chown d6/de/f21 125 1 2024-02-10T00:00:29.605 INFO:tasks.workunit.client.0.smithi164.stdout:4/118: rename d2/d19/l10 to d2/l2b 0 2024-02-10T00:00:29.610 INFO:tasks.workunit.client.1.smithi183.stdout:5/569: creat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d9f/fb4 x:0 0 0 2024-02-10T00:00:29.610 INFO:tasks.workunit.client.0.smithi164.stdout:7/150: creat d3/d26/f36 x:0 0 0 2024-02-10T00:00:29.610 INFO:tasks.workunit.client.0.smithi164.stdout:7/151: chown d3/d34 827 1 2024-02-10T00:00:29.611 INFO:tasks.workunit.client.0.smithi164.stdout:6/194: mknod d0/d3b/c3f 0 2024-02-10T00:00:29.613 INFO:tasks.workunit.client.0.smithi164.stdout:9/138: mkdir d6/de/d2b 0 2024-02-10T00:00:29.613 INFO:tasks.workunit.client.0.smithi164.stdout:9/139: stat c3 0 2024-02-10T00:00:29.614 INFO:tasks.workunit.client.0.smithi164.stdout:6/195: dread d0/fc [0,4194304] 0 2024-02-10T00:00:29.615 INFO:tasks.workunit.client.0.smithi164.stdout:1/83: rename d1/cf to d1/da/d18/c1d 0 2024-02-10T00:00:29.616 INFO:tasks.workunit.client.0.smithi164.stdout:1/84: stat l0 0 2024-02-10T00:00:29.618 INFO:tasks.workunit.client.0.smithi164.stdout:2/129: rmdir d3/d24/d25/d34 0 2024-02-10T00:00:29.619 INFO:tasks.workunit.client.0.smithi164.stdout:9/140: dwrite d6/de/d22/f26 [0,4194304] 0 2024-02-10T00:00:29.619 INFO:tasks.workunit.client.0.smithi164.stdout:6/196: dread d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:29.620 INFO:tasks.workunit.client.0.smithi164.stdout:2/130: dread - d3/d24/d25/d27/f28 zero size 2024-02-10T00:00:29.620 INFO:tasks.workunit.client.0.smithi164.stdout:9/141: dread - d6/de/f14 zero size 2024-02-10T00:00:29.621 INFO:tasks.workunit.client.0.smithi164.stdout:9/142: fdatasync d6/de/f14 0 2024-02-10T00:00:29.622 INFO:tasks.workunit.client.0.smithi164.stdout:5/143: link d7/l12 d7/d17/d21/d24/l30 0 2024-02-10T00:00:29.623 INFO:tasks.workunit.client.1.smithi183.stdout:7/469: dread d0/d2/d3/f20 [0,4194304] 0 2024-02-10T00:00:29.623 INFO:tasks.workunit.client.1.smithi183.stdout:5/570: write d4/d23/d3e/d80/da1/d9e/f39 [1256403,97926] 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.0.smithi164.stdout:0/98: getdents d6 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.0.smithi164.stdout:6/197: symlink d0/d3b/l40 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.0.smithi164.stdout:2/131: mknod d3/c35 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.0.smithi164.stdout:0/99: write f5 [4317295,69716] 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.0.smithi164.stdout:9/143: stat d6/f20 0 2024-02-10T00:00:29.628 INFO:tasks.workunit.client.1.smithi183.stdout:7/470: creat d0/d11/f82 x:0 0 0 2024-02-10T00:00:29.629 INFO:tasks.workunit.client.0.smithi164.stdout:5/144: symlink d7/d17/d21/d24/l31 0 2024-02-10T00:00:29.630 INFO:tasks.workunit.client.0.smithi164.stdout:5/145: write d7/d15/d1f/f25 [588013,40185] 0 2024-02-10T00:00:29.631 INFO:tasks.workunit.client.0.smithi164.stdout:6/198: write d0/fc [3028350,129769] 0 2024-02-10T00:00:29.633 INFO:tasks.workunit.client.0.smithi164.stdout:9/144: write d6/f9 [1355464,38148] 0 2024-02-10T00:00:29.634 INFO:tasks.workunit.client.0.smithi164.stdout:2/132: mkdir d3/d24/d25/d27/d2e/d36 0 2024-02-10T00:00:29.634 INFO:tasks.workunit.client.0.smithi164.stdout:2/133: chown d3/f16 20370198 1 2024-02-10T00:00:29.635 INFO:tasks.workunit.client.0.smithi164.stdout:0/100: mknod d6/d10/d18/d1c/c1e 0 2024-02-10T00:00:29.638 INFO:tasks.workunit.client.0.smithi164.stdout:2/134: dread d3/fe [0,4194304] 0 2024-02-10T00:00:29.638 INFO:tasks.workunit.client.1.smithi183.stdout:0/445: sync 2024-02-10T00:00:29.639 INFO:tasks.workunit.client.1.smithi183.stdout:0/446: readlink d14/d3e/d5f/l61 0 2024-02-10T00:00:29.639 INFO:tasks.workunit.client.0.smithi164.stdout:0/101: unlink d6/d7/fd 0 2024-02-10T00:00:29.641 INFO:tasks.workunit.client.1.smithi183.stdout:0/447: write d14/d1d/d59/d71/d22/f44 [1828242,15709] 0 2024-02-10T00:00:29.641 INFO:tasks.workunit.client.0.smithi164.stdout:2/135: symlink d3/d24/d25/l37 0 2024-02-10T00:00:29.642 INFO:tasks.workunit.client.0.smithi164.stdout:2/136: chown d3/l4 2352 1 2024-02-10T00:00:29.642 INFO:tasks.workunit.client.0.smithi164.stdout:9/145: creat d6/d1c/f2c x:0 0 0 2024-02-10T00:00:29.642 INFO:tasks.workunit.client.1.smithi183.stdout:0/448: fsync d14/d1d/d59/d3c/d72/f94 0 2024-02-10T00:00:29.642 INFO:tasks.workunit.client.1.smithi183.stdout:6/390: dread d2/d1a/f23 [4194304,4194304] 0 2024-02-10T00:00:29.643 INFO:tasks.workunit.client.0.smithi164.stdout:0/102: creat d6/d10/d18/d1c/f1f x:0 0 0 2024-02-10T00:00:29.643 INFO:tasks.workunit.client.0.smithi164.stdout:6/199: getdents d0/d6/d12 0 2024-02-10T00:00:29.645 INFO:tasks.workunit.client.1.smithi183.stdout:0/449: creat d14/d1d/d96/da0/fa5 x:0 0 0 2024-02-10T00:00:29.645 INFO:tasks.workunit.client.1.smithi183.stdout:6/391: read d2/f65 [910009,59167] 0 2024-02-10T00:00:29.646 INFO:tasks.workunit.client.1.smithi183.stdout:0/450: stat d14/d3e/c53 0 2024-02-10T00:00:29.646 INFO:tasks.workunit.client.0.smithi164.stdout:0/103: unlink d6/ce 0 2024-02-10T00:00:29.646 INFO:tasks.workunit.client.0.smithi164.stdout:9/146: truncate d6/f1a 120284 0 2024-02-10T00:00:29.647 INFO:tasks.workunit.client.0.smithi164.stdout:2/137: dwrite d3/d24/d25/d27/f2c [0,4194304] 0 2024-02-10T00:00:29.649 INFO:tasks.workunit.client.0.smithi164.stdout:6/200: rename d0/d6/f8 to d0/d6/d12/f41 0 2024-02-10T00:00:29.650 INFO:tasks.workunit.client.0.smithi164.stdout:6/201: write d0/d6/d12/f1f [594065,95376] 0 2024-02-10T00:00:29.651 INFO:tasks.workunit.client.0.smithi164.stdout:0/104: creat d6/d7/d14/f20 x:0 0 0 2024-02-10T00:00:29.651 INFO:tasks.workunit.client.1.smithi183.stdout:0/451: dwrite d14/d1d/d2d/d31/d68/f6a [0,4194304] 0 2024-02-10T00:00:29.651 INFO:tasks.workunit.client.0.smithi164.stdout:6/202: chown d0/f2f 44478 1 2024-02-10T00:00:29.652 INFO:tasks.workunit.client.0.smithi164.stdout:2/138: dread d3/f18 [0,4194304] 0 2024-02-10T00:00:29.652 INFO:tasks.workunit.client.0.smithi164.stdout:6/203: chown d0/fc 819911801 1 2024-02-10T00:00:29.652 INFO:tasks.workunit.client.1.smithi183.stdout:0/452: readlink d14/d3e/d92/l66 0 2024-02-10T00:00:29.653 INFO:tasks.workunit.client.0.smithi164.stdout:6/204: dread - d0/d2b/d3a/f3e zero size 2024-02-10T00:00:29.654 INFO:tasks.workunit.client.0.smithi164.stdout:6/205: fdatasync d0/d2b/f36 0 2024-02-10T00:00:29.654 INFO:tasks.workunit.client.0.smithi164.stdout:6/206: chown d0/d2b/d3a/d3d 91649 1 2024-02-10T00:00:29.654 INFO:tasks.workunit.client.1.smithi183.stdout:9/496: dread d0/d3/d14/d1c/f5c [0,4194304] 0 2024-02-10T00:00:29.658 INFO:tasks.workunit.client.1.smithi183.stdout:9/497: rmdir d0/d3/d14/d74/d90 39 2024-02-10T00:00:29.659 INFO:tasks.workunit.client.0.smithi164.stdout:2/139: rename d3/l1e to d3/d24/d25/d27/l38 0 2024-02-10T00:00:29.659 INFO:tasks.workunit.client.0.smithi164.stdout:9/147: link d6/ca d6/de/d22/c2d 0 2024-02-10T00:00:29.660 INFO:tasks.workunit.client.1.smithi183.stdout:6/392: dread d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:29.661 INFO:tasks.workunit.client.1.smithi183.stdout:6/393: stat d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c6d 0 2024-02-10T00:00:29.663 INFO:tasks.workunit.client.1.smithi183.stdout:6/394: write d2/d1a/d25/d3c/d31/f6b [641504,87546] 0 2024-02-10T00:00:29.663 INFO:tasks.workunit.client.1.smithi183.stdout:0/453: read d14/f37 [336696,66041] 0 2024-02-10T00:00:29.663 INFO:tasks.workunit.client.1.smithi183.stdout:5/571: dread d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f69 [0,4194304] 0 2024-02-10T00:00:29.664 INFO:tasks.workunit.client.1.smithi183.stdout:5/572: chown d4/d23/d3e/d80/da1/f6b 88 1 2024-02-10T00:00:29.665 INFO:tasks.workunit.client.1.smithi183.stdout:9/498: mkdir d0/d3/d14/d74/da8 0 2024-02-10T00:00:29.665 INFO:tasks.workunit.client.0.smithi164.stdout:2/140: creat d3/d24/f39 x:0 0 0 2024-02-10T00:00:29.666 INFO:tasks.workunit.client.0.smithi164.stdout:0/105: link d6/d10/l12 d6/d10/d18/l21 0 2024-02-10T00:00:29.666 INFO:tasks.workunit.client.0.smithi164.stdout:2/141: write f0 [496303,1009] 0 2024-02-10T00:00:29.666 INFO:tasks.workunit.client.0.smithi164.stdout:0/106: fsync d6/d7/fc 0 2024-02-10T00:00:29.670 INFO:tasks.workunit.client.0.smithi164.stdout:0/107: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:29.671 INFO:tasks.workunit.client.1.smithi183.stdout:3/422: getdents d7/db/d2a/d4d 0 2024-02-10T00:00:29.672 INFO:tasks.workunit.client.0.smithi164.stdout:2/142: rename d3/f22 to d3/d24/d25/d27/d2e/f3a 0 2024-02-10T00:00:29.673 INFO:tasks.workunit.client.0.smithi164.stdout:2/143: read d3/f15 [2375060,57329] 0 2024-02-10T00:00:29.674 INFO:tasks.workunit.client.0.smithi164.stdout:9/148: creat d6/d1c/f2e x:0 0 0 2024-02-10T00:00:29.674 INFO:tasks.workunit.client.1.smithi183.stdout:6/395: write d2/f65 [1856617,17786] 0 2024-02-10T00:00:29.677 INFO:tasks.workunit.client.1.smithi183.stdout:0/454: symlink d14/d43/la6 0 2024-02-10T00:00:29.679 INFO:tasks.workunit.client.1.smithi183.stdout:5/573: creat d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fb5 x:0 0 0 2024-02-10T00:00:29.680 INFO:tasks.workunit.client.0.smithi164.stdout:7/152: sync 2024-02-10T00:00:29.681 INFO:tasks.workunit.client.0.smithi164.stdout:8/107: truncate d2/f10 1345057 0 2024-02-10T00:00:29.681 INFO:tasks.workunit.client.0.smithi164.stdout:7/153: fdatasync d3/f9 0 2024-02-10T00:00:29.682 INFO:tasks.workunit.client.1.smithi183.stdout:1/449: truncate d0/d3/d7/d36/f47 1764791 0 2024-02-10T00:00:29.682 INFO:tasks.workunit.client.1.smithi183.stdout:8/560: write d0/d45/f49 [2438165,63859] 0 2024-02-10T00:00:29.682 INFO:tasks.workunit.client.1.smithi183.stdout:2/567: sync 2024-02-10T00:00:29.682 INFO:tasks.workunit.client.1.smithi183.stdout:4/492: sync 2024-02-10T00:00:29.683 INFO:tasks.workunit.client.0.smithi164.stdout:3/84: truncate d0/d1/d2/fe 4096873 0 2024-02-10T00:00:29.684 INFO:tasks.workunit.client.0.smithi164.stdout:4/119: write f1 [2895054,9372] 0 2024-02-10T00:00:29.684 INFO:tasks.workunit.client.1.smithi183.stdout:7/471: truncate d0/d2/d50/d5d/f55 2756407 0 2024-02-10T00:00:29.685 INFO:tasks.workunit.client.1.smithi183.stdout:7/472: stat d0/d2/l72 0 2024-02-10T00:00:29.685 INFO:tasks.workunit.client.0.smithi164.stdout:7/154: read d3/f13 [2080009,84298] 0 2024-02-10T00:00:29.686 INFO:tasks.workunit.client.0.smithi164.stdout:7/155: fsync d3/d11/f23 0 2024-02-10T00:00:29.687 INFO:tasks.workunit.client.1.smithi183.stdout:7/473: dread - d0/d11/d35/f61 zero size 2024-02-10T00:00:29.687 INFO:tasks.workunit.client.1.smithi183.stdout:3/423: mknod d7/db/d2a/d2d/c7f 0 2024-02-10T00:00:29.691 INFO:tasks.workunit.client.0.smithi164.stdout:6/207: truncate d0/d6/d12/f22 1476614 0 2024-02-10T00:00:29.692 INFO:tasks.workunit.client.0.smithi164.stdout:1/85: truncate d1/f9 4074767 0 2024-02-10T00:00:29.694 INFO:tasks.workunit.client.0.smithi164.stdout:0/108: mknod d6/d7/d14/c22 0 2024-02-10T00:00:29.695 INFO:tasks.workunit.client.0.smithi164.stdout:5/146: write d7/f19 [189207,70628] 0 2024-02-10T00:00:29.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/147: dread - d7/d17/f22 zero size 2024-02-10T00:00:29.698 INFO:tasks.workunit.client.0.smithi164.stdout:0/109: dwrite d6/d7/d14/f1b [4194304,4194304] 0 2024-02-10T00:00:29.709 INFO:tasks.workunit.client.0.smithi164.stdout:8/108: rename d2/ce to d2/c1b 0 2024-02-10T00:00:29.710 INFO:tasks.workunit.client.0.smithi164.stdout:8/109: fdatasync d2/f13 0 2024-02-10T00:00:29.714 INFO:tasks.workunit.client.0.smithi164.stdout:4/120: symlink d2/d19/d16/d1f/l2c 0 2024-02-10T00:00:29.715 INFO:tasks.workunit.client.1.smithi183.stdout:8/561: dwrite d0/d23/d2d/d24/f54 [0,4194304] 0 2024-02-10T00:00:29.716 INFO:tasks.workunit.client.1.smithi183.stdout:1/450: write d0/d3/d67/d7b/f98 [985133,101868] 0 2024-02-10T00:00:29.716 INFO:tasks.workunit.client.0.smithi164.stdout:7/156: rename d3/d11/c12 to d3/d26/c37 0 2024-02-10T00:00:29.718 INFO:tasks.workunit.client.1.smithi183.stdout:9/499: rename d0/d3/d14/d1c/d4b/d97/f9a to d0/d10/fa9 0 2024-02-10T00:00:29.719 INFO:tasks.workunit.client.1.smithi183.stdout:6/396: rename d2/d1a to d2/d1a/d25/d3c/d31/d38/d3f/d5e/d76 22 2024-02-10T00:00:29.719 INFO:tasks.workunit.client.1.smithi183.stdout:5/574: mknod d4/d23/d3e/d80/da1/d9e/d27/d38/cb6 0 2024-02-10T00:00:29.719 INFO:tasks.workunit.client.1.smithi183.stdout:9/500: chown d0/d10/f81 189949069 1 2024-02-10T00:00:29.721 INFO:tasks.workunit.client.1.smithi183.stdout:3/424: read d7/f30 [1563391,27471] 0 2024-02-10T00:00:29.722 INFO:tasks.workunit.client.1.smithi183.stdout:8/562: mkdir d0/d23/db1 0 2024-02-10T00:00:29.724 INFO:tasks.workunit.client.0.smithi164.stdout:5/148: readlink d7/l9 0 2024-02-10T00:00:29.724 INFO:tasks.workunit.client.0.smithi164.stdout:0/110: mknod d6/d7/d14/c23 0 2024-02-10T00:00:29.724 INFO:tasks.workunit.client.1.smithi183.stdout:5/575: unlink d4/d23/d3e/d80/da1/d9c/f7d 0 2024-02-10T00:00:29.725 INFO:tasks.workunit.client.1.smithi183.stdout:7/474: link d0/d2/d50/d5d/c77 d0/d2/d3/c83 0 2024-02-10T00:00:29.725 INFO:tasks.workunit.client.0.smithi164.stdout:5/149: fsync d7/d17/d21/d24/f28 0 2024-02-10T00:00:29.725 INFO:tasks.workunit.client.0.smithi164.stdout:0/111: stat d6/d10/d18/d1c/c1e 0 2024-02-10T00:00:29.725 INFO:tasks.workunit.client.0.smithi164.stdout:2/144: creat d3/d24/d25/d27/d2e/d36/f3b x:0 0 0 2024-02-10T00:00:29.726 INFO:tasks.workunit.client.1.smithi183.stdout:6/397: dwrite d2/d1a/d25/d3c/d31/d38/d6e/f2e [4194304,4194304] 0 2024-02-10T00:00:29.726 INFO:tasks.workunit.client.0.smithi164.stdout:2/145: dread - d3/d24/d25/d27/d2e/f3a zero size 2024-02-10T00:00:29.726 INFO:tasks.workunit.client.1.smithi183.stdout:9/501: mkdir d0/d3/d14/d1c/d4b/d97/daa 0 2024-02-10T00:00:29.728 INFO:tasks.workunit.client.0.smithi164.stdout:3/85: mkdir d0/d13 0 2024-02-10T00:00:29.728 INFO:tasks.workunit.client.0.smithi164.stdout:2/146: fsync d3/d24/d25/d27/f2c 0 2024-02-10T00:00:29.729 INFO:tasks.workunit.client.0.smithi164.stdout:8/110: mknod d2/c1c 0 2024-02-10T00:00:29.729 INFO:tasks.workunit.client.0.smithi164.stdout:3/86: read - d0/d1/d2/f12 zero size 2024-02-10T00:00:29.730 INFO:tasks.workunit.client.1.smithi183.stdout:7/475: write d0/f1 [4596611,21089] 0 2024-02-10T00:00:29.730 INFO:tasks.workunit.client.0.smithi164.stdout:5/150: dwrite d7/f1d [0,4194304] 0 2024-02-10T00:00:29.730 INFO:tasks.workunit.client.0.smithi164.stdout:4/121: creat d2/d19/f2d x:0 0 0 2024-02-10T00:00:29.731 INFO:tasks.workunit.client.0.smithi164.stdout:3/87: dread - d0/d1/d2/f12 zero size 2024-02-10T00:00:29.731 INFO:tasks.workunit.client.0.smithi164.stdout:8/111: dread d2/fa [0,4194304] 0 2024-02-10T00:00:29.732 INFO:tasks.workunit.client.1.smithi183.stdout:5/576: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/f7b [603320,66770] 0 2024-02-10T00:00:29.733 INFO:tasks.workunit.client.1.smithi183.stdout:3/425: dwrite d7/db/f41 [0,4194304] 0 2024-02-10T00:00:29.734 INFO:tasks.workunit.client.0.smithi164.stdout:0/112: rmdir d6 39 2024-02-10T00:00:29.734 INFO:tasks.workunit.client.1.smithi183.stdout:4/493: rename de/d14/d1d/d2f/f5c to de/d19/f95 0 2024-02-10T00:00:29.735 INFO:tasks.workunit.client.0.smithi164.stdout:5/151: dwrite d7/f1d [0,4194304] 0 2024-02-10T00:00:29.735 INFO:tasks.workunit.client.0.smithi164.stdout:9/149: link d6/de/c12 d6/d1c/d24/c2f 0 2024-02-10T00:00:29.736 INFO:tasks.workunit.client.0.smithi164.stdout:9/150: read - d6/d1c/f2e zero size 2024-02-10T00:00:29.736 INFO:tasks.workunit.client.1.smithi183.stdout:6/398: mknod d2/d1a/d3a/d45/c77 0 2024-02-10T00:00:29.737 INFO:tasks.workunit.client.1.smithi183.stdout:9/502: mknod d0/d3/d14/d1c/d2d/d4f/cab 0 2024-02-10T00:00:29.738 INFO:tasks.workunit.client.1.smithi183.stdout:9/503: readlink d0/d3/d14/d48/l6d 0 2024-02-10T00:00:29.739 INFO:tasks.workunit.client.0.smithi164.stdout:2/147: mknod d3/d32/c3c 0 2024-02-10T00:00:29.739 INFO:tasks.workunit.client.1.smithi183.stdout:5/577: creat d4/dd/d31/d73/fb7 x:0 0 0 2024-02-10T00:00:29.742 INFO:tasks.workunit.client.1.smithi183.stdout:6/399: dwrite d2/d1a/d25/d3c/d31/d38/d6e/f2e [0,4194304] 0 2024-02-10T00:00:29.743 INFO:tasks.workunit.client.0.smithi164.stdout:4/122: mknod d2/d19/d16/d1f/c2e 0 2024-02-10T00:00:29.743 INFO:tasks.workunit.client.1.smithi183.stdout:2/568: dread d2/da/d19/d31/d55/f5d [0,4194304] 0 2024-02-10T00:00:29.743 INFO:tasks.workunit.client.0.smithi164.stdout:8/112: symlink d2/d12/l1d 0 2024-02-10T00:00:29.744 INFO:tasks.workunit.client.1.smithi183.stdout:6/400: write d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 [148031,10171] 0 2024-02-10T00:00:29.746 INFO:tasks.workunit.client.0.smithi164.stdout:4/123: dwrite f1 [0,4194304] 0 2024-02-10T00:00:29.747 INFO:tasks.workunit.client.0.smithi164.stdout:4/124: chown d2/c4 114 1 2024-02-10T00:00:29.747 INFO:tasks.workunit.client.0.smithi164.stdout:5/152: rename f1 to d7/f32 0 2024-02-10T00:00:29.750 INFO:tasks.workunit.client.0.smithi164.stdout:9/151: stat d6/de/c16 0 2024-02-10T00:00:29.750 INFO:tasks.workunit.client.0.smithi164.stdout:2/148: creat d3/d24/d25/f3d x:0 0 0 2024-02-10T00:00:29.751 INFO:tasks.workunit.client.0.smithi164.stdout:9/152: readlink d6/l27 0 2024-02-10T00:00:29.752 INFO:tasks.workunit.client.0.smithi164.stdout:7/157: link d3/f9 d3/f38 0 2024-02-10T00:00:29.753 INFO:tasks.workunit.client.1.smithi183.stdout:1/451: rename d0/d3/l4 to d0/d3/d29/d1f/d86/la8 0 2024-02-10T00:00:29.753 INFO:tasks.workunit.client.1.smithi183.stdout:1/452: dread - d0/f4b zero size 2024-02-10T00:00:29.754 INFO:tasks.workunit.client.1.smithi183.stdout:1/453: write d0/d3/d67/d7b/f98 [871371,100946] 0 2024-02-10T00:00:29.755 INFO:tasks.workunit.client.1.smithi183.stdout:6/401: stat d2/f19 0 2024-02-10T00:00:29.755 INFO:tasks.workunit.client.1.smithi183.stdout:8/563: getdents d0/d10/d9e 0 2024-02-10T00:00:29.760 INFO:tasks.workunit.client.0.smithi164.stdout:9/153: creat d6/de/d22/f30 x:0 0 0 2024-02-10T00:00:29.761 INFO:tasks.workunit.client.0.smithi164.stdout:7/158: mkdir d3/d11/d39 0 2024-02-10T00:00:29.763 INFO:tasks.workunit.client.0.smithi164.stdout:3/88: rmdir d0/d13 0 2024-02-10T00:00:29.763 INFO:tasks.workunit.client.0.smithi164.stdout:3/89: fdatasync d0/f10 0 2024-02-10T00:00:29.764 INFO:tasks.workunit.client.0.smithi164.stdout:8/113: fsync d2/f7 0 2024-02-10T00:00:29.766 INFO:tasks.workunit.client.1.smithi183.stdout:3/426: unlink d7/db/d2a/l4c 0 2024-02-10T00:00:29.766 INFO:tasks.workunit.client.1.smithi183.stdout:7/476: truncate d0/d2/d4/f6e 345637 0 2024-02-10T00:00:29.767 INFO:tasks.workunit.client.1.smithi183.stdout:9/504: symlink d0/d3/d14/d1c/d2d/d4f/lac 0 2024-02-10T00:00:29.767 INFO:tasks.workunit.client.1.smithi183.stdout:5/578: link d4/d23/d3e/d80/da1/d9e/d89/f9b d4/d23/d4a/d36/fb8 0 2024-02-10T00:00:29.768 INFO:tasks.workunit.client.0.smithi164.stdout:0/113: creat d6/d7/f24 x:0 0 0 2024-02-10T00:00:29.768 INFO:tasks.workunit.client.1.smithi183.stdout:8/564: rmdir d0/d23/d2d/d24 39 2024-02-10T00:00:29.768 INFO:tasks.workunit.client.1.smithi183.stdout:3/427: stat d7/db/d2a/f65 0 2024-02-10T00:00:29.768 INFO:tasks.workunit.client.1.smithi183.stdout:4/494: creat de/d19/f96 x:0 0 0 2024-02-10T00:00:29.768 INFO:tasks.workunit.client.1.smithi183.stdout:1/454: mkdir d0/d3/da9 0 2024-02-10T00:00:29.769 INFO:tasks.workunit.client.1.smithi183.stdout:8/565: chown d0/f18 11193 1 2024-02-10T00:00:29.770 INFO:tasks.workunit.client.0.smithi164.stdout:3/90: mknod d0/c14 0 2024-02-10T00:00:29.770 INFO:tasks.workunit.client.0.smithi164.stdout:9/154: truncate d6/de/d22/f30 379498 0 2024-02-10T00:00:29.770 INFO:tasks.workunit.client.1.smithi183.stdout:7/477: mknod d0/d11/d2f/d64/c84 0 2024-02-10T00:00:29.770 INFO:tasks.workunit.client.1.smithi183.stdout:5/579: dread - d4/d23/d3e/d80/da1/d9e/d89/f92 zero size 2024-02-10T00:00:29.771 INFO:tasks.workunit.client.1.smithi183.stdout:1/455: mknod d0/d3/d7/d36/caa 0 2024-02-10T00:00:29.772 INFO:tasks.workunit.client.1.smithi183.stdout:1/456: chown d0/d3/fa4 105 1 2024-02-10T00:00:29.773 INFO:tasks.workunit.client.0.smithi164.stdout:3/91: symlink d0/d1/dd/l15 0 2024-02-10T00:00:29.774 INFO:tasks.workunit.client.1.smithi183.stdout:3/428: rename d7/db/d2a/d2d/c7f to d7/db/d2a/d33/d59/c80 0 2024-02-10T00:00:29.775 INFO:tasks.workunit.client.1.smithi183.stdout:5/580: dread - d4/d23/f3b zero size 2024-02-10T00:00:29.776 INFO:tasks.workunit.client.1.smithi183.stdout:9/505: mknod d0/d3/d14/d1c/d2d/d4f/d89/cad 0 2024-02-10T00:00:29.776 INFO:tasks.workunit.client.0.smithi164.stdout:9/155: truncate d6/f1e 958342 0 2024-02-10T00:00:29.777 INFO:tasks.workunit.client.1.smithi183.stdout:3/429: fdatasync d7/db/d2a/d1c/f27 0 2024-02-10T00:00:29.778 INFO:tasks.workunit.client.0.smithi164.stdout:9/156: fdatasync d6/ff 0 2024-02-10T00:00:29.779 INFO:tasks.workunit.client.0.smithi164.stdout:3/92: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:29.779 INFO:tasks.workunit.client.1.smithi183.stdout:3/430: dread d7/f12 [0,4194304] 0 2024-02-10T00:00:29.780 INFO:tasks.workunit.client.1.smithi183.stdout:3/431: write d7/db/d2a/f2c [3040132,125607] 0 2024-02-10T00:00:29.782 INFO:tasks.workunit.client.0.smithi164.stdout:3/93: mknod d0/d1/d2/c16 0 2024-02-10T00:00:29.782 INFO:tasks.workunit.client.1.smithi183.stdout:7/478: rename d0/d2/d50/c6c to d0/c85 0 2024-02-10T00:00:29.783 INFO:tasks.workunit.client.0.smithi164.stdout:9/157: dread d6/f7 [0,4194304] 0 2024-02-10T00:00:29.783 INFO:tasks.workunit.client.1.smithi183.stdout:3/432: readlink d7/db/d2a/l3b 0 2024-02-10T00:00:29.784 INFO:tasks.workunit.client.0.smithi164.stdout:9/158: read - d6/de/f21 zero size 2024-02-10T00:00:29.785 INFO:tasks.workunit.client.1.smithi183.stdout:0/455: sync 2024-02-10T00:00:29.787 INFO:tasks.workunit.client.0.smithi164.stdout:3/94: dwrite d0/d1/ff [0,4194304] 0 2024-02-10T00:00:29.788 INFO:tasks.workunit.client.1.smithi183.stdout:9/506: rmdir d0/d30/d94 0 2024-02-10T00:00:29.788 INFO:tasks.workunit.client.1.smithi183.stdout:9/507: dread - d0/d10/f53 zero size 2024-02-10T00:00:29.789 INFO:tasks.workunit.client.1.smithi183.stdout:3/433: creat d7/db/d2a/d4d/d63/f81 x:0 0 0 2024-02-10T00:00:29.790 INFO:tasks.workunit.client.1.smithi183.stdout:0/456: chown d14/d7a/d63 29081455 1 2024-02-10T00:00:29.792 INFO:tasks.workunit.client.1.smithi183.stdout:5/581: rename d4/d23/d3e/d80/da1/d9c/d72/l8b to d4/d23/d4a/d36/lb9 0 2024-02-10T00:00:29.793 INFO:tasks.workunit.client.0.smithi164.stdout:3/95: dwrite d0/d1/d2/fe [0,4194304] 0 2024-02-10T00:00:29.793 INFO:tasks.workunit.client.0.smithi164.stdout:6/208: write d0/d6/d12/d14/f24 [91727,42639] 0 2024-02-10T00:00:29.795 INFO:tasks.workunit.client.0.smithi164.stdout:3/96: write d0/d1/ff [2280184,37757] 0 2024-02-10T00:00:29.795 INFO:tasks.workunit.client.1.smithi183.stdout:7/479: creat d0/d11/d2f/d64/d6b/f86 x:0 0 0 2024-02-10T00:00:29.798 INFO:tasks.workunit.client.0.smithi164.stdout:8/114: dread d2/f10 [0,4194304] 0 2024-02-10T00:00:29.799 INFO:tasks.workunit.client.0.smithi164.stdout:6/209: dread d0/d6/d12/f41 [0,4194304] 0 2024-02-10T00:00:29.799 INFO:tasks.workunit.client.0.smithi164.stdout:4/125: rename d2/d19/d16/d1f to d2/d2f 0 2024-02-10T00:00:29.802 INFO:tasks.workunit.client.0.smithi164.stdout:8/115: dwrite d2/f4 [4194304,4194304] 0 2024-02-10T00:00:29.803 INFO:tasks.workunit.client.0.smithi164.stdout:8/116: readlink d2/d12/l1d 0 2024-02-10T00:00:29.805 INFO:tasks.workunit.client.0.smithi164.stdout:7/159: getdents d3/d11 0 2024-02-10T00:00:29.806 INFO:tasks.workunit.client.0.smithi164.stdout:3/97: mkdir d0/d1/d2/d17 0 2024-02-10T00:00:29.809 INFO:tasks.workunit.client.0.smithi164.stdout:5/153: truncate d7/f19 1384958 0 2024-02-10T00:00:29.809 INFO:tasks.workunit.client.0.smithi164.stdout:5/154: dread - d7/d17/f22 zero size 2024-02-10T00:00:29.810 INFO:tasks.workunit.client.0.smithi164.stdout:5/155: dread - d7/d17/f22 zero size 2024-02-10T00:00:29.810 INFO:tasks.workunit.client.0.smithi164.stdout:5/156: chown d7/d17/d21 110 1 2024-02-10T00:00:29.811 INFO:tasks.workunit.client.0.smithi164.stdout:2/149: truncate d3/f16 571157 0 2024-02-10T00:00:29.812 INFO:tasks.workunit.client.0.smithi164.stdout:2/150: write f2 [2572259,96370] 0 2024-02-10T00:00:29.813 INFO:tasks.workunit.client.1.smithi183.stdout:3/434: symlink d7/db/d2a/d33/l82 0 2024-02-10T00:00:29.813 INFO:tasks.workunit.client.1.smithi183.stdout:0/457: mkdir d14/d1d/d59/da7 0 2024-02-10T00:00:29.813 INFO:tasks.workunit.client.1.smithi183.stdout:5/582: creat d4/d74/fba x:0 0 0 2024-02-10T00:00:29.815 INFO:tasks.workunit.client.1.smithi183.stdout:7/480: write d0/d11/d35/f61 [344063,73825] 0 2024-02-10T00:00:29.815 INFO:tasks.workunit.client.1.smithi183.stdout:4/495: truncate de/d14/d27/d2e/f90 1739295 0 2024-02-10T00:00:29.816 INFO:tasks.workunit.client.1.smithi183.stdout:4/496: dread - de/d14/d27/f55 zero size 2024-02-10T00:00:29.817 INFO:tasks.workunit.client.0.smithi164.stdout:2/151: dwrite d3/d24/d25/d27/d2e/d36/f3b [0,4194304] 0 2024-02-10T00:00:29.818 INFO:tasks.workunit.client.0.smithi164.stdout:2/152: stat d3/l5 0 2024-02-10T00:00:29.818 INFO:tasks.workunit.client.0.smithi164.stdout:5/157: creat d7/d17/f33 x:0 0 0 2024-02-10T00:00:29.819 INFO:tasks.workunit.client.1.smithi183.stdout:0/458: mknod d14/d1d/d59/ca8 0 2024-02-10T00:00:29.820 INFO:tasks.workunit.client.0.smithi164.stdout:2/153: fdatasync d3/d24/d25/d27/f28 0 2024-02-10T00:00:29.821 INFO:tasks.workunit.client.0.smithi164.stdout:0/114: rename d6/cb to d6/d7/d14/c25 0 2024-02-10T00:00:29.822 INFO:tasks.workunit.client.1.smithi183.stdout:5/583: readlink d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/l63 0 2024-02-10T00:00:29.823 INFO:tasks.workunit.client.0.smithi164.stdout:6/210: mkdir d0/d2b/d3a/d3d/d42 0 2024-02-10T00:00:29.823 INFO:tasks.workunit.client.0.smithi164.stdout:2/154: chown d3/l14 438882688 1 2024-02-10T00:00:29.823 INFO:tasks.workunit.client.0.smithi164.stdout:9/159: dwrite d6/f18 [0,4194304] 0 2024-02-10T00:00:29.824 INFO:tasks.workunit.client.1.smithi183.stdout:4/497: unlink de/d19/d20/c84 0 2024-02-10T00:00:29.825 INFO:tasks.workunit.client.0.smithi164.stdout:9/160: dread - d6/de/f14 zero size 2024-02-10T00:00:29.825 INFO:tasks.workunit.client.1.smithi183.stdout:0/459: mknod d14/d1d/d55/d6e/ca9 0 2024-02-10T00:00:29.826 INFO:tasks.workunit.client.0.smithi164.stdout:3/98: mknod d0/c18 0 2024-02-10T00:00:29.826 INFO:tasks.workunit.client.1.smithi183.stdout:2/569: sync 2024-02-10T00:00:29.826 INFO:tasks.workunit.client.1.smithi183.stdout:3/435: symlink d7/db/d2a/d2d/d51/d78/l83 0 2024-02-10T00:00:29.828 INFO:tasks.workunit.client.0.smithi164.stdout:5/158: dwrite d7/d15/d1f/f25 [0,4194304] 0 2024-02-10T00:00:29.828 INFO:tasks.workunit.client.1.smithi183.stdout:7/481: rename d0/d2/d3/f20 to d0/d11/d35/f87 0 2024-02-10T00:00:29.829 INFO:tasks.workunit.client.1.smithi183.stdout:7/482: fdatasync d0/d11/d3e/f70 0 2024-02-10T00:00:29.831 INFO:tasks.workunit.client.1.smithi183.stdout:5/584: creat d4/d23/d4a/fbb x:0 0 0 2024-02-10T00:00:29.831 INFO:tasks.workunit.client.0.smithi164.stdout:1/86: dwrite d1/f11 [0,4194304] 0 2024-02-10T00:00:29.831 INFO:tasks.workunit.client.0.smithi164.stdout:4/126: creat d2/d19/d16/f30 x:0 0 0 2024-02-10T00:00:29.833 INFO:tasks.workunit.client.1.smithi183.stdout:9/508: dwrite d0/d3/d14/f20 [0,4194304] 0 2024-02-10T00:00:29.833 INFO:tasks.workunit.client.0.smithi164.stdout:1/87: dread - d1/d13/f14 zero size 2024-02-10T00:00:29.833 INFO:tasks.workunit.client.0.smithi164.stdout:7/160: rename d3/d34 to d3/d11/d39/d3a 0 2024-02-10T00:00:29.834 INFO:tasks.workunit.client.0.smithi164.stdout:9/161: dwrite d6/de/d22/f26 [0,4194304] 0 2024-02-10T00:00:29.834 INFO:tasks.workunit.client.0.smithi164.stdout:1/88: chown d1 0 1 2024-02-10T00:00:29.834 INFO:tasks.workunit.client.1.smithi183.stdout:5/585: write d4/d23/d3e/d80/da1/d9e/d27/d38/f48 [3300010,122058] 0 2024-02-10T00:00:29.834 INFO:tasks.workunit.client.0.smithi164.stdout:2/155: creat d3/f3e x:0 0 0 2024-02-10T00:00:29.836 INFO:tasks.workunit.client.0.smithi164.stdout:6/211: mkdir d0/d6/d12/d43 0 2024-02-10T00:00:29.838 INFO:tasks.workunit.client.1.smithi183.stdout:0/460: rename d14/d1d/d2d/d31/d6c/d70/d99 to d14/d3e/d5f/daa 0 2024-02-10T00:00:29.839 INFO:tasks.workunit.client.0.smithi164.stdout:1/89: dwrite d1/f7 [0,4194304] 0 2024-02-10T00:00:29.839 INFO:tasks.workunit.client.1.smithi183.stdout:4/498: link de/d14/d27/d2e/f88 de/d14/d1d/f97 0 2024-02-10T00:00:29.840 INFO:tasks.workunit.client.0.smithi164.stdout:5/159: rmdir d7/d17/d21/d23 39 2024-02-10T00:00:29.841 INFO:tasks.workunit.client.1.smithi183.stdout:3/436: fsync d7/f9 0 2024-02-10T00:00:29.842 INFO:tasks.workunit.client.1.smithi183.stdout:3/437: chown d7/db/d2a/d33/l77 2 1 2024-02-10T00:00:29.843 INFO:tasks.workunit.client.1.smithi183.stdout:6/402: sync 2024-02-10T00:00:29.844 INFO:tasks.workunit.client.0.smithi164.stdout:7/161: creat d3/d28/f3b x:0 0 0 2024-02-10T00:00:29.844 INFO:tasks.workunit.client.1.smithi183.stdout:7/483: mkdir d0/d11/d88 0 2024-02-10T00:00:29.844 INFO:tasks.workunit.client.0.smithi164.stdout:7/162: dread - d3/d26/f2e zero size 2024-02-10T00:00:29.845 INFO:tasks.workunit.client.1.smithi183.stdout:4/499: symlink de/d14/d4e/l98 0 2024-02-10T00:00:29.845 INFO:tasks.workunit.client.0.smithi164.stdout:9/162: symlink d6/d1c/d24/l31 0 2024-02-10T00:00:29.845 INFO:tasks.workunit.client.0.smithi164.stdout:2/156: creat d3/d24/d25/f3f x:0 0 0 2024-02-10T00:00:29.846 INFO:tasks.workunit.client.1.smithi183.stdout:9/509: truncate d0/f5b 1634541 0 2024-02-10T00:00:29.847 INFO:tasks.workunit.client.1.smithi183.stdout:9/510: dread - d0/d3/d14/d1c/d4b/d51/fa5 zero size 2024-02-10T00:00:29.848 INFO:tasks.workunit.client.0.smithi164.stdout:8/117: getdents d2 0 2024-02-10T00:00:29.849 INFO:tasks.workunit.client.0.smithi164.stdout:9/163: dwrite d6/d1c/f29 [0,4194304] 0 2024-02-10T00:00:29.853 INFO:tasks.workunit.client.0.smithi164.stdout:8/118: dwrite d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:29.854 INFO:tasks.workunit.client.1.smithi183.stdout:9/511: creat d0/d3/d14/d3c/fae x:0 0 0 2024-02-10T00:00:29.854 INFO:tasks.workunit.client.1.smithi183.stdout:3/438: link d7/db/d2a/d33/f37 d7/db/d2a/d2d/f84 0 2024-02-10T00:00:29.854 INFO:tasks.workunit.client.1.smithi183.stdout:4/500: chown de/d14/d27/d40/l48 2280847 1 2024-02-10T00:00:29.855 INFO:tasks.workunit.client.1.smithi183.stdout:9/512: write d0/d3/d14/d1c/d4b/d51/fa5 [336574,80826] 0 2024-02-10T00:00:29.856 INFO:tasks.workunit.client.1.smithi183.stdout:9/513: write d0/d3/d14/d3c/fae [429865,24993] 0 2024-02-10T00:00:29.857 INFO:tasks.workunit.client.1.smithi183.stdout:9/514: write d0/d10/f5f [339354,103030] 0 2024-02-10T00:00:29.857 INFO:tasks.workunit.client.0.smithi164.stdout:1/90: symlink d1/da/d18/l1e 0 2024-02-10T00:00:29.858 INFO:tasks.workunit.client.0.smithi164.stdout:1/91: write d1/d13/f14 [325,55528] 0 2024-02-10T00:00:29.861 INFO:tasks.workunit.client.1.smithi183.stdout:1/457: sync 2024-02-10T00:00:29.861 INFO:tasks.workunit.client.1.smithi183.stdout:8/566: sync 2024-02-10T00:00:29.862 INFO:tasks.workunit.client.1.smithi183.stdout:8/567: stat d0/d4e 0 2024-02-10T00:00:29.863 INFO:tasks.workunit.client.0.smithi164.stdout:4/127: mkdir d2/d19/d16/d31 0 2024-02-10T00:00:29.864 INFO:tasks.workunit.client.0.smithi164.stdout:7/163: unlink d3/d26/f2e 0 2024-02-10T00:00:29.866 INFO:tasks.workunit.client.1.smithi183.stdout:3/439: unlink d7/db/d2a/d1c/c35 0 2024-02-10T00:00:29.868 INFO:tasks.workunit.client.0.smithi164.stdout:2/157: dwrite d3/f6 [0,4194304] 0 2024-02-10T00:00:29.869 INFO:tasks.workunit.client.1.smithi183.stdout:8/568: rename d0/d23/d2d to d0/d3f/db2 0 2024-02-10T00:00:29.870 INFO:tasks.workunit.client.0.smithi164.stdout:6/212: creat d0/d6/d12/d43/f44 x:0 0 0 2024-02-10T00:00:29.872 INFO:tasks.workunit.client.1.smithi183.stdout:9/515: dread d0/d3/d14/f38 [0,4194304] 0 2024-02-10T00:00:29.872 INFO:tasks.workunit.client.0.smithi164.stdout:0/115: rename d6/d10/d18/d1c/f1f to d6/d7/f26 0 2024-02-10T00:00:29.873 INFO:tasks.workunit.client.1.smithi183.stdout:1/458: truncate d0/f4b 554700 0 2024-02-10T00:00:29.874 INFO:tasks.workunit.client.0.smithi164.stdout:6/213: dread d0/d6/d12/d14/f1e [0,4194304] 0 2024-02-10T00:00:29.874 INFO:tasks.workunit.client.0.smithi164.stdout:4/128: symlink d2/d19/l32 0 2024-02-10T00:00:29.875 INFO:tasks.workunit.client.0.smithi164.stdout:6/214: fdatasync d0/d6/d12/d14/f24 0 2024-02-10T00:00:29.875 INFO:tasks.workunit.client.0.smithi164.stdout:4/129: fdatasync d2/fb 0 2024-02-10T00:00:29.876 INFO:tasks.workunit.client.0.smithi164.stdout:6/215: write d0/d2b/f39 [682337,123494] 0 2024-02-10T00:00:29.876 INFO:tasks.workunit.client.1.smithi183.stdout:9/516: dwrite d0/d3/d14/f69 [0,4194304] 0 2024-02-10T00:00:29.877 INFO:tasks.workunit.client.0.smithi164.stdout:6/216: stat d0/d6/d12/d14/l1d 0 2024-02-10T00:00:29.877 INFO:tasks.workunit.client.1.smithi183.stdout:8/569: read d0/d3f/db2/d24/f28 [387488,68858] 0 2024-02-10T00:00:29.878 INFO:tasks.workunit.client.0.smithi164.stdout:3/99: getdents d0/d1/dd 0 2024-02-10T00:00:29.880 INFO:tasks.workunit.client.1.smithi183.stdout:1/459: dwrite d0/d3a/f80 [0,4194304] 0 2024-02-10T00:00:29.881 INFO:tasks.workunit.client.1.smithi183.stdout:8/570: symlink d0/d10/lb3 0 2024-02-10T00:00:29.881 INFO:tasks.workunit.client.1.smithi183.stdout:1/460: stat d0/d3c/c8b 0 2024-02-10T00:00:29.881 INFO:tasks.workunit.client.0.smithi164.stdout:0/116: creat d6/d7/d14/f27 x:0 0 0 2024-02-10T00:00:29.882 INFO:tasks.workunit.client.1.smithi183.stdout:1/461: dread - d0/d3a/f83 zero size 2024-02-10T00:00:29.882 INFO:tasks.workunit.client.1.smithi183.stdout:1/462: chown d0/c6b 35847 1 2024-02-10T00:00:29.882 INFO:tasks.workunit.client.1.smithi183.stdout:9/517: creat d0/d3/d14/d74/da8/faf x:0 0 0 2024-02-10T00:00:29.884 INFO:tasks.workunit.client.0.smithi164.stdout:0/117: dread f3 [0,4194304] 0 2024-02-10T00:00:29.884 INFO:tasks.workunit.client.1.smithi183.stdout:9/518: readlink d0/d3/d14/d3c/l64 0 2024-02-10T00:00:29.884 INFO:tasks.workunit.client.0.smithi164.stdout:9/164: creat d6/d1c/f32 x:0 0 0 2024-02-10T00:00:29.886 INFO:tasks.workunit.client.0.smithi164.stdout:9/165: write d6/de/f11 [301865,94752] 0 2024-02-10T00:00:29.886 INFO:tasks.workunit.client.0.smithi164.stdout:4/130: rename d2/d2f/c2e to d2/d19/c33 0 2024-02-10T00:00:29.886 INFO:tasks.workunit.client.1.smithi183.stdout:9/519: symlink d0/d30/d52/lb0 0 2024-02-10T00:00:29.886 INFO:tasks.workunit.client.0.smithi164.stdout:4/131: fdatasync d2/fb 0 2024-02-10T00:00:29.887 INFO:tasks.workunit.client.0.smithi164.stdout:4/132: write d2/d19/d16/f30 [582034,111798] 0 2024-02-10T00:00:29.888 INFO:tasks.workunit.client.1.smithi183.stdout:1/463: dwrite d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:29.888 INFO:tasks.workunit.client.1.smithi183.stdout:1/464: write d0/d3/d67/f94 [116685,56550] 0 2024-02-10T00:00:29.890 INFO:tasks.workunit.client.0.smithi164.stdout:3/100: mkdir d0/d1/d2/d19 0 2024-02-10T00:00:29.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/133: dread d2/fb [0,4194304] 0 2024-02-10T00:00:29.890 INFO:tasks.workunit.client.0.smithi164.stdout:7/164: truncate d3/d26/f31 549886 0 2024-02-10T00:00:29.891 INFO:tasks.workunit.client.0.smithi164.stdout:4/134: chown d2/d19/d16/f27 123964246 1 2024-02-10T00:00:29.892 INFO:tasks.workunit.client.1.smithi183.stdout:1/465: dwrite d0/d3/d67/f94 [0,4194304] 0 2024-02-10T00:00:29.893 INFO:tasks.workunit.client.1.smithi183.stdout:1/466: write d0/d3a/fa7 [121646,76669] 0 2024-02-10T00:00:29.894 INFO:tasks.workunit.client.0.smithi164.stdout:2/158: link d3/l21 d3/d32/l40 0 2024-02-10T00:00:29.894 INFO:tasks.workunit.client.0.smithi164.stdout:3/101: dwrite d0/f10 [4194304,4194304] 0 2024-02-10T00:00:29.895 INFO:tasks.workunit.client.0.smithi164.stdout:6/217: truncate d0/d6/f7 1965588 0 2024-02-10T00:00:29.895 INFO:tasks.workunit.client.0.smithi164.stdout:9/166: dread d6/fc [0,4194304] 0 2024-02-10T00:00:29.895 INFO:tasks.workunit.client.0.smithi164.stdout:7/165: mknod d3/d28/c3c 0 2024-02-10T00:00:29.896 INFO:tasks.workunit.client.0.smithi164.stdout:3/102: write d0/d1/ff [2680396,23057] 0 2024-02-10T00:00:29.896 INFO:tasks.workunit.client.0.smithi164.stdout:2/159: write d3/d24/d25/f3d [760249,8612] 0 2024-02-10T00:00:29.896 INFO:tasks.workunit.client.0.smithi164.stdout:6/218: fsync d0/d2b/d3a/f3e 0 2024-02-10T00:00:29.897 INFO:tasks.workunit.client.1.smithi183.stdout:1/467: unlink d0/d3/d7/d36/f50 0 2024-02-10T00:00:29.899 INFO:tasks.workunit.client.0.smithi164.stdout:4/135: creat d2/d2f/d28/f34 x:0 0 0 2024-02-10T00:00:29.900 INFO:tasks.workunit.client.0.smithi164.stdout:2/160: dread f0 [0,4194304] 0 2024-02-10T00:00:29.902 INFO:tasks.workunit.client.1.smithi183.stdout:7/484: dread d0/f21 [0,4194304] 0 2024-02-10T00:00:29.904 INFO:tasks.workunit.client.0.smithi164.stdout:2/161: dwrite d3/d24/d25/f3d [0,4194304] 0 2024-02-10T00:00:29.904 INFO:tasks.workunit.client.1.smithi183.stdout:1/468: getdents d0/d3/d67 0 2024-02-10T00:00:29.904 INFO:tasks.workunit.client.1.smithi183.stdout:1/469: dread - d0/d3a/fa5 zero size 2024-02-10T00:00:29.905 INFO:tasks.workunit.client.0.smithi164.stdout:7/166: symlink d3/d26/l3d 0 2024-02-10T00:00:29.908 INFO:tasks.workunit.client.0.smithi164.stdout:7/167: dread d3/f2d [0,4194304] 0 2024-02-10T00:00:29.908 INFO:tasks.workunit.client.0.smithi164.stdout:7/168: dread - d3/d28/f3b zero size 2024-02-10T00:00:29.910 INFO:tasks.workunit.client.1.smithi183.stdout:7/485: rename d0/d2/d50/f71 to d0/d11/d3e/f89 0 2024-02-10T00:00:29.910 INFO:tasks.workunit.client.0.smithi164.stdout:9/167: rename d6/ff to d6/d1c/d24/f33 0 2024-02-10T00:00:29.910 INFO:tasks.workunit.client.0.smithi164.stdout:0/118: link d6/d10/d18/d1c/c1e d6/d7/d14/c28 0 2024-02-10T00:00:29.910 INFO:tasks.workunit.client.0.smithi164.stdout:4/136: readlink d2/l3 0 2024-02-10T00:00:29.910 INFO:tasks.workunit.client.1.smithi183.stdout:2/570: dread d2/da/f17 [0,4194304] 0 2024-02-10T00:00:29.912 INFO:tasks.workunit.client.1.smithi183.stdout:7/486: mkdir d0/d2/d4/d8/d59/d8a 0 2024-02-10T00:00:29.913 INFO:tasks.workunit.client.1.smithi183.stdout:1/470: truncate d0/d3/d67/d70/fa1 896988 0 2024-02-10T00:00:29.914 INFO:tasks.workunit.client.1.smithi183.stdout:2/571: dread d2/da/f17 [0,4194304] 0 2024-02-10T00:00:29.915 INFO:tasks.workunit.client.0.smithi164.stdout:7/169: mknod d3/d26/c3e 0 2024-02-10T00:00:29.915 INFO:tasks.workunit.client.0.smithi164.stdout:4/137: fdatasync d2/f8 0 2024-02-10T00:00:29.916 INFO:tasks.workunit.client.0.smithi164.stdout:4/138: read - d2/f1a zero size 2024-02-10T00:00:29.916 INFO:tasks.workunit.client.0.smithi164.stdout:0/119: symlink d6/d10/d18/d1c/l29 0 2024-02-10T00:00:29.917 INFO:tasks.workunit.client.1.smithi183.stdout:8/571: dread d0/d10/f1a [0,4194304] 0 2024-02-10T00:00:29.920 INFO:tasks.workunit.client.1.smithi183.stdout:1/471: rename d0/d3/d7/d3d/d60/f64 to d0/d3/da9/fab 0 2024-02-10T00:00:29.920 INFO:tasks.workunit.client.0.smithi164.stdout:0/120: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:29.921 INFO:tasks.workunit.client.0.smithi164.stdout:2/162: link d3/d24/f39 d3/d24/d25/d27/d2e/f41 0 2024-02-10T00:00:29.921 INFO:tasks.workunit.client.0.smithi164.stdout:3/103: link d0/c18 d0/d1/d2/c1a 0 2024-02-10T00:00:29.922 INFO:tasks.workunit.client.0.smithi164.stdout:4/139: creat d2/d2f/d28/f35 x:0 0 0 2024-02-10T00:00:29.922 INFO:tasks.workunit.client.0.smithi164.stdout:4/140: dread - d2/d2f/d28/f35 zero size 2024-02-10T00:00:29.923 INFO:tasks.workunit.client.0.smithi164.stdout:0/121: creat d6/f2a x:0 0 0 2024-02-10T00:00:29.924 INFO:tasks.workunit.client.1.smithi183.stdout:8/572: mknod d0/d3f/db2/cb4 0 2024-02-10T00:00:29.924 INFO:tasks.workunit.client.0.smithi164.stdout:0/122: fsync d6/d7/d14/f1b 0 2024-02-10T00:00:29.925 INFO:tasks.workunit.client.0.smithi164.stdout:7/170: truncate d3/f2d 1940236 0 2024-02-10T00:00:29.926 INFO:tasks.workunit.client.1.smithi183.stdout:2/572: getdents d2/d2c/d2f/d60 0 2024-02-10T00:00:29.927 INFO:tasks.workunit.client.0.smithi164.stdout:4/141: dread d2/d19/d16/f27 [0,4194304] 0 2024-02-10T00:00:29.928 INFO:tasks.workunit.client.0.smithi164.stdout:4/142: read - d2/d2f/d28/f35 zero size 2024-02-10T00:00:29.928 INFO:tasks.workunit.client.1.smithi183.stdout:8/573: symlink d0/d27/d75/lb5 0 2024-02-10T00:00:29.929 INFO:tasks.workunit.client.0.smithi164.stdout:4/143: write d2/d19/f15 [298582,111600] 0 2024-02-10T00:00:29.929 INFO:tasks.workunit.client.0.smithi164.stdout:7/171: dread d3/d11/f14 [0,4194304] 0 2024-02-10T00:00:29.929 INFO:tasks.workunit.client.1.smithi183.stdout:2/573: unlink d2/da/d5b/lb7 0 2024-02-10T00:00:29.930 INFO:tasks.workunit.client.0.smithi164.stdout:7/172: stat c0 0 2024-02-10T00:00:29.931 INFO:tasks.workunit.client.1.smithi183.stdout:1/472: rename d0/d3a/f8f to d0/d3/d7/d3d/fac 0 2024-02-10T00:00:29.932 INFO:tasks.workunit.client.0.smithi164.stdout:4/144: dread f1 [0,4194304] 0 2024-02-10T00:00:29.933 INFO:tasks.workunit.client.1.smithi183.stdout:2/574: mkdir d2/da/d20/d6d/dbe 0 2024-02-10T00:00:29.934 INFO:tasks.workunit.client.0.smithi164.stdout:3/104: link d0/d1/d2/lb d0/d1/d2/d19/l1b 0 2024-02-10T00:00:29.935 INFO:tasks.workunit.client.0.smithi164.stdout:7/173: creat d3/d28/f3f x:0 0 0 2024-02-10T00:00:29.936 INFO:tasks.workunit.client.0.smithi164.stdout:4/145: write d2/d19/d16/f27 [4670967,70334] 0 2024-02-10T00:00:29.936 INFO:tasks.workunit.client.1.smithi183.stdout:1/473: rename d0/d3/d29/d1f/f5c to d0/d3/d29/fad 0 2024-02-10T00:00:29.937 INFO:tasks.workunit.client.1.smithi183.stdout:8/574: getdents d0/d10/d9e 0 2024-02-10T00:00:29.938 INFO:tasks.workunit.client.0.smithi164.stdout:7/174: symlink d3/d26/l40 0 2024-02-10T00:00:29.939 INFO:tasks.workunit.client.0.smithi164.stdout:3/105: creat d0/d1/d2/d19/f1c x:0 0 0 2024-02-10T00:00:29.941 INFO:tasks.workunit.client.1.smithi183.stdout:1/474: dwrite d0/d3/d7/f58 [4194304,4194304] 0 2024-02-10T00:00:29.941 INFO:tasks.workunit.client.0.smithi164.stdout:4/146: creat d2/d19/d16/d31/f36 x:0 0 0 2024-02-10T00:00:29.942 INFO:tasks.workunit.client.1.smithi183.stdout:8/575: creat d0/d27/d75/d5b/d85/fb6 x:0 0 0 2024-02-10T00:00:29.942 INFO:tasks.workunit.client.0.smithi164.stdout:3/106: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:29.943 INFO:tasks.workunit.client.0.smithi164.stdout:7/175: symlink d3/l41 0 2024-02-10T00:00:29.943 INFO:tasks.workunit.client.0.smithi164.stdout:7/176: dread - d3/d5/f30 zero size 2024-02-10T00:00:29.944 INFO:tasks.workunit.client.0.smithi164.stdout:7/177: fsync d3/f1d 0 2024-02-10T00:00:29.945 INFO:tasks.workunit.client.0.smithi164.stdout:3/107: symlink d0/d1/dd/l1d 0 2024-02-10T00:00:29.945 INFO:tasks.workunit.client.1.smithi183.stdout:1/475: rmdir d0/d3c 39 2024-02-10T00:00:29.945 INFO:tasks.workunit.client.1.smithi183.stdout:2/575: link d2/da/d19/d31/c4d d2/da/d19/d31/cbf 0 2024-02-10T00:00:29.946 INFO:tasks.workunit.client.1.smithi183.stdout:2/576: chown d2/d2c/d2f/d72/f92 66276104 1 2024-02-10T00:00:29.946 INFO:tasks.workunit.client.1.smithi183.stdout:8/576: fsync d0/d3f/db2/d24/f59 0 2024-02-10T00:00:29.947 INFO:tasks.workunit.client.0.smithi164.stdout:3/108: mkdir d0/d1/dd/d1e 0 2024-02-10T00:00:29.948 INFO:tasks.workunit.client.1.smithi183.stdout:8/577: chown d0/d3f/db2/d24/f59 23718 1 2024-02-10T00:00:29.948 INFO:tasks.workunit.client.1.smithi183.stdout:1/476: chown d0/d3/d7/f23 3 1 2024-02-10T00:00:29.948 INFO:tasks.workunit.client.0.smithi164.stdout:7/178: truncate d3/f38 4879416 0 2024-02-10T00:00:29.949 INFO:tasks.workunit.client.1.smithi183.stdout:8/578: dread - d0/d4e/d53/fa3 zero size 2024-02-10T00:00:29.949 INFO:tasks.workunit.client.0.smithi164.stdout:3/109: creat d0/d1/dd/f1f x:0 0 0 2024-02-10T00:00:29.950 INFO:tasks.workunit.client.0.smithi164.stdout:3/110: read d0/d1/f11 [289018,68053] 0 2024-02-10T00:00:29.950 INFO:tasks.workunit.client.0.smithi164.stdout:5/160: fdatasync d7/d15/d1f/f25 0 2024-02-10T00:00:29.951 INFO:tasks.workunit.client.1.smithi183.stdout:1/477: mkdir d0/d3/d67/d70/dae 0 2024-02-10T00:00:29.952 INFO:tasks.workunit.client.1.smithi183.stdout:3/440: rmdir d7/db/d2a/d2d/d51 39 2024-02-10T00:00:29.953 INFO:tasks.workunit.client.0.smithi164.stdout:5/161: dread d7/f1d [0,4194304] 0 2024-02-10T00:00:29.957 INFO:tasks.workunit.client.0.smithi164.stdout:9/168: dread d6/f9 [0,4194304] 0 2024-02-10T00:00:29.957 INFO:tasks.workunit.client.1.smithi183.stdout:1/478: creat d0/d3/d67/d7b/faf x:0 0 0 2024-02-10T00:00:29.957 INFO:tasks.workunit.client.0.smithi164.stdout:5/162: mknod d7/d15/d1f/c34 0 2024-02-10T00:00:29.959 INFO:tasks.workunit.client.1.smithi183.stdout:1/479: dread d0/d3/d67/f96 [0,4194304] 0 2024-02-10T00:00:29.960 INFO:tasks.workunit.client.0.smithi164.stdout:3/111: rename d0/c14 to d0/c20 0 2024-02-10T00:00:29.961 INFO:tasks.workunit.client.1.smithi183.stdout:2/577: link d2/da/d20/d21/d36/c87 d2/d2c/d2f/d60/d8d/d9c/da7/cc0 0 2024-02-10T00:00:29.961 INFO:tasks.workunit.client.0.smithi164.stdout:3/112: chown d0/d1/d2/la 778545 1 2024-02-10T00:00:29.961 INFO:tasks.workunit.client.0.smithi164.stdout:9/169: truncate d6/d1c/f32 532171 0 2024-02-10T00:00:29.963 INFO:tasks.workunit.client.0.smithi164.stdout:1/92: sync 2024-02-10T00:00:29.963 INFO:tasks.workunit.client.1.smithi183.stdout:5/586: dread d4/dd/d71/f84 [0,4194304] 0 2024-02-10T00:00:29.964 INFO:tasks.workunit.client.1.smithi183.stdout:2/578: symlink d2/d2c/d2f/d72/lc1 0 2024-02-10T00:00:29.965 INFO:tasks.workunit.client.1.smithi183.stdout:1/480: dwrite d0/d3/d29/f4c [0,4194304] 0 2024-02-10T00:00:29.965 INFO:tasks.workunit.client.0.smithi164.stdout:9/170: creat d6/de/d2b/f34 x:0 0 0 2024-02-10T00:00:29.965 INFO:tasks.workunit.client.0.smithi164.stdout:3/113: link d0/l9 d0/l21 0 2024-02-10T00:00:29.969 INFO:tasks.workunit.client.0.smithi164.stdout:1/93: dwrite d1/da/fb [0,4194304] 0 2024-02-10T00:00:29.970 INFO:tasks.workunit.client.1.smithi183.stdout:1/481: dwrite d0/d3/d29/d1f/f28 [0,4194304] 0 2024-02-10T00:00:29.971 INFO:tasks.workunit.client.1.smithi183.stdout:1/482: chown d0/d3/d29/d38/l41 940668 1 2024-02-10T00:00:29.972 INFO:tasks.workunit.client.0.smithi164.stdout:1/94: unlink d1/l8 0 2024-02-10T00:00:29.973 INFO:tasks.workunit.client.0.smithi164.stdout:1/95: readlink d1/da/d18/l1e 0 2024-02-10T00:00:29.973 INFO:tasks.workunit.client.0.smithi164.stdout:1/96: readlink d1/da/d18/l1e 0 2024-02-10T00:00:29.974 INFO:tasks.workunit.client.1.smithi183.stdout:5/587: rmdir d4/d23/d3e/d80/da1/d9e/d27/d37/d46/da6 0 2024-02-10T00:00:29.978 INFO:tasks.workunit.client.0.smithi164.stdout:1/97: mkdir d1/d13/d1f 0 2024-02-10T00:00:29.978 INFO:tasks.workunit.client.1.smithi183.stdout:5/588: dwrite d4/dd/d31/f83 [0,4194304] 0 2024-02-10T00:00:29.980 INFO:tasks.workunit.client.0.smithi164.stdout:1/98: mknod d1/c20 0 2024-02-10T00:00:29.983 INFO:tasks.workunit.client.0.smithi164.stdout:2/163: fdatasync d3/f6 0 2024-02-10T00:00:29.984 INFO:tasks.workunit.client.1.smithi183.stdout:5/589: dwrite d4/d23/d3e/d80/da1/f8f [0,4194304] 0 2024-02-10T00:00:29.985 INFO:tasks.workunit.client.1.smithi183.stdout:5/590: write d4/d74/f7e [402661,52583] 0 2024-02-10T00:00:29.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/99: link d1/da/l12 d1/da/d18/l21 0 2024-02-10T00:00:29.987 INFO:tasks.workunit.client.0.smithi164.stdout:2/164: dread d3/f15 [0,4194304] 0 2024-02-10T00:00:29.987 INFO:tasks.workunit.client.0.smithi164.stdout:2/165: readlink d3/d32/l33 0 2024-02-10T00:00:29.988 INFO:tasks.workunit.client.0.smithi164.stdout:2/166: dread d3/f7 [0,4194304] 0 2024-02-10T00:00:29.988 INFO:tasks.workunit.client.0.smithi164.stdout:2/167: chown d3/fe 62354099 1 2024-02-10T00:00:29.989 INFO:tasks.workunit.client.1.smithi183.stdout:6/403: write d2/d1a/d25/d3c/d31/d66/f71 [92274,4916] 0 2024-02-10T00:00:29.990 INFO:tasks.workunit.client.1.smithi183.stdout:6/404: write d2/d1a/d25/d3c/d31/d66/f71 [893502,87526] 0 2024-02-10T00:00:29.991 INFO:tasks.workunit.client.1.smithi183.stdout:0/461: truncate d14/d1d/d59/d71/d22/f4f 3974031 0 2024-02-10T00:00:29.992 INFO:tasks.workunit.client.1.smithi183.stdout:0/462: chown d14/d7a/f7e 5706 1 2024-02-10T00:00:29.992 INFO:tasks.workunit.client.1.smithi183.stdout:5/591: rmdir d4/d23/d3e/d80/da1/d9e/d27/d38/d4f 39 2024-02-10T00:00:29.994 INFO:tasks.workunit.client.1.smithi183.stdout:6/405: unlink d2/d1a/c4a 0 2024-02-10T00:00:29.995 INFO:tasks.workunit.client.1.smithi183.stdout:0/463: chown d14/d7a/c5c 70286 1 2024-02-10T00:00:29.996 INFO:tasks.workunit.client.1.smithi183.stdout:0/464: stat l13 0 2024-02-10T00:00:29.998 INFO:tasks.workunit.client.1.smithi183.stdout:0/465: rmdir d14/d1d/d59/d3c/d72 39 2024-02-10T00:00:29.999 INFO:tasks.workunit.client.0.smithi164.stdout:2/168: link d3/d32/l40 d3/d24/d25/d27/d2e/l42 0 2024-02-10T00:00:30.000 INFO:tasks.workunit.client.1.smithi183.stdout:4/501: write de/d14/d27/d2e/f8e [4308538,57641] 0 2024-02-10T00:00:30.000 INFO:tasks.workunit.client.0.smithi164.stdout:2/169: creat d3/d24/d25/d27/d2e/d36/f43 x:0 0 0 2024-02-10T00:00:30.001 INFO:tasks.workunit.client.0.smithi164.stdout:2/170: chown d3/d24/d25/d27/f2d 118141 1 2024-02-10T00:00:30.002 INFO:tasks.workunit.client.0.smithi164.stdout:2/171: stat d3/d26/l2b 0 2024-02-10T00:00:30.002 INFO:tasks.workunit.client.0.smithi164.stdout:2/172: chown d3/d24/d25/d27/f28 63085 1 2024-02-10T00:00:30.003 INFO:tasks.workunit.client.1.smithi183.stdout:4/502: dwrite de/d19/f96 [0,4194304] 0 2024-02-10T00:00:30.026 INFO:tasks.workunit.client.1.smithi183.stdout:5/592: link d4/d23/d3e/d80/da1/d9e/d89/f9b d4/d23/d3e/d80/da1/d9e/d27/d5d/fbc 0 2024-02-10T00:00:30.026 INFO:tasks.workunit.client.0.smithi164.stdout:4/147: read d2/d19/f15 [221660,6391] 0 2024-02-10T00:00:30.027 INFO:tasks.workunit.client.1.smithi183.stdout:5/593: write d4/d23/d4a/d36/f5e [5236032,3895] 0 2024-02-10T00:00:30.029 INFO:tasks.workunit.client.0.smithi164.stdout:5/163: sync 2024-02-10T00:00:30.030 INFO:tasks.workunit.client.0.smithi164.stdout:5/164: stat d7/d15 0 2024-02-10T00:00:30.030 INFO:tasks.workunit.client.0.smithi164.stdout:4/148: dread d2/d19/f11 [0,4194304] 0 2024-02-10T00:00:30.030 INFO:tasks.workunit.client.0.smithi164.stdout:8/119: dwrite d2/f10 [0,4194304] 0 2024-02-10T00:00:30.035 INFO:tasks.workunit.client.0.smithi164.stdout:1/100: fsync d1/da/fb 0 2024-02-10T00:00:30.036 INFO:tasks.workunit.client.1.smithi183.stdout:0/466: rmdir d14/d1d/d59/da7 0 2024-02-10T00:00:30.036 INFO:tasks.workunit.client.1.smithi183.stdout:0/467: write d14/d1d/d2d/d31/f3a [1032405,7123] 0 2024-02-10T00:00:30.036 INFO:tasks.workunit.client.1.smithi183.stdout:4/503: rename de/d14/c78 to de/d19/d20/c99 0 2024-02-10T00:00:30.036 INFO:tasks.workunit.client.1.smithi183.stdout:4/504: dread - de/d14/d27/f8b zero size 2024-02-10T00:00:30.037 INFO:tasks.workunit.client.1.smithi183.stdout:0/468: mknod d14/d3e/cab 0 2024-02-10T00:00:30.038 INFO:tasks.workunit.client.1.smithi183.stdout:5/594: creat d4/dd/fbd x:0 0 0 2024-02-10T00:00:30.039 INFO:tasks.workunit.client.0.smithi164.stdout:5/165: stat d7/d17/d21/d23/f2d 0 2024-02-10T00:00:30.041 INFO:tasks.workunit.client.1.smithi183.stdout:9/520: truncate d0/d3/d14/d3c/f60 862529 0 2024-02-10T00:00:30.041 INFO:tasks.workunit.client.1.smithi183.stdout:4/505: dwrite de/d14/d27/f55 [0,4194304] 0 2024-02-10T00:00:30.044 INFO:tasks.workunit.client.0.smithi164.stdout:4/149: mkdir d2/d2f/d37 0 2024-02-10T00:00:30.045 INFO:tasks.workunit.client.1.smithi183.stdout:7/487: truncate d0/d11/d2f/f66 2747676 0 2024-02-10T00:00:30.046 INFO:tasks.workunit.client.0.smithi164.stdout:6/219: dread d0/f21 [0,4194304] 0 2024-02-10T00:00:30.046 INFO:tasks.workunit.client.0.smithi164.stdout:2/173: sync 2024-02-10T00:00:30.047 INFO:tasks.workunit.client.0.smithi164.stdout:8/120: mknod d2/d12/c1e 0 2024-02-10T00:00:30.049 INFO:tasks.workunit.client.0.smithi164.stdout:4/150: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:30.050 INFO:tasks.workunit.client.0.smithi164.stdout:1/101: creat d1/d1a/f22 x:0 0 0 2024-02-10T00:00:30.052 INFO:tasks.workunit.client.1.smithi183.stdout:8/579: dread d0/d3f/db2/d24/f32 [0,4194304] 0 2024-02-10T00:00:30.052 INFO:tasks.workunit.client.1.smithi183.stdout:8/580: chown d0/d3f/f43 54003917 1 2024-02-10T00:00:30.053 INFO:tasks.workunit.client.0.smithi164.stdout:2/174: link d3/d24/d25/d27/d2a/f31 d3/f44 0 2024-02-10T00:00:30.059 INFO:tasks.workunit.client.1.smithi183.stdout:1/483: write d0/d3a/f83 [55510,95287] 0 2024-02-10T00:00:30.060 INFO:tasks.workunit.client.1.smithi183.stdout:3/441: dwrite d7/db/d2a/f2b [0,4194304] 0 2024-02-10T00:00:30.063 INFO:tasks.workunit.client.1.smithi183.stdout:2/579: dwrite d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:30.066 INFO:tasks.workunit.client.0.smithi164.stdout:0/123: truncate d6/d7/f26 507561 0 2024-02-10T00:00:30.070 INFO:tasks.workunit.client.1.smithi183.stdout:6/406: sync 2024-02-10T00:00:30.073 INFO:tasks.workunit.client.0.smithi164.stdout:9/171: rmdir d6/d1c 39 2024-02-10T00:00:30.075 INFO:tasks.workunit.client.0.smithi164.stdout:3/114: truncate d0/d1/ff 4108685 0 2024-02-10T00:00:30.076 INFO:tasks.workunit.client.1.smithi183.stdout:5/595: creat d4/d23/d3e/d80/da1/d9e/d27/d5d/fbe x:0 0 0 2024-02-10T00:00:30.078 INFO:tasks.workunit.client.0.smithi164.stdout:1/102: mkdir d1/d23 0 2024-02-10T00:00:30.078 INFO:tasks.workunit.client.1.smithi183.stdout:4/506: fsync de/d14/d27/f21 0 2024-02-10T00:00:30.080 INFO:tasks.workunit.client.1.smithi183.stdout:1/484: fsync d0/d3/d7/d3d/fac 0 2024-02-10T00:00:30.081 INFO:tasks.workunit.client.1.smithi183.stdout:1/485: readlink d0/d3/d7/d3d/d60/d89/l90 0 2024-02-10T00:00:30.082 INFO:tasks.workunit.client.1.smithi183.stdout:2/580: creat d2/da/d5b/fc2 x:0 0 0 2024-02-10T00:00:30.082 INFO:tasks.workunit.client.0.smithi164.stdout:5/166: sync 2024-02-10T00:00:30.083 INFO:tasks.workunit.client.0.smithi164.stdout:6/220: write d0/d6/d12/d14/f1e [2350899,7164] 0 2024-02-10T00:00:30.084 INFO:tasks.workunit.client.0.smithi164.stdout:6/221: write d0/d6/d12/d43/f44 [261611,29052] 0 2024-02-10T00:00:30.085 INFO:tasks.workunit.client.0.smithi164.stdout:8/121: truncate d2/d12/f17 2811510 0 2024-02-10T00:00:30.086 INFO:tasks.workunit.client.0.smithi164.stdout:0/124: symlink d6/d10/d18/l2b 0 2024-02-10T00:00:30.087 INFO:tasks.workunit.client.1.smithi183.stdout:5/596: unlink d4/d23/d2a/f49 0 2024-02-10T00:00:30.087 INFO:tasks.workunit.client.0.smithi164.stdout:3/115: creat d0/d1/d2/d19/f22 x:0 0 0 2024-02-10T00:00:30.087 INFO:tasks.workunit.client.0.smithi164.stdout:3/116: chown d0/d1/dd/d1e 119447209 1 2024-02-10T00:00:30.088 INFO:tasks.workunit.client.0.smithi164.stdout:1/103: mknod d1/d13/c24 0 2024-02-10T00:00:30.089 INFO:tasks.workunit.client.0.smithi164.stdout:6/222: mkdir d0/d6/d12/d45 0 2024-02-10T00:00:30.093 INFO:tasks.workunit.client.0.smithi164.stdout:4/151: truncate d2/d19/d16/f27 1888431 0 2024-02-10T00:00:30.093 INFO:tasks.workunit.client.1.smithi183.stdout:7/488: symlink d0/l8b 0 2024-02-10T00:00:30.094 INFO:tasks.workunit.client.0.smithi164.stdout:0/125: creat d6/d10/d18/d1c/f2c x:0 0 0 2024-02-10T00:00:30.094 INFO:tasks.workunit.client.1.smithi183.stdout:8/581: symlink d0/d10/d9e/da4/lb7 0 2024-02-10T00:00:30.095 INFO:tasks.workunit.client.0.smithi164.stdout:5/167: dwrite d7/f32 [0,4194304] 0 2024-02-10T00:00:30.096 INFO:tasks.workunit.client.0.smithi164.stdout:2/175: sync 2024-02-10T00:00:30.096 INFO:tasks.workunit.client.1.smithi183.stdout:0/469: truncate d14/d1d/d55/f5a 4972654 0 2024-02-10T00:00:30.096 INFO:tasks.workunit.client.0.smithi164.stdout:7/179: dwrite d3/f38 [0,4194304] 0 2024-02-10T00:00:30.097 INFO:tasks.workunit.client.0.smithi164.stdout:6/223: dread d0/d6/f28 [0,4194304] 0 2024-02-10T00:00:30.098 INFO:tasks.workunit.client.0.smithi164.stdout:6/224: fsync d0/f2f 0 2024-02-10T00:00:30.098 INFO:tasks.workunit.client.0.smithi164.stdout:9/172: creat d6/f35 x:0 0 0 2024-02-10T00:00:30.099 INFO:tasks.workunit.client.0.smithi164.stdout:3/117: symlink d0/d1/dd/d1e/l23 0 2024-02-10T00:00:30.099 INFO:tasks.workunit.client.0.smithi164.stdout:1/104: mknod d1/d13/d1f/c25 0 2024-02-10T00:00:30.100 INFO:tasks.workunit.client.1.smithi183.stdout:5/597: chown d4/d23/d3e/d80/da1/d9e/d89/f9b 261018625 1 2024-02-10T00:00:30.100 INFO:tasks.workunit.client.1.smithi183.stdout:5/598: readlink d4/d23/d2a/l33 0 2024-02-10T00:00:30.100 INFO:tasks.workunit.client.1.smithi183.stdout:6/407: dread d2/d1a/d25/f36 [0,4194304] 0 2024-02-10T00:00:30.100 INFO:tasks.workunit.client.0.smithi164.stdout:0/126: rmdir d6/d10/d18 39 2024-02-10T00:00:30.101 INFO:tasks.workunit.client.1.smithi183.stdout:5/599: write d4/d23/d3e/d80/da1/f5c [1378983,43917] 0 2024-02-10T00:00:30.101 INFO:tasks.workunit.client.0.smithi164.stdout:8/122: read d2/d12/f17 [1710600,122293] 0 2024-02-10T00:00:30.101 INFO:tasks.workunit.client.0.smithi164.stdout:1/105: read d1/f7 [4044114,97651] 0 2024-02-10T00:00:30.102 INFO:tasks.workunit.client.0.smithi164.stdout:7/180: symlink d3/d28/l42 0 2024-02-10T00:00:30.103 INFO:tasks.workunit.client.1.smithi183.stdout:4/507: creat de/d19/d8d/f9a x:0 0 0 2024-02-10T00:00:30.104 INFO:tasks.workunit.client.0.smithi164.stdout:3/118: dread d0/f10 [4194304,4194304] 0 2024-02-10T00:00:30.105 INFO:tasks.workunit.client.1.smithi183.stdout:1/486: dwrite d0/d3/d67/f2f [0,4194304] 0 2024-02-10T00:00:30.105 INFO:tasks.workunit.client.1.smithi183.stdout:9/521: rename d0/d10/f1b to d0/d3/d14/d1c/d2d/d4f/fb1 0 2024-02-10T00:00:30.106 INFO:tasks.workunit.client.0.smithi164.stdout:0/127: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:30.109 INFO:tasks.workunit.client.0.smithi164.stdout:2/176: dwrite d3/d24/d25/d27/d2e/f3a [0,4194304] 0 2024-02-10T00:00:30.109 INFO:tasks.workunit.client.1.smithi183.stdout:6/408: mknod d2/d1a/d25/d3c/d31/d38/d3f/c78 0 2024-02-10T00:00:30.110 INFO:tasks.workunit.client.0.smithi164.stdout:8/123: write d2/fa [1739231,117607] 0 2024-02-10T00:00:30.110 INFO:tasks.workunit.client.0.smithi164.stdout:2/177: chown d3/l14 26 1 2024-02-10T00:00:30.110 INFO:tasks.workunit.client.1.smithi183.stdout:9/522: dwrite d0/d3/d14/d3c/d7b/f87 [0,4194304] 0 2024-02-10T00:00:30.110 INFO:tasks.workunit.client.0.smithi164.stdout:1/106: symlink d1/d1a/l26 0 2024-02-10T00:00:30.112 INFO:tasks.workunit.client.0.smithi164.stdout:7/181: rename d3/l41 to d3/d5/l43 0 2024-02-10T00:00:30.114 INFO:tasks.workunit.client.0.smithi164.stdout:7/182: write d3/d11/f18 [1128782,113270] 0 2024-02-10T00:00:30.115 INFO:tasks.workunit.client.1.smithi183.stdout:6/409: dwrite d2/d1a/d3a/f48 [0,4194304] 0 2024-02-10T00:00:30.116 INFO:tasks.workunit.client.1.smithi183.stdout:5/600: mknod d4/d23/d3e/d80/d96/cbf 0 2024-02-10T00:00:30.116 INFO:tasks.workunit.client.0.smithi164.stdout:8/124: dwrite d2/f4 [8388608,4194304] 0 2024-02-10T00:00:30.117 INFO:tasks.workunit.client.0.smithi164.stdout:2/178: dwrite d3/d24/d25/f3f [0,4194304] 0 2024-02-10T00:00:30.118 INFO:tasks.workunit.client.0.smithi164.stdout:8/125: write d2/fa [19414,1838] 0 2024-02-10T00:00:30.118 INFO:tasks.workunit.client.0.smithi164.stdout:8/126: write d2/f19 [463688,33841] 0 2024-02-10T00:00:30.119 INFO:tasks.workunit.client.1.smithi183.stdout:0/470: creat d14/d1d/d59/d71/d22/fac x:0 0 0 2024-02-10T00:00:30.120 INFO:tasks.workunit.client.0.smithi164.stdout:3/119: mknod d0/d1/dd/d1e/c24 0 2024-02-10T00:00:30.121 INFO:tasks.workunit.client.1.smithi183.stdout:6/410: unlink d2/d1a/d3a/d45/c77 0 2024-02-10T00:00:30.123 INFO:tasks.workunit.client.0.smithi164.stdout:8/127: dwrite d2/f11 [0,4194304] 0 2024-02-10T00:00:30.125 INFO:tasks.workunit.client.0.smithi164.stdout:1/107: readlink d1/da/d18/l21 0 2024-02-10T00:00:30.125 INFO:tasks.workunit.client.0.smithi164.stdout:7/183: mkdir d3/d11/d39/d44 0 2024-02-10T00:00:30.128 INFO:tasks.workunit.client.0.smithi164.stdout:8/128: dwrite d2/f11 [0,4194304] 0 2024-02-10T00:00:30.129 INFO:tasks.workunit.client.0.smithi164.stdout:8/129: stat d2/f4 0 2024-02-10T00:00:30.129 INFO:tasks.workunit.client.1.smithi183.stdout:2/581: sync 2024-02-10T00:00:30.129 INFO:tasks.workunit.client.1.smithi183.stdout:2/582: readlink d2/d2c/d2f/d60/d8d/l94 0 2024-02-10T00:00:30.129 INFO:tasks.workunit.client.0.smithi164.stdout:4/152: sync 2024-02-10T00:00:30.130 INFO:tasks.workunit.client.0.smithi164.stdout:4/153: dread - d2/d19/f29 zero size 2024-02-10T00:00:30.130 INFO:tasks.workunit.client.0.smithi164.stdout:2/179: creat d3/d24/d25/d27/f45 x:0 0 0 2024-02-10T00:00:30.130 INFO:tasks.workunit.client.0.smithi164.stdout:6/225: truncate d0/d6/f1c 315580 0 2024-02-10T00:00:30.131 INFO:tasks.workunit.client.1.smithi183.stdout:3/442: rename d7/db/d2a/d2d/d51/d78/l83 to d7/db/d2a/l85 0 2024-02-10T00:00:30.132 INFO:tasks.workunit.client.1.smithi183.stdout:0/471: creat d14/d1d/d96/da0/fad x:0 0 0 2024-02-10T00:00:30.132 INFO:tasks.workunit.client.1.smithi183.stdout:6/411: creat d2/d1a/d25/d3c/d31/f79 x:0 0 0 2024-02-10T00:00:30.133 INFO:tasks.workunit.client.1.smithi183.stdout:2/583: rmdir d2/da/d20/d21/d36 39 2024-02-10T00:00:30.133 INFO:tasks.workunit.client.1.smithi183.stdout:3/443: write d7/db/f41 [4392053,9158] 0 2024-02-10T00:00:30.134 INFO:tasks.workunit.client.0.smithi164.stdout:3/120: creat d0/d1/f25 x:0 0 0 2024-02-10T00:00:30.134 INFO:tasks.workunit.client.0.smithi164.stdout:0/128: readlink d6/d10/d18/l21 0 2024-02-10T00:00:30.135 INFO:tasks.workunit.client.1.smithi183.stdout:6/412: fsync d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c 0 2024-02-10T00:00:30.135 INFO:tasks.workunit.client.0.smithi164.stdout:3/121: chown d0/f10 0 1 2024-02-10T00:00:30.135 INFO:tasks.workunit.client.1.smithi183.stdout:6/413: read d2/d1a/d25/d3c/d31/d38/d6e/f2e [5796099,127152] 0 2024-02-10T00:00:30.136 INFO:tasks.workunit.client.0.smithi164.stdout:3/122: write d0/d1/d2/f12 [1047327,103078] 0 2024-02-10T00:00:30.136 INFO:tasks.workunit.client.0.smithi164.stdout:3/123: write d0/d1/f25 [942947,119076] 0 2024-02-10T00:00:30.137 INFO:tasks.workunit.client.0.smithi164.stdout:3/124: dread - d0/d1/d2/d19/f1c zero size 2024-02-10T00:00:30.139 INFO:tasks.workunit.client.0.smithi164.stdout:1/108: symlink d1/da/d18/l27 0 2024-02-10T00:00:30.142 INFO:tasks.workunit.client.0.smithi164.stdout:2/180: creat d3/d24/f46 x:0 0 0 2024-02-10T00:00:30.142 INFO:tasks.workunit.client.1.smithi183.stdout:8/582: rename d0/d27/d75/d5b/d92 to d0/d31/db8 0 2024-02-10T00:00:30.143 INFO:tasks.workunit.client.0.smithi164.stdout:3/125: write d0/f10 [49374,41829] 0 2024-02-10T00:00:30.143 INFO:tasks.workunit.client.0.smithi164.stdout:2/181: chown d3/d32/l33 73400 1 2024-02-10T00:00:30.146 INFO:tasks.workunit.client.1.smithi183.stdout:2/584: dwrite d2/da/f7d [4194304,4194304] 0 2024-02-10T00:00:30.146 INFO:tasks.workunit.client.0.smithi164.stdout:9/173: link d6/d1c/d24/c2f d6/d1c/c36 0 2024-02-10T00:00:30.147 INFO:tasks.workunit.client.0.smithi164.stdout:3/126: dwrite d0/d1/d2/fe [4194304,4194304] 0 2024-02-10T00:00:30.148 INFO:tasks.workunit.client.0.smithi164.stdout:3/127: readlink d0/d1/dd/l15 0 2024-02-10T00:00:30.149 INFO:tasks.workunit.client.0.smithi164.stdout:2/182: mknod d3/d24/d25/d27/d2e/c47 0 2024-02-10T00:00:30.149 INFO:tasks.workunit.client.0.smithi164.stdout:3/128: write d0/f10 [5638200,66950] 0 2024-02-10T00:00:30.150 INFO:tasks.workunit.client.0.smithi164.stdout:1/109: rename d1/da/f17 to d1/d13/d1f/f28 0 2024-02-10T00:00:30.151 INFO:tasks.workunit.client.0.smithi164.stdout:1/110: write d1/f11 [2273009,40324] 0 2024-02-10T00:00:30.153 INFO:tasks.workunit.client.1.smithi183.stdout:1/487: rename d0/d3a/c5f to d0/d3/d7/d3d/d99/cb0 0 2024-02-10T00:00:30.154 INFO:tasks.workunit.client.0.smithi164.stdout:2/183: creat d3/d26/f48 x:0 0 0 2024-02-10T00:00:30.155 INFO:tasks.workunit.client.1.smithi183.stdout:1/488: stat d0/d3/d29/d1f/d86 0 2024-02-10T00:00:30.155 INFO:tasks.workunit.client.1.smithi183.stdout:1/489: chown d0/d3/d7/d3d/d99 116584 1 2024-02-10T00:00:30.155 INFO:tasks.workunit.client.0.smithi164.stdout:6/226: dread d0/d6/d12/d43/f44 [0,4194304] 0 2024-02-10T00:00:30.156 INFO:tasks.workunit.client.0.smithi164.stdout:3/129: mknod d0/d1/dd/d1e/c26 0 2024-02-10T00:00:30.156 INFO:tasks.workunit.client.0.smithi164.stdout:2/184: stat d3/c30 0 2024-02-10T00:00:30.156 INFO:tasks.workunit.client.1.smithi183.stdout:2/585: mknod d2/da/d20/d21/d43/d58/cc3 0 2024-02-10T00:00:30.156 INFO:tasks.workunit.client.0.smithi164.stdout:1/111: dwrite d1/d13/f19 [0,4194304] 0 2024-02-10T00:00:30.159 INFO:tasks.workunit.client.0.smithi164.stdout:6/227: dread d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:30.159 INFO:tasks.workunit.client.0.smithi164.stdout:3/130: chown d0/d1/d2/d19/l1b 0 1 2024-02-10T00:00:30.160 INFO:tasks.workunit.client.0.smithi164.stdout:9/174: getdents d6/d1c/d24 0 2024-02-10T00:00:30.160 INFO:tasks.workunit.client.0.smithi164.stdout:6/228: chown d0/d6/d12/d43 295777123 1 2024-02-10T00:00:30.160 INFO:tasks.workunit.client.0.smithi164.stdout:1/112: creat d1/d1a/f29 x:0 0 0 2024-02-10T00:00:30.161 INFO:tasks.workunit.client.0.smithi164.stdout:6/229: readlink d0/l15 0 2024-02-10T00:00:30.162 INFO:tasks.workunit.client.0.smithi164.stdout:6/230: stat d0/d6/d12/c38 0 2024-02-10T00:00:30.163 INFO:tasks.workunit.client.1.smithi183.stdout:2/586: mkdir d2/da/d20/d21/d43/d58/d74/d83/dc4 0 2024-02-10T00:00:30.163 INFO:tasks.workunit.client.0.smithi164.stdout:9/175: creat d6/de/d2b/f37 x:0 0 0 2024-02-10T00:00:30.163 INFO:tasks.workunit.client.0.smithi164.stdout:9/176: chown d6/d1c/f2e 9443 1 2024-02-10T00:00:30.163 INFO:tasks.workunit.client.0.smithi164.stdout:1/113: symlink d1/d1a/l2a 0 2024-02-10T00:00:30.164 INFO:tasks.workunit.client.0.smithi164.stdout:9/177: dread - d6/d1c/d24/f2a zero size 2024-02-10T00:00:30.165 INFO:tasks.workunit.client.0.smithi164.stdout:6/231: symlink d0/d6/d12/d43/l46 0 2024-02-10T00:00:30.165 INFO:tasks.workunit.client.1.smithi183.stdout:5/601: rename d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d9f to d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0 0 2024-02-10T00:00:30.166 INFO:tasks.workunit.client.0.smithi164.stdout:6/232: write d0/d2b/d3a/f3e [607340,18954] 0 2024-02-10T00:00:30.167 INFO:tasks.workunit.client.0.smithi164.stdout:3/131: truncate d0/d1/d2/d19/f22 692334 0 2024-02-10T00:00:30.170 INFO:tasks.workunit.client.1.smithi183.stdout:0/472: rename d14/d3e/d5f/daa/f9d to d14/d1d/d2d/d31/d6c/fae 0 2024-02-10T00:00:30.170 INFO:tasks.workunit.client.0.smithi164.stdout:9/178: dwrite d6/d1c/f2e [0,4194304] 0 2024-02-10T00:00:30.171 INFO:tasks.workunit.client.0.smithi164.stdout:3/132: mkdir d0/d1/d2/d19/d27 0 2024-02-10T00:00:30.172 INFO:tasks.workunit.client.1.smithi183.stdout:5/602: unlink d4/l52 0 2024-02-10T00:00:30.172 INFO:tasks.workunit.client.0.smithi164.stdout:6/233: truncate d0/d6/d12/f22 614568 0 2024-02-10T00:00:30.172 INFO:tasks.workunit.client.0.smithi164.stdout:9/179: dread - d6/d1c/d24/f2a zero size 2024-02-10T00:00:30.172 INFO:tasks.workunit.client.0.smithi164.stdout:8/130: sync 2024-02-10T00:00:30.172 INFO:tasks.workunit.client.0.smithi164.stdout:4/154: sync 2024-02-10T00:00:30.174 INFO:tasks.workunit.client.1.smithi183.stdout:0/473: dwrite d14/d1d/d2d/f8f [0,4194304] 0 2024-02-10T00:00:30.175 INFO:tasks.workunit.client.1.smithi183.stdout:2/587: creat d2/da/d20/d21/d43/d58/d74/d83/dc4/fc5 x:0 0 0 2024-02-10T00:00:30.176 INFO:tasks.workunit.client.1.smithi183.stdout:5/603: fsync d4/d23/d3e/d80/da1/d9e/f43 0 2024-02-10T00:00:30.177 INFO:tasks.workunit.client.0.smithi164.stdout:3/133: dwrite d0/d1/d2/d19/f1c [0,4194304] 0 2024-02-10T00:00:30.177 INFO:tasks.workunit.client.1.smithi183.stdout:8/583: sync 2024-02-10T00:00:30.178 INFO:tasks.workunit.client.1.smithi183.stdout:6/414: sync 2024-02-10T00:00:30.179 INFO:tasks.workunit.client.1.smithi183.stdout:0/474: rename d14/d1d/d59/d71/d22/l4a to d14/d1d/d2d/d31/d68/laf 0 2024-02-10T00:00:30.179 INFO:tasks.workunit.client.0.smithi164.stdout:6/234: creat d0/d2b/d3a/d3d/d42/f47 x:0 0 0 2024-02-10T00:00:30.180 INFO:tasks.workunit.client.0.smithi164.stdout:8/131: link d2/l15 d2/l1f 0 2024-02-10T00:00:30.181 INFO:tasks.workunit.client.1.smithi183.stdout:2/588: mkdir d2/da/d20/d21/d36/dc6 0 2024-02-10T00:00:30.182 INFO:tasks.workunit.client.0.smithi164.stdout:3/134: dwrite d0/d1/f25 [0,4194304] 0 2024-02-10T00:00:30.184 INFO:tasks.workunit.client.0.smithi164.stdout:3/135: read d0/d1/f25 [144984,18211] 0 2024-02-10T00:00:30.184 INFO:tasks.workunit.client.1.smithi183.stdout:0/475: mknod d14/d1d/d96/cb0 0 2024-02-10T00:00:30.184 INFO:tasks.workunit.client.0.smithi164.stdout:3/136: write d0/f10 [2156862,12949] 0 2024-02-10T00:00:30.185 INFO:tasks.workunit.client.1.smithi183.stdout:0/476: write d14/d7a/f7e [585457,99802] 0 2024-02-10T00:00:30.185 INFO:tasks.workunit.client.0.smithi164.stdout:3/137: chown d0/d1/dd/d1e/l23 1018532 1 2024-02-10T00:00:30.186 INFO:tasks.workunit.client.1.smithi183.stdout:6/415: rmdir d2/d1a/d25/d3c/d31/d38/d6e/d34/d61 39 2024-02-10T00:00:30.186 INFO:tasks.workunit.client.0.smithi164.stdout:3/138: write d0/d1/d2/f12 [1262128,67016] 0 2024-02-10T00:00:30.187 INFO:tasks.workunit.client.1.smithi183.stdout:8/584: dread d0/d45/f49 [0,4194304] 0 2024-02-10T00:00:30.189 INFO:tasks.workunit.client.1.smithi183.stdout:2/589: rename d2/da/d19/d31/d9b to d2/da/d77/dc7 0 2024-02-10T00:00:30.190 INFO:tasks.workunit.client.1.smithi183.stdout:0/477: creat d14/d3e/d5f/fb1 x:0 0 0 2024-02-10T00:00:30.191 INFO:tasks.workunit.client.0.smithi164.stdout:3/139: stat d0/d1/d2/c1a 0 2024-02-10T00:00:30.192 INFO:tasks.workunit.client.1.smithi183.stdout:2/590: mknod d2/da/d20/d21/d43/d58/d74/cc8 0 2024-02-10T00:00:30.192 INFO:tasks.workunit.client.1.smithi183.stdout:7/489: write d0/d11/d3e/f58 [979692,60938] 0 2024-02-10T00:00:30.194 INFO:tasks.workunit.client.1.smithi183.stdout:0/478: unlink d14/d7a/c5c 0 2024-02-10T00:00:30.196 INFO:tasks.workunit.client.1.smithi183.stdout:7/490: dread d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:30.197 INFO:tasks.workunit.client.1.smithi183.stdout:6/416: getdents d2/d1a 0 2024-02-10T00:00:30.198 INFO:tasks.workunit.client.1.smithi183.stdout:0/479: truncate f6 1453960 0 2024-02-10T00:00:30.199 INFO:tasks.workunit.client.1.smithi183.stdout:2/591: creat d2/d2c/dba/fc9 x:0 0 0 2024-02-10T00:00:30.199 INFO:tasks.workunit.client.1.smithi183.stdout:2/592: write d2/da/d19/fb4 [239423,33810] 0 2024-02-10T00:00:30.201 INFO:tasks.workunit.client.1.smithi183.stdout:2/593: write d2/d2c/d2f/d60/d8d/d9c/da7/fbc [713993,55348] 0 2024-02-10T00:00:30.202 INFO:tasks.workunit.client.1.smithi183.stdout:7/491: symlink d0/d2/d4/l8c 0 2024-02-10T00:00:30.202 INFO:tasks.workunit.client.1.smithi183.stdout:7/492: chown d0 0 1 2024-02-10T00:00:30.203 INFO:tasks.workunit.client.1.smithi183.stdout:6/417: creat d2/d1a/d25/d3c/d31/d38/d3f/d5e/f7a x:0 0 0 2024-02-10T00:00:30.203 INFO:tasks.workunit.client.1.smithi183.stdout:4/508: dread de/d14/d27/d2e/f90 [0,4194304] 0 2024-02-10T00:00:30.204 INFO:tasks.workunit.client.1.smithi183.stdout:2/594: unlink d2/d2c/f6f 0 2024-02-10T00:00:30.204 INFO:tasks.workunit.client.1.smithi183.stdout:2/595: stat d2/c64 0 2024-02-10T00:00:30.205 INFO:tasks.workunit.client.1.smithi183.stdout:6/418: chown d2/d1a/d25/d3c/d31/d38/d6e/c58 357285571 1 2024-02-10T00:00:30.207 INFO:tasks.workunit.client.1.smithi183.stdout:6/419: symlink d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7b 0 2024-02-10T00:00:30.208 INFO:tasks.workunit.client.1.smithi183.stdout:7/493: rmdir d0/d2/d4/d8/d7a 0 2024-02-10T00:00:30.208 INFO:tasks.workunit.client.1.smithi183.stdout:5/604: dread d4/d23/d3e/d80/da1/d9e/d89/f90 [0,4194304] 0 2024-02-10T00:00:30.209 INFO:tasks.workunit.client.1.smithi183.stdout:5/605: chown d4/dd/f75 167885804 1 2024-02-10T00:00:30.209 INFO:tasks.workunit.client.1.smithi183.stdout:2/596: mknod d2/d2c/cca 0 2024-02-10T00:00:30.210 INFO:tasks.workunit.client.1.smithi183.stdout:6/420: creat d2/d1a/d3a/d45/d53/f7c x:0 0 0 2024-02-10T00:00:30.210 INFO:tasks.workunit.client.1.smithi183.stdout:7/494: symlink d0/d11/d3e/l8d 0 2024-02-10T00:00:30.212 INFO:tasks.workunit.client.1.smithi183.stdout:7/495: chown d0/d2/d4/l7e 9823 1 2024-02-10T00:00:30.212 INFO:tasks.workunit.client.1.smithi183.stdout:4/509: link de/d14/d27/l52 de/d14/d27/d2e/l9b 0 2024-02-10T00:00:30.213 INFO:tasks.workunit.client.1.smithi183.stdout:7/496: read - d0/d2/d50/d5d/f78 zero size 2024-02-10T00:00:30.213 INFO:tasks.workunit.client.1.smithi183.stdout:7/497: write d0/d2/d50/d5d/f78 [150891,117134] 0 2024-02-10T00:00:30.216 INFO:tasks.workunit.client.1.smithi183.stdout:4/510: mkdir de/d22/d92/d9c 0 2024-02-10T00:00:30.218 INFO:tasks.workunit.client.0.smithi164.stdout:2/185: dread d3/d24/d25/d27/f2d [0,4194304] 0 2024-02-10T00:00:30.219 INFO:tasks.workunit.client.0.smithi164.stdout:2/186: chown d3/d24/d25/d27/d2e/f41 3191097 1 2024-02-10T00:00:30.220 INFO:tasks.workunit.client.1.smithi183.stdout:7/498: unlink d0/d2/d50/d5d/c77 0 2024-02-10T00:00:30.221 INFO:tasks.workunit.client.0.smithi164.stdout:2/187: write d3/f1f [437464,18820] 0 2024-02-10T00:00:30.221 INFO:tasks.workunit.client.1.smithi183.stdout:6/421: getdents d2/d1a/d25/d3c/d31/d38/d6e/d34 0 2024-02-10T00:00:30.222 INFO:tasks.workunit.client.0.smithi164.stdout:2/188: chown d3/d32/l40 389 1 2024-02-10T00:00:30.224 INFO:tasks.workunit.client.0.smithi164.stdout:2/189: mknod d3/d24/d25/d27/d2e/c49 0 2024-02-10T00:00:30.226 INFO:tasks.workunit.client.0.smithi164.stdout:2/190: creat d3/f4a x:0 0 0 2024-02-10T00:00:30.227 INFO:tasks.workunit.client.0.smithi164.stdout:2/191: creat d3/d24/d25/d27/d2e/d36/f4b x:0 0 0 2024-02-10T00:00:30.228 INFO:tasks.workunit.client.0.smithi164.stdout:2/192: write d3/d24/d25/d27/f28 [57566,32212] 0 2024-02-10T00:00:30.231 INFO:tasks.workunit.client.0.smithi164.stdout:2/193: truncate d3/d24/d25/d27/d2a/f31 764312 0 2024-02-10T00:00:30.235 INFO:tasks.workunit.client.0.smithi164.stdout:2/194: dwrite d3/d24/d25/d27/d2e/d36/f3b [4194304,4194304] 0 2024-02-10T00:00:30.242 INFO:tasks.workunit.client.0.smithi164.stdout:5/168: write d7/f19 [899703,117581] 0 2024-02-10T00:00:30.252 INFO:tasks.workunit.client.0.smithi164.stdout:5/169: link d7/d17/d21/d24/l30 d7/d15/l35 0 2024-02-10T00:00:30.257 INFO:tasks.workunit.client.1.smithi183.stdout:2/597: dread d2/da/d77/f4f [0,4194304] 0 2024-02-10T00:00:30.259 INFO:tasks.workunit.client.0.smithi164.stdout:5/170: getdents d7 0 2024-02-10T00:00:30.259 INFO:tasks.workunit.client.1.smithi183.stdout:6/422: dread d2/f30 [4194304,4194304] 0 2024-02-10T00:00:30.260 INFO:tasks.workunit.client.0.smithi164.stdout:5/171: fdatasync d7/d17/d21/d23/f2d 0 2024-02-10T00:00:30.261 INFO:tasks.workunit.client.1.smithi183.stdout:2/598: truncate d2/d2c/d2f/d72/f9f 205786 0 2024-02-10T00:00:30.261 INFO:tasks.workunit.client.0.smithi164.stdout:5/172: chown d7/d15/d1f/f25 3750 1 2024-02-10T00:00:30.262 INFO:tasks.workunit.client.1.smithi183.stdout:6/423: mknod d2/d1a/d25/d3c/c7d 0 2024-02-10T00:00:30.262 INFO:tasks.workunit.client.1.smithi183.stdout:2/599: write d2/d2c/d2f/d60/d8d/d9c/fb2 [453492,44629] 0 2024-02-10T00:00:30.262 INFO:tasks.workunit.client.1.smithi183.stdout:6/424: chown d2/d1a/d3a/l55 1 1 2024-02-10T00:00:30.263 INFO:tasks.workunit.client.0.smithi164.stdout:5/173: mkdir d7/d17/d21/d24/d26/d2a/d36 0 2024-02-10T00:00:30.264 INFO:tasks.workunit.client.1.smithi183.stdout:6/425: write d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [583448,60011] 0 2024-02-10T00:00:30.265 INFO:tasks.workunit.client.1.smithi183.stdout:8/585: dread d0/d27/f3a [0,4194304] 0 2024-02-10T00:00:30.266 INFO:tasks.workunit.client.0.smithi164.stdout:5/174: dwrite d7/fd [4194304,4194304] 0 2024-02-10T00:00:30.268 INFO:tasks.workunit.client.1.smithi183.stdout:9/523: truncate d0/f36 4871107 0 2024-02-10T00:00:30.270 INFO:tasks.workunit.client.1.smithi183.stdout:3/444: rmdir d7/db 39 2024-02-10T00:00:30.272 INFO:tasks.workunit.client.0.smithi164.stdout:0/129: dwrite f5 [4194304,4194304] 0 2024-02-10T00:00:30.272 INFO:tasks.workunit.client.1.smithi183.stdout:9/524: dwrite d0/d3/d14/d3c/d7b/f87 [4194304,4194304] 0 2024-02-10T00:00:30.275 INFO:tasks.workunit.client.1.smithi183.stdout:8/586: rename d0/d3f/f57 to d0/d10/d9e/fb9 0 2024-02-10T00:00:30.277 INFO:tasks.workunit.client.0.smithi164.stdout:0/130: write f1 [4511650,62555] 0 2024-02-10T00:00:30.279 INFO:tasks.workunit.client.0.smithi164.stdout:7/184: dread d3/ff [0,4194304] 0 2024-02-10T00:00:30.282 INFO:tasks.workunit.client.1.smithi183.stdout:1/490: truncate d0/d3/d29/d1f/f28 4142813 0 2024-02-10T00:00:30.283 INFO:tasks.workunit.client.0.smithi164.stdout:1/114: dwrite d1/fd [0,4194304] 0 2024-02-10T00:00:30.283 INFO:tasks.workunit.client.0.smithi164.stdout:8/132: truncate d2/f10 1630925 0 2024-02-10T00:00:30.284 INFO:tasks.workunit.client.0.smithi164.stdout:4/155: dwrite d2/d19/f11 [0,4194304] 0 2024-02-10T00:00:30.288 INFO:tasks.workunit.client.0.smithi164.stdout:3/140: truncate d0/d1/f11 3466203 0 2024-02-10T00:00:30.289 INFO:tasks.workunit.client.0.smithi164.stdout:6/235: truncate d0/d6/f1c 1243006 0 2024-02-10T00:00:30.291 INFO:tasks.workunit.client.0.smithi164.stdout:5/175: rename d7/d17/d21/d24/d26/d2a to d7/d17/d21/d23/d37 0 2024-02-10T00:00:30.293 INFO:tasks.workunit.client.1.smithi183.stdout:0/480: rmdir d14/d7a 39 2024-02-10T00:00:30.293 INFO:tasks.workunit.client.0.smithi164.stdout:9/180: rmdir d6 39 2024-02-10T00:00:30.294 INFO:tasks.workunit.client.0.smithi164.stdout:2/195: dwrite d3/d24/d25/d27/d2e/d36/f3b [8388608,4194304] 0 2024-02-10T00:00:30.294 INFO:tasks.workunit.client.0.smithi164.stdout:0/131: rmdir d6/d7/d14 39 2024-02-10T00:00:30.295 INFO:tasks.workunit.client.0.smithi164.stdout:0/132: write d6/f15 [4295545,19866] 0 2024-02-10T00:00:30.295 INFO:tasks.workunit.client.1.smithi183.stdout:3/445: dread - d7/db/d2a/d33/d59/d52/f60 zero size 2024-02-10T00:00:30.295 INFO:tasks.workunit.client.1.smithi183.stdout:3/446: dread - d7/db/f61 zero size 2024-02-10T00:00:30.296 INFO:tasks.workunit.client.1.smithi183.stdout:3/447: fdatasync d7/f30 0 2024-02-10T00:00:30.296 INFO:tasks.workunit.client.1.smithi183.stdout:3/448: fsync d7/f5a 0 2024-02-10T00:00:30.300 INFO:tasks.workunit.client.0.smithi164.stdout:3/141: write d0/d1/ff [5039311,79642] 0 2024-02-10T00:00:30.300 INFO:tasks.workunit.client.0.smithi164.stdout:3/142: chown d0/d1/d2/d17 2173728 1 2024-02-10T00:00:30.300 INFO:tasks.workunit.client.0.smithi164.stdout:6/236: mknod d0/d2b/c48 0 2024-02-10T00:00:30.301 INFO:tasks.workunit.client.0.smithi164.stdout:3/143: fsync d0/d1/d2/fe 0 2024-02-10T00:00:30.302 INFO:tasks.workunit.client.0.smithi164.stdout:5/176: rename d7/la to d7/l38 0 2024-02-10T00:00:30.302 INFO:tasks.workunit.client.1.smithi183.stdout:5/606: truncate d4/d23/d4a/d36/f5e 5184849 0 2024-02-10T00:00:30.303 INFO:tasks.workunit.client.0.smithi164.stdout:5/177: read - d7/d17/d21/d23/f2d zero size 2024-02-10T00:00:30.303 INFO:tasks.workunit.client.1.smithi183.stdout:4/511: write de/d14/d27/d2e/f88 [653258,56452] 0 2024-02-10T00:00:30.305 INFO:tasks.workunit.client.0.smithi164.stdout:2/196: creat d3/d24/d25/d27/f4c x:0 0 0 2024-02-10T00:00:30.306 INFO:tasks.workunit.client.1.smithi183.stdout:7/499: truncate d0/d11/d2f/d64/f69 149929 0 2024-02-10T00:00:30.308 INFO:tasks.workunit.client.1.smithi183.stdout:2/600: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:30.309 INFO:tasks.workunit.client.0.smithi164.stdout:6/237: mknod d0/d6/d12/c49 0 2024-02-10T00:00:30.309 INFO:tasks.workunit.client.1.smithi183.stdout:2/601: fdatasync d2/d2c/dba/fc9 0 2024-02-10T00:00:30.309 INFO:tasks.workunit.client.0.smithi164.stdout:6/238: fdatasync d0/d2b/d3a/d3d/d42/f47 0 2024-02-10T00:00:30.311 INFO:tasks.workunit.client.1.smithi183.stdout:8/587: mknod d0/d4e/d53/cba 0 2024-02-10T00:00:30.311 INFO:tasks.workunit.client.0.smithi164.stdout:9/181: creat d6/de/d2b/f38 x:0 0 0 2024-02-10T00:00:30.312 INFO:tasks.workunit.client.0.smithi164.stdout:9/182: fsync d6/de/f11 0 2024-02-10T00:00:30.312 INFO:tasks.workunit.client.0.smithi164.stdout:9/183: stat d6/de/c25 0 2024-02-10T00:00:30.313 INFO:tasks.workunit.client.0.smithi164.stdout:2/197: mknod d3/d26/c4d 0 2024-02-10T00:00:30.313 INFO:tasks.workunit.client.0.smithi164.stdout:0/133: read d6/d7/d14/f1b [4026437,9478] 0 2024-02-10T00:00:30.313 INFO:tasks.workunit.client.1.smithi183.stdout:0/481: creat d14/d1d/d2d/d31/d6c/fb2 x:0 0 0 2024-02-10T00:00:30.314 INFO:tasks.workunit.client.0.smithi164.stdout:4/156: creat d2/d19/d16/f38 x:0 0 0 2024-02-10T00:00:30.316 INFO:tasks.workunit.client.0.smithi164.stdout:6/239: symlink d0/d2b/l4a 0 2024-02-10T00:00:30.318 INFO:tasks.workunit.client.1.smithi183.stdout:3/449: creat d7/db/d2a/d33/d59/f86 x:0 0 0 2024-02-10T00:00:30.320 INFO:tasks.workunit.client.1.smithi183.stdout:4/512: chown de/d19/d1c 3537 1 2024-02-10T00:00:30.320 INFO:tasks.workunit.client.1.smithi183.stdout:5/607: symlink d4/d23/d3e/d80/da1/d9c/d72/da0/lc1 0 2024-02-10T00:00:30.321 INFO:tasks.workunit.client.0.smithi164.stdout:0/134: mkdir d6/d10/d18/d2d 0 2024-02-10T00:00:30.321 INFO:tasks.workunit.client.0.smithi164.stdout:3/144: link d0/d1/dd/d1e/c26 d0/d1/d2/d19/c28 0 2024-02-10T00:00:30.322 INFO:tasks.workunit.client.0.smithi164.stdout:3/145: dread - d0/d1/dd/f1f zero size 2024-02-10T00:00:30.323 INFO:tasks.workunit.client.0.smithi164.stdout:4/157: symlink d2/d2f/d37/l39 0 2024-02-10T00:00:30.325 INFO:tasks.workunit.client.0.smithi164.stdout:6/240: dwrite d0/d6/d12/d43/f44 [0,4194304] 0 2024-02-10T00:00:30.327 INFO:tasks.workunit.client.0.smithi164.stdout:4/158: creat d2/d19/d16/f3a x:0 0 0 2024-02-10T00:00:30.327 INFO:tasks.workunit.client.1.smithi183.stdout:2/602: creat d2/da/d20/d21/d36/fcb x:0 0 0 2024-02-10T00:00:30.328 INFO:tasks.workunit.client.1.smithi183.stdout:6/426: link d2/d1a/d25/d3c/d31/d38/d6e/c63 d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/c7e 0 2024-02-10T00:00:30.330 INFO:tasks.workunit.client.1.smithi183.stdout:3/450: write d7/db/f45 [1264699,22176] 0 2024-02-10T00:00:30.331 INFO:tasks.workunit.client.0.smithi164.stdout:4/159: unlink d2/d19/d16/f27 0 2024-02-10T00:00:30.331 INFO:tasks.workunit.client.1.smithi183.stdout:4/513: mknod de/d22/c9d 0 2024-02-10T00:00:30.333 INFO:tasks.workunit.client.1.smithi183.stdout:9/525: link d0/d3/d14/d48/l6d d0/d30/lb2 0 2024-02-10T00:00:30.334 INFO:tasks.workunit.client.0.smithi164.stdout:4/160: truncate d2/d19/d16/f25 593195 0 2024-02-10T00:00:30.334 INFO:tasks.workunit.client.0.smithi164.stdout:4/161: chown d2 201408898 1 2024-02-10T00:00:30.337 INFO:tasks.workunit.client.1.smithi183.stdout:6/427: symlink d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7f 0 2024-02-10T00:00:30.338 INFO:tasks.workunit.client.1.smithi183.stdout:0/482: unlink d14/d7a/f82 0 2024-02-10T00:00:30.339 INFO:tasks.workunit.client.0.smithi164.stdout:0/135: fsync d6/f15 0 2024-02-10T00:00:30.342 INFO:tasks.workunit.client.0.smithi164.stdout:8/133: write d2/f10 [35438,48409] 0 2024-02-10T00:00:30.344 INFO:tasks.workunit.client.1.smithi183.stdout:5/608: link d4/dd/d31/d73/fb7 d4/dd/d31/d73/fc2 0 2024-02-10T00:00:30.344 INFO:tasks.workunit.client.1.smithi183.stdout:5/609: dread - d4/d23/d3e/d80/da1/f8a zero size 2024-02-10T00:00:30.348 INFO:tasks.workunit.client.0.smithi164.stdout:1/115: dwrite d1/fd [4194304,4194304] 0 2024-02-10T00:00:30.350 INFO:tasks.workunit.client.1.smithi183.stdout:2/603: mknod d2/da/d20/d6d/dbe/ccc 0 2024-02-10T00:00:30.350 INFO:tasks.workunit.client.1.smithi183.stdout:1/491: getdents d0/d3/d7 0 2024-02-10T00:00:30.351 INFO:tasks.workunit.client.0.smithi164.stdout:7/185: dwrite d3/d11/f23 [0,4194304] 0 2024-02-10T00:00:30.352 INFO:tasks.workunit.client.0.smithi164.stdout:7/186: readlink d3/d5/l25 0 2024-02-10T00:00:30.352 INFO:tasks.workunit.client.0.smithi164.stdout:2/198: rename d3/d24/d25 to d3/d32/d4e 0 2024-02-10T00:00:30.354 INFO:tasks.workunit.client.0.smithi164.stdout:5/178: truncate d7/f19 681695 0 2024-02-10T00:00:30.355 INFO:tasks.workunit.client.1.smithi183.stdout:6/428: fsync d2/d1a/d25/d3c/d31/d38/d6e/f2e 0 2024-02-10T00:00:30.356 INFO:tasks.workunit.client.1.smithi183.stdout:6/429: chown d2/d1a/d25/d3c/d31/d38/d6e/d34 4 1 2024-02-10T00:00:30.356 INFO:tasks.workunit.client.0.smithi164.stdout:9/184: truncate d6/de/d22/f26 1576233 0 2024-02-10T00:00:30.356 INFO:tasks.workunit.client.1.smithi183.stdout:0/483: mknod d14/d3e/d5f/cb3 0 2024-02-10T00:00:30.357 INFO:tasks.workunit.client.0.smithi164.stdout:0/136: creat d6/d10/d18/d2d/f2e x:0 0 0 2024-02-10T00:00:30.357 INFO:tasks.workunit.client.1.smithi183.stdout:3/451: fsync d7/db/d2a/d1c/f1e 0 2024-02-10T00:00:30.358 INFO:tasks.workunit.client.0.smithi164.stdout:0/137: stat d6/d7/d14/f20 0 2024-02-10T00:00:30.358 INFO:tasks.workunit.client.1.smithi183.stdout:4/514: creat de/d22/d92/d9c/f9e x:0 0 0 2024-02-10T00:00:30.358 INFO:tasks.workunit.client.0.smithi164.stdout:6/241: dread d0/f1a [0,4194304] 0 2024-02-10T00:00:30.359 INFO:tasks.workunit.client.0.smithi164.stdout:8/134: write d2/d12/f17 [405187,68895] 0 2024-02-10T00:00:30.361 INFO:tasks.workunit.client.0.smithi164.stdout:9/185: dread d6/d1c/f29 [0,4194304] 0 2024-02-10T00:00:30.361 INFO:tasks.workunit.client.0.smithi164.stdout:8/135: dread d2/f10 [0,4194304] 0 2024-02-10T00:00:30.361 INFO:tasks.workunit.client.0.smithi164.stdout:4/162: write f1 [1204611,106794] 0 2024-02-10T00:00:30.362 INFO:tasks.workunit.client.0.smithi164.stdout:9/186: read d6/f9 [927826,130937] 0 2024-02-10T00:00:30.362 INFO:tasks.workunit.client.0.smithi164.stdout:4/163: chown d2/d19/d16/f30 7 1 2024-02-10T00:00:30.363 INFO:tasks.workunit.client.0.smithi164.stdout:1/116: mkdir d1/d13/d2b 0 2024-02-10T00:00:30.364 INFO:tasks.workunit.client.1.smithi183.stdout:8/588: truncate d0/f2f 510150 0 2024-02-10T00:00:30.365 INFO:tasks.workunit.client.0.smithi164.stdout:7/187: mkdir d3/d28/d45 0 2024-02-10T00:00:30.366 INFO:tasks.workunit.client.0.smithi164.stdout:3/146: rename d0/d1/f25 to d0/d1/d2/d19/f29 0 2024-02-10T00:00:30.368 INFO:tasks.workunit.client.1.smithi183.stdout:7/500: link d0/d2/d50/d5d/f55 d0/d2/d50/d5d/f8e 0 2024-02-10T00:00:30.369 INFO:tasks.workunit.client.0.smithi164.stdout:6/242: mkdir d0/d6/d12/d14/d4b 0 2024-02-10T00:00:30.369 INFO:tasks.workunit.client.0.smithi164.stdout:7/188: dwrite d3/d26/f36 [0,4194304] 0 2024-02-10T00:00:30.370 INFO:tasks.workunit.client.0.smithi164.stdout:6/243: write d0/d6/f32 [772543,40737] 0 2024-02-10T00:00:30.371 INFO:tasks.workunit.client.0.smithi164.stdout:7/189: write d3/f1d [309778,65856] 0 2024-02-10T00:00:30.371 INFO:tasks.workunit.client.0.smithi164.stdout:8/136: creat d2/f20 x:0 0 0 2024-02-10T00:00:30.371 INFO:tasks.workunit.client.0.smithi164.stdout:9/187: mknod d6/d1c/d24/c39 0 2024-02-10T00:00:30.372 INFO:tasks.workunit.client.1.smithi183.stdout:6/430: symlink d2/d1a/d25/d3c/d31/d38/d3f/l80 0 2024-02-10T00:00:30.372 INFO:tasks.workunit.client.0.smithi164.stdout:4/164: mknod d2/d19/d16/d31/c3b 0 2024-02-10T00:00:30.373 INFO:tasks.workunit.client.1.smithi183.stdout:3/452: fdatasync d7/db/d2a/d2d/f50 0 2024-02-10T00:00:30.373 INFO:tasks.workunit.client.1.smithi183.stdout:5/610: dwrite d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/fb3 [4194304,4194304] 0 2024-02-10T00:00:30.374 INFO:tasks.workunit.client.0.smithi164.stdout:8/137: read d2/fa [1090305,99334] 0 2024-02-10T00:00:30.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/117: unlink d1/d1a/f29 0 2024-02-10T00:00:30.375 INFO:tasks.workunit.client.1.smithi183.stdout:3/453: readlink d7/db/d2a/d33/l34 0 2024-02-10T00:00:30.375 INFO:tasks.workunit.client.1.smithi183.stdout:4/515: creat de/d14/d27/d2e/f9f x:0 0 0 2024-02-10T00:00:30.375 INFO:tasks.workunit.client.1.smithi183.stdout:4/516: readlink l8 0 2024-02-10T00:00:30.376 INFO:tasks.workunit.client.0.smithi164.stdout:1/118: readlink d1/l10 0 2024-02-10T00:00:30.376 INFO:tasks.workunit.client.1.smithi183.stdout:5/611: write d4/d23/d4a/fbb [890561,106053] 0 2024-02-10T00:00:30.376 INFO:tasks.workunit.client.0.smithi164.stdout:7/190: dread d3/d26/f36 [0,4194304] 0 2024-02-10T00:00:30.376 INFO:tasks.workunit.client.0.smithi164.stdout:4/165: dread d2/fb [0,4194304] 0 2024-02-10T00:00:30.377 INFO:tasks.workunit.client.0.smithi164.stdout:7/191: chown d3/f16 558 1 2024-02-10T00:00:30.377 INFO:tasks.workunit.client.0.smithi164.stdout:7/192: fsync d3/f38 0 2024-02-10T00:00:30.378 INFO:tasks.workunit.client.0.smithi164.stdout:4/166: write d2/d19/d16/d31/f36 [890083,22386] 0 2024-02-10T00:00:30.378 INFO:tasks.workunit.client.1.smithi183.stdout:1/492: mkdir d0/d3/d7/d36/d7c/db1 0 2024-02-10T00:00:30.378 INFO:tasks.workunit.client.1.smithi183.stdout:8/589: creat d0/d3f/db2/d24/fbb x:0 0 0 2024-02-10T00:00:30.379 INFO:tasks.workunit.client.1.smithi183.stdout:6/431: stat d2/c33 0 2024-02-10T00:00:30.381 INFO:tasks.workunit.client.0.smithi164.stdout:0/138: link f5 d6/d10/d18/d2d/f2f 0 2024-02-10T00:00:30.381 INFO:tasks.workunit.client.1.smithi183.stdout:4/517: dwrite de/d22/d92/d9c/f9e [0,4194304] 0 2024-02-10T00:00:30.382 INFO:tasks.workunit.client.0.smithi164.stdout:7/193: dwrite d3/d28/f3b [0,4194304] 0 2024-02-10T00:00:30.382 INFO:tasks.workunit.client.1.smithi183.stdout:3/454: rename d7/db/d2a/d4d/f71 to d7/db/d2a/d33/f87 0 2024-02-10T00:00:30.383 INFO:tasks.workunit.client.1.smithi183.stdout:2/604: truncate d2/da/d5b/fc2 308954 0 2024-02-10T00:00:30.385 INFO:tasks.workunit.client.1.smithi183.stdout:0/484: truncate d14/d1d/d2d/d31/f6d 398148 0 2024-02-10T00:00:30.386 INFO:tasks.workunit.client.0.smithi164.stdout:7/194: dwrite d3/d28/f3b [0,4194304] 0 2024-02-10T00:00:30.387 INFO:tasks.workunit.client.1.smithi183.stdout:4/518: rmdir de/d22 39 2024-02-10T00:00:30.387 INFO:tasks.workunit.client.0.smithi164.stdout:8/138: mkdir d2/d12/d21 0 2024-02-10T00:00:30.388 INFO:tasks.workunit.client.0.smithi164.stdout:1/119: creat d1/d1a/f2c x:0 0 0 2024-02-10T00:00:30.388 INFO:tasks.workunit.client.1.smithi183.stdout:3/455: dwrite d7/db/d2a/d2d/f2f [4194304,4194304] 0 2024-02-10T00:00:30.389 INFO:tasks.workunit.client.0.smithi164.stdout:7/195: dread d3/d26/f36 [0,4194304] 0 2024-02-10T00:00:30.389 INFO:tasks.workunit.client.1.smithi183.stdout:2/605: mknod d2/d2c/d2f/dbb/ccd 0 2024-02-10T00:00:30.390 INFO:tasks.workunit.client.1.smithi183.stdout:8/590: mknod d0/d3f/d94/cbc 0 2024-02-10T00:00:30.395 INFO:tasks.workunit.client.1.smithi183.stdout:1/493: rename d0/d3/d29/d1f/d86/la8 to d0/d3/da9/lb2 0 2024-02-10T00:00:30.395 INFO:tasks.workunit.client.1.smithi183.stdout:0/485: dread d14/d1d/d2d/f79 [0,4194304] 0 2024-02-10T00:00:30.395 INFO:tasks.workunit.client.0.smithi164.stdout:6/244: mknod d0/d6/d12/d45/c4c 0 2024-02-10T00:00:30.396 INFO:tasks.workunit.client.0.smithi164.stdout:6/245: stat d0/l15 0 2024-02-10T00:00:30.397 INFO:tasks.workunit.client.1.smithi183.stdout:1/494: write d0/d3/d29/f4c [2793107,117034] 0 2024-02-10T00:00:30.397 INFO:tasks.workunit.client.0.smithi164.stdout:9/188: mknod d6/d1c/c3a 0 2024-02-10T00:00:30.398 INFO:tasks.workunit.client.1.smithi183.stdout:4/519: dwrite de/d19/d20/f26 [4194304,4194304] 0 2024-02-10T00:00:30.399 INFO:tasks.workunit.client.1.smithi183.stdout:2/606: symlink d2/da/d5b/lce 0 2024-02-10T00:00:30.399 INFO:tasks.workunit.client.1.smithi183.stdout:2/607: chown d2/d2c/dab 26 1 2024-02-10T00:00:30.399 INFO:tasks.workunit.client.0.smithi164.stdout:0/139: mknod d6/d7/d14/c30 0 2024-02-10T00:00:30.400 INFO:tasks.workunit.client.1.smithi183.stdout:8/591: rename d0/d31/l34 to d0/d4e/da6/lbd 0 2024-02-10T00:00:30.401 INFO:tasks.workunit.client.0.smithi164.stdout:8/139: creat d2/f22 x:0 0 0 2024-02-10T00:00:30.402 INFO:tasks.workunit.client.1.smithi183.stdout:3/456: fdatasync d7/db/f13 0 2024-02-10T00:00:30.403 INFO:tasks.workunit.client.0.smithi164.stdout:7/196: unlink d3/d5/l25 0 2024-02-10T00:00:30.405 INFO:tasks.workunit.client.0.smithi164.stdout:6/246: mkdir d0/d6/d4d 0 2024-02-10T00:00:30.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/199: sync 2024-02-10T00:00:30.407 INFO:tasks.workunit.client.0.smithi164.stdout:9/189: mkdir d6/de/d3b 0 2024-02-10T00:00:30.407 INFO:tasks.workunit.client.0.smithi164.stdout:9/190: readlink d6/l27 0 2024-02-10T00:00:30.410 INFO:tasks.workunit.client.0.smithi164.stdout:0/140: rename f5 to d6/d10/d18/f31 0 2024-02-10T00:00:30.412 INFO:tasks.workunit.client.0.smithi164.stdout:1/120: truncate d1/f6 507344 0 2024-02-10T00:00:30.413 INFO:tasks.workunit.client.0.smithi164.stdout:4/167: link d2/d2f/c22 d2/d2f/d37/c3c 0 2024-02-10T00:00:30.414 INFO:tasks.workunit.client.0.smithi164.stdout:6/247: creat d0/d6/d12/f4e x:0 0 0 2024-02-10T00:00:30.415 INFO:tasks.workunit.client.0.smithi164.stdout:0/141: dwrite d6/d10/d18/d2d/f2e [0,4194304] 0 2024-02-10T00:00:30.415 INFO:tasks.workunit.client.0.smithi164.stdout:0/142: chown d6/d7 2808931 1 2024-02-10T00:00:30.416 INFO:tasks.workunit.client.0.smithi164.stdout:0/143: dread - d6/f2a zero size 2024-02-10T00:00:30.416 INFO:tasks.workunit.client.0.smithi164.stdout:8/140: symlink d2/d12/d21/l23 0 2024-02-10T00:00:30.419 INFO:tasks.workunit.client.0.smithi164.stdout:7/197: rename d3/c21 to d3/d28/c46 0 2024-02-10T00:00:30.419 INFO:tasks.workunit.client.0.smithi164.stdout:7/198: readlink d3/d5/l1c 0 2024-02-10T00:00:30.425 INFO:tasks.workunit.client.0.smithi164.stdout:4/168: mkdir d2/d2f/d28/d3d 0 2024-02-10T00:00:30.425 INFO:tasks.workunit.client.0.smithi164.stdout:0/144: dread d6/d7/f17 [0,4194304] 0 2024-02-10T00:00:30.425 INFO:tasks.workunit.client.0.smithi164.stdout:4/169: dread - d2/d19/d16/f3a zero size 2024-02-10T00:00:30.426 INFO:tasks.workunit.client.0.smithi164.stdout:1/121: rename d1/da to d1/d1a/d2d 0 2024-02-10T00:00:30.427 INFO:tasks.workunit.client.0.smithi164.stdout:3/147: truncate d0/d1/f11 1570198 0 2024-02-10T00:00:30.435 INFO:tasks.workunit.client.0.smithi164.stdout:1/122: write d1/d1a/d2d/fb [4875684,82437] 0 2024-02-10T00:00:30.436 INFO:tasks.workunit.client.0.smithi164.stdout:6/248: rename d0/d2b/f33 to d0/d6/f4f 0 2024-02-10T00:00:30.436 INFO:tasks.workunit.client.0.smithi164.stdout:1/123: fsync d1/d1a/f22 0 2024-02-10T00:00:30.437 INFO:tasks.workunit.client.0.smithi164.stdout:6/249: fdatasync d0/f17 0 2024-02-10T00:00:30.437 INFO:tasks.workunit.client.0.smithi164.stdout:4/170: dread d2/fb [0,4194304] 0 2024-02-10T00:00:30.439 INFO:tasks.workunit.client.0.smithi164.stdout:3/148: symlink d0/d1/dd/d1e/l2a 0 2024-02-10T00:00:30.439 INFO:tasks.workunit.client.0.smithi164.stdout:1/124: readlink d1/d1a/l26 0 2024-02-10T00:00:30.439 INFO:tasks.workunit.client.0.smithi164.stdout:6/250: stat d0/l15 0 2024-02-10T00:00:30.440 INFO:tasks.workunit.client.0.smithi164.stdout:1/125: stat d1/d13 0 2024-02-10T00:00:30.440 INFO:tasks.workunit.client.0.smithi164.stdout:4/171: creat d2/d2f/d28/f3e x:0 0 0 2024-02-10T00:00:30.444 INFO:tasks.workunit.client.0.smithi164.stdout:3/149: unlink d0/d1/dd/d1e/l2a 0 2024-02-10T00:00:30.444 INFO:tasks.workunit.client.0.smithi164.stdout:5/179: dread d7/f19 [0,4194304] 0 2024-02-10T00:00:30.450 INFO:tasks.workunit.client.0.smithi164.stdout:2/200: dread d3/f11 [0,4194304] 0 2024-02-10T00:00:30.451 INFO:tasks.workunit.client.0.smithi164.stdout:1/126: creat d1/d13/d2b/f2e x:0 0 0 2024-02-10T00:00:30.451 INFO:tasks.workunit.client.0.smithi164.stdout:2/201: fsync d3/d32/d4e/d27/f2c 0 2024-02-10T00:00:30.451 INFO:tasks.workunit.client.0.smithi164.stdout:2/202: dread - d3/f4a zero size 2024-02-10T00:00:30.452 INFO:tasks.workunit.client.0.smithi164.stdout:9/191: chown d6/de/d22/f26 114 1 2024-02-10T00:00:30.453 INFO:tasks.workunit.client.0.smithi164.stdout:2/203: read d3/f18 [1341584,115638] 0 2024-02-10T00:00:30.453 INFO:tasks.workunit.client.0.smithi164.stdout:0/145: rmdir d6/d10 39 2024-02-10T00:00:30.456 INFO:tasks.workunit.client.0.smithi164.stdout:1/127: dwrite d1/d13/f14 [0,4194304] 0 2024-02-10T00:00:30.457 INFO:tasks.workunit.client.1.smithi183.stdout:6/432: dread d2/f19 [0,4194304] 0 2024-02-10T00:00:30.460 INFO:tasks.workunit.client.0.smithi164.stdout:1/128: dwrite d1/d1a/d2d/fb [4194304,4194304] 0 2024-02-10T00:00:30.461 INFO:tasks.workunit.client.1.smithi183.stdout:6/433: fdatasync d2/d1a/d3a/d45/d53/f7c 0 2024-02-10T00:00:30.462 INFO:tasks.workunit.client.1.smithi183.stdout:3/457: dwrite d7/db/d2a/d33/d59/f86 [0,4194304] 0 2024-02-10T00:00:30.463 INFO:tasks.workunit.client.0.smithi164.stdout:6/251: write d0/f21 [470159,26322] 0 2024-02-10T00:00:30.465 INFO:tasks.workunit.client.0.smithi164.stdout:6/252: dread d0/fb [0,4194304] 0 2024-02-10T00:00:30.465 INFO:tasks.workunit.client.0.smithi164.stdout:4/172: chown d2/d2f/c22 253382850 1 2024-02-10T00:00:30.465 INFO:tasks.workunit.client.1.smithi183.stdout:9/526: dwrite d0/d3/d14/d3c/f6f [0,4194304] 0 2024-02-10T00:00:30.466 INFO:tasks.workunit.client.1.smithi183.stdout:6/434: chown d2/d1a/d25/d3c/d31/d38/d3f 24 1 2024-02-10T00:00:30.466 INFO:tasks.workunit.client.0.smithi164.stdout:6/253: chown d0/d2b/c48 148883706 1 2024-02-10T00:00:30.466 INFO:tasks.workunit.client.0.smithi164.stdout:6/254: chown d0/d2b/c30 321194683 1 2024-02-10T00:00:30.466 INFO:tasks.workunit.client.0.smithi164.stdout:5/180: mknod d7/d17/d21/d24/c39 0 2024-02-10T00:00:30.467 INFO:tasks.workunit.client.0.smithi164.stdout:5/181: dread - d7/d17/d21/d23/f2d zero size 2024-02-10T00:00:30.467 INFO:tasks.workunit.client.1.smithi183.stdout:0/486: dread d14/d1d/d59/d71/d22/f44 [0,4194304] 0 2024-02-10T00:00:30.468 INFO:tasks.workunit.client.0.smithi164.stdout:5/182: write d7/d17/d21/f29 [852553,14048] 0 2024-02-10T00:00:30.468 INFO:tasks.workunit.client.0.smithi164.stdout:9/192: creat d6/de/d2b/f3c x:0 0 0 2024-02-10T00:00:30.468 INFO:tasks.workunit.client.1.smithi183.stdout:2/608: link d2/da/d20/d21/d43/d58/d74/d83/dc4/fc5 d2/da/d20/d21/fcf 0 2024-02-10T00:00:30.469 INFO:tasks.workunit.client.0.smithi164.stdout:0/146: rmdir d6/d7/d14 39 2024-02-10T00:00:30.469 INFO:tasks.workunit.client.1.smithi183.stdout:7/501: sync 2024-02-10T00:00:30.470 INFO:tasks.workunit.client.1.smithi183.stdout:3/458: dread - d7/db/d2a/f4a zero size 2024-02-10T00:00:30.471 INFO:tasks.workunit.client.0.smithi164.stdout:2/204: unlink d3/d26/l29 0 2024-02-10T00:00:30.472 INFO:tasks.workunit.client.0.smithi164.stdout:2/205: write d3/f1f [781288,8552] 0 2024-02-10T00:00:30.472 INFO:tasks.workunit.client.1.smithi183.stdout:8/592: dwrite d0/d23/f95 [0,4194304] 0 2024-02-10T00:00:30.472 INFO:tasks.workunit.client.1.smithi183.stdout:3/459: chown d7/f20 9321405 1 2024-02-10T00:00:30.472 INFO:tasks.workunit.client.0.smithi164.stdout:1/129: mkdir d1/d13/d2f 0 2024-02-10T00:00:30.473 INFO:tasks.workunit.client.1.smithi183.stdout:5/612: dread d4/d23/d3e/d80/da1/d9e/f7c [0,4194304] 0 2024-02-10T00:00:30.476 INFO:tasks.workunit.client.0.smithi164.stdout:4/173: rmdir d2/d2f/d28 39 2024-02-10T00:00:30.477 INFO:tasks.workunit.client.1.smithi183.stdout:2/609: rmdir d2/d2c/d2f/d72 39 2024-02-10T00:00:30.477 INFO:tasks.workunit.client.1.smithi183.stdout:4/520: truncate de/d19/d1c/d61/f91 667295 0 2024-02-10T00:00:30.478 INFO:tasks.workunit.client.0.smithi164.stdout:0/147: dread d6/d7/f17 [0,4194304] 0 2024-02-10T00:00:30.478 INFO:tasks.workunit.client.1.smithi183.stdout:5/613: dwrite d4/d23/d3e/d80/da1/f60 [0,4194304] 0 2024-02-10T00:00:30.479 INFO:tasks.workunit.client.0.smithi164.stdout:0/148: dread - d6/d7/f24 zero size 2024-02-10T00:00:30.479 INFO:tasks.workunit.client.1.smithi183.stdout:0/487: mkdir d14/d1d/d59/d71/db4 0 2024-02-10T00:00:30.479 INFO:tasks.workunit.client.1.smithi183.stdout:7/502: stat d0/d2/d4/l74 0 2024-02-10T00:00:30.481 INFO:tasks.workunit.client.1.smithi183.stdout:5/614: chown d4/d23/d3e/d80/da1/d9e/d89/f90 7788505 1 2024-02-10T00:00:30.482 INFO:tasks.workunit.client.1.smithi183.stdout:8/593: creat d0/d10/d9e/fbe x:0 0 0 2024-02-10T00:00:30.484 INFO:tasks.workunit.client.1.smithi183.stdout:5/615: write d4/dd/f25 [1637737,17487] 0 2024-02-10T00:00:30.485 INFO:tasks.workunit.client.1.smithi183.stdout:5/616: readlink d4/l3a 0 2024-02-10T00:00:30.485 INFO:tasks.workunit.client.0.smithi164.stdout:0/149: dread d6/d10/d18/f31 [0,4194304] 0 2024-02-10T00:00:30.486 INFO:tasks.workunit.client.1.smithi183.stdout:4/521: dwrite de/d14/d1d/d7b/f8f [0,4194304] 0 2024-02-10T00:00:30.488 INFO:tasks.workunit.client.0.smithi164.stdout:2/206: fdatasync d3/f44 0 2024-02-10T00:00:30.489 INFO:tasks.workunit.client.0.smithi164.stdout:8/141: sync 2024-02-10T00:00:30.489 INFO:tasks.workunit.client.1.smithi183.stdout:3/460: dwrite d7/db/d2a/d33/f87 [0,4194304] 0 2024-02-10T00:00:30.489 INFO:tasks.workunit.client.1.smithi183.stdout:7/503: mknod d0/d11/d2f/c8f 0 2024-02-10T00:00:30.490 INFO:tasks.workunit.client.1.smithi183.stdout:7/504: stat d0/d2/d50/d5d/f8e 0 2024-02-10T00:00:30.490 INFO:tasks.workunit.client.0.smithi164.stdout:0/150: mknod d6/d10/d18/d2d/c32 0 2024-02-10T00:00:30.492 INFO:tasks.workunit.client.0.smithi164.stdout:8/142: dwrite d2/f4 [8388608,4194304] 0 2024-02-10T00:00:30.493 INFO:tasks.workunit.client.1.smithi183.stdout:3/461: dwrite d7/db/d2a/d33/f56 [0,4194304] 0 2024-02-10T00:00:30.494 INFO:tasks.workunit.client.1.smithi183.stdout:6/435: getdents d2/d1a/d3a 0 2024-02-10T00:00:30.495 INFO:tasks.workunit.client.0.smithi164.stdout:4/174: rename d2/d19/d16/f30 to d2/d19/d16/f3f 0 2024-02-10T00:00:30.495 INFO:tasks.workunit.client.0.smithi164.stdout:2/207: fdatasync f0 0 2024-02-10T00:00:30.495 INFO:tasks.workunit.client.1.smithi183.stdout:1/495: sync 2024-02-10T00:00:30.496 INFO:tasks.workunit.client.1.smithi183.stdout:0/488: symlink d14/d1d/d59/d71/d22/lb5 0 2024-02-10T00:00:30.496 INFO:tasks.workunit.client.1.smithi183.stdout:2/610: getdents d2/da/d77/dc7/db5/d35/db1 0 2024-02-10T00:00:30.496 INFO:tasks.workunit.client.0.smithi164.stdout:0/151: stat d6/d7/d14/f20 0 2024-02-10T00:00:30.497 INFO:tasks.workunit.client.0.smithi164.stdout:0/152: fdatasync d6/d7/d14/f20 0 2024-02-10T00:00:30.497 INFO:tasks.workunit.client.1.smithi183.stdout:2/611: fdatasync d2/da/d20/d21/d43/f45 0 2024-02-10T00:00:30.498 INFO:tasks.workunit.client.0.smithi164.stdout:8/143: creat d2/d12/f24 x:0 0 0 2024-02-10T00:00:30.498 INFO:tasks.workunit.client.0.smithi164.stdout:8/144: read - d2/f13 zero size 2024-02-10T00:00:30.503 INFO:tasks.workunit.client.1.smithi183.stdout:2/612: dwrite d2/f4a [0,4194304] 0 2024-02-10T00:00:30.503 INFO:tasks.workunit.client.1.smithi183.stdout:4/522: rename de/d14/d27/d2e/l49 to de/d22/d92/la0 0 2024-02-10T00:00:30.503 INFO:tasks.workunit.client.1.smithi183.stdout:7/505: dwrite d0/f53 [0,4194304] 0 2024-02-10T00:00:30.504 INFO:tasks.workunit.client.1.smithi183.stdout:6/436: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/d81 0 2024-02-10T00:00:30.504 INFO:tasks.workunit.client.0.smithi164.stdout:8/145: creat d2/f25 x:0 0 0 2024-02-10T00:00:30.504 INFO:tasks.workunit.client.0.smithi164.stdout:2/208: truncate d3/f16 1104023 0 2024-02-10T00:00:30.505 INFO:tasks.workunit.client.0.smithi164.stdout:8/146: read d2/d12/f17 [708520,88346] 0 2024-02-10T00:00:30.505 INFO:tasks.workunit.client.1.smithi183.stdout:2/613: write d2/da/f25 [1126821,98334] 0 2024-02-10T00:00:30.509 INFO:tasks.workunit.client.0.smithi164.stdout:2/209: mknod d3/c4f 0 2024-02-10T00:00:30.509 INFO:tasks.workunit.client.1.smithi183.stdout:2/614: dwrite d2/d2c/d2f/f3b [0,4194304] 0 2024-02-10T00:00:30.510 INFO:tasks.workunit.client.1.smithi183.stdout:2/615: chown d2/d3d/fa0 21184761 1 2024-02-10T00:00:30.511 INFO:tasks.workunit.client.0.smithi164.stdout:8/147: readlink d2/l1f 0 2024-02-10T00:00:30.512 INFO:tasks.workunit.client.1.smithi183.stdout:4/523: stat de/d14/l89 0 2024-02-10T00:00:30.513 INFO:tasks.workunit.client.1.smithi183.stdout:4/524: write de/f1f [1871695,38775] 0 2024-02-10T00:00:30.513 INFO:tasks.workunit.client.0.smithi164.stdout:2/210: dwrite d3/d32/d4e/d27/d2e/f3a [4194304,4194304] 0 2024-02-10T00:00:30.514 INFO:tasks.workunit.client.1.smithi183.stdout:0/489: mknod d14/d1d/d59/d3c/cb6 0 2024-02-10T00:00:30.514 INFO:tasks.workunit.client.0.smithi164.stdout:8/148: symlink d2/l26 0 2024-02-10T00:00:30.516 INFO:tasks.workunit.client.1.smithi183.stdout:6/437: mknod d2/d32/c82 0 2024-02-10T00:00:30.518 INFO:tasks.workunit.client.0.smithi164.stdout:2/211: creat d3/f50 x:0 0 0 2024-02-10T00:00:30.519 INFO:tasks.workunit.client.1.smithi183.stdout:8/594: getdents d0/d23 0 2024-02-10T00:00:30.520 INFO:tasks.workunit.client.1.smithi183.stdout:3/462: creat d7/db/d2a/f88 x:0 0 0 2024-02-10T00:00:30.521 INFO:tasks.workunit.client.0.smithi164.stdout:8/149: creat d2/f27 x:0 0 0 2024-02-10T00:00:30.521 INFO:tasks.workunit.client.0.smithi164.stdout:7/199: sync 2024-02-10T00:00:30.522 INFO:tasks.workunit.client.1.smithi183.stdout:5/617: link d4/dd/d31/d73/fb7 d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/fc3 0 2024-02-10T00:00:30.523 INFO:tasks.workunit.client.0.smithi164.stdout:2/212: mkdir d3/d24/d51 0 2024-02-10T00:00:30.524 INFO:tasks.workunit.client.1.smithi183.stdout:2/616: mknod d2/da/d20/d21/d36/cd0 0 2024-02-10T00:00:30.524 INFO:tasks.workunit.client.0.smithi164.stdout:7/200: dread d3/f2d [0,4194304] 0 2024-02-10T00:00:30.527 INFO:tasks.workunit.client.1.smithi183.stdout:0/490: chown d14/d1d/d59/d71/f27 55 1 2024-02-10T00:00:30.529 INFO:tasks.workunit.client.1.smithi183.stdout:2/617: dwrite d2/d2c/d2f/d60/d8d/d9c/da7/fbc [0,4194304] 0 2024-02-10T00:00:30.530 INFO:tasks.workunit.client.0.smithi164.stdout:2/213: rename f0 to d3/d24/f52 0 2024-02-10T00:00:30.531 INFO:tasks.workunit.client.1.smithi183.stdout:2/618: write d2/da/fb [1334509,99768] 0 2024-02-10T00:00:30.531 INFO:tasks.workunit.client.1.smithi183.stdout:3/463: unlink d7/db/d2a/d2d/d51/f7b 0 2024-02-10T00:00:30.531 INFO:tasks.workunit.client.0.smithi164.stdout:2/214: readlink d3/d32/d4e/d27/d2e/l42 0 2024-02-10T00:00:30.531 INFO:tasks.workunit.client.0.smithi164.stdout:7/201: creat d3/d11/d39/f47 x:0 0 0 2024-02-10T00:00:30.531 INFO:tasks.workunit.client.0.smithi164.stdout:2/215: readlink d3/d32/l33 0 2024-02-10T00:00:30.532 INFO:tasks.workunit.client.0.smithi164.stdout:7/202: fdatasync d3/d11/f18 0 2024-02-10T00:00:30.532 INFO:tasks.workunit.client.0.smithi164.stdout:2/216: readlink d3/d32/l33 0 2024-02-10T00:00:30.532 INFO:tasks.workunit.client.0.smithi164.stdout:2/217: write f2 [4107772,104102] 0 2024-02-10T00:00:30.534 INFO:tasks.workunit.client.1.smithi183.stdout:0/491: creat d14/d43/fb7 x:0 0 0 2024-02-10T00:00:30.536 INFO:tasks.workunit.client.0.smithi164.stdout:2/218: symlink d3/d26/l53 0 2024-02-10T00:00:30.536 INFO:tasks.workunit.client.0.smithi164.stdout:7/203: mkdir d3/d11/d39/d44/d48 0 2024-02-10T00:00:30.536 INFO:tasks.workunit.client.1.smithi183.stdout:5/618: mkdir d4/d23/dc4 0 2024-02-10T00:00:30.537 INFO:tasks.workunit.client.1.smithi183.stdout:2/619: mkdir d2/d2c/d2f/d60/d8d/d9c/dd1 0 2024-02-10T00:00:30.538 INFO:tasks.workunit.client.0.smithi164.stdout:2/219: mkdir d3/d32/d4e/d27/d2e/d36/d54 0 2024-02-10T00:00:30.539 INFO:tasks.workunit.client.1.smithi183.stdout:0/492: dwrite d14/d1d/d59/d71/d22/f35 [0,4194304] 0 2024-02-10T00:00:30.539 INFO:tasks.workunit.client.1.smithi183.stdout:7/506: creat d0/d2/d3/f90 x:0 0 0 2024-02-10T00:00:30.540 INFO:tasks.workunit.client.0.smithi164.stdout:7/204: dread d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:30.540 INFO:tasks.workunit.client.0.smithi164.stdout:7/205: readlink d3/d5/l1c 0 2024-02-10T00:00:30.541 INFO:tasks.workunit.client.1.smithi183.stdout:5/619: mknod d4/dd/d31/cc5 0 2024-02-10T00:00:30.542 INFO:tasks.workunit.client.0.smithi164.stdout:2/220: link d3/d32/d4e/d27/f2c d3/d32/d4e/d27/d2e/d36/d54/f55 0 2024-02-10T00:00:30.542 INFO:tasks.workunit.client.1.smithi183.stdout:5/620: chown d4/d23/d3e/d80/d96/cbf 28572 1 2024-02-10T00:00:30.543 INFO:tasks.workunit.client.1.smithi183.stdout:2/620: creat d2/da/d77/dc7/fd2 x:0 0 0 2024-02-10T00:00:30.545 INFO:tasks.workunit.client.1.smithi183.stdout:6/438: rename d2/f24 to d2/d1a/d3a/d45/f83 0 2024-02-10T00:00:30.545 INFO:tasks.workunit.client.0.smithi164.stdout:2/221: mkdir d3/d26/d56 0 2024-02-10T00:00:30.546 INFO:tasks.workunit.client.0.smithi164.stdout:2/222: chown d3/f4a 7729 1 2024-02-10T00:00:30.546 INFO:tasks.workunit.client.0.smithi164.stdout:2/223: fsync d3/f3e 0 2024-02-10T00:00:30.548 INFO:tasks.workunit.client.1.smithi183.stdout:2/621: dread d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:30.549 INFO:tasks.workunit.client.0.smithi164.stdout:2/224: unlink d3/d32/d4e/d27/f45 0 2024-02-10T00:00:30.549 INFO:tasks.workunit.client.1.smithi183.stdout:7/507: dwrite d0/d11/d35/f87 [4194304,4194304] 0 2024-02-10T00:00:30.550 INFO:tasks.workunit.client.1.smithi183.stdout:0/493: creat d14/d1d/d59/d3c/d72/fb8 x:0 0 0 2024-02-10T00:00:30.551 INFO:tasks.workunit.client.1.smithi183.stdout:3/464: getdents d7/db/d2a/d33/d59 0 2024-02-10T00:00:30.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/439: creat d2/d1a/d25/d3c/d31/d38/d6e/f84 x:0 0 0 2024-02-10T00:00:30.554 INFO:tasks.workunit.client.1.smithi183.stdout:0/494: symlink d14/d3e/d5f/daa/lb9 0 2024-02-10T00:00:30.555 INFO:tasks.workunit.client.0.smithi164.stdout:6/255: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:30.556 INFO:tasks.workunit.client.1.smithi183.stdout:3/465: truncate d7/f9 3058773 0 2024-02-10T00:00:30.562 INFO:tasks.workunit.client.1.smithi183.stdout:3/466: readlink d7/db/d2a/d33/l77 0 2024-02-10T00:00:30.562 INFO:tasks.workunit.client.1.smithi183.stdout:0/495: write d14/d1d/d59/d71/f56 [1557187,95709] 0 2024-02-10T00:00:30.562 INFO:tasks.workunit.client.1.smithi183.stdout:2/622: dwrite d2/f3e [0,4194304] 0 2024-02-10T00:00:30.562 INFO:tasks.workunit.client.1.smithi183.stdout:3/467: chown d7/db 1486083980 1 2024-02-10T00:00:30.565 INFO:tasks.workunit.client.1.smithi183.stdout:0/496: rename fb to d14/d1d/fba 0 2024-02-10T00:00:30.566 INFO:tasks.workunit.client.1.smithi183.stdout:2/623: chown d2/da/d19/d31/d55/ca2 78486 1 2024-02-10T00:00:30.568 INFO:tasks.workunit.client.1.smithi183.stdout:3/468: mknod d7/db/d2a/d33/d59/d52/c89 0 2024-02-10T00:00:30.569 INFO:tasks.workunit.client.1.smithi183.stdout:3/469: write d7/db/d2a/d1c/f1e [511151,82900] 0 2024-02-10T00:00:30.570 INFO:tasks.workunit.client.1.smithi183.stdout:0/497: dread d14/d1d/d59/d71/d22/f35 [0,4194304] 0 2024-02-10T00:00:30.572 INFO:tasks.workunit.client.1.smithi183.stdout:2/624: unlink d2/f13 0 2024-02-10T00:00:30.575 INFO:tasks.workunit.client.1.smithi183.stdout:0/498: fsync d14/d1d/d59/d71/f7f 0 2024-02-10T00:00:30.575 INFO:tasks.workunit.client.1.smithi183.stdout:2/625: write d2/da/d19/d31/f47 [150542,38109] 0 2024-02-10T00:00:30.577 INFO:tasks.workunit.client.1.smithi183.stdout:0/499: mknod d14/d1d/d59/cbb 0 2024-02-10T00:00:30.578 INFO:tasks.workunit.client.1.smithi183.stdout:2/626: mknod d2/d2c/cd3 0 2024-02-10T00:00:30.578 INFO:tasks.workunit.client.1.smithi183.stdout:0/500: write d14/d1d/d2d/d31/d6c/fae [153827,73111] 0 2024-02-10T00:00:30.580 INFO:tasks.workunit.client.0.smithi164.stdout:6/256: dread d0/d6/d12/d14/f24 [0,4194304] 0 2024-02-10T00:00:30.582 INFO:tasks.workunit.client.1.smithi183.stdout:0/501: creat d14/d1d/d2d/d31/d68/fbc x:0 0 0 2024-02-10T00:00:30.583 INFO:tasks.workunit.client.1.smithi183.stdout:0/502: dread - d14/d1d/d59/d71/d22/fac zero size 2024-02-10T00:00:30.584 INFO:tasks.workunit.client.1.smithi183.stdout:2/627: rename d2/da/d19/d31/d55 to d2/d2c/d2f/d60/d8d/d9c/da7/dd4 0 2024-02-10T00:00:30.584 INFO:tasks.workunit.client.1.smithi183.stdout:8/595: dread d0/d27/d75/d5b/f99 [0,4194304] 0 2024-02-10T00:00:30.584 INFO:tasks.workunit.client.0.smithi164.stdout:6/257: dwrite d0/fc [4194304,4194304] 0 2024-02-10T00:00:30.585 INFO:tasks.workunit.client.1.smithi183.stdout:8/596: write d0/d10/f19 [2167443,11589] 0 2024-02-10T00:00:30.586 INFO:tasks.workunit.client.1.smithi183.stdout:0/503: symlink d14/d1d/d96/da0/lbd 0 2024-02-10T00:00:30.588 INFO:tasks.workunit.client.1.smithi183.stdout:2/628: write d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d [3737253,76076] 0 2024-02-10T00:00:30.589 INFO:tasks.workunit.client.1.smithi183.stdout:0/504: symlink d14/d1d/d59/d71/db4/lbe 0 2024-02-10T00:00:30.591 INFO:tasks.workunit.client.1.smithi183.stdout:3/470: dread d7/f20 [0,4194304] 0 2024-02-10T00:00:30.591 INFO:tasks.workunit.client.0.smithi164.stdout:6/258: getdents d0/d2b/d3a/d3d/d42 0 2024-02-10T00:00:30.592 INFO:tasks.workunit.client.1.smithi183.stdout:3/471: readlink d7/db/d2a/d2d/d51/l73 0 2024-02-10T00:00:30.592 INFO:tasks.workunit.client.1.smithi183.stdout:2/629: dwrite d2/da/d20/d21/f29 [0,4194304] 0 2024-02-10T00:00:30.593 INFO:tasks.workunit.client.0.smithi164.stdout:6/259: rmdir d0/d6/d12/d14 39 2024-02-10T00:00:30.593 INFO:tasks.workunit.client.1.smithi183.stdout:2/630: dread - d2/d2c/d2f/d60/fb9 zero size 2024-02-10T00:00:30.597 INFO:tasks.workunit.client.1.smithi183.stdout:2/631: mknod d2/da/d77/dc7/db5/d35/dae/cd5 0 2024-02-10T00:00:30.598 INFO:tasks.workunit.client.1.smithi183.stdout:2/632: readlink d2/da/d77/dc7/laf 0 2024-02-10T00:00:30.599 INFO:tasks.workunit.client.1.smithi183.stdout:2/633: fdatasync d2/da/f17 0 2024-02-10T00:00:30.601 INFO:tasks.workunit.client.1.smithi183.stdout:2/634: creat d2/da/d20/d21/d43/d58/d8e/fd6 x:0 0 0 2024-02-10T00:00:30.610 INFO:tasks.workunit.client.1.smithi183.stdout:7/508: sync 2024-02-10T00:00:30.611 INFO:tasks.workunit.client.1.smithi183.stdout:7/509: dread - d0/d11/d2f/d64/d6b/f75 zero size 2024-02-10T00:00:30.612 INFO:tasks.workunit.client.0.smithi164.stdout:9/193: getdents d6/de/d2b 0 2024-02-10T00:00:30.612 INFO:tasks.workunit.client.0.smithi164.stdout:9/194: chown d6/de/d2b/f38 6449689 1 2024-02-10T00:00:30.612 INFO:tasks.workunit.client.0.smithi164.stdout:5/183: write d7/f1d [2721385,59554] 0 2024-02-10T00:00:30.614 INFO:tasks.workunit.client.0.smithi164.stdout:1/130: truncate d1/f1b 1083813 0 2024-02-10T00:00:30.615 INFO:tasks.workunit.client.1.smithi183.stdout:7/510: link d0/f53 d0/d11/d88/f91 0 2024-02-10T00:00:30.616 INFO:tasks.workunit.client.1.smithi183.stdout:7/511: fsync d0/d2/f2b 0 2024-02-10T00:00:30.617 INFO:tasks.workunit.client.0.smithi164.stdout:9/195: dwrite d6/f35 [0,4194304] 0 2024-02-10T00:00:30.618 INFO:tasks.workunit.client.0.smithi164.stdout:9/196: dread - d6/de/d2b/f37 zero size 2024-02-10T00:00:30.621 INFO:tasks.workunit.client.0.smithi164.stdout:9/197: creat d6/de/f3d x:0 0 0 2024-02-10T00:00:30.625 INFO:tasks.workunit.client.1.smithi183.stdout:9/527: truncate d0/d3/d14/f82 2789565 0 2024-02-10T00:00:30.626 INFO:tasks.workunit.client.1.smithi183.stdout:9/528: write d0/d10/f8d [469990,129576] 0 2024-02-10T00:00:30.630 INFO:tasks.workunit.client.0.smithi164.stdout:9/198: creat d6/f3e x:0 0 0 2024-02-10T00:00:30.631 INFO:tasks.workunit.client.0.smithi164.stdout:1/131: fsync d1/f11 0 2024-02-10T00:00:30.634 INFO:tasks.workunit.client.0.smithi164.stdout:1/132: creat d1/d1a/d2d/d18/f30 x:0 0 0 2024-02-10T00:00:30.634 INFO:tasks.workunit.client.0.smithi164.stdout:9/199: read d6/de/f11 [2425884,67180] 0 2024-02-10T00:00:30.636 INFO:tasks.workunit.client.0.smithi164.stdout:1/133: creat d1/d13/d2f/f31 x:0 0 0 2024-02-10T00:00:30.637 INFO:tasks.workunit.client.0.smithi164.stdout:1/134: chown d1/d13/d1f 319603 1 2024-02-10T00:00:30.637 INFO:tasks.workunit.client.1.smithi183.stdout:8/597: sync 2024-02-10T00:00:30.638 INFO:tasks.workunit.client.0.smithi164.stdout:6/260: dread d0/d6/d12/f2e [0,4194304] 0 2024-02-10T00:00:30.639 INFO:tasks.workunit.client.1.smithi183.stdout:8/598: mknod d0/d10/cbf 0 2024-02-10T00:00:30.641 INFO:tasks.workunit.client.0.smithi164.stdout:1/135: dwrite d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:30.643 INFO:tasks.workunit.client.0.smithi164.stdout:0/153: dread d6/f15 [0,4194304] 0 2024-02-10T00:00:30.643 INFO:tasks.workunit.client.0.smithi164.stdout:1/136: write d1/f9 [7608435,14413] 0 2024-02-10T00:00:30.643 INFO:tasks.workunit.client.0.smithi164.stdout:4/175: truncate d2/d19/f15 316591 0 2024-02-10T00:00:30.644 INFO:tasks.workunit.client.1.smithi183.stdout:8/599: getdents d0/d3f/db2 0 2024-02-10T00:00:30.644 INFO:tasks.workunit.client.0.smithi164.stdout:1/137: read d1/d13/f19 [1806974,93040] 0 2024-02-10T00:00:30.644 INFO:tasks.workunit.client.0.smithi164.stdout:4/176: readlink d2/d2f/d37/l39 0 2024-02-10T00:00:30.645 INFO:tasks.workunit.client.0.smithi164.stdout:1/138: readlink d1/d1a/d2d/d18/l1e 0 2024-02-10T00:00:30.645 INFO:tasks.workunit.client.0.smithi164.stdout:6/261: stat d0/d6/d12/d14/c2c 0 2024-02-10T00:00:30.646 INFO:tasks.workunit.client.0.smithi164.stdout:8/150: rmdir d2 39 2024-02-10T00:00:30.647 INFO:tasks.workunit.client.1.smithi183.stdout:8/600: dwrite d0/d27/d36/f80 [0,4194304] 0 2024-02-10T00:00:30.651 INFO:tasks.workunit.client.0.smithi164.stdout:9/200: getdents d6/de/d22 0 2024-02-10T00:00:30.651 INFO:tasks.workunit.client.0.smithi164.stdout:9/201: dread d6/f9 [0,4194304] 0 2024-02-10T00:00:30.652 INFO:tasks.workunit.client.1.smithi183.stdout:1/496: truncate d0/d3/d67/d7b/f98 1238131 0 2024-02-10T00:00:30.654 INFO:tasks.workunit.client.0.smithi164.stdout:6/262: creat d0/d6/d12/d14/f50 x:0 0 0 2024-02-10T00:00:30.655 INFO:tasks.workunit.client.1.smithi183.stdout:1/497: symlink d0/d3/d7/d36/lb3 0 2024-02-10T00:00:30.657 INFO:tasks.workunit.client.0.smithi164.stdout:5/184: fdatasync d7/f1d 0 2024-02-10T00:00:30.660 INFO:tasks.workunit.client.0.smithi164.stdout:9/202: unlink d6/f18 0 2024-02-10T00:00:30.660 INFO:tasks.workunit.client.0.smithi164.stdout:6/263: write d0/fb [1292337,96762] 0 2024-02-10T00:00:30.660 INFO:tasks.workunit.client.1.smithi183.stdout:4/525: truncate de/d19/f95 773235 0 2024-02-10T00:00:30.661 INFO:tasks.workunit.client.0.smithi164.stdout:6/264: dread - d0/d6/d12/f18 zero size 2024-02-10T00:00:30.662 INFO:tasks.workunit.client.1.smithi183.stdout:9/529: dread d0/d3/d14/d48/f83 [0,4194304] 0 2024-02-10T00:00:30.662 INFO:tasks.workunit.client.1.smithi183.stdout:8/601: read d0/d23/f26 [1260668,7389] 0 2024-02-10T00:00:30.663 INFO:tasks.workunit.client.0.smithi164.stdout:7/206: truncate d3/d11/f18 901245 0 2024-02-10T00:00:30.663 INFO:tasks.workunit.client.1.smithi183.stdout:8/602: dread - d0/d27/d36/d7f/fae zero size 2024-02-10T00:00:30.664 INFO:tasks.workunit.client.0.smithi164.stdout:7/207: fsync d3/d5/f30 0 2024-02-10T00:00:30.665 INFO:tasks.workunit.client.0.smithi164.stdout:6/265: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:30.668 INFO:tasks.workunit.client.1.smithi183.stdout:6/440: dread d2/f4b [0,4194304] 0 2024-02-10T00:00:30.669 INFO:tasks.workunit.client.1.smithi183.stdout:9/530: rename d0/d10/f81 to d0/d3/d14/d1c/d2d/d4f/d79/fb3 0 2024-02-10T00:00:30.669 INFO:tasks.workunit.client.1.smithi183.stdout:0/505: sync 2024-02-10T00:00:30.670 INFO:tasks.workunit.client.1.smithi183.stdout:8/603: mknod d0/d31/cc0 0 2024-02-10T00:00:30.671 INFO:tasks.workunit.client.0.smithi164.stdout:4/177: mknod d2/d2f/d28/d3d/c40 0 2024-02-10T00:00:30.671 INFO:tasks.workunit.client.0.smithi164.stdout:3/150: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:30.672 INFO:tasks.workunit.client.0.smithi164.stdout:4/178: dread - d2/d19/f2d zero size 2024-02-10T00:00:30.672 INFO:tasks.workunit.client.0.smithi164.stdout:2/225: dwrite d3/d32/d4e/d27/d2e/f41 [0,4194304] 0 2024-02-10T00:00:30.673 INFO:tasks.workunit.client.1.smithi183.stdout:4/526: link de/d14/d27/d2e/f88 de/d14/d4e/fa1 0 2024-02-10T00:00:30.673 INFO:tasks.workunit.client.1.smithi183.stdout:6/441: dwrite d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:30.674 INFO:tasks.workunit.client.0.smithi164.stdout:5/185: symlink d7/l3a 0 2024-02-10T00:00:30.677 INFO:tasks.workunit.client.0.smithi164.stdout:3/151: dwrite d0/d1/d2/fe [4194304,4194304] 0 2024-02-10T00:00:30.677 INFO:tasks.workunit.client.1.smithi183.stdout:8/604: creat d0/d27/d75/d5b/fc1 x:0 0 0 2024-02-10T00:00:30.677 INFO:tasks.workunit.client.1.smithi183.stdout:1/498: dread d0/d3/d29/fad [0,4194304] 0 2024-02-10T00:00:30.679 INFO:tasks.workunit.client.0.smithi164.stdout:7/208: mknod d3/d26/c49 0 2024-02-10T00:00:30.679 INFO:tasks.workunit.client.1.smithi183.stdout:5/621: truncate d4/dd/f14 7157525 0 2024-02-10T00:00:30.683 INFO:tasks.workunit.client.0.smithi164.stdout:7/209: dwrite d3/f38 [0,4194304] 0 2024-02-10T00:00:30.684 INFO:tasks.workunit.client.0.smithi164.stdout:2/226: mkdir d3/d32/d4e/d27/d57 0 2024-02-10T00:00:30.687 INFO:tasks.workunit.client.0.smithi164.stdout:8/151: link d2/c6 d2/d12/d21/c28 0 2024-02-10T00:00:30.687 INFO:tasks.workunit.client.0.smithi164.stdout:3/152: rmdir d0/d1/d2 39 2024-02-10T00:00:30.689 INFO:tasks.workunit.client.0.smithi164.stdout:1/139: rmdir d1/d13/d2f 39 2024-02-10T00:00:30.691 INFO:tasks.workunit.client.0.smithi164.stdout:9/203: truncate d6/de/f11 4333085 0 2024-02-10T00:00:30.693 INFO:tasks.workunit.client.0.smithi164.stdout:7/210: dread d3/f22 [0,4194304] 0 2024-02-10T00:00:30.696 INFO:tasks.workunit.client.0.smithi164.stdout:8/152: truncate d2/f7 223503 0 2024-02-10T00:00:30.697 INFO:tasks.workunit.client.0.smithi164.stdout:7/211: dwrite d3/d5/f30 [0,4194304] 0 2024-02-10T00:00:30.699 INFO:tasks.workunit.client.1.smithi183.stdout:3/472: truncate d7/db/d2a/f2c 3576089 0 2024-02-10T00:00:30.700 INFO:tasks.workunit.client.1.smithi183.stdout:2/635: write d2/da/f1d [577897,45016] 0 2024-02-10T00:00:30.700 INFO:tasks.workunit.client.1.smithi183.stdout:7/512: truncate d0/d11/d2f/d64/f69 235252 0 2024-02-10T00:00:30.701 INFO:tasks.workunit.client.1.smithi183.stdout:3/473: chown d7/db/d2a/d4d 2037 1 2024-02-10T00:00:30.701 INFO:tasks.workunit.client.0.smithi164.stdout:1/140: dread d1/f7 [0,4194304] 0 2024-02-10T00:00:30.701 INFO:tasks.workunit.client.0.smithi164.stdout:3/153: unlink d0/d1/d2/d19/f1c 0 2024-02-10T00:00:30.702 INFO:tasks.workunit.client.0.smithi164.stdout:9/204: read d6/f1a [15890,88393] 0 2024-02-10T00:00:30.704 INFO:tasks.workunit.client.1.smithi183.stdout:2/636: dwrite d2/da/d19/d31/f80 [4194304,4194304] 0 2024-02-10T00:00:30.704 INFO:tasks.workunit.client.0.smithi164.stdout:4/179: rename d2/d2f/d28 to d2/d2f/d37/d41 0 2024-02-10T00:00:30.705 INFO:tasks.workunit.client.0.smithi164.stdout:4/180: write d2/fb [3631555,50294] 0 2024-02-10T00:00:30.706 INFO:tasks.workunit.client.0.smithi164.stdout:4/181: fsync d2/d19/d16/f3a 0 2024-02-10T00:00:30.706 INFO:tasks.workunit.client.0.smithi164.stdout:4/182: chown d2/d19/d16/f38 7494 1 2024-02-10T00:00:30.708 INFO:tasks.workunit.client.1.smithi183.stdout:5/622: creat d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fc6 x:0 0 0 2024-02-10T00:00:30.709 INFO:tasks.workunit.client.0.smithi164.stdout:2/227: truncate d3/f11 43239 0 2024-02-10T00:00:30.709 INFO:tasks.workunit.client.1.smithi183.stdout:7/513: mknod d0/d2/d4/d8/c92 0 2024-02-10T00:00:30.710 INFO:tasks.workunit.client.0.smithi164.stdout:6/266: dwrite d0/d6/d12/f41 [0,4194304] 0 2024-02-10T00:00:30.710 INFO:tasks.workunit.client.0.smithi164.stdout:7/212: mkdir d3/d5/d2b/d4a 0 2024-02-10T00:00:30.711 INFO:tasks.workunit.client.1.smithi183.stdout:1/499: dread d0/f4b [0,4194304] 0 2024-02-10T00:00:30.711 INFO:tasks.workunit.client.1.smithi183.stdout:3/474: write d7/db/d2a/d33/f36 [2317465,96948] 0 2024-02-10T00:00:30.711 INFO:tasks.workunit.client.1.smithi183.stdout:2/637: dwrite d2/da/d77/dc7/fd2 [0,4194304] 0 2024-02-10T00:00:30.711 INFO:tasks.workunit.client.0.smithi164.stdout:6/267: readlink d0/d6/l34 0 2024-02-10T00:00:30.711 INFO:tasks.workunit.client.0.smithi164.stdout:7/213: write d3/d5/fe [412522,58339] 0 2024-02-10T00:00:30.712 INFO:tasks.workunit.client.1.smithi183.stdout:7/514: stat d0/d2/d4/d8/c48 0 2024-02-10T00:00:30.713 INFO:tasks.workunit.client.0.smithi164.stdout:3/154: chown d0/c20 1049599194 1 2024-02-10T00:00:30.713 INFO:tasks.workunit.client.0.smithi164.stdout:3/155: fsync d0/f10 0 2024-02-10T00:00:30.714 INFO:tasks.workunit.client.0.smithi164.stdout:3/156: chown d0/d1/d2/d19/l1b 13559319 1 2024-02-10T00:00:30.715 INFO:tasks.workunit.client.0.smithi164.stdout:0/154: sync 2024-02-10T00:00:30.715 INFO:tasks.workunit.client.0.smithi164.stdout:0/155: dread - d6/d10/f1d zero size 2024-02-10T00:00:30.715 INFO:tasks.workunit.client.1.smithi183.stdout:3/475: dread d7/db/d2a/d33/f56 [0,4194304] 0 2024-02-10T00:00:30.716 INFO:tasks.workunit.client.0.smithi164.stdout:5/186: rename d7/d17/d21/d24/d26 to d7/d17/d3b 0 2024-02-10T00:00:30.717 INFO:tasks.workunit.client.1.smithi183.stdout:3/476: write d7/db/d2a/d2d/f2f [9292052,22528] 0 2024-02-10T00:00:30.718 INFO:tasks.workunit.client.0.smithi164.stdout:4/183: mkdir d2/d2f/d37/d41/d3d/d42 0 2024-02-10T00:00:30.718 INFO:tasks.workunit.client.1.smithi183.stdout:8/605: truncate d0/d31/f88 1793366 0 2024-02-10T00:00:30.718 INFO:tasks.workunit.client.1.smithi183.stdout:6/442: getdents d2/d1a/d25/d3c/d31/d38/d3f/d5e 0 2024-02-10T00:00:30.718 INFO:tasks.workunit.client.1.smithi183.stdout:1/500: creat d0/d3/d7/d36/fb4 x:0 0 0 2024-02-10T00:00:30.719 INFO:tasks.workunit.client.0.smithi164.stdout:2/228: mknod d3/d32/d4e/d27/d2e/c58 0 2024-02-10T00:00:30.720 INFO:tasks.workunit.client.1.smithi183.stdout:3/477: fsync d7/db/d2a/d33/f87 0 2024-02-10T00:00:30.720 INFO:tasks.workunit.client.1.smithi183.stdout:6/443: stat d2/d1a/d25/d3c 0 2024-02-10T00:00:30.720 INFO:tasks.workunit.client.1.smithi183.stdout:5/623: mknod d4/d23/cc7 0 2024-02-10T00:00:30.720 INFO:tasks.workunit.client.1.smithi183.stdout:8/606: chown d0/d3f/db2/l4c 453796 1 2024-02-10T00:00:30.721 INFO:tasks.workunit.client.0.smithi164.stdout:1/141: creat d1/d23/f32 x:0 0 0 2024-02-10T00:00:30.722 INFO:tasks.workunit.client.0.smithi164.stdout:4/184: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:30.723 INFO:tasks.workunit.client.1.smithi183.stdout:1/501: creat d0/d3/d29/d38/fb5 x:0 0 0 2024-02-10T00:00:30.724 INFO:tasks.workunit.client.0.smithi164.stdout:5/187: dread d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:30.725 INFO:tasks.workunit.client.0.smithi164.stdout:9/205: symlink d6/de/d3b/l3f 0 2024-02-10T00:00:30.726 INFO:tasks.workunit.client.1.smithi183.stdout:5/624: dwrite d4/dd/fbd [0,4194304] 0 2024-02-10T00:00:30.726 INFO:tasks.workunit.client.1.smithi183.stdout:8/607: unlink d0/f18 0 2024-02-10T00:00:30.726 INFO:tasks.workunit.client.0.smithi164.stdout:5/188: chown d7/l14 5 1 2024-02-10T00:00:30.726 INFO:tasks.workunit.client.0.smithi164.stdout:9/206: write d6/d1c/d24/f2a [606980,22985] 0 2024-02-10T00:00:30.727 INFO:tasks.workunit.client.1.smithi183.stdout:8/608: stat d0/d27/f2e 0 2024-02-10T00:00:30.727 INFO:tasks.workunit.client.1.smithi183.stdout:3/478: creat d7/db/d2a/d2d/d51/f8a x:0 0 0 2024-02-10T00:00:30.728 INFO:tasks.workunit.client.0.smithi164.stdout:3/157: read d0/f10 [424124,70307] 0 2024-02-10T00:00:30.728 INFO:tasks.workunit.client.1.smithi183.stdout:6/444: creat d2/d1a/d25/d3c/d31/d38/f85 x:0 0 0 2024-02-10T00:00:30.728 INFO:tasks.workunit.client.1.smithi183.stdout:4/527: sync 2024-02-10T00:00:30.729 INFO:tasks.workunit.client.1.smithi183.stdout:2/638: truncate d2/d3d/fa0 509020 0 2024-02-10T00:00:30.730 INFO:tasks.workunit.client.0.smithi164.stdout:7/214: mkdir d3/d28/d45/d4b 0 2024-02-10T00:00:30.730 INFO:tasks.workunit.client.0.smithi164.stdout:4/185: creat d2/d2f/d37/f43 x:0 0 0 2024-02-10T00:00:30.731 INFO:tasks.workunit.client.0.smithi164.stdout:0/156: symlink d6/d10/l33 0 2024-02-10T00:00:30.732 INFO:tasks.workunit.client.0.smithi164.stdout:0/157: chown d6/c19 3065452 1 2024-02-10T00:00:30.732 INFO:tasks.workunit.client.1.smithi183.stdout:8/609: dwrite d0/d4e/f4f [0,4194304] 0 2024-02-10T00:00:30.733 INFO:tasks.workunit.client.0.smithi164.stdout:9/207: rmdir d6/d1c 39 2024-02-10T00:00:30.734 INFO:tasks.workunit.client.1.smithi183.stdout:8/610: fsync d0/d3f/db2/f2c 0 2024-02-10T00:00:30.735 INFO:tasks.workunit.client.0.smithi164.stdout:0/158: dread d6/d10/d18/d2d/f2e [0,4194304] 0 2024-02-10T00:00:30.735 INFO:tasks.workunit.client.1.smithi183.stdout:8/611: read - d0/d27/d75/d5b/fc1 zero size 2024-02-10T00:00:30.736 INFO:tasks.workunit.client.1.smithi183.stdout:5/625: unlink d4/dd/d31/d73/f85 0 2024-02-10T00:00:30.737 INFO:tasks.workunit.client.1.smithi183.stdout:1/502: dwrite d0/d3/fa4 [0,4194304] 0 2024-02-10T00:00:30.738 INFO:tasks.workunit.client.0.smithi164.stdout:4/186: symlink d2/d19/l44 0 2024-02-10T00:00:30.741 INFO:tasks.workunit.client.1.smithi183.stdout:3/479: link d7/db/d2a/d4d/d63/f81 d7/db/d2a/d33/d59/f8b 0 2024-02-10T00:00:30.741 INFO:tasks.workunit.client.1.smithi183.stdout:1/503: creat d0/d3a/fb6 x:0 0 0 2024-02-10T00:00:30.742 INFO:tasks.workunit.client.0.smithi164.stdout:9/208: mkdir d6/de/d40 0 2024-02-10T00:00:30.742 INFO:tasks.workunit.client.0.smithi164.stdout:0/159: symlink d6/d10/d18/d2d/l34 0 2024-02-10T00:00:30.742 INFO:tasks.workunit.client.0.smithi164.stdout:2/229: rmdir d3/d32/d4e/d27/d57 0 2024-02-10T00:00:30.743 INFO:tasks.workunit.client.0.smithi164.stdout:2/230: dread - d3/f23 zero size 2024-02-10T00:00:30.744 INFO:tasks.workunit.client.1.smithi183.stdout:5/626: creat d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/fc8 x:0 0 0 2024-02-10T00:00:30.745 INFO:tasks.workunit.client.0.smithi164.stdout:4/187: mkdir d2/d2f/d37/d45 0 2024-02-10T00:00:30.749 INFO:tasks.workunit.client.1.smithi183.stdout:4/528: rename de/d22/d92 to de/d14/d1d/d2f/da2 0 2024-02-10T00:00:30.751 INFO:tasks.workunit.client.0.smithi164.stdout:7/215: fdatasync d3/f38 0 2024-02-10T00:00:30.751 INFO:tasks.workunit.client.0.smithi164.stdout:5/189: getdents d7/d17/d3b 0 2024-02-10T00:00:30.751 INFO:tasks.workunit.client.1.smithi183.stdout:3/480: mkdir d7/db/d2a/d1c/d8c 0 2024-02-10T00:00:30.752 INFO:tasks.workunit.client.1.smithi183.stdout:8/612: getdents d0/d4e 0 2024-02-10T00:00:30.754 INFO:tasks.workunit.client.0.smithi164.stdout:2/231: link d3/d32/d4e/f3f d3/d32/d4e/f59 0 2024-02-10T00:00:30.756 INFO:tasks.workunit.client.1.smithi183.stdout:6/445: rename d2/d1a/d25/d3c/c2a to d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/c86 0 2024-02-10T00:00:30.756 INFO:tasks.workunit.client.0.smithi164.stdout:7/216: symlink d3/d11/d39/d3a/l4c 0 2024-02-10T00:00:30.758 INFO:tasks.workunit.client.0.smithi164.stdout:2/232: mknod d3/d32/d4e/d27/d2e/d36/c5a 0 2024-02-10T00:00:30.759 INFO:tasks.workunit.client.0.smithi164.stdout:7/217: chown d3/d5/l20 653 1 2024-02-10T00:00:30.759 INFO:tasks.workunit.client.1.smithi183.stdout:1/504: getdents d0/d3/d67/d70 0 2024-02-10T00:00:30.760 INFO:tasks.workunit.client.1.smithi183.stdout:4/529: dread de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:30.760 INFO:tasks.workunit.client.0.smithi164.stdout:2/233: mkdir d3/d24/d5b 0 2024-02-10T00:00:30.762 INFO:tasks.workunit.client.0.smithi164.stdout:5/190: rename d7/l1e to d7/d17/d21/l3c 0 2024-02-10T00:00:30.763 INFO:tasks.workunit.client.1.smithi183.stdout:3/481: rmdir d7/db/d2a/d1c/d8c 0 2024-02-10T00:00:30.764 INFO:tasks.workunit.client.0.smithi164.stdout:5/191: chown d7/d17/d21/d23/d37/d36 13391 1 2024-02-10T00:00:30.764 INFO:tasks.workunit.client.0.smithi164.stdout:2/234: dread d3/d32/d4e/d27/d2e/f41 [0,4194304] 0 2024-02-10T00:00:30.764 INFO:tasks.workunit.client.1.smithi183.stdout:2/639: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:30.764 INFO:tasks.workunit.client.1.smithi183.stdout:4/530: mkdir de/d14/d4e/da3 0 2024-02-10T00:00:30.764 INFO:tasks.workunit.client.0.smithi164.stdout:2/235: fdatasync d3/f17 0 2024-02-10T00:00:30.765 INFO:tasks.workunit.client.1.smithi183.stdout:1/505: unlink d0/d3/d7/d36/f47 0 2024-02-10T00:00:30.765 INFO:tasks.workunit.client.0.smithi164.stdout:7/218: getdents d3/d28 0 2024-02-10T00:00:30.767 INFO:tasks.workunit.client.0.smithi164.stdout:5/192: creat d7/d17/d21/d24/f3d x:0 0 0 2024-02-10T00:00:30.768 INFO:tasks.workunit.client.1.smithi183.stdout:2/640: dwrite d2/da/d20/d21/d43/f65 [0,4194304] 0 2024-02-10T00:00:30.768 INFO:tasks.workunit.client.1.smithi183.stdout:1/506: chown d0/d3/da9/lb2 6244571 1 2024-02-10T00:00:30.769 INFO:tasks.workunit.client.0.smithi164.stdout:7/219: mkdir d3/d4d 0 2024-02-10T00:00:30.770 INFO:tasks.workunit.client.1.smithi183.stdout:2/641: creat d2/da/d77/dc7/fd7 x:0 0 0 2024-02-10T00:00:30.771 INFO:tasks.workunit.client.1.smithi183.stdout:1/507: creat d0/d3/d67/d70/fb7 x:0 0 0 2024-02-10T00:00:30.772 INFO:tasks.workunit.client.1.smithi183.stdout:2/642: symlink d2/d2c/d2f/d60/d8d/ld8 0 2024-02-10T00:00:30.773 INFO:tasks.workunit.client.0.smithi164.stdout:5/193: link d7/d15/l18 d7/d17/d21/d24/l3e 0 2024-02-10T00:00:30.774 INFO:tasks.workunit.client.1.smithi183.stdout:1/508: symlink d0/d3/da9/lb8 0 2024-02-10T00:00:30.777 INFO:tasks.workunit.client.1.smithi183.stdout:2/643: dwrite d2/da/d77/dc7/fd7 [0,4194304] 0 2024-02-10T00:00:30.778 INFO:tasks.workunit.client.1.smithi183.stdout:1/509: symlink d0/d3a/lb9 0 2024-02-10T00:00:30.779 INFO:tasks.workunit.client.0.smithi164.stdout:5/194: unlink d7/d17/f33 0 2024-02-10T00:00:30.779 INFO:tasks.workunit.client.0.smithi164.stdout:7/220: getdents d3/d5 0 2024-02-10T00:00:30.781 INFO:tasks.workunit.client.0.smithi164.stdout:7/221: unlink d3/d26/f36 0 2024-02-10T00:00:30.784 INFO:tasks.workunit.client.1.smithi183.stdout:1/510: dwrite d0/d3/d67/d7b/faf [0,4194304] 0 2024-02-10T00:00:30.784 INFO:tasks.workunit.client.1.smithi183.stdout:1/511: fdatasync d0/f78 0 2024-02-10T00:00:30.785 INFO:tasks.workunit.client.0.smithi164.stdout:5/195: rename d7/d15/d1f/f25 to d7/d17/f3f 0 2024-02-10T00:00:30.785 INFO:tasks.workunit.client.0.smithi164.stdout:5/196: chown d7/d15/d1f/c34 1603 1 2024-02-10T00:00:30.786 INFO:tasks.workunit.client.1.smithi183.stdout:1/512: read - d0/d3/d67/d70/fb7 zero size 2024-02-10T00:00:30.786 INFO:tasks.workunit.client.0.smithi164.stdout:5/197: chown l3 62 1 2024-02-10T00:00:30.786 INFO:tasks.workunit.client.1.smithi183.stdout:1/513: write d0/d3a/f7a [1523898,91465] 0 2024-02-10T00:00:30.790 INFO:tasks.workunit.client.1.smithi183.stdout:8/613: dread d0/d4e/f6a [0,4194304] 0 2024-02-10T00:00:30.791 INFO:tasks.workunit.client.0.smithi164.stdout:8/153: write d2/d12/f17 [749128,52850] 0 2024-02-10T00:00:30.791 INFO:tasks.workunit.client.1.smithi183.stdout:8/614: stat d0/fd 0 2024-02-10T00:00:30.791 INFO:tasks.workunit.client.1.smithi183.stdout:9/531: write d0/f5b [1579334,64964] 0 2024-02-10T00:00:30.791 INFO:tasks.workunit.client.1.smithi183.stdout:9/532: stat d0/d10/f7c 0 2024-02-10T00:00:30.794 INFO:tasks.workunit.client.1.smithi183.stdout:0/506: dwrite d14/f40 [4194304,4194304] 0 2024-02-10T00:00:30.795 INFO:tasks.workunit.client.0.smithi164.stdout:7/222: rename d3/ff to d3/d5/d2b/f4e 0 2024-02-10T00:00:30.798 INFO:tasks.workunit.client.0.smithi164.stdout:5/198: write d7/f19 [371606,41856] 0 2024-02-10T00:00:30.798 INFO:tasks.workunit.client.0.smithi164.stdout:4/188: sync 2024-02-10T00:00:30.799 INFO:tasks.workunit.client.0.smithi164.stdout:8/154: creat d2/f29 x:0 0 0 2024-02-10T00:00:30.799 INFO:tasks.workunit.client.0.smithi164.stdout:8/155: write d2/f13 [830424,29872] 0 2024-02-10T00:00:30.800 INFO:tasks.workunit.client.0.smithi164.stdout:7/223: mknod d3/d5/d2b/c4f 0 2024-02-10T00:00:30.800 INFO:tasks.workunit.client.1.smithi183.stdout:7/515: truncate d0/d11/d88/f91 4987382 0 2024-02-10T00:00:30.802 INFO:tasks.workunit.client.0.smithi164.stdout:6/268: write d0/d6/f10 [5197701,92602] 0 2024-02-10T00:00:30.804 INFO:tasks.workunit.client.0.smithi164.stdout:8/156: dwrite d2/f13 [0,4194304] 0 2024-02-10T00:00:30.806 INFO:tasks.workunit.client.1.smithi183.stdout:5/627: truncate d4/d23/d3e/d80/da1/f5c 756661 0 2024-02-10T00:00:30.808 INFO:tasks.workunit.client.1.smithi183.stdout:5/628: write d4/d23/d3e/d80/da1/d9e/f39 [3542743,126024] 0 2024-02-10T00:00:30.808 INFO:tasks.workunit.client.0.smithi164.stdout:0/160: rmdir d6 39 2024-02-10T00:00:30.809 INFO:tasks.workunit.client.1.smithi183.stdout:6/446: write d2/d1a/f1f [5452330,22451] 0 2024-02-10T00:00:30.809 INFO:tasks.workunit.client.1.smithi183.stdout:5/629: chown d4/d23/d3e/d80/da1/d9e/f39 1747 1 2024-02-10T00:00:30.811 INFO:tasks.workunit.client.0.smithi164.stdout:3/158: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:30.811 INFO:tasks.workunit.client.0.smithi164.stdout:1/142: dwrite d1/f6 [0,4194304] 0 2024-02-10T00:00:30.812 INFO:tasks.workunit.client.0.smithi164.stdout:9/209: truncate f5 957367 0 2024-02-10T00:00:30.812 INFO:tasks.workunit.client.0.smithi164.stdout:8/157: dwrite d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:30.812 INFO:tasks.workunit.client.0.smithi164.stdout:1/143: fdatasync d1/fd 0 2024-02-10T00:00:30.813 INFO:tasks.workunit.client.0.smithi164.stdout:9/210: write d6/f3e [440486,11799] 0 2024-02-10T00:00:30.814 INFO:tasks.workunit.client.1.smithi183.stdout:4/531: write de/d14/d4e/f65 [1992574,103032] 0 2024-02-10T00:00:30.814 INFO:tasks.workunit.client.0.smithi164.stdout:1/144: dread - d1/d1a/f2c zero size 2024-02-10T00:00:30.814 INFO:tasks.workunit.client.0.smithi164.stdout:8/158: write d2/d12/f24 [458009,53347] 0 2024-02-10T00:00:30.818 INFO:tasks.workunit.client.0.smithi164.stdout:2/236: truncate d3/d32/d4e/d27/f28 32199 0 2024-02-10T00:00:30.820 INFO:tasks.workunit.client.1.smithi183.stdout:2/644: dwrite d2/d3d/fa0 [0,4194304] 0 2024-02-10T00:00:30.821 INFO:tasks.workunit.client.1.smithi183.stdout:3/482: sync 2024-02-10T00:00:30.825 INFO:tasks.workunit.client.1.smithi183.stdout:6/447: rename d2/d1a/d3a/d45/d53 to d2/d1a/d25/d3c/d31/d38/d87 0 2024-02-10T00:00:30.826 INFO:tasks.workunit.client.1.smithi183.stdout:0/507: dwrite d14/d1d/d59/d71/f27 [0,4194304] 0 2024-02-10T00:00:30.827 INFO:tasks.workunit.client.1.smithi183.stdout:5/630: rmdir d4/d23/d3e/d80/da1/d9e/d27/d5d 39 2024-02-10T00:00:30.829 INFO:tasks.workunit.client.1.smithi183.stdout:5/631: stat d4/d23/d3e/d80/da1/d9e/c8e 0 2024-02-10T00:00:30.830 INFO:tasks.workunit.client.1.smithi183.stdout:5/632: readlink d4/d23/d3e/d80/da1/d9e/d27/d37/lad 0 2024-02-10T00:00:30.831 INFO:tasks.workunit.client.0.smithi164.stdout:8/159: mknod d2/d12/c2a 0 2024-02-10T00:00:30.832 INFO:tasks.workunit.client.0.smithi164.stdout:1/145: mkdir d1/d1a/d2d/d18/d33 0 2024-02-10T00:00:30.832 INFO:tasks.workunit.client.1.smithi183.stdout:9/533: read d0/d3/d14/d48/f5e [463604,51019] 0 2024-02-10T00:00:30.833 INFO:tasks.workunit.client.1.smithi183.stdout:1/514: dread d0/d3/d67/d7b/f98 [0,4194304] 0 2024-02-10T00:00:30.833 INFO:tasks.workunit.client.1.smithi183.stdout:2/645: creat d2/da/d77/dc7/db5/fd9 x:0 0 0 2024-02-10T00:00:30.834 INFO:tasks.workunit.client.1.smithi183.stdout:1/515: fsync d0/d3/d67/d70/fb7 0 2024-02-10T00:00:30.838 INFO:tasks.workunit.client.1.smithi183.stdout:6/448: rename d2/d1a/d3a/f40 to d2/d1a/d25/d3c/d31/d38/d87/f88 0 2024-02-10T00:00:30.840 INFO:tasks.workunit.client.1.smithi183.stdout:6/449: rename d2/d1a/d25/d3c/d31/d38/d87 to d2/d1a/d25/d3c/d31/d38/d87/d89 22 2024-02-10T00:00:30.840 INFO:tasks.workunit.client.0.smithi164.stdout:3/159: mknod d0/d1/d2/d19/d27/c2b 0 2024-02-10T00:00:30.841 INFO:tasks.workunit.client.0.smithi164.stdout:9/211: fsync d6/de/f11 0 2024-02-10T00:00:30.841 INFO:tasks.workunit.client.1.smithi183.stdout:4/532: mkdir de/d14/da4 0 2024-02-10T00:00:30.842 INFO:tasks.workunit.client.1.smithi183.stdout:5/633: symlink d4/d23/d3e/d80/da1/d9c/lc9 0 2024-02-10T00:00:30.842 INFO:tasks.workunit.client.0.smithi164.stdout:3/160: chown d0/d1/d2/d19/d27 706826 1 2024-02-10T00:00:30.842 INFO:tasks.workunit.client.0.smithi164.stdout:3/161: stat d0/c20 0 2024-02-10T00:00:30.842 INFO:tasks.workunit.client.0.smithi164.stdout:8/160: symlink d2/l2b 0 2024-02-10T00:00:30.843 INFO:tasks.workunit.client.1.smithi183.stdout:8/615: creat d0/fc2 x:0 0 0 2024-02-10T00:00:30.844 INFO:tasks.workunit.client.0.smithi164.stdout:5/199: link d7/l12 d7/d17/d21/d24/l40 0 2024-02-10T00:00:30.844 INFO:tasks.workunit.client.0.smithi164.stdout:9/212: chown d6/d1c 3 1 2024-02-10T00:00:30.845 INFO:tasks.workunit.client.1.smithi183.stdout:4/533: dread de/d19/d20/f26 [4194304,4194304] 0 2024-02-10T00:00:30.845 INFO:tasks.workunit.client.1.smithi183.stdout:2/646: stat d2/da/c1b 0 2024-02-10T00:00:30.845 INFO:tasks.workunit.client.1.smithi183.stdout:7/516: write d0/d2/f17 [5838518,13894] 0 2024-02-10T00:00:30.846 INFO:tasks.workunit.client.0.smithi164.stdout:8/161: dwrite d2/f4 [0,4194304] 0 2024-02-10T00:00:30.846 INFO:tasks.workunit.client.0.smithi164.stdout:8/162: stat d2/c1a 0 2024-02-10T00:00:30.848 INFO:tasks.workunit.client.0.smithi164.stdout:1/146: creat d1/d13/d2f/f34 x:0 0 0 2024-02-10T00:00:30.849 INFO:tasks.workunit.client.1.smithi183.stdout:6/450: creat d2/d1a/d25/d3c/d31/f8a x:0 0 0 2024-02-10T00:00:30.851 INFO:tasks.workunit.client.0.smithi164.stdout:8/163: creat d2/f2c x:0 0 0 2024-02-10T00:00:30.851 INFO:tasks.workunit.client.1.smithi183.stdout:8/616: creat d0/d4e/d53/fc3 x:0 0 0 2024-02-10T00:00:30.852 INFO:tasks.workunit.client.1.smithi183.stdout:4/534: mknod de/d14/d4e/ca5 0 2024-02-10T00:00:30.852 INFO:tasks.workunit.client.1.smithi183.stdout:0/508: dread d14/d1d/d2d/d31/d6c/d70/f81 [0,4194304] 0 2024-02-10T00:00:30.855 INFO:tasks.workunit.client.1.smithi183.stdout:2/647: creat d2/d2c/dba/fda x:0 0 0 2024-02-10T00:00:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:5/200: rename d7/l12 to d7/d15/d1f/l41 0 2024-02-10T00:00:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:9/213: mkdir d6/d41 0 2024-02-10T00:00:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:8/164: chown d2/f7 19673918 1 2024-02-10T00:00:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:8/165: readlink d2/lf 0 2024-02-10T00:00:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:5/201: chown d7/d17/d21/d23/c2e 574852 1 2024-02-10T00:00:30.859 INFO:tasks.workunit.client.1.smithi183.stdout:4/535: dread - de/d14/d27/f8b zero size 2024-02-10T00:00:30.859 INFO:tasks.workunit.client.1.smithi183.stdout:9/534: dread d0/d3/d14/d1c/d2d/d4f/d89/f9b [0,4194304] 0 2024-02-10T00:00:30.859 INFO:tasks.workunit.client.1.smithi183.stdout:0/509: stat d14/d1d/d2d/d31/d68/fbc 0 2024-02-10T00:00:30.859 INFO:tasks.workunit.client.1.smithi183.stdout:7/517: creat d0/d11/d2f/d64/f93 x:0 0 0 2024-02-10T00:00:30.859 INFO:tasks.workunit.client.1.smithi183.stdout:3/483: getdents d7/db/d2a/d33/d59/d52 0 2024-02-10T00:00:30.860 INFO:tasks.workunit.client.1.smithi183.stdout:3/484: chown d7/c18 102657753 1 2024-02-10T00:00:30.860 INFO:tasks.workunit.client.1.smithi183.stdout:6/451: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b 0 2024-02-10T00:00:30.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/166: dread d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:30.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/167: chown d2/c1b 17445 1 2024-02-10T00:00:30.862 INFO:tasks.workunit.client.1.smithi183.stdout:6/452: dwrite d2/d1a/d25/d3c/d31/f70 [0,4194304] 0 2024-02-10T00:00:30.863 INFO:tasks.workunit.client.0.smithi164.stdout:8/168: creat d2/d12/d21/f2d x:0 0 0 2024-02-10T00:00:30.864 INFO:tasks.workunit.client.1.smithi183.stdout:9/535: unlink d0/d30/d52/l5d 0 2024-02-10T00:00:30.867 INFO:tasks.workunit.client.1.smithi183.stdout:5/634: creat d4/d23/d3e/d80/da1/d9e/d27/fca x:0 0 0 2024-02-10T00:00:30.868 INFO:tasks.workunit.client.0.smithi164.stdout:8/169: dwrite d2/f20 [0,4194304] 0 2024-02-10T00:00:30.868 INFO:tasks.workunit.client.0.smithi164.stdout:8/170: dread - d2/d12/d21/f2d zero size 2024-02-10T00:00:30.871 INFO:tasks.workunit.client.1.smithi183.stdout:2/648: creat d2/da/d20/d6d/dbd/fdb x:0 0 0 2024-02-10T00:00:30.878 INFO:tasks.workunit.client.1.smithi183.stdout:7/518: fsync d0/f53 0 2024-02-10T00:00:30.880 INFO:tasks.workunit.client.1.smithi183.stdout:4/536: rmdir de/d14/d4e/da3 0 2024-02-10T00:00:30.883 INFO:tasks.workunit.client.1.smithi183.stdout:7/519: dwrite d0/d11/d2f/f34 [4194304,4194304] 0 2024-02-10T00:00:30.884 INFO:tasks.workunit.client.0.smithi164.stdout:2/237: write d3/d32/d4e/f3f [2309386,98970] 0 2024-02-10T00:00:30.885 INFO:tasks.workunit.client.0.smithi164.stdout:4/189: truncate d2/fb 2748894 0 2024-02-10T00:00:30.885 INFO:tasks.workunit.client.1.smithi183.stdout:4/537: mknod de/d19/d8d/ca6 0 2024-02-10T00:00:30.886 INFO:tasks.workunit.client.0.smithi164.stdout:2/238: mknod d3/d26/c5c 0 2024-02-10T00:00:30.887 INFO:tasks.workunit.client.0.smithi164.stdout:7/224: truncate d3/d5/d2b/f4e 3830137 0 2024-02-10T00:00:30.887 INFO:tasks.workunit.client.0.smithi164.stdout:6/269: truncate d0/d6/f10 201025 0 2024-02-10T00:00:30.888 INFO:tasks.workunit.client.0.smithi164.stdout:2/239: dread d3/f44 [0,4194304] 0 2024-02-10T00:00:30.890 INFO:tasks.workunit.client.1.smithi183.stdout:3/485: getdents d7/db/d2a/d4d 0 2024-02-10T00:00:30.892 INFO:tasks.workunit.client.0.smithi164.stdout:7/225: dread d3/f38 [0,4194304] 0 2024-02-10T00:00:30.892 INFO:tasks.workunit.client.0.smithi164.stdout:0/161: dwrite d6/d7/f17 [0,4194304] 0 2024-02-10T00:00:30.893 INFO:tasks.workunit.client.0.smithi164.stdout:0/162: fsync d6/d10/f1d 0 2024-02-10T00:00:30.893 INFO:tasks.workunit.client.0.smithi164.stdout:4/190: creat d2/d2f/d37/d41/f46 x:0 0 0 2024-02-10T00:00:30.894 INFO:tasks.workunit.client.1.smithi183.stdout:1/516: truncate d0/d3/d67/f2f 3215120 0 2024-02-10T00:00:30.894 INFO:tasks.workunit.client.0.smithi164.stdout:0/163: readlink d6/d10/l12 0 2024-02-10T00:00:30.894 INFO:tasks.workunit.client.0.smithi164.stdout:3/162: write d0/d1/d2/d19/f22 [988205,107631] 0 2024-02-10T00:00:30.895 INFO:tasks.workunit.client.1.smithi183.stdout:7/520: write d0/f1 [1040878,117777] 0 2024-02-10T00:00:30.895 INFO:tasks.workunit.client.0.smithi164.stdout:1/147: rename d1/d13/d2f to d1/d1a/d35 0 2024-02-10T00:00:30.896 INFO:tasks.workunit.client.0.smithi164.stdout:0/164: fsync d6/d7/d14/f20 0 2024-02-10T00:00:30.896 INFO:tasks.workunit.client.0.smithi164.stdout:5/202: truncate d7/f32 1018723 0 2024-02-10T00:00:30.897 INFO:tasks.workunit.client.1.smithi183.stdout:3/486: fsync d7/f20 0 2024-02-10T00:00:30.898 INFO:tasks.workunit.client.0.smithi164.stdout:8/171: write d2/f10 [666025,110724] 0 2024-02-10T00:00:30.898 INFO:tasks.workunit.client.0.smithi164.stdout:1/148: chown d1/d1a/d35/f31 192173555 1 2024-02-10T00:00:30.898 INFO:tasks.workunit.client.1.smithi183.stdout:2/649: getdents d2/d2c 0 2024-02-10T00:00:30.900 INFO:tasks.workunit.client.1.smithi183.stdout:8/617: dread d0/d45/d46/d81/fa7 [0,4194304] 0 2024-02-10T00:00:30.900 INFO:tasks.workunit.client.0.smithi164.stdout:6/270: write d0/f1a [2169988,62431] 0 2024-02-10T00:00:30.900 INFO:tasks.workunit.client.0.smithi164.stdout:0/165: chown d6/d7/la 478 1 2024-02-10T00:00:30.901 INFO:tasks.workunit.client.0.smithi164.stdout:2/240: creat d3/d32/d4e/d27/d2e/d36/f5d x:0 0 0 2024-02-10T00:00:30.902 INFO:tasks.workunit.client.0.smithi164.stdout:7/226: dwrite d3/f16 [0,4194304] 0 2024-02-10T00:00:30.903 INFO:tasks.workunit.client.0.smithi164.stdout:3/163: creat d0/d1/d2/d19/d27/f2c x:0 0 0 2024-02-10T00:00:30.903 INFO:tasks.workunit.client.1.smithi183.stdout:3/487: read d7/db/f45 [162749,87656] 0 2024-02-10T00:00:30.903 INFO:tasks.workunit.client.1.smithi183.stdout:2/650: dwrite d2/da/d19/f7a [0,4194304] 0 2024-02-10T00:00:30.904 INFO:tasks.workunit.client.1.smithi183.stdout:3/488: dread - d7/db/d2a/f88 zero size 2024-02-10T00:00:30.904 INFO:tasks.workunit.client.0.smithi164.stdout:7/227: chown d3/d11/f14 168048396 1 2024-02-10T00:00:30.905 INFO:tasks.workunit.client.0.smithi164.stdout:9/214: dwrite d6/f9 [0,4194304] 0 2024-02-10T00:00:30.905 INFO:tasks.workunit.client.0.smithi164.stdout:8/172: unlink d2/c1a 0 2024-02-10T00:00:30.905 INFO:tasks.workunit.client.0.smithi164.stdout:3/164: chown d0/d1/d2/c1a 0 1 2024-02-10T00:00:30.905 INFO:tasks.workunit.client.1.smithi183.stdout:6/453: write d2/d1a/d3a/d45/f83 [1307825,88782] 0 2024-02-10T00:00:30.906 INFO:tasks.workunit.client.1.smithi183.stdout:6/454: readlink d2/d1a/d25/d3c/d31/d38/d3f/l80 0 2024-02-10T00:00:30.906 INFO:tasks.workunit.client.0.smithi164.stdout:4/191: mkdir d2/d2f/d37/d41/d3d/d42/d47 0 2024-02-10T00:00:30.908 INFO:tasks.workunit.client.0.smithi164.stdout:6/271: creat d0/d6/d12/d45/f51 x:0 0 0 2024-02-10T00:00:30.909 INFO:tasks.workunit.client.0.smithi164.stdout:7/228: dread d3/f38 [0,4194304] 0 2024-02-10T00:00:30.909 INFO:tasks.workunit.client.1.smithi183.stdout:9/536: rmdir d0 39 2024-02-10T00:00:30.910 INFO:tasks.workunit.client.0.smithi164.stdout:9/215: creat d6/d1c/d24/f42 x:0 0 0 2024-02-10T00:00:30.911 INFO:tasks.workunit.client.1.smithi183.stdout:0/510: truncate d14/d1d/d2d/d31/f3a 5419023 0 2024-02-10T00:00:30.911 INFO:tasks.workunit.client.0.smithi164.stdout:8/173: symlink d2/d12/d21/l2e 0 2024-02-10T00:00:30.912 INFO:tasks.workunit.client.0.smithi164.stdout:1/149: fsync d1/d1a/d2d/fe 0 2024-02-10T00:00:30.912 INFO:tasks.workunit.client.1.smithi183.stdout:0/511: dread - d14/d3e/d5f/fb1 zero size 2024-02-10T00:00:30.912 INFO:tasks.workunit.client.1.smithi183.stdout:5/635: sync 2024-02-10T00:00:30.912 INFO:tasks.workunit.client.1.smithi183.stdout:7/521: mkdir d0/d11/d88/d94 0 2024-02-10T00:00:30.913 INFO:tasks.workunit.client.0.smithi164.stdout:1/150: chown d1/d1a/l26 219049 1 2024-02-10T00:00:30.913 INFO:tasks.workunit.client.1.smithi183.stdout:7/522: stat d0/d11/d35/c7f 0 2024-02-10T00:00:30.914 INFO:tasks.workunit.client.1.smithi183.stdout:2/651: fdatasync d2/da/d20/f37 0 2024-02-10T00:00:30.914 INFO:tasks.workunit.client.1.smithi183.stdout:3/489: readlink d7/db/l54 0 2024-02-10T00:00:30.915 INFO:tasks.workunit.client.1.smithi183.stdout:3/490: read - d7/db/d2a/d2d/d6a/f6c zero size 2024-02-10T00:00:30.915 INFO:tasks.workunit.client.0.smithi164.stdout:1/151: dread d1/f7 [0,4194304] 0 2024-02-10T00:00:30.915 INFO:tasks.workunit.client.1.smithi183.stdout:3/491: write d7/db/d2a/f69 [1284850,77027] 0 2024-02-10T00:00:30.916 INFO:tasks.workunit.client.1.smithi183.stdout:3/492: chown d7/f30 2662 1 2024-02-10T00:00:30.916 INFO:tasks.workunit.client.0.smithi164.stdout:4/192: creat d2/d19/f48 x:0 0 0 2024-02-10T00:00:30.920 INFO:tasks.workunit.client.0.smithi164.stdout:4/193: mknod d2/d19/c49 0 2024-02-10T00:00:30.921 INFO:tasks.workunit.client.1.smithi183.stdout:6/455: mknod d2/d1a/d25/d3c/d31/d38/d6e/d34/c8c 0 2024-02-10T00:00:30.921 INFO:tasks.workunit.client.1.smithi183.stdout:8/618: truncate d0/d31/f88 1975298 0 2024-02-10T00:00:30.922 INFO:tasks.workunit.client.0.smithi164.stdout:6/272: dread d0/d2b/f39 [0,4194304] 0 2024-02-10T00:00:30.923 INFO:tasks.workunit.client.0.smithi164.stdout:6/273: stat d0/d3b 0 2024-02-10T00:00:30.923 INFO:tasks.workunit.client.1.smithi183.stdout:9/537: chown d0/f2f 364164 1 2024-02-10T00:00:30.924 INFO:tasks.workunit.client.1.smithi183.stdout:9/538: dread - d0/d3/d14/d1c/d4b/d51/f75 zero size 2024-02-10T00:00:30.925 INFO:tasks.workunit.client.1.smithi183.stdout:9/539: stat d0/f3a 0 2024-02-10T00:00:30.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/194: dwrite d2/d2f/f21 [0,4194304] 0 2024-02-10T00:00:30.925 INFO:tasks.workunit.client.0.smithi164.stdout:7/229: mkdir d3/d11/d39/d44/d48/d50 0 2024-02-10T00:00:30.926 INFO:tasks.workunit.client.0.smithi164.stdout:7/230: readlink d3/d5/l43 0 2024-02-10T00:00:30.928 INFO:tasks.workunit.client.1.smithi183.stdout:7/523: symlink d0/d11/d3e/l95 0 2024-02-10T00:00:30.929 INFO:tasks.workunit.client.1.smithi183.stdout:1/517: getdents d0/d3/d29/d38 0 2024-02-10T00:00:30.929 INFO:tasks.workunit.client.1.smithi183.stdout:7/524: read - d0/d11/d3e/f6a zero size 2024-02-10T00:00:30.930 INFO:tasks.workunit.client.0.smithi164.stdout:3/165: link d0/d1/dd/d1e/c24 d0/d1/dd/d1e/c2d 0 2024-02-10T00:00:30.930 INFO:tasks.workunit.client.0.smithi164.stdout:3/166: fdatasync d0/d1/d2/fe 0 2024-02-10T00:00:30.930 INFO:tasks.workunit.client.0.smithi164.stdout:6/274: symlink d0/d6/d12/d14/l52 0 2024-02-10T00:00:30.931 INFO:tasks.workunit.client.1.smithi183.stdout:8/619: readlink d0/d45/l65 0 2024-02-10T00:00:30.931 INFO:tasks.workunit.client.0.smithi164.stdout:4/195: fsync d2/d19/d16/f1b 0 2024-02-10T00:00:30.933 INFO:tasks.workunit.client.1.smithi183.stdout:9/540: creat d0/d10/fb4 x:0 0 0 2024-02-10T00:00:30.934 INFO:tasks.workunit.client.1.smithi183.stdout:5/636: rmdir d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d 39 2024-02-10T00:00:30.935 INFO:tasks.workunit.client.0.smithi164.stdout:7/231: read d3/f13 [2798195,116975] 0 2024-02-10T00:00:30.935 INFO:tasks.workunit.client.1.smithi183.stdout:1/518: symlink d0/d3/d7/lba 0 2024-02-10T00:00:30.936 INFO:tasks.workunit.client.0.smithi164.stdout:7/232: readlink d3/d11/d39/d3a/l4c 0 2024-02-10T00:00:30.936 INFO:tasks.workunit.client.0.smithi164.stdout:9/216: rename d6/de/c12 to d6/d1c/c43 0 2024-02-10T00:00:30.937 INFO:tasks.workunit.client.0.smithi164.stdout:9/217: chown d6/d1c/d24/f33 14949 1 2024-02-10T00:00:30.937 INFO:tasks.workunit.client.0.smithi164.stdout:9/218: readlink d6/l27 0 2024-02-10T00:00:30.939 INFO:tasks.workunit.client.0.smithi164.stdout:7/233: mkdir d3/d28/d51 0 2024-02-10T00:00:30.940 INFO:tasks.workunit.client.0.smithi164.stdout:7/234: fsync d3/d5/f30 0 2024-02-10T00:00:30.940 INFO:tasks.workunit.client.1.smithi183.stdout:9/541: mkdir d0/d30/db5 0 2024-02-10T00:00:30.941 INFO:tasks.workunit.client.1.smithi183.stdout:2/652: truncate d2/d2c/fb6 462705 0 2024-02-10T00:00:30.941 INFO:tasks.workunit.client.1.smithi183.stdout:4/538: dwrite de/d14/d27/f3d [0,4194304] 0 2024-02-10T00:00:30.941 INFO:tasks.workunit.client.0.smithi164.stdout:8/174: rename d2/f22 to d2/d12/d21/f2f 0 2024-02-10T00:00:30.941 INFO:tasks.workunit.client.0.smithi164.stdout:3/167: link d0/d1/dd/d1e/l23 d0/d1/d2/d19/l2e 0 2024-02-10T00:00:30.942 INFO:tasks.workunit.client.0.smithi164.stdout:3/168: write d0/d1/d2/fe [2906903,17067] 0 2024-02-10T00:00:30.944 INFO:tasks.workunit.client.1.smithi183.stdout:3/493: rename d7/db/d2a/d2d/d51/l73 to d7/db/l8d 0 2024-02-10T00:00:30.945 INFO:tasks.workunit.client.1.smithi183.stdout:3/494: stat d7/l32 0 2024-02-10T00:00:30.946 INFO:tasks.workunit.client.0.smithi164.stdout:9/219: dwrite d6/f7 [0,4194304] 0 2024-02-10T00:00:30.946 INFO:tasks.workunit.client.1.smithi183.stdout:3/495: readlink d7/db/d2a/d33/l34 0 2024-02-10T00:00:30.947 INFO:tasks.workunit.client.1.smithi183.stdout:4/539: dwrite de/d14/d1d/d7b/f8f [0,4194304] 0 2024-02-10T00:00:30.949 INFO:tasks.workunit.client.0.smithi164.stdout:8/175: mknod d2/d12/c30 0 2024-02-10T00:00:30.949 INFO:tasks.workunit.client.1.smithi183.stdout:7/525: truncate d0/d2/f2b 2828585 0 2024-02-10T00:00:30.950 INFO:tasks.workunit.client.0.smithi164.stdout:9/220: dread f5 [0,4194304] 0 2024-02-10T00:00:30.952 INFO:tasks.workunit.client.1.smithi183.stdout:9/542: getdents d0/d3/d14/d1c/d4b/d97/daa 0 2024-02-10T00:00:30.953 INFO:tasks.workunit.client.0.smithi164.stdout:8/176: mkdir d2/d12/d21/d31 0 2024-02-10T00:00:30.953 INFO:tasks.workunit.client.1.smithi183.stdout:7/526: symlink d0/d2/d50/d5d/l96 0 2024-02-10T00:00:30.954 INFO:tasks.workunit.client.1.smithi183.stdout:4/540: mknod de/d19/ca7 0 2024-02-10T00:00:30.955 INFO:tasks.workunit.client.1.smithi183.stdout:3/496: dwrite d7/db/f45 [0,4194304] 0 2024-02-10T00:00:30.956 INFO:tasks.workunit.client.1.smithi183.stdout:2/653: dread d2/da/d20/d21/d36/f6e [0,4194304] 0 2024-02-10T00:00:30.957 INFO:tasks.workunit.client.1.smithi183.stdout:3/497: write d7/db/f45 [4088186,12296] 0 2024-02-10T00:00:30.957 INFO:tasks.workunit.client.1.smithi183.stdout:2/654: fsync d2/da/d5b/f8a 0 2024-02-10T00:00:30.958 INFO:tasks.workunit.client.0.smithi164.stdout:1/152: truncate d1/f9 2079516 0 2024-02-10T00:00:30.961 INFO:tasks.workunit.client.1.smithi183.stdout:2/655: dread d2/da/d77/dc7/fd2 [0,4194304] 0 2024-02-10T00:00:30.963 INFO:tasks.workunit.client.0.smithi164.stdout:4/196: rename d2/c13 to d2/d19/d16/c4a 0 2024-02-10T00:00:30.963 INFO:tasks.workunit.client.1.smithi183.stdout:4/541: unlink de/d14/d27/d40/f66 0 2024-02-10T00:00:30.964 INFO:tasks.workunit.client.0.smithi164.stdout:3/169: truncate d0/f10 1178029 0 2024-02-10T00:00:30.966 INFO:tasks.workunit.client.1.smithi183.stdout:0/512: dwrite d14/d1d/d2d/f39 [0,4194304] 0 2024-02-10T00:00:30.971 INFO:tasks.workunit.client.0.smithi164.stdout:6/275: truncate d0/d6/d12/d43/f44 101811 0 2024-02-10T00:00:30.972 INFO:tasks.workunit.client.0.smithi164.stdout:6/276: chown d0/d6/d12/d45/f51 0 1 2024-02-10T00:00:30.972 INFO:tasks.workunit.client.0.smithi164.stdout:6/277: stat d0/d6/d12 0 2024-02-10T00:00:30.973 INFO:tasks.workunit.client.1.smithi183.stdout:8/620: dread d0/d3f/db2/d24/f28 [0,4194304] 0 2024-02-10T00:00:30.974 INFO:tasks.workunit.client.1.smithi183.stdout:2/656: creat d2/da/d20/d6d/fdc x:0 0 0 2024-02-10T00:00:30.974 INFO:tasks.workunit.client.1.smithi183.stdout:6/456: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f67 873053 1 2024-02-10T00:00:30.975 INFO:tasks.workunit.client.1.smithi183.stdout:6/457: chown d2/d1a/f20 50 1 2024-02-10T00:00:30.975 INFO:tasks.workunit.client.0.smithi164.stdout:7/235: dwrite d3/d5/f7 [0,4194304] 0 2024-02-10T00:00:30.977 INFO:tasks.workunit.client.1.smithi183.stdout:3/498: mkdir d7/db/d2a/d8e 0 2024-02-10T00:00:30.978 INFO:tasks.workunit.client.0.smithi164.stdout:9/221: creat d6/d41/f44 x:0 0 0 2024-02-10T00:00:30.979 INFO:tasks.workunit.client.1.smithi183.stdout:1/519: symlink d0/d3/d7/lbb 0 2024-02-10T00:00:30.979 INFO:tasks.workunit.client.0.smithi164.stdout:4/197: mkdir d2/d19/d16/d31/d4b 0 2024-02-10T00:00:30.980 INFO:tasks.workunit.client.1.smithi183.stdout:0/513: mknod d14/d3e/d9b/cbf 0 2024-02-10T00:00:30.980 INFO:tasks.workunit.client.0.smithi164.stdout:7/236: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:30.981 INFO:tasks.workunit.client.1.smithi183.stdout:6/458: mkdir d2/d1a/d25/d3c/d8d 0 2024-02-10T00:00:30.982 INFO:tasks.workunit.client.1.smithi183.stdout:2/657: rename d2/da/d77/dc7/db5/d35/l73 to d2/da/d20/d21/d36/ldd 0 2024-02-10T00:00:30.982 INFO:tasks.workunit.client.1.smithi183.stdout:8/621: dwrite d0/d4e/fa1 [0,4194304] 0 2024-02-10T00:00:30.983 INFO:tasks.workunit.client.0.smithi164.stdout:1/153: mknod d1/d1a/d2d/d18/d33/c36 0 2024-02-10T00:00:30.983 INFO:tasks.workunit.client.0.smithi164.stdout:9/222: chown d6/c1b 58 1 2024-02-10T00:00:30.983 INFO:tasks.workunit.client.0.smithi164.stdout:9/223: fdatasync d6/de/d2b/f37 0 2024-02-10T00:00:30.983 INFO:tasks.workunit.client.0.smithi164.stdout:9/224: chown d6/d1c/f2c 255572440 1 2024-02-10T00:00:30.984 INFO:tasks.workunit.client.1.smithi183.stdout:5/637: truncate d4/d23/d3e/d80/da1/d9e/d89/f90 598755 0 2024-02-10T00:00:30.984 INFO:tasks.workunit.client.1.smithi183.stdout:5/638: chown d4/f13 3316 1 2024-02-10T00:00:30.984 INFO:tasks.workunit.client.1.smithi183.stdout:5/639: stat d4/d23/d3e/d80/da1/d9e/d89 0 2024-02-10T00:00:30.985 INFO:tasks.workunit.client.1.smithi183.stdout:1/520: symlink d0/d3/d29/d1f/d86/lbc 0 2024-02-10T00:00:30.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/154: mkdir d1/d23/d37 0 2024-02-10T00:00:30.989 INFO:tasks.workunit.client.1.smithi183.stdout:8/622: creat d0/d27/d36/fc4 x:0 0 0 2024-02-10T00:00:30.989 INFO:tasks.workunit.client.1.smithi183.stdout:3/499: dwrite d7/db/d2a/d33/f56 [4194304,4194304] 0 2024-02-10T00:00:30.990 INFO:tasks.workunit.client.0.smithi164.stdout:7/237: mknod d3/d28/d45/d4b/c52 0 2024-02-10T00:00:30.992 INFO:tasks.workunit.client.0.smithi164.stdout:4/198: creat d2/d2f/f4c x:0 0 0 2024-02-10T00:00:30.992 INFO:tasks.workunit.client.0.smithi164.stdout:9/225: dwrite f5 [4194304,4194304] 0 2024-02-10T00:00:30.993 INFO:tasks.workunit.client.0.smithi164.stdout:9/226: dread d6/f1a [0,4194304] 0 2024-02-10T00:00:30.994 INFO:tasks.workunit.client.0.smithi164.stdout:5/203: sync 2024-02-10T00:00:30.994 INFO:tasks.workunit.client.0.smithi164.stdout:5/204: fdatasync d7/d17/d21/d24/f3d 0 2024-02-10T00:00:30.995 INFO:tasks.workunit.client.0.smithi164.stdout:5/205: write d7/d17/d21/d23/f2d [705465,125618] 0 2024-02-10T00:00:30.996 INFO:tasks.workunit.client.1.smithi183.stdout:0/514: truncate d14/d1d/d59/d71/d22/f4f 3267921 0 2024-02-10T00:00:30.997 INFO:tasks.workunit.client.1.smithi183.stdout:5/640: read d4/d23/d3e/d80/da1/d9e/d27/d38/f88 [349726,29609] 0 2024-02-10T00:00:30.997 INFO:tasks.workunit.client.1.smithi183.stdout:3/500: dread - d7/db/d2a/d1c/f5c zero size 2024-02-10T00:00:30.998 INFO:tasks.workunit.client.1.smithi183.stdout:0/515: fsync d14/d3e/d5f/fb1 0 2024-02-10T00:00:30.998 INFO:tasks.workunit.client.1.smithi183.stdout:6/459: creat d2/d1a/d25/f8e x:0 0 0 2024-02-10T00:00:30.999 INFO:tasks.workunit.client.0.smithi164.stdout:1/155: symlink d1/l38 0 2024-02-10T00:00:31.000 INFO:tasks.workunit.client.0.smithi164.stdout:9/227: read d6/de/f11 [3766541,31588] 0 2024-02-10T00:00:31.000 INFO:tasks.workunit.client.0.smithi164.stdout:7/238: creat d3/d5/d2b/d4a/f53 x:0 0 0 2024-02-10T00:00:31.001 INFO:tasks.workunit.client.1.smithi183.stdout:1/521: creat d0/d3/d7/d3d/d60/d89/fbd x:0 0 0 2024-02-10T00:00:31.001 INFO:tasks.workunit.client.1.smithi183.stdout:5/641: read d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/f78 [1271563,91697] 0 2024-02-10T00:00:31.002 INFO:tasks.workunit.client.1.smithi183.stdout:3/501: mkdir d7/db/d2a/d2d/d51/d8f 0 2024-02-10T00:00:31.003 INFO:tasks.workunit.client.0.smithi164.stdout:5/206: symlink d7/d17/d21/l42 0 2024-02-10T00:00:31.004 INFO:tasks.workunit.client.1.smithi183.stdout:0/516: dread d14/d1d/d2d/f39 [0,4194304] 0 2024-02-10T00:00:31.004 INFO:tasks.workunit.client.0.smithi164.stdout:5/207: stat d7/fc 0 2024-02-10T00:00:31.005 INFO:tasks.workunit.client.0.smithi164.stdout:9/228: dwrite f2 [4194304,4194304] 0 2024-02-10T00:00:31.005 INFO:tasks.workunit.client.0.smithi164.stdout:7/239: symlink d3/d11/d39/d44/d48/l54 0 2024-02-10T00:00:31.006 INFO:tasks.workunit.client.1.smithi183.stdout:6/460: mknod d2/d1a/d25/d3c/d8d/c8f 0 2024-02-10T00:00:31.007 INFO:tasks.workunit.client.1.smithi183.stdout:3/502: dread d7/db/d2a/d33/d59/f86 [0,4194304] 0 2024-02-10T00:00:31.008 INFO:tasks.workunit.client.1.smithi183.stdout:4/542: dread de/d14/d4e/f94 [0,4194304] 0 2024-02-10T00:00:31.010 INFO:tasks.workunit.client.1.smithi183.stdout:0/517: mkdir d14/d1d/d59/d3c/dc0 0 2024-02-10T00:00:31.011 INFO:tasks.workunit.client.1.smithi183.stdout:4/543: mknod de/d19/d8d/ca8 0 2024-02-10T00:00:31.011 INFO:tasks.workunit.client.1.smithi183.stdout:6/461: dwrite d2/d1a/d3a/d45/f83 [0,4194304] 0 2024-02-10T00:00:31.012 INFO:tasks.workunit.client.1.smithi183.stdout:0/518: unlink ld 0 2024-02-10T00:00:31.014 INFO:tasks.workunit.client.1.smithi183.stdout:3/503: truncate d7/db/d2a/d33/d59/f8b 337063 0 2024-02-10T00:00:31.014 INFO:tasks.workunit.client.1.smithi183.stdout:6/462: write d2/d1a/d25/d3c/d31/d38/d3f/d5e/f7a [723318,83747] 0 2024-02-10T00:00:31.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/241: sync 2024-02-10T00:00:31.015 INFO:tasks.workunit.client.0.smithi164.stdout:0/166: sync 2024-02-10T00:00:31.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/242: chown d3/f19 12070056 1 2024-02-10T00:00:31.018 INFO:tasks.workunit.client.1.smithi183.stdout:0/519: unlink d14/d1d/d2d/d31/d68/ca4 0 2024-02-10T00:00:31.019 INFO:tasks.workunit.client.0.smithi164.stdout:0/167: mkdir d6/d10/d18/d2d/d35 0 2024-02-10T00:00:31.019 INFO:tasks.workunit.client.1.smithi183.stdout:6/463: write d2/d1a/f43 [1784487,7583] 0 2024-02-10T00:00:31.020 INFO:tasks.workunit.client.0.smithi164.stdout:0/168: write d6/d10/d18/d1c/f2c [743855,69269] 0 2024-02-10T00:00:31.020 INFO:tasks.workunit.client.0.smithi164.stdout:1/156: read d1/f1b [454443,92725] 0 2024-02-10T00:00:31.021 INFO:tasks.workunit.client.1.smithi183.stdout:1/522: dread d0/f78 [0,4194304] 0 2024-02-10T00:00:31.022 INFO:tasks.workunit.client.1.smithi183.stdout:3/504: mkdir d7/d90 0 2024-02-10T00:00:31.022 INFO:tasks.workunit.client.1.smithi183.stdout:0/520: symlink d14/d3e/lc1 0 2024-02-10T00:00:31.023 INFO:tasks.workunit.client.0.smithi164.stdout:0/169: unlink d6/d7/d14/c30 0 2024-02-10T00:00:31.023 INFO:tasks.workunit.client.1.smithi183.stdout:3/505: readlink d7/db/d2a/d2d/d51/l66 0 2024-02-10T00:00:31.023 INFO:tasks.workunit.client.0.smithi164.stdout:1/157: creat d1/d1a/f39 x:0 0 0 2024-02-10T00:00:31.024 INFO:tasks.workunit.client.1.smithi183.stdout:3/506: stat d7/db/d2a/d33/d59/d52/c89 0 2024-02-10T00:00:31.024 INFO:tasks.workunit.client.0.smithi164.stdout:1/158: dread - d1/d1a/f39 zero size 2024-02-10T00:00:31.025 INFO:tasks.workunit.client.1.smithi183.stdout:4/544: dread de/d14/d4e/fa1 [0,4194304] 0 2024-02-10T00:00:31.025 INFO:tasks.workunit.client.1.smithi183.stdout:0/521: creat d14/d1d/d55/fc2 x:0 0 0 2024-02-10T00:00:31.025 INFO:tasks.workunit.client.1.smithi183.stdout:3/507: dread - d7/db/d2a/d33/d59/d52/f64 zero size 2024-02-10T00:00:31.025 INFO:tasks.workunit.client.0.smithi164.stdout:0/170: mknod d6/c36 0 2024-02-10T00:00:31.027 INFO:tasks.workunit.client.1.smithi183.stdout:1/523: creat d0/d3/d7/d36/d7c/db1/fbe x:0 0 0 2024-02-10T00:00:31.031 INFO:tasks.workunit.client.1.smithi183.stdout:0/522: rename d14/d3e/d92/f64 to d14/d1d/d59/d71/fc3 0 2024-02-10T00:00:31.031 INFO:tasks.workunit.client.1.smithi183.stdout:0/523: chown l12 1319 1 2024-02-10T00:00:31.032 INFO:tasks.workunit.client.1.smithi183.stdout:4/545: dread de/d14/d27/d2e/f74 [0,4194304] 0 2024-02-10T00:00:31.032 INFO:tasks.workunit.client.1.smithi183.stdout:4/546: stat de/d14/d27/f55 0 2024-02-10T00:00:31.036 INFO:tasks.workunit.client.1.smithi183.stdout:4/547: creat de/d14/da4/fa9 x:0 0 0 2024-02-10T00:00:31.036 INFO:tasks.workunit.client.1.smithi183.stdout:4/548: fsync de/d14/d27/d2e/f86 0 2024-02-10T00:00:31.037 INFO:tasks.workunit.client.1.smithi183.stdout:1/524: rename d0/d3/d7/d3d/l43 to d0/d3/lbf 0 2024-02-10T00:00:31.037 INFO:tasks.workunit.client.1.smithi183.stdout:4/549: chown de/d14/d1d/d7b/c7c 3 1 2024-02-10T00:00:31.042 INFO:tasks.workunit.client.1.smithi183.stdout:4/550: link l8 de/d22/laa 0 2024-02-10T00:00:31.042 INFO:tasks.workunit.client.1.smithi183.stdout:1/525: link d0/c1e d0/d3/d29/d1f/d86/cc0 0 2024-02-10T00:00:31.044 INFO:tasks.workunit.client.0.smithi164.stdout:5/208: dread d7/f1d [0,4194304] 0 2024-02-10T00:00:31.044 INFO:tasks.workunit.client.1.smithi183.stdout:4/551: mkdir de/d19/d1c/d61/dab 0 2024-02-10T00:00:31.045 INFO:tasks.workunit.client.0.smithi164.stdout:5/209: rmdir d7 39 2024-02-10T00:00:31.046 INFO:tasks.workunit.client.1.smithi183.stdout:4/552: creat de/d22/fac x:0 0 0 2024-02-10T00:00:31.048 INFO:tasks.workunit.client.1.smithi183.stdout:4/553: readlink de/d19/d1c/l80 0 2024-02-10T00:00:31.048 INFO:tasks.workunit.client.1.smithi183.stdout:1/526: dwrite d0/d3/d7/f4a [0,4194304] 0 2024-02-10T00:00:31.052 INFO:tasks.workunit.client.1.smithi183.stdout:9/543: truncate d0/d10/f7c 1138874 0 2024-02-10T00:00:31.053 INFO:tasks.workunit.client.0.smithi164.stdout:1/159: write d1/f9 [1098559,12990] 0 2024-02-10T00:00:31.055 INFO:tasks.workunit.client.1.smithi183.stdout:4/554: dwrite de/d14/d27/d2e/f9f [0,4194304] 0 2024-02-10T00:00:31.056 INFO:tasks.workunit.client.0.smithi164.stdout:3/170: rename d0/f4 to d0/d1/d2/f2f 0 2024-02-10T00:00:31.061 INFO:tasks.workunit.client.1.smithi183.stdout:9/544: dread d0/d3/d14/d48/f5e [0,4194304] 0 2024-02-10T00:00:31.061 INFO:tasks.workunit.client.1.smithi183.stdout:4/555: dwrite de/d14/d1d/f59 [0,4194304] 0 2024-02-10T00:00:31.062 INFO:tasks.workunit.client.0.smithi164.stdout:8/177: write d2/f13 [4343748,110901] 0 2024-02-10T00:00:31.062 INFO:tasks.workunit.client.0.smithi164.stdout:8/178: write d2/f27 [689471,257] 0 2024-02-10T00:00:31.062 INFO:tasks.workunit.client.0.smithi164.stdout:1/160: mkdir d1/d1a/d2d/d18/d3a 0 2024-02-10T00:00:31.062 INFO:tasks.workunit.client.0.smithi164.stdout:3/171: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:31.063 INFO:tasks.workunit.client.0.smithi164.stdout:3/172: chown d0/c20 3882457 1 2024-02-10T00:00:31.063 INFO:tasks.workunit.client.0.smithi164.stdout:3/173: fdatasync d0/d1/d2/f12 0 2024-02-10T00:00:31.063 INFO:tasks.workunit.client.0.smithi164.stdout:6/278: rename d0/d6/d12/d14/f29 to d0/d2b/d3a/f53 0 2024-02-10T00:00:31.063 INFO:tasks.workunit.client.1.smithi183.stdout:2/658: write d2/da/d5b/f88 [1452446,75521] 0 2024-02-10T00:00:31.064 INFO:tasks.workunit.client.1.smithi183.stdout:4/556: dwrite de/d14/f16 [0,4194304] 0 2024-02-10T00:00:31.068 INFO:tasks.workunit.client.1.smithi183.stdout:8/623: dwrite d0/d3f/db2/d24/f7a [0,4194304] 0 2024-02-10T00:00:31.068 INFO:tasks.workunit.client.0.smithi164.stdout:2/243: rename d3/d26/f48 to d3/d32/d4e/f5e 0 2024-02-10T00:00:31.069 INFO:tasks.workunit.client.0.smithi164.stdout:1/161: rename d1 to d1/d1a/d2d/d18/d3b 22 2024-02-10T00:00:31.069 INFO:tasks.workunit.client.0.smithi164.stdout:6/279: write d0/d2b/f39 [1233430,102579] 0 2024-02-10T00:00:31.069 INFO:tasks.workunit.client.0.smithi164.stdout:3/174: mkdir d0/d1/d2/d19/d27/d30 0 2024-02-10T00:00:31.070 INFO:tasks.workunit.client.1.smithi183.stdout:4/557: dread de/d14/d27/d2e/f9f [0,4194304] 0 2024-02-10T00:00:31.071 INFO:tasks.workunit.client.0.smithi164.stdout:6/280: write d0/f21 [217818,108678] 0 2024-02-10T00:00:31.074 INFO:tasks.workunit.client.0.smithi164.stdout:6/281: dwrite d0/d2b/f36 [0,4194304] 0 2024-02-10T00:00:31.075 INFO:tasks.workunit.client.1.smithi183.stdout:2/659: dread d2/d2c/d2f/d60/d8d/d9c/fb2 [0,4194304] 0 2024-02-10T00:00:31.076 INFO:tasks.workunit.client.0.smithi164.stdout:6/282: write d0/d2b/f39 [40752,113433] 0 2024-02-10T00:00:31.076 INFO:tasks.workunit.client.0.smithi164.stdout:8/179: mkdir d2/d12/d21/d31/d32 0 2024-02-10T00:00:31.076 INFO:tasks.workunit.client.0.smithi164.stdout:6/283: stat d0/d6/d12/d14/c2c 0 2024-02-10T00:00:31.077 INFO:tasks.workunit.client.0.smithi164.stdout:2/244: symlink d3/d32/d4e/l5f 0 2024-02-10T00:00:31.077 INFO:tasks.workunit.client.0.smithi164.stdout:6/284: write d0/f17 [1997283,40342] 0 2024-02-10T00:00:31.077 INFO:tasks.workunit.client.1.smithi183.stdout:5/642: dwrite d4/d23/d3e/d80/da1/d9e/f3f [0,4194304] 0 2024-02-10T00:00:31.077 INFO:tasks.workunit.client.1.smithi183.stdout:7/527: write d0/d2/f2b [1627629,3043] 0 2024-02-10T00:00:31.078 INFO:tasks.workunit.client.0.smithi164.stdout:6/285: write d0/d6/d12/d14/f24 [496029,23829] 0 2024-02-10T00:00:31.082 INFO:tasks.workunit.client.0.smithi164.stdout:8/180: symlink d2/l33 0 2024-02-10T00:00:31.083 INFO:tasks.workunit.client.0.smithi164.stdout:8/181: read d2/f13 [1188947,99670] 0 2024-02-10T00:00:31.083 INFO:tasks.workunit.client.0.smithi164.stdout:8/182: write d2/f2c [680765,122804] 0 2024-02-10T00:00:31.084 INFO:tasks.workunit.client.1.smithi183.stdout:6/464: dwrite d2/f4b [4194304,4194304] 0 2024-02-10T00:00:31.084 INFO:tasks.workunit.client.0.smithi164.stdout:8/183: fdatasync d2/f10 0 2024-02-10T00:00:31.084 INFO:tasks.workunit.client.0.smithi164.stdout:8/184: stat d2/l26 0 2024-02-10T00:00:31.085 INFO:tasks.workunit.client.1.smithi183.stdout:6/465: write d2/d1a/d25/d3c/d31/d38/d6e/f2e [2286854,104065] 0 2024-02-10T00:00:31.087 INFO:tasks.workunit.client.0.smithi164.stdout:2/245: rename d3/c30 to d3/d24/c60 0 2024-02-10T00:00:31.088 INFO:tasks.workunit.client.0.smithi164.stdout:2/246: stat d3/l5 0 2024-02-10T00:00:31.088 INFO:tasks.workunit.client.0.smithi164.stdout:6/286: creat d0/d6/f54 x:0 0 0 2024-02-10T00:00:31.088 INFO:tasks.workunit.client.0.smithi164.stdout:2/247: fsync d3/fd 0 2024-02-10T00:00:31.089 INFO:tasks.workunit.client.0.smithi164.stdout:8/185: dwrite d2/f11 [4194304,4194304] 0 2024-02-10T00:00:31.090 INFO:tasks.workunit.client.1.smithi183.stdout:8/624: symlink d0/d27/lc5 0 2024-02-10T00:00:31.091 INFO:tasks.workunit.client.0.smithi164.stdout:2/248: dread - d3/d32/d4e/d27/d2e/d36/f5d zero size 2024-02-10T00:00:31.093 INFO:tasks.workunit.client.0.smithi164.stdout:2/249: chown d3/d32/d4e/d27/d2e/c47 0 1 2024-02-10T00:00:31.093 INFO:tasks.workunit.client.0.smithi164.stdout:6/287: dwrite d0/f2f [0,4194304] 0 2024-02-10T00:00:31.094 INFO:tasks.workunit.client.0.smithi164.stdout:7/240: write d3/d11/f14 [1745240,9069] 0 2024-02-10T00:00:31.095 INFO:tasks.workunit.client.0.smithi164.stdout:7/241: dread - d3/d28/f3f zero size 2024-02-10T00:00:31.096 INFO:tasks.workunit.client.0.smithi164.stdout:4/199: getdents d2/d2f 0 2024-02-10T00:00:31.098 INFO:tasks.workunit.client.0.smithi164.stdout:6/288: creat d0/d2b/d3a/f55 x:0 0 0 2024-02-10T00:00:31.098 INFO:tasks.workunit.client.0.smithi164.stdout:9/229: write d6/d1c/f1d [1628770,65483] 0 2024-02-10T00:00:31.100 INFO:tasks.workunit.client.0.smithi164.stdout:0/171: write d6/d10/d18/d2d/f2e [2812229,27238] 0 2024-02-10T00:00:31.102 INFO:tasks.workunit.client.1.smithi183.stdout:7/528: creat d0/d11/d35/f97 x:0 0 0 2024-02-10T00:00:31.102 INFO:tasks.workunit.client.1.smithi183.stdout:6/466: fsync d2/d1a/d3a/f57 0 2024-02-10T00:00:31.103 INFO:tasks.workunit.client.0.smithi164.stdout:4/200: creat d2/d19/d16/d31/f4d x:0 0 0 2024-02-10T00:00:31.103 INFO:tasks.workunit.client.0.smithi164.stdout:2/250: dwrite d3/f15 [4194304,4194304] 0 2024-02-10T00:00:31.103 INFO:tasks.workunit.client.1.smithi183.stdout:6/467: write d2/d1a/d25/d3c/d31/f70 [3715964,63344] 0 2024-02-10T00:00:31.104 INFO:tasks.workunit.client.0.smithi164.stdout:2/251: write d3/d32/d4e/f59 [2866800,89966] 0 2024-02-10T00:00:31.105 INFO:tasks.workunit.client.1.smithi183.stdout:8/625: rmdir d0/d23 39 2024-02-10T00:00:31.106 INFO:tasks.workunit.client.0.smithi164.stdout:7/242: creat d3/d4d/f55 x:0 0 0 2024-02-10T00:00:31.106 INFO:tasks.workunit.client.0.smithi164.stdout:8/186: truncate d2/d12/d21/f2d 417640 0 2024-02-10T00:00:31.106 INFO:tasks.workunit.client.0.smithi164.stdout:8/187: fdatasync d2/f27 0 2024-02-10T00:00:31.106 INFO:tasks.workunit.client.1.smithi183.stdout:8/626: fdatasync d0/d3f/db2/d24/f54 0 2024-02-10T00:00:31.107 INFO:tasks.workunit.client.0.smithi164.stdout:7/243: dread d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:31.107 INFO:tasks.workunit.client.0.smithi164.stdout:0/172: creat d6/d10/d18/d2d/f37 x:0 0 0 2024-02-10T00:00:31.108 INFO:tasks.workunit.client.1.smithi183.stdout:6/468: dwrite d2/d1a/d25/d3c/d31/f70 [4194304,4194304] 0 2024-02-10T00:00:31.109 INFO:tasks.workunit.client.1.smithi183.stdout:6/469: write d2/d1a/d25/f2c [4746044,97541] 0 2024-02-10T00:00:31.111 INFO:tasks.workunit.client.0.smithi164.stdout:2/252: creat d3/f61 x:0 0 0 2024-02-10T00:00:31.112 INFO:tasks.workunit.client.0.smithi164.stdout:0/173: dwrite d6/d10/d18/d2d/f2e [0,4194304] 0 2024-02-10T00:00:31.113 INFO:tasks.workunit.client.0.smithi164.stdout:0/174: chown d6/d10/d18/d1c/l29 0 1 2024-02-10T00:00:31.113 INFO:tasks.workunit.client.0.smithi164.stdout:2/253: write d3/d32/d4e/d27/d2e/d36/f5d [829610,16020] 0 2024-02-10T00:00:31.113 INFO:tasks.workunit.client.0.smithi164.stdout:8/188: stat d2/c5 0 2024-02-10T00:00:31.114 INFO:tasks.workunit.client.0.smithi164.stdout:0/175: chown d6/d7/d14/f27 880 1 2024-02-10T00:00:31.116 INFO:tasks.workunit.client.0.smithi164.stdout:6/289: truncate d0/d6/d12/f27 778029 0 2024-02-10T00:00:31.117 INFO:tasks.workunit.client.1.smithi183.stdout:3/508: dread d7/db/d2a/f2c [0,4194304] 0 2024-02-10T00:00:31.117 INFO:tasks.workunit.client.1.smithi183.stdout:2/660: link d2/d2c/d2f/d60/d8d/d9c/da7/dd4/ca2 d2/da/d20/d21/d43/d58/d74/d83/cde 0 2024-02-10T00:00:31.117 INFO:tasks.workunit.client.1.smithi183.stdout:5/643: getdents d4/d23/d4a 0 2024-02-10T00:00:31.118 INFO:tasks.workunit.client.1.smithi183.stdout:5/644: readlink d4/l3a 0 2024-02-10T00:00:31.118 INFO:tasks.workunit.client.1.smithi183.stdout:2/661: chown d2/d2c/dab/d99/fa3 29465755 1 2024-02-10T00:00:31.119 INFO:tasks.workunit.client.0.smithi164.stdout:2/254: write d3/d32/d4e/f5e [918456,113538] 0 2024-02-10T00:00:31.119 INFO:tasks.workunit.client.0.smithi164.stdout:2/255: write d3/f4a [436605,96685] 0 2024-02-10T00:00:31.119 INFO:tasks.workunit.client.0.smithi164.stdout:0/176: mknod d6/d10/d18/d1c/c38 0 2024-02-10T00:00:31.120 INFO:tasks.workunit.client.1.smithi183.stdout:2/662: write d2/da/d20/f37 [1324814,109846] 0 2024-02-10T00:00:31.120 INFO:tasks.workunit.client.1.smithi183.stdout:7/529: creat d0/d11/f98 x:0 0 0 2024-02-10T00:00:31.121 INFO:tasks.workunit.client.0.smithi164.stdout:7/244: mknod d3/d11/d39/d44/d48/d50/c56 0 2024-02-10T00:00:31.121 INFO:tasks.workunit.client.1.smithi183.stdout:8/627: mknod d0/d23/db1/cc6 0 2024-02-10T00:00:31.122 INFO:tasks.workunit.client.0.smithi164.stdout:2/256: creat d3/f62 x:0 0 0 2024-02-10T00:00:31.122 INFO:tasks.workunit.client.1.smithi183.stdout:5/645: truncate d4/d23/d4a/d36/fb8 307659 0 2024-02-10T00:00:31.124 INFO:tasks.workunit.client.1.smithi183.stdout:2/663: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:31.130 INFO:tasks.workunit.client.1.smithi183.stdout:3/509: creat d7/db/d2a/f91 x:0 0 0 2024-02-10T00:00:31.130 INFO:tasks.workunit.client.1.smithi183.stdout:8/628: mknod d0/d4e/cc7 0 2024-02-10T00:00:31.130 INFO:tasks.workunit.client.1.smithi183.stdout:7/530: symlink d0/d11/l99 0 2024-02-10T00:00:31.131 INFO:tasks.workunit.client.1.smithi183.stdout:5/646: rmdir d4/dd/d31/d73 39 2024-02-10T00:00:31.132 INFO:tasks.workunit.client.0.smithi164.stdout:2/257: truncate d3/f7 1181479 0 2024-02-10T00:00:31.132 INFO:tasks.workunit.client.0.smithi164.stdout:6/290: dwrite d0/d2b/d3a/f53 [0,4194304] 0 2024-02-10T00:00:31.133 INFO:tasks.workunit.client.1.smithi183.stdout:2/664: mkdir d2/d2c/dab/d99/ddf 0 2024-02-10T00:00:31.134 INFO:tasks.workunit.client.0.smithi164.stdout:5/210: dwrite d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:31.135 INFO:tasks.workunit.client.1.smithi183.stdout:3/510: dwrite d7/db/d2a/f65 [0,4194304] 0 2024-02-10T00:00:31.136 INFO:tasks.workunit.client.1.smithi183.stdout:7/531: fsync d0/d11/d3e/f49 0 2024-02-10T00:00:31.138 INFO:tasks.workunit.client.0.smithi164.stdout:6/291: mkdir d0/d3b/d56 0 2024-02-10T00:00:31.138 INFO:tasks.workunit.client.1.smithi183.stdout:2/665: dread d2/da/d20/d21/f29 [0,4194304] 0 2024-02-10T00:00:31.139 INFO:tasks.workunit.client.0.smithi164.stdout:5/211: mkdir d7/d17/d3b/d43 0 2024-02-10T00:00:31.139 INFO:tasks.workunit.client.1.smithi183.stdout:2/666: dread - d2/da/d20/d6d/fdc zero size 2024-02-10T00:00:31.141 INFO:tasks.workunit.client.0.smithi164.stdout:6/292: mkdir d0/d6/d12/d57 0 2024-02-10T00:00:31.142 INFO:tasks.workunit.client.1.smithi183.stdout:7/532: rename d0/d11/c16 to d0/d11/d35/c9a 0 2024-02-10T00:00:31.142 INFO:tasks.workunit.client.0.smithi164.stdout:5/212: rmdir d7/d17/d21/d23/d37 39 2024-02-10T00:00:31.142 INFO:tasks.workunit.client.0.smithi164.stdout:5/213: chown d7/d17/f3f 53261179 1 2024-02-10T00:00:31.143 INFO:tasks.workunit.client.1.smithi183.stdout:5/647: creat d4/d23/d3e/d80/da1/d9e/d27/fcb x:0 0 0 2024-02-10T00:00:31.143 INFO:tasks.workunit.client.0.smithi164.stdout:5/214: chown d7/f1d 2307960 1 2024-02-10T00:00:31.143 INFO:tasks.workunit.client.1.smithi183.stdout:2/667: mknod d2/d2c/d2f/d60/d8d/d9c/da7/ce0 0 2024-02-10T00:00:31.145 INFO:tasks.workunit.client.0.smithi164.stdout:6/293: creat d0/d6/d12/d57/f58 x:0 0 0 2024-02-10T00:00:31.145 INFO:tasks.workunit.client.1.smithi183.stdout:7/533: creat d0/d11/d35/f9b x:0 0 0 2024-02-10T00:00:31.145 INFO:tasks.workunit.client.1.smithi183.stdout:3/511: getdents d7/db/d2a/d4d 0 2024-02-10T00:00:31.145 INFO:tasks.workunit.client.0.smithi164.stdout:5/215: creat d7/d15/d1f/f44 x:0 0 0 2024-02-10T00:00:31.146 INFO:tasks.workunit.client.0.smithi164.stdout:5/216: read d7/f1d [1232495,96473] 0 2024-02-10T00:00:31.149 INFO:tasks.workunit.client.0.smithi164.stdout:6/294: dwrite d0/d6/f7 [0,4194304] 0 2024-02-10T00:00:31.151 INFO:tasks.workunit.client.1.smithi183.stdout:2/668: creat d2/da/d20/d21/d43/d58/d74/d83/dc4/fe1 x:0 0 0 2024-02-10T00:00:31.153 INFO:tasks.workunit.client.1.smithi183.stdout:3/512: dread d7/db/d2a/d33/d59/f8b [0,4194304] 0 2024-02-10T00:00:31.153 INFO:tasks.workunit.client.1.smithi183.stdout:3/513: stat d7/f5a 0 2024-02-10T00:00:31.153 INFO:tasks.workunit.client.1.smithi183.stdout:3/514: readlink d7/l22 0 2024-02-10T00:00:31.154 INFO:tasks.workunit.client.1.smithi183.stdout:2/669: mkdir d2/da/d19/d31/de2 0 2024-02-10T00:00:31.158 INFO:tasks.workunit.client.0.smithi164.stdout:6/295: read d0/d6/f32 [746929,92755] 0 2024-02-10T00:00:31.159 INFO:tasks.workunit.client.1.smithi183.stdout:7/534: rename d0/d11/d3e/l95 to d0/d11/l9c 0 2024-02-10T00:00:31.159 INFO:tasks.workunit.client.1.smithi183.stdout:7/535: dread - d0/d11/f82 zero size 2024-02-10T00:00:31.160 INFO:tasks.workunit.client.1.smithi183.stdout:2/670: creat d2/da/d77/dc7/db5/d35/fe3 x:0 0 0 2024-02-10T00:00:31.161 INFO:tasks.workunit.client.0.smithi164.stdout:6/296: dread d0/f1a [0,4194304] 0 2024-02-10T00:00:31.161 INFO:tasks.workunit.client.1.smithi183.stdout:2/671: dread - d2/da/d77/dc7/db5/d35/fa5 zero size 2024-02-10T00:00:31.162 INFO:tasks.workunit.client.0.smithi164.stdout:6/297: chown d0/f1a 13 1 2024-02-10T00:00:31.162 INFO:tasks.workunit.client.0.smithi164.stdout:6/298: write d0/d6/d12/f18 [123228,40936] 0 2024-02-10T00:00:31.163 INFO:tasks.workunit.client.0.smithi164.stdout:7/245: dread d3/d26/f27 [0,4194304] 0 2024-02-10T00:00:31.163 INFO:tasks.workunit.client.1.smithi183.stdout:2/672: write d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d [3012405,62153] 0 2024-02-10T00:00:31.164 INFO:tasks.workunit.client.0.smithi164.stdout:6/299: creat d0/d6/f59 x:0 0 0 2024-02-10T00:00:31.165 INFO:tasks.workunit.client.0.smithi164.stdout:8/189: sync 2024-02-10T00:00:31.166 INFO:tasks.workunit.client.0.smithi164.stdout:8/190: write d2/f2c [1553768,44361] 0 2024-02-10T00:00:31.166 INFO:tasks.workunit.client.1.smithi183.stdout:5/648: truncate d4/d23/d4a/d36/fb8 639122 0 2024-02-10T00:00:31.166 INFO:tasks.workunit.client.0.smithi164.stdout:6/300: unlink d0/d6/d12/f41 0 2024-02-10T00:00:31.167 INFO:tasks.workunit.client.0.smithi164.stdout:6/301: write d0/d6/f54 [237316,51762] 0 2024-02-10T00:00:31.168 INFO:tasks.workunit.client.1.smithi183.stdout:2/673: creat d2/d2c/dab/fe4 x:0 0 0 2024-02-10T00:00:31.168 INFO:tasks.workunit.client.0.smithi164.stdout:6/302: rmdir d0/d3b 39 2024-02-10T00:00:31.169 INFO:tasks.workunit.client.1.smithi183.stdout:7/536: truncate d0/d2/d3/f90 473855 0 2024-02-10T00:00:31.169 INFO:tasks.workunit.client.0.smithi164.stdout:8/191: creat d2/d12/d21/d31/d32/f34 x:0 0 0 2024-02-10T00:00:31.170 INFO:tasks.workunit.client.0.smithi164.stdout:8/192: chown d2/d12/l14 2 1 2024-02-10T00:00:31.170 INFO:tasks.workunit.client.0.smithi164.stdout:8/193: chown d2/d12/d21 158981 1 2024-02-10T00:00:31.171 INFO:tasks.workunit.client.0.smithi164.stdout:6/303: dread d0/fb [0,4194304] 0 2024-02-10T00:00:31.172 INFO:tasks.workunit.client.0.smithi164.stdout:8/194: chown d2/l18 0 1 2024-02-10T00:00:31.172 INFO:tasks.workunit.client.1.smithi183.stdout:7/537: mkdir d0/d11/d9d 0 2024-02-10T00:00:31.174 INFO:tasks.workunit.client.1.smithi183.stdout:2/674: rmdir d2/da/d77/dc7/db5/d35/db1 0 2024-02-10T00:00:31.175 INFO:tasks.workunit.client.0.smithi164.stdout:8/195: truncate d2/f25 387713 0 2024-02-10T00:00:31.177 INFO:tasks.workunit.client.1.smithi183.stdout:7/538: dwrite d0/d11/d35/f97 [0,4194304] 0 2024-02-10T00:00:31.180 INFO:tasks.workunit.client.1.smithi183.stdout:2/675: dread d2/da/d77/dc7/fd2 [0,4194304] 0 2024-02-10T00:00:31.180 INFO:tasks.workunit.client.1.smithi183.stdout:6/470: sync 2024-02-10T00:00:31.181 INFO:tasks.workunit.client.1.smithi183.stdout:7/539: rename d0/d11/d3e/l8d to d0/d11/d2f/d64/d6b/l9e 0 2024-02-10T00:00:31.181 INFO:tasks.workunit.client.1.smithi183.stdout:2/676: write d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d [555833,16059] 0 2024-02-10T00:00:31.182 INFO:tasks.workunit.client.1.smithi183.stdout:6/471: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:31.182 INFO:tasks.workunit.client.1.smithi183.stdout:2/677: dread - d2/d8b/fb3 zero size 2024-02-10T00:00:31.184 INFO:tasks.workunit.client.1.smithi183.stdout:6/472: unlink d2/f30 0 2024-02-10T00:00:31.186 INFO:tasks.workunit.client.1.smithi183.stdout:6/473: fsync d2/d1a/d25/d3c/d31/d66/f71 0 2024-02-10T00:00:31.187 INFO:tasks.workunit.client.1.smithi183.stdout:7/540: link d0/d2/f2b d0/d2/d4/d8/f9f 0 2024-02-10T00:00:31.187 INFO:tasks.workunit.client.1.smithi183.stdout:2/678: mknod d2/da/d20/d21/d36/dc6/ce5 0 2024-02-10T00:00:31.193 INFO:tasks.workunit.client.1.smithi183.stdout:7/541: getdents d0/d2 0 2024-02-10T00:00:31.193 INFO:tasks.workunit.client.1.smithi183.stdout:2/679: getdents d2/d8b 0 2024-02-10T00:00:31.194 INFO:tasks.workunit.client.1.smithi183.stdout:2/680: write d2/d2c/dab/d99/fa3 [1357244,76262] 0 2024-02-10T00:00:31.196 INFO:tasks.workunit.client.0.smithi164.stdout:9/230: dread d6/de/d22/f26 [0,4194304] 0 2024-02-10T00:00:31.197 INFO:tasks.workunit.client.1.smithi183.stdout:2/681: creat d2/d2c/d2f/d60/d8d/d9c/da7/fe6 x:0 0 0 2024-02-10T00:00:31.200 INFO:tasks.workunit.client.0.smithi164.stdout:9/231: link d6/de/f21 d6/d1c/d24/f45 0 2024-02-10T00:00:31.200 INFO:tasks.workunit.client.1.smithi183.stdout:0/524: dread d14/d1d/f32 [0,4194304] 0 2024-02-10T00:00:31.201 INFO:tasks.workunit.client.0.smithi164.stdout:9/232: creat d6/de/d40/f46 x:0 0 0 2024-02-10T00:00:31.202 INFO:tasks.workunit.client.1.smithi183.stdout:0/525: readlink d14/d1d/d59/d71/l1e 0 2024-02-10T00:00:31.202 INFO:tasks.workunit.client.0.smithi164.stdout:9/233: write d6/de/f14 [271840,65949] 0 2024-02-10T00:00:31.205 INFO:tasks.workunit.client.0.smithi164.stdout:1/162: fdatasync d1/f9 0 2024-02-10T00:00:31.205 INFO:tasks.workunit.client.0.smithi164.stdout:1/163: rename d1 to d1/d13/d1f/d3c 22 2024-02-10T00:00:31.206 INFO:tasks.workunit.client.0.smithi164.stdout:1/164: dread - d1/d13/d1f/f28 zero size 2024-02-10T00:00:31.206 INFO:tasks.workunit.client.0.smithi164.stdout:1/165: write d1/d1a/d35/f31 [894394,12680] 0 2024-02-10T00:00:31.209 INFO:tasks.workunit.client.0.smithi164.stdout:1/166: mknod d1/d1a/d2d/c3d 0 2024-02-10T00:00:31.212 INFO:tasks.workunit.client.1.smithi183.stdout:0/526: dread d14/f17 [0,4194304] 0 2024-02-10T00:00:31.214 INFO:tasks.workunit.client.1.smithi183.stdout:4/558: rmdir de/d19 39 2024-02-10T00:00:31.214 INFO:tasks.workunit.client.1.smithi183.stdout:0/527: fsync d14/d1d/d59/d71/fc3 0 2024-02-10T00:00:31.218 INFO:tasks.workunit.client.0.smithi164.stdout:1/167: truncate d1/d1a/f22 606981 0 2024-02-10T00:00:31.218 INFO:tasks.workunit.client.1.smithi183.stdout:0/528: symlink d14/d3e/d5f/daa/lc4 0 2024-02-10T00:00:31.219 INFO:tasks.workunit.client.0.smithi164.stdout:1/168: fsync d1/d1a/d2d/fb 0 2024-02-10T00:00:31.220 INFO:tasks.workunit.client.0.smithi164.stdout:1/169: fsync d1/d13/f19 0 2024-02-10T00:00:31.221 INFO:tasks.workunit.client.0.smithi164.stdout:1/170: read d1/d13/f14 [951462,59940] 0 2024-02-10T00:00:31.222 INFO:tasks.workunit.client.1.smithi183.stdout:0/529: dwrite d14/d1d/d59/d71/d22/f41 [0,4194304] 0 2024-02-10T00:00:31.222 INFO:tasks.workunit.client.0.smithi164.stdout:5/217: dread d7/f32 [0,4194304] 0 2024-02-10T00:00:31.225 INFO:tasks.workunit.client.0.smithi164.stdout:1/171: link d1/fd d1/d1a/d2d/d18/f3e 0 2024-02-10T00:00:31.227 INFO:tasks.workunit.client.1.smithi183.stdout:0/530: dwrite d14/d1d/d2d/f8a [0,4194304] 0 2024-02-10T00:00:31.230 INFO:tasks.workunit.client.1.smithi183.stdout:0/531: creat d14/d1d/d55/d6e/fc5 x:0 0 0 2024-02-10T00:00:31.231 INFO:tasks.workunit.client.1.smithi183.stdout:0/532: read d14/d1d/f32 [976958,36905] 0 2024-02-10T00:00:31.233 INFO:tasks.workunit.client.1.smithi183.stdout:9/545: write d0/d3/d14/f46 [3525629,88775] 0 2024-02-10T00:00:31.234 INFO:tasks.workunit.client.1.smithi183.stdout:0/533: symlink d14/d1d/d59/lc6 0 2024-02-10T00:00:31.235 INFO:tasks.workunit.client.1.smithi183.stdout:0/534: write d14/d7a/f62 [4895907,99562] 0 2024-02-10T00:00:31.236 INFO:tasks.workunit.client.0.smithi164.stdout:0/177: fdatasync d6/d10/d18/d2d/f2e 0 2024-02-10T00:00:31.237 INFO:tasks.workunit.client.0.smithi164.stdout:3/175: dread d0/d1/d2/fe [0,4194304] 0 2024-02-10T00:00:31.237 INFO:tasks.workunit.client.1.smithi183.stdout:1/527: dwrite d0/d3c/f73 [0,4194304] 0 2024-02-10T00:00:31.238 INFO:tasks.workunit.client.1.smithi183.stdout:0/535: readlink d14/d1d/d59/d3c/l9f 0 2024-02-10T00:00:31.238 INFO:tasks.workunit.client.0.smithi164.stdout:0/178: chown d6/d10/d18/f31 959701715 1 2024-02-10T00:00:31.240 INFO:tasks.workunit.client.1.smithi183.stdout:9/546: chown d0/d3/d14/d1c/d2d/d4f/fb1 31 1 2024-02-10T00:00:31.240 INFO:tasks.workunit.client.0.smithi164.stdout:9/234: sync 2024-02-10T00:00:31.241 INFO:tasks.workunit.client.0.smithi164.stdout:7/246: rmdir d3/d4d 39 2024-02-10T00:00:31.242 INFO:tasks.workunit.client.0.smithi164.stdout:7/247: write d3/d5/d2b/d4a/f53 [674488,39380] 0 2024-02-10T00:00:31.243 INFO:tasks.workunit.client.0.smithi164.stdout:3/176: creat d0/d1/dd/f31 x:0 0 0 2024-02-10T00:00:31.243 INFO:tasks.workunit.client.1.smithi183.stdout:0/536: rename d14/d1d/d59/cbb to d14/d1d/d2d/d31/d68/cc7 0 2024-02-10T00:00:31.243 INFO:tasks.workunit.client.0.smithi164.stdout:0/179: mkdir d6/d10/d18/d2d/d39 0 2024-02-10T00:00:31.244 INFO:tasks.workunit.client.0.smithi164.stdout:4/201: write d2/d19/d16/f25 [1342787,69968] 0 2024-02-10T00:00:31.245 INFO:tasks.workunit.client.0.smithi164.stdout:4/202: chown d2/d2f/d37/c3c 1576 1 2024-02-10T00:00:31.247 INFO:tasks.workunit.client.0.smithi164.stdout:9/235: symlink d6/d1c/l47 0 2024-02-10T00:00:31.247 INFO:tasks.workunit.client.0.smithi164.stdout:3/177: mknod d0/d1/c32 0 2024-02-10T00:00:31.249 INFO:tasks.workunit.client.0.smithi164.stdout:6/304: dread d0/f17 [0,4194304] 0 2024-02-10T00:00:31.249 INFO:tasks.workunit.client.0.smithi164.stdout:9/236: dread - d6/d1c/d24/f42 zero size 2024-02-10T00:00:31.250 INFO:tasks.workunit.client.0.smithi164.stdout:0/180: dwrite d6/d7/d14/f1b [8388608,4194304] 0 2024-02-10T00:00:31.252 INFO:tasks.workunit.client.0.smithi164.stdout:4/203: rename d2/d19/f2d to d2/d2f/d37/d41/f4e 0 2024-02-10T00:00:31.253 INFO:tasks.workunit.client.0.smithi164.stdout:4/204: dread - d2/d2f/f4c zero size 2024-02-10T00:00:31.254 INFO:tasks.workunit.client.1.smithi183.stdout:2/682: sync 2024-02-10T00:00:31.255 INFO:tasks.workunit.client.0.smithi164.stdout:0/181: dread d6/f15 [0,4194304] 0 2024-02-10T00:00:31.264 INFO:tasks.workunit.client.0.smithi164.stdout:3/178: rename d0/d1/d2/d19/f22 to d0/d1/d2/d19/f33 0 2024-02-10T00:00:31.264 INFO:tasks.workunit.client.0.smithi164.stdout:3/179: chown d0/d1/d2/c1a 1591669680 1 2024-02-10T00:00:31.265 INFO:tasks.workunit.client.1.smithi183.stdout:3/515: dwrite d7/f9 [0,4194304] 0 2024-02-10T00:00:31.265 INFO:tasks.workunit.client.1.smithi183.stdout:9/547: dread d0/f5b [0,4194304] 0 2024-02-10T00:00:31.265 INFO:tasks.workunit.client.1.smithi183.stdout:5/649: dwrite d4/fa [0,4194304] 0 2024-02-10T00:00:31.265 INFO:tasks.workunit.client.1.smithi183.stdout:7/542: rmdir d0/d11/d2f/d64/d6b 39 2024-02-10T00:00:31.265 INFO:tasks.workunit.client.0.smithi164.stdout:5/218: write d7/f32 [439658,7802] 0 2024-02-10T00:00:31.267 INFO:tasks.workunit.client.0.smithi164.stdout:1/172: write d1/f7 [119116,125663] 0 2024-02-10T00:00:31.268 INFO:tasks.workunit.client.1.smithi183.stdout:3/516: dwrite d7/db/d2a/d2d/f2f [4194304,4194304] 0 2024-02-10T00:00:31.268 INFO:tasks.workunit.client.1.smithi183.stdout:9/548: dwrite d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:31.269 INFO:tasks.workunit.client.0.smithi164.stdout:1/173: dread - d1/d1a/f2c zero size 2024-02-10T00:00:31.270 INFO:tasks.workunit.client.0.smithi164.stdout:1/174: fsync d1/d23/f32 0 2024-02-10T00:00:31.271 INFO:tasks.workunit.client.0.smithi164.stdout:1/175: chown d1/d1a 4246286 1 2024-02-10T00:00:31.272 INFO:tasks.workunit.client.0.smithi164.stdout:8/196: dwrite d2/d12/d21/f2d [0,4194304] 0 2024-02-10T00:00:31.273 INFO:tasks.workunit.client.0.smithi164.stdout:7/248: dwrite d3/d11/f23 [0,4194304] 0 2024-02-10T00:00:31.276 INFO:tasks.workunit.client.1.smithi183.stdout:2/683: mkdir d2/da/d20/d6d/dbe/de7 0 2024-02-10T00:00:31.277 INFO:tasks.workunit.client.0.smithi164.stdout:9/237: rename d6/d1c/l47 to d6/de/d3b/l48 0 2024-02-10T00:00:31.277 INFO:tasks.workunit.client.0.smithi164.stdout:9/238: fsync d6/d1c/f2c 0 2024-02-10T00:00:31.278 INFO:tasks.workunit.client.1.smithi183.stdout:8/629: write d0/d4e/f4f [4395701,62471] 0 2024-02-10T00:00:31.278 INFO:tasks.workunit.client.0.smithi164.stdout:5/219: mkdir d7/d17/d3b/d45 0 2024-02-10T00:00:31.279 INFO:tasks.workunit.client.0.smithi164.stdout:4/205: write d2/d19/d16/f3f [1482071,7373] 0 2024-02-10T00:00:31.279 INFO:tasks.workunit.client.1.smithi183.stdout:4/559: dwrite de/d14/d27/d2e/f3f [0,4194304] 0 2024-02-10T00:00:31.280 INFO:tasks.workunit.client.1.smithi183.stdout:6/474: dwrite d2/f15 [4194304,4194304] 0 2024-02-10T00:00:31.280 INFO:tasks.workunit.client.0.smithi164.stdout:4/206: chown d2/d19/ld 389861 1 2024-02-10T00:00:31.280 INFO:tasks.workunit.client.0.smithi164.stdout:5/220: write d7/d17/d21/d24/f3d [610963,44382] 0 2024-02-10T00:00:31.281 INFO:tasks.workunit.client.0.smithi164.stdout:4/207: dread - d2/d2f/d37/d41/f34 zero size 2024-02-10T00:00:31.281 INFO:tasks.workunit.client.1.smithi183.stdout:0/537: dwrite d14/d1d/d2d/f8a [4194304,4194304] 0 2024-02-10T00:00:31.282 INFO:tasks.workunit.client.1.smithi183.stdout:3/517: rmdir d7/db 39 2024-02-10T00:00:31.283 INFO:tasks.workunit.client.1.smithi183.stdout:1/528: dwrite d0/d3/d7/f63 [0,4194304] 0 2024-02-10T00:00:31.284 INFO:tasks.workunit.client.0.smithi164.stdout:6/305: rename d0/d2b/l4a to d0/d3b/d56/l5a 0 2024-02-10T00:00:31.285 INFO:tasks.workunit.client.0.smithi164.stdout:4/208: dwrite d2/d2f/f4c [0,4194304] 0 2024-02-10T00:00:31.285 INFO:tasks.workunit.client.0.smithi164.stdout:0/182: mkdir d6/d3a 0 2024-02-10T00:00:31.286 INFO:tasks.workunit.client.1.smithi183.stdout:9/549: rename d0/d3/d14/d48/f83 to d0/d30/fb6 0 2024-02-10T00:00:31.288 INFO:tasks.workunit.client.1.smithi183.stdout:8/630: rename d0 to d0/d4e/d53/dc8 22 2024-02-10T00:00:31.289 INFO:tasks.workunit.client.0.smithi164.stdout:6/306: dwrite d0/f2f [4194304,4194304] 0 2024-02-10T00:00:31.289 INFO:tasks.workunit.client.0.smithi164.stdout:5/221: unlink d7/d17/f22 0 2024-02-10T00:00:31.291 INFO:tasks.workunit.client.1.smithi183.stdout:4/560: mknod de/d14/da4/cad 0 2024-02-10T00:00:31.292 INFO:tasks.workunit.client.1.smithi183.stdout:6/475: rmdir d2/d1a/d25/d3c/d31/d38/d6e/d35 39 2024-02-10T00:00:31.296 INFO:tasks.workunit.client.1.smithi183.stdout:7/543: creat d0/fa0 x:0 0 0 2024-02-10T00:00:31.297 INFO:tasks.workunit.client.1.smithi183.stdout:3/518: dwrite d7/db/d2a/f69 [0,4194304] 0 2024-02-10T00:00:31.297 INFO:tasks.workunit.client.0.smithi164.stdout:4/209: write d2/d2f/d37/d41/f4e [169797,63976] 0 2024-02-10T00:00:31.298 INFO:tasks.workunit.client.1.smithi183.stdout:4/561: dwrite de/d14/d1d/d2f/da2/d9c/f9e [4194304,4194304] 0 2024-02-10T00:00:31.298 INFO:tasks.workunit.client.1.smithi183.stdout:2/684: mkdir d2/da/d19/d31/de2/de8 0 2024-02-10T00:00:31.299 INFO:tasks.workunit.client.1.smithi183.stdout:8/631: rmdir d0/d27 39 2024-02-10T00:00:31.300 INFO:tasks.workunit.client.0.smithi164.stdout:0/183: creat d6/d10/d18/d1c/f3b x:0 0 0 2024-02-10T00:00:31.301 INFO:tasks.workunit.client.0.smithi164.stdout:0/184: stat d6/d10/l33 0 2024-02-10T00:00:31.301 INFO:tasks.workunit.client.0.smithi164.stdout:4/210: dwrite d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:31.301 INFO:tasks.workunit.client.1.smithi183.stdout:9/550: mkdir d0/d92/db7 0 2024-02-10T00:00:31.302 INFO:tasks.workunit.client.0.smithi164.stdout:0/185: chown d6/d7/d14/f20 0 1 2024-02-10T00:00:31.302 INFO:tasks.workunit.client.1.smithi183.stdout:9/551: dread - d0/d3/f4e zero size 2024-02-10T00:00:31.303 INFO:tasks.workunit.client.1.smithi183.stdout:7/544: dwrite d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:31.303 INFO:tasks.workunit.client.0.smithi164.stdout:1/176: rename d1/d1a/d2d/d18/c1d to d1/d1a/d2d/d18/d3a/c3f 0 2024-02-10T00:00:31.304 INFO:tasks.workunit.client.1.smithi183.stdout:9/552: chown d0/d3/d14/f20 69105 1 2024-02-10T00:00:31.304 INFO:tasks.workunit.client.1.smithi183.stdout:9/553: write d0/d3/d14/d74/da8/faf [433730,108975] 0 2024-02-10T00:00:31.305 INFO:tasks.workunit.client.0.smithi164.stdout:4/211: dread d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:31.305 INFO:tasks.workunit.client.0.smithi164.stdout:0/186: dread d6/f15 [0,4194304] 0 2024-02-10T00:00:31.306 INFO:tasks.workunit.client.0.smithi164.stdout:4/212: write d2/d19/f11 [2871834,29857] 0 2024-02-10T00:00:31.309 INFO:tasks.workunit.client.0.smithi164.stdout:7/249: getdents d3/d28/d45/d4b 0 2024-02-10T00:00:31.310 INFO:tasks.workunit.client.0.smithi164.stdout:6/307: creat d0/d6/d12/f5b x:0 0 0 2024-02-10T00:00:31.313 INFO:tasks.workunit.client.0.smithi164.stdout:5/222: creat d7/d17/d21/d23/d37/d36/f46 x:0 0 0 2024-02-10T00:00:31.316 INFO:tasks.workunit.client.1.smithi183.stdout:7/545: unlink d0/d2/f41 0 2024-02-10T00:00:31.321 INFO:tasks.workunit.client.1.smithi183.stdout:5/650: sync 2024-02-10T00:00:31.322 INFO:tasks.workunit.client.0.smithi164.stdout:6/308: rename d0/d6/d12/d43/l46 to d0/d3b/l5c 0 2024-02-10T00:00:31.323 INFO:tasks.workunit.client.1.smithi183.stdout:7/546: mknod d0/d11/d3e/ca1 0 2024-02-10T00:00:31.323 INFO:tasks.workunit.client.0.smithi164.stdout:6/309: write d0/fc [8884117,78989] 0 2024-02-10T00:00:31.326 INFO:tasks.workunit.client.0.smithi164.stdout:6/310: dread d0/f1a [0,4194304] 0 2024-02-10T00:00:31.326 INFO:tasks.workunit.client.0.smithi164.stdout:6/311: readlink d0/d3b/l40 0 2024-02-10T00:00:31.328 INFO:tasks.workunit.client.0.smithi164.stdout:0/187: link d6/d10/l12 d6/d7/d14/l3c 0 2024-02-10T00:00:31.329 INFO:tasks.workunit.client.0.smithi164.stdout:2/258: dwrite d3/f7 [0,4194304] 0 2024-02-10T00:00:31.331 INFO:tasks.workunit.client.1.smithi183.stdout:9/554: mkdir d0/d3/d14/d1c/d2d/d4f/db8 0 2024-02-10T00:00:31.331 INFO:tasks.workunit.client.1.smithi183.stdout:3/519: creat d7/db/d2a/d2d/f92 x:0 0 0 2024-02-10T00:00:31.331 INFO:tasks.workunit.client.1.smithi183.stdout:4/562: creat de/fae x:0 0 0 2024-02-10T00:00:31.331 INFO:tasks.workunit.client.0.smithi164.stdout:2/259: dread d3/f44 [0,4194304] 0 2024-02-10T00:00:31.332 INFO:tasks.workunit.client.0.smithi164.stdout:5/223: creat d7/d17/d21/f47 x:0 0 0 2024-02-10T00:00:31.332 INFO:tasks.workunit.client.1.smithi183.stdout:7/547: symlink d0/d11/d35/la2 0 2024-02-10T00:00:31.336 INFO:tasks.workunit.client.0.smithi164.stdout:6/312: dwrite d0/d6/f4f [0,4194304] 0 2024-02-10T00:00:31.336 INFO:tasks.workunit.client.0.smithi164.stdout:5/224: fsync d7/d17/f3f 0 2024-02-10T00:00:31.337 INFO:tasks.workunit.client.0.smithi164.stdout:6/313: readlink d0/d6/l2d 0 2024-02-10T00:00:31.338 INFO:tasks.workunit.client.0.smithi164.stdout:0/188: creat d6/f3d x:0 0 0 2024-02-10T00:00:31.338 INFO:tasks.workunit.client.0.smithi164.stdout:2/260: dwrite d3/f62 [0,4194304] 0 2024-02-10T00:00:31.339 INFO:tasks.workunit.client.1.smithi183.stdout:4/563: fsync de/d19/d20/f5d 0 2024-02-10T00:00:31.339 INFO:tasks.workunit.client.1.smithi183.stdout:4/564: chown de/d19/f30 3 1 2024-02-10T00:00:31.341 INFO:tasks.workunit.client.1.smithi183.stdout:9/555: symlink d0/d3/d14/d1c/d2d/d4f/d89/lb9 0 2024-02-10T00:00:31.341 INFO:tasks.workunit.client.1.smithi183.stdout:9/556: chown d0/d3/d14/d3c/c71 1627 1 2024-02-10T00:00:31.342 INFO:tasks.workunit.client.1.smithi183.stdout:4/565: symlink de/d14/d27/d40/laf 0 2024-02-10T00:00:31.343 INFO:tasks.workunit.client.1.smithi183.stdout:2/685: read d2/da/f7d [5431923,79685] 0 2024-02-10T00:00:31.343 INFO:tasks.workunit.client.0.smithi164.stdout:2/261: dwrite d3/d32/d4e/d27/f4c [0,4194304] 0 2024-02-10T00:00:31.343 INFO:tasks.workunit.client.0.smithi164.stdout:2/262: stat d3 0 2024-02-10T00:00:31.345 INFO:tasks.workunit.client.1.smithi183.stdout:2/686: mkdir d2/d2c/dba/de9 0 2024-02-10T00:00:31.347 INFO:tasks.workunit.client.1.smithi183.stdout:9/557: unlink d0/f2e 0 2024-02-10T00:00:31.349 INFO:tasks.workunit.client.0.smithi164.stdout:5/225: getdents d7/d15/d1f 0 2024-02-10T00:00:31.349 INFO:tasks.workunit.client.0.smithi164.stdout:2/263: symlink d3/d24/d51/l63 0 2024-02-10T00:00:31.350 INFO:tasks.workunit.client.1.smithi183.stdout:4/566: symlink de/d14/d27/lb0 0 2024-02-10T00:00:31.351 INFO:tasks.workunit.client.1.smithi183.stdout:2/687: getdents d2/da/d20/d6d/dbe/de7 0 2024-02-10T00:00:31.353 INFO:tasks.workunit.client.1.smithi183.stdout:2/688: stat d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d 0 2024-02-10T00:00:31.353 INFO:tasks.workunit.client.1.smithi183.stdout:4/567: dread de/d14/d27/d2e/f9f [0,4194304] 0 2024-02-10T00:00:31.356 INFO:tasks.workunit.client.1.smithi183.stdout:4/568: fsync de/d14/d27/d2e/f90 0 2024-02-10T00:00:31.357 INFO:tasks.workunit.client.1.smithi183.stdout:2/689: dwrite d2/da/f25 [0,4194304] 0 2024-02-10T00:00:31.360 INFO:tasks.workunit.client.1.smithi183.stdout:4/569: creat de/d19/d1c/d61/dab/fb1 x:0 0 0 2024-02-10T00:00:31.361 INFO:tasks.workunit.client.0.smithi164.stdout:5/226: creat d7/d17/f48 x:0 0 0 2024-02-10T00:00:31.361 INFO:tasks.workunit.client.0.smithi164.stdout:2/264: read d3/f62 [1647436,32973] 0 2024-02-10T00:00:31.363 INFO:tasks.workunit.client.1.smithi183.stdout:2/690: dwrite d2/da/d77/dc7/db5/d35/fa5 [0,4194304] 0 2024-02-10T00:00:31.363 INFO:tasks.workunit.client.0.smithi164.stdout:5/227: symlink d7/d17/d21/d23/d37/l49 0 2024-02-10T00:00:31.364 INFO:tasks.workunit.client.0.smithi164.stdout:5/228: fsync d7/fd 0 2024-02-10T00:00:31.364 INFO:tasks.workunit.client.0.smithi164.stdout:5/229: write d7/f1d [4531549,66017] 0 2024-02-10T00:00:31.365 INFO:tasks.workunit.client.0.smithi164.stdout:2/265: mkdir d3/d26/d64 0 2024-02-10T00:00:31.367 INFO:tasks.workunit.client.0.smithi164.stdout:5/230: creat d7/d15/d1f/f4a x:0 0 0 2024-02-10T00:00:31.368 INFO:tasks.workunit.client.1.smithi183.stdout:4/570: creat de/d19/d20/fb2 x:0 0 0 2024-02-10T00:00:31.368 INFO:tasks.workunit.client.1.smithi183.stdout:2/691: dwrite d2/da/d20/d6d/d8f/f93 [0,4194304] 0 2024-02-10T00:00:31.370 INFO:tasks.workunit.client.1.smithi183.stdout:4/571: symlink de/d22/lb3 0 2024-02-10T00:00:31.370 INFO:tasks.workunit.client.0.smithi164.stdout:2/266: creat d3/d32/d4e/d27/d2e/d36/d54/f65 x:0 0 0 2024-02-10T00:00:31.370 INFO:tasks.workunit.client.1.smithi183.stdout:2/692: chown d2/da/d20/d21/d36/c87 147912 1 2024-02-10T00:00:31.371 INFO:tasks.workunit.client.1.smithi183.stdout:5/651: sync 2024-02-10T00:00:31.372 INFO:tasks.workunit.client.0.smithi164.stdout:2/267: symlink d3/l66 0 2024-02-10T00:00:31.373 INFO:tasks.workunit.client.0.smithi164.stdout:1/177: dread d1/f1b [0,4194304] 0 2024-02-10T00:00:31.374 INFO:tasks.workunit.client.0.smithi164.stdout:1/178: fdatasync d1/d1a/d2d/fe 0 2024-02-10T00:00:31.375 INFO:tasks.workunit.client.1.smithi183.stdout:4/572: getdents de/d14/d1d 0 2024-02-10T00:00:31.375 INFO:tasks.workunit.client.1.smithi183.stdout:2/693: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:31.375 INFO:tasks.workunit.client.0.smithi164.stdout:2/268: dread d3/f7 [0,4194304] 0 2024-02-10T00:00:31.376 INFO:tasks.workunit.client.0.smithi164.stdout:1/179: rmdir d1/d1a/d2d/d18/d3a 39 2024-02-10T00:00:31.377 INFO:tasks.workunit.client.1.smithi183.stdout:5/652: symlink d4/d23/d3e/d80/da1/d9e/d27/d5d/lcc 0 2024-02-10T00:00:31.378 INFO:tasks.workunit.client.0.smithi164.stdout:2/269: creat d3/d32/d4e/f67 x:0 0 0 2024-02-10T00:00:31.381 INFO:tasks.workunit.client.1.smithi183.stdout:2/694: symlink d2/da/d77/dc7/db5/d35/dae/lea 0 2024-02-10T00:00:31.382 INFO:tasks.workunit.client.1.smithi183.stdout:9/558: dread d0/d30/d52/f66 [0,4194304] 0 2024-02-10T00:00:31.382 INFO:tasks.workunit.client.1.smithi183.stdout:9/559: chown d0/c17 1 1 2024-02-10T00:00:31.383 INFO:tasks.workunit.client.0.smithi164.stdout:1/180: truncate d1/d1a/f2c 642766 0 2024-02-10T00:00:31.384 INFO:tasks.workunit.client.1.smithi183.stdout:2/695: write d2/da/d20/d21/f29 [37140,108500] 0 2024-02-10T00:00:31.384 INFO:tasks.workunit.client.1.smithi183.stdout:4/573: getdents de/d14/d1d/d7b 0 2024-02-10T00:00:31.385 INFO:tasks.workunit.client.1.smithi183.stdout:2/696: chown d2/da/d20/d6d/dbd 484 1 2024-02-10T00:00:31.385 INFO:tasks.workunit.client.0.smithi164.stdout:1/181: symlink d1/d23/l40 0 2024-02-10T00:00:31.386 INFO:tasks.workunit.client.1.smithi183.stdout:9/560: creat d0/d3/d14/d74/da8/fba x:0 0 0 2024-02-10T00:00:31.387 INFO:tasks.workunit.client.1.smithi183.stdout:2/697: creat d2/d8b/feb x:0 0 0 2024-02-10T00:00:31.388 INFO:tasks.workunit.client.1.smithi183.stdout:9/561: mknod d0/d3/d14/cbb 0 2024-02-10T00:00:31.389 INFO:tasks.workunit.client.1.smithi183.stdout:4/574: dwrite de/d19/d20/f5d [0,4194304] 0 2024-02-10T00:00:31.390 INFO:tasks.workunit.client.1.smithi183.stdout:9/562: mknod d0/d3/d14/d1c/cbc 0 2024-02-10T00:00:31.393 INFO:tasks.workunit.client.1.smithi183.stdout:9/563: write d0/d3/d14/d3c/d7b/f87 [2763569,47090] 0 2024-02-10T00:00:31.393 INFO:tasks.workunit.client.1.smithi183.stdout:4/575: dread de/d14/d27/f1b [0,4194304] 0 2024-02-10T00:00:31.393 INFO:tasks.workunit.client.1.smithi183.stdout:4/576: fdatasync de/d14/d27/d40/f57 0 2024-02-10T00:00:31.394 INFO:tasks.workunit.client.1.smithi183.stdout:4/577: stat de/d19/ca7 0 2024-02-10T00:00:31.394 INFO:tasks.workunit.client.1.smithi183.stdout:4/578: dread - de/f71 zero size 2024-02-10T00:00:31.415 INFO:tasks.workunit.client.0.smithi164.stdout:0/189: sync 2024-02-10T00:00:31.417 INFO:tasks.workunit.client.0.smithi164.stdout:0/190: dread f3 [0,4194304] 0 2024-02-10T00:00:31.418 INFO:tasks.workunit.client.0.smithi164.stdout:0/191: read - d6/d7/f24 zero size 2024-02-10T00:00:31.419 INFO:tasks.workunit.client.0.smithi164.stdout:0/192: read d6/d10/d18/d2d/f2e [3800267,94908] 0 2024-02-10T00:00:31.419 INFO:tasks.workunit.client.0.smithi164.stdout:0/193: fsync d6/d7/d14/f1b 0 2024-02-10T00:00:31.422 INFO:tasks.workunit.client.0.smithi164.stdout:0/194: link d6/d7/d14/f27 d6/d7/d14/f3e 0 2024-02-10T00:00:31.423 INFO:tasks.workunit.client.0.smithi164.stdout:0/195: rmdir d6/d10 39 2024-02-10T00:00:31.426 INFO:tasks.workunit.client.0.smithi164.stdout:0/196: mknod d6/d10/d18/d1c/c3f 0 2024-02-10T00:00:31.430 INFO:tasks.workunit.client.0.smithi164.stdout:0/197: dwrite d6/d7/f17 [0,4194304] 0 2024-02-10T00:00:31.433 INFO:tasks.workunit.client.0.smithi164.stdout:0/198: truncate d6/d10/d18/d1c/f3b 756920 0 2024-02-10T00:00:31.434 INFO:tasks.workunit.client.0.smithi164.stdout:0/199: dread - d6/d7/d14/f3e zero size 2024-02-10T00:00:31.434 INFO:tasks.workunit.client.0.smithi164.stdout:0/200: fsync f1 0 2024-02-10T00:00:31.455 INFO:tasks.workunit.client.1.smithi183.stdout:9/564: sync 2024-02-10T00:00:31.455 INFO:tasks.workunit.client.1.smithi183.stdout:2/698: sync 2024-02-10T00:00:31.458 INFO:tasks.workunit.client.1.smithi183.stdout:9/565: truncate d0/d3/d14/f20 4492579 0 2024-02-10T00:00:31.460 INFO:tasks.workunit.client.1.smithi183.stdout:2/699: dwrite d2/da/d20/d6d/fdc [0,4194304] 0 2024-02-10T00:00:31.464 INFO:tasks.workunit.client.1.smithi183.stdout:9/566: rename d0/d3/d14/f82 to d0/d3/d14/d74/da8/fbd 0 2024-02-10T00:00:31.465 INFO:tasks.workunit.client.0.smithi164.stdout:9/239: readlink d6/de/d3b/l48 0 2024-02-10T00:00:31.466 INFO:tasks.workunit.client.1.smithi183.stdout:2/700: creat d2/da/d77/dc7/db5/d35/dae/fec x:0 0 0 2024-02-10T00:00:31.467 INFO:tasks.workunit.client.1.smithi183.stdout:2/701: write d2/d8b/fb3 [344898,106297] 0 2024-02-10T00:00:31.467 INFO:tasks.workunit.client.1.smithi183.stdout:2/702: write d2/f15 [5090924,109199] 0 2024-02-10T00:00:31.471 INFO:tasks.workunit.client.1.smithi183.stdout:2/703: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:31.472 INFO:tasks.workunit.client.1.smithi183.stdout:9/567: mknod d0/d3/d14/d3c/cbe 0 2024-02-10T00:00:31.472 INFO:tasks.workunit.client.0.smithi164.stdout:9/240: dwrite d6/f1e [0,4194304] 0 2024-02-10T00:00:31.473 INFO:tasks.workunit.client.1.smithi183.stdout:2/704: fsync d2/da/d20/d21/d43/d58/d74/d83/dc4/fc5 0 2024-02-10T00:00:31.473 INFO:tasks.workunit.client.0.smithi164.stdout:9/241: rename f5 to d6/de/f49 0 2024-02-10T00:00:31.475 INFO:tasks.workunit.client.0.smithi164.stdout:9/242: truncate d6/de/f11 5299139 0 2024-02-10T00:00:31.476 INFO:tasks.workunit.client.1.smithi183.stdout:9/568: rename d0/d3/d14/d1c/d4b/d51/ca6 to d0/d3/d14/d1c/d2d/d4f/cbf 0 2024-02-10T00:00:31.477 INFO:tasks.workunit.client.1.smithi183.stdout:9/569: write d0/d3/d14/d1c/d4b/f65 [514222,9335] 0 2024-02-10T00:00:31.480 INFO:tasks.workunit.client.1.smithi183.stdout:9/570: creat d0/fc0 x:0 0 0 2024-02-10T00:00:31.484 INFO:tasks.workunit.client.1.smithi183.stdout:9/571: symlink d0/d3/d14/d1c/d2d/d4f/lc1 0 2024-02-10T00:00:31.488 INFO:tasks.workunit.client.1.smithi183.stdout:9/572: dwrite d0/d3/d14/d3c/f6f [0,4194304] 0 2024-02-10T00:00:31.489 INFO:tasks.workunit.client.1.smithi183.stdout:9/573: readlink d0/d3/d14/d3c/d7b/l91 0 2024-02-10T00:00:31.489 INFO:tasks.workunit.client.1.smithi183.stdout:5/653: fdatasync d4/d23/d4a/d36/fb8 0 2024-02-10T00:00:31.493 INFO:tasks.workunit.client.0.smithi164.stdout:2/270: dread d3/fd [0,4194304] 0 2024-02-10T00:00:31.494 INFO:tasks.workunit.client.1.smithi183.stdout:6/476: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:31.495 INFO:tasks.workunit.client.1.smithi183.stdout:6/477: write d2/f18 [2720536,54194] 0 2024-02-10T00:00:31.495 INFO:tasks.workunit.client.0.smithi164.stdout:3/180: write d0/f10 [1146104,22617] 0 2024-02-10T00:00:31.496 INFO:tasks.workunit.client.1.smithi183.stdout:6/478: chown d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7f 5610 1 2024-02-10T00:00:31.496 INFO:tasks.workunit.client.0.smithi164.stdout:3/181: rename d0 to d0/d1/d2/d19/d27/d34 22 2024-02-10T00:00:31.497 INFO:tasks.workunit.client.1.smithi183.stdout:6/479: dread - d2/d1a/d25/d3c/d31/d38/d6e/f68 zero size 2024-02-10T00:00:31.497 INFO:tasks.workunit.client.0.smithi164.stdout:0/201: sync 2024-02-10T00:00:31.499 INFO:tasks.workunit.client.0.smithi164.stdout:8/197: truncate d2/f2c 1772637 0 2024-02-10T00:00:31.499 INFO:tasks.workunit.client.1.smithi183.stdout:1/529: write d0/d3/d67/d70/fa1 [601916,85260] 0 2024-02-10T00:00:31.501 INFO:tasks.workunit.client.1.smithi183.stdout:6/480: dread d2/f15 [4194304,4194304] 0 2024-02-10T00:00:31.501 INFO:tasks.workunit.client.1.smithi183.stdout:0/538: dread d14/d1d/d59/d71/f7f [0,4194304] 0 2024-02-10T00:00:31.502 INFO:tasks.workunit.client.1.smithi183.stdout:8/632: write d0/d31/f88 [297583,14598] 0 2024-02-10T00:00:31.503 INFO:tasks.workunit.client.1.smithi183.stdout:4/579: dread de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:31.504 INFO:tasks.workunit.client.1.smithi183.stdout:4/580: readlink de/d14/d4e/l60 0 2024-02-10T00:00:31.505 INFO:tasks.workunit.client.1.smithi183.stdout:5/654: read d4/d23/d3e/d80/da1/d9e/f39 [1750702,117588] 0 2024-02-10T00:00:31.505 INFO:tasks.workunit.client.0.smithi164.stdout:7/250: write d3/d11/f18 [1639466,114339] 0 2024-02-10T00:00:31.506 INFO:tasks.workunit.client.0.smithi164.stdout:7/251: readlink d3/lc 0 2024-02-10T00:00:31.506 INFO:tasks.workunit.client.1.smithi183.stdout:0/539: mkdir d14/d1d/d2d/d31/dc8 0 2024-02-10T00:00:31.507 INFO:tasks.workunit.client.1.smithi183.stdout:3/520: dread d7/fe [0,4194304] 0 2024-02-10T00:00:31.507 INFO:tasks.workunit.client.0.smithi164.stdout:4/213: dwrite d2/d19/f15 [0,4194304] 0 2024-02-10T00:00:31.508 INFO:tasks.workunit.client.1.smithi183.stdout:3/521: chown d7/db/d2a/d33/l82 1 1 2024-02-10T00:00:31.508 INFO:tasks.workunit.client.0.smithi164.stdout:4/214: chown d2/d19/d16/f38 154 1 2024-02-10T00:00:31.510 INFO:tasks.workunit.client.1.smithi183.stdout:7/548: chown d0/d2/d50/d5d/l96 14 1 2024-02-10T00:00:31.510 INFO:tasks.workunit.client.0.smithi164.stdout:8/198: mknod d2/d12/d21/d31/d32/c35 0 2024-02-10T00:00:31.513 INFO:tasks.workunit.client.0.smithi164.stdout:0/202: dwrite d6/d7/d14/f3e [0,4194304] 0 2024-02-10T00:00:31.513 INFO:tasks.workunit.client.1.smithi183.stdout:0/540: dwrite d14/d1d/d2d/d31/d6c/fb2 [0,4194304] 0 2024-02-10T00:00:31.513 INFO:tasks.workunit.client.0.smithi164.stdout:6/314: truncate d0/d2b/f39 1674662 0 2024-02-10T00:00:31.516 INFO:tasks.workunit.client.0.smithi164.stdout:8/199: dwrite d2/f20 [0,4194304] 0 2024-02-10T00:00:31.517 INFO:tasks.workunit.client.1.smithi183.stdout:1/530: dread d0/d3a/f83 [0,4194304] 0 2024-02-10T00:00:31.518 INFO:tasks.workunit.client.0.smithi164.stdout:5/231: truncate d7/fd 6723368 0 2024-02-10T00:00:31.518 INFO:tasks.workunit.client.0.smithi164.stdout:5/232: stat d7/d17/d21/d24 0 2024-02-10T00:00:31.520 INFO:tasks.workunit.client.0.smithi164.stdout:7/252: rmdir d3/d11/d39/d44/d48/d50 39 2024-02-10T00:00:31.522 INFO:tasks.workunit.client.0.smithi164.stdout:4/215: creat d2/d19/d16/d31/f4f x:0 0 0 2024-02-10T00:00:31.522 INFO:tasks.workunit.client.0.smithi164.stdout:9/243: sync 2024-02-10T00:00:31.523 INFO:tasks.workunit.client.0.smithi164.stdout:5/233: dwrite d7/d15/d1f/f44 [0,4194304] 0 2024-02-10T00:00:31.524 INFO:tasks.workunit.client.0.smithi164.stdout:9/244: write d6/de/d2b/f38 [679564,19014] 0 2024-02-10T00:00:31.525 INFO:tasks.workunit.client.0.smithi164.stdout:3/182: rename d0/d1/d2/f2f to d0/f35 0 2024-02-10T00:00:31.526 INFO:tasks.workunit.client.0.smithi164.stdout:3/183: chown d0/d1/dd 2088994 1 2024-02-10T00:00:31.527 INFO:tasks.workunit.client.1.smithi183.stdout:7/549: write d0/d2/f65 [1011423,39084] 0 2024-02-10T00:00:31.527 INFO:tasks.workunit.client.0.smithi164.stdout:1/182: truncate d1/f7 2560582 0 2024-02-10T00:00:31.528 INFO:tasks.workunit.client.0.smithi164.stdout:5/234: dwrite d7/d17/d21/f47 [0,4194304] 0 2024-02-10T00:00:31.529 INFO:tasks.workunit.client.1.smithi183.stdout:0/541: unlink d14/d3e/c53 0 2024-02-10T00:00:31.530 INFO:tasks.workunit.client.1.smithi183.stdout:0/542: fsync d14/d1d/d59/d71/d22/f48 0 2024-02-10T00:00:31.535 INFO:tasks.workunit.client.1.smithi183.stdout:3/522: creat d7/db/d2a/d8e/f93 x:0 0 0 2024-02-10T00:00:31.535 INFO:tasks.workunit.client.1.smithi183.stdout:6/481: dread d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:31.536 INFO:tasks.workunit.client.0.smithi164.stdout:0/203: mknod d6/d10/d18/c40 0 2024-02-10T00:00:31.537 INFO:tasks.workunit.client.1.smithi183.stdout:8/633: rename d0/d3f/db2/cb4 to d0/d27/d36/cc9 0 2024-02-10T00:00:31.538 INFO:tasks.workunit.client.0.smithi164.stdout:6/315: mkdir d0/d2b/d3a/d3d/d42/d5d 0 2024-02-10T00:00:31.541 INFO:tasks.workunit.client.0.smithi164.stdout:2/271: sync 2024-02-10T00:00:31.541 INFO:tasks.workunit.client.0.smithi164.stdout:8/200: dread d2/f19 [0,4194304] 0 2024-02-10T00:00:31.541 INFO:tasks.workunit.client.1.smithi183.stdout:2/705: write d2/da/d20/d21/fcf [1039695,58039] 0 2024-02-10T00:00:31.541 INFO:tasks.workunit.client.1.smithi183.stdout:2/706: stat d2/da/d19/fb4 0 2024-02-10T00:00:31.542 INFO:tasks.workunit.client.1.smithi183.stdout:2/707: chown d2/d2c/dab/d99 1977052726 1 2024-02-10T00:00:31.543 INFO:tasks.workunit.client.0.smithi164.stdout:3/184: readlink d0/d1/dd/d1e/l23 0 2024-02-10T00:00:31.544 INFO:tasks.workunit.client.0.smithi164.stdout:1/183: unlink d1/d1a/d2d/d18/d33/c36 0 2024-02-10T00:00:31.545 INFO:tasks.workunit.client.0.smithi164.stdout:1/184: readlink d1/l10 0 2024-02-10T00:00:31.545 INFO:tasks.workunit.client.1.smithi183.stdout:4/581: creat de/d14/d27/fb4 x:0 0 0 2024-02-10T00:00:31.547 INFO:tasks.workunit.client.1.smithi183.stdout:4/582: chown de/d14/d27/f45 991 1 2024-02-10T00:00:31.547 INFO:tasks.workunit.client.1.smithi183.stdout:1/531: truncate d0/d3/d7/f8d 596023 0 2024-02-10T00:00:31.547 INFO:tasks.workunit.client.1.smithi183.stdout:9/574: dwrite d0/d3/d14/d48/f5e [0,4194304] 0 2024-02-10T00:00:31.548 INFO:tasks.workunit.client.0.smithi164.stdout:5/235: creat d7/d17/d21/d23/d37/f4b x:0 0 0 2024-02-10T00:00:31.549 INFO:tasks.workunit.client.1.smithi183.stdout:0/543: creat d14/d1d/d59/d3c/d93/fc9 x:0 0 0 2024-02-10T00:00:31.550 INFO:tasks.workunit.client.1.smithi183.stdout:5/655: link d4/ce d4/d23/d3e/d80/d96/ccd 0 2024-02-10T00:00:31.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/482: symlink d2/d1a/d25/d3c/d31/l90 0 2024-02-10T00:00:31.552 INFO:tasks.workunit.client.0.smithi164.stdout:6/316: dread d0/d6/f1c [0,4194304] 0 2024-02-10T00:00:31.552 INFO:tasks.workunit.client.0.smithi164.stdout:4/216: creat d2/d19/d16/d31/d4b/f50 x:0 0 0 2024-02-10T00:00:31.552 INFO:tasks.workunit.client.1.smithi183.stdout:8/634: fsync d0/d45/f66 0 2024-02-10T00:00:31.552 INFO:tasks.workunit.client.1.smithi183.stdout:7/550: dwrite d0/d11/d3e/f89 [0,4194304] 0 2024-02-10T00:00:31.555 INFO:tasks.workunit.client.1.smithi183.stdout:1/532: mkdir d0/d3/d29/d1f/d86/dc1 0 2024-02-10T00:00:31.556 INFO:tasks.workunit.client.0.smithi164.stdout:3/185: unlink d0/d1/ff 0 2024-02-10T00:00:31.558 INFO:tasks.workunit.client.1.smithi183.stdout:0/544: unlink d14/d1d/d59/d3c/d72/c73 0 2024-02-10T00:00:31.559 INFO:tasks.workunit.client.0.smithi164.stdout:0/204: creat d6/d10/d18/d2d/d35/f41 x:0 0 0 2024-02-10T00:00:31.559 INFO:tasks.workunit.client.1.smithi183.stdout:7/551: dwrite d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:31.561 INFO:tasks.workunit.client.0.smithi164.stdout:5/236: readlink d7/d15/d1f/l41 0 2024-02-10T00:00:31.561 INFO:tasks.workunit.client.0.smithi164.stdout:5/237: fdatasync d7/d17/d21/d24/f3d 0 2024-02-10T00:00:31.562 INFO:tasks.workunit.client.0.smithi164.stdout:5/238: write d7/d17/d21/d23/d37/d36/f46 [898903,100715] 0 2024-02-10T00:00:31.564 INFO:tasks.workunit.client.1.smithi183.stdout:9/575: dread d0/f5 [0,4194304] 0 2024-02-10T00:00:31.565 INFO:tasks.workunit.client.1.smithi183.stdout:9/576: fsync d0/d3/d14/d3c/fae 0 2024-02-10T00:00:31.565 INFO:tasks.workunit.client.0.smithi164.stdout:4/217: creat d2/d2f/f51 x:0 0 0 2024-02-10T00:00:31.567 INFO:tasks.workunit.client.1.smithi183.stdout:1/533: fdatasync d0/d3/d7/d36/f4d 0 2024-02-10T00:00:31.568 INFO:tasks.workunit.client.1.smithi183.stdout:0/545: creat d14/d3e/fca x:0 0 0 2024-02-10T00:00:31.570 INFO:tasks.workunit.client.0.smithi164.stdout:0/205: symlink d6/d10/d18/l42 0 2024-02-10T00:00:31.571 INFO:tasks.workunit.client.0.smithi164.stdout:6/317: read d0/d6/d12/d43/f44 [45157,81579] 0 2024-02-10T00:00:31.572 INFO:tasks.workunit.client.1.smithi183.stdout:7/552: mkdir d0/d11/d2f/da3 0 2024-02-10T00:00:31.573 INFO:tasks.workunit.client.0.smithi164.stdout:5/239: dread d7/f19 [0,4194304] 0 2024-02-10T00:00:31.574 INFO:tasks.workunit.client.0.smithi164.stdout:1/185: dread d1/f7 [0,4194304] 0 2024-02-10T00:00:31.575 INFO:tasks.workunit.client.0.smithi164.stdout:7/253: link d3/d5/l8 d3/d4d/l57 0 2024-02-10T00:00:31.575 INFO:tasks.workunit.client.0.smithi164.stdout:1/186: stat d1/d13/d16 0 2024-02-10T00:00:31.575 INFO:tasks.workunit.client.0.smithi164.stdout:7/254: stat c1 0 2024-02-10T00:00:31.576 INFO:tasks.workunit.client.0.smithi164.stdout:8/201: truncate d2/f27 1553533 0 2024-02-10T00:00:31.576 INFO:tasks.workunit.client.1.smithi183.stdout:5/656: mknod d4/d23/d3e/d80/da1/d9e/d27/d37/d46/cce 0 2024-02-10T00:00:31.578 INFO:tasks.workunit.client.0.smithi164.stdout:3/186: mknod d0/c36 0 2024-02-10T00:00:31.578 INFO:tasks.workunit.client.1.smithi183.stdout:4/583: rename de/d14/d1d/c6c to de/d14/d27/cb5 0 2024-02-10T00:00:31.579 INFO:tasks.workunit.client.0.smithi164.stdout:7/255: dwrite d3/f2d [0,4194304] 0 2024-02-10T00:00:31.580 INFO:tasks.workunit.client.1.smithi183.stdout:1/534: mkdir d0/d3/d7/d3d/d60/dc2 0 2024-02-10T00:00:31.580 INFO:tasks.workunit.client.0.smithi164.stdout:6/318: creat d0/d2b/d3a/f5e x:0 0 0 2024-02-10T00:00:31.581 INFO:tasks.workunit.client.1.smithi183.stdout:9/577: symlink d0/d3/d14/d74/lc2 0 2024-02-10T00:00:31.583 INFO:tasks.workunit.client.1.smithi183.stdout:2/708: getdents d2/da/d5b 0 2024-02-10T00:00:31.583 INFO:tasks.workunit.client.1.smithi183.stdout:8/635: truncate d0/d4e/d53/fa3 107486 0 2024-02-10T00:00:31.583 INFO:tasks.workunit.client.0.smithi164.stdout:3/187: dwrite d0/d1/d2/f12 [0,4194304] 0 2024-02-10T00:00:31.584 INFO:tasks.workunit.client.1.smithi183.stdout:6/483: link d2/d1a/d25/d3c/d8d/c8f d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/c91 0 2024-02-10T00:00:31.585 INFO:tasks.workunit.client.1.smithi183.stdout:2/709: chown d2/da/d77/dc7/db5/d35/dae 83437729 1 2024-02-10T00:00:31.585 INFO:tasks.workunit.client.1.smithi183.stdout:1/535: dwrite d0/d3/d67/d70/fa1 [0,4194304] 0 2024-02-10T00:00:31.585 INFO:tasks.workunit.client.1.smithi183.stdout:5/657: mknod d4/d23/d3e/d80/da1/d9e/d27/d9d/ccf 0 2024-02-10T00:00:31.586 INFO:tasks.workunit.client.0.smithi164.stdout:5/240: getdents d7/d17/d3b/d43 0 2024-02-10T00:00:31.586 INFO:tasks.workunit.client.1.smithi183.stdout:5/658: write d4/d74/fba [203793,75954] 0 2024-02-10T00:00:31.588 INFO:tasks.workunit.client.0.smithi164.stdout:7/256: mknod d3/d5/d2b/d4a/c58 0 2024-02-10T00:00:31.588 INFO:tasks.workunit.client.0.smithi164.stdout:6/319: symlink d0/d3b/d56/l5f 0 2024-02-10T00:00:31.589 INFO:tasks.workunit.client.1.smithi183.stdout:4/584: mkdir de/d14/d1d/d2f/da2/db6 0 2024-02-10T00:00:31.589 INFO:tasks.workunit.client.1.smithi183.stdout:0/546: mkdir d14/d1d/d59/d71/dcb 0 2024-02-10T00:00:31.589 INFO:tasks.workunit.client.1.smithi183.stdout:4/585: fsync de/d19/d20/f5d 0 2024-02-10T00:00:31.589 INFO:tasks.workunit.client.1.smithi183.stdout:0/547: chown d14/d1d/fba 87 1 2024-02-10T00:00:31.590 INFO:tasks.workunit.client.0.smithi164.stdout:5/241: creat d7/d17/d21/d24/f4c x:0 0 0 2024-02-10T00:00:31.591 INFO:tasks.workunit.client.0.smithi164.stdout:3/188: mkdir d0/d1/d2/d17/d37 0 2024-02-10T00:00:31.591 INFO:tasks.workunit.client.0.smithi164.stdout:3/189: chown d0/d1/d2 0 1 2024-02-10T00:00:31.592 INFO:tasks.workunit.client.1.smithi183.stdout:9/578: readlink d0/d3/d14/d48/l6d 0 2024-02-10T00:00:31.593 INFO:tasks.workunit.client.0.smithi164.stdout:7/257: mkdir d3/d5/d59 0 2024-02-10T00:00:31.594 INFO:tasks.workunit.client.0.smithi164.stdout:4/218: getdents d2/d19/d16 0 2024-02-10T00:00:31.594 INFO:tasks.workunit.client.0.smithi164.stdout:7/258: dread d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:31.595 INFO:tasks.workunit.client.0.smithi164.stdout:7/259: chown d3/f22 25 1 2024-02-10T00:00:31.596 INFO:tasks.workunit.client.0.smithi164.stdout:5/242: rename d7/d17/c20 to d7/d15/c4d 0 2024-02-10T00:00:31.599 INFO:tasks.workunit.client.0.smithi164.stdout:3/190: symlink d0/d1/d2/d19/d27/l38 0 2024-02-10T00:00:31.601 INFO:tasks.workunit.client.0.smithi164.stdout:5/243: unlink d7/d17/d21/f47 0 2024-02-10T00:00:31.602 INFO:tasks.workunit.client.0.smithi164.stdout:5/244: fsync d7/f1d 0 2024-02-10T00:00:31.602 INFO:tasks.workunit.client.0.smithi164.stdout:5/245: chown d7/fc 193820925 1 2024-02-10T00:00:31.602 INFO:tasks.workunit.client.0.smithi164.stdout:5/246: dread - d7/d15/d1f/f4a zero size 2024-02-10T00:00:31.604 INFO:tasks.workunit.client.0.smithi164.stdout:3/191: unlink d0/d1/c8 0 2024-02-10T00:00:31.606 INFO:tasks.workunit.client.0.smithi164.stdout:7/260: rename d3/d5/f7 to d3/d11/d39/d44/d48/d50/f5a 0 2024-02-10T00:00:31.607 INFO:tasks.workunit.client.0.smithi164.stdout:7/261: write d3/d11/f18 [2074363,23734] 0 2024-02-10T00:00:31.607 INFO:tasks.workunit.client.0.smithi164.stdout:7/262: readlink d3/d5/l1c 0 2024-02-10T00:00:31.608 INFO:tasks.workunit.client.0.smithi164.stdout:4/219: creat d2/d2f/d37/d41/d3d/f52 x:0 0 0 2024-02-10T00:00:31.608 INFO:tasks.workunit.client.0.smithi164.stdout:6/320: getdents d0/d2b/d3a/d3d/d42 0 2024-02-10T00:00:31.609 INFO:tasks.workunit.client.0.smithi164.stdout:4/220: write d2/f1a [252468,107640] 0 2024-02-10T00:00:31.611 INFO:tasks.workunit.client.0.smithi164.stdout:3/192: creat d0/d1/d2/d19/f39 x:0 0 0 2024-02-10T00:00:31.611 INFO:tasks.workunit.client.0.smithi164.stdout:3/193: chown d0/d1/d2/d17/d37 0 1 2024-02-10T00:00:31.612 INFO:tasks.workunit.client.0.smithi164.stdout:3/194: write d0/d1/dd/f31 [730422,21897] 0 2024-02-10T00:00:31.612 INFO:tasks.workunit.client.0.smithi164.stdout:7/263: rename d3/d11/c1b to d3/d28/c5b 0 2024-02-10T00:00:31.613 INFO:tasks.workunit.client.0.smithi164.stdout:3/195: write d0/d1/dd/f31 [1296237,104910] 0 2024-02-10T00:00:31.614 INFO:tasks.workunit.client.0.smithi164.stdout:5/247: unlink d7/d15/l16 0 2024-02-10T00:00:31.617 INFO:tasks.workunit.client.0.smithi164.stdout:7/264: symlink d3/d5/d2b/d4a/l5c 0 2024-02-10T00:00:31.617 INFO:tasks.workunit.client.0.smithi164.stdout:3/196: readlink d0/l21 0 2024-02-10T00:00:31.618 INFO:tasks.workunit.client.0.smithi164.stdout:4/221: getdents d2/d2f/d37/d41/d3d/d42/d47 0 2024-02-10T00:00:31.619 INFO:tasks.workunit.client.1.smithi183.stdout:2/710: creat d2/d2c/dab/fed x:0 0 0 2024-02-10T00:00:31.619 INFO:tasks.workunit.client.1.smithi183.stdout:0/548: mkdir d14/d1d/d2d/d31/d68/dcc 0 2024-02-10T00:00:31.619 INFO:tasks.workunit.client.1.smithi183.stdout:4/586: rename de/d14/d27/d2e/c46 to de/d19/d1c/d61/cb7 0 2024-02-10T00:00:31.619 INFO:tasks.workunit.client.0.smithi164.stdout:7/265: mkdir d3/d4d/d5d 0 2024-02-10T00:00:31.620 INFO:tasks.workunit.client.1.smithi183.stdout:9/579: creat d0/d3/d14/d74/da8/fc3 x:0 0 0 2024-02-10T00:00:31.620 INFO:tasks.workunit.client.1.smithi183.stdout:8/636: symlink d0/lca 0 2024-02-10T00:00:31.620 INFO:tasks.workunit.client.1.smithi183.stdout:4/587: chown de/l1e 1 1 2024-02-10T00:00:31.621 INFO:tasks.workunit.client.0.smithi164.stdout:5/248: creat d7/d17/d3b/d43/f4e x:0 0 0 2024-02-10T00:00:31.621 INFO:tasks.workunit.client.1.smithi183.stdout:5/659: symlink d4/d23/d3e/d80/da1/d9e/d27/d5d/ld0 0 2024-02-10T00:00:31.621 INFO:tasks.workunit.client.1.smithi183.stdout:9/580: dread - d0/d3/d14/d1c/d4b/d51/f75 zero size 2024-02-10T00:00:31.622 INFO:tasks.workunit.client.1.smithi183.stdout:0/549: creat d14/d1d/d2d/d31/fcd x:0 0 0 2024-02-10T00:00:31.622 INFO:tasks.workunit.client.0.smithi164.stdout:7/266: unlink d3/d26/c2f 0 2024-02-10T00:00:31.623 INFO:tasks.workunit.client.0.smithi164.stdout:7/267: dread - d3/d4d/f55 zero size 2024-02-10T00:00:31.623 INFO:tasks.workunit.client.0.smithi164.stdout:3/197: creat d0/d1/d2/d17/d37/f3a x:0 0 0 2024-02-10T00:00:31.624 INFO:tasks.workunit.client.1.smithi183.stdout:2/711: rename d2/da/f25 to d2/da/fee 0 2024-02-10T00:00:31.624 INFO:tasks.workunit.client.0.smithi164.stdout:7/268: write d3/d11/f14 [3183449,116140] 0 2024-02-10T00:00:31.626 INFO:tasks.workunit.client.1.smithi183.stdout:4/588: creat de/d14/d1d/d2f/da2/d9c/fb8 x:0 0 0 2024-02-10T00:00:31.626 INFO:tasks.workunit.client.1.smithi183.stdout:9/581: dread d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:31.626 INFO:tasks.workunit.client.1.smithi183.stdout:5/660: readlink d4/d23/d3e/d80/da1/d9e/d27/la8 0 2024-02-10T00:00:31.627 INFO:tasks.workunit.client.0.smithi164.stdout:7/269: mknod d3/d11/d39/d44/c5e 0 2024-02-10T00:00:31.628 INFO:tasks.workunit.client.0.smithi164.stdout:7/270: write d3/d11/f23 [1285226,32408] 0 2024-02-10T00:00:31.628 INFO:tasks.workunit.client.0.smithi164.stdout:3/198: dwrite d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:31.629 INFO:tasks.workunit.client.0.smithi164.stdout:3/199: fdatasync d0/d1/f11 0 2024-02-10T00:00:31.629 INFO:tasks.workunit.client.0.smithi164.stdout:7/271: chown d3/d28/c46 1296365465 1 2024-02-10T00:00:31.631 INFO:tasks.workunit.client.1.smithi183.stdout:9/582: dwrite d0/d3/d14/d1c/d4b/f65 [0,4194304] 0 2024-02-10T00:00:31.632 INFO:tasks.workunit.client.1.smithi183.stdout:0/550: rename d14/d43/l50 to d14/d1d/d59/d71/db4/lce 0 2024-02-10T00:00:31.633 INFO:tasks.workunit.client.1.smithi183.stdout:8/637: chown d0/d4e/d53/fa3 1465 1 2024-02-10T00:00:31.633 INFO:tasks.workunit.client.0.smithi164.stdout:3/200: unlink d0/d1/d2/d19/d27/c2b 0 2024-02-10T00:00:31.634 INFO:tasks.workunit.client.1.smithi183.stdout:2/712: creat d2/da/d20/d6d/dbd/fef x:0 0 0 2024-02-10T00:00:31.634 INFO:tasks.workunit.client.0.smithi164.stdout:3/201: chown d0/f10 9364 1 2024-02-10T00:00:31.634 INFO:tasks.workunit.client.0.smithi164.stdout:3/202: chown d0 11211322 1 2024-02-10T00:00:31.635 INFO:tasks.workunit.client.1.smithi183.stdout:0/551: write d14/d1d/d59/d71/d22/f48 [3966683,131054] 0 2024-02-10T00:00:31.635 INFO:tasks.workunit.client.1.smithi183.stdout:4/589: write de/d14/d27/d2e/f74 [967919,112096] 0 2024-02-10T00:00:31.635 INFO:tasks.workunit.client.1.smithi183.stdout:5/661: creat d4/d74/fd1 x:0 0 0 2024-02-10T00:00:31.636 INFO:tasks.workunit.client.1.smithi183.stdout:0/552: chown d14/d1d/d2d/f79 3040 1 2024-02-10T00:00:31.636 INFO:tasks.workunit.client.1.smithi183.stdout:0/553: stat f3 0 2024-02-10T00:00:31.637 INFO:tasks.workunit.client.1.smithi183.stdout:0/554: fsync d14/d1d/d2d/d31/f91 0 2024-02-10T00:00:31.637 INFO:tasks.workunit.client.0.smithi164.stdout:3/203: mkdir d0/d3b 0 2024-02-10T00:00:31.638 INFO:tasks.workunit.client.1.smithi183.stdout:8/638: creat d0/d3f/d94/fcb x:0 0 0 2024-02-10T00:00:31.639 INFO:tasks.workunit.client.1.smithi183.stdout:4/590: fsync de/d14/d27/f37 0 2024-02-10T00:00:31.643 INFO:tasks.workunit.client.0.smithi164.stdout:3/204: dwrite d0/f10 [0,4194304] 0 2024-02-10T00:00:31.647 INFO:tasks.workunit.client.0.smithi164.stdout:3/205: mkdir d0/d1/d3c 0 2024-02-10T00:00:31.649 INFO:tasks.workunit.client.0.smithi164.stdout:1/187: rename d1/d1a/d2d to d1/d1a/d41 0 2024-02-10T00:00:31.650 INFO:tasks.workunit.client.1.smithi183.stdout:5/662: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/f61 [0,4194304] 0 2024-02-10T00:00:31.650 INFO:tasks.workunit.client.1.smithi183.stdout:0/555: dwrite d14/d1d/d59/d71/d22/f35 [0,4194304] 0 2024-02-10T00:00:31.651 INFO:tasks.workunit.client.0.smithi164.stdout:9/245: truncate d6/fc 125353 0 2024-02-10T00:00:31.652 INFO:tasks.workunit.client.1.smithi183.stdout:5/663: fsync d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/fc8 0 2024-02-10T00:00:31.652 INFO:tasks.workunit.client.0.smithi164.stdout:2/272: write d3/d32/d4e/d27/d2e/d36/d54/f55 [3509920,96279] 0 2024-02-10T00:00:31.652 INFO:tasks.workunit.client.1.smithi183.stdout:5/664: chown d4/d23/d3e/d80/da1/d9e/d27/d38/cb6 661344821 1 2024-02-10T00:00:31.653 INFO:tasks.workunit.client.0.smithi164.stdout:1/188: symlink d1/d23/l42 0 2024-02-10T00:00:31.654 INFO:tasks.workunit.client.0.smithi164.stdout:3/206: mkdir d0/d1/d3c/d3d 0 2024-02-10T00:00:31.655 INFO:tasks.workunit.client.0.smithi164.stdout:9/246: creat d6/d1c/d24/f4a x:0 0 0 2024-02-10T00:00:31.655 INFO:tasks.workunit.client.0.smithi164.stdout:2/273: mknod d3/d32/d4e/d27/d2e/c68 0 2024-02-10T00:00:31.656 INFO:tasks.workunit.client.0.smithi164.stdout:4/222: dread d2/f1e [0,4194304] 0 2024-02-10T00:00:31.657 INFO:tasks.workunit.client.0.smithi164.stdout:9/247: chown d6/c13 2040507737 1 2024-02-10T00:00:31.657 INFO:tasks.workunit.client.1.smithi183.stdout:3/523: dwrite d7/db/d2a/d1c/f27 [0,4194304] 0 2024-02-10T00:00:31.658 INFO:tasks.workunit.client.1.smithi183.stdout:4/591: creat de/d14/d27/fb9 x:0 0 0 2024-02-10T00:00:31.659 INFO:tasks.workunit.client.0.smithi164.stdout:3/207: mkdir d0/d1/d3c/d3d/d3e 0 2024-02-10T00:00:31.659 INFO:tasks.workunit.client.1.smithi183.stdout:0/556: symlink d14/d1d/d59/d71/d22/lcf 0 2024-02-10T00:00:31.661 INFO:tasks.workunit.client.0.smithi164.stdout:4/223: creat d2/d19/d16/f53 x:0 0 0 2024-02-10T00:00:31.662 INFO:tasks.workunit.client.0.smithi164.stdout:2/274: mknod d3/d24/d5b/c69 0 2024-02-10T00:00:31.663 INFO:tasks.workunit.client.1.smithi183.stdout:4/592: dwrite de/d14/d27/d2e/f8e [0,4194304] 0 2024-02-10T00:00:31.663 INFO:tasks.workunit.client.0.smithi164.stdout:9/248: mkdir d6/d4b 0 2024-02-10T00:00:31.664 INFO:tasks.workunit.client.1.smithi183.stdout:4/593: read de/d14/d27/d2e/f9f [2825433,52111] 0 2024-02-10T00:00:31.665 INFO:tasks.workunit.client.0.smithi164.stdout:3/208: mkdir d0/d1/d2/d17/d37/d3f 0 2024-02-10T00:00:31.666 INFO:tasks.workunit.client.0.smithi164.stdout:2/275: dwrite d3/d32/d4e/d27/d2e/d36/f3b [8388608,4194304] 0 2024-02-10T00:00:31.670 INFO:tasks.workunit.client.1.smithi183.stdout:3/524: creat d7/db/f94 x:0 0 0 2024-02-10T00:00:31.671 INFO:tasks.workunit.client.1.smithi183.stdout:1/536: sync 2024-02-10T00:00:31.671 INFO:tasks.workunit.client.1.smithi183.stdout:4/594: stat de/d14/d1d/d2f/c5f 0 2024-02-10T00:00:31.673 INFO:tasks.workunit.client.0.smithi164.stdout:0/206: dread d6/d10/d18/d1c/f3b [0,4194304] 0 2024-02-10T00:00:31.677 INFO:tasks.workunit.client.0.smithi164.stdout:3/209: getdents d0/d1/d2/d17/d37/d3f 0 2024-02-10T00:00:31.679 INFO:tasks.workunit.client.0.smithi164.stdout:2/276: creat d3/d26/d64/f6a x:0 0 0 2024-02-10T00:00:31.679 INFO:tasks.workunit.client.1.smithi183.stdout:1/537: mknod d0/d3/d7/d3d/cc3 0 2024-02-10T00:00:31.680 INFO:tasks.workunit.client.0.smithi164.stdout:0/207: mkdir d6/d43 0 2024-02-10T00:00:31.681 INFO:tasks.workunit.client.0.smithi164.stdout:4/224: creat d2/d2f/f54 x:0 0 0 2024-02-10T00:00:31.683 INFO:tasks.workunit.client.0.smithi164.stdout:2/277: dwrite d3/f1f [0,4194304] 0 2024-02-10T00:00:31.684 INFO:tasks.workunit.client.0.smithi164.stdout:0/208: dwrite d6/d10/f1d [0,4194304] 0 2024-02-10T00:00:31.685 INFO:tasks.workunit.client.0.smithi164.stdout:0/209: dread - d6/d7/f24 zero size 2024-02-10T00:00:31.686 INFO:tasks.workunit.client.0.smithi164.stdout:4/225: unlink d2/l6 0 2024-02-10T00:00:31.686 INFO:tasks.workunit.client.0.smithi164.stdout:4/226: readlink d2/l3 0 2024-02-10T00:00:31.687 INFO:tasks.workunit.client.1.smithi183.stdout:4/595: getdents de 0 2024-02-10T00:00:31.689 INFO:tasks.workunit.client.1.smithi183.stdout:1/538: truncate d0/d3/d7/f6c 1428553 0 2024-02-10T00:00:31.691 INFO:tasks.workunit.client.0.smithi164.stdout:0/210: mkdir d6/d10/d18/d2d/d35/d44 0 2024-02-10T00:00:31.692 INFO:tasks.workunit.client.1.smithi183.stdout:1/539: mkdir d0/d3/d29/dc4 0 2024-02-10T00:00:31.692 INFO:tasks.workunit.client.1.smithi183.stdout:8/639: dread d0/fd [0,4194304] 0 2024-02-10T00:00:31.694 INFO:tasks.workunit.client.0.smithi164.stdout:4/227: creat d2/d2f/d37/f55 x:0 0 0 2024-02-10T00:00:31.696 INFO:tasks.workunit.client.0.smithi164.stdout:0/211: dwrite d6/d7/f17 [0,4194304] 0 2024-02-10T00:00:31.698 INFO:tasks.workunit.client.0.smithi164.stdout:0/212: dread - d6/d7/f24 zero size 2024-02-10T00:00:31.699 INFO:tasks.workunit.client.0.smithi164.stdout:4/228: dwrite d2/d19/f15 [0,4194304] 0 2024-02-10T00:00:31.703 INFO:tasks.workunit.client.1.smithi183.stdout:7/553: truncate d0/d2/f2b 2731896 0 2024-02-10T00:00:31.707 INFO:tasks.workunit.client.1.smithi183.stdout:6/484: truncate d2/f65 823799 0 2024-02-10T00:00:31.711 INFO:tasks.workunit.client.0.smithi164.stdout:5/249: truncate d7/d17/f1c 710041 0 2024-02-10T00:00:31.712 INFO:tasks.workunit.client.0.smithi164.stdout:6/321: dwrite d0/d6/d12/d43/f44 [0,4194304] 0 2024-02-10T00:00:31.714 INFO:tasks.workunit.client.0.smithi164.stdout:4/229: mkdir d2/d2f/d37/d41/d3d/d56 0 2024-02-10T00:00:31.714 INFO:tasks.workunit.client.1.smithi183.stdout:9/583: truncate d0/d10/f8d 1041357 0 2024-02-10T00:00:31.717 INFO:tasks.workunit.client.0.smithi164.stdout:7/272: dwrite d3/f13 [0,4194304] 0 2024-02-10T00:00:31.718 INFO:tasks.workunit.client.0.smithi164.stdout:6/322: dwrite d0/fc [0,4194304] 0 2024-02-10T00:00:31.718 INFO:tasks.workunit.client.1.smithi183.stdout:2/713: rename d2/da/d20/d6d to d2/d2c/dba/df0 0 2024-02-10T00:00:31.719 INFO:tasks.workunit.client.0.smithi164.stdout:7/273: dread - d3/d28/f3f zero size 2024-02-10T00:00:31.719 INFO:tasks.workunit.client.1.smithi183.stdout:8/640: fdatasync d0/d45/d46/d81/fa7 0 2024-02-10T00:00:31.720 INFO:tasks.workunit.client.0.smithi164.stdout:7/274: chown d3/d11/d39/d44/d48/l54 60084197 1 2024-02-10T00:00:31.720 INFO:tasks.workunit.client.1.smithi183.stdout:8/641: fdatasync d0/d27/d75/d5b/fc1 0 2024-02-10T00:00:31.720 INFO:tasks.workunit.client.1.smithi183.stdout:2/714: chown d2/da/d77/dc7/db5/d35/f4e 69939725 1 2024-02-10T00:00:31.721 INFO:tasks.workunit.client.1.smithi183.stdout:8/642: dread - d0/d27/d75/d5b/fc1 zero size 2024-02-10T00:00:31.724 INFO:tasks.workunit.client.0.smithi164.stdout:6/323: rename d0/d6/d12/d14/c2c to d0/d6/d12/d43/c60 0 2024-02-10T00:00:31.724 INFO:tasks.workunit.client.1.smithi183.stdout:2/715: dwrite d2/d2c/dab/f95 [0,4194304] 0 2024-02-10T00:00:31.725 INFO:tasks.workunit.client.1.smithi183.stdout:5/665: rename d4/d23/d3e/d80/da1/d9e/d27/d38/f47 to d4/dd/d31/d73/fd2 0 2024-02-10T00:00:31.726 INFO:tasks.workunit.client.1.smithi183.stdout:2/716: chown d2/da/d19/fb4 200727944 1 2024-02-10T00:00:31.726 INFO:tasks.workunit.client.0.smithi164.stdout:7/275: creat d3/f5f x:0 0 0 2024-02-10T00:00:31.727 INFO:tasks.workunit.client.1.smithi183.stdout:8/643: symlink d0/d27/d36/d7f/lcc 0 2024-02-10T00:00:31.728 INFO:tasks.workunit.client.1.smithi183.stdout:8/644: write d0/d27/d75/f7e [451353,45796] 0 2024-02-10T00:00:31.730 INFO:tasks.workunit.client.1.smithi183.stdout:4/596: rename de/d14/f47 to de/d19/d20/fba 0 2024-02-10T00:00:31.734 INFO:tasks.workunit.client.1.smithi183.stdout:8/645: unlink d0/d3f/db2/d24/f54 0 2024-02-10T00:00:31.734 INFO:tasks.workunit.client.1.smithi183.stdout:4/597: chown de/d19/d1c/f36 4000 1 2024-02-10T00:00:31.735 INFO:tasks.workunit.client.0.smithi164.stdout:6/324: link d0/d6/f10 d0/d6/d12/d14/f61 0 2024-02-10T00:00:31.735 INFO:tasks.workunit.client.1.smithi183.stdout:4/598: stat de/d19/d20/f6b 0 2024-02-10T00:00:31.736 INFO:tasks.workunit.client.0.smithi164.stdout:7/276: symlink d3/d11/d39/d44/d48/l60 0 2024-02-10T00:00:31.736 INFO:tasks.workunit.client.0.smithi164.stdout:7/277: dread - d3/d28/f3f zero size 2024-02-10T00:00:31.736 INFO:tasks.workunit.client.1.smithi183.stdout:5/666: truncate d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fa3 855667 0 2024-02-10T00:00:31.737 INFO:tasks.workunit.client.0.smithi164.stdout:6/325: mkdir d0/d6/d12/d14/d4b/d62 0 2024-02-10T00:00:31.738 INFO:tasks.workunit.client.1.smithi183.stdout:2/717: unlink d2/d2c/d2f/d72/f9f 0 2024-02-10T00:00:31.738 INFO:tasks.workunit.client.1.smithi183.stdout:4/599: rmdir de/d19/d8d 39 2024-02-10T00:00:31.739 INFO:tasks.workunit.client.1.smithi183.stdout:8/646: symlink d0/d3f/db2/lcd 0 2024-02-10T00:00:31.740 INFO:tasks.workunit.client.0.smithi164.stdout:6/326: mknod d0/d6/d4d/c63 0 2024-02-10T00:00:31.741 INFO:tasks.workunit.client.1.smithi183.stdout:2/718: creat d2/d2c/dba/df0/dbd/ff1 x:0 0 0 2024-02-10T00:00:31.741 INFO:tasks.workunit.client.0.smithi164.stdout:6/327: write d0/d2b/d3a/f3e [1231490,62202] 0 2024-02-10T00:00:31.741 INFO:tasks.workunit.client.1.smithi183.stdout:8/647: chown d0/d4e/d6b 5144456 1 2024-02-10T00:00:31.743 INFO:tasks.workunit.client.1.smithi183.stdout:8/648: fsync d0/d27/f44 0 2024-02-10T00:00:31.744 INFO:tasks.workunit.client.0.smithi164.stdout:6/328: mknod d0/d6/d12/c64 0 2024-02-10T00:00:31.744 INFO:tasks.workunit.client.1.smithi183.stdout:8/649: dread - d0/fc2 zero size 2024-02-10T00:00:31.745 INFO:tasks.workunit.client.1.smithi183.stdout:4/600: dwrite de/d14/d4e/f94 [0,4194304] 0 2024-02-10T00:00:31.748 INFO:tasks.workunit.client.1.smithi183.stdout:8/650: stat d0/d4e/l70 0 2024-02-10T00:00:31.750 INFO:tasks.workunit.client.1.smithi183.stdout:4/601: read de/d19/f95 [447985,104531] 0 2024-02-10T00:00:31.752 INFO:tasks.workunit.client.1.smithi183.stdout:4/602: creat de/d14/d1d/d7b/fbb x:0 0 0 2024-02-10T00:00:31.752 INFO:tasks.workunit.client.1.smithi183.stdout:4/603: fdatasync de/d14/d1d/d2f/da2/d9c/fb8 0 2024-02-10T00:00:31.753 INFO:tasks.workunit.client.0.smithi164.stdout:4/230: stat d2/d19/d16 0 2024-02-10T00:00:31.753 INFO:tasks.workunit.client.0.smithi164.stdout:1/189: dwrite d1/d1a/d41/d18/f3e [0,4194304] 0 2024-02-10T00:00:31.753 INFO:tasks.workunit.client.1.smithi183.stdout:9/584: sync 2024-02-10T00:00:31.756 INFO:tasks.workunit.client.1.smithi183.stdout:9/585: unlink d0/d3/d14/f77 0 2024-02-10T00:00:31.757 INFO:tasks.workunit.client.0.smithi164.stdout:1/190: rename d1/d13/d1f/c25 to d1/d1a/c43 0 2024-02-10T00:00:31.757 INFO:tasks.workunit.client.0.smithi164.stdout:4/231: dread d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:31.759 INFO:tasks.workunit.client.0.smithi164.stdout:8/202: dwrite d2/f27 [0,4194304] 0 2024-02-10T00:00:31.762 INFO:tasks.workunit.client.0.smithi164.stdout:4/232: chown d2/fb 60 1 2024-02-10T00:00:31.764 INFO:tasks.workunit.client.0.smithi164.stdout:1/191: mknod d1/d23/c44 0 2024-02-10T00:00:31.765 INFO:tasks.workunit.client.1.smithi183.stdout:9/586: getdents d0/d3/d14/d48 0 2024-02-10T00:00:31.768 INFO:tasks.workunit.client.0.smithi164.stdout:4/233: mkdir d2/d19/d16/d31/d57 0 2024-02-10T00:00:31.768 INFO:tasks.workunit.client.0.smithi164.stdout:1/192: dwrite d1/d1a/d35/f31 [0,4194304] 0 2024-02-10T00:00:31.770 INFO:tasks.workunit.client.0.smithi164.stdout:1/193: fsync d1/d1a/d35/f34 0 2024-02-10T00:00:31.774 INFO:tasks.workunit.client.0.smithi164.stdout:8/203: dread d2/d12/f24 [0,4194304] 0 2024-02-10T00:00:31.774 INFO:tasks.workunit.client.0.smithi164.stdout:4/234: link d2/l3 d2/d2f/d37/l58 0 2024-02-10T00:00:31.775 INFO:tasks.workunit.client.0.smithi164.stdout:4/235: dread - d2/d2f/d37/f55 zero size 2024-02-10T00:00:31.776 INFO:tasks.workunit.client.0.smithi164.stdout:8/204: truncate d2/f7 286216 0 2024-02-10T00:00:31.781 INFO:tasks.workunit.client.0.smithi164.stdout:4/236: dwrite d2/d2f/f21 [0,4194304] 0 2024-02-10T00:00:31.781 INFO:tasks.workunit.client.0.smithi164.stdout:8/205: dread d2/f13 [0,4194304] 0 2024-02-10T00:00:31.783 INFO:tasks.workunit.client.0.smithi164.stdout:4/237: read d2/d19/d16/d31/f36 [44797,85782] 0 2024-02-10T00:00:31.784 INFO:tasks.workunit.client.0.smithi164.stdout:8/206: symlink d2/d12/d21/d31/l36 0 2024-02-10T00:00:31.787 INFO:tasks.workunit.client.1.smithi183.stdout:0/557: truncate f3 2412384 0 2024-02-10T00:00:31.788 INFO:tasks.workunit.client.0.smithi164.stdout:8/207: symlink d2/d12/d21/d31/d32/l37 0 2024-02-10T00:00:31.788 INFO:tasks.workunit.client.1.smithi183.stdout:3/525: write d7/db/d2a/d2d/f5b [21184,46553] 0 2024-02-10T00:00:31.788 INFO:tasks.workunit.client.0.smithi164.stdout:4/238: link d2/d2f/d37/d41/f35 d2/d19/d16/d31/d57/f59 0 2024-02-10T00:00:31.789 INFO:tasks.workunit.client.1.smithi183.stdout:0/558: write d14/d1d/d59/d71/f27 [3180261,49044] 0 2024-02-10T00:00:31.789 INFO:tasks.workunit.client.0.smithi164.stdout:4/239: write d2/d19/d16/d31/d4b/f50 [516307,103141] 0 2024-02-10T00:00:31.790 INFO:tasks.workunit.client.0.smithi164.stdout:8/208: creat d2/d12/d21/d31/d32/f38 x:0 0 0 2024-02-10T00:00:31.790 INFO:tasks.workunit.client.1.smithi183.stdout:3/526: symlink d7/db/d2a/d2d/d51/l95 0 2024-02-10T00:00:31.791 INFO:tasks.workunit.client.1.smithi183.stdout:0/559: getdents d14/d1d/d59/d3c/dc0 0 2024-02-10T00:00:31.791 INFO:tasks.workunit.client.1.smithi183.stdout:0/560: dread - d14/d43/fb7 zero size 2024-02-10T00:00:31.792 INFO:tasks.workunit.client.0.smithi164.stdout:8/209: creat d2/f39 x:0 0 0 2024-02-10T00:00:31.792 INFO:tasks.workunit.client.1.smithi183.stdout:4/604: sync 2024-02-10T00:00:31.792 INFO:tasks.workunit.client.1.smithi183.stdout:0/561: chown d14/d1d/d96/da0 31341 1 2024-02-10T00:00:31.793 INFO:tasks.workunit.client.0.smithi164.stdout:8/210: write d2/d12/d21/d31/d32/f38 [709740,55176] 0 2024-02-10T00:00:31.793 INFO:tasks.workunit.client.1.smithi183.stdout:0/562: read - d14/d1d/d96/da0/fad zero size 2024-02-10T00:00:31.793 INFO:tasks.workunit.client.1.smithi183.stdout:4/605: write de/d19/d1c/d61/dab/fb1 [468952,66256] 0 2024-02-10T00:00:31.794 INFO:tasks.workunit.client.0.smithi164.stdout:4/240: truncate d2/d2f/d37/d41/f34 225894 0 2024-02-10T00:00:31.794 INFO:tasks.workunit.client.1.smithi183.stdout:3/527: rmdir d7/d90 0 2024-02-10T00:00:31.794 INFO:tasks.workunit.client.1.smithi183.stdout:4/606: chown de/d14/d27/f3d 37 1 2024-02-10T00:00:31.796 INFO:tasks.workunit.client.0.smithi164.stdout:4/241: truncate d2/d2f/f51 700769 0 2024-02-10T00:00:31.797 INFO:tasks.workunit.client.1.smithi183.stdout:4/607: rename de/d19/d20/f6b to de/d19/d1c/d61/fbc 0 2024-02-10T00:00:31.798 INFO:tasks.workunit.client.0.smithi164.stdout:8/211: dwrite d2/d12/d21/d31/d32/f38 [0,4194304] 0 2024-02-10T00:00:31.798 INFO:tasks.workunit.client.1.smithi183.stdout:3/528: dwrite d7/db/d2a/d33/f36 [0,4194304] 0 2024-02-10T00:00:31.800 INFO:tasks.workunit.client.1.smithi183.stdout:4/608: creat de/d14/d1d/fbd x:0 0 0 2024-02-10T00:00:31.803 INFO:tasks.workunit.client.1.smithi183.stdout:4/609: unlink de/d19/ca7 0 2024-02-10T00:00:31.804 INFO:tasks.workunit.client.1.smithi183.stdout:4/610: readlink de/d14/d27/lb0 0 2024-02-10T00:00:31.804 INFO:tasks.workunit.client.1.smithi183.stdout:3/529: creat d7/db/f96 x:0 0 0 2024-02-10T00:00:31.804 INFO:tasks.workunit.client.1.smithi183.stdout:4/611: readlink de/d22/l42 0 2024-02-10T00:00:31.805 INFO:tasks.workunit.client.1.smithi183.stdout:8/651: dread d0/d23/f95 [0,4194304] 0 2024-02-10T00:00:31.808 INFO:tasks.workunit.client.1.smithi183.stdout:3/530: creat d7/db/d2a/d2d/d51/f97 x:0 0 0 2024-02-10T00:00:31.808 INFO:tasks.workunit.client.1.smithi183.stdout:4/612: creat de/d19/d1c/d61/dab/fbe x:0 0 0 2024-02-10T00:00:31.809 INFO:tasks.workunit.client.1.smithi183.stdout:4/613: write de/f7f [3822912,66444] 0 2024-02-10T00:00:31.812 INFO:tasks.workunit.client.1.smithi183.stdout:8/652: rmdir d0/d27/d75/d5b 39 2024-02-10T00:00:31.812 INFO:tasks.workunit.client.1.smithi183.stdout:8/653: chown d0 420117 1 2024-02-10T00:00:31.813 INFO:tasks.workunit.client.1.smithi183.stdout:4/614: creat de/d14/da4/fbf x:0 0 0 2024-02-10T00:00:31.814 INFO:tasks.workunit.client.1.smithi183.stdout:8/654: creat d0/d4e/d6b/fce x:0 0 0 2024-02-10T00:00:31.816 INFO:tasks.workunit.client.1.smithi183.stdout:4/615: symlink de/d19/d1c/d61/dab/lc0 0 2024-02-10T00:00:31.816 INFO:tasks.workunit.client.1.smithi183.stdout:3/531: truncate d7/f20 4350360 0 2024-02-10T00:00:31.817 INFO:tasks.workunit.client.0.smithi164.stdout:9/249: write d6/de/d22/f30 [644284,121271] 0 2024-02-10T00:00:31.817 INFO:tasks.workunit.client.1.smithi183.stdout:8/655: symlink d0/d3f/lcf 0 2024-02-10T00:00:31.819 INFO:tasks.workunit.client.0.smithi164.stdout:3/210: truncate d0/f10 1624195 0 2024-02-10T00:00:31.820 INFO:tasks.workunit.client.1.smithi183.stdout:4/616: creat de/d19/d1c/fc1 x:0 0 0 2024-02-10T00:00:31.820 INFO:tasks.workunit.client.0.smithi164.stdout:3/211: write d0/d1/d2/d19/d27/f2c [576599,126153] 0 2024-02-10T00:00:31.821 INFO:tasks.workunit.client.0.smithi164.stdout:2/278: rmdir d3 39 2024-02-10T00:00:31.822 INFO:tasks.workunit.client.1.smithi183.stdout:4/617: write de/d14/d27/d2e/f86 [1006401,76710] 0 2024-02-10T00:00:31.822 INFO:tasks.workunit.client.1.smithi183.stdout:8/656: dwrite d0/d10/d9e/fbe [0,4194304] 0 2024-02-10T00:00:31.823 INFO:tasks.workunit.client.1.smithi183.stdout:4/618: rmdir de 39 2024-02-10T00:00:31.823 INFO:tasks.workunit.client.0.smithi164.stdout:3/212: rename d0/d1/dd/l15 to d0/d1/d2/d17/d37/l40 0 2024-02-10T00:00:31.825 INFO:tasks.workunit.client.1.smithi183.stdout:4/619: fsync de/d14/d27/d2e/f4d 0 2024-02-10T00:00:31.825 INFO:tasks.workunit.client.0.smithi164.stdout:9/250: mknod d6/d4b/c4c 0 2024-02-10T00:00:31.826 INFO:tasks.workunit.client.1.smithi183.stdout:8/657: creat d0/fd0 x:0 0 0 2024-02-10T00:00:31.826 INFO:tasks.workunit.client.1.smithi183.stdout:4/620: write de/d14/d1d/d2f/da2/d9c/f9e [9146811,44373] 0 2024-02-10T00:00:31.828 INFO:tasks.workunit.client.1.smithi183.stdout:4/621: write de/d14/d27/f45 [251414,129412] 0 2024-02-10T00:00:31.828 INFO:tasks.workunit.client.0.smithi164.stdout:9/251: link f2 d6/d1c/d24/f4d 0 2024-02-10T00:00:31.830 INFO:tasks.workunit.client.1.smithi183.stdout:4/622: creat de/d14/d27/d2e/fc2 x:0 0 0 2024-02-10T00:00:31.830 INFO:tasks.workunit.client.0.smithi164.stdout:2/279: truncate d3/d32/d4e/d27/d2e/d36/f43 363325 0 2024-02-10T00:00:31.830 INFO:tasks.workunit.client.1.smithi183.stdout:4/623: write de/d14/d1d/d2f/da2/d9c/fb8 [855600,85646] 0 2024-02-10T00:00:31.831 INFO:tasks.workunit.client.1.smithi183.stdout:4/624: chown de/d19/d20/f5d 230911 1 2024-02-10T00:00:31.832 INFO:tasks.workunit.client.1.smithi183.stdout:8/658: link d0/d27/d36/c58 d0/d3f/cd1 0 2024-02-10T00:00:31.832 INFO:tasks.workunit.client.0.smithi164.stdout:9/252: dread d6/d1c/d24/f4d [4194304,4194304] 0 2024-02-10T00:00:31.832 INFO:tasks.workunit.client.1.smithi183.stdout:4/625: chown de/c76 529331 1 2024-02-10T00:00:31.834 INFO:tasks.workunit.client.1.smithi183.stdout:4/626: creat de/d14/d1d/fc3 x:0 0 0 2024-02-10T00:00:31.835 INFO:tasks.workunit.client.0.smithi164.stdout:2/280: dwrite d3/f50 [0,4194304] 0 2024-02-10T00:00:31.835 INFO:tasks.workunit.client.1.smithi183.stdout:4/627: chown de/d14/d1d/d2f/da2/d9c/fb8 0 1 2024-02-10T00:00:31.837 INFO:tasks.workunit.client.0.smithi164.stdout:9/253: rename d6/de/d3b/l3f to d6/de/d22/l4e 0 2024-02-10T00:00:31.837 INFO:tasks.workunit.client.0.smithi164.stdout:9/254: stat d6/de/d22/f30 0 2024-02-10T00:00:31.838 INFO:tasks.workunit.client.0.smithi164.stdout:2/281: rmdir d3/d24/d5b 39 2024-02-10T00:00:31.842 INFO:tasks.workunit.client.0.smithi164.stdout:0/213: truncate d6/d7/d14/f3e 3866376 0 2024-02-10T00:00:31.842 INFO:tasks.workunit.client.1.smithi183.stdout:1/540: dwrite d0/d3/d7/d36/f4d [0,4194304] 0 2024-02-10T00:00:31.843 INFO:tasks.workunit.client.0.smithi164.stdout:0/214: stat d6/d7 0 2024-02-10T00:00:31.843 INFO:tasks.workunit.client.0.smithi164.stdout:5/250: dwrite d7/f19 [0,4194304] 0 2024-02-10T00:00:31.844 INFO:tasks.workunit.client.1.smithi183.stdout:1/541: chown d0/f5a 1613 1 2024-02-10T00:00:31.844 INFO:tasks.workunit.client.1.smithi183.stdout:6/485: dwrite d2/f19 [0,4194304] 0 2024-02-10T00:00:31.846 INFO:tasks.workunit.client.0.smithi164.stdout:7/278: truncate d3/d11/f14 4009022 0 2024-02-10T00:00:31.848 INFO:tasks.workunit.client.1.smithi183.stdout:5/667: write d4/d23/f26 [9028886,7303] 0 2024-02-10T00:00:31.849 INFO:tasks.workunit.client.1.smithi183.stdout:2/719: truncate d2/da/d20/d21/d43/d58/d74/d83/dc4/fc5 952772 0 2024-02-10T00:00:31.849 INFO:tasks.workunit.client.0.smithi164.stdout:9/255: mkdir d6/d1c/d24/d4f 0 2024-02-10T00:00:31.850 INFO:tasks.workunit.client.1.smithi183.stdout:2/720: fdatasync d2/d2c/f90 0 2024-02-10T00:00:31.851 INFO:tasks.workunit.client.1.smithi183.stdout:2/721: write d2/da/d20/d21/d43/f65 [831463,88610] 0 2024-02-10T00:00:31.853 INFO:tasks.workunit.client.0.smithi164.stdout:7/279: unlink d3/d11/d39/d44/d48/l54 0 2024-02-10T00:00:31.854 INFO:tasks.workunit.client.1.smithi183.stdout:4/628: mknod de/d14/cc4 0 2024-02-10T00:00:31.858 INFO:tasks.workunit.client.1.smithi183.stdout:4/629: dwrite de/d14/d27/d2e/f8e [0,4194304] 0 2024-02-10T00:00:31.861 INFO:tasks.workunit.client.1.smithi183.stdout:6/486: unlink d2/f16 0 2024-02-10T00:00:31.861 INFO:tasks.workunit.client.0.smithi164.stdout:6/329: truncate d0/d6/d12/d14/f1e 2941247 0 2024-02-10T00:00:31.861 INFO:tasks.workunit.client.0.smithi164.stdout:3/213: dread d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:31.864 INFO:tasks.workunit.client.1.smithi183.stdout:9/587: truncate d0/d10/f5f 963581 0 2024-02-10T00:00:31.864 INFO:tasks.workunit.client.1.smithi183.stdout:7/554: dread d0/d2/d4/d8/f9f [0,4194304] 0 2024-02-10T00:00:31.865 INFO:tasks.workunit.client.1.smithi183.stdout:4/630: dwrite de/d22/f43 [0,4194304] 0 2024-02-10T00:00:31.867 INFO:tasks.workunit.client.0.smithi164.stdout:1/194: dwrite d1/d13/f19 [4194304,4194304] 0 2024-02-10T00:00:31.868 INFO:tasks.workunit.client.0.smithi164.stdout:1/195: chown d1/c20 2106838 1 2024-02-10T00:00:31.868 INFO:tasks.workunit.client.0.smithi164.stdout:1/196: readlink d1/l38 0 2024-02-10T00:00:31.869 INFO:tasks.workunit.client.1.smithi183.stdout:6/487: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [0,4194304] 0 2024-02-10T00:00:31.870 INFO:tasks.workunit.client.0.smithi164.stdout:5/251: fsync d7/d17/d21/d24/f3d 0 2024-02-10T00:00:31.870 INFO:tasks.workunit.client.0.smithi164.stdout:7/280: creat d3/d28/f61 x:0 0 0 2024-02-10T00:00:31.872 INFO:tasks.workunit.client.1.smithi183.stdout:0/563: dwrite f6 [0,4194304] 0 2024-02-10T00:00:31.872 INFO:tasks.workunit.client.1.smithi183.stdout:8/659: sync 2024-02-10T00:00:31.872 INFO:tasks.workunit.client.1.smithi183.stdout:0/564: dread - d14/d3e/d5f/fb1 zero size 2024-02-10T00:00:31.873 INFO:tasks.workunit.client.1.smithi183.stdout:8/660: readlink d0/d27/d36/l9d 0 2024-02-10T00:00:31.875 INFO:tasks.workunit.client.0.smithi164.stdout:1/197: dread d1/d13/f14 [0,4194304] 0 2024-02-10T00:00:31.880 INFO:tasks.workunit.client.1.smithi183.stdout:1/542: creat d0/fc5 x:0 0 0 2024-02-10T00:00:31.881 INFO:tasks.workunit.client.1.smithi183.stdout:2/722: mkdir d2/da/d20/d21/df2 0 2024-02-10T00:00:31.881 INFO:tasks.workunit.client.0.smithi164.stdout:3/214: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:31.881 INFO:tasks.workunit.client.0.smithi164.stdout:8/212: sync 2024-02-10T00:00:31.882 INFO:tasks.workunit.client.0.smithi164.stdout:1/198: dread d1/f7 [0,4194304] 0 2024-02-10T00:00:31.882 INFO:tasks.workunit.client.0.smithi164.stdout:4/242: read d2/d2f/d37/d41/f34 [61332,50747] 0 2024-02-10T00:00:31.882 INFO:tasks.workunit.client.0.smithi164.stdout:3/215: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:31.884 INFO:tasks.workunit.client.0.smithi164.stdout:7/281: mknod d3/d26/c62 0 2024-02-10T00:00:31.884 INFO:tasks.workunit.client.0.smithi164.stdout:8/213: write d2/f19 [84364,106794] 0 2024-02-10T00:00:31.885 INFO:tasks.workunit.client.0.smithi164.stdout:7/282: chown d3/d5/d2b/d4a/c58 53438 1 2024-02-10T00:00:31.885 INFO:tasks.workunit.client.0.smithi164.stdout:1/199: rmdir d1/d13 39 2024-02-10T00:00:31.890 INFO:tasks.workunit.client.1.smithi183.stdout:4/631: symlink de/d14/d27/d40/lc5 0 2024-02-10T00:00:31.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/243: mkdir d2/d5a 0 2024-02-10T00:00:31.891 INFO:tasks.workunit.client.0.smithi164.stdout:6/330: rmdir d0/d6/d12/d14/d4b/d62 0 2024-02-10T00:00:31.892 INFO:tasks.workunit.client.1.smithi183.stdout:6/488: mknod d2/d1a/d25/d3c/d31/d38/d3f/d5e/c92 0 2024-02-10T00:00:31.892 INFO:tasks.workunit.client.1.smithi183.stdout:6/489: chown d2/d1a/d25/d3c/d31/d38/d3f/d5e 2039955183 1 2024-02-10T00:00:31.894 INFO:tasks.workunit.client.0.smithi164.stdout:1/200: creat d1/d1a/f45 x:0 0 0 2024-02-10T00:00:31.894 INFO:tasks.workunit.client.0.smithi164.stdout:7/283: creat d3/d5/d2b/d4a/f63 x:0 0 0 2024-02-10T00:00:31.895 INFO:tasks.workunit.client.0.smithi164.stdout:7/284: read d3/d26/f31 [24369,25499] 0 2024-02-10T00:00:31.896 INFO:tasks.workunit.client.0.smithi164.stdout:7/285: chown d3/d28/c46 448373 1 2024-02-10T00:00:31.896 INFO:tasks.workunit.client.1.smithi183.stdout:8/661: creat d0/d10/d9e/da4/fd2 x:0 0 0 2024-02-10T00:00:31.898 INFO:tasks.workunit.client.1.smithi183.stdout:2/723: creat d2/d2c/d2f/d72/ff3 x:0 0 0 2024-02-10T00:00:31.899 INFO:tasks.workunit.client.0.smithi164.stdout:6/331: creat d0/d6/d12/d45/f65 x:0 0 0 2024-02-10T00:00:31.899 INFO:tasks.workunit.client.0.smithi164.stdout:0/215: sync 2024-02-10T00:00:31.900 INFO:tasks.workunit.client.1.smithi183.stdout:9/588: unlink d0/d3/d14/d1c/d2d/d4f/d79/l8e 0 2024-02-10T00:00:31.902 INFO:tasks.workunit.client.0.smithi164.stdout:7/286: fsync d3/d26/f31 0 2024-02-10T00:00:31.902 INFO:tasks.workunit.client.0.smithi164.stdout:1/201: mknod d1/d13/d16/c46 0 2024-02-10T00:00:31.903 INFO:tasks.workunit.client.0.smithi164.stdout:3/216: dread d0/d1/d2/d19/f33 [0,4194304] 0 2024-02-10T00:00:31.903 INFO:tasks.workunit.client.1.smithi183.stdout:4/632: unlink de/d14/d4e/f65 0 2024-02-10T00:00:31.904 INFO:tasks.workunit.client.1.smithi183.stdout:0/565: symlink d14/d7a/ld0 0 2024-02-10T00:00:31.904 INFO:tasks.workunit.client.1.smithi183.stdout:1/543: mkdir d0/d3/d67/d70/dae/dc6 0 2024-02-10T00:00:31.905 INFO:tasks.workunit.client.1.smithi183.stdout:8/662: creat d0/d3f/db2/d24/fd3 x:0 0 0 2024-02-10T00:00:31.905 INFO:tasks.workunit.client.0.smithi164.stdout:6/332: mkdir d0/d2b/d3a/d3d/d42/d5d/d66 0 2024-02-10T00:00:31.906 INFO:tasks.workunit.client.1.smithi183.stdout:2/724: symlink d2/d2c/d2f/dbb/lf4 0 2024-02-10T00:00:31.906 INFO:tasks.workunit.client.0.smithi164.stdout:1/202: dwrite d1/fd [4194304,4194304] 0 2024-02-10T00:00:31.907 INFO:tasks.workunit.client.1.smithi183.stdout:8/663: write d0/d45/d46/d81/fa7 [4369484,127739] 0 2024-02-10T00:00:31.907 INFO:tasks.workunit.client.0.smithi164.stdout:6/333: write d0/d2b/d3a/f55 [158712,14976] 0 2024-02-10T00:00:31.908 INFO:tasks.workunit.client.1.smithi183.stdout:7/555: rename d0/d11/d2f/c68 to d0/d2/ca4 0 2024-02-10T00:00:31.908 INFO:tasks.workunit.client.0.smithi164.stdout:1/203: read - d1/d1a/f39 zero size 2024-02-10T00:00:31.908 INFO:tasks.workunit.client.0.smithi164.stdout:7/287: rename d3/d11/d39/d44/d48/d50/f5a to d3/d28/d51/f64 0 2024-02-10T00:00:31.909 INFO:tasks.workunit.client.0.smithi164.stdout:6/334: dread d0/d6/f1c [0,4194304] 0 2024-02-10T00:00:31.909 INFO:tasks.workunit.client.0.smithi164.stdout:7/288: dread d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:31.910 INFO:tasks.workunit.client.1.smithi183.stdout:0/566: creat d14/d1d/d59/fd1 x:0 0 0 2024-02-10T00:00:31.911 INFO:tasks.workunit.client.1.smithi183.stdout:0/567: fsync d14/d1d/d55/fc2 0 2024-02-10T00:00:31.911 INFO:tasks.workunit.client.0.smithi164.stdout:3/217: mknod d0/d1/d2/d19/d27/d30/c41 0 2024-02-10T00:00:31.911 INFO:tasks.workunit.client.0.smithi164.stdout:7/289: stat d3/d11/d39/d3a/l4c 0 2024-02-10T00:00:31.911 INFO:tasks.workunit.client.1.smithi183.stdout:2/725: symlink d2/d2c/dab/lf5 0 2024-02-10T00:00:31.913 INFO:tasks.workunit.client.1.smithi183.stdout:3/532: dread d7/f5a [0,4194304] 0 2024-02-10T00:00:31.913 INFO:tasks.workunit.client.0.smithi164.stdout:1/204: creat d1/d13/f47 x:0 0 0 2024-02-10T00:00:31.913 INFO:tasks.workunit.client.1.smithi183.stdout:8/664: symlink d0/d3f/db2/d24/ld4 0 2024-02-10T00:00:31.915 INFO:tasks.workunit.client.0.smithi164.stdout:7/290: mknod d3/d4d/c65 0 2024-02-10T00:00:31.915 INFO:tasks.workunit.client.1.smithi183.stdout:2/726: write d2/d2c/d2f/d72/f92 [366435,52690] 0 2024-02-10T00:00:31.916 INFO:tasks.workunit.client.0.smithi164.stdout:6/335: creat d0/d6/d12/f67 x:0 0 0 2024-02-10T00:00:31.916 INFO:tasks.workunit.client.1.smithi183.stdout:2/727: chown d2/d2c/d2f/d60/d8d/d9c/da7/ce0 174649 1 2024-02-10T00:00:31.917 INFO:tasks.workunit.client.1.smithi183.stdout:9/589: rename d0/d3/d14/d1c/d2d/d4f/d58/f61 to d0/d30/d52/fc4 0 2024-02-10T00:00:31.918 INFO:tasks.workunit.client.0.smithi164.stdout:6/336: chown d0/d2b/c3c 25938235 1 2024-02-10T00:00:31.918 INFO:tasks.workunit.client.0.smithi164.stdout:1/205: dwrite d1/f11 [0,4194304] 0 2024-02-10T00:00:31.918 INFO:tasks.workunit.client.1.smithi183.stdout:9/590: readlink d0/d3/d14/d1c/d2d/d4f/d79/l9e 0 2024-02-10T00:00:31.919 INFO:tasks.workunit.client.1.smithi183.stdout:3/533: rmdir d7/db/d2a/d33/d59 39 2024-02-10T00:00:31.920 INFO:tasks.workunit.client.0.smithi164.stdout:1/206: fsync d1/d1a/d35/f34 0 2024-02-10T00:00:31.920 INFO:tasks.workunit.client.0.smithi164.stdout:7/291: write d3/d28/d51/f64 [4685319,36799] 0 2024-02-10T00:00:31.921 INFO:tasks.workunit.client.1.smithi183.stdout:4/633: link de/d14/d1d/c5b de/d19/d1c/d61/dab/cc6 0 2024-02-10T00:00:31.922 INFO:tasks.workunit.client.0.smithi164.stdout:3/218: dwrite d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:31.923 INFO:tasks.workunit.client.0.smithi164.stdout:7/292: chown d3/d26/f31 16043784 1 2024-02-10T00:00:31.924 INFO:tasks.workunit.client.0.smithi164.stdout:7/293: readlink d3/d11/d39/d3a/l4c 0 2024-02-10T00:00:31.924 INFO:tasks.workunit.client.1.smithi183.stdout:4/634: dwrite de/d14/d27/f3d [4194304,4194304] 0 2024-02-10T00:00:31.925 INFO:tasks.workunit.client.0.smithi164.stdout:6/337: rename d0/d6/d12/d14/l52 to d0/d6/d12/d57/l68 0 2024-02-10T00:00:31.925 INFO:tasks.workunit.client.1.smithi183.stdout:0/568: rename d14/d3e/d92/l66 to d14/d1d/d2d/d31/d68/ld2 0 2024-02-10T00:00:31.925 INFO:tasks.workunit.client.0.smithi164.stdout:1/207: mknod d1/d13/d16/c48 0 2024-02-10T00:00:31.926 INFO:tasks.workunit.client.1.smithi183.stdout:9/591: mkdir d0/d3/d14/d1c/d2d/d4f/d89/dc5 0 2024-02-10T00:00:31.926 INFO:tasks.workunit.client.0.smithi164.stdout:6/338: write d0/d6/d12/d45/f51 [873882,100512] 0 2024-02-10T00:00:31.927 INFO:tasks.workunit.client.1.smithi183.stdout:0/569: read d14/d1d/d2d/d31/d6c/d70/f81 [272133,3153] 0 2024-02-10T00:00:31.927 INFO:tasks.workunit.client.0.smithi164.stdout:3/219: dread d0/d1/d2/f12 [0,4194304] 0 2024-02-10T00:00:31.927 INFO:tasks.workunit.client.1.smithi183.stdout:9/592: dread - d0/d3/d14/d1c/d4b/d51/f7d zero size 2024-02-10T00:00:31.928 INFO:tasks.workunit.client.0.smithi164.stdout:7/294: creat d3/d11/d39/d3a/f66 x:0 0 0 2024-02-10T00:00:31.928 INFO:tasks.workunit.client.1.smithi183.stdout:9/593: chown d0/d3/d14/d48 3413308 1 2024-02-10T00:00:31.929 INFO:tasks.workunit.client.0.smithi164.stdout:6/339: mknod d0/d6/d12/d14/d4b/c69 0 2024-02-10T00:00:31.930 INFO:tasks.workunit.client.0.smithi164.stdout:6/340: write d0/d2b/d3a/f3e [997438,108756] 0 2024-02-10T00:00:31.931 INFO:tasks.workunit.client.0.smithi164.stdout:3/220: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:31.931 INFO:tasks.workunit.client.0.smithi164.stdout:7/295: mkdir d3/d26/d67 0 2024-02-10T00:00:31.932 INFO:tasks.workunit.client.1.smithi183.stdout:0/570: dwrite d14/d7a/d63/f65 [0,4194304] 0 2024-02-10T00:00:31.934 INFO:tasks.workunit.client.1.smithi183.stdout:2/728: creat d2/da/d20/d21/ff6 x:0 0 0 2024-02-10T00:00:31.934 INFO:tasks.workunit.client.1.smithi183.stdout:7/556: getdents d0/d2/d50/d5d 0 2024-02-10T00:00:31.937 INFO:tasks.workunit.client.0.smithi164.stdout:6/341: symlink d0/d6/d12/d14/d4b/l6a 0 2024-02-10T00:00:31.937 INFO:tasks.workunit.client.0.smithi164.stdout:7/296: symlink d3/d5/l68 0 2024-02-10T00:00:31.937 INFO:tasks.workunit.client.0.smithi164.stdout:8/214: dread d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:31.938 INFO:tasks.workunit.client.0.smithi164.stdout:6/342: fdatasync d0/d6/d12/d45/f65 0 2024-02-10T00:00:31.939 INFO:tasks.workunit.client.1.smithi183.stdout:7/557: chown d0/d11/d2f/d64/d6b/l9e 1039276447 1 2024-02-10T00:00:31.940 INFO:tasks.workunit.client.0.smithi164.stdout:3/221: creat d0/f42 x:0 0 0 2024-02-10T00:00:31.940 INFO:tasks.workunit.client.1.smithi183.stdout:4/635: link de/d22/laa de/d19/d20/lc7 0 2024-02-10T00:00:31.941 INFO:tasks.workunit.client.1.smithi183.stdout:9/594: getdents d0/d3/d14/d1c/d4b/d97 0 2024-02-10T00:00:31.942 INFO:tasks.workunit.client.0.smithi164.stdout:6/343: dread d0/fb [0,4194304] 0 2024-02-10T00:00:31.943 INFO:tasks.workunit.client.0.smithi164.stdout:3/222: fsync d0/d1/d2/fe 0 2024-02-10T00:00:31.943 INFO:tasks.workunit.client.0.smithi164.stdout:5/252: dread d7/d17/f3f [0,4194304] 0 2024-02-10T00:00:31.944 INFO:tasks.workunit.client.1.smithi183.stdout:2/729: truncate d2/d2c/dba/fda 27215 0 2024-02-10T00:00:31.944 INFO:tasks.workunit.client.1.smithi183.stdout:7/558: dread d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:31.944 INFO:tasks.workunit.client.1.smithi183.stdout:0/571: dread d14/d1d/d2d/f79 [0,4194304] 0 2024-02-10T00:00:31.945 INFO:tasks.workunit.client.1.smithi183.stdout:4/636: fsync de/d19/d8d/f9a 0 2024-02-10T00:00:31.945 INFO:tasks.workunit.client.1.smithi183.stdout:9/595: rmdir d0/d3/d14/d1c/d4b 39 2024-02-10T00:00:31.946 INFO:tasks.workunit.client.1.smithi183.stdout:6/490: dread d2/d1a/f23 [0,4194304] 0 2024-02-10T00:00:31.947 INFO:tasks.workunit.client.0.smithi164.stdout:3/223: dwrite d0/d1/dd/f31 [0,4194304] 0 2024-02-10T00:00:31.948 INFO:tasks.workunit.client.1.smithi183.stdout:2/730: creat d2/d2c/d2f/d60/d8d/d9c/ff7 x:0 0 0 2024-02-10T00:00:31.949 INFO:tasks.workunit.client.0.smithi164.stdout:5/253: mkdir d7/d17/d3b/d43/d4f 0 2024-02-10T00:00:31.949 INFO:tasks.workunit.client.1.smithi183.stdout:0/572: creat d14/d1d/d59/d71/db4/fd3 x:0 0 0 2024-02-10T00:00:31.951 INFO:tasks.workunit.client.1.smithi183.stdout:4/637: symlink de/d19/d20/lc8 0 2024-02-10T00:00:31.952 INFO:tasks.workunit.client.1.smithi183.stdout:9/596: creat d0/d3/d14/d1c/d2d/d4f/d58/fc6 x:0 0 0 2024-02-10T00:00:31.953 INFO:tasks.workunit.client.0.smithi164.stdout:5/254: dwrite d7/d17/f3f [0,4194304] 0 2024-02-10T00:00:31.953 INFO:tasks.workunit.client.1.smithi183.stdout:2/731: mkdir d2/d2c/dba/df0/dbe/df8 0 2024-02-10T00:00:31.954 INFO:tasks.workunit.client.0.smithi164.stdout:3/224: creat d0/f43 x:0 0 0 2024-02-10T00:00:31.957 INFO:tasks.workunit.client.0.smithi164.stdout:5/255: dwrite d7/f32 [0,4194304] 0 2024-02-10T00:00:31.958 INFO:tasks.workunit.client.1.smithi183.stdout:0/573: mkdir d14/d3e/dd4 0 2024-02-10T00:00:31.958 INFO:tasks.workunit.client.1.smithi183.stdout:7/559: dread d0/d11/d35/f61 [0,4194304] 0 2024-02-10T00:00:31.958 INFO:tasks.workunit.client.1.smithi183.stdout:4/638: symlink de/lc9 0 2024-02-10T00:00:31.959 INFO:tasks.workunit.client.0.smithi164.stdout:3/225: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:31.960 INFO:tasks.workunit.client.1.smithi183.stdout:6/491: truncate d2/d1a/d25/d3c/d31/d66/f71 1111233 0 2024-02-10T00:00:31.960 INFO:tasks.workunit.client.1.smithi183.stdout:6/492: write d2/f4b [410612,110709] 0 2024-02-10T00:00:31.961 INFO:tasks.workunit.client.1.smithi183.stdout:6/493: fsync d2/d1a/f43 0 2024-02-10T00:00:31.961 INFO:tasks.workunit.client.1.smithi183.stdout:7/560: chown d0/d2/d4/f3c 49999 1 2024-02-10T00:00:31.962 INFO:tasks.workunit.client.1.smithi183.stdout:7/561: chown d0/d11/d2f/d64 27210 1 2024-02-10T00:00:31.962 INFO:tasks.workunit.client.0.smithi164.stdout:0/216: sync 2024-02-10T00:00:31.963 INFO:tasks.workunit.client.0.smithi164.stdout:0/217: write d6/d10/d18/d2d/f37 [82791,45382] 0 2024-02-10T00:00:31.964 INFO:tasks.workunit.client.0.smithi164.stdout:3/226: rename d0/d1/d2/d19/d27/l38 to d0/d1/d2/d19/l44 0 2024-02-10T00:00:31.967 INFO:tasks.workunit.client.0.smithi164.stdout:3/227: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:31.968 INFO:tasks.workunit.client.1.smithi183.stdout:1/544: dread d0/d3/d67/f94 [0,4194304] 0 2024-02-10T00:00:31.969 INFO:tasks.workunit.client.1.smithi183.stdout:1/545: write d0/fc5 [840630,99190] 0 2024-02-10T00:00:31.969 INFO:tasks.workunit.client.1.smithi183.stdout:0/574: unlink d14/d1d/d2d/d31/d68/laf 0 2024-02-10T00:00:31.969 INFO:tasks.workunit.client.0.smithi164.stdout:3/228: fsync d0/f35 0 2024-02-10T00:00:31.971 INFO:tasks.workunit.client.1.smithi183.stdout:4/639: rename de/d14/d27/d2e/l9b to de/d19/d20/lca 0 2024-02-10T00:00:31.971 INFO:tasks.workunit.client.1.smithi183.stdout:6/494: fsync d2/f7 0 2024-02-10T00:00:31.973 INFO:tasks.workunit.client.0.smithi164.stdout:3/229: dwrite d0/f42 [0,4194304] 0 2024-02-10T00:00:31.973 INFO:tasks.workunit.client.1.smithi183.stdout:7/562: mkdir d0/d11/da5 0 2024-02-10T00:00:31.973 INFO:tasks.workunit.client.0.smithi164.stdout:0/218: read d6/d7/fc [3053706,121174] 0 2024-02-10T00:00:31.975 INFO:tasks.workunit.client.1.smithi183.stdout:0/575: getdents d14/d1d/d59/d71/dcb 0 2024-02-10T00:00:31.975 INFO:tasks.workunit.client.1.smithi183.stdout:6/495: readlink d2/d1a/d25/d3c/d31/d38/d6e/d34/l3b 0 2024-02-10T00:00:31.976 INFO:tasks.workunit.client.0.smithi164.stdout:3/230: unlink d0/f42 0 2024-02-10T00:00:31.979 INFO:tasks.workunit.client.1.smithi183.stdout:1/546: link d0/d3/d67/d7b/f98 d0/d3/d67/d70/fc7 0 2024-02-10T00:00:31.980 INFO:tasks.workunit.client.1.smithi183.stdout:1/547: write d0/fc5 [1771380,28878] 0 2024-02-10T00:00:31.981 INFO:tasks.workunit.client.0.smithi164.stdout:3/231: rename d0/d1/d3c/d3d/d3e to d0/d1/d2/d19/d45 0 2024-02-10T00:00:31.982 INFO:tasks.workunit.client.0.smithi164.stdout:0/219: link d6/d10/d18/c40 d6/d10/d18/c45 0 2024-02-10T00:00:31.982 INFO:tasks.workunit.client.1.smithi183.stdout:1/548: creat d0/d3/d67/fc8 x:0 0 0 2024-02-10T00:00:31.985 INFO:tasks.workunit.client.0.smithi164.stdout:3/232: dread d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:31.986 INFO:tasks.workunit.client.1.smithi183.stdout:9/597: read d0/d3/d14/d3c/d7b/f87 [3210525,106834] 0 2024-02-10T00:00:31.990 INFO:tasks.workunit.client.1.smithi183.stdout:5/668: truncate d4/d23/d3e/d80/da1/d9e/d27/d38/f61 2598597 0 2024-02-10T00:00:31.992 INFO:tasks.workunit.client.0.smithi164.stdout:0/220: unlink d6/d7/d14/f3e 0 2024-02-10T00:00:31.992 INFO:tasks.workunit.client.1.smithi183.stdout:5/669: mknod d4/d23/d2a/d5b/cd3 0 2024-02-10T00:00:31.994 INFO:tasks.workunit.client.1.smithi183.stdout:9/598: dwrite d0/d30/fb6 [0,4194304] 0 2024-02-10T00:00:31.996 INFO:tasks.workunit.client.1.smithi183.stdout:5/670: mkdir d4/d23/d3e/d80/da1/d9e/d89/dd4 0 2024-02-10T00:00:31.997 INFO:tasks.workunit.client.0.smithi164.stdout:2/282: truncate d3/d32/d4e/f59 4190995 0 2024-02-10T00:00:31.998 INFO:tasks.workunit.client.1.smithi183.stdout:5/671: mknod d4/d23/d3e/d80/cd5 0 2024-02-10T00:00:32.002 INFO:tasks.workunit.client.0.smithi164.stdout:0/221: creat d6/d43/f46 x:0 0 0 2024-02-10T00:00:32.006 INFO:tasks.workunit.client.1.smithi183.stdout:9/599: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:32.008 INFO:tasks.workunit.client.1.smithi183.stdout:9/600: mknod d0/d3/d14/d74/da8/cc7 0 2024-02-10T00:00:32.008 INFO:tasks.workunit.client.1.smithi183.stdout:9/601: readlink d0/d3/d14/l28 0 2024-02-10T00:00:32.008 INFO:tasks.workunit.client.1.smithi183.stdout:9/602: readlink d0/d3/d14/d1c/d2d/l37 0 2024-02-10T00:00:32.012 INFO:tasks.workunit.client.1.smithi183.stdout:9/603: dwrite d0/d3/d14/d48/f5e [0,4194304] 0 2024-02-10T00:00:32.015 INFO:tasks.workunit.client.1.smithi183.stdout:9/604: write d0/d3/d14/d3c/f60 [2812990,29320] 0 2024-02-10T00:00:32.015 INFO:tasks.workunit.client.0.smithi164.stdout:1/208: sync 2024-02-10T00:00:32.016 INFO:tasks.workunit.client.1.smithi183.stdout:6/496: dread d2/d1a/d25/d3c/d31/d38/d6e/f2e [0,4194304] 0 2024-02-10T00:00:32.016 INFO:tasks.workunit.client.1.smithi183.stdout:6/497: stat d2/d1a/d25/d3c/d31/f8a 0 2024-02-10T00:00:32.017 INFO:tasks.workunit.client.1.smithi183.stdout:9/605: fsync d0/d3/d14/d1c/d2d/d4f/d79/f80 0 2024-02-10T00:00:32.019 INFO:tasks.workunit.client.1.smithi183.stdout:6/498: unlink d2/d32/l52 0 2024-02-10T00:00:32.020 INFO:tasks.workunit.client.1.smithi183.stdout:6/499: chown d2/d1a/d25/d3c/d31/d38/d6e/f84 4 1 2024-02-10T00:00:32.021 INFO:tasks.workunit.client.0.smithi164.stdout:0/222: dread d6/d10/d18/d2d/f2e [0,4194304] 0 2024-02-10T00:00:32.021 INFO:tasks.workunit.client.0.smithi164.stdout:1/209: write d1/d1a/f45 [973986,117873] 0 2024-02-10T00:00:32.022 INFO:tasks.workunit.client.0.smithi164.stdout:2/283: link d3/d32/d4e/d27/d2e/c49 d3/d24/c6b 0 2024-02-10T00:00:32.022 INFO:tasks.workunit.client.0.smithi164.stdout:0/223: stat d6/d7/d14/f1b 0 2024-02-10T00:00:32.022 INFO:tasks.workunit.client.0.smithi164.stdout:1/210: stat d1/d23/l40 0 2024-02-10T00:00:32.023 INFO:tasks.workunit.client.0.smithi164.stdout:2/284: write d3/f6 [833713,77798] 0 2024-02-10T00:00:32.024 INFO:tasks.workunit.client.0.smithi164.stdout:5/256: dread d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:32.026 INFO:tasks.workunit.client.1.smithi183.stdout:6/500: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d93 0 2024-02-10T00:00:32.026 INFO:tasks.workunit.client.1.smithi183.stdout:6/501: chown d2/d1a/f1f 3006046 1 2024-02-10T00:00:32.027 INFO:tasks.workunit.client.1.smithi183.stdout:6/502: chown d2/f5a 0 1 2024-02-10T00:00:32.027 INFO:tasks.workunit.client.0.smithi164.stdout:0/224: dwrite d6/d10/f1d [0,4194304] 0 2024-02-10T00:00:32.031 INFO:tasks.workunit.client.0.smithi164.stdout:5/257: rmdir d7/d17/d3b/d43/d4f 0 2024-02-10T00:00:32.031 INFO:tasks.workunit.client.1.smithi183.stdout:7/563: sync 2024-02-10T00:00:32.032 INFO:tasks.workunit.client.0.smithi164.stdout:5/258: chown d7/d17/d21/f29 115 1 2024-02-10T00:00:32.032 INFO:tasks.workunit.client.0.smithi164.stdout:0/225: dwrite d6/f2a [0,4194304] 0 2024-02-10T00:00:32.037 INFO:tasks.workunit.client.1.smithi183.stdout:8/665: write d0/f1e [4013500,51351] 0 2024-02-10T00:00:32.038 INFO:tasks.workunit.client.1.smithi183.stdout:2/732: dread d2/d3d/fa0 [0,4194304] 0 2024-02-10T00:00:32.039 INFO:tasks.workunit.client.1.smithi183.stdout:6/503: mkdir d2/d1a/d25/d3c/d31/d38/d3f/d94 0 2024-02-10T00:00:32.040 INFO:tasks.workunit.client.0.smithi164.stdout:7/297: getdents d3/d11/d39/d44/d48/d50 0 2024-02-10T00:00:32.041 INFO:tasks.workunit.client.0.smithi164.stdout:7/298: chown d3/c2c 13487 1 2024-02-10T00:00:32.042 INFO:tasks.workunit.client.1.smithi183.stdout:6/504: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [0,4194304] 0 2024-02-10T00:00:32.042 INFO:tasks.workunit.client.0.smithi164.stdout:4/244: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:32.043 INFO:tasks.workunit.client.1.smithi183.stdout:6/505: chown d2/d1a/d25/d3c/d31/f6b 1370715 1 2024-02-10T00:00:32.043 INFO:tasks.workunit.client.1.smithi183.stdout:6/506: dread - d2/d1a/d3a/f57 zero size 2024-02-10T00:00:32.043 INFO:tasks.workunit.client.1.smithi183.stdout:3/534: truncate d7/f55 5178399 0 2024-02-10T00:00:32.049 INFO:tasks.workunit.client.0.smithi164.stdout:8/215: truncate d2/f19 522530 0 2024-02-10T00:00:32.050 INFO:tasks.workunit.client.0.smithi164.stdout:6/344: write d0/d6/f10 [78020,63274] 0 2024-02-10T00:00:32.050 INFO:tasks.workunit.client.0.smithi164.stdout:0/226: rmdir d6/d10/d18 39 2024-02-10T00:00:32.051 INFO:tasks.workunit.client.0.smithi164.stdout:6/345: write d0/d6/d12/d57/f58 [1028964,63065] 0 2024-02-10T00:00:32.055 INFO:tasks.workunit.client.1.smithi183.stdout:5/672: sync 2024-02-10T00:00:32.055 INFO:tasks.workunit.client.1.smithi183.stdout:0/576: write d14/f17 [3443478,28944] 0 2024-02-10T00:00:32.060 INFO:tasks.workunit.client.0.smithi164.stdout:9/256: write d6/fc [421358,25649] 0 2024-02-10T00:00:32.060 INFO:tasks.workunit.client.1.smithi183.stdout:4/640: dwrite de/d19/d1c/d61/f91 [0,4194304] 0 2024-02-10T00:00:32.060 INFO:tasks.workunit.client.0.smithi164.stdout:9/257: chown d6/d1c/f1d 477715 1 2024-02-10T00:00:32.061 INFO:tasks.workunit.client.1.smithi183.stdout:1/549: dwrite d0/d3/d29/d38/f3b [4194304,4194304] 0 2024-02-10T00:00:32.063 INFO:tasks.workunit.client.1.smithi183.stdout:1/550: fdatasync d0/f8e 0 2024-02-10T00:00:32.064 INFO:tasks.workunit.client.1.smithi183.stdout:0/577: dread d14/d1d/d2d/d31/d6c/fb2 [0,4194304] 0 2024-02-10T00:00:32.064 INFO:tasks.workunit.client.0.smithi164.stdout:1/211: dwrite d1/d1a/f22 [0,4194304] 0 2024-02-10T00:00:32.065 INFO:tasks.workunit.client.1.smithi183.stdout:7/564: rename d0/d2/d4/d8/f9f to d0/d11/d35/fa6 0 2024-02-10T00:00:32.065 INFO:tasks.workunit.client.0.smithi164.stdout:4/245: fsync d2/d19/d16/d31/f36 0 2024-02-10T00:00:32.066 INFO:tasks.workunit.client.0.smithi164.stdout:4/246: dread - d2/d19/d16/d31/f4d zero size 2024-02-10T00:00:32.066 INFO:tasks.workunit.client.0.smithi164.stdout:3/233: sync 2024-02-10T00:00:32.067 INFO:tasks.workunit.client.0.smithi164.stdout:8/216: mknod d2/d12/d21/c3a 0 2024-02-10T00:00:32.068 INFO:tasks.workunit.client.1.smithi183.stdout:9/606: dwrite d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:32.069 INFO:tasks.workunit.client.1.smithi183.stdout:2/733: dread d2/da/fb [0,4194304] 0 2024-02-10T00:00:32.073 INFO:tasks.workunit.client.0.smithi164.stdout:1/212: dwrite d1/d1a/d35/f34 [0,4194304] 0 2024-02-10T00:00:32.074 INFO:tasks.workunit.client.0.smithi164.stdout:9/258: mknod d6/d41/c50 0 2024-02-10T00:00:32.076 INFO:tasks.workunit.client.0.smithi164.stdout:4/247: dwrite d2/f1a [0,4194304] 0 2024-02-10T00:00:32.077 INFO:tasks.workunit.client.0.smithi164.stdout:3/234: dwrite d0/d1/dd/f1f [0,4194304] 0 2024-02-10T00:00:32.078 INFO:tasks.workunit.client.0.smithi164.stdout:3/235: readlink d0/d1/dd/d1e/l23 0 2024-02-10T00:00:32.079 INFO:tasks.workunit.client.0.smithi164.stdout:6/346: fdatasync d0/d2b/f39 0 2024-02-10T00:00:32.079 INFO:tasks.workunit.client.0.smithi164.stdout:0/227: mkdir d6/d10/d18/d2d/d35/d47 0 2024-02-10T00:00:32.080 INFO:tasks.workunit.client.1.smithi183.stdout:4/641: mkdir de/d14/d1d/d7b/dcb 0 2024-02-10T00:00:32.080 INFO:tasks.workunit.client.1.smithi183.stdout:1/551: rename d0/d3/d29/d1f to d0/d3c/dc9 0 2024-02-10T00:00:32.080 INFO:tasks.workunit.client.1.smithi183.stdout:0/578: creat d14/d3e/d9b/fd5 x:0 0 0 2024-02-10T00:00:32.081 INFO:tasks.workunit.client.0.smithi164.stdout:5/259: link d7/d15/l2b d7/d17/d21/d23/d37/d36/l50 0 2024-02-10T00:00:32.081 INFO:tasks.workunit.client.1.smithi183.stdout:4/642: read de/d14/d27/f21 [1048157,95748] 0 2024-02-10T00:00:32.081 INFO:tasks.workunit.client.0.smithi164.stdout:1/213: fsync d1/f7 0 2024-02-10T00:00:32.083 INFO:tasks.workunit.client.0.smithi164.stdout:1/214: chown d1/d1a/l2a 10 1 2024-02-10T00:00:32.084 INFO:tasks.workunit.client.0.smithi164.stdout:3/236: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:32.084 INFO:tasks.workunit.client.1.smithi183.stdout:3/535: mkdir d7/d98 0 2024-02-10T00:00:32.084 INFO:tasks.workunit.client.0.smithi164.stdout:4/248: creat d2/d2f/d37/d41/d3d/d42/f5b x:0 0 0 2024-02-10T00:00:32.085 INFO:tasks.workunit.client.0.smithi164.stdout:0/228: creat d6/d10/d18/d2d/d35/f48 x:0 0 0 2024-02-10T00:00:32.085 INFO:tasks.workunit.client.0.smithi164.stdout:3/237: stat d0/d1/d2/d17/d37/f3a 0 2024-02-10T00:00:32.086 INFO:tasks.workunit.client.1.smithi183.stdout:5/673: mknod d4/d23/d3e/d80/da1/d9e/d89/dd4/cd6 0 2024-02-10T00:00:32.089 INFO:tasks.workunit.client.1.smithi183.stdout:0/579: creat d14/d1d/d2d/d31/d6c/d70/fd6 x:0 0 0 2024-02-10T00:00:32.091 INFO:tasks.workunit.client.1.smithi183.stdout:5/674: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/fb0 [0,4194304] 0 2024-02-10T00:00:32.092 INFO:tasks.workunit.client.1.smithi183.stdout:0/580: symlink d14/d43/ld7 0 2024-02-10T00:00:32.093 INFO:tasks.workunit.client.1.smithi183.stdout:5/675: read - d4/dd/d31/d73/f98 zero size 2024-02-10T00:00:32.096 INFO:tasks.workunit.client.1.smithi183.stdout:6/507: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:32.097 INFO:tasks.workunit.client.1.smithi183.stdout:0/581: write d14/d1d/d2d/d31/d6c/fb2 [5114217,98406] 0 2024-02-10T00:00:32.097 INFO:tasks.workunit.client.0.smithi164.stdout:4/249: creat d2/d2f/d37/d41/d3d/f5c x:0 0 0 2024-02-10T00:00:32.098 INFO:tasks.workunit.client.1.smithi183.stdout:4/643: getdents de/d14/d1d/d2f/da2 0 2024-02-10T00:00:32.098 INFO:tasks.workunit.client.1.smithi183.stdout:3/536: getdents d7/db/d2a/d2d/d6a 0 2024-02-10T00:00:32.098 INFO:tasks.workunit.client.1.smithi183.stdout:4/644: chown de/d19/d1c/d61/fbc 982360 1 2024-02-10T00:00:32.100 INFO:tasks.workunit.client.0.smithi164.stdout:5/260: rename d7/d15/l2b to d7/d17/l51 0 2024-02-10T00:00:32.100 INFO:tasks.workunit.client.0.smithi164.stdout:8/217: link d2/f25 d2/d12/d21/f3b 0 2024-02-10T00:00:32.100 INFO:tasks.workunit.client.1.smithi183.stdout:0/582: fsync d14/d3e/f69 0 2024-02-10T00:00:32.102 INFO:tasks.workunit.client.0.smithi164.stdout:0/229: mkdir d6/d10/d18/d2d/d35/d44/d49 0 2024-02-10T00:00:32.103 INFO:tasks.workunit.client.1.smithi183.stdout:3/537: creat d7/db/d2a/f99 x:0 0 0 2024-02-10T00:00:32.103 INFO:tasks.workunit.client.0.smithi164.stdout:7/299: dread d3/d5/d2b/f4e [0,4194304] 0 2024-02-10T00:00:32.103 INFO:tasks.workunit.client.1.smithi183.stdout:3/538: chown d7/db/d2a/d33/l34 877309696 1 2024-02-10T00:00:32.104 INFO:tasks.workunit.client.0.smithi164.stdout:9/259: getdents d6/de/d22 0 2024-02-10T00:00:32.105 INFO:tasks.workunit.client.0.smithi164.stdout:6/347: getdents d0 0 2024-02-10T00:00:32.105 INFO:tasks.workunit.client.0.smithi164.stdout:5/261: mkdir d7/d15/d52 0 2024-02-10T00:00:32.106 INFO:tasks.workunit.client.0.smithi164.stdout:8/218: creat d2/d12/d21/f3c x:0 0 0 2024-02-10T00:00:32.106 INFO:tasks.workunit.client.0.smithi164.stdout:6/348: chown d0/d6/d12/d14/f61 67553 1 2024-02-10T00:00:32.106 INFO:tasks.workunit.client.0.smithi164.stdout:5/262: chown d7/d15/d1f/c2c 0 1 2024-02-10T00:00:32.107 INFO:tasks.workunit.client.0.smithi164.stdout:3/238: truncate d0/d1/d2/fe 5935722 0 2024-02-10T00:00:32.107 INFO:tasks.workunit.client.1.smithi183.stdout:3/539: creat d7/db/d2a/f9a x:0 0 0 2024-02-10T00:00:32.107 INFO:tasks.workunit.client.1.smithi183.stdout:0/583: dwrite d14/d1d/f2b [0,4194304] 0 2024-02-10T00:00:32.108 INFO:tasks.workunit.client.1.smithi183.stdout:0/584: fdatasync d14/d1d/d55/d6e/fc5 0 2024-02-10T00:00:32.108 INFO:tasks.workunit.client.0.smithi164.stdout:6/349: write d0/d6/f54 [749201,120028] 0 2024-02-10T00:00:32.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/300: mknod d3/d11/d39/d44/d48/d50/c69 0 2024-02-10T00:00:32.109 INFO:tasks.workunit.client.0.smithi164.stdout:6/350: chown d0/l15 540565 1 2024-02-10T00:00:32.110 INFO:tasks.workunit.client.0.smithi164.stdout:9/260: creat d6/de/d22/f51 x:0 0 0 2024-02-10T00:00:32.111 INFO:tasks.workunit.client.1.smithi183.stdout:3/540: creat d7/db/d2a/d2d/f9b x:0 0 0 2024-02-10T00:00:32.112 INFO:tasks.workunit.client.0.smithi164.stdout:5/263: dwrite d7/d17/d21/d24/f3d [0,4194304] 0 2024-02-10T00:00:32.112 INFO:tasks.workunit.client.0.smithi164.stdout:0/230: mkdir d6/d10/d4a 0 2024-02-10T00:00:32.113 INFO:tasks.workunit.client.1.smithi183.stdout:0/585: dwrite d14/d1d/d2d/d31/d6c/d70/fd6 [0,4194304] 0 2024-02-10T00:00:32.114 INFO:tasks.workunit.client.0.smithi164.stdout:7/301: creat d3/d28/d45/d4b/f6a x:0 0 0 2024-02-10T00:00:32.115 INFO:tasks.workunit.client.0.smithi164.stdout:8/219: dwrite d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:32.116 INFO:tasks.workunit.client.0.smithi164.stdout:7/302: write d3/f5f [844052,61731] 0 2024-02-10T00:00:32.118 INFO:tasks.workunit.client.1.smithi183.stdout:3/541: dwrite d7/db/f94 [0,4194304] 0 2024-02-10T00:00:32.118 INFO:tasks.workunit.client.1.smithi183.stdout:8/666: dwrite d0/fd [4194304,4194304] 0 2024-02-10T00:00:32.119 INFO:tasks.workunit.client.0.smithi164.stdout:0/231: dread d6/f2a [0,4194304] 0 2024-02-10T00:00:32.119 INFO:tasks.workunit.client.0.smithi164.stdout:5/264: chown d7/d17/d21/d24/l30 6947 1 2024-02-10T00:00:32.119 INFO:tasks.workunit.client.1.smithi183.stdout:8/667: stat d0/d23/f95 0 2024-02-10T00:00:32.120 INFO:tasks.workunit.client.1.smithi183.stdout:0/586: getdents d14/d3e 0 2024-02-10T00:00:32.120 INFO:tasks.workunit.client.1.smithi183.stdout:3/542: write d7/db/d2a/d2d/d51/f97 [566163,122557] 0 2024-02-10T00:00:32.120 INFO:tasks.workunit.client.0.smithi164.stdout:9/261: mknod d6/d1c/d24/d4f/c52 0 2024-02-10T00:00:32.121 INFO:tasks.workunit.client.1.smithi183.stdout:3/543: chown d7/l28 485586395 1 2024-02-10T00:00:32.122 INFO:tasks.workunit.client.0.smithi164.stdout:7/303: creat d3/d5/d2b/d4a/f6b x:0 0 0 2024-02-10T00:00:32.123 INFO:tasks.workunit.client.0.smithi164.stdout:7/304: write d3/d11/d39/d3a/f66 [29987,37973] 0 2024-02-10T00:00:32.125 INFO:tasks.workunit.client.1.smithi183.stdout:3/544: mknod d7/db/d2a/d2d/d6a/c9c 0 2024-02-10T00:00:32.125 INFO:tasks.workunit.client.1.smithi183.stdout:3/545: dread - d7/db/d2a/d2d/f9b zero size 2024-02-10T00:00:32.127 INFO:tasks.workunit.client.0.smithi164.stdout:9/262: mknod d6/d4b/c53 0 2024-02-10T00:00:32.128 INFO:tasks.workunit.client.1.smithi183.stdout:3/546: readlink d7/db/d2a/d33/d59/l57 0 2024-02-10T00:00:32.130 INFO:tasks.workunit.client.0.smithi164.stdout:9/263: mkdir d6/de/d40/d54 0 2024-02-10T00:00:32.132 INFO:tasks.workunit.client.0.smithi164.stdout:0/232: getdents d6 0 2024-02-10T00:00:32.132 INFO:tasks.workunit.client.0.smithi164.stdout:9/264: mknod d6/de/c55 0 2024-02-10T00:00:32.133 INFO:tasks.workunit.client.1.smithi183.stdout:7/565: sync 2024-02-10T00:00:32.134 INFO:tasks.workunit.client.1.smithi183.stdout:3/547: link d7/db/d2a/d33/f37 d7/db/d2a/d33/d59/d52/f9d 0 2024-02-10T00:00:32.137 INFO:tasks.workunit.client.0.smithi164.stdout:9/265: creat d6/de/d40/f56 x:0 0 0 2024-02-10T00:00:32.138 INFO:tasks.workunit.client.1.smithi183.stdout:7/566: fdatasync d0/d2/f65 0 2024-02-10T00:00:32.138 INFO:tasks.workunit.client.1.smithi183.stdout:7/567: chown d0/d11/d2f/d64/d6b/f86 2 1 2024-02-10T00:00:32.138 INFO:tasks.workunit.client.1.smithi183.stdout:3/548: mknod d7/db/d2a/d2d/d6a/c9e 0 2024-02-10T00:00:32.143 INFO:tasks.workunit.client.1.smithi183.stdout:3/549: rename d7/db/d2a/d8e/f93 to d7/db/d2a/d4d/d63/f9f 0 2024-02-10T00:00:32.144 INFO:tasks.workunit.client.0.smithi164.stdout:0/233: rename d6/d10/d18/c45 to d6/d10/d18/d2d/d35/d44/c4b 0 2024-02-10T00:00:32.145 INFO:tasks.workunit.client.1.smithi183.stdout:7/568: rmdir d0/d11/da5 0 2024-02-10T00:00:32.145 INFO:tasks.workunit.client.1.smithi183.stdout:7/569: dread - d0/d11/d3e/f70 zero size 2024-02-10T00:00:32.146 INFO:tasks.workunit.client.0.smithi164.stdout:9/266: truncate f2 9364950 0 2024-02-10T00:00:32.146 INFO:tasks.workunit.client.0.smithi164.stdout:9/267: fdatasync d6/f35 0 2024-02-10T00:00:32.146 INFO:tasks.workunit.client.1.smithi183.stdout:3/550: unlink d7/db/d2a/d2d/d51/l95 0 2024-02-10T00:00:32.147 INFO:tasks.workunit.client.0.smithi164.stdout:7/305: dread d3/f1d [0,4194304] 0 2024-02-10T00:00:32.149 INFO:tasks.workunit.client.1.smithi183.stdout:3/551: mkdir d7/db/d2a/d8e/da0 0 2024-02-10T00:00:32.149 INFO:tasks.workunit.client.1.smithi183.stdout:2/734: dread d2/d2c/d2f/f3b [0,4194304] 0 2024-02-10T00:00:32.149 INFO:tasks.workunit.client.0.smithi164.stdout:0/234: dwrite d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:32.150 INFO:tasks.workunit.client.0.smithi164.stdout:9/268: unlink d6/d41/f44 0 2024-02-10T00:00:32.152 INFO:tasks.workunit.client.0.smithi164.stdout:9/269: creat d6/d4b/f57 x:0 0 0 2024-02-10T00:00:32.153 INFO:tasks.workunit.client.0.smithi164.stdout:0/235: mknod d6/d10/d18/d2d/d35/d47/c4c 0 2024-02-10T00:00:32.154 INFO:tasks.workunit.client.1.smithi183.stdout:2/735: getdents d2/d2c/dba/df0/dbe 0 2024-02-10T00:00:32.154 INFO:tasks.workunit.client.0.smithi164.stdout:9/270: chown d6/d1c/c43 27460149 1 2024-02-10T00:00:32.155 INFO:tasks.workunit.client.0.smithi164.stdout:9/271: fdatasync d6/f20 0 2024-02-10T00:00:32.156 INFO:tasks.workunit.client.1.smithi183.stdout:6/508: sync 2024-02-10T00:00:32.157 INFO:tasks.workunit.client.1.smithi183.stdout:2/736: creat d2/d2c/d2f/d60/d8d/d9c/da7/dd4/d79/ff9 x:0 0 0 2024-02-10T00:00:32.158 INFO:tasks.workunit.client.1.smithi183.stdout:2/737: chown d2/da/fb 45967 1 2024-02-10T00:00:32.159 INFO:tasks.workunit.client.0.smithi164.stdout:0/236: link d6/d10/d18/d1c/l29 d6/d10/d18/d2d/d35/d47/l4d 0 2024-02-10T00:00:32.159 INFO:tasks.workunit.client.0.smithi164.stdout:7/306: dread d3/d5/d2b/d4a/f53 [0,4194304] 0 2024-02-10T00:00:32.160 INFO:tasks.workunit.client.1.smithi183.stdout:2/738: mkdir d2/da/d20/d21/d36/dfa 0 2024-02-10T00:00:32.160 INFO:tasks.workunit.client.0.smithi164.stdout:9/272: truncate d6/de/d40/f46 22424 0 2024-02-10T00:00:32.161 INFO:tasks.workunit.client.0.smithi164.stdout:0/237: creat d6/d10/d18/d2d/d35/d47/f4e x:0 0 0 2024-02-10T00:00:32.162 INFO:tasks.workunit.client.1.smithi183.stdout:9/607: dread d0/d10/f50 [0,4194304] 0 2024-02-10T00:00:32.164 INFO:tasks.workunit.client.1.smithi183.stdout:2/739: dwrite d2/da/d19/d31/f80 [8388608,4194304] 0 2024-02-10T00:00:32.165 INFO:tasks.workunit.client.0.smithi164.stdout:7/307: dwrite d3/d11/d39/d3a/f66 [0,4194304] 0 2024-02-10T00:00:32.165 INFO:tasks.workunit.client.0.smithi164.stdout:0/238: rename d6/d10/d18/l42 to d6/d10/d4a/l4f 0 2024-02-10T00:00:32.166 INFO:tasks.workunit.client.0.smithi164.stdout:9/273: dwrite d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:32.167 INFO:tasks.workunit.client.1.smithi183.stdout:2/740: mknod d2/d2c/d2f/d60/d8d/d9c/da7/cfb 0 2024-02-10T00:00:32.169 INFO:tasks.workunit.client.0.smithi164.stdout:9/274: mkdir d6/de/d22/d58 0 2024-02-10T00:00:32.169 INFO:tasks.workunit.client.1.smithi183.stdout:9/608: getdents d0/d3/d14 0 2024-02-10T00:00:32.169 INFO:tasks.workunit.client.0.smithi164.stdout:0/239: truncate d6/d10/d18/f31 8956912 0 2024-02-10T00:00:32.171 INFO:tasks.workunit.client.0.smithi164.stdout:0/240: write d6/d43/f46 [782910,37160] 0 2024-02-10T00:00:32.171 INFO:tasks.workunit.client.0.smithi164.stdout:9/275: creat d6/de/d3b/f59 x:0 0 0 2024-02-10T00:00:32.172 INFO:tasks.workunit.client.1.smithi183.stdout:2/741: dwrite d2/da/d19/fb4 [0,4194304] 0 2024-02-10T00:00:32.172 INFO:tasks.workunit.client.0.smithi164.stdout:7/308: dwrite d3/f1d [0,4194304] 0 2024-02-10T00:00:32.172 INFO:tasks.workunit.client.1.smithi183.stdout:9/609: getdents d0/d3/d14/d1c/d2d/d4f/da4 0 2024-02-10T00:00:32.173 INFO:tasks.workunit.client.0.smithi164.stdout:7/309: write d3/d4d/f55 [239895,1590] 0 2024-02-10T00:00:32.177 INFO:tasks.workunit.client.0.smithi164.stdout:9/276: unlink d6/d1c/d24/f42 0 2024-02-10T00:00:32.177 INFO:tasks.workunit.client.0.smithi164.stdout:0/241: dwrite d6/f15 [4194304,4194304] 0 2024-02-10T00:00:32.179 INFO:tasks.workunit.client.0.smithi164.stdout:7/310: symlink d3/d11/d39/d44/d48/d50/l6c 0 2024-02-10T00:00:32.181 INFO:tasks.workunit.client.0.smithi164.stdout:7/311: write d3/d11/d39/f47 [574859,122872] 0 2024-02-10T00:00:32.181 INFO:tasks.workunit.client.1.smithi183.stdout:9/610: link d0/d3/d14/d3c/c71 d0/d3/cc8 0 2024-02-10T00:00:32.183 INFO:tasks.workunit.client.0.smithi164.stdout:2/285: dread d3/d32/d4e/f3f [0,4194304] 0 2024-02-10T00:00:32.184 INFO:tasks.workunit.client.0.smithi164.stdout:7/312: creat d3/d28/d45/d4b/f6d x:0 0 0 2024-02-10T00:00:32.185 INFO:tasks.workunit.client.1.smithi183.stdout:2/742: truncate d2/d2c/dba/df0/dbd/fef 792445 0 2024-02-10T00:00:32.187 INFO:tasks.workunit.client.1.smithi183.stdout:2/743: truncate d2/da/d20/f37 422567 0 2024-02-10T00:00:32.188 INFO:tasks.workunit.client.1.smithi183.stdout:2/744: dread - d2/da/d77/dc7/db5/d35/fe3 zero size 2024-02-10T00:00:32.189 INFO:tasks.workunit.client.0.smithi164.stdout:2/286: unlink d3/l20 0 2024-02-10T00:00:32.189 INFO:tasks.workunit.client.0.smithi164.stdout:2/287: fsync d3/fd 0 2024-02-10T00:00:32.193 INFO:tasks.workunit.client.1.smithi183.stdout:2/745: rename d2/da/d20/d21/d43/d58/d8e/fd6 to d2/d2c/d2f/d72/ffc 0 2024-02-10T00:00:32.197 INFO:tasks.workunit.client.1.smithi183.stdout:2/746: rename d2/d2c/d2f/d60/d8d/ld8 to d2/da/d77/dc7/db5/lfd 0 2024-02-10T00:00:32.202 INFO:tasks.workunit.client.1.smithi183.stdout:2/747: link d2/f4a d2/d2c/d2f/d60/d8d/d9c/ffe 0 2024-02-10T00:00:32.208 INFO:tasks.workunit.client.0.smithi164.stdout:8/220: dread d2/d12/d21/f2d [0,4194304] 0 2024-02-10T00:00:32.209 INFO:tasks.workunit.client.0.smithi164.stdout:8/221: dread d2/d12/f24 [0,4194304] 0 2024-02-10T00:00:32.213 INFO:tasks.workunit.client.0.smithi164.stdout:8/222: dwrite d2/d12/d21/d31/d32/f34 [0,4194304] 0 2024-02-10T00:00:32.217 INFO:tasks.workunit.client.0.smithi164.stdout:8/223: dwrite d2/f11 [4194304,4194304] 0 2024-02-10T00:00:32.218 INFO:tasks.workunit.client.0.smithi164.stdout:8/224: chown d2/d12/d21/d31/d32/f34 414001113 1 2024-02-10T00:00:32.223 INFO:tasks.workunit.client.0.smithi164.stdout:6/351: dread d0/d6/f54 [0,4194304] 0 2024-02-10T00:00:32.227 INFO:tasks.workunit.client.0.smithi164.stdout:6/352: dwrite d0/d6/d12/f4e [0,4194304] 0 2024-02-10T00:00:32.230 INFO:tasks.workunit.client.0.smithi164.stdout:6/353: creat d0/d6/d12/d14/d4b/f6b x:0 0 0 2024-02-10T00:00:32.231 INFO:tasks.workunit.client.1.smithi183.stdout:9/611: sync 2024-02-10T00:00:32.232 INFO:tasks.workunit.client.0.smithi164.stdout:6/354: read - d0/d6/f59 zero size 2024-02-10T00:00:32.232 INFO:tasks.workunit.client.0.smithi164.stdout:6/355: stat d0/d6/d12/c49 0 2024-02-10T00:00:32.233 INFO:tasks.workunit.client.1.smithi183.stdout:9/612: fdatasync d0/d3/d14/d1c/f45 0 2024-02-10T00:00:32.234 INFO:tasks.workunit.client.0.smithi164.stdout:6/356: symlink d0/d6/d12/d14/d4b/l6c 0 2024-02-10T00:00:32.234 INFO:tasks.workunit.client.0.smithi164.stdout:6/357: readlink d0/d6/l34 0 2024-02-10T00:00:32.235 INFO:tasks.workunit.client.1.smithi183.stdout:9/613: creat d0/d30/fc9 x:0 0 0 2024-02-10T00:00:32.236 INFO:tasks.workunit.client.1.smithi183.stdout:9/614: write d0/f3b [354041,87262] 0 2024-02-10T00:00:32.236 INFO:tasks.workunit.client.0.smithi164.stdout:6/358: mkdir d0/d2b/d3a/d3d/d6d 0 2024-02-10T00:00:32.238 INFO:tasks.workunit.client.1.smithi183.stdout:9/615: symlink d0/d3/d14/d3c/lca 0 2024-02-10T00:00:32.241 INFO:tasks.workunit.client.1.smithi183.stdout:9/616: creat d0/d3/d14/d1c/d2d/d4f/fcb x:0 0 0 2024-02-10T00:00:32.242 INFO:tasks.workunit.client.1.smithi183.stdout:9/617: unlink d0/l35 0 2024-02-10T00:00:32.245 INFO:tasks.workunit.client.1.smithi183.stdout:9/618: symlink d0/lcc 0 2024-02-10T00:00:32.247 INFO:tasks.workunit.client.1.smithi183.stdout:0/587: dread d14/d1d/d2d/f8a [4194304,4194304] 0 2024-02-10T00:00:32.247 INFO:tasks.workunit.client.0.smithi164.stdout:4/250: fdatasync d2/f1a 0 2024-02-10T00:00:32.247 INFO:tasks.workunit.client.1.smithi183.stdout:0/588: fdatasync d14/d1d/d59/d71/f7f 0 2024-02-10T00:00:32.248 INFO:tasks.workunit.client.1.smithi183.stdout:0/589: chown d14/d7a/f62 3 1 2024-02-10T00:00:32.248 INFO:tasks.workunit.client.0.smithi164.stdout:2/288: sync 2024-02-10T00:00:32.249 INFO:tasks.workunit.client.0.smithi164.stdout:4/251: readlink d2/d19/l14 0 2024-02-10T00:00:32.250 INFO:tasks.workunit.client.0.smithi164.stdout:4/252: read - d2/d19/d16/f38 zero size 2024-02-10T00:00:32.251 INFO:tasks.workunit.client.1.smithi183.stdout:0/590: unlink d14/d1d/d59/d71/d22/c2a 0 2024-02-10T00:00:32.252 INFO:tasks.workunit.client.0.smithi164.stdout:2/289: rename d3/lb to d3/d32/d4e/d27/d2a/l6c 0 2024-02-10T00:00:32.257 INFO:tasks.workunit.client.1.smithi183.stdout:1/552: write d0/d3/d29/f51 [1539946,105408] 0 2024-02-10T00:00:32.257 INFO:tasks.workunit.client.1.smithi183.stdout:1/553: write d0/f78 [141328,82241] 0 2024-02-10T00:00:32.258 INFO:tasks.workunit.client.0.smithi164.stdout:1/215: truncate d1/d13/f19 9109196 0 2024-02-10T00:00:32.259 INFO:tasks.workunit.client.1.smithi183.stdout:0/591: creat d14/d3e/d5f/daa/fd8 x:0 0 0 2024-02-10T00:00:32.259 INFO:tasks.workunit.client.1.smithi183.stdout:1/554: write d0/d3/d7/d3d/fac [946570,71847] 0 2024-02-10T00:00:32.259 INFO:tasks.workunit.client.1.smithi183.stdout:5/676: write d4/d23/f21 [2358816,91134] 0 2024-02-10T00:00:32.263 INFO:tasks.workunit.client.0.smithi164.stdout:1/216: dwrite d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:32.265 INFO:tasks.workunit.client.1.smithi183.stdout:4/645: dwrite de/d19/d1c/f36 [4194304,4194304] 0 2024-02-10T00:00:32.266 INFO:tasks.workunit.client.0.smithi164.stdout:8/225: sync 2024-02-10T00:00:32.266 INFO:tasks.workunit.client.0.smithi164.stdout:5/265: truncate d7/f19 2404223 0 2024-02-10T00:00:32.268 INFO:tasks.workunit.client.1.smithi183.stdout:8/668: dwrite d0/d3f/db2/f21 [0,4194304] 0 2024-02-10T00:00:32.268 INFO:tasks.workunit.client.1.smithi183.stdout:0/592: dread d14/d1d/d2d/d31/d6c/d70/fd6 [0,4194304] 0 2024-02-10T00:00:32.268 INFO:tasks.workunit.client.1.smithi183.stdout:4/646: chown de/d14/d1d/d2f/da2/d9c/fb8 3 1 2024-02-10T00:00:32.269 INFO:tasks.workunit.client.1.smithi183.stdout:8/669: readlink d0/d10/d9e/lad 0 2024-02-10T00:00:32.269 INFO:tasks.workunit.client.1.smithi183.stdout:1/555: dread d0/d3/da9/fab [0,4194304] 0 2024-02-10T00:00:32.270 INFO:tasks.workunit.client.1.smithi183.stdout:3/552: write d7/db/d2a/d33/d59/d52/f9d [732201,91551] 0 2024-02-10T00:00:32.270 INFO:tasks.workunit.client.1.smithi183.stdout:0/593: chown d14/d1d/d96/da0/fa5 68622 1 2024-02-10T00:00:32.271 INFO:tasks.workunit.client.1.smithi183.stdout:1/556: fdatasync d0/d3/fa6 0 2024-02-10T00:00:32.273 INFO:tasks.workunit.client.1.smithi183.stdout:1/557: chown d0/d3/lb 164 1 2024-02-10T00:00:32.275 INFO:tasks.workunit.client.1.smithi183.stdout:7/570: dwrite d0/d2/d4/f3c [0,4194304] 0 2024-02-10T00:00:32.275 INFO:tasks.workunit.client.1.smithi183.stdout:6/509: dwrite d2/f7 [0,4194304] 0 2024-02-10T00:00:32.276 INFO:tasks.workunit.client.0.smithi164.stdout:2/290: creat d3/f6d x:0 0 0 2024-02-10T00:00:32.277 INFO:tasks.workunit.client.0.smithi164.stdout:4/253: creat d2/d2f/d37/d41/d3d/d56/f5d x:0 0 0 2024-02-10T00:00:32.280 INFO:tasks.workunit.client.0.smithi164.stdout:8/226: rename d2/f10 to d2/f3d 0 2024-02-10T00:00:32.282 INFO:tasks.workunit.client.0.smithi164.stdout:8/227: write d2/d12/d21/d31/d32/f34 [2712543,49423] 0 2024-02-10T00:00:32.285 INFO:tasks.workunit.client.1.smithi183.stdout:2/748: truncate d2/f8 2523739 0 2024-02-10T00:00:32.286 INFO:tasks.workunit.client.1.smithi183.stdout:9/619: write d0/d3/d14/d1c/f5c [5100316,6656] 0 2024-02-10T00:00:32.287 INFO:tasks.workunit.client.0.smithi164.stdout:5/266: link d7/f32 d7/d17/d3b/d43/f53 0 2024-02-10T00:00:32.288 INFO:tasks.workunit.client.0.smithi164.stdout:5/267: write d7/d17/d21/f29 [4285173,27823] 0 2024-02-10T00:00:32.291 INFO:tasks.workunit.client.1.smithi183.stdout:8/670: creat d0/d3f/db2/d24/fd5 x:0 0 0 2024-02-10T00:00:32.292 INFO:tasks.workunit.client.0.smithi164.stdout:7/313: fsync d3/d28/d45/d4b/f6d 0 2024-02-10T00:00:32.292 INFO:tasks.workunit.client.0.smithi164.stdout:0/242: write d6/d7/d14/f27 [2972184,36059] 0 2024-02-10T00:00:32.295 INFO:tasks.workunit.client.1.smithi183.stdout:4/647: symlink de/d14/lcc 0 2024-02-10T00:00:32.295 INFO:tasks.workunit.client.0.smithi164.stdout:9/277: dwrite d6/d1c/f1f [0,4194304] 0 2024-02-10T00:00:32.298 INFO:tasks.workunit.client.0.smithi164.stdout:5/268: dread d7/d17/d21/d23/d37/d36/f46 [0,4194304] 0 2024-02-10T00:00:32.298 INFO:tasks.workunit.client.0.smithi164.stdout:5/269: chown d7/d15 13991 1 2024-02-10T00:00:32.298 INFO:tasks.workunit.client.0.smithi164.stdout:6/359: truncate d0/d6/d12/f1f 590826 0 2024-02-10T00:00:32.299 INFO:tasks.workunit.client.1.smithi183.stdout:0/594: mknod d14/d1d/d2d/d31/d68/da3/cd9 0 2024-02-10T00:00:32.301 INFO:tasks.workunit.client.1.smithi183.stdout:1/558: symlink d0/lca 0 2024-02-10T00:00:32.301 INFO:tasks.workunit.client.1.smithi183.stdout:6/510: dwrite d2/d1a/d25/d3c/d31/d38/d87/f88 [0,4194304] 0 2024-02-10T00:00:32.302 INFO:tasks.workunit.client.1.smithi183.stdout:4/648: mknod de/ccd 0 2024-02-10T00:00:32.302 INFO:tasks.workunit.client.1.smithi183.stdout:6/511: write d2/d1a/d3a/f57 [925747,124234] 0 2024-02-10T00:00:32.303 INFO:tasks.workunit.client.0.smithi164.stdout:2/291: rename d3/d32/d4e/d27/d2e/d36/f4b to d3/d24/d5b/f6e 0 2024-02-10T00:00:32.303 INFO:tasks.workunit.client.1.smithi183.stdout:6/512: dread - d2/f5a zero size 2024-02-10T00:00:32.303 INFO:tasks.workunit.client.1.smithi183.stdout:2/749: mknod d2/d2c/dab/d99/ddf/cff 0 2024-02-10T00:00:32.306 INFO:tasks.workunit.client.0.smithi164.stdout:8/228: write d2/d12/d21/f2d [1229234,37748] 0 2024-02-10T00:00:32.306 INFO:tasks.workunit.client.0.smithi164.stdout:3/239: dwrite d0/d1/d2/fe [4194304,4194304] 0 2024-02-10T00:00:32.307 INFO:tasks.workunit.client.1.smithi183.stdout:0/595: creat d14/d43/fda x:0 0 0 2024-02-10T00:00:32.307 INFO:tasks.workunit.client.1.smithi183.stdout:4/649: dread de/d14/d27/d2e/f86 [0,4194304] 0 2024-02-10T00:00:32.309 INFO:tasks.workunit.client.0.smithi164.stdout:9/278: dread d6/de/f14 [0,4194304] 0 2024-02-10T00:00:32.309 INFO:tasks.workunit.client.0.smithi164.stdout:0/243: creat d6/d10/d18/d2d/d35/d47/f50 x:0 0 0 2024-02-10T00:00:32.310 INFO:tasks.workunit.client.1.smithi183.stdout:6/513: write d2/d1a/d3a/f48 [2655493,38083] 0 2024-02-10T00:00:32.310 INFO:tasks.workunit.client.0.smithi164.stdout:5/270: chown d7/d17/d21/d24/f4c 10875321 1 2024-02-10T00:00:32.312 INFO:tasks.workunit.client.1.smithi183.stdout:9/620: rename d0/d3/d14/d48/f5e to d0/d3/d14/d74/fcd 0 2024-02-10T00:00:32.313 INFO:tasks.workunit.client.1.smithi183.stdout:8/671: creat d0/d3f/db2/fd6 x:0 0 0 2024-02-10T00:00:32.314 INFO:tasks.workunit.client.0.smithi164.stdout:6/360: dwrite d0/d6/d12/f22 [0,4194304] 0 2024-02-10T00:00:32.315 INFO:tasks.workunit.client.1.smithi183.stdout:1/559: mkdir d0/d3/d7/d3d/dcb 0 2024-02-10T00:00:32.318 INFO:tasks.workunit.client.1.smithi183.stdout:4/650: fdatasync de/d14/d1d/f97 0 2024-02-10T00:00:32.319 INFO:tasks.workunit.client.0.smithi164.stdout:3/240: rename d0/d1/dd/d1e to d0/d3b/d46 0 2024-02-10T00:00:32.319 INFO:tasks.workunit.client.1.smithi183.stdout:7/571: link d0/d2/d4/c1e d0/d11/d2f/d64/d6b/ca7 0 2024-02-10T00:00:32.320 INFO:tasks.workunit.client.0.smithi164.stdout:0/244: rmdir d6/d7 39 2024-02-10T00:00:32.324 INFO:tasks.workunit.client.1.smithi183.stdout:8/672: unlink d0/d45/cab 0 2024-02-10T00:00:32.325 INFO:tasks.workunit.client.0.smithi164.stdout:5/271: dwrite d7/d17/d21/d23/d37/d36/f46 [0,4194304] 0 2024-02-10T00:00:32.325 INFO:tasks.workunit.client.1.smithi183.stdout:1/560: symlink d0/d3/d29/lcc 0 2024-02-10T00:00:32.325 INFO:tasks.workunit.client.0.smithi164.stdout:5/272: dread - d7/d17/d3b/d43/f4e zero size 2024-02-10T00:00:32.326 INFO:tasks.workunit.client.0.smithi164.stdout:5/273: write d7/d17/f3f [4399176,45663] 0 2024-02-10T00:00:32.326 INFO:tasks.workunit.client.1.smithi183.stdout:4/651: fdatasync de/d14/d1d/f97 0 2024-02-10T00:00:32.327 INFO:tasks.workunit.client.0.smithi164.stdout:2/292: link d3/f6 d3/d24/d51/f6f 0 2024-02-10T00:00:32.328 INFO:tasks.workunit.client.0.smithi164.stdout:7/314: link d3/d11/d39/d44/c5e d3/d5/d59/c6e 0 2024-02-10T00:00:32.331 INFO:tasks.workunit.client.0.smithi164.stdout:8/229: rename d2/d12/d21/f3c to d2/d12/d21/d31/d32/f3e 0 2024-02-10T00:00:32.332 INFO:tasks.workunit.client.1.smithi183.stdout:6/514: mknod d2/c95 0 2024-02-10T00:00:32.332 INFO:tasks.workunit.client.0.smithi164.stdout:8/230: chown d2/d12/d21/c3a 1308 1 2024-02-10T00:00:32.332 INFO:tasks.workunit.client.1.smithi183.stdout:9/621: fsync d0/d3/d14/f20 0 2024-02-10T00:00:32.333 INFO:tasks.workunit.client.0.smithi164.stdout:3/241: creat d0/d1/d3c/d3d/f47 x:0 0 0 2024-02-10T00:00:32.335 INFO:tasks.workunit.client.0.smithi164.stdout:5/274: fdatasync d7/d17/f1c 0 2024-02-10T00:00:32.338 INFO:tasks.workunit.client.0.smithi164.stdout:7/315: mkdir d3/d11/d39/d44/d6f 0 2024-02-10T00:00:32.339 INFO:tasks.workunit.client.0.smithi164.stdout:7/316: chown d3/d5/d2b/d4a/f6b 1678689587 1 2024-02-10T00:00:32.340 INFO:tasks.workunit.client.0.smithi164.stdout:9/279: rename d6/de/d3b/f59 to d6/d1c/d24/d4f/f5a 0 2024-02-10T00:00:32.341 INFO:tasks.workunit.client.0.smithi164.stdout:8/231: chown d2/d12/d21/f3b 8071 1 2024-02-10T00:00:32.342 INFO:tasks.workunit.client.1.smithi183.stdout:6/515: link d2/d1a/d3a/c75 d2/d1a/d25/c96 0 2024-02-10T00:00:32.342 INFO:tasks.workunit.client.0.smithi164.stdout:9/280: write d6/d1c/f2e [3471937,71667] 0 2024-02-10T00:00:32.343 INFO:tasks.workunit.client.0.smithi164.stdout:0/245: chown d6/d7/d14/f20 33983 1 2024-02-10T00:00:32.343 INFO:tasks.workunit.client.0.smithi164.stdout:0/246: readlink d6/d7/la 0 2024-02-10T00:00:32.344 INFO:tasks.workunit.client.1.smithi183.stdout:6/516: creat d2/d1a/d25/d3c/d31/d38/d6e/f97 x:0 0 0 2024-02-10T00:00:32.347 INFO:tasks.workunit.client.1.smithi183.stdout:6/517: write d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 [810059,1156] 0 2024-02-10T00:00:32.347 INFO:tasks.workunit.client.0.smithi164.stdout:8/232: creat d2/d12/f3f x:0 0 0 2024-02-10T00:00:32.348 INFO:tasks.workunit.client.1.smithi183.stdout:6/518: stat d2/d1a/d25/d3c/d31 0 2024-02-10T00:00:32.348 INFO:tasks.workunit.client.0.smithi164.stdout:8/233: read d2/d12/f24 [21103,20344] 0 2024-02-10T00:00:32.349 INFO:tasks.workunit.client.0.smithi164.stdout:3/242: dread d0/d1/d2/fe [0,4194304] 0 2024-02-10T00:00:32.350 INFO:tasks.workunit.client.0.smithi164.stdout:9/281: mkdir d6/de/d2b/d5b 0 2024-02-10T00:00:32.351 INFO:tasks.workunit.client.1.smithi183.stdout:6/519: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d34/d98 0 2024-02-10T00:00:32.353 INFO:tasks.workunit.client.1.smithi183.stdout:6/520: write d2/d1a/d25/d3c/d31/d38/d3f/f4d [939290,11605] 0 2024-02-10T00:00:32.354 INFO:tasks.workunit.client.0.smithi164.stdout:0/247: creat d6/d10/d18/d2d/f51 x:0 0 0 2024-02-10T00:00:32.354 INFO:tasks.workunit.client.0.smithi164.stdout:9/282: creat d6/d1c/d24/f5c x:0 0 0 2024-02-10T00:00:32.357 INFO:tasks.workunit.client.0.smithi164.stdout:3/243: dwrite d0/d1/d2/d19/f33 [0,4194304] 0 2024-02-10T00:00:32.358 INFO:tasks.workunit.client.0.smithi164.stdout:3/244: write d0/f35 [742793,53464] 0 2024-02-10T00:00:32.358 INFO:tasks.workunit.client.0.smithi164.stdout:1/217: truncate d1/fd 4978298 0 2024-02-10T00:00:32.360 INFO:tasks.workunit.client.1.smithi183.stdout:2/750: write d2/f8 [877728,41909] 0 2024-02-10T00:00:32.362 INFO:tasks.workunit.client.1.smithi183.stdout:5/677: truncate d4/dd/fbd 4782198 0 2024-02-10T00:00:32.363 INFO:tasks.workunit.client.1.smithi183.stdout:0/596: dread d14/d1d/d2d/f8f [0,4194304] 0 2024-02-10T00:00:32.363 INFO:tasks.workunit.client.1.smithi183.stdout:6/521: dread d2/d1a/d25/d3c/d31/d38/d3f/d5e/f7a [0,4194304] 0 2024-02-10T00:00:32.364 INFO:tasks.workunit.client.0.smithi164.stdout:5/275: rmdir d7/d17 39 2024-02-10T00:00:32.364 INFO:tasks.workunit.client.1.smithi183.stdout:0/597: fdatasync d14/d3e/d92/f58 0 2024-02-10T00:00:32.368 INFO:tasks.workunit.client.1.smithi183.stdout:3/553: dwrite f6 [0,4194304] 0 2024-02-10T00:00:32.369 INFO:tasks.workunit.client.0.smithi164.stdout:4/254: truncate d2/d2f/f4c 2173130 0 2024-02-10T00:00:32.370 INFO:tasks.workunit.client.1.smithi183.stdout:0/598: dwrite d14/d1d/d59/d71/d22/f48 [0,4194304] 0 2024-02-10T00:00:32.375 INFO:tasks.workunit.client.1.smithi183.stdout:9/622: truncate d0/f3b 1876388 0 2024-02-10T00:00:32.378 INFO:tasks.workunit.client.1.smithi183.stdout:7/572: dread d0/d11/d35/f87 [4194304,4194304] 0 2024-02-10T00:00:32.378 INFO:tasks.workunit.client.1.smithi183.stdout:4/652: dread de/d19/d20/f5d [0,4194304] 0 2024-02-10T00:00:32.379 INFO:tasks.workunit.client.0.smithi164.stdout:6/361: truncate d0/d6/f10 612988 0 2024-02-10T00:00:32.379 INFO:tasks.workunit.client.1.smithi183.stdout:8/673: dread d0/d10/d9e/fb9 [0,4194304] 0 2024-02-10T00:00:32.380 INFO:tasks.workunit.client.1.smithi183.stdout:3/554: symlink d7/db/d2a/d33/d59/d52/la1 0 2024-02-10T00:00:32.381 INFO:tasks.workunit.client.1.smithi183.stdout:8/674: stat d0/d45/l74 0 2024-02-10T00:00:32.381 INFO:tasks.workunit.client.1.smithi183.stdout:1/561: dwrite d0/d3/d67/d7b/f98 [0,4194304] 0 2024-02-10T00:00:32.382 INFO:tasks.workunit.client.1.smithi183.stdout:3/555: chown d7/fe 344 1 2024-02-10T00:00:32.383 INFO:tasks.workunit.client.1.smithi183.stdout:3/556: write d7/f9 [4060440,91458] 0 2024-02-10T00:00:32.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/234: rmdir d2/d12 39 2024-02-10T00:00:32.388 INFO:tasks.workunit.client.1.smithi183.stdout:7/573: mknod d0/d11/d88/d94/ca8 0 2024-02-10T00:00:32.390 INFO:tasks.workunit.client.1.smithi183.stdout:4/653: rename de/d14/c93 to de/d14/d1d/d7b/cce 0 2024-02-10T00:00:32.391 INFO:tasks.workunit.client.0.smithi164.stdout:1/218: symlink d1/d1a/d41/d18/d3a/l49 0 2024-02-10T00:00:32.391 INFO:tasks.workunit.client.1.smithi183.stdout:4/654: write de/d14/d27/f45 [1740062,16102] 0 2024-02-10T00:00:32.391 INFO:tasks.workunit.client.1.smithi183.stdout:9/623: creat d0/d3/d14/d1c/d2d/d4f/fce x:0 0 0 2024-02-10T00:00:32.396 INFO:tasks.workunit.client.1.smithi183.stdout:6/522: getdents d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73 0 2024-02-10T00:00:32.396 INFO:tasks.workunit.client.0.smithi164.stdout:8/235: dread d2/d12/d21/f2d [0,4194304] 0 2024-02-10T00:00:32.396 INFO:tasks.workunit.client.0.smithi164.stdout:3/245: rename d0/c36 to d0/d1/c48 0 2024-02-10T00:00:32.398 INFO:tasks.workunit.client.1.smithi183.stdout:4/655: dwrite de/d19/d8d/f9a [0,4194304] 0 2024-02-10T00:00:32.399 INFO:tasks.workunit.client.1.smithi183.stdout:2/751: truncate d2/da/d20/d21/d43/f45 3504350 0 2024-02-10T00:00:32.399 INFO:tasks.workunit.client.1.smithi183.stdout:9/624: dread d0/d30/d52/f66 [0,4194304] 0 2024-02-10T00:00:32.399 INFO:tasks.workunit.client.1.smithi183.stdout:5/678: dwrite d4/dd/fbd [0,4194304] 0 2024-02-10T00:00:32.399 INFO:tasks.workunit.client.0.smithi164.stdout:0/248: getdents d6/d10/d18 0 2024-02-10T00:00:32.400 INFO:tasks.workunit.client.0.smithi164.stdout:0/249: chown d6/d10/d18/d2d/d35 530005 1 2024-02-10T00:00:32.400 INFO:tasks.workunit.client.1.smithi183.stdout:7/574: truncate d0/d11/d35/f9b 1028132 0 2024-02-10T00:00:32.402 INFO:tasks.workunit.client.1.smithi183.stdout:7/575: stat d0/d11/d3e/l5a 0 2024-02-10T00:00:32.402 INFO:tasks.workunit.client.1.smithi183.stdout:4/656: dread - de/d19/d1c/fc1 zero size 2024-02-10T00:00:32.402 INFO:tasks.workunit.client.0.smithi164.stdout:6/362: link d0/d6/d12/f18 d0/f6e 0 2024-02-10T00:00:32.403 INFO:tasks.workunit.client.1.smithi183.stdout:2/752: write d2/da/d19/f7a [2858518,20323] 0 2024-02-10T00:00:32.405 INFO:tasks.workunit.client.0.smithi164.stdout:9/283: getdents d6/de 0 2024-02-10T00:00:32.405 INFO:tasks.workunit.client.0.smithi164.stdout:4/255: rename d2/d2f/d37/f43 to d2/f5e 0 2024-02-10T00:00:32.406 INFO:tasks.workunit.client.0.smithi164.stdout:5/276: dread d7/fc [0,4194304] 0 2024-02-10T00:00:32.406 INFO:tasks.workunit.client.0.smithi164.stdout:8/236: rename d2/d12 to d2/d12/d40 22 2024-02-10T00:00:32.406 INFO:tasks.workunit.client.1.smithi183.stdout:6/523: rename d2/d1a/f23 to d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/f99 0 2024-02-10T00:00:32.407 INFO:tasks.workunit.client.0.smithi164.stdout:3/246: symlink d0/d1/d2/d19/d45/l49 0 2024-02-10T00:00:32.407 INFO:tasks.workunit.client.0.smithi164.stdout:8/237: read - d2/f29 zero size 2024-02-10T00:00:32.407 INFO:tasks.workunit.client.1.smithi183.stdout:5/679: creat d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fd7 x:0 0 0 2024-02-10T00:00:32.408 INFO:tasks.workunit.client.0.smithi164.stdout:4/256: dread d2/d2f/d37/d41/f34 [0,4194304] 0 2024-02-10T00:00:32.412 INFO:tasks.workunit.client.1.smithi183.stdout:7/576: dwrite d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:32.413 INFO:tasks.workunit.client.0.smithi164.stdout:0/250: fdatasync d6/d7/fc 0 2024-02-10T00:00:32.414 INFO:tasks.workunit.client.0.smithi164.stdout:3/247: symlink d0/d1/dd/l4a 0 2024-02-10T00:00:32.417 INFO:tasks.workunit.client.0.smithi164.stdout:7/317: sync 2024-02-10T00:00:32.418 INFO:tasks.workunit.client.0.smithi164.stdout:9/284: dread d6/f3e [0,4194304] 0 2024-02-10T00:00:32.418 INFO:tasks.workunit.client.0.smithi164.stdout:0/251: rmdir d6/d10/d18/d2d 39 2024-02-10T00:00:32.419 INFO:tasks.workunit.client.1.smithi183.stdout:7/577: rename d0/d11/f3a to d0/d2/d4/d8/d59/d8a/fa9 0 2024-02-10T00:00:32.419 INFO:tasks.workunit.client.0.smithi164.stdout:8/238: dwrite d2/d12/d21/d31/d32/f3e [0,4194304] 0 2024-02-10T00:00:32.419 INFO:tasks.workunit.client.0.smithi164.stdout:9/285: fdatasync d6/d1c/d24/f2a 0 2024-02-10T00:00:32.420 INFO:tasks.workunit.client.0.smithi164.stdout:3/248: creat d0/d1/d2/d19/d45/f4b x:0 0 0 2024-02-10T00:00:32.421 INFO:tasks.workunit.client.0.smithi164.stdout:3/249: read d0/d1/d2/d19/f33 [2810312,87132] 0 2024-02-10T00:00:32.422 INFO:tasks.workunit.client.1.smithi183.stdout:9/625: dread d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:32.422 INFO:tasks.workunit.client.1.smithi183.stdout:9/626: chown d0/lcc 230492589 1 2024-02-10T00:00:32.424 INFO:tasks.workunit.client.1.smithi183.stdout:7/578: mknod d0/d11/d35/caa 0 2024-02-10T00:00:32.424 INFO:tasks.workunit.client.1.smithi183.stdout:5/680: creat d4/d23/d2a/fd8 x:0 0 0 2024-02-10T00:00:32.424 INFO:tasks.workunit.client.0.smithi164.stdout:4/257: truncate d2/d19/d16/d31/f4d 977154 0 2024-02-10T00:00:32.424 INFO:tasks.workunit.client.0.smithi164.stdout:5/277: rename d7/d17/d21/d24/c39 to d7/d15/d52/c54 0 2024-02-10T00:00:32.425 INFO:tasks.workunit.client.0.smithi164.stdout:5/278: chown d7/f32 532 1 2024-02-10T00:00:32.426 INFO:tasks.workunit.client.0.smithi164.stdout:9/286: creat d6/d1c/d24/d4f/f5d x:0 0 0 2024-02-10T00:00:32.429 INFO:tasks.workunit.client.1.smithi183.stdout:5/681: mkdir d4/d23/d3e/d80/d96/dd9 0 2024-02-10T00:00:32.430 INFO:tasks.workunit.client.0.smithi164.stdout:4/258: mkdir d2/d2f/d37/d41/d3d/d42/d5f 0 2024-02-10T00:00:32.433 INFO:tasks.workunit.client.0.smithi164.stdout:0/252: mkdir d6/d3a/d52 0 2024-02-10T00:00:32.434 INFO:tasks.workunit.client.0.smithi164.stdout:1/219: dread d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:32.434 INFO:tasks.workunit.client.0.smithi164.stdout:3/250: link d0/d1/d2/lb d0/d1/d2/d17/d37/d3f/l4c 0 2024-02-10T00:00:32.435 INFO:tasks.workunit.client.0.smithi164.stdout:4/259: chown d2/d19/d16/d31/f4d 771109 1 2024-02-10T00:00:32.436 INFO:tasks.workunit.client.1.smithi183.stdout:5/682: link d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fa3 d4/dd/d31/fda 0 2024-02-10T00:00:32.436 INFO:tasks.workunit.client.0.smithi164.stdout:4/260: write d2/fb [4004802,110294] 0 2024-02-10T00:00:32.437 INFO:tasks.workunit.client.0.smithi164.stdout:1/220: creat d1/d13/d2b/f4a x:0 0 0 2024-02-10T00:00:32.438 INFO:tasks.workunit.client.0.smithi164.stdout:3/251: symlink d0/d1/d2/d17/l4d 0 2024-02-10T00:00:32.439 INFO:tasks.workunit.client.1.smithi183.stdout:3/557: dread d7/db/d2a/d33/f87 [0,4194304] 0 2024-02-10T00:00:32.439 INFO:tasks.workunit.client.1.smithi183.stdout:5/683: fsync d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f69 0 2024-02-10T00:00:32.439 INFO:tasks.workunit.client.1.smithi183.stdout:0/599: sync 2024-02-10T00:00:32.439 INFO:tasks.workunit.client.1.smithi183.stdout:8/675: sync 2024-02-10T00:00:32.441 INFO:tasks.workunit.client.0.smithi164.stdout:4/261: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:32.442 INFO:tasks.workunit.client.1.smithi183.stdout:0/600: unlink d14/d3e/f69 0 2024-02-10T00:00:32.443 INFO:tasks.workunit.client.1.smithi183.stdout:3/558: creat d7/db/d2a/d2d/d51/d8f/fa2 x:0 0 0 2024-02-10T00:00:32.443 INFO:tasks.workunit.client.0.smithi164.stdout:4/262: rename d2/d2f to d2/d2f/d37/d41/d3d/d42/d60 22 2024-02-10T00:00:32.444 INFO:tasks.workunit.client.1.smithi183.stdout:8/676: creat d0/d3f/d94/fd7 x:0 0 0 2024-02-10T00:00:32.444 INFO:tasks.workunit.client.1.smithi183.stdout:8/677: chown d0/d27 84207278 1 2024-02-10T00:00:32.445 INFO:tasks.workunit.client.0.smithi164.stdout:3/252: dwrite d0/d1/d2/d17/d37/f3a [0,4194304] 0 2024-02-10T00:00:32.445 INFO:tasks.workunit.client.0.smithi164.stdout:4/263: chown d2/d2f/d37/d41/f35 0 1 2024-02-10T00:00:32.445 INFO:tasks.workunit.client.1.smithi183.stdout:8/678: readlink d0/d10/d9e/da4/lb7 0 2024-02-10T00:00:32.446 INFO:tasks.workunit.client.1.smithi183.stdout:1/562: dread d0/d3c/dc9/f28 [0,4194304] 0 2024-02-10T00:00:32.447 INFO:tasks.workunit.client.1.smithi183.stdout:5/684: link d4/d23/d3e/d80/da1/f8a d4/d23/dc4/fdb 0 2024-02-10T00:00:32.449 INFO:tasks.workunit.client.0.smithi164.stdout:3/253: mkdir d0/d1/d2/d17/d37/d3f/d4e 0 2024-02-10T00:00:32.449 INFO:tasks.workunit.client.0.smithi164.stdout:4/264: dwrite d2/f1a [0,4194304] 0 2024-02-10T00:00:32.452 INFO:tasks.workunit.client.1.smithi183.stdout:0/601: rename d14/d1d/c1f to d14/d1d/d59/d3c/cdb 0 2024-02-10T00:00:32.453 INFO:tasks.workunit.client.1.smithi183.stdout:0/602: chown c10 276674048 1 2024-02-10T00:00:32.453 INFO:tasks.workunit.client.1.smithi183.stdout:5/685: symlink d4/d23/d3e/d80/da1/ldc 0 2024-02-10T00:00:32.457 INFO:tasks.workunit.client.1.smithi183.stdout:8/679: symlink d0/d4e/da6/ld8 0 2024-02-10T00:00:32.460 INFO:tasks.workunit.client.0.smithi164.stdout:6/363: dread - d0/d6/d12/d14/d4b/f6b zero size 2024-02-10T00:00:32.460 INFO:tasks.workunit.client.0.smithi164.stdout:2/293: write d3/f16 [2020106,118519] 0 2024-02-10T00:00:32.462 INFO:tasks.workunit.client.1.smithi183.stdout:0/603: rmdir d14/d1d/d55/d6e/d74 39 2024-02-10T00:00:32.465 INFO:tasks.workunit.client.1.smithi183.stdout:4/657: write de/f11 [4399490,6278] 0 2024-02-10T00:00:32.465 INFO:tasks.workunit.client.0.smithi164.stdout:2/294: dread - d3/f6d zero size 2024-02-10T00:00:32.465 INFO:tasks.workunit.client.0.smithi164.stdout:3/254: link d0/d1/d2/d19/c28 d0/d1/d2/d17/c4f 0 2024-02-10T00:00:32.466 INFO:tasks.workunit.client.1.smithi183.stdout:8/680: chown d0/d3f/cd1 89219766 1 2024-02-10T00:00:32.466 INFO:tasks.workunit.client.0.smithi164.stdout:3/255: fsync d0/d1/d2/d19/f39 0 2024-02-10T00:00:32.466 INFO:tasks.workunit.client.1.smithi183.stdout:2/753: truncate d2/d3d/fa0 4243345 0 2024-02-10T00:00:32.467 INFO:tasks.workunit.client.0.smithi164.stdout:3/256: chown d0/d1/d2/d19/d27/f2c 155627990 1 2024-02-10T00:00:32.468 INFO:tasks.workunit.client.1.smithi183.stdout:6/524: write d2/d1a/d25/d3c/d31/d66/f71 [2025665,4578] 0 2024-02-10T00:00:32.469 INFO:tasks.workunit.client.1.smithi183.stdout:6/525: write d2/f7 [2897592,89825] 0 2024-02-10T00:00:32.470 INFO:tasks.workunit.client.1.smithi183.stdout:9/627: truncate d0/d3/d14/d3c/f6f 4584870 0 2024-02-10T00:00:32.470 INFO:tasks.workunit.client.1.smithi183.stdout:6/526: write d2/d1a/d3a/f57 [971320,65843] 0 2024-02-10T00:00:32.471 INFO:tasks.workunit.client.0.smithi164.stdout:9/287: dread d6/d1c/f2e [0,4194304] 0 2024-02-10T00:00:32.472 INFO:tasks.workunit.client.0.smithi164.stdout:7/318: dread d3/f38 [0,4194304] 0 2024-02-10T00:00:32.472 INFO:tasks.workunit.client.1.smithi183.stdout:0/604: rename d14/d1d/d2d/d31/d68/fbc to d14/d1d/d59/fdc 0 2024-02-10T00:00:32.474 INFO:tasks.workunit.client.0.smithi164.stdout:1/221: truncate d1/d1a/d35/f34 1146708 0 2024-02-10T00:00:32.475 INFO:tasks.workunit.client.0.smithi164.stdout:6/364: getdents d0/d2b/d3a/d3d/d42/d5d/d66 0 2024-02-10T00:00:32.476 INFO:tasks.workunit.client.0.smithi164.stdout:3/257: symlink d0/d1/d2/d19/l50 0 2024-02-10T00:00:32.476 INFO:tasks.workunit.client.0.smithi164.stdout:9/288: read d6/d1c/d24/f33 [2140151,46346] 0 2024-02-10T00:00:32.476 INFO:tasks.workunit.client.0.smithi164.stdout:2/295: mknod d3/d26/c70 0 2024-02-10T00:00:32.477 INFO:tasks.workunit.client.0.smithi164.stdout:7/319: symlink d3/d5/d2b/l70 0 2024-02-10T00:00:32.481 INFO:tasks.workunit.client.0.smithi164.stdout:1/222: unlink d1/d1a/d35/f31 0 2024-02-10T00:00:32.481 INFO:tasks.workunit.client.0.smithi164.stdout:1/223: stat l0 0 2024-02-10T00:00:32.482 INFO:tasks.workunit.client.1.smithi183.stdout:7/579: write d0/d2/d50/d5d/f8e [3720734,105381] 0 2024-02-10T00:00:32.482 INFO:tasks.workunit.client.0.smithi164.stdout:2/296: write d3/f3e [395775,104015] 0 2024-02-10T00:00:32.482 INFO:tasks.workunit.client.0.smithi164.stdout:5/279: sync 2024-02-10T00:00:32.483 INFO:tasks.workunit.client.0.smithi164.stdout:8/239: sync 2024-02-10T00:00:32.483 INFO:tasks.workunit.client.0.smithi164.stdout:8/240: write d2/f20 [5039323,110644] 0 2024-02-10T00:00:32.484 INFO:tasks.workunit.client.1.smithi183.stdout:5/686: getdents d4/d23/d4a 0 2024-02-10T00:00:32.484 INFO:tasks.workunit.client.0.smithi164.stdout:8/241: chown d2/d12/d21/d31/d32/f3e 30458 1 2024-02-10T00:00:32.485 INFO:tasks.workunit.client.0.smithi164.stdout:0/253: dread f3 [0,4194304] 0 2024-02-10T00:00:32.485 INFO:tasks.workunit.client.0.smithi164.stdout:6/365: creat d0/d3b/f6f x:0 0 0 2024-02-10T00:00:32.486 INFO:tasks.workunit.client.1.smithi183.stdout:6/527: creat d2/d1a/d25/d3c/d31/d38/f9a x:0 0 0 2024-02-10T00:00:32.486 INFO:tasks.workunit.client.1.smithi183.stdout:6/528: chown d2/f19 19 1 2024-02-10T00:00:32.486 INFO:tasks.workunit.client.0.smithi164.stdout:6/366: write d0/d6/d12/d57/f58 [550631,105921] 0 2024-02-10T00:00:32.487 INFO:tasks.workunit.client.1.smithi183.stdout:0/605: mkdir d14/d3e/d5f/daa/ddd 0 2024-02-10T00:00:32.490 INFO:tasks.workunit.client.1.smithi183.stdout:7/580: rename d0/d11/d2f/d64/d80 to d0/d11/d9d/dab 0 2024-02-10T00:00:32.490 INFO:tasks.workunit.client.1.smithi183.stdout:6/529: dwrite d2/d1a/d25/d3c/d31/d38/f9a [0,4194304] 0 2024-02-10T00:00:32.491 INFO:tasks.workunit.client.1.smithi183.stdout:6/530: fdatasync d2/d32/f5c 0 2024-02-10T00:00:32.495 INFO:tasks.workunit.client.1.smithi183.stdout:5/687: creat d4/d23/d3e/d80/da1/d9c/d72/da0/da9/fdd x:0 0 0 2024-02-10T00:00:32.495 INFO:tasks.workunit.client.0.smithi164.stdout:7/320: mkdir d3/d11/d39/d44/d48/d71 0 2024-02-10T00:00:32.495 INFO:tasks.workunit.client.0.smithi164.stdout:0/254: readlink d6/l13 0 2024-02-10T00:00:32.496 INFO:tasks.workunit.client.0.smithi164.stdout:1/224: symlink d1/d13/l4b 0 2024-02-10T00:00:32.498 INFO:tasks.workunit.client.0.smithi164.stdout:1/225: write d1/d1a/f39 [649168,110192] 0 2024-02-10T00:00:32.499 INFO:tasks.workunit.client.1.smithi183.stdout:3/559: truncate d7/f9 3723396 0 2024-02-10T00:00:32.500 INFO:tasks.workunit.client.0.smithi164.stdout:4/265: dwrite d2/d2f/f51 [0,4194304] 0 2024-02-10T00:00:32.501 INFO:tasks.workunit.client.0.smithi164.stdout:0/255: dread d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:32.501 INFO:tasks.workunit.client.0.smithi164.stdout:4/266: readlink d2/d19/ld 0 2024-02-10T00:00:32.502 INFO:tasks.workunit.client.1.smithi183.stdout:1/563: dread d0/d3c/f73 [0,4194304] 0 2024-02-10T00:00:32.504 INFO:tasks.workunit.client.0.smithi164.stdout:3/258: rename d0/d3b/d46 to d0/d1/d3c/d3d/d51 0 2024-02-10T00:00:32.504 INFO:tasks.workunit.client.1.smithi183.stdout:8/681: truncate d0/d27/d36/fc4 759517 0 2024-02-10T00:00:32.505 INFO:tasks.workunit.client.0.smithi164.stdout:5/280: write d7/f32 [4155589,69172] 0 2024-02-10T00:00:32.505 INFO:tasks.workunit.client.0.smithi164.stdout:3/259: write d0/f43 [184212,13521] 0 2024-02-10T00:00:32.506 INFO:tasks.workunit.client.0.smithi164.stdout:3/260: readlink d0/l21 0 2024-02-10T00:00:32.506 INFO:tasks.workunit.client.1.smithi183.stdout:6/531: dread d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:32.508 INFO:tasks.workunit.client.0.smithi164.stdout:7/321: rmdir d3/d28/d51 39 2024-02-10T00:00:32.509 INFO:tasks.workunit.client.0.smithi164.stdout:9/289: dwrite d6/d1c/f32 [0,4194304] 0 2024-02-10T00:00:32.513 INFO:tasks.workunit.client.0.smithi164.stdout:6/367: dread d0/d2b/f36 [0,4194304] 0 2024-02-10T00:00:32.514 INFO:tasks.workunit.client.0.smithi164.stdout:6/368: chown d0/d6/d12/d14/d4b/l6a 2202502 1 2024-02-10T00:00:32.514 INFO:tasks.workunit.client.1.smithi183.stdout:2/754: truncate d2/da/d20/d21/d43/f65 715480 0 2024-02-10T00:00:32.515 INFO:tasks.workunit.client.0.smithi164.stdout:8/242: creat d2/f41 x:0 0 0 2024-02-10T00:00:32.515 INFO:tasks.workunit.client.0.smithi164.stdout:6/369: fsync d0/d6/d12/f5b 0 2024-02-10T00:00:32.516 INFO:tasks.workunit.client.1.smithi183.stdout:9/628: write d0/f3b [182538,125875] 0 2024-02-10T00:00:32.517 INFO:tasks.workunit.client.0.smithi164.stdout:0/256: dwrite d6/d10/d18/d2d/d35/d47/f50 [0,4194304] 0 2024-02-10T00:00:32.518 INFO:tasks.workunit.client.0.smithi164.stdout:7/322: chown d3/d11/f14 811 1 2024-02-10T00:00:32.519 INFO:tasks.workunit.client.0.smithi164.stdout:1/226: symlink d1/d1a/d41/d18/l4c 0 2024-02-10T00:00:32.520 INFO:tasks.workunit.client.0.smithi164.stdout:1/227: chown d1/f6 400673 1 2024-02-10T00:00:32.521 INFO:tasks.workunit.client.0.smithi164.stdout:8/243: fsync d2/f13 0 2024-02-10T00:00:32.521 INFO:tasks.workunit.client.1.smithi183.stdout:5/688: mknod d4/d23/d4a/cde 0 2024-02-10T00:00:32.521 INFO:tasks.workunit.client.0.smithi164.stdout:6/370: fsync d0/d2b/f36 0 2024-02-10T00:00:32.524 INFO:tasks.workunit.client.0.smithi164.stdout:7/323: dwrite d3/f5f [0,4194304] 0 2024-02-10T00:00:32.527 INFO:tasks.workunit.client.1.smithi183.stdout:2/755: mknod d2/d2c/dab/c100 0 2024-02-10T00:00:32.527 INFO:tasks.workunit.client.0.smithi164.stdout:1/228: creat d1/d1a/d41/d18/d33/f4d x:0 0 0 2024-02-10T00:00:32.528 INFO:tasks.workunit.client.0.smithi164.stdout:8/244: creat d2/d12/d21/f42 x:0 0 0 2024-02-10T00:00:32.529 INFO:tasks.workunit.client.1.smithi183.stdout:9/629: unlink d0/d3/d14/d1c/d2d/d4f/c8c 0 2024-02-10T00:00:32.529 INFO:tasks.workunit.client.0.smithi164.stdout:2/297: link d3/d32/d4e/d27/d2e/d36/f43 d3/d32/f71 0 2024-02-10T00:00:32.529 INFO:tasks.workunit.client.0.smithi164.stdout:8/245: write d2/f20 [3003830,33492] 0 2024-02-10T00:00:32.530 INFO:tasks.workunit.client.1.smithi183.stdout:9/630: write d0/d10/fa9 [4017722,92099] 0 2024-02-10T00:00:32.530 INFO:tasks.workunit.client.1.smithi183.stdout:3/560: creat d7/d98/fa3 x:0 0 0 2024-02-10T00:00:32.531 INFO:tasks.workunit.client.0.smithi164.stdout:0/257: creat d6/d3a/d52/f53 x:0 0 0 2024-02-10T00:00:32.534 INFO:tasks.workunit.client.1.smithi183.stdout:6/532: mknod d2/d1a/d3a/d45/c9b 0 2024-02-10T00:00:32.535 INFO:tasks.workunit.client.0.smithi164.stdout:6/371: rename d0/cd to d0/d6/d12/d57/c70 0 2024-02-10T00:00:32.536 INFO:tasks.workunit.client.1.smithi183.stdout:0/606: getdents d14/d1d/d2d/d31/d68 0 2024-02-10T00:00:32.536 INFO:tasks.workunit.client.1.smithi183.stdout:8/682: link d0/d27/d75/ca9 d0/d4e/d6b/cd9 0 2024-02-10T00:00:32.537 INFO:tasks.workunit.client.0.smithi164.stdout:2/298: unlink d3/d24/d51/f6f 0 2024-02-10T00:00:32.538 INFO:tasks.workunit.client.0.smithi164.stdout:7/324: truncate d3/d28/f3f 1023806 0 2024-02-10T00:00:32.538 INFO:tasks.workunit.client.0.smithi164.stdout:3/261: dread d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:32.538 INFO:tasks.workunit.client.0.smithi164.stdout:7/325: chown d3/d5/d2b/d4a 943218 1 2024-02-10T00:00:32.540 INFO:tasks.workunit.client.0.smithi164.stdout:7/326: write d3/f2d [4291870,108205] 0 2024-02-10T00:00:32.540 INFO:tasks.workunit.client.0.smithi164.stdout:1/229: creat d1/f4e x:0 0 0 2024-02-10T00:00:32.540 INFO:tasks.workunit.client.1.smithi183.stdout:2/756: link d2/f8 d2/da/d20/d21/d36/dc6/f101 0 2024-02-10T00:00:32.540 INFO:tasks.workunit.client.0.smithi164.stdout:7/327: fsync d3/d5/f30 0 2024-02-10T00:00:32.541 INFO:tasks.workunit.client.0.smithi164.stdout:0/258: rename d6/d7/f26 to d6/d7/d14/f54 0 2024-02-10T00:00:32.542 INFO:tasks.workunit.client.1.smithi183.stdout:7/581: rename d0/l2c to d0/d2/lac 0 2024-02-10T00:00:32.542 INFO:tasks.workunit.client.1.smithi183.stdout:4/658: sync 2024-02-10T00:00:32.542 INFO:tasks.workunit.client.0.smithi164.stdout:0/259: write d6/d10/d18/d2d/f37 [674427,124447] 0 2024-02-10T00:00:32.545 INFO:tasks.workunit.client.1.smithi183.stdout:5/689: rename d4/d23/d3e/d80/da1/d9e/d27/d5d/fbc to d4/d23/dc4/fdf 0 2024-02-10T00:00:32.546 INFO:tasks.workunit.client.1.smithi183.stdout:5/690: stat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/f62 0 2024-02-10T00:00:32.547 INFO:tasks.workunit.client.1.smithi183.stdout:4/659: creat de/d14/d1d/d7b/dcb/fcf x:0 0 0 2024-02-10T00:00:32.548 INFO:tasks.workunit.client.1.smithi183.stdout:3/561: rename d7/db/d2a/d4d/c4f to d7/db/d2a/d8e/ca4 0 2024-02-10T00:00:32.550 INFO:tasks.workunit.client.1.smithi183.stdout:4/660: truncate de/d14/d27/d2e/f86 1973160 0 2024-02-10T00:00:32.551 INFO:tasks.workunit.client.0.smithi164.stdout:0/260: fdatasync d6/d10/d18/d2d/f37 0 2024-02-10T00:00:32.551 INFO:tasks.workunit.client.1.smithi183.stdout:4/661: write de/d14/d1d/d2f/da2/d9c/f9e [7533088,56026] 0 2024-02-10T00:00:32.551 INFO:tasks.workunit.client.1.smithi183.stdout:4/662: stat de/d14/d27/d2e/c32 0 2024-02-10T00:00:32.552 INFO:tasks.workunit.client.1.smithi183.stdout:8/683: rename d0/d45/l74 to d0/d4e/da6/lda 0 2024-02-10T00:00:32.552 INFO:tasks.workunit.client.0.smithi164.stdout:7/328: creat d3/d5/d59/f72 x:0 0 0 2024-02-10T00:00:32.554 INFO:tasks.workunit.client.0.smithi164.stdout:4/267: write d2/d2f/f4c [1313295,25190] 0 2024-02-10T00:00:32.555 INFO:tasks.workunit.client.0.smithi164.stdout:0/261: chown d6/l1a 2387080 1 2024-02-10T00:00:32.556 INFO:tasks.workunit.client.1.smithi183.stdout:8/684: dwrite d0/d10/d9e/fbe [4194304,4194304] 0 2024-02-10T00:00:32.556 INFO:tasks.workunit.client.0.smithi164.stdout:5/281: dwrite d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:32.557 INFO:tasks.workunit.client.0.smithi164.stdout:4/268: creat d2/d2f/d37/f61 x:0 0 0 2024-02-10T00:00:32.558 INFO:tasks.workunit.client.0.smithi164.stdout:5/282: fdatasync d7/d17/d3b/d43/f4e 0 2024-02-10T00:00:32.558 INFO:tasks.workunit.client.0.smithi164.stdout:4/269: write d2/d2f/d37/d41/f46 [924764,73404] 0 2024-02-10T00:00:32.559 INFO:tasks.workunit.client.0.smithi164.stdout:7/329: mknod d3/d28/c73 0 2024-02-10T00:00:32.560 INFO:tasks.workunit.client.0.smithi164.stdout:7/330: readlink d3/d11/d39/d44/d48/d50/l6c 0 2024-02-10T00:00:32.560 INFO:tasks.workunit.client.0.smithi164.stdout:7/331: dread - d3/d28/f61 zero size 2024-02-10T00:00:32.561 INFO:tasks.workunit.client.0.smithi164.stdout:7/332: dread - d3/d28/f61 zero size 2024-02-10T00:00:32.563 INFO:tasks.workunit.client.1.smithi183.stdout:1/564: write d0/f4b [1426952,2263] 0 2024-02-10T00:00:32.565 INFO:tasks.workunit.client.0.smithi164.stdout:0/262: rename d6/d10/d18/c40 to d6/d10/d18/d1c/c55 0 2024-02-10T00:00:32.567 INFO:tasks.workunit.client.1.smithi183.stdout:1/565: dwrite d0/d3/d67/fc8 [0,4194304] 0 2024-02-10T00:00:32.568 INFO:tasks.workunit.client.1.smithi183.stdout:9/631: write d0/f2f [1333647,64008] 0 2024-02-10T00:00:32.574 INFO:tasks.workunit.client.1.smithi183.stdout:0/607: truncate d14/d7a/f7e 616826 0 2024-02-10T00:00:32.575 INFO:tasks.workunit.client.1.smithi183.stdout:0/608: write d14/d1d/d59/d3c/d93/fc9 [182599,45446] 0 2024-02-10T00:00:32.575 INFO:tasks.workunit.client.0.smithi164.stdout:9/290: sync 2024-02-10T00:00:32.579 INFO:tasks.workunit.client.0.smithi164.stdout:7/333: mknod d3/d28/c74 0 2024-02-10T00:00:32.580 INFO:tasks.workunit.client.1.smithi183.stdout:0/609: dwrite d14/d1d/d59/d3c/d72/f90 [0,4194304] 0 2024-02-10T00:00:32.580 INFO:tasks.workunit.client.0.smithi164.stdout:0/263: dwrite d6/d10/d18/d2d/f2e [4194304,4194304] 0 2024-02-10T00:00:32.580 INFO:tasks.workunit.client.0.smithi164.stdout:8/246: dread d2/f13 [0,4194304] 0 2024-02-10T00:00:32.581 INFO:tasks.workunit.client.1.smithi183.stdout:3/562: mkdir d7/db/d2a/da5 0 2024-02-10T00:00:32.581 INFO:tasks.workunit.client.0.smithi164.stdout:4/270: rename d2/d2f/d37/f61 to d2/d2f/d37/d41/d3d/f62 0 2024-02-10T00:00:32.584 INFO:tasks.workunit.client.1.smithi183.stdout:4/663: fdatasync de/d14/d27/d2e/f86 0 2024-02-10T00:00:32.587 INFO:tasks.workunit.client.1.smithi183.stdout:3/563: mknod d7/db/d2a/d2d/d51/d8f/ca6 0 2024-02-10T00:00:32.588 INFO:tasks.workunit.client.1.smithi183.stdout:3/564: read - d7/db/d2a/d2d/d51/f8a zero size 2024-02-10T00:00:32.592 INFO:tasks.workunit.client.0.smithi164.stdout:2/299: truncate d3/d32/d4e/d27/d2e/f41 4715993 0 2024-02-10T00:00:32.592 INFO:tasks.workunit.client.0.smithi164.stdout:8/247: symlink d2/d12/d21/l43 0 2024-02-10T00:00:32.593 INFO:tasks.workunit.client.0.smithi164.stdout:6/372: creat d0/d6/f71 x:0 0 0 2024-02-10T00:00:32.593 INFO:tasks.workunit.client.0.smithi164.stdout:9/291: truncate d6/d1c/d24/f4d 1603939 0 2024-02-10T00:00:32.593 INFO:tasks.workunit.client.0.smithi164.stdout:2/300: fdatasync d3/f16 0 2024-02-10T00:00:32.594 INFO:tasks.workunit.client.1.smithi183.stdout:7/582: rename d0/d11/d35 to d0/d2/d50/dad 0 2024-02-10T00:00:32.594 INFO:tasks.workunit.client.0.smithi164.stdout:7/334: mkdir d3/d11/d39/d44/d6f/d75 0 2024-02-10T00:00:32.594 INFO:tasks.workunit.client.1.smithi183.stdout:0/610: symlink d14/d3e/d5f/daa/ddd/lde 0 2024-02-10T00:00:32.594 INFO:tasks.workunit.client.0.smithi164.stdout:6/373: stat d0/d6/d12/f22 0 2024-02-10T00:00:32.595 INFO:tasks.workunit.client.0.smithi164.stdout:2/301: dread - d3/d24/d5b/f6e zero size 2024-02-10T00:00:32.595 INFO:tasks.workunit.client.1.smithi183.stdout:9/632: mkdir d0/d3/d14/d1c/d4b/d97/daa/dcf 0 2024-02-10T00:00:32.595 INFO:tasks.workunit.client.0.smithi164.stdout:6/374: readlink d0/d6/d12/d14/d4b/l6c 0 2024-02-10T00:00:32.596 INFO:tasks.workunit.client.0.smithi164.stdout:4/271: rename d2/d2f/d37/d41/d3d/d56/f5d to d2/d2f/d37/d41/d3d/d42/f63 0 2024-02-10T00:00:32.596 INFO:tasks.workunit.client.1.smithi183.stdout:3/565: rmdir d7/d98 39 2024-02-10T00:00:32.597 INFO:tasks.workunit.client.1.smithi183.stdout:2/757: sync 2024-02-10T00:00:32.597 INFO:tasks.workunit.client.1.smithi183.stdout:6/533: sync 2024-02-10T00:00:32.598 INFO:tasks.workunit.client.1.smithi183.stdout:6/534: stat d2/f7 0 2024-02-10T00:00:32.598 INFO:tasks.workunit.client.1.smithi183.stdout:4/664: mkdir de/d19/d1c/dd0 0 2024-02-10T00:00:32.599 INFO:tasks.workunit.client.0.smithi164.stdout:0/264: unlink d6/d10/l12 0 2024-02-10T00:00:32.599 INFO:tasks.workunit.client.1.smithi183.stdout:9/633: dwrite d0/f3a [4194304,4194304] 0 2024-02-10T00:00:32.599 INFO:tasks.workunit.client.1.smithi183.stdout:2/758: write d2/da/d19/f7a [3099299,5879] 0 2024-02-10T00:00:32.600 INFO:tasks.workunit.client.0.smithi164.stdout:3/262: sync 2024-02-10T00:00:32.600 INFO:tasks.workunit.client.0.smithi164.stdout:8/248: mkdir d2/d12/d21/d31/d32/d44 0 2024-02-10T00:00:32.600 INFO:tasks.workunit.client.1.smithi183.stdout:7/583: creat d0/d11/d2f/fae x:0 0 0 2024-02-10T00:00:32.601 INFO:tasks.workunit.client.0.smithi164.stdout:8/249: write d2/f27 [2947898,37560] 0 2024-02-10T00:00:32.601 INFO:tasks.workunit.client.0.smithi164.stdout:7/335: symlink d3/d11/d39/d44/d6f/l76 0 2024-02-10T00:00:32.601 INFO:tasks.workunit.client.0.smithi164.stdout:8/250: fdatasync d2/d12/d21/f42 0 2024-02-10T00:00:32.602 INFO:tasks.workunit.client.1.smithi183.stdout:0/611: mknod d14/d1d/d96/da0/cdf 0 2024-02-10T00:00:32.602 INFO:tasks.workunit.client.0.smithi164.stdout:7/336: stat d3/d11/d39/d44/d48/l60 0 2024-02-10T00:00:32.604 INFO:tasks.workunit.client.0.smithi164.stdout:2/302: symlink d3/d26/d64/l72 0 2024-02-10T00:00:32.605 INFO:tasks.workunit.client.0.smithi164.stdout:9/292: rename c3 to d6/d41/c5e 0 2024-02-10T00:00:32.605 INFO:tasks.workunit.client.1.smithi183.stdout:2/759: chown d2/da/d19/d31/cbf 6754 1 2024-02-10T00:00:32.605 INFO:tasks.workunit.client.1.smithi183.stdout:4/665: dwrite de/d14/d1d/d2f/da2/d9c/fb8 [0,4194304] 0 2024-02-10T00:00:32.607 INFO:tasks.workunit.client.1.smithi183.stdout:2/760: chown d2/da/f7d 433174 1 2024-02-10T00:00:32.607 INFO:tasks.workunit.client.1.smithi183.stdout:2/761: fdatasync d2/da/d20/d21/d36/fcb 0 2024-02-10T00:00:32.607 INFO:tasks.workunit.client.1.smithi183.stdout:6/535: rename d2/c95 to d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c9c 0 2024-02-10T00:00:32.608 INFO:tasks.workunit.client.0.smithi164.stdout:0/265: mknod d6/d10/d18/d2d/d35/c56 0 2024-02-10T00:00:32.608 INFO:tasks.workunit.client.1.smithi183.stdout:6/536: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b 69 1 2024-02-10T00:00:32.610 INFO:tasks.workunit.client.1.smithi183.stdout:6/537: write d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 [1488214,122323] 0 2024-02-10T00:00:32.610 INFO:tasks.workunit.client.1.smithi183.stdout:0/612: mkdir d14/d1d/d2d/d31/de0 0 2024-02-10T00:00:32.616 INFO:tasks.workunit.client.1.smithi183.stdout:2/762: symlink d2/d2c/dba/df0/l102 0 2024-02-10T00:00:32.617 INFO:tasks.workunit.client.0.smithi164.stdout:0/266: dread d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:32.618 INFO:tasks.workunit.client.0.smithi164.stdout:6/375: rename d0/d3b/d56/l5a to d0/d6/d12/d45/l72 0 2024-02-10T00:00:32.619 INFO:tasks.workunit.client.1.smithi183.stdout:7/584: rename d0/d2/d4/f6e to d0/d11/d9d/faf 0 2024-02-10T00:00:32.619 INFO:tasks.workunit.client.0.smithi164.stdout:8/251: truncate d2/f41 129577 0 2024-02-10T00:00:32.621 INFO:tasks.workunit.client.1.smithi183.stdout:5/691: dread d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f6c [0,4194304] 0 2024-02-10T00:00:32.621 INFO:tasks.workunit.client.0.smithi164.stdout:2/303: creat d3/f73 x:0 0 0 2024-02-10T00:00:32.621 INFO:tasks.workunit.client.0.smithi164.stdout:6/376: fsync d0/fb 0 2024-02-10T00:00:32.621 INFO:tasks.workunit.client.0.smithi164.stdout:6/377: readlink d0/d6/d12/d14/d4b/l6c 0 2024-02-10T00:00:32.622 INFO:tasks.workunit.client.1.smithi183.stdout:0/613: creat d14/d1d/d59/fe1 x:0 0 0 2024-02-10T00:00:32.622 INFO:tasks.workunit.client.1.smithi183.stdout:8/685: sync 2024-02-10T00:00:32.624 INFO:tasks.workunit.client.0.smithi164.stdout:8/252: mknod d2/d12/d21/d31/d32/c45 0 2024-02-10T00:00:32.626 INFO:tasks.workunit.client.1.smithi183.stdout:1/566: truncate d0/d3/d7/d36/f4d 5157905 0 2024-02-10T00:00:32.626 INFO:tasks.workunit.client.1.smithi183.stdout:8/686: dwrite d0/fd0 [0,4194304] 0 2024-02-10T00:00:32.627 INFO:tasks.workunit.client.1.smithi183.stdout:9/634: link d0/d3/d14/l28 d0/d3/d14/d1c/d2d/d4f/db8/ld0 0 2024-02-10T00:00:32.628 INFO:tasks.workunit.client.0.smithi164.stdout:5/283: truncate d7/f32 4968221 0 2024-02-10T00:00:32.629 INFO:tasks.workunit.client.1.smithi183.stdout:4/666: link de/d14/d1d/d7b/f8f de/d19/fd1 0 2024-02-10T00:00:32.637 INFO:tasks.workunit.client.0.smithi164.stdout:8/253: dwrite d2/f19 [0,4194304] 0 2024-02-10T00:00:32.641 INFO:tasks.workunit.client.1.smithi183.stdout:2/763: fsync d2/d2c/dba/fda 0 2024-02-10T00:00:32.641 INFO:tasks.workunit.client.1.smithi183.stdout:6/538: creat d2/d1a/d25/d3c/d31/d38/d6e/f9d x:0 0 0 2024-02-10T00:00:32.642 INFO:tasks.workunit.client.1.smithi183.stdout:2/764: dread - d2/da/d20/d21/d36/fcb zero size 2024-02-10T00:00:32.645 INFO:tasks.workunit.client.1.smithi183.stdout:5/692: mknod d4/d23/d2a/ce0 0 2024-02-10T00:00:32.645 INFO:tasks.workunit.client.0.smithi164.stdout:4/272: write d2/d19/d16/d31/d57/f59 [579733,23676] 0 2024-02-10T00:00:32.646 INFO:tasks.workunit.client.0.smithi164.stdout:4/273: stat d2/d19/d16/d31/d4b 0 2024-02-10T00:00:32.646 INFO:tasks.workunit.client.1.smithi183.stdout:8/687: mknod d0/d27/d75/d5b/d85/cdb 0 2024-02-10T00:00:32.648 INFO:tasks.workunit.client.1.smithi183.stdout:4/667: symlink de/d19/ld2 0 2024-02-10T00:00:32.649 INFO:tasks.workunit.client.0.smithi164.stdout:1/230: sync 2024-02-10T00:00:32.650 INFO:tasks.workunit.client.0.smithi164.stdout:5/284: mknod d7/d17/d3b/d43/c55 0 2024-02-10T00:00:32.651 INFO:tasks.workunit.client.0.smithi164.stdout:0/267: link d6/d7/d14/c23 d6/d10/d18/d2d/d35/c57 0 2024-02-10T00:00:32.652 INFO:tasks.workunit.client.0.smithi164.stdout:6/378: symlink d0/d2b/l73 0 2024-02-10T00:00:32.652 INFO:tasks.workunit.client.1.smithi183.stdout:7/585: fdatasync d0/d2/d3/f90 0 2024-02-10T00:00:32.653 INFO:tasks.workunit.client.0.smithi164.stdout:0/268: fsync d6/d7/d14/f27 0 2024-02-10T00:00:32.653 INFO:tasks.workunit.client.1.smithi183.stdout:7/586: chown d0/d11/d3e/f70 4 1 2024-02-10T00:00:32.654 INFO:tasks.workunit.client.0.smithi164.stdout:1/231: mknod d1/d1a/d41/d18/d3a/c4f 0 2024-02-10T00:00:32.654 INFO:tasks.workunit.client.0.smithi164.stdout:8/254: write d2/d12/d21/f2f [735384,28750] 0 2024-02-10T00:00:32.656 INFO:tasks.workunit.client.1.smithi183.stdout:6/539: dread d2/d1a/d25/d3c/d31/d66/f71 [0,4194304] 0 2024-02-10T00:00:32.657 INFO:tasks.workunit.client.0.smithi164.stdout:7/337: dwrite d3/d28/f35 [4194304,4194304] 0 2024-02-10T00:00:32.657 INFO:tasks.workunit.client.0.smithi164.stdout:2/304: dwrite d3/d32/d4e/f59 [0,4194304] 0 2024-02-10T00:00:32.658 INFO:tasks.workunit.client.1.smithi183.stdout:2/765: creat d2/da/d20/d21/d43/f103 x:0 0 0 2024-02-10T00:00:32.658 INFO:tasks.workunit.client.0.smithi164.stdout:7/338: chown d3/d5/l43 729603882 1 2024-02-10T00:00:32.659 INFO:tasks.workunit.client.1.smithi183.stdout:2/766: chown d2/da/d5b/fc2 171461297 1 2024-02-10T00:00:32.659 INFO:tasks.workunit.client.0.smithi164.stdout:5/285: rename d7/l10 to d7/d17/d3b/l56 0 2024-02-10T00:00:32.659 INFO:tasks.workunit.client.0.smithi164.stdout:6/379: chown d0/l15 1922 1 2024-02-10T00:00:32.660 INFO:tasks.workunit.client.1.smithi183.stdout:9/635: dwrite d0/d10/f42 [0,4194304] 0 2024-02-10T00:00:32.660 INFO:tasks.workunit.client.0.smithi164.stdout:8/255: dread d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:32.661 INFO:tasks.workunit.client.1.smithi183.stdout:5/693: rename d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/fb4 to d4/d23/d4a/d36/fe1 0 2024-02-10T00:00:32.661 INFO:tasks.workunit.client.1.smithi183.stdout:4/668: mkdir de/d14/d4e/dd3 0 2024-02-10T00:00:32.662 INFO:tasks.workunit.client.0.smithi164.stdout:1/232: creat d1/d13/d2b/f50 x:0 0 0 2024-02-10T00:00:32.663 INFO:tasks.workunit.client.1.smithi183.stdout:3/566: sync 2024-02-10T00:00:32.665 INFO:tasks.workunit.client.0.smithi164.stdout:5/286: dwrite d7/d17/d21/f29 [4194304,4194304] 0 2024-02-10T00:00:32.665 INFO:tasks.workunit.client.0.smithi164.stdout:5/287: chown d7/d15/d1f/l41 80537 1 2024-02-10T00:00:32.668 INFO:tasks.workunit.client.1.smithi183.stdout:2/767: fdatasync d2/da/fee 0 2024-02-10T00:00:32.668 INFO:tasks.workunit.client.1.smithi183.stdout:8/688: symlink d0/d3f/db2/ldc 0 2024-02-10T00:00:32.668 INFO:tasks.workunit.client.0.smithi164.stdout:2/305: rmdir d3/d32/d4e 39 2024-02-10T00:00:32.668 INFO:tasks.workunit.client.0.smithi164.stdout:2/306: stat d3 0 2024-02-10T00:00:32.670 INFO:tasks.workunit.client.1.smithi183.stdout:5/694: mknod d4/d23/d4a/d36/ce2 0 2024-02-10T00:00:32.671 INFO:tasks.workunit.client.0.smithi164.stdout:6/380: creat d0/d2b/d3a/d3d/f74 x:0 0 0 2024-02-10T00:00:32.671 INFO:tasks.workunit.client.1.smithi183.stdout:4/669: chown de/d14/d27/cb5 108631 1 2024-02-10T00:00:32.672 INFO:tasks.workunit.client.0.smithi164.stdout:6/381: chown d0/d2b/d3a/d3d/d42/f47 20424 1 2024-02-10T00:00:32.672 INFO:tasks.workunit.client.1.smithi183.stdout:3/567: mknod d7/db/d2a/d2d/d51/ca7 0 2024-02-10T00:00:32.672 INFO:tasks.workunit.client.1.smithi183.stdout:0/614: dread d14/d1d/fba [0,4194304] 0 2024-02-10T00:00:32.673 INFO:tasks.workunit.client.1.smithi183.stdout:9/636: dwrite d0/d3/d14/d3c/d7b/f87 [0,4194304] 0 2024-02-10T00:00:32.673 INFO:tasks.workunit.client.1.smithi183.stdout:4/670: chown de/d19/d20/f6d 5081411 1 2024-02-10T00:00:32.673 INFO:tasks.workunit.client.0.smithi164.stdout:1/233: creat d1/d1a/d41/d18/d3a/f51 x:0 0 0 2024-02-10T00:00:32.674 INFO:tasks.workunit.client.0.smithi164.stdout:1/234: write d1/d1a/f22 [4419114,67294] 0 2024-02-10T00:00:32.675 INFO:tasks.workunit.client.0.smithi164.stdout:1/235: fdatasync d1/d1a/d41/d18/f30 0 2024-02-10T00:00:32.675 INFO:tasks.workunit.client.0.smithi164.stdout:7/339: symlink d3/l77 0 2024-02-10T00:00:32.676 INFO:tasks.workunit.client.0.smithi164.stdout:8/256: mknod d2/d12/d21/d31/d32/d44/c46 0 2024-02-10T00:00:32.676 INFO:tasks.workunit.client.0.smithi164.stdout:2/307: stat d3/d32/d4e/d27/d2e/d36 0 2024-02-10T00:00:32.677 INFO:tasks.workunit.client.1.smithi183.stdout:7/587: rename d0/d11/d2f/d64/d6b/l9e to d0/lb0 0 2024-02-10T00:00:32.678 INFO:tasks.workunit.client.0.smithi164.stdout:3/263: sync 2024-02-10T00:00:32.679 INFO:tasks.workunit.client.0.smithi164.stdout:7/340: read d3/d4d/f55 [134132,130022] 0 2024-02-10T00:00:32.679 INFO:tasks.workunit.client.0.smithi164.stdout:9/293: dread d6/f9 [0,4194304] 0 2024-02-10T00:00:32.680 INFO:tasks.workunit.client.1.smithi183.stdout:9/637: dwrite d0/d3/d14/d1c/d2d/d4f/f5a [0,4194304] 0 2024-02-10T00:00:32.680 INFO:tasks.workunit.client.0.smithi164.stdout:7/341: write d3/d11/d39/f47 [1544360,104108] 0 2024-02-10T00:00:32.680 INFO:tasks.workunit.client.1.smithi183.stdout:3/568: unlink d7/db/d2a/d2d/f50 0 2024-02-10T00:00:32.681 INFO:tasks.workunit.client.1.smithi183.stdout:5/695: dwrite d4/dd/d71/f84 [0,4194304] 0 2024-02-10T00:00:32.682 INFO:tasks.workunit.client.0.smithi164.stdout:6/382: dread d0/d6/d12/f1f [0,4194304] 0 2024-02-10T00:00:32.683 INFO:tasks.workunit.client.1.smithi183.stdout:4/671: creat de/d14/d27/d2e/fd4 x:0 0 0 2024-02-10T00:00:32.684 INFO:tasks.workunit.client.1.smithi183.stdout:2/768: rename d2/d2c/dba/df0/dbe/df8 to d2/d2c/d104 0 2024-02-10T00:00:32.686 INFO:tasks.workunit.client.0.smithi164.stdout:3/264: readlink d0/d1/d2/d17/d37/l40 0 2024-02-10T00:00:32.686 INFO:tasks.workunit.client.1.smithi183.stdout:7/588: dwrite d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:32.689 INFO:tasks.workunit.client.0.smithi164.stdout:5/288: link d7/l3a d7/d17/d21/l57 0 2024-02-10T00:00:32.689 INFO:tasks.workunit.client.1.smithi183.stdout:5/696: creat d4/d23/d3e/d80/da1/d9c/d72/da0/da9/fe3 x:0 0 0 2024-02-10T00:00:32.690 INFO:tasks.workunit.client.1.smithi183.stdout:9/638: creat d0/d3/d14/d1c/d4b/d97/daa/dcf/fd1 x:0 0 0 2024-02-10T00:00:32.692 INFO:tasks.workunit.client.0.smithi164.stdout:3/265: write d0/d1/d2/f12 [4164995,1864] 0 2024-02-10T00:00:32.692 INFO:tasks.workunit.client.0.smithi164.stdout:3/266: fdatasync d0/f35 0 2024-02-10T00:00:32.692 INFO:tasks.workunit.client.0.smithi164.stdout:9/294: fdatasync d6/de/d40/f46 0 2024-02-10T00:00:32.693 INFO:tasks.workunit.client.1.smithi183.stdout:9/639: chown d0/d3/d14/c25 36 1 2024-02-10T00:00:32.693 INFO:tasks.workunit.client.1.smithi183.stdout:3/569: dwrite d7/db/d2a/d33/d59/d52/f9d [0,4194304] 0 2024-02-10T00:00:32.693 INFO:tasks.workunit.client.0.smithi164.stdout:3/267: stat d0/d1/d2/fe 0 2024-02-10T00:00:32.694 INFO:tasks.workunit.client.1.smithi183.stdout:7/589: write d0/d2/d50/dad/f61 [517700,85656] 0 2024-02-10T00:00:32.694 INFO:tasks.workunit.client.1.smithi183.stdout:4/672: dwrite de/d14/d27/d2e/f4d [0,4194304] 0 2024-02-10T00:00:32.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/289: readlink d7/d17/d21/d24/l40 0 2024-02-10T00:00:32.696 INFO:tasks.workunit.client.1.smithi183.stdout:1/567: sync 2024-02-10T00:00:32.699 INFO:tasks.workunit.client.0.smithi164.stdout:1/236: getdents d1/d1a 0 2024-02-10T00:00:32.700 INFO:tasks.workunit.client.1.smithi183.stdout:2/769: truncate d2/da/d20/d21/d43/d58/d74/d83/dc4/fc5 1929990 0 2024-02-10T00:00:32.701 INFO:tasks.workunit.client.1.smithi183.stdout:4/673: dwrite de/d19/f96 [0,4194304] 0 2024-02-10T00:00:32.702 INFO:tasks.workunit.client.0.smithi164.stdout:5/290: read d7/d17/f3f [3934491,108803] 0 2024-02-10T00:00:32.702 INFO:tasks.workunit.client.0.smithi164.stdout:7/342: creat d3/d11/d39/d44/d48/f78 x:0 0 0 2024-02-10T00:00:32.702 INFO:tasks.workunit.client.1.smithi183.stdout:9/640: dwrite d0/d3/d14/d1c/d2d/d4f/d58/fc6 [0,4194304] 0 2024-02-10T00:00:32.702 INFO:tasks.workunit.client.1.smithi183.stdout:4/674: stat de/d14/d1d/l34 0 2024-02-10T00:00:32.703 INFO:tasks.workunit.client.1.smithi183.stdout:5/697: getdents d4/d23/d3e/d80/d96 0 2024-02-10T00:00:32.703 INFO:tasks.workunit.client.1.smithi183.stdout:4/675: readlink de/d14/d27/d40/lc5 0 2024-02-10T00:00:32.704 INFO:tasks.workunit.client.1.smithi183.stdout:1/568: fdatasync d0/d3/d67/f2f 0 2024-02-10T00:00:32.704 INFO:tasks.workunit.client.1.smithi183.stdout:5/698: chown f2 0 1 2024-02-10T00:00:32.705 INFO:tasks.workunit.client.0.smithi164.stdout:2/308: getdents d3 0 2024-02-10T00:00:32.705 INFO:tasks.workunit.client.1.smithi183.stdout:4/676: write de/f1f [1979845,42812] 0 2024-02-10T00:00:32.705 INFO:tasks.workunit.client.1.smithi183.stdout:5/699: write f2 [645787,25480] 0 2024-02-10T00:00:32.705 INFO:tasks.workunit.client.0.smithi164.stdout:9/295: rename d6/d1c/d24/c2f to d6/de/d2b/c5f 0 2024-02-10T00:00:32.706 INFO:tasks.workunit.client.0.smithi164.stdout:9/296: chown d6/de/f3d 1682423341 1 2024-02-10T00:00:32.706 INFO:tasks.workunit.client.1.smithi183.stdout:5/700: chown d4/d23/d3e/d80/da1/d9e/d27/d5d/fbe 1923 1 2024-02-10T00:00:32.707 INFO:tasks.workunit.client.0.smithi164.stdout:8/257: getdents d2/d12 0 2024-02-10T00:00:32.708 INFO:tasks.workunit.client.0.smithi164.stdout:9/297: chown d6/f3e 16410153 1 2024-02-10T00:00:32.708 INFO:tasks.workunit.client.1.smithi183.stdout:1/569: readlink d0/l2 0 2024-02-10T00:00:32.708 INFO:tasks.workunit.client.0.smithi164.stdout:7/343: dwrite d3/d11/d39/d3a/f66 [0,4194304] 0 2024-02-10T00:00:32.709 INFO:tasks.workunit.client.0.smithi164.stdout:7/344: fsync d3/d28/f35 0 2024-02-10T00:00:32.715 INFO:tasks.workunit.client.1.smithi183.stdout:2/770: dread d2/da/d5b/fc2 [0,4194304] 0 2024-02-10T00:00:32.718 INFO:tasks.workunit.client.0.smithi164.stdout:2/309: creat d3/d32/d4e/d27/f74 x:0 0 0 2024-02-10T00:00:32.718 INFO:tasks.workunit.client.1.smithi183.stdout:9/641: rename d0/f3b to d0/d3/d14/d1c/d2d/d4f/fd2 0 2024-02-10T00:00:32.719 INFO:tasks.workunit.client.0.smithi164.stdout:5/291: chown d7/d17/d21/l3c 34 1 2024-02-10T00:00:32.719 INFO:tasks.workunit.client.1.smithi183.stdout:1/570: dread - d0/d3/d7/d3d/f91 zero size 2024-02-10T00:00:32.719 INFO:tasks.workunit.client.0.smithi164.stdout:5/292: dread - d7/d17/d21/d24/f4c zero size 2024-02-10T00:00:32.720 INFO:tasks.workunit.client.0.smithi164.stdout:6/383: truncate d0/f5 681772 0 2024-02-10T00:00:32.722 INFO:tasks.workunit.client.0.smithi164.stdout:8/258: truncate d2/f2c 1301165 0 2024-02-10T00:00:32.722 INFO:tasks.workunit.client.1.smithi183.stdout:6/540: write d2/d1a/f20 [1580330,62859] 0 2024-02-10T00:00:32.723 INFO:tasks.workunit.client.1.smithi183.stdout:9/642: rmdir d0/d3/d14/d74 39 2024-02-10T00:00:32.723 INFO:tasks.workunit.client.1.smithi183.stdout:0/615: sync 2024-02-10T00:00:32.724 INFO:tasks.workunit.client.1.smithi183.stdout:6/541: write d2/d1a/d25/f36 [2884740,7551] 0 2024-02-10T00:00:32.725 INFO:tasks.workunit.client.0.smithi164.stdout:8/259: dread d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:32.725 INFO:tasks.workunit.client.0.smithi164.stdout:7/345: mkdir d3/d26/d67/d79 0 2024-02-10T00:00:32.725 INFO:tasks.workunit.client.0.smithi164.stdout:9/298: truncate d6/d1c/d24/f45 736475 0 2024-02-10T00:00:32.727 INFO:tasks.workunit.client.0.smithi164.stdout:8/260: dread d2/f11 [4194304,4194304] 0 2024-02-10T00:00:32.728 INFO:tasks.workunit.client.0.smithi164.stdout:4/274: sync 2024-02-10T00:00:32.729 INFO:tasks.workunit.client.1.smithi183.stdout:6/542: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 [0,4194304] 0 2024-02-10T00:00:32.730 INFO:tasks.workunit.client.0.smithi164.stdout:2/310: rmdir d3/d32/d4e/d27/d2a 39 2024-02-10T00:00:32.730 INFO:tasks.workunit.client.0.smithi164.stdout:6/384: unlink d0/d2b/c3c 0 2024-02-10T00:00:32.732 INFO:tasks.workunit.client.1.smithi183.stdout:3/570: dread d7/f20 [0,4194304] 0 2024-02-10T00:00:32.734 INFO:tasks.workunit.client.1.smithi183.stdout:9/643: truncate d0/fc0 940582 0 2024-02-10T00:00:32.734 INFO:tasks.workunit.client.0.smithi164.stdout:1/237: getdents d1/d13 0 2024-02-10T00:00:32.735 INFO:tasks.workunit.client.1.smithi183.stdout:0/616: getdents d14/d7a/d63 0 2024-02-10T00:00:32.736 INFO:tasks.workunit.client.0.smithi164.stdout:8/261: dwrite d2/d12/d21/d31/d32/f3e [0,4194304] 0 2024-02-10T00:00:32.737 INFO:tasks.workunit.client.0.smithi164.stdout:5/293: creat d7/d17/d21/f58 x:0 0 0 2024-02-10T00:00:32.739 INFO:tasks.workunit.client.0.smithi164.stdout:7/346: dread d3/d11/d39/f47 [0,4194304] 0 2024-02-10T00:00:32.740 INFO:tasks.workunit.client.0.smithi164.stdout:6/385: rename d0/d6/d12/f2e to d0/d2b/d3a/d3d/d42/f75 0 2024-02-10T00:00:32.741 INFO:tasks.workunit.client.1.smithi183.stdout:3/571: link d7/db/d2a/f79 d7/db/d2a/d8e/da0/fa8 0 2024-02-10T00:00:32.741 INFO:tasks.workunit.client.1.smithi183.stdout:9/644: unlink d0/d3/d14/d1c/d4b/d51/fa5 0 2024-02-10T00:00:32.742 INFO:tasks.workunit.client.0.smithi164.stdout:1/238: dwrite d1/d1a/d41/d18/d33/f4d [0,4194304] 0 2024-02-10T00:00:32.743 INFO:tasks.workunit.client.1.smithi183.stdout:0/617: symlink d14/le2 0 2024-02-10T00:00:32.743 INFO:tasks.workunit.client.1.smithi183.stdout:4/677: dread de/d14/d27/d2e/f3f [0,4194304] 0 2024-02-10T00:00:32.744 INFO:tasks.workunit.client.1.smithi183.stdout:3/572: mkdir d7/db/d2a/d2d/d51/d78/da9 0 2024-02-10T00:00:32.745 INFO:tasks.workunit.client.0.smithi164.stdout:8/262: truncate d2/d12/d21/f3b 1281393 0 2024-02-10T00:00:32.746 INFO:tasks.workunit.client.1.smithi183.stdout:9/645: dread d0/d3/d14/d1c/d2d/d4f/f5a [0,4194304] 0 2024-02-10T00:00:32.746 INFO:tasks.workunit.client.0.smithi164.stdout:5/294: rmdir d7/d17/d21/d24 39 2024-02-10T00:00:32.748 INFO:tasks.workunit.client.1.smithi183.stdout:4/678: creat de/d14/d27/d40/fd5 x:0 0 0 2024-02-10T00:00:32.750 INFO:tasks.workunit.client.0.smithi164.stdout:7/347: mknod d3/d11/d39/c7a 0 2024-02-10T00:00:32.750 INFO:tasks.workunit.client.1.smithi183.stdout:4/679: write de/d14/d27/d2e/fd4 [927789,79345] 0 2024-02-10T00:00:32.750 INFO:tasks.workunit.client.1.smithi183.stdout:3/573: mkdir d7/db/d2a/d33/d59/daa 0 2024-02-10T00:00:32.750 INFO:tasks.workunit.client.1.smithi183.stdout:3/574: chown d7/f12 2 1 2024-02-10T00:00:32.751 INFO:tasks.workunit.client.1.smithi183.stdout:3/575: fsync d7/db/f61 0 2024-02-10T00:00:32.751 INFO:tasks.workunit.client.1.smithi183.stdout:9/646: creat d0/d3/d14/d3c/d7b/fd3 x:0 0 0 2024-02-10T00:00:32.752 INFO:tasks.workunit.client.0.smithi164.stdout:1/239: rename d1/d13/d16 to d1/d13/d2b/d52 0 2024-02-10T00:00:32.753 INFO:tasks.workunit.client.0.smithi164.stdout:5/295: dread - d7/d17/d21/d24/f4c zero size 2024-02-10T00:00:32.754 INFO:tasks.workunit.client.1.smithi183.stdout:3/576: fdatasync d7/db/d2a/d4d/d63/f81 0 2024-02-10T00:00:32.755 INFO:tasks.workunit.client.1.smithi183.stdout:0/618: getdents d14/d1d/d2d 0 2024-02-10T00:00:32.755 INFO:tasks.workunit.client.0.smithi164.stdout:7/348: mknod d3/d11/d39/d44/d6f/d75/c7b 0 2024-02-10T00:00:32.756 INFO:tasks.workunit.client.1.smithi183.stdout:4/680: mknod de/d19/d1c/dd0/cd6 0 2024-02-10T00:00:32.756 INFO:tasks.workunit.client.0.smithi164.stdout:7/349: write d3/d11/f18 [2205091,36383] 0 2024-02-10T00:00:32.757 INFO:tasks.workunit.client.0.smithi164.stdout:5/296: mkdir d7/d15/d1f/d59 0 2024-02-10T00:00:32.757 INFO:tasks.workunit.client.1.smithi183.stdout:9/647: dwrite d0/d3/d14/d1c/d2d/d4f/d58/f9f [0,4194304] 0 2024-02-10T00:00:32.758 INFO:tasks.workunit.client.1.smithi183.stdout:0/619: write d14/d1d/d59/d71/d22/f48 [1130704,117898] 0 2024-02-10T00:00:32.758 INFO:tasks.workunit.client.0.smithi164.stdout:8/263: getdents d2/d12/d21/d31 0 2024-02-10T00:00:32.763 INFO:tasks.workunit.client.1.smithi183.stdout:7/590: sync 2024-02-10T00:00:32.764 INFO:tasks.workunit.client.1.smithi183.stdout:7/591: chown d0/d11/l31 142369892 1 2024-02-10T00:00:32.765 INFO:tasks.workunit.client.1.smithi183.stdout:0/620: rename d14/d1d/d59/d3c/d72 to d14/d1d/d2d/d31/d6c/de3 0 2024-02-10T00:00:32.767 INFO:tasks.workunit.client.0.smithi164.stdout:8/264: mknod d2/d12/c47 0 2024-02-10T00:00:32.767 INFO:tasks.workunit.client.0.smithi164.stdout:5/297: mkdir d7/d17/d21/d23/d5a 0 2024-02-10T00:00:32.768 INFO:tasks.workunit.client.1.smithi183.stdout:7/592: rmdir d0/d2/d50 39 2024-02-10T00:00:32.769 INFO:tasks.workunit.client.1.smithi183.stdout:0/621: creat d14/d3e/d9b/fe4 x:0 0 0 2024-02-10T00:00:32.770 INFO:tasks.workunit.client.1.smithi183.stdout:7/593: mkdir d0/d11/d88/db1 0 2024-02-10T00:00:32.771 INFO:tasks.workunit.client.0.smithi164.stdout:8/265: creat d2/d12/f48 x:0 0 0 2024-02-10T00:00:32.771 INFO:tasks.workunit.client.0.smithi164.stdout:5/298: dwrite d7/d15/d1f/f44 [0,4194304] 0 2024-02-10T00:00:32.772 INFO:tasks.workunit.client.1.smithi183.stdout:0/622: symlink d14/d1d/d59/d3c/dc0/le5 0 2024-02-10T00:00:32.775 INFO:tasks.workunit.client.0.smithi164.stdout:8/266: unlink d2/l26 0 2024-02-10T00:00:32.775 INFO:tasks.workunit.client.0.smithi164.stdout:5/299: rmdir d7/d17/d21/d23/d37/d36 39 2024-02-10T00:00:32.775 INFO:tasks.workunit.client.1.smithi183.stdout:9/648: dread d0/d3/d14/d74/da8/faf [0,4194304] 0 2024-02-10T00:00:32.777 INFO:tasks.workunit.client.1.smithi183.stdout:4/681: dread de/d14/d27/f82 [0,4194304] 0 2024-02-10T00:00:32.779 INFO:tasks.workunit.client.1.smithi183.stdout:7/594: link d0/d2/f2b d0/d11/d2f/da3/fb2 0 2024-02-10T00:00:32.779 INFO:tasks.workunit.client.1.smithi183.stdout:9/649: write d0/d3/d14/d3c/fae [1283308,111465] 0 2024-02-10T00:00:32.779 INFO:tasks.workunit.client.0.smithi164.stdout:5/300: mknod d7/d17/d21/d24/c5b 0 2024-02-10T00:00:32.780 INFO:tasks.workunit.client.1.smithi183.stdout:0/623: dwrite d14/d1d/d2d/f8f [0,4194304] 0 2024-02-10T00:00:32.780 INFO:tasks.workunit.client.0.smithi164.stdout:8/267: creat d2/f49 x:0 0 0 2024-02-10T00:00:32.781 INFO:tasks.workunit.client.1.smithi183.stdout:9/650: dread - d0/d3/d14/d1c/d2d/d4f/fcb zero size 2024-02-10T00:00:32.781 INFO:tasks.workunit.client.0.smithi164.stdout:8/268: write d2/d12/d21/f2f [1242276,89875] 0 2024-02-10T00:00:32.782 INFO:tasks.workunit.client.0.smithi164.stdout:5/301: fsync d7/fd 0 2024-02-10T00:00:32.782 INFO:tasks.workunit.client.1.smithi183.stdout:4/682: creat de/d19/fd7 x:0 0 0 2024-02-10T00:00:32.783 INFO:tasks.workunit.client.0.smithi164.stdout:5/302: write d7/d17/d21/d23/d37/f4b [529364,26671] 0 2024-02-10T00:00:32.783 INFO:tasks.workunit.client.1.smithi183.stdout:7/595: creat d0/fb3 x:0 0 0 2024-02-10T00:00:32.783 INFO:tasks.workunit.client.1.smithi183.stdout:4/683: readlink de/d19/d1c/d61/dab/lc0 0 2024-02-10T00:00:32.784 INFO:tasks.workunit.client.0.smithi164.stdout:5/303: readlink d7/d17/d21/l2f 0 2024-02-10T00:00:32.786 INFO:tasks.workunit.client.1.smithi183.stdout:7/596: write d0/d11/d3e/f6a [787606,103682] 0 2024-02-10T00:00:32.786 INFO:tasks.workunit.client.1.smithi183.stdout:9/651: dwrite d0/d3/d14/d3c/fae [0,4194304] 0 2024-02-10T00:00:32.788 INFO:tasks.workunit.client.0.smithi164.stdout:8/269: rename d2/d12/d21/c28 to d2/c4a 0 2024-02-10T00:00:32.788 INFO:tasks.workunit.client.1.smithi183.stdout:9/652: chown d0/c33 0 1 2024-02-10T00:00:32.789 INFO:tasks.workunit.client.1.smithi183.stdout:6/543: sync 2024-02-10T00:00:32.791 INFO:tasks.workunit.client.1.smithi183.stdout:4/684: dwrite de/d14/d1d/d2f/da2/d9c/f9e [0,4194304] 0 2024-02-10T00:00:32.791 INFO:tasks.workunit.client.0.smithi164.stdout:5/304: rename d7/d15/d52 to d7/d17/d3b/d45/d5c 0 2024-02-10T00:00:32.792 INFO:tasks.workunit.client.1.smithi183.stdout:8/689: truncate d0/d3f/db2/f21 3792389 0 2024-02-10T00:00:32.792 INFO:tasks.workunit.client.0.smithi164.stdout:8/270: dwrite d2/f29 [0,4194304] 0 2024-02-10T00:00:32.794 INFO:tasks.workunit.client.0.smithi164.stdout:5/305: mkdir d7/d17/d21/d5d 0 2024-02-10T00:00:32.795 INFO:tasks.workunit.client.0.smithi164.stdout:5/306: fsync d7/d17/d3b/d43/f4e 0 2024-02-10T00:00:32.795 INFO:tasks.workunit.client.0.smithi164.stdout:5/307: chown d7/d17/f3f 35784 1 2024-02-10T00:00:32.796 INFO:tasks.workunit.client.1.smithi183.stdout:0/624: read d14/d1d/d2d/d31/f6d [127358,117558] 0 2024-02-10T00:00:32.797 INFO:tasks.workunit.client.0.smithi164.stdout:5/308: write d7/d17/d21/f58 [413526,106491] 0 2024-02-10T00:00:32.797 INFO:tasks.workunit.client.0.smithi164.stdout:8/271: creat d2/d12/d21/d31/d32/f4b x:0 0 0 2024-02-10T00:00:32.799 INFO:tasks.workunit.client.1.smithi183.stdout:7/597: mkdir d0/d11/d2f/da3/db4 0 2024-02-10T00:00:32.799 INFO:tasks.workunit.client.0.smithi164.stdout:5/309: write d7/d17/f3f [591658,96369] 0 2024-02-10T00:00:32.800 INFO:tasks.workunit.client.1.smithi183.stdout:8/690: mknod d0/d23/cdd 0 2024-02-10T00:00:32.800 INFO:tasks.workunit.client.0.smithi164.stdout:0/269: sync 2024-02-10T00:00:32.801 INFO:tasks.workunit.client.1.smithi183.stdout:0/625: mkdir d14/d3e/d5f/daa/de6 0 2024-02-10T00:00:32.804 INFO:tasks.workunit.client.1.smithi183.stdout:7/598: readlink d0/d2/d50/d5d/l96 0 2024-02-10T00:00:32.807 INFO:tasks.workunit.client.1.smithi183.stdout:8/691: mkdir d0/d4e/da6/dde 0 2024-02-10T00:00:32.809 INFO:tasks.workunit.client.0.smithi164.stdout:0/270: creat d6/d7/f58 x:0 0 0 2024-02-10T00:00:32.809 INFO:tasks.workunit.client.1.smithi183.stdout:9/653: creat d0/d3/d14/d74/fd4 x:0 0 0 2024-02-10T00:00:32.809 INFO:tasks.workunit.client.0.smithi164.stdout:5/310: rename d7/d17/d21/d24/l31 to d7/d17/d21/d23/d37/d36/l5e 0 2024-02-10T00:00:32.810 INFO:tasks.workunit.client.1.smithi183.stdout:0/626: rename d14/d1d/d55/d6e/f77 to d14/d7a/d63/fe7 0 2024-02-10T00:00:32.811 INFO:tasks.workunit.client.1.smithi183.stdout:2/771: dread d2/f4a [0,4194304] 0 2024-02-10T00:00:32.812 INFO:tasks.workunit.client.0.smithi164.stdout:0/271: dread f3 [0,4194304] 0 2024-02-10T00:00:32.812 INFO:tasks.workunit.client.1.smithi183.stdout:7/599: mknod d0/d2/d50/d5d/cb5 0 2024-02-10T00:00:32.814 INFO:tasks.workunit.client.0.smithi164.stdout:5/311: dwrite d7/d17/d21/f58 [0,4194304] 0 2024-02-10T00:00:32.815 INFO:tasks.workunit.client.1.smithi183.stdout:8/692: dread d0/d4e/d53/fa3 [0,4194304] 0 2024-02-10T00:00:32.815 INFO:tasks.workunit.client.1.smithi183.stdout:4/685: getdents de/d22 0 2024-02-10T00:00:32.815 INFO:tasks.workunit.client.1.smithi183.stdout:7/600: read d0/d2/d50/dad/f61 [525769,33053] 0 2024-02-10T00:00:32.817 INFO:tasks.workunit.client.1.smithi183.stdout:0/627: dwrite d14/d1d/d2d/d31/d6c/fae [0,4194304] 0 2024-02-10T00:00:32.817 INFO:tasks.workunit.client.1.smithi183.stdout:7/601: write d0/d2/d50/d5d/f78 [556348,120382] 0 2024-02-10T00:00:32.819 INFO:tasks.workunit.client.1.smithi183.stdout:8/693: fsync d0/d3f/db2/d24/f59 0 2024-02-10T00:00:32.821 INFO:tasks.workunit.client.0.smithi164.stdout:0/272: rename d6/d10/d18/d1c/c1e to d6/d10/d18/d2d/c59 0 2024-02-10T00:00:32.823 INFO:tasks.workunit.client.1.smithi183.stdout:0/628: dwrite d14/d7a/d63/f65 [0,4194304] 0 2024-02-10T00:00:32.825 INFO:tasks.workunit.client.1.smithi183.stdout:2/772: rename d2/da/d77/dc7/db5/d35 to d2/d2c/dab/d99/ddf/d105 0 2024-02-10T00:00:32.825 INFO:tasks.workunit.client.0.smithi164.stdout:0/273: rename d6/d10/d18/d2d/d35/d47/f50 to d6/d10/d18/d2d/f5a 0 2024-02-10T00:00:32.826 INFO:tasks.workunit.client.0.smithi164.stdout:0/274: write f1 [1680182,91162] 0 2024-02-10T00:00:32.827 INFO:tasks.workunit.client.1.smithi183.stdout:7/602: dwrite d0/f67 [0,4194304] 0 2024-02-10T00:00:32.827 INFO:tasks.workunit.client.1.smithi183.stdout:8/694: mknod d0/d3f/d94/cdf 0 2024-02-10T00:00:32.830 INFO:tasks.workunit.client.1.smithi183.stdout:1/571: dread d0/d3/fa4 [0,4194304] 0 2024-02-10T00:00:32.830 INFO:tasks.workunit.client.0.smithi164.stdout:0/275: dwrite d6/d10/d18/d2d/f51 [0,4194304] 0 2024-02-10T00:00:32.832 INFO:tasks.workunit.client.1.smithi183.stdout:0/629: dwrite d14/d1d/d55/fc2 [0,4194304] 0 2024-02-10T00:00:32.833 INFO:tasks.workunit.client.1.smithi183.stdout:7/603: creat d0/d11/d2f/fb6 x:0 0 0 2024-02-10T00:00:32.834 INFO:tasks.workunit.client.0.smithi164.stdout:9/299: sync 2024-02-10T00:00:32.834 INFO:tasks.workunit.client.0.smithi164.stdout:9/300: chown d6/de/d3b 117 1 2024-02-10T00:00:32.834 INFO:tasks.workunit.client.1.smithi183.stdout:8/695: unlink d0/d27/l29 0 2024-02-10T00:00:32.836 INFO:tasks.workunit.client.1.smithi183.stdout:1/572: mknod d0/d3c/ccd 0 2024-02-10T00:00:32.836 INFO:tasks.workunit.client.0.smithi164.stdout:9/301: creat d6/d1c/d24/f60 x:0 0 0 2024-02-10T00:00:32.837 INFO:tasks.workunit.client.0.smithi164.stdout:9/302: fdatasync d6/d1c/f1d 0 2024-02-10T00:00:32.838 INFO:tasks.workunit.client.1.smithi183.stdout:8/696: dwrite d0/d4e/f4f [0,4194304] 0 2024-02-10T00:00:32.838 INFO:tasks.workunit.client.1.smithi183.stdout:7/604: mknod d0/d2/d4/d8/d59/cb7 0 2024-02-10T00:00:32.844 INFO:tasks.workunit.client.1.smithi183.stdout:1/573: rename d0/f78 to d0/d3/d7/d36/d7c/db1/fce 0 2024-02-10T00:00:32.852 INFO:tasks.workunit.client.1.smithi183.stdout:8/697: rename d0/d3f/db2/d24/fd5 to d0/d27/d75/d5b/fe0 0 2024-02-10T00:00:32.852 INFO:tasks.workunit.client.1.smithi183.stdout:0/630: getdents d14/d1d/d59/d71/db4 0 2024-02-10T00:00:32.853 INFO:tasks.workunit.client.1.smithi183.stdout:0/631: write d14/d43/f78 [1126081,11780] 0 2024-02-10T00:00:32.854 INFO:tasks.workunit.client.1.smithi183.stdout:0/632: fsync d14/d1d/d2d/d31/d6c/f76 0 2024-02-10T00:00:32.855 INFO:tasks.workunit.client.1.smithi183.stdout:1/574: symlink d0/d3c/dc9/d86/lcf 0 2024-02-10T00:00:32.857 INFO:tasks.workunit.client.1.smithi183.stdout:8/698: creat d0/d4e/d53/fe1 x:0 0 0 2024-02-10T00:00:32.857 INFO:tasks.workunit.client.1.smithi183.stdout:0/633: symlink d14/d1d/d2d/d31/d6c/d70/le8 0 2024-02-10T00:00:32.858 INFO:tasks.workunit.client.1.smithi183.stdout:8/699: read - d0/d45/fa5 zero size 2024-02-10T00:00:32.859 INFO:tasks.workunit.client.1.smithi183.stdout:1/575: dwrite d0/d3/d7/f4a [0,4194304] 0 2024-02-10T00:00:32.859 INFO:tasks.workunit.client.1.smithi183.stdout:8/700: dread d0/d4e/d53/fa3 [0,4194304] 0 2024-02-10T00:00:32.860 INFO:tasks.workunit.client.1.smithi183.stdout:8/701: stat d0/d3f/db2/lcd 0 2024-02-10T00:00:32.863 INFO:tasks.workunit.client.1.smithi183.stdout:8/702: creat d0/d27/d75/d5b/fe2 x:0 0 0 2024-02-10T00:00:32.866 INFO:tasks.workunit.client.0.smithi164.stdout:6/386: sync 2024-02-10T00:00:32.868 INFO:tasks.workunit.client.0.smithi164.stdout:6/387: symlink d0/d3b/d56/l76 0 2024-02-10T00:00:32.868 INFO:tasks.workunit.client.0.smithi164.stdout:6/388: fdatasync d0/d6/d12/f5b 0 2024-02-10T00:00:32.872 INFO:tasks.workunit.client.0.smithi164.stdout:6/389: dwrite d0/d2b/d3a/f55 [0,4194304] 0 2024-02-10T00:00:32.875 INFO:tasks.workunit.client.0.smithi164.stdout:6/390: unlink d0/d6/d12/c49 0 2024-02-10T00:00:32.875 INFO:tasks.workunit.client.0.smithi164.stdout:6/391: fsync d0/d2b/d3a/d3d/f74 0 2024-02-10T00:00:32.879 INFO:tasks.workunit.client.0.smithi164.stdout:6/392: link d0/d2b/f39 d0/d6/d12/d45/f77 0 2024-02-10T00:00:32.880 INFO:tasks.workunit.client.0.smithi164.stdout:6/393: fsync d0/d6/d12/f1f 0 2024-02-10T00:00:32.893 INFO:tasks.workunit.client.1.smithi183.stdout:8/703: mkdir d0/d27/d36/de3 0 2024-02-10T00:00:32.895 INFO:tasks.workunit.client.1.smithi183.stdout:1/576: dwrite d0/d3/d7/d36/fa2 [0,4194304] 0 2024-02-10T00:00:32.897 INFO:tasks.workunit.client.1.smithi183.stdout:5/701: dread d4/dd/f14 [0,4194304] 0 2024-02-10T00:00:32.901 INFO:tasks.workunit.client.1.smithi183.stdout:5/702: rename d4/d23/d4a/d36/f5e to d4/fe4 0 2024-02-10T00:00:32.902 INFO:tasks.workunit.client.1.smithi183.stdout:7/605: sync 2024-02-10T00:00:32.902 INFO:tasks.workunit.client.1.smithi183.stdout:7/606: write d0/d11/d2f/fb6 [810724,824] 0 2024-02-10T00:00:32.903 INFO:tasks.workunit.client.1.smithi183.stdout:5/703: creat d4/d74/fe5 x:0 0 0 2024-02-10T00:00:32.906 INFO:tasks.workunit.client.1.smithi183.stdout:5/704: symlink d4/dd/d31/le6 0 2024-02-10T00:00:32.906 INFO:tasks.workunit.client.1.smithi183.stdout:8/704: read d0/d45/f66 [2818325,115702] 0 2024-02-10T00:00:32.907 INFO:tasks.workunit.client.1.smithi183.stdout:8/705: dread - d0/d3f/db2/d24/fbb zero size 2024-02-10T00:00:32.913 INFO:tasks.workunit.client.0.smithi164.stdout:3/268: truncate d0/d1/dd/f31 1934185 0 2024-02-10T00:00:32.913 INFO:tasks.workunit.client.0.smithi164.stdout:3/269: chown d0/d1/d3c/d3d 21585 1 2024-02-10T00:00:32.914 INFO:tasks.workunit.client.1.smithi183.stdout:1/577: truncate d0/d3/d7/d36/f25 1509569 0 2024-02-10T00:00:32.915 INFO:tasks.workunit.client.1.smithi183.stdout:1/578: rename d0/d3 to d0/d3/d7/d3d/d60/dc2/dd0 22 2024-02-10T00:00:32.916 INFO:tasks.workunit.client.0.smithi164.stdout:3/270: dread d0/d1/d2/d17/d37/f3a [0,4194304] 0 2024-02-10T00:00:32.917 INFO:tasks.workunit.client.1.smithi183.stdout:8/706: dwrite d0/d4e/fa1 [0,4194304] 0 2024-02-10T00:00:32.920 INFO:tasks.workunit.client.1.smithi183.stdout:8/707: mknod d0/d4e/da6/ce4 0 2024-02-10T00:00:32.921 INFO:tasks.workunit.client.0.smithi164.stdout:3/271: unlink d0/d1/dd/l1d 0 2024-02-10T00:00:32.921 INFO:tasks.workunit.client.0.smithi164.stdout:3/272: chown d0 999972728 1 2024-02-10T00:00:32.924 INFO:tasks.workunit.client.0.smithi164.stdout:4/275: truncate d2/d19/d16/d31/d57/f59 1238972 0 2024-02-10T00:00:32.924 INFO:tasks.workunit.client.1.smithi183.stdout:0/634: sync 2024-02-10T00:00:32.924 INFO:tasks.workunit.client.1.smithi183.stdout:1/579: dread d0/d3/d67/d70/f7d [0,4194304] 0 2024-02-10T00:00:32.924 INFO:tasks.workunit.client.1.smithi183.stdout:0/635: chown d14/d1d/d59/d3c 140991 1 2024-02-10T00:00:32.925 INFO:tasks.workunit.client.0.smithi164.stdout:2/311: truncate d3/fe 2090736 0 2024-02-10T00:00:32.925 INFO:tasks.workunit.client.1.smithi183.stdout:3/577: rename d7/db/d2a/d2d/d51/d78 to d7/db/d2a/d2d/d51/dab 0 2024-02-10T00:00:32.928 INFO:tasks.workunit.client.0.smithi164.stdout:4/276: creat d2/d2f/d37/d41/d3d/f64 x:0 0 0 2024-02-10T00:00:32.929 INFO:tasks.workunit.client.0.smithi164.stdout:2/312: creat d3/d26/d64/f75 x:0 0 0 2024-02-10T00:00:32.930 INFO:tasks.workunit.client.0.smithi164.stdout:4/277: read - d2/d19/d16/f1b zero size 2024-02-10T00:00:32.933 INFO:tasks.workunit.client.1.smithi183.stdout:3/578: creat d7/db/d2a/d33/d59/fac x:0 0 0 2024-02-10T00:00:32.933 INFO:tasks.workunit.client.1.smithi183.stdout:8/708: link d0/d3f/db2/d24/f69 d0/d45/d46/d81/fe5 0 2024-02-10T00:00:32.935 INFO:tasks.workunit.client.0.smithi164.stdout:4/278: truncate d2/d19/d16/d31/f4f 106223 0 2024-02-10T00:00:32.935 INFO:tasks.workunit.client.0.smithi164.stdout:4/279: fdatasync d2/d19/f48 0 2024-02-10T00:00:32.936 INFO:tasks.workunit.client.1.smithi183.stdout:1/580: dread d0/fc5 [0,4194304] 0 2024-02-10T00:00:32.937 INFO:tasks.workunit.client.0.smithi164.stdout:4/280: write d2/d2f/f51 [4833052,24562] 0 2024-02-10T00:00:32.937 INFO:tasks.workunit.client.0.smithi164.stdout:4/281: dread - d2/d19/d16/f53 zero size 2024-02-10T00:00:32.937 INFO:tasks.workunit.client.0.smithi164.stdout:2/313: dread d3/d32/d4e/d27/d2e/d36/f5d [0,4194304] 0 2024-02-10T00:00:32.938 INFO:tasks.workunit.client.0.smithi164.stdout:2/314: stat d3/d26/l2b 0 2024-02-10T00:00:32.938 INFO:tasks.workunit.client.1.smithi183.stdout:8/709: truncate d0/d3f/db2/fd6 164249 0 2024-02-10T00:00:32.938 INFO:tasks.workunit.client.1.smithi183.stdout:3/579: dwrite d7/db/d2a/f99 [0,4194304] 0 2024-02-10T00:00:32.939 INFO:tasks.workunit.client.1.smithi183.stdout:3/580: readlink d7/l32 0 2024-02-10T00:00:32.939 INFO:tasks.workunit.client.1.smithi183.stdout:8/710: write d0/d4e/f4f [2872635,72742] 0 2024-02-10T00:00:32.940 INFO:tasks.workunit.client.1.smithi183.stdout:3/581: stat d7/db/d2a/d2d/d51/d8f/ca6 0 2024-02-10T00:00:32.941 INFO:tasks.workunit.client.1.smithi183.stdout:8/711: write d0/d3f/d94/fd7 [954076,86028] 0 2024-02-10T00:00:32.941 INFO:tasks.workunit.client.1.smithi183.stdout:8/712: chown d0/d27/d75/d5b 26 1 2024-02-10T00:00:32.942 INFO:tasks.workunit.client.0.smithi164.stdout:4/282: dwrite d2/d2f/d37/d41/d3d/f52 [0,4194304] 0 2024-02-10T00:00:32.942 INFO:tasks.workunit.client.1.smithi183.stdout:8/713: chown d0/d27/f2e 0 1 2024-02-10T00:00:32.942 INFO:tasks.workunit.client.1.smithi183.stdout:8/714: fdatasync d0/d4e/d53/fe1 0 2024-02-10T00:00:32.943 INFO:tasks.workunit.client.1.smithi183.stdout:3/582: symlink d7/db/d2a/d2d/lad 0 2024-02-10T00:00:32.944 INFO:tasks.workunit.client.1.smithi183.stdout:3/583: write d7/db/d2a/d33/d59/d52/f64 [565779,34034] 0 2024-02-10T00:00:32.946 INFO:tasks.workunit.client.1.smithi183.stdout:7/607: dread d0/d11/d88/f91 [0,4194304] 0 2024-02-10T00:00:32.947 INFO:tasks.workunit.client.0.smithi164.stdout:4/283: rename d2/d19/c49 to d2/d19/d16/d31/c65 0 2024-02-10T00:00:32.951 INFO:tasks.workunit.client.1.smithi183.stdout:7/608: dwrite d0/d11/f82 [0,4194304] 0 2024-02-10T00:00:32.951 INFO:tasks.workunit.client.0.smithi164.stdout:4/284: link d2/f1a d2/d2f/d37/d41/d3d/d42/f66 0 2024-02-10T00:00:32.952 INFO:tasks.workunit.client.1.smithi183.stdout:7/609: chown d0/d11/d2f/d64/d6b 3191 1 2024-02-10T00:00:32.955 INFO:tasks.workunit.client.0.smithi164.stdout:0/276: dread d6/d7/d14/f1b [0,4194304] 0 2024-02-10T00:00:32.955 INFO:tasks.workunit.client.0.smithi164.stdout:4/285: rename d2/f1e to d2/d2f/d37/d41/d3d/d42/d5f/f67 0 2024-02-10T00:00:32.957 INFO:tasks.workunit.client.1.smithi183.stdout:2/773: dread d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:32.957 INFO:tasks.workunit.client.1.smithi183.stdout:6/544: truncate d2/f15 229108 0 2024-02-10T00:00:32.959 INFO:tasks.workunit.client.1.smithi183.stdout:6/545: write d2/d1a/d25/d3c/d31/d38/d87/f88 [3995790,50194] 0 2024-02-10T00:00:32.959 INFO:tasks.workunit.client.0.smithi164.stdout:3/273: sync 2024-02-10T00:00:32.960 INFO:tasks.workunit.client.0.smithi164.stdout:1/240: truncate d1/f9 916087 0 2024-02-10T00:00:32.960 INFO:tasks.workunit.client.1.smithi183.stdout:9/654: write d0/d3/d14/f20 [4933558,100468] 0 2024-02-10T00:00:32.961 INFO:tasks.workunit.client.1.smithi183.stdout:4/686: write de/d14/d27/d2e/f88 [1143024,68613] 0 2024-02-10T00:00:32.962 INFO:tasks.workunit.client.1.smithi183.stdout:4/687: write de/d14/d1d/d7b/fbb [963427,55481] 0 2024-02-10T00:00:32.963 INFO:tasks.workunit.client.0.smithi164.stdout:7/350: dwrite d3/f22 [0,4194304] 0 2024-02-10T00:00:32.969 INFO:tasks.workunit.client.1.smithi183.stdout:2/774: dread d2/d2c/dab/d99/fa3 [0,4194304] 0 2024-02-10T00:00:32.969 INFO:tasks.workunit.client.0.smithi164.stdout:8/272: write d2/fa [778615,54111] 0 2024-02-10T00:00:32.974 INFO:tasks.workunit.client.1.smithi183.stdout:2/775: read d2/da/d77/dc7/fd7 [2453871,113859] 0 2024-02-10T00:00:32.975 INFO:tasks.workunit.client.1.smithi183.stdout:5/705: write d4/d23/d3e/d80/da1/d9e/d89/f9b [15035,4660] 0 2024-02-10T00:00:32.976 INFO:tasks.workunit.client.0.smithi164.stdout:5/312: truncate d7/d17/d21/f58 3013404 0 2024-02-10T00:00:32.980 INFO:tasks.workunit.client.1.smithi183.stdout:0/636: write d14/f28 [1332557,71974] 0 2024-02-10T00:00:32.980 INFO:tasks.workunit.client.0.smithi164.stdout:9/303: truncate d6/d1c/d24/d4f/f5a 600725 0 2024-02-10T00:00:32.981 INFO:tasks.workunit.client.1.smithi183.stdout:1/581: write d0/f8a [719855,17552] 0 2024-02-10T00:00:32.982 INFO:tasks.workunit.client.1.smithi183.stdout:7/610: mkdir d0/d11/d2f/db8 0 2024-02-10T00:00:32.984 INFO:tasks.workunit.client.1.smithi183.stdout:6/546: fsync d2/d1a/d25/d3c/d31/d38/d3f/d5e/f7a 0 2024-02-10T00:00:32.985 INFO:tasks.workunit.client.1.smithi183.stdout:9/655: creat d0/d3/d14/d1c/d2d/fd5 x:0 0 0 2024-02-10T00:00:32.985 INFO:tasks.workunit.client.0.smithi164.stdout:6/394: dwrite d0/d2b/f39 [0,4194304] 0 2024-02-10T00:00:32.986 INFO:tasks.workunit.client.1.smithi183.stdout:7/611: dread d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:32.986 INFO:tasks.workunit.client.0.smithi164.stdout:7/351: rename d3/d28/c3c to d3/d28/d45/d4b/c7c 0 2024-02-10T00:00:32.987 INFO:tasks.workunit.client.1.smithi183.stdout:4/688: unlink de/d14/d4e/l53 0 2024-02-10T00:00:32.987 INFO:tasks.workunit.client.0.smithi164.stdout:4/286: mknod d2/d2f/d37/d41/d3d/d42/d47/c68 0 2024-02-10T00:00:32.990 INFO:tasks.workunit.client.1.smithi183.stdout:8/715: creat d0/d45/fe6 x:0 0 0 2024-02-10T00:00:32.990 INFO:tasks.workunit.client.0.smithi164.stdout:5/313: unlink d7/d17/d21/d24/l30 0 2024-02-10T00:00:32.992 INFO:tasks.workunit.client.1.smithi183.stdout:2/776: dread - d2/d2c/d2f/d60/d8d/d9c/da7/dd4/d79/ff9 zero size 2024-02-10T00:00:32.993 INFO:tasks.workunit.client.1.smithi183.stdout:5/706: fsync d4/d23/d3e/d80/da1/d9e/f7c 0 2024-02-10T00:00:32.993 INFO:tasks.workunit.client.0.smithi164.stdout:3/274: rmdir d0 39 2024-02-10T00:00:32.994 INFO:tasks.workunit.client.1.smithi183.stdout:5/707: write d4/d74/f7e [83825,49458] 0 2024-02-10T00:00:32.994 INFO:tasks.workunit.client.1.smithi183.stdout:3/584: truncate d7/db/d2a/f79 320705 0 2024-02-10T00:00:32.995 INFO:tasks.workunit.client.1.smithi183.stdout:5/708: dread - d4/d23/d3e/d80/da1/d9c/d72/da0/da9/fe3 zero size 2024-02-10T00:00:32.995 INFO:tasks.workunit.client.1.smithi183.stdout:0/637: stat d14/d1d/d96/da0/la2 0 2024-02-10T00:00:32.996 INFO:tasks.workunit.client.0.smithi164.stdout:6/395: symlink d0/d2b/d3a/d3d/l78 0 2024-02-10T00:00:32.996 INFO:tasks.workunit.client.1.smithi183.stdout:0/638: write d14/f17 [1171267,108289] 0 2024-02-10T00:00:32.998 INFO:tasks.workunit.client.1.smithi183.stdout:6/547: mknod d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/c9e 0 2024-02-10T00:00:32.998 INFO:tasks.workunit.client.0.smithi164.stdout:8/273: rename d2/fa to d2/d12/d21/d31/d32/d44/f4c 0 2024-02-10T00:00:32.999 INFO:tasks.workunit.client.0.smithi164.stdout:7/352: rmdir d3/d11/d39/d44/d6f/d75 39 2024-02-10T00:00:32.999 INFO:tasks.workunit.client.1.smithi183.stdout:9/656: mkdir d0/d3/d14/d1c/d2d/d4f/d79/dd6 0 2024-02-10T00:00:33.000 INFO:tasks.workunit.client.1.smithi183.stdout:1/582: dwrite d0/fc5 [0,4194304] 0 2024-02-10T00:00:33.006 INFO:tasks.workunit.client.0.smithi164.stdout:4/287: chown d2/d19/l24 19 1 2024-02-10T00:00:33.007 INFO:tasks.workunit.client.1.smithi183.stdout:4/689: chown de/d19/c3b 3646 1 2024-02-10T00:00:33.009 INFO:tasks.workunit.client.0.smithi164.stdout:6/396: mkdir d0/d2b/d3a/d3d/d42/d5d/d79 0 2024-02-10T00:00:33.010 INFO:tasks.workunit.client.1.smithi183.stdout:3/585: creat d7/db/d2a/d8e/fae x:0 0 0 2024-02-10T00:00:33.011 INFO:tasks.workunit.client.1.smithi183.stdout:4/690: dwrite de/d14/da4/fa9 [0,4194304] 0 2024-02-10T00:00:33.012 INFO:tasks.workunit.client.1.smithi183.stdout:3/586: write d7/db/d2a/d1c/f27 [3402718,69718] 0 2024-02-10T00:00:33.013 INFO:tasks.workunit.client.0.smithi164.stdout:1/241: dread d1/d1a/d41/fe [0,4194304] 0 2024-02-10T00:00:33.017 INFO:tasks.workunit.client.1.smithi183.stdout:6/548: mknod d2/d1a/d25/d3c/c9f 0 2024-02-10T00:00:33.018 INFO:tasks.workunit.client.0.smithi164.stdout:0/277: truncate d6/d7/d14/f1b 597876 0 2024-02-10T00:00:33.019 INFO:tasks.workunit.client.1.smithi183.stdout:1/583: write d0/d3/d67/d70/f81 [988512,47575] 0 2024-02-10T00:00:33.020 INFO:tasks.workunit.client.1.smithi183.stdout:8/716: mkdir d0/d4e/da6/dde/de7 0 2024-02-10T00:00:33.021 INFO:tasks.workunit.client.0.smithi164.stdout:8/274: dread d2/f3d [0,4194304] 0 2024-02-10T00:00:33.021 INFO:tasks.workunit.client.0.smithi164.stdout:4/288: rmdir d2/d19 39 2024-02-10T00:00:33.022 INFO:tasks.workunit.client.1.smithi183.stdout:2/777: unlink d2/d2c/dba/df0/l84 0 2024-02-10T00:00:33.022 INFO:tasks.workunit.client.0.smithi164.stdout:9/304: dwrite d6/de/d40/f46 [0,4194304] 0 2024-02-10T00:00:33.025 INFO:tasks.workunit.client.1.smithi183.stdout:5/709: symlink d4/d23/d3e/d80/da1/d9e/d27/le7 0 2024-02-10T00:00:33.026 INFO:tasks.workunit.client.1.smithi183.stdout:4/691: creat de/fd8 x:0 0 0 2024-02-10T00:00:33.027 INFO:tasks.workunit.client.1.smithi183.stdout:4/692: dread - de/d19/d1c/d61/dab/fbe zero size 2024-02-10T00:00:33.027 INFO:tasks.workunit.client.1.smithi183.stdout:7/612: creat d0/d2/d4/fb9 x:0 0 0 2024-02-10T00:00:33.028 INFO:tasks.workunit.client.1.smithi183.stdout:7/613: write d0/d11/d3e/f6d [3780731,116608] 0 2024-02-10T00:00:33.029 INFO:tasks.workunit.client.0.smithi164.stdout:6/397: creat d0/d6/d12/d43/f7a x:0 0 0 2024-02-10T00:00:33.032 INFO:tasks.workunit.client.1.smithi183.stdout:6/549: unlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c6d 0 2024-02-10T00:00:33.032 INFO:tasks.workunit.client.0.smithi164.stdout:5/314: creat d7/d17/d21/d23/f5f x:0 0 0 2024-02-10T00:00:33.032 INFO:tasks.workunit.client.0.smithi164.stdout:2/315: dread d3/fe [0,4194304] 0 2024-02-10T00:00:33.034 INFO:tasks.workunit.client.0.smithi164.stdout:8/275: rmdir d2/d12/d21/d31/d32 39 2024-02-10T00:00:33.034 INFO:tasks.workunit.client.1.smithi183.stdout:5/710: mknod d4/d23/dc4/ce8 0 2024-02-10T00:00:33.035 INFO:tasks.workunit.client.0.smithi164.stdout:5/315: dread d7/d17/d21/f58 [0,4194304] 0 2024-02-10T00:00:33.035 INFO:tasks.workunit.client.0.smithi164.stdout:9/305: rmdir d6/de 39 2024-02-10T00:00:33.036 INFO:tasks.workunit.client.0.smithi164.stdout:5/316: read d7/d17/d21/d23/f2d [52691,27422] 0 2024-02-10T00:00:33.036 INFO:tasks.workunit.client.0.smithi164.stdout:9/306: dread - d6/d1c/d24/f5c zero size 2024-02-10T00:00:33.037 INFO:tasks.workunit.client.1.smithi183.stdout:4/693: chown de/d22/laa 12 1 2024-02-10T00:00:33.037 INFO:tasks.workunit.client.0.smithi164.stdout:3/275: link d0/d1/dd/f1f d0/d1/dd/f52 0 2024-02-10T00:00:33.038 INFO:tasks.workunit.client.1.smithi183.stdout:2/778: dwrite d2/da/d77/dc7/fd7 [4194304,4194304] 0 2024-02-10T00:00:33.039 INFO:tasks.workunit.client.0.smithi164.stdout:6/398: creat d0/d6/d12/d57/f7b x:0 0 0 2024-02-10T00:00:33.039 INFO:tasks.workunit.client.0.smithi164.stdout:6/399: stat d0/d6/d12/d43/f44 0 2024-02-10T00:00:33.040 INFO:tasks.workunit.client.1.smithi183.stdout:7/614: symlink d0/d11/d88/db1/lba 0 2024-02-10T00:00:33.047 INFO:tasks.workunit.client.0.smithi164.stdout:7/353: getdents d3/d28/d45 0 2024-02-10T00:00:33.048 INFO:tasks.workunit.client.0.smithi164.stdout:1/242: unlink d1/d13/d2b/d52/c46 0 2024-02-10T00:00:33.053 INFO:tasks.workunit.client.1.smithi183.stdout:2/779: link d2/da/d5b/f8a d2/da/d20/d21/df2/f106 0 2024-02-10T00:00:33.053 INFO:tasks.workunit.client.0.smithi164.stdout:7/354: creat d3/d11/d39/d3a/f7d x:0 0 0 2024-02-10T00:00:33.054 INFO:tasks.workunit.client.0.smithi164.stdout:7/355: write d3/d28/f61 [748427,95237] 0 2024-02-10T00:00:33.055 INFO:tasks.workunit.client.1.smithi183.stdout:7/615: symlink d0/d2/d4/lbb 0 2024-02-10T00:00:33.055 INFO:tasks.workunit.client.0.smithi164.stdout:1/243: unlink d1/d1a/f39 0 2024-02-10T00:00:33.056 INFO:tasks.workunit.client.0.smithi164.stdout:9/307: mkdir d6/de/d2b/d5b/d61 0 2024-02-10T00:00:33.056 INFO:tasks.workunit.client.1.smithi183.stdout:0/639: truncate d14/d1d/d2d/d31/d6c/fae 4867268 0 2024-02-10T00:00:33.059 INFO:tasks.workunit.client.1.smithi183.stdout:2/780: dwrite d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:33.059 INFO:tasks.workunit.client.1.smithi183.stdout:4/694: truncate de/d19/d20/f5d 686041 0 2024-02-10T00:00:33.059 INFO:tasks.workunit.client.1.smithi183.stdout:8/717: fsync d0/d3f/db2/fd6 0 2024-02-10T00:00:33.059 INFO:tasks.workunit.client.0.smithi164.stdout:7/356: dwrite d3/d11/d39/d3a/f7d [0,4194304] 0 2024-02-10T00:00:33.060 INFO:tasks.workunit.client.0.smithi164.stdout:7/357: write d3/d28/f3b [1147335,87792] 0 2024-02-10T00:00:33.061 INFO:tasks.workunit.client.1.smithi183.stdout:2/781: fdatasync d2/d8b/fb3 0 2024-02-10T00:00:33.061 INFO:tasks.workunit.client.1.smithi183.stdout:4/695: fsync de/d19/f69 0 2024-02-10T00:00:33.062 INFO:tasks.workunit.client.1.smithi183.stdout:1/584: truncate d0/fc5 2947642 0 2024-02-10T00:00:33.063 INFO:tasks.workunit.client.1.smithi183.stdout:9/657: dwrite d0/d3/d14/d3c/f60 [0,4194304] 0 2024-02-10T00:00:33.065 INFO:tasks.workunit.client.0.smithi164.stdout:4/289: truncate d2/d2f/f21 2098412 0 2024-02-10T00:00:33.065 INFO:tasks.workunit.client.1.smithi183.stdout:6/550: truncate d2/d1a/d25/d3c/d31/d38/d3f/f4d 600173 0 2024-02-10T00:00:33.065 INFO:tasks.workunit.client.1.smithi183.stdout:7/616: dwrite d0/d2/d50/d5d/f55 [0,4194304] 0 2024-02-10T00:00:33.067 INFO:tasks.workunit.client.0.smithi164.stdout:8/276: write d2/f7 [1240867,79026] 0 2024-02-10T00:00:33.068 INFO:tasks.workunit.client.0.smithi164.stdout:2/316: dread d3/d32/d4e/d27/f2c [0,4194304] 0 2024-02-10T00:00:33.069 INFO:tasks.workunit.client.1.smithi183.stdout:3/587: dwrite d7/db/d2a/d8e/da0/fa8 [0,4194304] 0 2024-02-10T00:00:33.069 INFO:tasks.workunit.client.1.smithi183.stdout:6/551: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b 492 1 2024-02-10T00:00:33.071 INFO:tasks.workunit.client.1.smithi183.stdout:4/696: dread de/d14/d27/d2e/f4d [0,4194304] 0 2024-02-10T00:00:33.075 INFO:tasks.workunit.client.0.smithi164.stdout:5/317: link d7/d17/d21/d23/d37/d36/l50 d7/d15/d1f/d59/l60 0 2024-02-10T00:00:33.075 INFO:tasks.workunit.client.0.smithi164.stdout:3/276: getdents d0/d1/d3c/d3d/d51 0 2024-02-10T00:00:33.076 INFO:tasks.workunit.client.0.smithi164.stdout:6/400: getdents d0/d2b/d3a/d3d 0 2024-02-10T00:00:33.077 INFO:tasks.workunit.client.1.smithi183.stdout:5/711: rename d4/dd/f54 to d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/fe9 0 2024-02-10T00:00:33.077 INFO:tasks.workunit.client.1.smithi183.stdout:8/718: creat d0/d31/fe8 x:0 0 0 2024-02-10T00:00:33.077 INFO:tasks.workunit.client.0.smithi164.stdout:3/277: stat d0/d1/d2/d17/l4d 0 2024-02-10T00:00:33.078 INFO:tasks.workunit.client.1.smithi183.stdout:1/585: rmdir d0/d3/d7/d3d/d99 39 2024-02-10T00:00:33.078 INFO:tasks.workunit.client.1.smithi183.stdout:2/782: fsync d2/d2c/f86 0 2024-02-10T00:00:33.081 INFO:tasks.workunit.client.1.smithi183.stdout:0/640: dwrite d14/d1d/d2d/f8a [4194304,4194304] 0 2024-02-10T00:00:33.082 INFO:tasks.workunit.client.1.smithi183.stdout:7/617: symlink d0/d2/d4/d8/d59/d8a/lbc 0 2024-02-10T00:00:33.084 INFO:tasks.workunit.client.1.smithi183.stdout:6/552: unlink d2/d1a/d25/d3c/d31/d38/f85 0 2024-02-10T00:00:33.086 INFO:tasks.workunit.client.0.smithi164.stdout:7/358: symlink d3/d11/d39/d44/d48/l7e 0 2024-02-10T00:00:33.087 INFO:tasks.workunit.client.0.smithi164.stdout:7/359: stat d3/d5/d2b/d4a 0 2024-02-10T00:00:33.087 INFO:tasks.workunit.client.1.smithi183.stdout:4/697: unlink de/d19/d20/f6d 0 2024-02-10T00:00:33.087 INFO:tasks.workunit.client.1.smithi183.stdout:4/698: stat de/d22/f28 0 2024-02-10T00:00:33.087 INFO:tasks.workunit.client.0.smithi164.stdout:7/360: write d3/d28/f35 [8815919,92659] 0 2024-02-10T00:00:33.091 INFO:tasks.workunit.client.1.smithi183.stdout:9/658: symlink d0/d3/d14/d1c/d2d/d4f/db8/ld7 0 2024-02-10T00:00:33.092 INFO:tasks.workunit.client.0.smithi164.stdout:8/277: rename d2/d12/d21/d31/d32/d44 to d2/d12/d21/d31/d32/d4d 0 2024-02-10T00:00:33.092 INFO:tasks.workunit.client.1.smithi183.stdout:2/783: symlink d2/da/d20/d21/d43/l107 0 2024-02-10T00:00:33.092 INFO:tasks.workunit.client.0.smithi164.stdout:9/308: dread d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:33.093 INFO:tasks.workunit.client.0.smithi164.stdout:7/361: fsync d3/d4d/f55 0 2024-02-10T00:00:33.093 INFO:tasks.workunit.client.0.smithi164.stdout:9/309: stat d6/de/d2b/f3c 0 2024-02-10T00:00:33.094 INFO:tasks.workunit.client.1.smithi183.stdout:0/641: creat d14/d1d/d96/da0/fe9 x:0 0 0 2024-02-10T00:00:33.094 INFO:tasks.workunit.client.0.smithi164.stdout:2/317: getdents d3 0 2024-02-10T00:00:33.094 INFO:tasks.workunit.client.1.smithi183.stdout:0/642: write d14/d1d/d59/d71/d22/f48 [4200935,104391] 0 2024-02-10T00:00:33.095 INFO:tasks.workunit.client.0.smithi164.stdout:8/278: symlink d2/d12/d21/l4e 0 2024-02-10T00:00:33.095 INFO:tasks.workunit.client.1.smithi183.stdout:0/643: write d14/d43/fb7 [811589,81969] 0 2024-02-10T00:00:33.096 INFO:tasks.workunit.client.0.smithi164.stdout:9/310: write d6/d1c/f2e [3645297,33044] 0 2024-02-10T00:00:33.096 INFO:tasks.workunit.client.1.smithi183.stdout:0/644: write d14/d1d/d59/d71/d22/f48 [2987668,25516] 0 2024-02-10T00:00:33.097 INFO:tasks.workunit.client.0.smithi164.stdout:9/311: readlink d6/de/d22/l4e 0 2024-02-10T00:00:33.097 INFO:tasks.workunit.client.1.smithi183.stdout:1/586: creat d0/d3/d7/d3d/dcb/fd1 x:0 0 0 2024-02-10T00:00:33.098 INFO:tasks.workunit.client.1.smithi183.stdout:1/587: fdatasync d0/d3/d7/f4a 0 2024-02-10T00:00:33.099 INFO:tasks.workunit.client.1.smithi183.stdout:9/659: creat d0/d3/d14/d1c/d4b/d97/daa/fd8 x:0 0 0 2024-02-10T00:00:33.100 INFO:tasks.workunit.client.1.smithi183.stdout:9/660: dread - d0/d3/d14/d1c/d4b/d97/daa/dcf/fd1 zero size 2024-02-10T00:00:33.100 INFO:tasks.workunit.client.1.smithi183.stdout:2/784: creat d2/da/d77/f108 x:0 0 0 2024-02-10T00:00:33.100 INFO:tasks.workunit.client.0.smithi164.stdout:9/312: rename d6/de/c16 to d6/d1c/d24/c62 0 2024-02-10T00:00:33.101 INFO:tasks.workunit.client.1.smithi183.stdout:9/661: chown d0/d3/d14/d1c/l84 26 1 2024-02-10T00:00:33.101 INFO:tasks.workunit.client.0.smithi164.stdout:7/362: link d3/d5/l1c d3/d28/d45/d4b/l7f 0 2024-02-10T00:00:33.101 INFO:tasks.workunit.client.0.smithi164.stdout:2/318: dread d3/d32/d4e/d27/f2d [0,4194304] 0 2024-02-10T00:00:33.102 INFO:tasks.workunit.client.0.smithi164.stdout:9/313: dread d6/f3e [0,4194304] 0 2024-02-10T00:00:33.102 INFO:tasks.workunit.client.1.smithi183.stdout:6/553: mkdir d2/da0 0 2024-02-10T00:00:33.103 INFO:tasks.workunit.client.1.smithi183.stdout:4/699: mknod de/d19/cd9 0 2024-02-10T00:00:33.104 INFO:tasks.workunit.client.0.smithi164.stdout:2/319: symlink d3/l76 0 2024-02-10T00:00:33.104 INFO:tasks.workunit.client.0.smithi164.stdout:8/279: link d2/l1f d2/l4f 0 2024-02-10T00:00:33.104 INFO:tasks.workunit.client.0.smithi164.stdout:2/320: fdatasync d3/f4a 0 2024-02-10T00:00:33.105 INFO:tasks.workunit.client.1.smithi183.stdout:5/712: creat d4/dd/fea x:0 0 0 2024-02-10T00:00:33.105 INFO:tasks.workunit.client.0.smithi164.stdout:7/363: symlink d3/d4d/d5d/l80 0 2024-02-10T00:00:33.105 INFO:tasks.workunit.client.1.smithi183.stdout:0/645: chown d14/d1d/d55/d6e/d74 403875 1 2024-02-10T00:00:33.106 INFO:tasks.workunit.client.0.smithi164.stdout:7/364: chown d3/d28/c73 912383178 1 2024-02-10T00:00:33.106 INFO:tasks.workunit.client.0.smithi164.stdout:9/314: mknod d6/de/d22/d58/c63 0 2024-02-10T00:00:33.106 INFO:tasks.workunit.client.1.smithi183.stdout:1/588: creat d0/d3/d67/fd2 x:0 0 0 2024-02-10T00:00:33.107 INFO:tasks.workunit.client.1.smithi183.stdout:8/719: truncate d0/d10/d9e/da4/fd2 818106 0 2024-02-10T00:00:33.108 INFO:tasks.workunit.client.1.smithi183.stdout:7/618: creat d0/fbd x:0 0 0 2024-02-10T00:00:33.109 INFO:tasks.workunit.client.1.smithi183.stdout:7/619: write d0/fbd [965117,78063] 0 2024-02-10T00:00:33.109 INFO:tasks.workunit.client.0.smithi164.stdout:0/278: sync 2024-02-10T00:00:33.110 INFO:tasks.workunit.client.0.smithi164.stdout:8/280: dwrite d2/d12/d21/d31/d32/f3e [0,4194304] 0 2024-02-10T00:00:33.110 INFO:tasks.workunit.client.0.smithi164.stdout:2/321: dread d3/d32/d4e/d27/d2e/d36/d54/f55 [0,4194304] 0 2024-02-10T00:00:33.111 INFO:tasks.workunit.client.1.smithi183.stdout:5/713: mkdir d4/d23/d3e/d80/da1/d9e/d89/dd4/deb 0 2024-02-10T00:00:33.112 INFO:tasks.workunit.client.0.smithi164.stdout:2/322: mknod d3/c77 0 2024-02-10T00:00:33.115 INFO:tasks.workunit.client.1.smithi183.stdout:2/785: creat d2/d2c/d104/f109 x:0 0 0 2024-02-10T00:00:33.116 INFO:tasks.workunit.client.1.smithi183.stdout:6/554: mknod d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/ca1 0 2024-02-10T00:00:33.117 INFO:tasks.workunit.client.0.smithi164.stdout:0/279: creat d6/d10/d18/f5b x:0 0 0 2024-02-10T00:00:33.119 INFO:tasks.workunit.client.1.smithi183.stdout:7/620: dread d0/d11/d9d/faf [0,4194304] 0 2024-02-10T00:00:33.121 INFO:tasks.workunit.client.1.smithi183.stdout:8/720: fdatasync d0/d45/d46/d81/fe5 0 2024-02-10T00:00:33.124 INFO:tasks.workunit.client.1.smithi183.stdout:5/714: symlink d4/dd/d31/lec 0 2024-02-10T00:00:33.124 INFO:tasks.workunit.client.1.smithi183.stdout:8/721: dwrite d0/d45/d46/d81/fa7 [0,4194304] 0 2024-02-10T00:00:33.125 INFO:tasks.workunit.client.1.smithi183.stdout:1/589: rmdir d0/d3c/dc9/d86/dc1 0 2024-02-10T00:00:33.125 INFO:tasks.workunit.client.0.smithi164.stdout:5/318: dread d7/d17/d21/d23/f2d [0,4194304] 0 2024-02-10T00:00:33.126 INFO:tasks.workunit.client.1.smithi183.stdout:8/722: chown d0/d4e/d6b 28 1 2024-02-10T00:00:33.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/662: getdents d0/d3/d14/d1c/d4b/d51 0 2024-02-10T00:00:33.127 INFO:tasks.workunit.client.1.smithi183.stdout:8/723: chown d0/d3f/d94 73664336 1 2024-02-10T00:00:33.128 INFO:tasks.workunit.client.0.smithi164.stdout:5/319: creat d7/d15/d1f/f61 x:0 0 0 2024-02-10T00:00:33.128 INFO:tasks.workunit.client.1.smithi183.stdout:9/663: stat d0/d3/d14/d74/da8 0 2024-02-10T00:00:33.128 INFO:tasks.workunit.client.0.smithi164.stdout:5/320: read - d7/d15/d1f/f61 zero size 2024-02-10T00:00:33.129 INFO:tasks.workunit.client.1.smithi183.stdout:6/555: creat d2/d1a/d25/d3c/d31/d38/d3f/d94/fa2 x:0 0 0 2024-02-10T00:00:33.129 INFO:tasks.workunit.client.1.smithi183.stdout:5/715: dread d4/d23/d3e/d80/da1/d9e/d89/f9b [0,4194304] 0 2024-02-10T00:00:33.131 INFO:tasks.workunit.client.1.smithi183.stdout:8/724: write d0/d10/f1a [1373342,91256] 0 2024-02-10T00:00:33.131 INFO:tasks.workunit.client.1.smithi183.stdout:5/716: stat d4/d23/d3e/d80/da1/d9e/d27/d9d/laa 0 2024-02-10T00:00:33.132 INFO:tasks.workunit.client.0.smithi164.stdout:5/321: creat d7/f62 x:0 0 0 2024-02-10T00:00:33.132 INFO:tasks.workunit.client.1.smithi183.stdout:7/621: creat d0/d2/d4/fbe x:0 0 0 2024-02-10T00:00:33.134 INFO:tasks.workunit.client.1.smithi183.stdout:5/717: write d4/d23/d3e/d80/da1/d9e/d27/fca [1047393,4172] 0 2024-02-10T00:00:33.134 INFO:tasks.workunit.client.0.smithi164.stdout:5/322: chown d7/f19 344268 1 2024-02-10T00:00:33.134 INFO:tasks.workunit.client.1.smithi183.stdout:6/556: dread d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:33.134 INFO:tasks.workunit.client.1.smithi183.stdout:9/664: rename d0/d3/d14/d1c/d2d/d4f/c9d to d0/d92/db7/cd9 0 2024-02-10T00:00:33.136 INFO:tasks.workunit.client.0.smithi164.stdout:5/323: mknod d7/d17/d21/d5d/c63 0 2024-02-10T00:00:33.140 INFO:tasks.workunit.client.0.smithi164.stdout:5/324: creat d7/d17/d21/d24/f64 x:0 0 0 2024-02-10T00:00:33.142 INFO:tasks.workunit.client.1.smithi183.stdout:6/557: rmdir d2/d1a 39 2024-02-10T00:00:33.142 INFO:tasks.workunit.client.1.smithi183.stdout:8/725: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:33.143 INFO:tasks.workunit.client.1.smithi183.stdout:8/726: chown d0/d45/d46/c5f 2 1 2024-02-10T00:00:33.144 INFO:tasks.workunit.client.1.smithi183.stdout:1/590: truncate d0/d3/d7/d3d/d60/f9b 54065 0 2024-02-10T00:00:33.144 INFO:tasks.workunit.client.0.smithi164.stdout:9/315: dread d6/de/f11 [0,4194304] 0 2024-02-10T00:00:33.148 INFO:tasks.workunit.client.0.smithi164.stdout:9/316: symlink d6/de/d22/l64 0 2024-02-10T00:00:33.148 INFO:tasks.workunit.client.1.smithi183.stdout:5/718: mkdir d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded 0 2024-02-10T00:00:33.148 INFO:tasks.workunit.client.0.smithi164.stdout:1/244: write d1/fd [2403608,123857] 0 2024-02-10T00:00:33.149 INFO:tasks.workunit.client.1.smithi183.stdout:7/622: truncate d0/d11/d2f/d64/d6b/f86 817962 0 2024-02-10T00:00:33.149 INFO:tasks.workunit.client.0.smithi164.stdout:6/401: write d0/f21 [1094167,69009] 0 2024-02-10T00:00:33.150 INFO:tasks.workunit.client.0.smithi164.stdout:3/278: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:33.150 INFO:tasks.workunit.client.1.smithi183.stdout:1/591: mknod d0/d3/d67/d70/dae/cd3 0 2024-02-10T00:00:33.152 INFO:tasks.workunit.client.0.smithi164.stdout:8/281: rename d2/d12/d21 to d2/d50 0 2024-02-10T00:00:33.152 INFO:tasks.workunit.client.1.smithi183.stdout:6/558: mknod d2/d1a/d25/d3c/d31/ca3 0 2024-02-10T00:00:33.152 INFO:tasks.workunit.client.0.smithi164.stdout:0/280: rename d6/d10/d18/d2d/d35 to d6/d10/d18/d2d/d35/d44/d5c 22 2024-02-10T00:00:33.153 INFO:tasks.workunit.client.0.smithi164.stdout:4/290: dwrite d2/d19/d16/d31/f4d [0,4194304] 0 2024-02-10T00:00:33.154 INFO:tasks.workunit.client.1.smithi183.stdout:5/719: dwrite d4/d23/d4a/fbb [0,4194304] 0 2024-02-10T00:00:33.154 INFO:tasks.workunit.client.1.smithi183.stdout:4/700: dread de/d19/d20/f5d [0,4194304] 0 2024-02-10T00:00:33.159 INFO:tasks.workunit.client.1.smithi183.stdout:3/588: dread d7/db/d2a/d1c/f27 [0,4194304] 0 2024-02-10T00:00:33.159 INFO:tasks.workunit.client.0.smithi164.stdout:9/317: creat d6/de/d2b/f65 x:0 0 0 2024-02-10T00:00:33.159 INFO:tasks.workunit.client.0.smithi164.stdout:9/318: fsync d6/f20 0 2024-02-10T00:00:33.160 INFO:tasks.workunit.client.1.smithi183.stdout:3/589: dread - d7/db/d2a/d4d/d63/f9f zero size 2024-02-10T00:00:33.160 INFO:tasks.workunit.client.0.smithi164.stdout:9/319: fdatasync d6/d1c/d24/f4a 0 2024-02-10T00:00:33.161 INFO:tasks.workunit.client.0.smithi164.stdout:9/320: readlink d6/de/d22/l4e 0 2024-02-10T00:00:33.161 INFO:tasks.workunit.client.0.smithi164.stdout:6/402: symlink d0/d6/d12/d14/d4b/l7c 0 2024-02-10T00:00:33.161 INFO:tasks.workunit.client.0.smithi164.stdout:9/321: chown d6/de/d40/f56 54 1 2024-02-10T00:00:33.162 INFO:tasks.workunit.client.1.smithi183.stdout:4/701: dread de/d22/f25 [4194304,4194304] 0 2024-02-10T00:00:33.162 INFO:tasks.workunit.client.0.smithi164.stdout:6/403: write d0/d6/d12/f5b [729823,73060] 0 2024-02-10T00:00:33.163 INFO:tasks.workunit.client.0.smithi164.stdout:9/322: read d6/d1c/f32 [642247,118472] 0 2024-02-10T00:00:33.163 INFO:tasks.workunit.client.0.smithi164.stdout:6/404: readlink d0/d2b/l31 0 2024-02-10T00:00:33.164 INFO:tasks.workunit.client.1.smithi183.stdout:1/592: read d0/d3/d67/f2f [631076,101811] 0 2024-02-10T00:00:33.164 INFO:tasks.workunit.client.0.smithi164.stdout:2/323: dread d3/d32/d4e/d27/f4c [0,4194304] 0 2024-02-10T00:00:33.165 INFO:tasks.workunit.client.0.smithi164.stdout:5/325: rename d7/d15/d1f/c34 to d7/d15/c65 0 2024-02-10T00:00:33.165 INFO:tasks.workunit.client.0.smithi164.stdout:9/323: dread d6/de/f49 [0,4194304] 0 2024-02-10T00:00:33.165 INFO:tasks.workunit.client.0.smithi164.stdout:5/326: chown l6 12550836 1 2024-02-10T00:00:33.165 INFO:tasks.workunit.client.0.smithi164.stdout:4/291: mkdir d2/d2f/d37/d41/d69 0 2024-02-10T00:00:33.168 INFO:tasks.workunit.client.1.smithi183.stdout:0/646: truncate d14/d1d/f2b 1587328 0 2024-02-10T00:00:33.169 INFO:tasks.workunit.client.1.smithi183.stdout:2/786: write d2/da/d20/d21/d36/f6e [1282951,95253] 0 2024-02-10T00:00:33.169 INFO:tasks.workunit.client.0.smithi164.stdout:1/245: symlink d1/d23/d37/l53 0 2024-02-10T00:00:33.169 INFO:tasks.workunit.client.0.smithi164.stdout:8/282: dread d2/f41 [0,4194304] 0 2024-02-10T00:00:33.169 INFO:tasks.workunit.client.1.smithi183.stdout:1/593: read d0/f8a [542463,23478] 0 2024-02-10T00:00:33.172 INFO:tasks.workunit.client.0.smithi164.stdout:6/405: creat d0/d6/d4d/f7d x:0 0 0 2024-02-10T00:00:33.172 INFO:tasks.workunit.client.1.smithi183.stdout:4/702: read de/d22/f28 [878940,8787] 0 2024-02-10T00:00:33.172 INFO:tasks.workunit.client.0.smithi164.stdout:2/324: symlink d3/d32/d4e/l78 0 2024-02-10T00:00:33.175 INFO:tasks.workunit.client.1.smithi183.stdout:8/727: rename d0/d27/d36/d7f to d0/d3f/db2/de9 0 2024-02-10T00:00:33.176 INFO:tasks.workunit.client.0.smithi164.stdout:7/365: sync 2024-02-10T00:00:33.179 INFO:tasks.workunit.client.0.smithi164.stdout:8/283: creat d2/d50/f51 x:0 0 0 2024-02-10T00:00:33.180 INFO:tasks.workunit.client.1.smithi183.stdout:5/720: fdatasync d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/f78 0 2024-02-10T00:00:33.180 INFO:tasks.workunit.client.0.smithi164.stdout:8/284: chown d2/f27 1626314201 1 2024-02-10T00:00:33.180 INFO:tasks.workunit.client.1.smithi183.stdout:9/665: dwrite d0/d10/f7c [0,4194304] 0 2024-02-10T00:00:33.180 INFO:tasks.workunit.client.1.smithi183.stdout:5/721: stat d4/d23/d4a/d36/l77 0 2024-02-10T00:00:33.181 INFO:tasks.workunit.client.0.smithi164.stdout:8/285: read d2/f7 [514067,3771] 0 2024-02-10T00:00:33.181 INFO:tasks.workunit.client.1.smithi183.stdout:5/722: stat d4/d23/d4a/d36/l77 0 2024-02-10T00:00:33.182 INFO:tasks.workunit.client.1.smithi183.stdout:5/723: fdatasync d4/dd/d31/f83 0 2024-02-10T00:00:33.183 INFO:tasks.workunit.client.0.smithi164.stdout:2/325: creat d3/d24/d51/f79 x:0 0 0 2024-02-10T00:00:33.184 INFO:tasks.workunit.client.0.smithi164.stdout:5/327: unlink d7/d15/c4d 0 2024-02-10T00:00:33.187 INFO:tasks.workunit.client.1.smithi183.stdout:2/787: rmdir d2/d2c/d2f/d60/d8d/d9c/da7 39 2024-02-10T00:00:33.188 INFO:tasks.workunit.client.0.smithi164.stdout:9/324: symlink d6/d1c/l66 0 2024-02-10T00:00:33.188 INFO:tasks.workunit.client.0.smithi164.stdout:9/325: chown d6/de/d40 306265 1 2024-02-10T00:00:33.188 INFO:tasks.workunit.client.0.smithi164.stdout:7/366: mknod d3/d5/c81 0 2024-02-10T00:00:33.189 INFO:tasks.workunit.client.0.smithi164.stdout:0/281: truncate d6/d7/d14/f20 114458 0 2024-02-10T00:00:33.193 INFO:tasks.workunit.client.1.smithi183.stdout:7/623: dread d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:33.193 INFO:tasks.workunit.client.0.smithi164.stdout:5/328: chown d7/d17/d21/l57 170320542 1 2024-02-10T00:00:33.194 INFO:tasks.workunit.client.1.smithi183.stdout:8/728: dwrite d0/d27/f68 [0,4194304] 0 2024-02-10T00:00:33.194 INFO:tasks.workunit.client.0.smithi164.stdout:9/326: rmdir d6/d1c/d24/d4f 39 2024-02-10T00:00:33.195 INFO:tasks.workunit.client.1.smithi183.stdout:3/590: link d7/db/d2a/d2d/f2f d7/db/d2a/d2d/d51/d8f/faf 0 2024-02-10T00:00:33.196 INFO:tasks.workunit.client.0.smithi164.stdout:7/367: creat d3/d11/f82 x:0 0 0 2024-02-10T00:00:33.198 INFO:tasks.workunit.client.0.smithi164.stdout:0/282: dread d6/d7/d14/f1b [0,4194304] 0 2024-02-10T00:00:33.198 INFO:tasks.workunit.client.1.smithi183.stdout:0/647: symlink d14/d1d/d2d/d31/d68/dcc/lea 0 2024-02-10T00:00:33.198 INFO:tasks.workunit.client.1.smithi183.stdout:0/648: chown d14/d1d 21626139 1 2024-02-10T00:00:33.199 INFO:tasks.workunit.client.1.smithi183.stdout:5/724: symlink d4/d23/d3e/d80/da1/d9c/lee 0 2024-02-10T00:00:33.199 INFO:tasks.workunit.client.0.smithi164.stdout:4/292: dread d2/d2f/f21 [0,4194304] 0 2024-02-10T00:00:33.199 INFO:tasks.workunit.client.0.smithi164.stdout:2/326: mkdir d3/d32/d4e/d27/d2a/d7a 0 2024-02-10T00:00:33.204 INFO:tasks.workunit.client.0.smithi164.stdout:9/327: rename d6/f20 to d6/de/d2b/f67 0 2024-02-10T00:00:33.204 INFO:tasks.workunit.client.0.smithi164.stdout:8/286: truncate d2/d50/d31/d32/f4b 268797 0 2024-02-10T00:00:33.204 INFO:tasks.workunit.client.1.smithi183.stdout:9/666: mkdir d0/d3/d14/d1c/d2d/d4f/da4/dda 0 2024-02-10T00:00:33.205 INFO:tasks.workunit.client.1.smithi183.stdout:3/591: creat d7/db/d2a/d8e/fb0 x:0 0 0 2024-02-10T00:00:33.205 INFO:tasks.workunit.client.0.smithi164.stdout:4/293: creat d2/d19/f6a x:0 0 0 2024-02-10T00:00:33.205 INFO:tasks.workunit.client.0.smithi164.stdout:5/329: mknod d7/d17/d21/d23/c66 0 2024-02-10T00:00:33.206 INFO:tasks.workunit.client.1.smithi183.stdout:3/592: dread - d7/db/f47 zero size 2024-02-10T00:00:33.206 INFO:tasks.workunit.client.0.smithi164.stdout:8/287: write d2/f29 [1746916,32123] 0 2024-02-10T00:00:33.206 INFO:tasks.workunit.client.0.smithi164.stdout:2/327: unlink d3/l14 0 2024-02-10T00:00:33.208 INFO:tasks.workunit.client.0.smithi164.stdout:3/279: sync 2024-02-10T00:00:33.208 INFO:tasks.workunit.client.0.smithi164.stdout:3/280: read - d0/d1/d3c/d3d/f47 zero size 2024-02-10T00:00:33.209 INFO:tasks.workunit.client.0.smithi164.stdout:0/283: rename d6/d7/f17 to d6/d10/d18/d2d/f5d 0 2024-02-10T00:00:33.209 INFO:tasks.workunit.client.0.smithi164.stdout:0/284: readlink d6/l13 0 2024-02-10T00:00:33.210 INFO:tasks.workunit.client.1.smithi183.stdout:6/559: rename d2/d1a/d25/d3c/d31/d38/d3f/d5e/f7a to d2/fa4 0 2024-02-10T00:00:33.214 INFO:tasks.workunit.client.1.smithi183.stdout:2/788: write d2/f15 [3632215,124201] 0 2024-02-10T00:00:33.215 INFO:tasks.workunit.client.0.smithi164.stdout:1/246: write d1/f11 [1843641,111478] 0 2024-02-10T00:00:33.215 INFO:tasks.workunit.client.0.smithi164.stdout:9/328: dwrite d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:33.215 INFO:tasks.workunit.client.1.smithi183.stdout:9/667: dwrite d0/d30/d52/f66 [0,4194304] 0 2024-02-10T00:00:33.215 INFO:tasks.workunit.client.0.smithi164.stdout:6/406: write d0/d6/d12/d14/f61 [272203,77504] 0 2024-02-10T00:00:33.216 INFO:tasks.workunit.client.0.smithi164.stdout:9/329: stat d6/d4b/f57 0 2024-02-10T00:00:33.216 INFO:tasks.workunit.client.0.smithi164.stdout:6/407: chown d0/d6/d12/d57/f7b 632096 1 2024-02-10T00:00:33.217 INFO:tasks.workunit.client.0.smithi164.stdout:8/288: symlink d2/d50/l52 0 2024-02-10T00:00:33.217 INFO:tasks.workunit.client.0.smithi164.stdout:9/330: write d6/f1e [1458778,105774] 0 2024-02-10T00:00:33.219 INFO:tasks.workunit.client.1.smithi183.stdout:4/703: rename de/d19/d1c/d61/c79 to de/d14/d1d/cda 0 2024-02-10T00:00:33.220 INFO:tasks.workunit.client.1.smithi183.stdout:0/649: link d14/d1d/d59/d3c/l52 d14/d3e/d92/leb 0 2024-02-10T00:00:33.220 INFO:tasks.workunit.client.1.smithi183.stdout:4/704: chown de/d14/l89 8 1 2024-02-10T00:00:33.225 INFO:tasks.workunit.client.1.smithi183.stdout:8/729: getdents d0/d27/d36 0 2024-02-10T00:00:33.226 INFO:tasks.workunit.client.1.smithi183.stdout:8/730: write d0/d27/f3a [3408231,81370] 0 2024-02-10T00:00:33.226 INFO:tasks.workunit.client.1.smithi183.stdout:0/650: symlink d14/d3e/d5f/daa/ddd/lec 0 2024-02-10T00:00:33.228 INFO:tasks.workunit.client.1.smithi183.stdout:4/705: mknod de/d19/d1c/dd0/cdb 0 2024-02-10T00:00:33.229 INFO:tasks.workunit.client.1.smithi183.stdout:5/725: getdents d4/d23/d3e/d80/da1/d9e/d27/d38/d4f 0 2024-02-10T00:00:33.231 INFO:tasks.workunit.client.1.smithi183.stdout:2/789: mknod d2/d2c/d2f/d60/d8d/d9c/da7/dd4/d79/c10a 0 2024-02-10T00:00:33.232 INFO:tasks.workunit.client.1.smithi183.stdout:6/560: truncate d2/d1a/d25/d3c/d31/d38/d6e/f68 458532 0 2024-02-10T00:00:33.232 INFO:tasks.workunit.client.0.smithi164.stdout:0/285: dread - d6/f3d zero size 2024-02-10T00:00:33.232 INFO:tasks.workunit.client.0.smithi164.stdout:7/368: link d3/d5/l68 d3/d28/l83 0 2024-02-10T00:00:33.233 INFO:tasks.workunit.client.0.smithi164.stdout:6/408: dread d0/d6/d12/f27 [0,4194304] 0 2024-02-10T00:00:33.235 INFO:tasks.workunit.client.1.smithi183.stdout:0/651: rename d14/d1d/d55/d6e/fc5 to d14/d43/fed 0 2024-02-10T00:00:33.235 INFO:tasks.workunit.client.0.smithi164.stdout:4/294: creat d2/d19/d16/f6b x:0 0 0 2024-02-10T00:00:33.235 INFO:tasks.workunit.client.0.smithi164.stdout:5/330: link d7/d17/d21/d23/f2d d7/d17/d21/d23/d37/d36/f67 0 2024-02-10T00:00:33.236 INFO:tasks.workunit.client.1.smithi183.stdout:4/706: unlink de/d14/d27/d2e/f4d 0 2024-02-10T00:00:33.237 INFO:tasks.workunit.client.0.smithi164.stdout:9/331: symlink d6/de/d40/d54/l68 0 2024-02-10T00:00:33.238 INFO:tasks.workunit.client.0.smithi164.stdout:0/286: chown d6/f2a 26 1 2024-02-10T00:00:33.239 INFO:tasks.workunit.client.0.smithi164.stdout:6/409: dwrite d0/d6/d12/f22 [0,4194304] 0 2024-02-10T00:00:33.239 INFO:tasks.workunit.client.0.smithi164.stdout:4/295: symlink d2/d2f/d37/d41/l6c 0 2024-02-10T00:00:33.240 INFO:tasks.workunit.client.0.smithi164.stdout:0/287: write d6/d10/f1d [540268,92409] 0 2024-02-10T00:00:33.242 INFO:tasks.workunit.client.0.smithi164.stdout:8/289: getdents d2/d12 0 2024-02-10T00:00:33.243 INFO:tasks.workunit.client.1.smithi183.stdout:3/593: truncate d7/db/d2a/f69 4550707 0 2024-02-10T00:00:33.244 INFO:tasks.workunit.client.1.smithi183.stdout:9/668: write d0/d3/d14/d1c/f45 [2299142,30959] 0 2024-02-10T00:00:33.244 INFO:tasks.workunit.client.1.smithi183.stdout:6/561: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/la5 0 2024-02-10T00:00:33.245 INFO:tasks.workunit.client.1.smithi183.stdout:3/594: write d7/db/d2a/f79 [2932761,2967] 0 2024-02-10T00:00:33.245 INFO:tasks.workunit.client.0.smithi164.stdout:5/331: rename d7/d15 to d7/d17/d21/d23/d5a/d68 0 2024-02-10T00:00:33.245 INFO:tasks.workunit.client.0.smithi164.stdout:9/332: dwrite d6/d1c/d24/f4a [0,4194304] 0 2024-02-10T00:00:33.246 INFO:tasks.workunit.client.1.smithi183.stdout:0/652: mkdir d14/d43/dee 0 2024-02-10T00:00:33.246 INFO:tasks.workunit.client.0.smithi164.stdout:6/410: creat d0/d2b/f7e x:0 0 0 2024-02-10T00:00:33.247 INFO:tasks.workunit.client.1.smithi183.stdout:8/731: truncate d0/d27/d75/d5b/d85/fb6 558149 0 2024-02-10T00:00:33.249 INFO:tasks.workunit.client.0.smithi164.stdout:8/290: dwrite d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:33.251 INFO:tasks.workunit.client.1.smithi183.stdout:9/669: unlink d0/d3/l88 0 2024-02-10T00:00:33.251 INFO:tasks.workunit.client.0.smithi164.stdout:5/332: mkdir d7/d17/d69 0 2024-02-10T00:00:33.252 INFO:tasks.workunit.client.0.smithi164.stdout:0/288: creat d6/d43/f5e x:0 0 0 2024-02-10T00:00:33.252 INFO:tasks.workunit.client.0.smithi164.stdout:9/333: fsync d6/de/f14 0 2024-02-10T00:00:33.252 INFO:tasks.workunit.client.0.smithi164.stdout:2/328: sync 2024-02-10T00:00:33.253 INFO:tasks.workunit.client.0.smithi164.stdout:4/296: chown d2/d19/d16/d31/f4f 4933953 1 2024-02-10T00:00:33.254 INFO:tasks.workunit.client.1.smithi183.stdout:8/732: fsync d0/d27/d75/d5b/fe0 0 2024-02-10T00:00:33.254 INFO:tasks.workunit.client.0.smithi164.stdout:0/289: read d6/d10/d18/d2d/f5a [1906872,79703] 0 2024-02-10T00:00:33.254 INFO:tasks.workunit.client.0.smithi164.stdout:5/333: write d7/d17/d21/d23/d37/d36/f46 [3028842,78128] 0 2024-02-10T00:00:33.255 INFO:tasks.workunit.client.0.smithi164.stdout:8/291: dread d2/d12/f17 [0,4194304] 0 2024-02-10T00:00:33.256 INFO:tasks.workunit.client.1.smithi183.stdout:6/562: symlink d2/d1a/d25/d3c/d31/d38/d6e/d93/la6 0 2024-02-10T00:00:33.257 INFO:tasks.workunit.client.0.smithi164.stdout:3/281: truncate d0/f43 966783 0 2024-02-10T00:00:33.259 INFO:tasks.workunit.client.0.smithi164.stdout:1/247: dread d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:33.259 INFO:tasks.workunit.client.0.smithi164.stdout:7/369: write d3/d4d/f55 [740323,26001] 0 2024-02-10T00:00:33.259 INFO:tasks.workunit.client.1.smithi183.stdout:0/653: rename d14/d3e/d92/leb to d14/d1d/d2d/d31/d68/da3/lef 0 2024-02-10T00:00:33.260 INFO:tasks.workunit.client.0.smithi164.stdout:4/297: dwrite d2/d2f/d37/d41/d3d/f64 [0,4194304] 0 2024-02-10T00:00:33.263 INFO:tasks.workunit.client.1.smithi183.stdout:3/595: getdents d7 0 2024-02-10T00:00:33.264 INFO:tasks.workunit.client.0.smithi164.stdout:5/334: dread d7/d17/d21/d23/d37/f4b [0,4194304] 0 2024-02-10T00:00:33.265 INFO:tasks.workunit.client.1.smithi183.stdout:2/790: dread d2/d2c/dba/df0/d8f/f93 [0,4194304] 0 2024-02-10T00:00:33.265 INFO:tasks.workunit.client.1.smithi183.stdout:9/670: rename d0/d30/d52/f6c to d0/d92/db7/fdb 0 2024-02-10T00:00:33.266 INFO:tasks.workunit.client.1.smithi183.stdout:9/671: write d0/d3/d14/d1c/d2d/d4f/d58/fc6 [3581019,69223] 0 2024-02-10T00:00:33.266 INFO:tasks.workunit.client.0.smithi164.stdout:2/329: mknod d3/d32/d4e/d27/d2e/d36/c7b 0 2024-02-10T00:00:33.267 INFO:tasks.workunit.client.1.smithi183.stdout:0/654: creat d14/d1d/d59/d3c/d93/ff0 x:0 0 0 2024-02-10T00:00:33.267 INFO:tasks.workunit.client.1.smithi183.stdout:6/563: truncate d2/d1a/d25/d3c/d31/d38/d87/f7c 853764 0 2024-02-10T00:00:33.267 INFO:tasks.workunit.client.0.smithi164.stdout:6/411: getdents d0/d2b/d3a/d3d/d42/d5d/d66 0 2024-02-10T00:00:33.268 INFO:tasks.workunit.client.1.smithi183.stdout:0/655: fdatasync d14/d3e/d5f/fb1 0 2024-02-10T00:00:33.268 INFO:tasks.workunit.client.1.smithi183.stdout:8/733: getdents d0/d31 0 2024-02-10T00:00:33.270 INFO:tasks.workunit.client.1.smithi183.stdout:2/791: mkdir d2/d2c/d2f/d60/d8d/d10b 0 2024-02-10T00:00:33.270 INFO:tasks.workunit.client.1.smithi183.stdout:8/734: write d0/d27/d36/f80 [4084651,32347] 0 2024-02-10T00:00:33.271 INFO:tasks.workunit.client.1.smithi183.stdout:8/735: write d0/d3f/db2/d24/f7a [5231424,46787] 0 2024-02-10T00:00:33.271 INFO:tasks.workunit.client.0.smithi164.stdout:3/282: mknod d0/d1/d2/c53 0 2024-02-10T00:00:33.271 INFO:tasks.workunit.client.0.smithi164.stdout:3/283: chown d0/d1/d2 460948 1 2024-02-10T00:00:33.272 INFO:tasks.workunit.client.1.smithi183.stdout:8/736: dread - d0/d31/fe8 zero size 2024-02-10T00:00:33.272 INFO:tasks.workunit.client.0.smithi164.stdout:7/370: chown d3/d5/l68 132 1 2024-02-10T00:00:33.273 INFO:tasks.workunit.client.1.smithi183.stdout:9/672: rename d0/d3/d14/d1c/d2d/d4f/d58 to d0/d30/d52/ddc 0 2024-02-10T00:00:33.273 INFO:tasks.workunit.client.0.smithi164.stdout:4/298: mkdir d2/d19/d16/d31/d6d 0 2024-02-10T00:00:33.273 INFO:tasks.workunit.client.0.smithi164.stdout:7/371: write d3/d28/f61 [1098422,102733] 0 2024-02-10T00:00:33.273 INFO:tasks.workunit.client.0.smithi164.stdout:4/299: dread - d2/d2f/d37/d41/d3d/f5c zero size 2024-02-10T00:00:33.274 INFO:tasks.workunit.client.1.smithi183.stdout:6/564: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c9c 11573 1 2024-02-10T00:00:33.274 INFO:tasks.workunit.client.1.smithi183.stdout:0/656: rmdir d14/d1d/d2d/d31/d68/dcc 39 2024-02-10T00:00:33.274 INFO:tasks.workunit.client.0.smithi164.stdout:5/335: chown d7/d17/d21/d23/d5a/d68/l35 1271 1 2024-02-10T00:00:33.275 INFO:tasks.workunit.client.0.smithi164.stdout:0/290: mknod d6/c5f 0 2024-02-10T00:00:33.277 INFO:tasks.workunit.client.0.smithi164.stdout:2/330: unlink d3/d32/d4e/d27/f4c 0 2024-02-10T00:00:33.278 INFO:tasks.workunit.client.0.smithi164.stdout:2/331: write d3/f23 [304231,35962] 0 2024-02-10T00:00:33.279 INFO:tasks.workunit.client.0.smithi164.stdout:6/412: mknod d0/d2b/d3a/d3d/d42/c7f 0 2024-02-10T00:00:33.282 INFO:tasks.workunit.client.0.smithi164.stdout:8/292: symlink d2/d50/d31/l53 0 2024-02-10T00:00:33.283 INFO:tasks.workunit.client.1.smithi183.stdout:8/737: symlink d0/d45/d46/lea 0 2024-02-10T00:00:33.286 INFO:tasks.workunit.client.0.smithi164.stdout:3/284: creat d0/d1/d2/d17/f54 x:0 0 0 2024-02-10T00:00:33.287 INFO:tasks.workunit.client.1.smithi183.stdout:6/565: creat d2/d1a/d25/d3c/d31/fa7 x:0 0 0 2024-02-10T00:00:33.288 INFO:tasks.workunit.client.1.smithi183.stdout:5/726: dwrite d4/d23/f94 [0,4194304] 0 2024-02-10T00:00:33.289 INFO:tasks.workunit.client.0.smithi164.stdout:7/372: mknod d3/d5/d59/c84 0 2024-02-10T00:00:33.289 INFO:tasks.workunit.client.0.smithi164.stdout:9/334: dwrite d6/d1c/f29 [0,4194304] 0 2024-02-10T00:00:33.290 INFO:tasks.workunit.client.0.smithi164.stdout:7/373: readlink d3/d4d/d5d/l80 0 2024-02-10T00:00:33.291 INFO:tasks.workunit.client.1.smithi183.stdout:1/594: sync 2024-02-10T00:00:33.291 INFO:tasks.workunit.client.1.smithi183.stdout:7/624: sync 2024-02-10T00:00:33.293 INFO:tasks.workunit.client.0.smithi164.stdout:8/293: mkdir d2/d50/d54 0 2024-02-10T00:00:33.294 INFO:tasks.workunit.client.0.smithi164.stdout:5/336: creat d7/d17/d69/f6a x:0 0 0 2024-02-10T00:00:33.296 INFO:tasks.workunit.client.1.smithi183.stdout:3/596: dread d7/db/d2a/f2b [0,4194304] 0 2024-02-10T00:00:33.297 INFO:tasks.workunit.client.0.smithi164.stdout:2/332: read d3/d32/d4e/d27/d2e/d36/f43 [337643,39219] 0 2024-02-10T00:00:33.298 INFO:tasks.workunit.client.0.smithi164.stdout:2/333: write d3/d24/d51/f79 [68993,65033] 0 2024-02-10T00:00:33.299 INFO:tasks.workunit.client.0.smithi164.stdout:2/334: write d3/d32/d4e/d27/f74 [831454,88351] 0 2024-02-10T00:00:33.300 INFO:tasks.workunit.client.0.smithi164.stdout:8/294: creat d2/d50/d31/d32/f55 x:0 0 0 2024-02-10T00:00:33.300 INFO:tasks.workunit.client.0.smithi164.stdout:9/335: dread d6/de/d22/f26 [0,4194304] 0 2024-02-10T00:00:33.301 INFO:tasks.workunit.client.1.smithi183.stdout:6/566: symlink d2/d1a/la8 0 2024-02-10T00:00:33.301 INFO:tasks.workunit.client.0.smithi164.stdout:7/374: rename d3/d5/l1c to d3/d26/l85 0 2024-02-10T00:00:33.302 INFO:tasks.workunit.client.0.smithi164.stdout:6/413: truncate d0/d6/d12/d45/f65 634803 0 2024-02-10T00:00:33.302 INFO:tasks.workunit.client.1.smithi183.stdout:5/727: mkdir d4/d23/d2a/d5b/def 0 2024-02-10T00:00:33.303 INFO:tasks.workunit.client.0.smithi164.stdout:0/291: getdents d6/d3a 0 2024-02-10T00:00:33.304 INFO:tasks.workunit.client.1.smithi183.stdout:2/792: creat d2/f10c x:0 0 0 2024-02-10T00:00:33.305 INFO:tasks.workunit.client.0.smithi164.stdout:9/336: mkdir d6/de/d22/d69 0 2024-02-10T00:00:33.305 INFO:tasks.workunit.client.1.smithi183.stdout:2/793: write d2/da/d20/d21/ff6 [792355,61737] 0 2024-02-10T00:00:33.305 INFO:tasks.workunit.client.1.smithi183.stdout:7/625: mkdir d0/d11/d2f/dbf 0 2024-02-10T00:00:33.307 INFO:tasks.workunit.client.0.smithi164.stdout:7/375: rename d3/d5/d2b/d4a/f63 to d3/d26/d67/f86 0 2024-02-10T00:00:33.308 INFO:tasks.workunit.client.0.smithi164.stdout:7/376: write d3/d28/f61 [1446034,69884] 0 2024-02-10T00:00:33.308 INFO:tasks.workunit.client.1.smithi183.stdout:6/567: unlink d2/d1a/d3a/d45/c9b 0 2024-02-10T00:00:33.308 INFO:tasks.workunit.client.1.smithi183.stdout:6/568: write d2/d1a/d25/f2c [3497330,13787] 0 2024-02-10T00:00:33.311 INFO:tasks.workunit.client.0.smithi164.stdout:8/295: fsync d2/f2c 0 2024-02-10T00:00:33.311 INFO:tasks.workunit.client.0.smithi164.stdout:8/296: readlink d2/lf 0 2024-02-10T00:00:33.312 INFO:tasks.workunit.client.0.smithi164.stdout:9/337: chown d6/d1c/d24/d4f 5575 1 2024-02-10T00:00:33.313 INFO:tasks.workunit.client.0.smithi164.stdout:9/338: dread - d6/d4b/f57 zero size 2024-02-10T00:00:33.313 INFO:tasks.workunit.client.0.smithi164.stdout:8/297: fsync d2/f2c 0 2024-02-10T00:00:33.314 INFO:tasks.workunit.client.0.smithi164.stdout:8/298: fsync d2/d50/f2f 0 2024-02-10T00:00:33.314 INFO:tasks.workunit.client.0.smithi164.stdout:8/299: fsync d2/f29 0 2024-02-10T00:00:33.318 INFO:tasks.workunit.client.0.smithi164.stdout:8/300: truncate d2/f49 547916 0 2024-02-10T00:00:33.319 INFO:tasks.workunit.client.0.smithi164.stdout:8/301: creat d2/d50/d31/d32/f56 x:0 0 0 2024-02-10T00:00:33.324 INFO:tasks.workunit.client.1.smithi183.stdout:1/595: mknod d0/d3/d29/dc4/cd4 0 2024-02-10T00:00:33.324 INFO:tasks.workunit.client.1.smithi183.stdout:9/673: truncate d0/d3/d14/d48/f9c 1763743 0 2024-02-10T00:00:33.325 INFO:tasks.workunit.client.0.smithi164.stdout:8/302: rename d2/f3d to d2/d50/d31/d32/d4d/f57 0 2024-02-10T00:00:33.325 INFO:tasks.workunit.client.1.smithi183.stdout:0/657: truncate d14/d1d/d59/d71/f56 2080064 0 2024-02-10T00:00:33.326 INFO:tasks.workunit.client.0.smithi164.stdout:0/292: dread d6/d7/d14/f27 [0,4194304] 0 2024-02-10T00:00:33.327 INFO:tasks.workunit.client.1.smithi183.stdout:1/596: write d0/d3/d7/d36/fb4 [248979,120971] 0 2024-02-10T00:00:33.327 INFO:tasks.workunit.client.0.smithi164.stdout:3/285: truncate d0/d1/d2/d19/d27/f2c 3636366 0 2024-02-10T00:00:33.327 INFO:tasks.workunit.client.1.smithi183.stdout:2/794: mkdir d2/da/d20/d21/df2/d10d 0 2024-02-10T00:00:33.329 INFO:tasks.workunit.client.0.smithi164.stdout:6/414: rmdir d0/d6 39 2024-02-10T00:00:33.329 INFO:tasks.workunit.client.1.smithi183.stdout:7/626: rmdir d0/d11/d2f/da3/db4 0 2024-02-10T00:00:33.329 INFO:tasks.workunit.client.1.smithi183.stdout:2/795: dread d2/d2c/dba/fda [0,4194304] 0 2024-02-10T00:00:33.330 INFO:tasks.workunit.client.1.smithi183.stdout:5/728: dwrite d4/f20 [4194304,4194304] 0 2024-02-10T00:00:33.331 INFO:tasks.workunit.client.1.smithi183.stdout:6/569: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 x:0 0 0 2024-02-10T00:00:33.332 INFO:tasks.workunit.client.0.smithi164.stdout:5/337: truncate d7/d17/d21/f29 1884058 0 2024-02-10T00:00:33.332 INFO:tasks.workunit.client.1.smithi183.stdout:1/597: mknod d0/d3/d67/d70/cd5 0 2024-02-10T00:00:33.333 INFO:tasks.workunit.client.0.smithi164.stdout:0/293: mkdir d6/d10/d4a/d60 0 2024-02-10T00:00:33.333 INFO:tasks.workunit.client.1.smithi183.stdout:0/658: creat d14/d7a/ff1 x:0 0 0 2024-02-10T00:00:33.335 INFO:tasks.workunit.client.0.smithi164.stdout:5/338: dread d7/d17/d21/f58 [0,4194304] 0 2024-02-10T00:00:33.335 INFO:tasks.workunit.client.0.smithi164.stdout:9/339: dwrite d6/f7 [0,4194304] 0 2024-02-10T00:00:33.336 INFO:tasks.workunit.client.0.smithi164.stdout:9/340: chown d6/de/d22 22 1 2024-02-10T00:00:33.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/707: sync 2024-02-10T00:00:33.336 INFO:tasks.workunit.client.0.smithi164.stdout:8/303: write d2/f13 [1622777,34988] 0 2024-02-10T00:00:33.337 INFO:tasks.workunit.client.1.smithi183.stdout:5/729: creat d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/ff0 x:0 0 0 2024-02-10T00:00:33.337 INFO:tasks.workunit.client.0.smithi164.stdout:9/341: write d6/de/d22/f51 [503593,25741] 0 2024-02-10T00:00:33.340 INFO:tasks.workunit.client.0.smithi164.stdout:5/339: creat d7/d17/d3b/f6b x:0 0 0 2024-02-10T00:00:33.340 INFO:tasks.workunit.client.1.smithi183.stdout:1/598: creat d0/d3/d29/dc4/fd6 x:0 0 0 2024-02-10T00:00:33.341 INFO:tasks.workunit.client.0.smithi164.stdout:9/342: dread d6/d1c/d24/f4a [0,4194304] 0 2024-02-10T00:00:33.343 INFO:tasks.workunit.client.0.smithi164.stdout:8/304: mkdir d2/d50/d31/d32/d58 0 2024-02-10T00:00:33.344 INFO:tasks.workunit.client.1.smithi183.stdout:4/708: symlink de/d14/d1d/ldc 0 2024-02-10T00:00:33.344 INFO:tasks.workunit.client.0.smithi164.stdout:8/305: fsync d2/f39 0 2024-02-10T00:00:33.344 INFO:tasks.workunit.client.0.smithi164.stdout:8/306: chown d2/c8 128783297 1 2024-02-10T00:00:33.345 INFO:tasks.workunit.client.0.smithi164.stdout:8/307: chown d2 14081 1 2024-02-10T00:00:33.346 INFO:tasks.workunit.client.1.smithi183.stdout:5/730: symlink d4/d23/d3e/d80/da1/d9c/d72/lf1 0 2024-02-10T00:00:33.346 INFO:tasks.workunit.client.1.smithi183.stdout:1/599: creat d0/d3c/fd7 x:0 0 0 2024-02-10T00:00:33.347 INFO:tasks.workunit.client.1.smithi183.stdout:0/659: rename d14/d1d/d2d/d31/d6c/fae to d14/d1d/d55/d6e/d74/ff2 0 2024-02-10T00:00:33.348 INFO:tasks.workunit.client.0.smithi164.stdout:6/415: mknod d0/d6/d12/d45/c80 0 2024-02-10T00:00:33.349 INFO:tasks.workunit.client.0.smithi164.stdout:0/294: creat d6/d10/f61 x:0 0 0 2024-02-10T00:00:33.350 INFO:tasks.workunit.client.0.smithi164.stdout:9/343: link d6/fc d6/de/f6a 0 2024-02-10T00:00:33.351 INFO:tasks.workunit.client.0.smithi164.stdout:5/340: symlink d7/d17/d21/l6c 0 2024-02-10T00:00:33.353 INFO:tasks.workunit.client.0.smithi164.stdout:5/341: write d7/d17/d21/d23/d5a/d68/d1f/f44 [1897778,115718] 0 2024-02-10T00:00:33.354 INFO:tasks.workunit.client.1.smithi183.stdout:2/796: dread d2/da/d5b/f88 [0,4194304] 0 2024-02-10T00:00:33.355 INFO:tasks.workunit.client.0.smithi164.stdout:0/295: dread d6/d43/f46 [0,4194304] 0 2024-02-10T00:00:33.355 INFO:tasks.workunit.client.0.smithi164.stdout:6/416: unlink d0/d2b/d3a/f3e 0 2024-02-10T00:00:33.356 INFO:tasks.workunit.client.1.smithi183.stdout:5/731: unlink d4/dd/d31/cc5 0 2024-02-10T00:00:33.356 INFO:tasks.workunit.client.0.smithi164.stdout:5/342: creat d7/d17/d21/d23/d37/d36/f6d x:0 0 0 2024-02-10T00:00:33.356 INFO:tasks.workunit.client.1.smithi183.stdout:1/600: fdatasync d0/d3/d7/f6c 0 2024-02-10T00:00:33.358 INFO:tasks.workunit.client.1.smithi183.stdout:2/797: mkdir d2/da/d20/d21/d43/d58/d74/d10e 0 2024-02-10T00:00:33.359 INFO:tasks.workunit.client.1.smithi183.stdout:2/798: readlink d2/l39 0 2024-02-10T00:00:33.359 INFO:tasks.workunit.client.1.smithi183.stdout:0/660: creat d14/d3e/dd4/ff3 x:0 0 0 2024-02-10T00:00:33.360 INFO:tasks.workunit.client.0.smithi164.stdout:5/343: dwrite d7/d17/d21/d23/d37/d36/f46 [0,4194304] 0 2024-02-10T00:00:33.361 INFO:tasks.workunit.client.1.smithi183.stdout:5/732: unlink d4/d23/d4a/l18 0 2024-02-10T00:00:33.361 INFO:tasks.workunit.client.0.smithi164.stdout:5/344: dread - d7/d17/d21/d24/f64 zero size 2024-02-10T00:00:33.362 INFO:tasks.workunit.client.0.smithi164.stdout:6/417: mkdir d0/d6/d81 0 2024-02-10T00:00:33.363 INFO:tasks.workunit.client.0.smithi164.stdout:3/286: truncate d0/d1/d2/d19/f29 1992004 0 2024-02-10T00:00:33.363 INFO:tasks.workunit.client.1.smithi183.stdout:9/674: dread d0/d3/d14/d1c/d2d/d4f/d79/fb3 [0,4194304] 0 2024-02-10T00:00:33.364 INFO:tasks.workunit.client.1.smithi183.stdout:1/601: mkdir d0/d3a/dd8 0 2024-02-10T00:00:33.366 INFO:tasks.workunit.client.1.smithi183.stdout:8/738: sync 2024-02-10T00:00:33.367 INFO:tasks.workunit.client.1.smithi183.stdout:8/739: write d0/d27/f68 [5233403,120370] 0 2024-02-10T00:00:33.368 INFO:tasks.workunit.client.0.smithi164.stdout:5/345: chown l2 2 1 2024-02-10T00:00:33.369 INFO:tasks.workunit.client.0.smithi164.stdout:5/346: chown d7/d17/d21/d23/d37/d36 12548476 1 2024-02-10T00:00:33.370 INFO:tasks.workunit.client.1.smithi183.stdout:6/570: write d2/f65 [174755,67015] 0 2024-02-10T00:00:33.370 INFO:tasks.workunit.client.1.smithi183.stdout:7/627: dread d0/d2/f2b [0,4194304] 0 2024-02-10T00:00:33.370 INFO:tasks.workunit.client.1.smithi183.stdout:0/661: creat d14/d1d/ff4 x:0 0 0 2024-02-10T00:00:33.371 INFO:tasks.workunit.client.1.smithi183.stdout:4/709: rmdir de 39 2024-02-10T00:00:33.371 INFO:tasks.workunit.client.1.smithi183.stdout:0/662: chown d14/d3e/d5f/cb3 2337 1 2024-02-10T00:00:33.372 INFO:tasks.workunit.client.1.smithi183.stdout:6/571: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/c8c 0 1 2024-02-10T00:00:33.372 INFO:tasks.workunit.client.0.smithi164.stdout:6/418: creat d0/d2b/d3a/d3d/d42/d5d/d66/f82 x:0 0 0 2024-02-10T00:00:33.372 INFO:tasks.workunit.client.0.smithi164.stdout:6/419: chown d0 19 1 2024-02-10T00:00:33.373 INFO:tasks.workunit.client.0.smithi164.stdout:5/347: creat d7/d17/d3b/d43/f6e x:0 0 0 2024-02-10T00:00:33.373 INFO:tasks.workunit.client.1.smithi183.stdout:6/572: chown d2/d1a/d25/d3c/d31/d38/d6e/f9d 1379 1 2024-02-10T00:00:33.375 INFO:tasks.workunit.client.0.smithi164.stdout:6/420: link d0/d2b/c30 d0/c83 0 2024-02-10T00:00:33.376 INFO:tasks.workunit.client.1.smithi183.stdout:9/675: rename d0/d3/d14/l8f to d0/d3/d14/d3c/ldd 0 2024-02-10T00:00:33.377 INFO:tasks.workunit.client.0.smithi164.stdout:4/300: sync 2024-02-10T00:00:33.377 INFO:tasks.workunit.client.0.smithi164.stdout:1/248: sync 2024-02-10T00:00:33.377 INFO:tasks.workunit.client.0.smithi164.stdout:5/348: dwrite d7/d17/d21/d24/f3d [0,4194304] 0 2024-02-10T00:00:33.379 INFO:tasks.workunit.client.1.smithi183.stdout:8/740: write d0/d10/d9e/fb9 [5008288,111724] 0 2024-02-10T00:00:33.380 INFO:tasks.workunit.client.1.smithi183.stdout:7/628: symlink d0/d11/d2f/lc0 0 2024-02-10T00:00:33.380 INFO:tasks.workunit.client.1.smithi183.stdout:8/741: write d0/d27/d75/d5b/f89 [915031,3702] 0 2024-02-10T00:00:33.381 INFO:tasks.workunit.client.1.smithi183.stdout:7/629: chown d0/d11/d2f/d64/d6b 1 1 2024-02-10T00:00:33.381 INFO:tasks.workunit.client.1.smithi183.stdout:1/602: dwrite d0/d3/d7/f58 [0,4194304] 0 2024-02-10T00:00:33.382 INFO:tasks.workunit.client.1.smithi183.stdout:7/630: fsync d0/d11/f98 0 2024-02-10T00:00:33.383 INFO:tasks.workunit.client.1.smithi183.stdout:7/631: chown d0/d2 98494997 1 2024-02-10T00:00:33.384 INFO:tasks.workunit.client.1.smithi183.stdout:1/603: write d0/d3/d67/d70/fa1 [4038307,77723] 0 2024-02-10T00:00:33.387 INFO:tasks.workunit.client.1.smithi183.stdout:2/799: link d2/da/d20/d21/d36/cd0 d2/d2c/d2f/d60/d8d/d9c/da7/dd4/c10f 0 2024-02-10T00:00:33.387 INFO:tasks.workunit.client.1.smithi183.stdout:4/710: read de/d14/d1d/d2f/da2/d9c/f9e [6313714,77494] 0 2024-02-10T00:00:33.387 INFO:tasks.workunit.client.1.smithi183.stdout:0/663: mkdir d14/d1d/d2d/d31/d68/dcc/df5 0 2024-02-10T00:00:33.388 INFO:tasks.workunit.client.0.smithi164.stdout:0/296: getdents d6/d10 0 2024-02-10T00:00:33.389 INFO:tasks.workunit.client.1.smithi183.stdout:6/573: mknod d2/d1a/d3a/d45/caa 0 2024-02-10T00:00:33.389 INFO:tasks.workunit.client.0.smithi164.stdout:1/249: mkdir d1/d13/d2b/d54 0 2024-02-10T00:00:33.391 INFO:tasks.workunit.client.1.smithi183.stdout:7/632: mkdir d0/d2/d4/d8/dc1 0 2024-02-10T00:00:33.391 INFO:tasks.workunit.client.1.smithi183.stdout:4/711: dread de/d14/da4/fa9 [0,4194304] 0 2024-02-10T00:00:33.391 INFO:tasks.workunit.client.1.smithi183.stdout:1/604: stat d0/d3/d67/d70/la0 0 2024-02-10T00:00:33.392 INFO:tasks.workunit.client.1.smithi183.stdout:9/676: symlink d0/d3/d14/d1c/d2d/da3/lde 0 2024-02-10T00:00:33.392 INFO:tasks.workunit.client.1.smithi183.stdout:4/712: fdatasync de/d19/d1c/d61/f91 0 2024-02-10T00:00:33.393 INFO:tasks.workunit.client.0.smithi164.stdout:0/297: dwrite d6/d10/d18/d2d/d35/f48 [0,4194304] 0 2024-02-10T00:00:33.393 INFO:tasks.workunit.client.1.smithi183.stdout:4/713: chown de/d22/c9d 911 1 2024-02-10T00:00:33.394 INFO:tasks.workunit.client.1.smithi183.stdout:2/800: rmdir d2/da/d77 39 2024-02-10T00:00:33.395 INFO:tasks.workunit.client.0.smithi164.stdout:1/250: creat d1/d23/f55 x:0 0 0 2024-02-10T00:00:33.398 INFO:tasks.workunit.client.1.smithi183.stdout:2/801: dwrite d2/d2c/dab/fe4 [0,4194304] 0 2024-02-10T00:00:33.398 INFO:tasks.workunit.client.0.smithi164.stdout:4/301: truncate d2/d19/d16/f1b 899726 0 2024-02-10T00:00:33.399 INFO:tasks.workunit.client.1.smithi183.stdout:7/633: fsync d0/d11/f1c 0 2024-02-10T00:00:33.400 INFO:tasks.workunit.client.1.smithi183.stdout:7/634: stat d0/d2/d4/f4a 0 2024-02-10T00:00:33.400 INFO:tasks.workunit.client.0.smithi164.stdout:5/349: getdents d7/d17 0 2024-02-10T00:00:33.401 INFO:tasks.workunit.client.0.smithi164.stdout:7/377: sync 2024-02-10T00:00:33.401 INFO:tasks.workunit.client.0.smithi164.stdout:2/335: sync 2024-02-10T00:00:33.402 INFO:tasks.workunit.client.0.smithi164.stdout:0/298: symlink d6/d10/d18/d2d/d35/d44/d49/l62 0 2024-02-10T00:00:33.404 INFO:tasks.workunit.client.1.smithi183.stdout:1/605: rename d0/d3/d7/f58 to d0/d3/d67/fd9 0 2024-02-10T00:00:33.404 INFO:tasks.workunit.client.1.smithi183.stdout:1/606: stat d0/d3/d29/dc4/cd4 0 2024-02-10T00:00:33.406 INFO:tasks.workunit.client.0.smithi164.stdout:5/350: chown d7/d17/d21/d23/d37/d36/l5e 67425 1 2024-02-10T00:00:33.408 INFO:tasks.workunit.client.0.smithi164.stdout:0/299: dwrite f1 [4194304,4194304] 0 2024-02-10T00:00:33.409 INFO:tasks.workunit.client.0.smithi164.stdout:4/302: dread d2/d2f/d37/d41/f35 [0,4194304] 0 2024-02-10T00:00:33.409 INFO:tasks.workunit.client.1.smithi183.stdout:2/802: mkdir d2/d2c/dba/df0/d8f/d110 0 2024-02-10T00:00:33.410 INFO:tasks.workunit.client.0.smithi164.stdout:1/251: truncate d1/f4e 917295 0 2024-02-10T00:00:33.412 INFO:tasks.workunit.client.0.smithi164.stdout:5/351: creat d7/d17/d3b/d45/d5c/f6f x:0 0 0 2024-02-10T00:00:33.413 INFO:tasks.workunit.client.0.smithi164.stdout:4/303: write d2/d2f/d37/d41/d3d/f62 [448846,96529] 0 2024-02-10T00:00:33.414 INFO:tasks.workunit.client.1.smithi183.stdout:4/714: truncate de/d19/d20/f5e 1008464 0 2024-02-10T00:00:33.414 INFO:tasks.workunit.client.0.smithi164.stdout:3/287: dread d0/d1/d2/fe [4194304,4194304] 0 2024-02-10T00:00:33.415 INFO:tasks.workunit.client.1.smithi183.stdout:4/715: write de/d19/d1c/fc1 [958263,44389] 0 2024-02-10T00:00:33.415 INFO:tasks.workunit.client.0.smithi164.stdout:0/300: symlink d6/l63 0 2024-02-10T00:00:33.415 INFO:tasks.workunit.client.1.smithi183.stdout:2/803: symlink d2/d8b/l111 0 2024-02-10T00:00:33.416 INFO:tasks.workunit.client.0.smithi164.stdout:1/252: unlink d1/d13/c24 0 2024-02-10T00:00:33.416 INFO:tasks.workunit.client.1.smithi183.stdout:1/607: dwrite d0/d3a/f83 [0,4194304] 0 2024-02-10T00:00:33.417 INFO:tasks.workunit.client.0.smithi164.stdout:5/352: mkdir d7/d17/d21/d23/d5a/d68/d1f/d70 0 2024-02-10T00:00:33.419 INFO:tasks.workunit.client.1.smithi183.stdout:7/635: unlink d0/d11/d2f/d64/f69 0 2024-02-10T00:00:33.420 INFO:tasks.workunit.client.0.smithi164.stdout:1/253: write d1/d13/f47 [769929,125740] 0 2024-02-10T00:00:33.420 INFO:tasks.workunit.client.0.smithi164.stdout:7/378: dread d3/d5/d2b/f4e [0,4194304] 0 2024-02-10T00:00:33.421 INFO:tasks.workunit.client.0.smithi164.stdout:3/288: truncate d0/d1/dd/f1f 3016471 0 2024-02-10T00:00:33.422 INFO:tasks.workunit.client.0.smithi164.stdout:3/289: chown d0/d1/d2/d17/d37 1729 1 2024-02-10T00:00:33.422 INFO:tasks.workunit.client.0.smithi164.stdout:4/304: dwrite d2/d19/d16/f3f [0,4194304] 0 2024-02-10T00:00:33.422 INFO:tasks.workunit.client.1.smithi183.stdout:4/716: unlink de/d19/d1c/d61/f91 0 2024-02-10T00:00:33.424 INFO:tasks.workunit.client.0.smithi164.stdout:1/254: mkdir d1/d13/d2b/d52/d56 0 2024-02-10T00:00:33.424 INFO:tasks.workunit.client.0.smithi164.stdout:7/379: chown d3/d5/d59/c6e 432 1 2024-02-10T00:00:33.424 INFO:tasks.workunit.client.0.smithi164.stdout:5/353: fdatasync d7/d17/d21/d23/d37/d36/f67 0 2024-02-10T00:00:33.425 INFO:tasks.workunit.client.1.smithi183.stdout:1/608: creat d0/d3/da9/fda x:0 0 0 2024-02-10T00:00:33.425 INFO:tasks.workunit.client.0.smithi164.stdout:7/380: chown d3/d5/d2b/c33 7220 1 2024-02-10T00:00:33.426 INFO:tasks.workunit.client.0.smithi164.stdout:5/354: dread - d7/d17/d3b/d45/d5c/f6f zero size 2024-02-10T00:00:33.427 INFO:tasks.workunit.client.0.smithi164.stdout:4/305: rename d2/d19/f6a to d2/d2f/d37/d41/f6e 0 2024-02-10T00:00:33.427 INFO:tasks.workunit.client.1.smithi183.stdout:4/717: symlink de/d22/ldd 0 2024-02-10T00:00:33.428 INFO:tasks.workunit.client.0.smithi164.stdout:7/381: read d3/d4d/f55 [127640,20587] 0 2024-02-10T00:00:33.429 INFO:tasks.workunit.client.0.smithi164.stdout:4/306: read d2/d2f/d37/d41/d3d/d42/d5f/f67 [3056213,69928] 0 2024-02-10T00:00:33.430 INFO:tasks.workunit.client.0.smithi164.stdout:5/355: creat d7/d17/f71 x:0 0 0 2024-02-10T00:00:33.431 INFO:tasks.workunit.client.1.smithi183.stdout:3/597: sync 2024-02-10T00:00:33.434 INFO:tasks.workunit.client.0.smithi164.stdout:4/307: creat d2/d19/d16/d31/d4b/f6f x:0 0 0 2024-02-10T00:00:33.434 INFO:tasks.workunit.client.1.smithi183.stdout:5/733: truncate d4/dd/fbd 4727477 0 2024-02-10T00:00:33.435 INFO:tasks.workunit.client.0.smithi164.stdout:8/308: dwrite d2/f49 [0,4194304] 0 2024-02-10T00:00:33.437 INFO:tasks.workunit.client.1.smithi183.stdout:1/609: chown d0/d3/d7/d3d/l68 0 1 2024-02-10T00:00:33.438 INFO:tasks.workunit.client.0.smithi164.stdout:4/308: creat d2/d19/d16/d31/f70 x:0 0 0 2024-02-10T00:00:33.438 INFO:tasks.workunit.client.0.smithi164.stdout:5/356: creat d7/d17/d21/d23/f72 x:0 0 0 2024-02-10T00:00:33.440 INFO:tasks.workunit.client.0.smithi164.stdout:6/421: truncate d0/d6/d12/f5b 457559 0 2024-02-10T00:00:33.441 INFO:tasks.workunit.client.0.smithi164.stdout:4/309: mkdir d2/d2f/d37/d71 0 2024-02-10T00:00:33.441 INFO:tasks.workunit.client.0.smithi164.stdout:8/309: dwrite d2/d50/d31/d32/f3e [0,4194304] 0 2024-02-10T00:00:33.444 INFO:tasks.workunit.client.0.smithi164.stdout:5/357: mknod d7/d17/d3b/d45/c73 0 2024-02-10T00:00:33.445 INFO:tasks.workunit.client.0.smithi164.stdout:8/310: read d2/f7 [1258912,38570] 0 2024-02-10T00:00:33.447 INFO:tasks.workunit.client.1.smithi183.stdout:0/664: write d14/d1d/f2b [667890,57666] 0 2024-02-10T00:00:33.447 INFO:tasks.workunit.client.0.smithi164.stdout:5/358: creat d7/d17/d21/d23/d5a/f74 x:0 0 0 2024-02-10T00:00:33.447 INFO:tasks.workunit.client.0.smithi164.stdout:4/310: dread d2/d19/d16/d31/f4f [0,4194304] 0 2024-02-10T00:00:33.449 INFO:tasks.workunit.client.0.smithi164.stdout:6/422: link d0/d2b/d3a/f5e d0/d2b/d3a/d3d/d42/f84 0 2024-02-10T00:00:33.449 INFO:tasks.workunit.client.1.smithi183.stdout:5/734: dread d4/d23/d3e/d80/da1/d9e/d89/f90 [0,4194304] 0 2024-02-10T00:00:33.449 INFO:tasks.workunit.client.1.smithi183.stdout:2/804: dread d2/d2c/d2f/d72/f92 [0,4194304] 0 2024-02-10T00:00:33.450 INFO:tasks.workunit.client.0.smithi164.stdout:7/382: dread d3/d11/f18 [0,4194304] 0 2024-02-10T00:00:33.450 INFO:tasks.workunit.client.1.smithi183.stdout:3/598: fsync d7/db/d2a/f69 0 2024-02-10T00:00:33.451 INFO:tasks.workunit.client.0.smithi164.stdout:8/311: unlink d2/d50/c3a 0 2024-02-10T00:00:33.451 INFO:tasks.workunit.client.0.smithi164.stdout:6/423: dread - d0/d2b/d3a/d3d/d42/f84 zero size 2024-02-10T00:00:33.451 INFO:tasks.workunit.client.1.smithi183.stdout:4/718: link de/d14/l89 de/d19/d20/lde 0 2024-02-10T00:00:33.452 INFO:tasks.workunit.client.0.smithi164.stdout:5/359: dwrite d7/d17/d21/d23/d37/d36/f46 [0,4194304] 0 2024-02-10T00:00:33.453 INFO:tasks.workunit.client.1.smithi183.stdout:6/574: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/f99 [4194304,4194304] 0 2024-02-10T00:00:33.454 INFO:tasks.workunit.client.1.smithi183.stdout:4/719: dread - de/d14/d27/d2e/fc2 zero size 2024-02-10T00:00:33.454 INFO:tasks.workunit.client.0.smithi164.stdout:2/336: write d3/f6 [484102,17161] 0 2024-02-10T00:00:33.455 INFO:tasks.workunit.client.1.smithi183.stdout:9/677: dwrite d0/fc0 [0,4194304] 0 2024-02-10T00:00:33.457 INFO:tasks.workunit.client.1.smithi183.stdout:6/575: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 0 1 2024-02-10T00:00:33.457 INFO:tasks.workunit.client.1.smithi183.stdout:7/636: write d0/d11/d2f/f66 [2706686,86317] 0 2024-02-10T00:00:33.458 INFO:tasks.workunit.client.0.smithi164.stdout:0/301: truncate d6/d10/d18/d2d/f51 503424 0 2024-02-10T00:00:33.464 INFO:tasks.workunit.client.1.smithi183.stdout:8/742: sync 2024-02-10T00:00:33.465 INFO:tasks.workunit.client.0.smithi164.stdout:4/311: mkdir d2/d19/d16/d31/d72 0 2024-02-10T00:00:33.465 INFO:tasks.workunit.client.0.smithi164.stdout:7/383: fsync d3/d11/f18 0 2024-02-10T00:00:33.465 INFO:tasks.workunit.client.0.smithi164.stdout:1/255: dwrite d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:33.466 INFO:tasks.workunit.client.1.smithi183.stdout:4/720: creat de/d14/d1d/fdf x:0 0 0 2024-02-10T00:00:33.469 INFO:tasks.workunit.client.0.smithi164.stdout:0/302: symlink d6/d10/d18/d1c/l64 0 2024-02-10T00:00:33.470 INFO:tasks.workunit.client.1.smithi183.stdout:7/637: creat d0/d2/d50/dad/fc2 x:0 0 0 2024-02-10T00:00:33.471 INFO:tasks.workunit.client.0.smithi164.stdout:5/360: dread d7/fc [0,4194304] 0 2024-02-10T00:00:33.472 INFO:tasks.workunit.client.0.smithi164.stdout:4/312: dwrite d2/fb [4194304,4194304] 0 2024-02-10T00:00:33.473 INFO:tasks.workunit.client.0.smithi164.stdout:7/384: dwrite d3/d5/d59/f72 [0,4194304] 0 2024-02-10T00:00:33.473 INFO:tasks.workunit.client.0.smithi164.stdout:5/361: chown d7/d17/d3b/d43/c55 982431555 1 2024-02-10T00:00:33.475 INFO:tasks.workunit.client.0.smithi164.stdout:6/424: rmdir d0/d3b/d56 39 2024-02-10T00:00:33.475 INFO:tasks.workunit.client.0.smithi164.stdout:2/337: creat d3/d26/d56/f7c x:0 0 0 2024-02-10T00:00:33.475 INFO:tasks.workunit.client.1.smithi183.stdout:0/665: link d14/d1d/d59/fe1 d14/d1d/d59/d3c/ff6 0 2024-02-10T00:00:33.476 INFO:tasks.workunit.client.1.smithi183.stdout:2/805: symlink d2/da/d77/l112 0 2024-02-10T00:00:33.476 INFO:tasks.workunit.client.0.smithi164.stdout:0/303: symlink d6/d10/d18/d2d/l65 0 2024-02-10T00:00:33.478 INFO:tasks.workunit.client.0.smithi164.stdout:4/313: readlink d2/d2f/l2c 0 2024-02-10T00:00:33.482 INFO:tasks.workunit.client.1.smithi183.stdout:1/610: sync 2024-02-10T00:00:33.482 INFO:tasks.workunit.client.1.smithi183.stdout:1/611: fsync d0/d3a/f7a 0 2024-02-10T00:00:33.489 INFO:tasks.workunit.client.0.smithi164.stdout:9/344: sync 2024-02-10T00:00:33.494 INFO:tasks.workunit.client.1.smithi183.stdout:8/743: fdatasync d0/d10/f73 0 2024-02-10T00:00:33.496 INFO:tasks.workunit.client.1.smithi183.stdout:6/576: mkdir d2/dab 0 2024-02-10T00:00:33.497 INFO:tasks.workunit.client.1.smithi183.stdout:7/638: unlink d0/fb3 0 2024-02-10T00:00:33.498 INFO:tasks.workunit.client.1.smithi183.stdout:0/666: truncate d14/d1d/d2d/d31/f6d 667193 0 2024-02-10T00:00:33.500 INFO:tasks.workunit.client.1.smithi183.stdout:6/577: dwrite d2/d1a/d3a/f48 [0,4194304] 0 2024-02-10T00:00:33.501 INFO:tasks.workunit.client.1.smithi183.stdout:6/578: fdatasync d2/d32/f5c 0 2024-02-10T00:00:33.501 INFO:tasks.workunit.client.1.smithi183.stdout:6/579: chown d2/d1a 20672 1 2024-02-10T00:00:33.502 INFO:tasks.workunit.client.1.smithi183.stdout:5/735: link d4/d23/d3e/d80/da1/d9e/d27/fca d4/d23/d3e/d80/da1/d9e/d27/d5d/ff2 0 2024-02-10T00:00:33.502 INFO:tasks.workunit.client.1.smithi183.stdout:3/599: link d7/db/d2a/d33/d59/d52/la1 d7/db/d2a/d33/d59/d52/lb1 0 2024-02-10T00:00:33.506 INFO:tasks.workunit.client.1.smithi183.stdout:9/678: truncate d0/d3/f4e 327137 0 2024-02-10T00:00:33.506 INFO:tasks.workunit.client.0.smithi164.stdout:2/338: dwrite d3/f3e [0,4194304] 0 2024-02-10T00:00:33.506 INFO:tasks.workunit.client.0.smithi164.stdout:0/304: mkdir d6/d10/d66 0 2024-02-10T00:00:33.508 INFO:tasks.workunit.client.0.smithi164.stdout:6/425: dwrite d0/d6/d12/d14/f50 [0,4194304] 0 2024-02-10T00:00:33.508 INFO:tasks.workunit.client.0.smithi164.stdout:8/312: getdents d2/d50/d31/d32 0 2024-02-10T00:00:33.508 INFO:tasks.workunit.client.1.smithi183.stdout:8/744: dwrite d0/d3f/db2/d24/f28 [0,4194304] 0 2024-02-10T00:00:33.508 INFO:tasks.workunit.client.1.smithi183.stdout:6/580: dwrite d2/d1a/d25/d3c/d31/f70 [0,4194304] 0 2024-02-10T00:00:33.509 INFO:tasks.workunit.client.0.smithi164.stdout:8/313: stat d2/d50/d31/l53 0 2024-02-10T00:00:33.511 INFO:tasks.workunit.client.0.smithi164.stdout:9/345: creat d6/de/d22/d69/f6b x:0 0 0 2024-02-10T00:00:33.513 INFO:tasks.workunit.client.0.smithi164.stdout:4/314: rename d2/d19/c1d to d2/d19/c73 0 2024-02-10T00:00:33.514 INFO:tasks.workunit.client.0.smithi164.stdout:2/339: mknod d3/d24/d5b/c7d 0 2024-02-10T00:00:33.517 INFO:tasks.workunit.client.0.smithi164.stdout:4/315: dwrite d2/d2f/d37/d41/d3d/f52 [0,4194304] 0 2024-02-10T00:00:33.519 INFO:tasks.workunit.client.0.smithi164.stdout:9/346: creat d6/de/d2b/d5b/f6c x:0 0 0 2024-02-10T00:00:33.519 INFO:tasks.workunit.client.0.smithi164.stdout:0/305: truncate d6/d10/d18/d2d/f2f 5887134 0 2024-02-10T00:00:33.519 INFO:tasks.workunit.client.1.smithi183.stdout:7/639: mkdir d0/d11/dc3 0 2024-02-10T00:00:33.519 INFO:tasks.workunit.client.1.smithi183.stdout:6/581: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/lac 0 2024-02-10T00:00:33.519 INFO:tasks.workunit.client.0.smithi164.stdout:9/347: chown d6/de/d22/f30 193 1 2024-02-10T00:00:33.520 INFO:tasks.workunit.client.1.smithi183.stdout:5/736: rename d4/d23/d3e/d80/da1/d9e/d27/d37/fa5 to d4/d23/d4a/ff3 0 2024-02-10T00:00:33.520 INFO:tasks.workunit.client.0.smithi164.stdout:2/340: creat d3/d26/d64/f7e x:0 0 0 2024-02-10T00:00:33.521 INFO:tasks.workunit.client.1.smithi183.stdout:5/737: write d4/d74/f7e [568924,98280] 0 2024-02-10T00:00:33.522 INFO:tasks.workunit.client.0.smithi164.stdout:8/314: mknod d2/d50/d31/c59 0 2024-02-10T00:00:33.522 INFO:tasks.workunit.client.1.smithi183.stdout:8/745: dwrite d0/f52 [0,4194304] 0 2024-02-10T00:00:33.523 INFO:tasks.workunit.client.1.smithi183.stdout:8/746: readlink d0/d4e/d53/la8 0 2024-02-10T00:00:33.524 INFO:tasks.workunit.client.0.smithi164.stdout:4/316: dwrite d2/d19/d16/d31/f4d [0,4194304] 0 2024-02-10T00:00:33.525 INFO:tasks.workunit.client.0.smithi164.stdout:4/317: fsync d2/d19/d16/d31/d4b/f6f 0 2024-02-10T00:00:33.527 INFO:tasks.workunit.client.0.smithi164.stdout:8/315: dwrite d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:33.529 INFO:tasks.workunit.client.0.smithi164.stdout:9/348: read d6/d1c/f1d [3342150,70201] 0 2024-02-10T00:00:33.529 INFO:tasks.workunit.client.1.smithi183.stdout:4/721: link de/d14/d27/d2e/f86 de/d19/fe0 0 2024-02-10T00:00:33.529 INFO:tasks.workunit.client.1.smithi183.stdout:9/679: mkdir d0/d3/d14/d1c/d2d/d4f/da4/dda/ddf 0 2024-02-10T00:00:33.530 INFO:tasks.workunit.client.0.smithi164.stdout:4/318: read d2/d2f/d37/d41/f34 [155176,113037] 0 2024-02-10T00:00:33.531 INFO:tasks.workunit.client.0.smithi164.stdout:2/341: mkdir d3/d24/d7f 0 2024-02-10T00:00:33.531 INFO:tasks.workunit.client.0.smithi164.stdout:4/319: read d2/d2f/d37/d41/f34 [202687,94678] 0 2024-02-10T00:00:33.532 INFO:tasks.workunit.client.0.smithi164.stdout:8/316: creat d2/d50/d31/d32/d4d/f5a x:0 0 0 2024-02-10T00:00:33.533 INFO:tasks.workunit.client.0.smithi164.stdout:8/317: write d2/d50/d31/d32/f34 [3288095,3603] 0 2024-02-10T00:00:33.534 INFO:tasks.workunit.client.0.smithi164.stdout:8/318: dread - d2/d50/f42 zero size 2024-02-10T00:00:33.534 INFO:tasks.workunit.client.1.smithi183.stdout:9/680: dwrite d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:33.534 INFO:tasks.workunit.client.0.smithi164.stdout:8/319: chown d2/d50/d31 80 1 2024-02-10T00:00:33.535 INFO:tasks.workunit.client.1.smithi183.stdout:4/722: creat de/d14/d1d/d7b/dcb/fe1 x:0 0 0 2024-02-10T00:00:33.536 INFO:tasks.workunit.client.0.smithi164.stdout:9/349: rename d6/f9 to d6/de/d2b/d5b/d61/f6d 0 2024-02-10T00:00:33.536 INFO:tasks.workunit.client.0.smithi164.stdout:8/320: rename d2 to d2/d50/d31/d32/d5b 22 2024-02-10T00:00:33.536 INFO:tasks.workunit.client.0.smithi164.stdout:9/350: readlink d6/l27 0 2024-02-10T00:00:33.537 INFO:tasks.workunit.client.1.smithi183.stdout:8/747: dread - d0/d23/f8c zero size 2024-02-10T00:00:33.539 INFO:tasks.workunit.client.0.smithi164.stdout:9/351: dread d6/de/d40/f46 [0,4194304] 0 2024-02-10T00:00:33.539 INFO:tasks.workunit.client.0.smithi164.stdout:2/342: symlink d3/d32/l80 0 2024-02-10T00:00:33.539 INFO:tasks.workunit.client.0.smithi164.stdout:9/352: fdatasync d6/f7 0 2024-02-10T00:00:33.540 INFO:tasks.workunit.client.0.smithi164.stdout:9/353: dread - d6/d1c/d24/f5c zero size 2024-02-10T00:00:33.541 INFO:tasks.workunit.client.1.smithi183.stdout:9/681: rmdir d0/d92/db7 39 2024-02-10T00:00:33.542 INFO:tasks.workunit.client.1.smithi183.stdout:7/640: getdents d0/d2/d50 0 2024-02-10T00:00:33.545 INFO:tasks.workunit.client.1.smithi183.stdout:9/682: rmdir d0/d3/d14/d1c/d4b 39 2024-02-10T00:00:33.545 INFO:tasks.workunit.client.0.smithi164.stdout:8/321: creat d2/d50/d31/d32/d58/f5c x:0 0 0 2024-02-10T00:00:33.546 INFO:tasks.workunit.client.0.smithi164.stdout:3/290: sync 2024-02-10T00:00:33.546 INFO:tasks.workunit.client.1.smithi183.stdout:7/641: creat d0/d11/d2f/d64/d6b/fc4 x:0 0 0 2024-02-10T00:00:33.547 INFO:tasks.workunit.client.1.smithi183.stdout:4/723: creat de/d19/d1c/fe2 x:0 0 0 2024-02-10T00:00:33.548 INFO:tasks.workunit.client.0.smithi164.stdout:2/343: symlink d3/d24/d51/l81 0 2024-02-10T00:00:33.550 INFO:tasks.workunit.client.1.smithi183.stdout:7/642: creat d0/d2/d50/dad/fc5 x:0 0 0 2024-02-10T00:00:33.550 INFO:tasks.workunit.client.1.smithi183.stdout:9/683: chown d0/d3/d14/d1c/d4b/d97/daa/dcf 7743570 1 2024-02-10T00:00:33.550 INFO:tasks.workunit.client.1.smithi183.stdout:4/724: read de/d14/da4/fa9 [29045,115763] 0 2024-02-10T00:00:33.551 INFO:tasks.workunit.client.1.smithi183.stdout:7/643: dread - d0/d11/d2f/fae zero size 2024-02-10T00:00:33.551 INFO:tasks.workunit.client.0.smithi164.stdout:1/256: dread d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:33.551 INFO:tasks.workunit.client.0.smithi164.stdout:3/291: creat d0/d1/d3c/d3d/d51/f55 x:0 0 0 2024-02-10T00:00:33.553 INFO:tasks.workunit.client.1.smithi183.stdout:4/725: creat de/fe3 x:0 0 0 2024-02-10T00:00:33.553 INFO:tasks.workunit.client.1.smithi183.stdout:9/684: rmdir d0/d3/d14/d1c 39 2024-02-10T00:00:33.554 INFO:tasks.workunit.client.1.smithi183.stdout:9/685: chown d0/d30/d52/f66 57954461 1 2024-02-10T00:00:33.554 INFO:tasks.workunit.client.0.smithi164.stdout:2/344: rename d3/d32/d4e/l37 to d3/d32/d4e/d27/d2a/l82 0 2024-02-10T00:00:33.555 INFO:tasks.workunit.client.1.smithi183.stdout:7/644: creat d0/d2/d50/d5d/fc6 x:0 0 0 2024-02-10T00:00:33.555 INFO:tasks.workunit.client.0.smithi164.stdout:1/257: mknod d1/d1a/c57 0 2024-02-10T00:00:33.555 INFO:tasks.workunit.client.1.smithi183.stdout:7/645: stat d0/d2/d50/dad/c4b 0 2024-02-10T00:00:33.556 INFO:tasks.workunit.client.0.smithi164.stdout:3/292: creat d0/d1/d2/d19/f56 x:0 0 0 2024-02-10T00:00:33.557 INFO:tasks.workunit.client.1.smithi183.stdout:4/726: unlink de/d14/d27/fb4 0 2024-02-10T00:00:33.558 INFO:tasks.workunit.client.0.smithi164.stdout:2/345: creat d3/d32/d4e/d27/d2e/d36/f83 x:0 0 0 2024-02-10T00:00:33.559 INFO:tasks.workunit.client.0.smithi164.stdout:8/322: getdents d2/d50/d31/d32 0 2024-02-10T00:00:33.560 INFO:tasks.workunit.client.0.smithi164.stdout:2/346: rmdir d3/d24 39 2024-02-10T00:00:33.561 INFO:tasks.workunit.client.1.smithi183.stdout:4/727: dwrite de/d14/d27/f82 [4194304,4194304] 0 2024-02-10T00:00:33.561 INFO:tasks.workunit.client.0.smithi164.stdout:1/258: creat d1/d1a/d41/f58 x:0 0 0 2024-02-10T00:00:33.562 INFO:tasks.workunit.client.0.smithi164.stdout:8/323: fdatasync d2/d50/f2d 0 2024-02-10T00:00:33.565 INFO:tasks.workunit.client.0.smithi164.stdout:3/293: dread d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:33.565 INFO:tasks.workunit.client.0.smithi164.stdout:2/347: dwrite f2 [0,4194304] 0 2024-02-10T00:00:33.565 INFO:tasks.workunit.client.1.smithi183.stdout:4/728: link ca de/d19/d1c/ce4 0 2024-02-10T00:00:33.566 INFO:tasks.workunit.client.0.smithi164.stdout:2/348: stat d3/d32/f71 0 2024-02-10T00:00:33.568 INFO:tasks.workunit.client.0.smithi164.stdout:3/294: creat d0/d1/d3c/d3d/f57 x:0 0 0 2024-02-10T00:00:33.569 INFO:tasks.workunit.client.0.smithi164.stdout:3/295: chown d0/d1/d2/d17/d37/l40 2968356 1 2024-02-10T00:00:33.570 INFO:tasks.workunit.client.1.smithi183.stdout:4/729: rename de/d14/d1d/d2f/da2/d9c/fb8 to de/d14/d1d/fe5 0 2024-02-10T00:00:33.570 INFO:tasks.workunit.client.0.smithi164.stdout:2/349: symlink d3/d24/l84 0 2024-02-10T00:00:33.571 INFO:tasks.workunit.client.0.smithi164.stdout:2/350: stat d3/d32/d4e/d27/d2e/d36/f43 0 2024-02-10T00:00:33.572 INFO:tasks.workunit.client.0.smithi164.stdout:2/351: dread - d3/d32/d4e/f67 zero size 2024-02-10T00:00:33.572 INFO:tasks.workunit.client.0.smithi164.stdout:2/352: chown d3/d26/d64/f6a 747262778 1 2024-02-10T00:00:33.575 INFO:tasks.workunit.client.1.smithi183.stdout:4/730: truncate de/d14/d1d/d7b/dcb/fcf 255457 0 2024-02-10T00:00:33.576 INFO:tasks.workunit.client.0.smithi164.stdout:2/353: mknod d3/d24/c85 0 2024-02-10T00:00:33.577 INFO:tasks.workunit.client.1.smithi183.stdout:6/582: sync 2024-02-10T00:00:33.579 INFO:tasks.workunit.client.0.smithi164.stdout:2/354: unlink d3/d32/d4e/d27/d2e/f3a 0 2024-02-10T00:00:33.580 INFO:tasks.workunit.client.1.smithi183.stdout:4/731: chown de/d14/c4f 148623 1 2024-02-10T00:00:33.580 INFO:tasks.workunit.client.0.smithi164.stdout:2/355: creat d3/d24/d51/f86 x:0 0 0 2024-02-10T00:00:33.581 INFO:tasks.workunit.client.1.smithi183.stdout:6/583: symlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lad 0 2024-02-10T00:00:33.582 INFO:tasks.workunit.client.1.smithi183.stdout:4/732: rmdir de/d19/d20 39 2024-02-10T00:00:33.582 INFO:tasks.workunit.client.1.smithi183.stdout:6/584: read - d2/d1a/d25/d3c/d31/d38/d87/f6a zero size 2024-02-10T00:00:33.584 INFO:tasks.workunit.client.0.smithi164.stdout:2/356: rmdir d3/d24/d7f 0 2024-02-10T00:00:33.586 INFO:tasks.workunit.client.0.smithi164.stdout:2/357: readlink d3/d32/d4e/d27/d2a/l6c 0 2024-02-10T00:00:33.586 INFO:tasks.workunit.client.1.smithi183.stdout:4/733: rename de/d19/d1c/d61/dab to de/d19/d20/de6 0 2024-02-10T00:00:33.587 INFO:tasks.workunit.client.1.smithi183.stdout:4/734: rmdir de/d14/da4 39 2024-02-10T00:00:33.593 INFO:tasks.workunit.client.1.smithi183.stdout:4/735: dread de/d14/d27/d2e/f90 [0,4194304] 0 2024-02-10T00:00:33.596 INFO:tasks.workunit.client.1.smithi183.stdout:4/736: rename de/d14/d1d/c3a to de/d19/d20/de6/ce7 0 2024-02-10T00:00:33.597 INFO:tasks.workunit.client.1.smithi183.stdout:4/737: read - de/fe3 zero size 2024-02-10T00:00:33.602 INFO:tasks.workunit.client.1.smithi183.stdout:4/738: creat de/d14/d27/fe8 x:0 0 0 2024-02-10T00:00:33.606 INFO:tasks.workunit.client.1.smithi183.stdout:8/748: sync 2024-02-10T00:00:33.608 INFO:tasks.workunit.client.1.smithi183.stdout:8/749: symlink d0/d27/d36/leb 0 2024-02-10T00:00:33.609 INFO:tasks.workunit.client.0.smithi164.stdout:7/385: sync 2024-02-10T00:00:33.610 INFO:tasks.workunit.client.0.smithi164.stdout:7/386: symlink d3/d4d/d5d/l87 0 2024-02-10T00:00:33.611 INFO:tasks.workunit.client.0.smithi164.stdout:7/387: chown d3/d11/d39/d44/d6f/l76 0 1 2024-02-10T00:00:33.612 INFO:tasks.workunit.client.1.smithi183.stdout:8/750: dwrite d0/d45/fe6 [0,4194304] 0 2024-02-10T00:00:33.613 INFO:tasks.workunit.client.0.smithi164.stdout:7/388: mknod d3/d5/d2b/c88 0 2024-02-10T00:00:33.613 INFO:tasks.workunit.client.0.smithi164.stdout:7/389: readlink d3/d26/l2a 0 2024-02-10T00:00:33.614 INFO:tasks.workunit.client.0.smithi164.stdout:7/390: write d3/d28/f3b [1070789,4372] 0 2024-02-10T00:00:33.617 INFO:tasks.workunit.client.0.smithi164.stdout:7/391: symlink d3/d11/d39/d44/d48/d71/l89 0 2024-02-10T00:00:33.617 INFO:tasks.workunit.client.0.smithi164.stdout:7/392: chown d3/d5/d2b/f4e 25 1 2024-02-10T00:00:33.620 INFO:tasks.workunit.client.1.smithi183.stdout:8/751: write d0/d27/d75/d5b/f99 [821205,97477] 0 2024-02-10T00:00:33.623 INFO:tasks.workunit.client.1.smithi183.stdout:8/752: mkdir d0/d10/dec 0 2024-02-10T00:00:33.624 INFO:tasks.workunit.client.1.smithi183.stdout:9/686: sync 2024-02-10T00:00:33.625 INFO:tasks.workunit.client.1.smithi183.stdout:7/646: sync 2024-02-10T00:00:33.625 INFO:tasks.workunit.client.1.smithi183.stdout:4/739: read de/d22/f43 [2312963,70448] 0 2024-02-10T00:00:33.628 INFO:tasks.workunit.client.1.smithi183.stdout:2/806: dread d2/da/d77/dc7/fd2 [0,4194304] 0 2024-02-10T00:00:33.631 INFO:tasks.workunit.client.1.smithi183.stdout:1/612: truncate d0/d3/d29/fad 1210018 0 2024-02-10T00:00:33.631 INFO:tasks.workunit.client.1.smithi183.stdout:1/613: chown d0/f9d 0 1 2024-02-10T00:00:33.633 INFO:tasks.workunit.client.1.smithi183.stdout:7/647: fsync d0/d2/d3/f33 0 2024-02-10T00:00:33.634 INFO:tasks.workunit.client.1.smithi183.stdout:7/648: fdatasync d0/d11/d2f/f66 0 2024-02-10T00:00:33.635 INFO:tasks.workunit.client.1.smithi183.stdout:0/667: dread d14/f40 [4194304,4194304] 0 2024-02-10T00:00:33.635 INFO:tasks.workunit.client.1.smithi183.stdout:1/614: mkdir d0/d3a/ddb 0 2024-02-10T00:00:33.636 INFO:tasks.workunit.client.1.smithi183.stdout:1/615: fsync d0/d3/d7/d36/fb4 0 2024-02-10T00:00:33.637 INFO:tasks.workunit.client.1.smithi183.stdout:9/687: unlink d0/d3/d14/d48/f9c 0 2024-02-10T00:00:33.639 INFO:tasks.workunit.client.1.smithi183.stdout:2/807: mkdir d2/d2c/d2f/d60/d8d/d9c/d113 0 2024-02-10T00:00:33.639 INFO:tasks.workunit.client.0.smithi164.stdout:6/426: unlink d0/d6/d12/f5b 0 2024-02-10T00:00:33.640 INFO:tasks.workunit.client.1.smithi183.stdout:3/600: write d7/db/f24 [469570,27830] 0 2024-02-10T00:00:33.641 INFO:tasks.workunit.client.0.smithi164.stdout:6/427: dread - d0/d6/d12/d57/f7b zero size 2024-02-10T00:00:33.641 INFO:tasks.workunit.client.1.smithi183.stdout:3/601: write d7/f30 [2442876,72359] 0 2024-02-10T00:00:33.641 INFO:tasks.workunit.client.1.smithi183.stdout:3/602: stat d7/c3d 0 2024-02-10T00:00:33.642 INFO:tasks.workunit.client.0.smithi164.stdout:5/362: sync 2024-02-10T00:00:33.644 INFO:tasks.workunit.client.0.smithi164.stdout:4/320: dread f1 [0,4194304] 0 2024-02-10T00:00:33.645 INFO:tasks.workunit.client.0.smithi164.stdout:0/306: fsync d6/d10/d18/d2d/f2f 0 2024-02-10T00:00:33.646 INFO:tasks.workunit.client.0.smithi164.stdout:4/321: stat d2/d19/d16/d31/d57/f59 0 2024-02-10T00:00:33.646 INFO:tasks.workunit.client.1.smithi183.stdout:5/738: write d4/f79 [1327206,92317] 0 2024-02-10T00:00:33.646 INFO:tasks.workunit.client.0.smithi164.stdout:6/428: dwrite d0/d3b/f6f [0,4194304] 0 2024-02-10T00:00:33.653 INFO:tasks.workunit.client.1.smithi183.stdout:6/585: truncate d2/d32/f41 1373583 0 2024-02-10T00:00:33.657 INFO:tasks.workunit.client.0.smithi164.stdout:1/259: truncate d1/d13/f47 1461932 0 2024-02-10T00:00:33.658 INFO:tasks.workunit.client.0.smithi164.stdout:9/354: getdents d6/de/d2b/d5b 0 2024-02-10T00:00:33.660 INFO:tasks.workunit.client.0.smithi164.stdout:8/324: sync 2024-02-10T00:00:33.660 INFO:tasks.workunit.client.0.smithi164.stdout:7/393: sync 2024-02-10T00:00:33.661 INFO:tasks.workunit.client.1.smithi183.stdout:8/753: write d0/d3f/f43 [1777983,64288] 0 2024-02-10T00:00:33.662 INFO:tasks.workunit.client.0.smithi164.stdout:9/355: dwrite d6/d1c/d24/f2a [0,4194304] 0 2024-02-10T00:00:33.666 INFO:tasks.workunit.client.1.smithi183.stdout:4/740: dread de/d14/d27/d2e/f9f [0,4194304] 0 2024-02-10T00:00:33.667 INFO:tasks.workunit.client.1.smithi183.stdout:2/808: rename d2/d2c/d2f/d60/d8d/d9c/d113 to d2/da/d77/d114 0 2024-02-10T00:00:33.668 INFO:tasks.workunit.client.0.smithi164.stdout:2/358: dwrite d3/d32/d4e/d27/d2a/f31 [0,4194304] 0 2024-02-10T00:00:33.668 INFO:tasks.workunit.client.0.smithi164.stdout:9/356: dwrite d6/de/d2b/f37 [0,4194304] 0 2024-02-10T00:00:33.669 INFO:tasks.workunit.client.0.smithi164.stdout:2/359: chown d3/d32/d4e/f2f 183674 1 2024-02-10T00:00:33.669 INFO:tasks.workunit.client.1.smithi183.stdout:1/616: dwrite d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:33.670 INFO:tasks.workunit.client.0.smithi164.stdout:6/429: fsync d0/f5 0 2024-02-10T00:00:33.670 INFO:tasks.workunit.client.1.smithi183.stdout:6/586: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae x:0 0 0 2024-02-10T00:00:33.671 INFO:tasks.workunit.client.0.smithi164.stdout:4/322: creat d2/d19/d16/d31/f74 x:0 0 0 2024-02-10T00:00:33.671 INFO:tasks.workunit.client.1.smithi183.stdout:9/688: dwrite d0/d3/d14/d1c/d2d/d4f/fce [0,4194304] 0 2024-02-10T00:00:33.672 INFO:tasks.workunit.client.0.smithi164.stdout:2/360: read d3/f6 [2240149,23955] 0 2024-02-10T00:00:33.673 INFO:tasks.workunit.client.0.smithi164.stdout:4/323: dread - d2/d2f/d37/d41/d3d/f5c zero size 2024-02-10T00:00:33.674 INFO:tasks.workunit.client.0.smithi164.stdout:0/307: dwrite d6/d10/d18/d2d/f2f [0,4194304] 0 2024-02-10T00:00:33.675 INFO:tasks.workunit.client.1.smithi183.stdout:3/603: mknod d7/db/d2a/d33/d59/daa/cb2 0 2024-02-10T00:00:33.675 INFO:tasks.workunit.client.0.smithi164.stdout:1/260: rmdir d1 39 2024-02-10T00:00:33.676 INFO:tasks.workunit.client.1.smithi183.stdout:9/689: dwrite d0/d10/fb4 [0,4194304] 0 2024-02-10T00:00:33.677 INFO:tasks.workunit.client.0.smithi164.stdout:5/363: mknod d7/c75 0 2024-02-10T00:00:33.678 INFO:tasks.workunit.client.1.smithi183.stdout:5/739: unlink d4/d23/d3e/d80/da1/d9e/d27/d38/f61 0 2024-02-10T00:00:33.680 INFO:tasks.workunit.client.1.smithi183.stdout:5/740: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fb5 [1004514,99512] 0 2024-02-10T00:00:33.681 INFO:tasks.workunit.client.1.smithi183.stdout:8/754: mkdir d0/d27/d36/de3/ded 0 2024-02-10T00:00:33.682 INFO:tasks.workunit.client.0.smithi164.stdout:8/325: unlink d2/d50/d31/d32/f34 0 2024-02-10T00:00:33.683 INFO:tasks.workunit.client.0.smithi164.stdout:8/326: chown d2/lf 13518714 1 2024-02-10T00:00:33.683 INFO:tasks.workunit.client.1.smithi183.stdout:6/587: creat d2/d1a/d25/d3c/faf x:0 0 0 2024-02-10T00:00:33.685 INFO:tasks.workunit.client.1.smithi183.stdout:8/755: dwrite d0/d3f/db2/d24/f7a [4194304,4194304] 0 2024-02-10T00:00:33.687 INFO:tasks.workunit.client.1.smithi183.stdout:3/604: chown d7/db/d2a/d1c/f7a 22 1 2024-02-10T00:00:33.688 INFO:tasks.workunit.client.1.smithi183.stdout:3/605: chown d7/l29 7 1 2024-02-10T00:00:33.688 INFO:tasks.workunit.client.1.smithi183.stdout:3/606: fsync d7/db/d2a/f88 0 2024-02-10T00:00:33.692 INFO:tasks.workunit.client.0.smithi164.stdout:2/361: symlink d3/d26/d56/l87 0 2024-02-10T00:00:33.692 INFO:tasks.workunit.client.0.smithi164.stdout:4/324: mknod d2/d19/c75 0 2024-02-10T00:00:33.693 INFO:tasks.workunit.client.1.smithi183.stdout:1/617: mknod d0/cdc 0 2024-02-10T00:00:33.695 INFO:tasks.workunit.client.1.smithi183.stdout:0/668: link d14/d1d/d2d/d31/d68/da3/lef d14/d43/dee/lf7 0 2024-02-10T00:00:33.695 INFO:tasks.workunit.client.0.smithi164.stdout:5/364: symlink d7/d17/d21/d23/d37/d36/l76 0 2024-02-10T00:00:33.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/365: stat d7/d17/d21/d24/f3d 0 2024-02-10T00:00:33.696 INFO:tasks.workunit.client.0.smithi164.stdout:5/366: chown d7/d17/d21/d23/d5a/d68/d1f/l41 166406 1 2024-02-10T00:00:33.698 INFO:tasks.workunit.client.0.smithi164.stdout:7/394: mknod d3/d11/d39/d44/d48/c8a 0 2024-02-10T00:00:33.701 INFO:tasks.workunit.client.1.smithi183.stdout:2/809: creat d2/d2c/d2f/f115 x:0 0 0 2024-02-10T00:00:33.702 INFO:tasks.workunit.client.1.smithi183.stdout:2/810: dread - d2/d2c/d2f/d72/ffc zero size 2024-02-10T00:00:33.702 INFO:tasks.workunit.client.0.smithi164.stdout:1/261: mknod d1/d23/c59 0 2024-02-10T00:00:33.703 INFO:tasks.workunit.client.1.smithi183.stdout:8/756: mkdir d0/d3f/db2/dee 0 2024-02-10T00:00:33.703 INFO:tasks.workunit.client.0.smithi164.stdout:2/362: mkdir d3/d32/d4e/d27/d2e/d88 0 2024-02-10T00:00:33.703 INFO:tasks.workunit.client.1.smithi183.stdout:1/618: symlink d0/d3/d7/d36/ldd 0 2024-02-10T00:00:33.704 INFO:tasks.workunit.client.1.smithi183.stdout:8/757: write d0/d3f/db2/d24/fd3 [416644,106689] 0 2024-02-10T00:00:33.704 INFO:tasks.workunit.client.0.smithi164.stdout:2/363: dread d3/d32/d4e/d27/f2d [0,4194304] 0 2024-02-10T00:00:33.706 INFO:tasks.workunit.client.0.smithi164.stdout:5/367: unlink d7/d17/d21/d24/f64 0 2024-02-10T00:00:33.706 INFO:tasks.workunit.client.1.smithi183.stdout:0/669: creat d14/d1d/d2d/d31/d68/dcc/ff8 x:0 0 0 2024-02-10T00:00:33.707 INFO:tasks.workunit.client.1.smithi183.stdout:5/741: creat d4/d23/d3e/d80/da1/d9e/d27/ff4 x:0 0 0 2024-02-10T00:00:33.707 INFO:tasks.workunit.client.0.smithi164.stdout:7/395: creat d3/d5/f8b x:0 0 0 2024-02-10T00:00:33.708 INFO:tasks.workunit.client.1.smithi183.stdout:3/607: truncate d7/db/d2a/d2d/f31 4887420 0 2024-02-10T00:00:33.708 INFO:tasks.workunit.client.0.smithi164.stdout:6/430: link d0/d2b/c48 d0/d2b/d3a/d3d/d6d/c85 0 2024-02-10T00:00:33.708 INFO:tasks.workunit.client.0.smithi164.stdout:7/396: dread - d3/d5/f8b zero size 2024-02-10T00:00:33.709 INFO:tasks.workunit.client.0.smithi164.stdout:7/397: dread - d3/d11/d39/d44/d48/f78 zero size 2024-02-10T00:00:33.710 INFO:tasks.workunit.client.1.smithi183.stdout:6/588: rename d2/d1a/d25/d3c/d31/d38/f9a to d2/fb0 0 2024-02-10T00:00:33.711 INFO:tasks.workunit.client.1.smithi183.stdout:2/811: creat d2/da/d77/d114/f116 x:0 0 0 2024-02-10T00:00:33.711 INFO:tasks.workunit.client.0.smithi164.stdout:1/262: creat d1/d13/d2b/f5a x:0 0 0 2024-02-10T00:00:33.711 INFO:tasks.workunit.client.1.smithi183.stdout:9/690: dread d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:33.713 INFO:tasks.workunit.client.0.smithi164.stdout:5/368: truncate d7/d17/d21/d23/f2d 532249 0 2024-02-10T00:00:33.714 INFO:tasks.workunit.client.0.smithi164.stdout:7/398: dwrite d3/d5/d2b/d4a/f6b [0,4194304] 0 2024-02-10T00:00:33.715 INFO:tasks.workunit.client.1.smithi183.stdout:3/608: mkdir d7/db/d2a/d2d/d51/db3 0 2024-02-10T00:00:33.715 INFO:tasks.workunit.client.1.smithi183.stdout:4/741: sync 2024-02-10T00:00:33.716 INFO:tasks.workunit.client.0.smithi164.stdout:6/431: unlink d0/d2b/f39 0 2024-02-10T00:00:33.717 INFO:tasks.workunit.client.1.smithi183.stdout:2/812: mknod d2/da/d20/d21/d43/d58/d74/c117 0 2024-02-10T00:00:33.717 INFO:tasks.workunit.client.1.smithi183.stdout:2/813: stat d2/da/d20/d21/d36/dfa 0 2024-02-10T00:00:33.718 INFO:tasks.workunit.client.1.smithi183.stdout:0/670: symlink d14/d1d/d2d/d31/d68/lf9 0 2024-02-10T00:00:33.718 INFO:tasks.workunit.client.0.smithi164.stdout:8/327: getdents d2/d50/d31/d32/d4d 0 2024-02-10T00:00:33.718 INFO:tasks.workunit.client.0.smithi164.stdout:8/328: dread - d2/d12/f48 zero size 2024-02-10T00:00:33.718 INFO:tasks.workunit.client.0.smithi164.stdout:8/329: readlink d2/d50/l43 0 2024-02-10T00:00:33.719 INFO:tasks.workunit.client.1.smithi183.stdout:5/742: mknod d4/d23/d3e/d80/da1/d9e/d27/d5d/cf5 0 2024-02-10T00:00:33.721 INFO:tasks.workunit.client.0.smithi164.stdout:8/330: dread d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:33.723 INFO:tasks.workunit.client.1.smithi183.stdout:4/742: rename de/d22/f25 to de/d14/d27/d2e/fe9 0 2024-02-10T00:00:33.723 INFO:tasks.workunit.client.0.smithi164.stdout:2/364: truncate d3/d26/d64/f75 977524 0 2024-02-10T00:00:33.724 INFO:tasks.workunit.client.0.smithi164.stdout:6/432: mknod d0/d6/d12/d14/d4b/c86 0 2024-02-10T00:00:33.725 INFO:tasks.workunit.client.0.smithi164.stdout:7/399: truncate d3/d28/d45/d4b/f6d 508699 0 2024-02-10T00:00:33.725 INFO:tasks.workunit.client.1.smithi183.stdout:0/671: mkdir d14/d1d/d55/dfa 0 2024-02-10T00:00:33.726 INFO:tasks.workunit.client.0.smithi164.stdout:8/331: dwrite d2/f49 [0,4194304] 0 2024-02-10T00:00:33.728 INFO:tasks.workunit.client.1.smithi183.stdout:4/743: write de/d14/da4/fbf [596773,11711] 0 2024-02-10T00:00:33.728 INFO:tasks.workunit.client.1.smithi183.stdout:2/814: getdents d2/da/d20/d21/d36/dfa 0 2024-02-10T00:00:33.729 INFO:tasks.workunit.client.1.smithi183.stdout:4/744: write de/d14/d4e/fa1 [636668,86308] 0 2024-02-10T00:00:33.730 INFO:tasks.workunit.client.1.smithi183.stdout:0/672: mkdir d14/d1d/d59/d71/dfb 0 2024-02-10T00:00:33.730 INFO:tasks.workunit.client.0.smithi164.stdout:3/296: dread d0/d1/dd/f52 [0,4194304] 0 2024-02-10T00:00:33.730 INFO:tasks.workunit.client.0.smithi164.stdout:6/433: dwrite d0/d6/f28 [4194304,4194304] 0 2024-02-10T00:00:33.731 INFO:tasks.workunit.client.1.smithi183.stdout:0/673: write d14/f37 [809385,38990] 0 2024-02-10T00:00:33.731 INFO:tasks.workunit.client.0.smithi164.stdout:3/297: write d0/d1/d3c/d3d/f47 [27957,5485] 0 2024-02-10T00:00:33.731 INFO:tasks.workunit.client.1.smithi183.stdout:2/815: rename d2/d2c/d2f/d60 to d2/d2c/d2f/d60/d8d/d9c/d118 22 2024-02-10T00:00:33.732 INFO:tasks.workunit.client.0.smithi164.stdout:6/434: creat d0/d2b/d3a/f87 x:0 0 0 2024-02-10T00:00:33.733 INFO:tasks.workunit.client.0.smithi164.stdout:9/357: sync 2024-02-10T00:00:33.733 INFO:tasks.workunit.client.1.smithi183.stdout:0/674: rmdir d14/d1d/d2d/d31/d6c/de3 39 2024-02-10T00:00:33.734 INFO:tasks.workunit.client.1.smithi183.stdout:0/675: dread - d14/d1d/d2d/d31/d68/dcc/ff8 zero size 2024-02-10T00:00:33.734 INFO:tasks.workunit.client.1.smithi183.stdout:0/676: chown d14/d1d/d2d/d31/l67 35113 1 2024-02-10T00:00:33.735 INFO:tasks.workunit.client.0.smithi164.stdout:6/435: symlink d0/d2b/d3a/d3d/d42/d5d/d66/l88 0 2024-02-10T00:00:33.737 INFO:tasks.workunit.client.0.smithi164.stdout:9/358: dwrite d6/d4b/f57 [0,4194304] 0 2024-02-10T00:00:33.738 INFO:tasks.workunit.client.1.smithi183.stdout:2/816: dwrite d2/d2c/dba/df0/d8f/f93 [4194304,4194304] 0 2024-02-10T00:00:33.743 INFO:tasks.workunit.client.0.smithi164.stdout:9/359: getdents d6/de/d2b/d5b 0 2024-02-10T00:00:33.744 INFO:tasks.workunit.client.0.smithi164.stdout:9/360: fsync d6/f1e 0 2024-02-10T00:00:33.747 INFO:tasks.workunit.client.0.smithi164.stdout:9/361: creat d6/de/d3b/f6e x:0 0 0 2024-02-10T00:00:33.761 INFO:tasks.workunit.client.0.smithi164.stdout:1/263: sync 2024-02-10T00:00:33.764 INFO:tasks.workunit.client.0.smithi164.stdout:1/264: getdents d1/d1a/d35 0 2024-02-10T00:00:33.766 INFO:tasks.workunit.client.0.smithi164.stdout:1/265: creat d1/d1a/d41/d18/d33/f5b x:0 0 0 2024-02-10T00:00:33.773 INFO:tasks.workunit.client.0.smithi164.stdout:2/365: dread d3/f62 [0,4194304] 0 2024-02-10T00:00:33.777 INFO:tasks.workunit.client.0.smithi164.stdout:2/366: dread d3/d32/d4e/d27/d2e/d36/f5d [0,4194304] 0 2024-02-10T00:00:33.779 INFO:tasks.workunit.client.0.smithi164.stdout:2/367: fsync d3/f7 0 2024-02-10T00:00:33.779 INFO:tasks.workunit.client.0.smithi164.stdout:2/368: chown d3/d26/c4d 21306623 1 2024-02-10T00:00:33.782 INFO:tasks.workunit.client.1.smithi183.stdout:7/649: truncate d0/d11/d3e/f89 5102568 0 2024-02-10T00:00:33.782 INFO:tasks.workunit.client.0.smithi164.stdout:2/369: mknod d3/d32/d4e/d27/d2e/d36/c89 0 2024-02-10T00:00:33.786 INFO:tasks.workunit.client.1.smithi183.stdout:7/650: dwrite d0/d11/d2f/d64/d6b/f75 [0,4194304] 0 2024-02-10T00:00:33.787 INFO:tasks.workunit.client.0.smithi164.stdout:2/370: getdents d3/d32/d4e/d27/d2a/d7a 0 2024-02-10T00:00:33.789 INFO:tasks.workunit.client.0.smithi164.stdout:4/325: dwrite d2/d19/d16/d31/d57/f59 [0,4194304] 0 2024-02-10T00:00:33.791 INFO:tasks.workunit.client.0.smithi164.stdout:2/371: dread d3/f3e [0,4194304] 0 2024-02-10T00:00:33.792 INFO:tasks.workunit.client.0.smithi164.stdout:2/372: chown d3/d32/d4e/d27/d2e/c47 6502390 1 2024-02-10T00:00:33.792 INFO:tasks.workunit.client.1.smithi183.stdout:6/589: dwrite d2/d1a/d25/d3c/d31/d38/d87/f7c [0,4194304] 0 2024-02-10T00:00:33.793 INFO:tasks.workunit.client.0.smithi164.stdout:2/373: readlink d3/d32/d4e/d27/d2a/l6c 0 2024-02-10T00:00:33.793 INFO:tasks.workunit.client.1.smithi183.stdout:8/758: truncate d0/d3f/db2/f7b 3260548 0 2024-02-10T00:00:33.796 INFO:tasks.workunit.client.1.smithi183.stdout:9/691: truncate d0/fc0 4700477 0 2024-02-10T00:00:33.797 INFO:tasks.workunit.client.1.smithi183.stdout:3/609: truncate d7/db/d2a/f65 3139696 0 2024-02-10T00:00:33.797 INFO:tasks.workunit.client.1.smithi183.stdout:4/745: truncate de/d14/d1d/f59 2086025 0 2024-02-10T00:00:33.799 INFO:tasks.workunit.client.1.smithi183.stdout:4/746: write de/d19/d20/de6/fbe [169796,124927] 0 2024-02-10T00:00:33.799 INFO:tasks.workunit.client.1.smithi183.stdout:5/743: dwrite d4/d23/dc4/fdf [0,4194304] 0 2024-02-10T00:00:33.800 INFO:tasks.workunit.client.1.smithi183.stdout:0/677: truncate d14/d1d/d2d/f8f 186362 0 2024-02-10T00:00:33.800 INFO:tasks.workunit.client.1.smithi183.stdout:2/817: write d2/da/fb [1363324,23417] 0 2024-02-10T00:00:33.801 INFO:tasks.workunit.client.1.smithi183.stdout:1/619: write d0/d3/d29/fad [1232460,64243] 0 2024-02-10T00:00:33.802 INFO:tasks.workunit.client.1.smithi183.stdout:2/818: readlink d2/da/d5b/l85 0 2024-02-10T00:00:33.807 INFO:tasks.workunit.client.0.smithi164.stdout:0/308: truncate d6/d10/d18/f31 4079322 0 2024-02-10T00:00:33.816 INFO:tasks.workunit.client.0.smithi164.stdout:5/369: dwrite d7/d17/d21/d23/d37/f4b [0,4194304] 0 2024-02-10T00:00:33.817 INFO:tasks.workunit.client.0.smithi164.stdout:7/400: write d3/f1d [4788155,45341] 0 2024-02-10T00:00:33.817 INFO:tasks.workunit.client.0.smithi164.stdout:5/370: fdatasync d7/d17/d21/d23/d5a/f74 0 2024-02-10T00:00:33.818 INFO:tasks.workunit.client.0.smithi164.stdout:8/332: write d2/d12/f17 [3327223,126386] 0 2024-02-10T00:00:33.820 INFO:tasks.workunit.client.0.smithi164.stdout:5/371: write d7/d17/d21/d23/d5a/d68/d1f/f44 [4344151,90373] 0 2024-02-10T00:00:33.821 INFO:tasks.workunit.client.0.smithi164.stdout:5/372: fsync d7/d17/d21/d23/d5a/d68/d1f/f61 0 2024-02-10T00:00:33.823 INFO:tasks.workunit.client.0.smithi164.stdout:3/298: write d0/f43 [672413,102666] 0 2024-02-10T00:00:33.824 INFO:tasks.workunit.client.0.smithi164.stdout:9/362: truncate d6/d1c/f2e 357410 0 2024-02-10T00:00:33.825 INFO:tasks.workunit.client.0.smithi164.stdout:7/401: read d3/f13 [791800,127105] 0 2024-02-10T00:00:33.826 INFO:tasks.workunit.client.0.smithi164.stdout:6/436: dwrite d0/d6/d12/f18 [0,4194304] 0 2024-02-10T00:00:33.828 INFO:tasks.workunit.client.0.smithi164.stdout:1/266: truncate d1/f6 3975599 0 2024-02-10T00:00:33.829 INFO:tasks.workunit.client.0.smithi164.stdout:1/267: write d1/f7 [2633807,68891] 0 2024-02-10T00:00:33.841 INFO:tasks.workunit.client.0.smithi164.stdout:2/374: mkdir d3/d32/d4e/d27/d2e/d8a 0 2024-02-10T00:00:33.844 INFO:tasks.workunit.client.0.smithi164.stdout:8/333: chown d2/l4f 4260 1 2024-02-10T00:00:33.844 INFO:tasks.workunit.client.0.smithi164.stdout:4/326: dwrite d2/d19/d16/f3a [0,4194304] 0 2024-02-10T00:00:33.846 INFO:tasks.workunit.client.0.smithi164.stdout:3/299: creat d0/d1/d3c/d3d/f58 x:0 0 0 2024-02-10T00:00:33.847 INFO:tasks.workunit.client.0.smithi164.stdout:3/300: dread - d0/d1/d3c/d3d/f58 zero size 2024-02-10T00:00:33.849 INFO:tasks.workunit.client.0.smithi164.stdout:9/363: unlink d6/d1c/f32 0 2024-02-10T00:00:33.855 INFO:tasks.workunit.client.0.smithi164.stdout:1/268: symlink d1/d1a/d35/l5c 0 2024-02-10T00:00:33.882 INFO:tasks.workunit.client.0.smithi164.stdout:8/334: mknod d2/d50/d31/d32/d4d/c5d 0 2024-02-10T00:00:33.882 INFO:tasks.workunit.client.0.smithi164.stdout:4/327: truncate d2/d2f/d37/d41/f34 172754 0 2024-02-10T00:00:33.883 INFO:tasks.workunit.client.0.smithi164.stdout:4/328: chown d2/d2f/d37/d41/d3d/f64 761047 1 2024-02-10T00:00:33.884 INFO:tasks.workunit.client.0.smithi164.stdout:3/301: symlink d0/d1/d3c/d3d/l59 0 2024-02-10T00:00:33.885 INFO:tasks.workunit.client.0.smithi164.stdout:3/302: chown d0/d1/dd/f1f 141471345 1 2024-02-10T00:00:33.885 INFO:tasks.workunit.client.0.smithi164.stdout:3/303: write d0/d1/d3c/d3d/f58 [700995,30258] 0 2024-02-10T00:00:33.886 INFO:tasks.workunit.client.0.smithi164.stdout:5/373: sync 2024-02-10T00:00:33.889 INFO:tasks.workunit.client.0.smithi164.stdout:1/269: creat d1/d13/d2b/d52/f5d x:0 0 0 2024-02-10T00:00:33.890 INFO:tasks.workunit.client.0.smithi164.stdout:5/374: dwrite d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:33.894 INFO:tasks.workunit.client.0.smithi164.stdout:0/309: creat d6/d10/d18/f67 x:0 0 0 2024-02-10T00:00:33.895 INFO:tasks.workunit.client.0.smithi164.stdout:2/375: mknod d3/d32/d4e/d27/c8b 0 2024-02-10T00:00:33.896 INFO:tasks.workunit.client.0.smithi164.stdout:4/329: mkdir d2/d19/d16/d31/d76 0 2024-02-10T00:00:33.901 INFO:tasks.workunit.client.0.smithi164.stdout:6/437: link d0/d6/d12/d14/d4b/c86 d0/d2b/d3a/d3d/c89 0 2024-02-10T00:00:33.901 INFO:tasks.workunit.client.0.smithi164.stdout:6/438: read - d0/d6/d12/d57/f7b zero size 2024-02-10T00:00:33.904 INFO:tasks.workunit.client.0.smithi164.stdout:5/375: chown d7/f32 66211755 1 2024-02-10T00:00:33.904 INFO:tasks.workunit.client.0.smithi164.stdout:5/376: stat l6 0 2024-02-10T00:00:33.905 INFO:tasks.workunit.client.0.smithi164.stdout:0/310: symlink d6/d7/d14/l68 0 2024-02-10T00:00:33.906 INFO:tasks.workunit.client.0.smithi164.stdout:8/335: mknod d2/d50/d54/c5e 0 2024-02-10T00:00:33.908 INFO:tasks.workunit.client.0.smithi164.stdout:2/376: rename d3/c35 to d3/d32/d4e/d27/d2a/c8c 0 2024-02-10T00:00:33.908 INFO:tasks.workunit.client.0.smithi164.stdout:2/377: stat d3/fe 0 2024-02-10T00:00:33.909 INFO:tasks.workunit.client.0.smithi164.stdout:7/402: truncate d3/d28/f61 1458904 0 2024-02-10T00:00:33.911 INFO:tasks.workunit.client.0.smithi164.stdout:1/270: write d1/d13/d1f/f28 [931240,33007] 0 2024-02-10T00:00:33.912 INFO:tasks.workunit.client.0.smithi164.stdout:0/311: rmdir d6/d10/d18/d2d/d35/d47 39 2024-02-10T00:00:33.913 INFO:tasks.workunit.client.1.smithi183.stdout:2/819: write d2/d2c/d2f/f3b [4263925,33235] 0 2024-02-10T00:00:33.913 INFO:tasks.workunit.client.0.smithi164.stdout:8/336: mkdir d2/d50/d54/d5f 0 2024-02-10T00:00:33.917 INFO:tasks.workunit.client.0.smithi164.stdout:8/337: dwrite d2/d50/d31/d32/d58/f5c [0,4194304] 0 2024-02-10T00:00:33.920 INFO:tasks.workunit.client.0.smithi164.stdout:5/377: rename d7/d17/d21/d24/c5b to d7/d17/d21/d23/d5a/d68/d1f/d70/c77 0 2024-02-10T00:00:33.920 INFO:tasks.workunit.client.0.smithi164.stdout:9/364: truncate d6/d1c/d24/f4d 891021 0 2024-02-10T00:00:33.921 INFO:tasks.workunit.client.0.smithi164.stdout:5/378: dread - d7/d17/d21/d23/d5a/d68/d1f/f4a zero size 2024-02-10T00:00:33.923 INFO:tasks.workunit.client.0.smithi164.stdout:3/304: truncate d0/f43 864530 0 2024-02-10T00:00:33.923 INFO:tasks.workunit.client.0.smithi164.stdout:3/305: fdatasync d0/f35 0 2024-02-10T00:00:33.924 INFO:tasks.workunit.client.0.smithi164.stdout:9/365: dread d6/de/f6a [0,4194304] 0 2024-02-10T00:00:33.924 INFO:tasks.workunit.client.0.smithi164.stdout:2/378: fsync d3/f11 0 2024-02-10T00:00:33.925 INFO:tasks.workunit.client.0.smithi164.stdout:2/379: write d3/f23 [381800,49018] 0 2024-02-10T00:00:33.929 INFO:tasks.workunit.client.0.smithi164.stdout:6/439: link d0/d2b/d3a/f53 d0/d6/d12/d43/f8a 0 2024-02-10T00:00:33.929 INFO:tasks.workunit.client.0.smithi164.stdout:1/271: mknod d1/d1a/d35/c5e 0 2024-02-10T00:00:33.929 INFO:tasks.workunit.client.0.smithi164.stdout:0/312: chown d6/d7/d14/c25 1 1 2024-02-10T00:00:33.930 INFO:tasks.workunit.client.0.smithi164.stdout:0/313: write d6/d10/d18/d1c/f2c [805558,20282] 0 2024-02-10T00:00:33.931 INFO:tasks.workunit.client.0.smithi164.stdout:0/314: chown d6/d7/d14/l16 0 1 2024-02-10T00:00:33.932 INFO:tasks.workunit.client.0.smithi164.stdout:8/338: unlink d2/f13 0 2024-02-10T00:00:33.933 INFO:tasks.workunit.client.0.smithi164.stdout:0/315: dread d6/d10/d18/d1c/f3b [0,4194304] 0 2024-02-10T00:00:33.933 INFO:tasks.workunit.client.1.smithi183.stdout:8/759: write d0/d10/f73 [505454,6957] 0 2024-02-10T00:00:33.935 INFO:tasks.workunit.client.0.smithi164.stdout:5/379: rename d7/l3a to d7/d17/d21/d23/d37/d36/l78 0 2024-02-10T00:00:33.936 INFO:tasks.workunit.client.1.smithi183.stdout:7/651: dwrite d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:33.937 INFO:tasks.workunit.client.0.smithi164.stdout:3/306: mknod d0/d1/d2/d17/d37/d3f/c5a 0 2024-02-10T00:00:33.938 INFO:tasks.workunit.client.0.smithi164.stdout:3/307: dread - d0/d1/d3c/d3d/f57 zero size 2024-02-10T00:00:33.940 INFO:tasks.workunit.client.0.smithi164.stdout:2/380: rmdir d3/d24/d5b 39 2024-02-10T00:00:33.946 INFO:tasks.workunit.client.0.smithi164.stdout:4/330: creat d2/d2f/f77 x:0 0 0 2024-02-10T00:00:33.950 INFO:tasks.workunit.client.1.smithi183.stdout:3/610: fdatasync d7/db/d2a/d2d/f31 0 2024-02-10T00:00:33.951 INFO:tasks.workunit.client.0.smithi164.stdout:0/316: fsync d6/f2a 0 2024-02-10T00:00:33.952 INFO:tasks.workunit.client.1.smithi183.stdout:3/611: write d7/db/d2a/f4a [918466,92998] 0 2024-02-10T00:00:33.952 INFO:tasks.workunit.client.0.smithi164.stdout:8/339: mkdir d2/d50/d31/d32/d4d/d60 0 2024-02-10T00:00:33.952 INFO:tasks.workunit.client.0.smithi164.stdout:5/380: stat d7/d17/d21/d23/d5a/d68/d1f/d70/c77 0 2024-02-10T00:00:33.953 INFO:tasks.workunit.client.0.smithi164.stdout:8/340: dread - d2/d50/d31/d32/d4d/f5a zero size 2024-02-10T00:00:33.954 INFO:tasks.workunit.client.1.smithi183.stdout:3/612: read d7/db/d2a/d33/f36 [30125,34794] 0 2024-02-10T00:00:33.955 INFO:tasks.workunit.client.1.smithi183.stdout:1/620: mknod d0/d3/d7/cde 0 2024-02-10T00:00:33.955 INFO:tasks.workunit.client.1.smithi183.stdout:3/613: fdatasync d7/db/d2a/d2d/d6a/f6c 0 2024-02-10T00:00:33.955 INFO:tasks.workunit.client.0.smithi164.stdout:7/403: truncate d3/d11/f82 213184 0 2024-02-10T00:00:33.956 INFO:tasks.workunit.client.1.smithi183.stdout:3/614: write d7/d98/fa3 [862653,21248] 0 2024-02-10T00:00:33.956 INFO:tasks.workunit.client.1.smithi183.stdout:1/621: dread - d0/d3/d7/d36/d7c/db1/fbe zero size 2024-02-10T00:00:33.957 INFO:tasks.workunit.client.1.smithi183.stdout:6/590: creat d2/d1a/d3a/d45/fb1 x:0 0 0 2024-02-10T00:00:33.958 INFO:tasks.workunit.client.0.smithi164.stdout:6/440: creat d0/d2b/d3a/d3d/d42/d5d/d79/f8b x:0 0 0 2024-02-10T00:00:33.958 INFO:tasks.workunit.client.1.smithi183.stdout:6/591: write d2/d1a/d25/d3c/faf [343355,2493] 0 2024-02-10T00:00:33.959 INFO:tasks.workunit.client.1.smithi183.stdout:4/747: truncate de/f7f 663159 0 2024-02-10T00:00:33.959 INFO:tasks.workunit.client.0.smithi164.stdout:3/308: mknod d0/d1/d2/d17/d37/d3f/d4e/c5b 0 2024-02-10T00:00:33.961 INFO:tasks.workunit.client.0.smithi164.stdout:2/381: dwrite d3/f18 [0,4194304] 0 2024-02-10T00:00:33.961 INFO:tasks.workunit.client.0.smithi164.stdout:5/381: rename d7/d17/d21/d5d to d7/d17/d79 0 2024-02-10T00:00:33.962 INFO:tasks.workunit.client.1.smithi183.stdout:0/678: creat d14/d7a/ffc x:0 0 0 2024-02-10T00:00:33.963 INFO:tasks.workunit.client.0.smithi164.stdout:1/272: creat d1/d1a/d41/f5f x:0 0 0 2024-02-10T00:00:33.963 INFO:tasks.workunit.client.0.smithi164.stdout:7/404: rmdir d3/d5/d2b 39 2024-02-10T00:00:33.963 INFO:tasks.workunit.client.1.smithi183.stdout:0/679: chown d14/d1d/d55/d6e/l8c 6818 1 2024-02-10T00:00:33.964 INFO:tasks.workunit.client.1.smithi183.stdout:3/615: rmdir d7/db/d2a/d2d 39 2024-02-10T00:00:33.964 INFO:tasks.workunit.client.0.smithi164.stdout:4/331: dwrite d2/d2f/d37/d41/d3d/d42/f63 [0,4194304] 0 2024-02-10T00:00:33.965 INFO:tasks.workunit.client.1.smithi183.stdout:1/622: creat d0/d3/d67/fdf x:0 0 0 2024-02-10T00:00:33.967 INFO:tasks.workunit.client.0.smithi164.stdout:9/366: write d6/d1c/d24/d4f/f5a [1436999,97168] 0 2024-02-10T00:00:33.967 INFO:tasks.workunit.client.1.smithi183.stdout:4/748: creat de/d14/d27/d40/fea x:0 0 0 2024-02-10T00:00:33.967 INFO:tasks.workunit.client.0.smithi164.stdout:8/341: dread d2/d50/d31/d32/d4d/f4c [0,4194304] 0 2024-02-10T00:00:33.968 INFO:tasks.workunit.client.0.smithi164.stdout:3/309: mknod d0/d3b/c5c 0 2024-02-10T00:00:33.968 INFO:tasks.workunit.client.0.smithi164.stdout:8/342: chown d2/f41 7 1 2024-02-10T00:00:33.969 INFO:tasks.workunit.client.1.smithi183.stdout:7/652: unlink d0/d2/d50/dad/c9a 0 2024-02-10T00:00:33.970 INFO:tasks.workunit.client.0.smithi164.stdout:2/382: rmdir d3/d26/d64 39 2024-02-10T00:00:33.971 INFO:tasks.workunit.client.1.smithi183.stdout:9/692: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:33.972 INFO:tasks.workunit.client.0.smithi164.stdout:5/382: mknod d7/d17/d21/d23/d5a/c7a 0 2024-02-10T00:00:33.973 INFO:tasks.workunit.client.1.smithi183.stdout:5/744: link d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/fc3 d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded/ff6 0 2024-02-10T00:00:33.974 INFO:tasks.workunit.client.1.smithi183.stdout:0/680: truncate d14/d1d/d2d/d31/d6c/d70/f85 471241 0 2024-02-10T00:00:33.974 INFO:tasks.workunit.client.0.smithi164.stdout:7/405: dread d3/d11/d39/f47 [0,4194304] 0 2024-02-10T00:00:33.975 INFO:tasks.workunit.client.1.smithi183.stdout:3/616: chown d7/db/d2a/d2d/d51/dab 4358 1 2024-02-10T00:00:33.976 INFO:tasks.workunit.client.1.smithi183.stdout:3/617: write d7/db/d2a/d2d/f84 [4074307,12342] 0 2024-02-10T00:00:33.976 INFO:tasks.workunit.client.1.smithi183.stdout:2/820: rename d2/da/d77/f108 to d2/da/d20/d21/f119 0 2024-02-10T00:00:33.977 INFO:tasks.workunit.client.0.smithi164.stdout:0/317: creat d6/d10/f69 x:0 0 0 2024-02-10T00:00:33.981 INFO:tasks.workunit.client.0.smithi164.stdout:8/343: creat d2/d50/f61 x:0 0 0 2024-02-10T00:00:33.982 INFO:tasks.workunit.client.0.smithi164.stdout:3/310: mknod d0/d1/d2/d19/c5d 0 2024-02-10T00:00:33.982 INFO:tasks.workunit.client.1.smithi183.stdout:3/618: mknod d7/db/d2a/d33/d59/daa/cb4 0 2024-02-10T00:00:33.983 INFO:tasks.workunit.client.1.smithi183.stdout:3/619: chown d7/db/f47 313 1 2024-02-10T00:00:33.983 INFO:tasks.workunit.client.1.smithi183.stdout:6/592: truncate d2/d1a/d25/f8e 798735 0 2024-02-10T00:00:33.984 INFO:tasks.workunit.client.1.smithi183.stdout:7/653: getdents d0/d2/d4/d8/dc1 0 2024-02-10T00:00:33.984 INFO:tasks.workunit.client.0.smithi164.stdout:1/273: mkdir d1/d13/d2b/d54/d60 0 2024-02-10T00:00:33.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/274: dread - d1/d13/d2b/f4a zero size 2024-02-10T00:00:33.986 INFO:tasks.workunit.client.0.smithi164.stdout:4/332: truncate d2/d2f/d37/d41/f34 262285 0 2024-02-10T00:00:33.987 INFO:tasks.workunit.client.1.smithi183.stdout:8/760: rename d0/d45/l86 to d0/d4e/d6b/lef 0 2024-02-10T00:00:33.987 INFO:tasks.workunit.client.0.smithi164.stdout:2/383: dwrite d3/d32/d4e/d27/d2e/d36/d54/f55 [0,4194304] 0 2024-02-10T00:00:33.989 INFO:tasks.workunit.client.0.smithi164.stdout:8/344: mknod d2/d50/d31/d32/d4d/c62 0 2024-02-10T00:00:33.989 INFO:tasks.workunit.client.0.smithi164.stdout:8/345: write d2/f29 [578310,39618] 0 2024-02-10T00:00:33.990 INFO:tasks.workunit.client.1.smithi183.stdout:6/593: creat d2/d1a/d25/d3c/d31/d38/fb2 x:0 0 0 2024-02-10T00:00:33.991 INFO:tasks.workunit.client.1.smithi183.stdout:6/594: write d2/d1a/d25/d3c/d31/d38/d6e/f9d [48349,30622] 0 2024-02-10T00:00:33.991 INFO:tasks.workunit.client.1.smithi183.stdout:3/620: symlink d7/db/d2a/d2d/d51/d8f/lb5 0 2024-02-10T00:00:33.992 INFO:tasks.workunit.client.0.smithi164.stdout:1/275: mkdir d1/d23/d61 0 2024-02-10T00:00:33.992 INFO:tasks.workunit.client.1.smithi183.stdout:3/621: dread - d7/db/d2a/d33/d59/d52/f60 zero size 2024-02-10T00:00:33.992 INFO:tasks.workunit.client.0.smithi164.stdout:1/276: write d1/d13/d2b/d52/f5d [253373,83333] 0 2024-02-10T00:00:33.993 INFO:tasks.workunit.client.1.smithi183.stdout:7/654: symlink d0/d2/d4/d8/d59/d8a/lc7 0 2024-02-10T00:00:33.993 INFO:tasks.workunit.client.0.smithi164.stdout:0/318: link d6/f3d d6/d10/d66/f6a 0 2024-02-10T00:00:33.994 INFO:tasks.workunit.client.0.smithi164.stdout:0/319: chown d6/d7/d14/f1b 6617 1 2024-02-10T00:00:33.995 INFO:tasks.workunit.client.1.smithi183.stdout:4/749: rename de/d14/d27/d2e/f90 to de/d22/feb 0 2024-02-10T00:00:33.996 INFO:tasks.workunit.client.1.smithi183.stdout:2/821: link d2/d2c/d2f/d60/d8d/d9c/da7/ce0 d2/da/d20/d21/d36/dfa/c11a 0 2024-02-10T00:00:33.998 INFO:tasks.workunit.client.1.smithi183.stdout:9/693: dread d0/d3/d14/f20 [0,4194304] 0 2024-02-10T00:00:33.999 INFO:tasks.workunit.client.1.smithi183.stdout:5/745: rename d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/f62 to d4/d23/d3e/d80/d96/ff7 0 2024-02-10T00:00:34.000 INFO:tasks.workunit.client.0.smithi164.stdout:9/367: getdents d6/d1c 0 2024-02-10T00:00:34.000 INFO:tasks.workunit.client.0.smithi164.stdout:9/368: write d6/f35 [4058857,23125] 0 2024-02-10T00:00:34.003 INFO:tasks.workunit.client.0.smithi164.stdout:3/311: creat d0/f5e x:0 0 0 2024-02-10T00:00:34.004 INFO:tasks.workunit.client.0.smithi164.stdout:5/383: getdents d7/d17 0 2024-02-10T00:00:34.007 INFO:tasks.workunit.client.0.smithi164.stdout:3/312: mkdir d0/d1/d2/d19/d27/d5f 0 2024-02-10T00:00:34.008 INFO:tasks.workunit.client.0.smithi164.stdout:5/384: mkdir d7/d17/d79/d7b 0 2024-02-10T00:00:34.008 INFO:tasks.workunit.client.0.smithi164.stdout:9/369: dread d6/de/d40/f46 [0,4194304] 0 2024-02-10T00:00:34.009 INFO:tasks.workunit.client.0.smithi164.stdout:1/277: creat d1/d13/f62 x:0 0 0 2024-02-10T00:00:34.010 INFO:tasks.workunit.client.0.smithi164.stdout:1/278: read d1/d1a/f2c [2900891,98200] 0 2024-02-10T00:00:34.011 INFO:tasks.workunit.client.0.smithi164.stdout:3/313: truncate d0/d1/dd/f1f 2996662 0 2024-02-10T00:00:34.013 INFO:tasks.workunit.client.0.smithi164.stdout:5/385: creat d7/d17/d21/d23/d5a/d68/f7c x:0 0 0 2024-02-10T00:00:34.014 INFO:tasks.workunit.client.0.smithi164.stdout:9/370: dread d6/de/d22/f30 [0,4194304] 0 2024-02-10T00:00:34.015 INFO:tasks.workunit.client.0.smithi164.stdout:6/441: dread d0/f21 [0,4194304] 0 2024-02-10T00:00:34.016 INFO:tasks.workunit.client.0.smithi164.stdout:9/371: read d6/d1c/d24/f33 [3800725,16457] 0 2024-02-10T00:00:34.016 INFO:tasks.workunit.client.0.smithi164.stdout:9/372: readlink d6/l27 0 2024-02-10T00:00:34.018 INFO:tasks.workunit.client.0.smithi164.stdout:9/373: read d6/d1c/f2e [192497,114103] 0 2024-02-10T00:00:34.018 INFO:tasks.workunit.client.1.smithi183.stdout:1/623: getdents d0/d3/d7 0 2024-02-10T00:00:34.018 INFO:tasks.workunit.client.1.smithi183.stdout:4/750: chown de/d14/d27/d40/l70 112138763 1 2024-02-10T00:00:34.019 INFO:tasks.workunit.client.0.smithi164.stdout:4/333: dread d2/d2f/d37/d41/f34 [0,4194304] 0 2024-02-10T00:00:34.020 INFO:tasks.workunit.client.1.smithi183.stdout:1/624: chown d0/d3/d29/c16 423609751 1 2024-02-10T00:00:34.020 INFO:tasks.workunit.client.1.smithi183.stdout:7/655: mknod d0/d2/d3/cc8 0 2024-02-10T00:00:34.021 INFO:tasks.workunit.client.0.smithi164.stdout:4/334: readlink d2/d19/l14 0 2024-02-10T00:00:34.021 INFO:tasks.workunit.client.1.smithi183.stdout:1/625: chown d0/l2 791 1 2024-02-10T00:00:34.022 INFO:tasks.workunit.client.0.smithi164.stdout:0/320: fsync d6/d10/d66/f6a 0 2024-02-10T00:00:34.022 INFO:tasks.workunit.client.1.smithi183.stdout:9/694: creat d0/d3/d14/d1c/d2d/da3/fe0 x:0 0 0 2024-02-10T00:00:34.023 INFO:tasks.workunit.client.0.smithi164.stdout:6/442: dwrite d0/d6/d4d/f7d [0,4194304] 0 2024-02-10T00:00:34.023 INFO:tasks.workunit.client.1.smithi183.stdout:4/751: symlink de/lec 0 2024-02-10T00:00:34.024 INFO:tasks.workunit.client.1.smithi183.stdout:5/746: mknod d4/d23/d3e/d80/da1/d9c/d72/cf8 0 2024-02-10T00:00:34.024 INFO:tasks.workunit.client.0.smithi164.stdout:6/443: stat d0/d6/d4d/f7d 0 2024-02-10T00:00:34.025 INFO:tasks.workunit.client.0.smithi164.stdout:8/346: truncate d2/f49 5101276 0 2024-02-10T00:00:34.026 INFO:tasks.workunit.client.1.smithi183.stdout:0/681: dwrite d14/d1d/d59/d71/f56 [0,4194304] 0 2024-02-10T00:00:34.027 INFO:tasks.workunit.client.0.smithi164.stdout:9/374: dwrite d6/de/d22/f51 [0,4194304] 0 2024-02-10T00:00:34.027 INFO:tasks.workunit.client.0.smithi164.stdout:2/384: dread d3/d32/d4e/d27/d2e/f41 [0,4194304] 0 2024-02-10T00:00:34.028 INFO:tasks.workunit.client.1.smithi183.stdout:8/761: dwrite d0/d27/d75/d5b/d85/fb6 [0,4194304] 0 2024-02-10T00:00:34.028 INFO:tasks.workunit.client.0.smithi164.stdout:9/375: write d6/f7 [3210935,83472] 0 2024-02-10T00:00:34.029 INFO:tasks.workunit.client.1.smithi183.stdout:2/822: creat d2/da/f11b x:0 0 0 2024-02-10T00:00:34.029 INFO:tasks.workunit.client.0.smithi164.stdout:1/279: mknod d1/d13/c63 0 2024-02-10T00:00:34.029 INFO:tasks.workunit.client.0.smithi164.stdout:3/314: write d0/d1/d2/d19/f29 [296097,4486] 0 2024-02-10T00:00:34.030 INFO:tasks.workunit.client.1.smithi183.stdout:2/823: chown d2/d3d 11448 1 2024-02-10T00:00:34.031 INFO:tasks.workunit.client.1.smithi183.stdout:9/695: mkdir d0/d30/d52/ddc/de1 0 2024-02-10T00:00:34.032 INFO:tasks.workunit.client.1.smithi183.stdout:3/622: getdents d7/db/d2a/d4d 0 2024-02-10T00:00:34.032 INFO:tasks.workunit.client.1.smithi183.stdout:1/626: dwrite d0/d3/d67/d70/f81 [0,4194304] 0 2024-02-10T00:00:34.033 INFO:tasks.workunit.client.1.smithi183.stdout:4/752: chown de/d19/d1c/ce4 51489 1 2024-02-10T00:00:34.033 INFO:tasks.workunit.client.0.smithi164.stdout:4/335: creat d2/d2f/d37/d41/d3d/d42/f78 x:0 0 0 2024-02-10T00:00:34.034 INFO:tasks.workunit.client.1.smithi183.stdout:5/747: dwrite d4/d74/f7e [0,4194304] 0 2024-02-10T00:00:34.035 INFO:tasks.workunit.client.0.smithi164.stdout:6/444: creat d0/d6/d12/d14/f8c x:0 0 0 2024-02-10T00:00:34.036 INFO:tasks.workunit.client.1.smithi183.stdout:7/656: write d0/d2/f2b [1094488,71776] 0 2024-02-10T00:00:34.036 INFO:tasks.workunit.client.0.smithi164.stdout:7/406: dwrite d3/d11/f82 [0,4194304] 0 2024-02-10T00:00:34.037 INFO:tasks.workunit.client.0.smithi164.stdout:9/376: dwrite d6/d1c/d24/f60 [0,4194304] 0 2024-02-10T00:00:34.038 INFO:tasks.workunit.client.0.smithi164.stdout:9/377: chown d6/f7 0 1 2024-02-10T00:00:34.038 INFO:tasks.workunit.client.0.smithi164.stdout:9/378: chown d6/de/d40/d54 12 1 2024-02-10T00:00:34.040 INFO:tasks.workunit.client.0.smithi164.stdout:1/280: unlink d1/d1a/l2a 0 2024-02-10T00:00:34.041 INFO:tasks.workunit.client.1.smithi183.stdout:9/696: dread d0/d3/d14/d1c/d2d/d4f/fce [0,4194304] 0 2024-02-10T00:00:34.041 INFO:tasks.workunit.client.1.smithi183.stdout:4/753: dwrite de/d19/d1c/f36 [0,4194304] 0 2024-02-10T00:00:34.042 INFO:tasks.workunit.client.0.smithi164.stdout:3/315: unlink d0/f35 0 2024-02-10T00:00:34.042 INFO:tasks.workunit.client.1.smithi183.stdout:2/824: stat d2/d2c/l98 0 2024-02-10T00:00:34.043 INFO:tasks.workunit.client.0.smithi164.stdout:3/316: stat d0/c20 0 2024-02-10T00:00:34.044 INFO:tasks.workunit.client.1.smithi183.stdout:3/623: mkdir d7/db/d2a/d33/d59/db6 0 2024-02-10T00:00:34.046 INFO:tasks.workunit.client.1.smithi183.stdout:7/657: creat d0/d2/d4/d8/d59/fc9 x:0 0 0 2024-02-10T00:00:34.046 INFO:tasks.workunit.client.1.smithi183.stdout:8/762: dwrite d0/d23/f2a [4194304,4194304] 0 2024-02-10T00:00:34.047 INFO:tasks.workunit.client.0.smithi164.stdout:3/317: dwrite d0/d1/d3c/d3d/f47 [0,4194304] 0 2024-02-10T00:00:34.048 INFO:tasks.workunit.client.1.smithi183.stdout:9/697: unlink d0/f3a 0 2024-02-10T00:00:34.049 INFO:tasks.workunit.client.1.smithi183.stdout:6/595: sync 2024-02-10T00:00:34.049 INFO:tasks.workunit.client.0.smithi164.stdout:6/445: creat d0/d6/d12/d14/f8d x:0 0 0 2024-02-10T00:00:34.051 INFO:tasks.workunit.client.1.smithi183.stdout:6/596: read - d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae zero size 2024-02-10T00:00:34.051 INFO:tasks.workunit.client.1.smithi183.stdout:0/682: unlink d14/d1d/d55/d6e/d74/ff2 0 2024-02-10T00:00:34.052 INFO:tasks.workunit.client.0.smithi164.stdout:9/379: unlink d6/d1c/l66 0 2024-02-10T00:00:34.053 INFO:tasks.workunit.client.1.smithi183.stdout:0/683: fdatasync d14/d1d/d59/d71/d22/f48 0 2024-02-10T00:00:34.053 INFO:tasks.workunit.client.1.smithi183.stdout:0/684: read - d14/d1d/d59/fdc zero size 2024-02-10T00:00:34.054 INFO:tasks.workunit.client.0.smithi164.stdout:7/407: dwrite d3/d26/d67/f86 [0,4194304] 0 2024-02-10T00:00:34.054 INFO:tasks.workunit.client.1.smithi183.stdout:2/825: symlink d2/d2c/d2f/d60/d8d/d9c/da7/l11c 0 2024-02-10T00:00:34.054 INFO:tasks.workunit.client.0.smithi164.stdout:5/386: getdents d7/d17/d3b 0 2024-02-10T00:00:34.055 INFO:tasks.workunit.client.0.smithi164.stdout:4/336: creat d2/d2f/d37/d71/f79 x:0 0 0 2024-02-10T00:00:34.056 INFO:tasks.workunit.client.1.smithi183.stdout:5/748: rename d4/dd/fbd to d4/d23/d3e/d80/da1/d9e/d27/d9d/ff9 0 2024-02-10T00:00:34.058 INFO:tasks.workunit.client.0.smithi164.stdout:3/318: rename d0/d1/d2/d17/d37/l40 to d0/d3b/l60 0 2024-02-10T00:00:34.059 INFO:tasks.workunit.client.1.smithi183.stdout:8/763: creat d0/d45/d46/ff0 x:0 0 0 2024-02-10T00:00:34.060 INFO:tasks.workunit.client.0.smithi164.stdout:7/408: dwrite d3/d28/f35 [4194304,4194304] 0 2024-02-10T00:00:34.061 INFO:tasks.workunit.client.1.smithi183.stdout:8/764: dread - d0/d3f/db2/d24/fbb zero size 2024-02-10T00:00:34.061 INFO:tasks.workunit.client.1.smithi183.stdout:6/597: stat d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/c91 0 2024-02-10T00:00:34.061 INFO:tasks.workunit.client.1.smithi183.stdout:5/749: dwrite d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/f7b [0,4194304] 0 2024-02-10T00:00:34.062 INFO:tasks.workunit.client.0.smithi164.stdout:9/380: creat d6/de/d40/f6f x:0 0 0 2024-02-10T00:00:34.062 INFO:tasks.workunit.client.0.smithi164.stdout:5/387: dwrite d7/d17/d21/d23/d5a/d68/d1f/f4a [0,4194304] 0 2024-02-10T00:00:34.062 INFO:tasks.workunit.client.0.smithi164.stdout:5/388: chown d7/fd 3767 1 2024-02-10T00:00:34.064 INFO:tasks.workunit.client.1.smithi183.stdout:1/627: truncate d0/d3/d7/d36/d7c/db1/fbe 974167 0 2024-02-10T00:00:34.065 INFO:tasks.workunit.client.1.smithi183.stdout:6/598: dwrite d2/f7 [0,4194304] 0 2024-02-10T00:00:34.065 INFO:tasks.workunit.client.0.smithi164.stdout:6/446: mknod d0/d3b/d56/c8e 0 2024-02-10T00:00:34.068 INFO:tasks.workunit.client.0.smithi164.stdout:0/321: dread d6/d10/d18/d2d/f2e [0,4194304] 0 2024-02-10T00:00:34.068 INFO:tasks.workunit.client.0.smithi164.stdout:0/322: fdatasync d6/d10/f69 0 2024-02-10T00:00:34.069 INFO:tasks.workunit.client.0.smithi164.stdout:7/409: creat d3/d5/d59/f8c x:0 0 0 2024-02-10T00:00:34.069 INFO:tasks.workunit.client.0.smithi164.stdout:0/323: chown d6/d10/d18/d1c/f2c 136183 1 2024-02-10T00:00:34.070 INFO:tasks.workunit.client.0.smithi164.stdout:2/385: dread d3/d32/d4e/f5e [0,4194304] 0 2024-02-10T00:00:34.075 INFO:tasks.workunit.client.1.smithi183.stdout:2/826: mknod d2/d2c/d2f/d60/d8d/d9c/c11d 0 2024-02-10T00:00:34.076 INFO:tasks.workunit.client.1.smithi183.stdout:2/827: write d2/da/fee [3693976,68055] 0 2024-02-10T00:00:34.077 INFO:tasks.workunit.client.1.smithi183.stdout:9/698: truncate d0/d3/d14/d74/da8/fba 777792 0 2024-02-10T00:00:34.078 INFO:tasks.workunit.client.0.smithi164.stdout:4/337: creat d2/d19/d16/d31/d57/f7a x:0 0 0 2024-02-10T00:00:34.079 INFO:tasks.workunit.client.1.smithi183.stdout:3/624: rename d7/l39 to d7/db/d2a/d2d/lb7 0 2024-02-10T00:00:34.079 INFO:tasks.workunit.client.0.smithi164.stdout:2/386: fsync d3/d24/f52 0 2024-02-10T00:00:34.082 INFO:tasks.workunit.client.0.smithi164.stdout:9/381: rename d6/f1a to d6/f70 0 2024-02-10T00:00:34.087 INFO:tasks.workunit.client.0.smithi164.stdout:7/410: fsync d3/d5/d2b/d4a/f53 0 2024-02-10T00:00:34.087 INFO:tasks.workunit.client.0.smithi164.stdout:5/389: rename d7/d17/d21/d24/l40 to d7/d17/d21/l7d 0 2024-02-10T00:00:34.087 INFO:tasks.workunit.client.1.smithi183.stdout:5/750: symlink d4/d23/d2a/lfa 0 2024-02-10T00:00:34.087 INFO:tasks.workunit.client.1.smithi183.stdout:1/628: creat d0/d3/d7/d3d/d99/fe0 x:0 0 0 2024-02-10T00:00:34.088 INFO:tasks.workunit.client.1.smithi183.stdout:1/629: write d0/d3a/f80 [4848187,13633] 0 2024-02-10T00:00:34.088 INFO:tasks.workunit.client.1.smithi183.stdout:1/630: chown d0/d3/d7/d36/d7c 119 1 2024-02-10T00:00:34.089 INFO:tasks.workunit.client.0.smithi164.stdout:4/338: mkdir d2/d2f/d7b 0 2024-02-10T00:00:34.089 INFO:tasks.workunit.client.0.smithi164.stdout:4/339: write d2/d2f/f54 [499146,10420] 0 2024-02-10T00:00:34.089 INFO:tasks.workunit.client.0.smithi164.stdout:2/387: symlink d3/d26/l8d 0 2024-02-10T00:00:34.090 INFO:tasks.workunit.client.1.smithi183.stdout:0/685: rename d14/d1d/d2d/d31/d68/f6a to d14/d1d/d2d/d31/d6c/de3/ffd 0 2024-02-10T00:00:34.091 INFO:tasks.workunit.client.1.smithi183.stdout:2/828: mknod d2/da/d20/d21/d43/d58/d74/d10e/c11e 0 2024-02-10T00:00:34.091 INFO:tasks.workunit.client.0.smithi164.stdout:7/411: creat d3/d11/d39/f8d x:0 0 0 2024-02-10T00:00:34.092 INFO:tasks.workunit.client.1.smithi183.stdout:5/751: dwrite d4/d23/d2a/f40 [4194304,4194304] 0 2024-02-10T00:00:34.092 INFO:tasks.workunit.client.0.smithi164.stdout:5/390: mknod d7/d17/d21/d23/d5a/d68/c7e 0 2024-02-10T00:00:34.094 INFO:tasks.workunit.client.0.smithi164.stdout:4/340: creat d2/d2f/d37/d41/d3d/d42/f7c x:0 0 0 2024-02-10T00:00:34.095 INFO:tasks.workunit.client.1.smithi183.stdout:5/752: fdatasync d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/fe9 0 2024-02-10T00:00:34.096 INFO:tasks.workunit.client.0.smithi164.stdout:4/341: read d2/d2f/d37/d41/d3d/d42/f63 [1119813,74892] 0 2024-02-10T00:00:34.096 INFO:tasks.workunit.client.0.smithi164.stdout:0/324: rename d6/d7/d14/f27 to d6/d7/f6b 0 2024-02-10T00:00:34.096 INFO:tasks.workunit.client.0.smithi164.stdout:7/412: dwrite d3/d5/d59/f72 [4194304,4194304] 0 2024-02-10T00:00:34.098 INFO:tasks.workunit.client.1.smithi183.stdout:1/631: getdents d0/d3c/dc9 0 2024-02-10T00:00:34.098 INFO:tasks.workunit.client.1.smithi183.stdout:5/753: dread d4/d74/f7e [0,4194304] 0 2024-02-10T00:00:34.100 INFO:tasks.workunit.client.0.smithi164.stdout:5/391: dwrite d7/d17/d21/d23/d5a/d68/d1f/f4a [0,4194304] 0 2024-02-10T00:00:34.104 INFO:tasks.workunit.client.0.smithi164.stdout:2/388: rename d3/d32/d4e/d27/d2e to d3/d32/d4e/d27/d2a/d7a/d8e 0 2024-02-10T00:00:34.105 INFO:tasks.workunit.client.0.smithi164.stdout:4/342: fdatasync d2/d2f/d37/d41/f6e 0 2024-02-10T00:00:34.106 INFO:tasks.workunit.client.0.smithi164.stdout:4/343: fdatasync d2/d2f/d37/d41/d3d/d42/f78 0 2024-02-10T00:00:34.107 INFO:tasks.workunit.client.1.smithi183.stdout:5/754: creat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded/ffb x:0 0 0 2024-02-10T00:00:34.107 INFO:tasks.workunit.client.1.smithi183.stdout:1/632: truncate d0/d3/fa6 621766 0 2024-02-10T00:00:34.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/413: mknod d3/d5/c8e 0 2024-02-10T00:00:34.110 INFO:tasks.workunit.client.1.smithi183.stdout:5/755: dread d4/d23/d3e/d80/da1/d9e/d27/f2b [4194304,4194304] 0 2024-02-10T00:00:34.111 INFO:tasks.workunit.client.1.smithi183.stdout:5/756: write d4/d23/d3e/d80/da1/d9e/d27/fcb [333580,65326] 0 2024-02-10T00:00:34.111 INFO:tasks.workunit.client.1.smithi183.stdout:1/633: unlink d0/l82 0 2024-02-10T00:00:34.112 INFO:tasks.workunit.client.1.smithi183.stdout:5/757: dread - d4/d23/d3e/d80/da1/f8a zero size 2024-02-10T00:00:34.113 INFO:tasks.workunit.client.0.smithi164.stdout:2/389: creat d3/d24/d5b/f8f x:0 0 0 2024-02-10T00:00:34.114 INFO:tasks.workunit.client.0.smithi164.stdout:2/390: chown d3/d32/d4e/d27/d2a/d7a/d8e/d36/c7b 397 1 2024-02-10T00:00:34.115 INFO:tasks.workunit.client.1.smithi183.stdout:1/634: creat d0/d3/d7/d3d/dcb/fe1 x:0 0 0 2024-02-10T00:00:34.115 INFO:tasks.workunit.client.1.smithi183.stdout:1/635: chown d0/d3c/dc9/d86/lbc 1205776 1 2024-02-10T00:00:34.116 INFO:tasks.workunit.client.0.smithi164.stdout:5/392: creat d7/f7f x:0 0 0 2024-02-10T00:00:34.116 INFO:tasks.workunit.client.0.smithi164.stdout:7/414: symlink d3/d28/d51/l8f 0 2024-02-10T00:00:34.118 INFO:tasks.workunit.client.0.smithi164.stdout:0/325: getdents d6/d10/d18/d2d/d35/d44/d49 0 2024-02-10T00:00:34.119 INFO:tasks.workunit.client.1.smithi183.stdout:1/636: unlink d0/d3/d29/d38/fb5 0 2024-02-10T00:00:34.119 INFO:tasks.workunit.client.1.smithi183.stdout:5/758: truncate d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f69 2843899 0 2024-02-10T00:00:34.120 INFO:tasks.workunit.client.0.smithi164.stdout:5/393: dwrite d7/d17/f48 [0,4194304] 0 2024-02-10T00:00:34.121 INFO:tasks.workunit.client.1.smithi183.stdout:5/759: fdatasync d4/dd/d31/f83 0 2024-02-10T00:00:34.121 INFO:tasks.workunit.client.0.smithi164.stdout:4/344: rename d2/l2b to d2/d2f/l7d 0 2024-02-10T00:00:34.121 INFO:tasks.workunit.client.1.smithi183.stdout:1/637: truncate d0/d3/d7/f8d 828367 0 2024-02-10T00:00:34.122 INFO:tasks.workunit.client.0.smithi164.stdout:5/394: fsync d7/d17/d21/d24/f4c 0 2024-02-10T00:00:34.122 INFO:tasks.workunit.client.1.smithi183.stdout:0/686: dread d14/f17 [4194304,4194304] 0 2024-02-10T00:00:34.123 INFO:tasks.workunit.client.1.smithi183.stdout:1/638: symlink d0/d3/d7/d36/le2 0 2024-02-10T00:00:34.125 INFO:tasks.workunit.client.1.smithi183.stdout:9/699: sync 2024-02-10T00:00:34.125 INFO:tasks.workunit.client.1.smithi183.stdout:5/760: link d4/d23/d3e/d80/da1/d9e/d27/d38/f88 d4/d23/d3e/d80/da1/d9e/d27/d37/ffc 0 2024-02-10T00:00:34.126 INFO:tasks.workunit.client.1.smithi183.stdout:1/639: mknod d0/d3/d7/d3d/d60/dc2/ce3 0 2024-02-10T00:00:34.128 INFO:tasks.workunit.client.1.smithi183.stdout:1/640: write d0/d3c/f73 [4055158,42444] 0 2024-02-10T00:00:34.129 INFO:tasks.workunit.client.1.smithi183.stdout:1/641: readlink d0/l3e 0 2024-02-10T00:00:34.131 INFO:tasks.workunit.client.1.smithi183.stdout:5/761: dread d4/f79 [0,4194304] 0 2024-02-10T00:00:34.132 INFO:tasks.workunit.client.1.smithi183.stdout:1/642: mkdir d0/d3/d7/d3d/d60/d89/de4 0 2024-02-10T00:00:34.135 INFO:tasks.workunit.client.1.smithi183.stdout:1/643: symlink d0/d3c/le5 0 2024-02-10T00:00:34.150 INFO:tasks.workunit.client.0.smithi164.stdout:4/345: mkdir d2/d19/d16/d31/d7e 0 2024-02-10T00:00:34.151 INFO:tasks.workunit.client.0.smithi164.stdout:2/391: getdents d3/d32/d4e 0 2024-02-10T00:00:34.153 INFO:tasks.workunit.client.0.smithi164.stdout:0/326: rename d6/d43 to d6/d10/d4a/d60/d6c 0 2024-02-10T00:00:34.154 INFO:tasks.workunit.client.0.smithi164.stdout:0/327: chown d6/d7/d14/l68 100512 1 2024-02-10T00:00:34.156 INFO:tasks.workunit.client.0.smithi164.stdout:2/392: chown d3/d32/d4e/d27/d2a/c8c 499594478 1 2024-02-10T00:00:34.157 INFO:tasks.workunit.client.0.smithi164.stdout:0/328: creat d6/d10/d18/d2d/d35/d44/d49/f6d x:0 0 0 2024-02-10T00:00:34.157 INFO:tasks.workunit.client.0.smithi164.stdout:5/395: truncate d7/d17/d21/d23/f2d 1551275 0 2024-02-10T00:00:34.158 INFO:tasks.workunit.client.0.smithi164.stdout:2/393: mkdir d3/d32/d4e/d27/d2a/d7a/d8e/d36/d90 0 2024-02-10T00:00:34.159 INFO:tasks.workunit.client.0.smithi164.stdout:5/396: write d7/d17/d21/d23/d5a/d68/d1f/f4a [1185148,114023] 0 2024-02-10T00:00:34.184 INFO:tasks.workunit.client.1.smithi183.stdout:6/599: dread d2/d1a/d25/d3c/d31/f70 [4194304,4194304] 0 2024-02-10T00:00:34.184 INFO:tasks.workunit.client.0.smithi164.stdout:0/329: read d6/d10/d18/d2d/f51 [293628,28566] 0 2024-02-10T00:00:34.184 INFO:tasks.workunit.client.0.smithi164.stdout:5/397: dread d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:34.185 INFO:tasks.workunit.client.1.smithi183.stdout:6/600: write d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [694888,19214] 0 2024-02-10T00:00:34.188 INFO:tasks.workunit.client.1.smithi183.stdout:7/658: fsync d0/d2/d4/d8/d59/fc9 0 2024-02-10T00:00:34.189 INFO:tasks.workunit.client.1.smithi183.stdout:6/601: dwrite d2/f19 [0,4194304] 0 2024-02-10T00:00:34.190 INFO:tasks.workunit.client.0.smithi164.stdout:5/398: dread d7/d17/d21/d23/d5a/d68/d1f/f4a [0,4194304] 0 2024-02-10T00:00:34.190 INFO:tasks.workunit.client.0.smithi164.stdout:8/347: dwrite d2/d50/d31/d32/f4b [0,4194304] 0 2024-02-10T00:00:34.190 INFO:tasks.workunit.client.1.smithi183.stdout:6/602: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lad 63554 1 2024-02-10T00:00:34.190 INFO:tasks.workunit.client.1.smithi183.stdout:6/603: fsync d2/f5a 0 2024-02-10T00:00:34.193 INFO:tasks.workunit.client.1.smithi183.stdout:4/754: write de/d19/d20/f5e [357027,81790] 0 2024-02-10T00:00:34.195 INFO:tasks.workunit.client.1.smithi183.stdout:8/765: write d0/d3f/db2/d24/f69 [335978,82532] 0 2024-02-10T00:00:34.196 INFO:tasks.workunit.client.0.smithi164.stdout:1/281: truncate d1/f7 1651016 0 2024-02-10T00:00:34.198 INFO:tasks.workunit.client.1.smithi183.stdout:4/755: symlink de/d14/d1d/d2f/da2/db6/led 0 2024-02-10T00:00:34.199 INFO:tasks.workunit.client.1.smithi183.stdout:4/756: readlink de/d14/d27/lb0 0 2024-02-10T00:00:34.199 INFO:tasks.workunit.client.1.smithi183.stdout:4/757: dread - de/fae zero size 2024-02-10T00:00:34.199 INFO:tasks.workunit.client.1.smithi183.stdout:7/659: creat d0/d11/fca x:0 0 0 2024-02-10T00:00:34.200 INFO:tasks.workunit.client.0.smithi164.stdout:6/447: write d0/f17 [3290633,112001] 0 2024-02-10T00:00:34.200 INFO:tasks.workunit.client.1.smithi183.stdout:4/758: dread - de/d14/d27/f8b zero size 2024-02-10T00:00:34.200 INFO:tasks.workunit.client.1.smithi183.stdout:6/604: creat d2/fb3 x:0 0 0 2024-02-10T00:00:34.201 INFO:tasks.workunit.client.1.smithi183.stdout:7/660: write d0/d11/d2f/da3/fb2 [556739,54487] 0 2024-02-10T00:00:34.204 INFO:tasks.workunit.client.1.smithi183.stdout:0/687: dread d14/d1d/d2d/d31/f91 [0,4194304] 0 2024-02-10T00:00:34.205 INFO:tasks.workunit.client.1.smithi183.stdout:0/688: dread - d14/d1d/d2d/d31/d6c/de3/fb8 zero size 2024-02-10T00:00:34.205 INFO:tasks.workunit.client.1.smithi183.stdout:0/689: dread - d14/d7a/ff1 zero size 2024-02-10T00:00:34.206 INFO:tasks.workunit.client.0.smithi164.stdout:4/346: rmdir d2/d19/d16/d31/d57 39 2024-02-10T00:00:34.206 INFO:tasks.workunit.client.1.smithi183.stdout:0/690: chown d14/d3e/cab 152505768 1 2024-02-10T00:00:34.213 INFO:tasks.workunit.client.1.smithi183.stdout:2/829: truncate d2/da/d20/f66 962823 0 2024-02-10T00:00:34.214 INFO:tasks.workunit.client.1.smithi183.stdout:2/830: write d2/d2c/dab/fe4 [3079858,70989] 0 2024-02-10T00:00:34.214 INFO:tasks.workunit.client.1.smithi183.stdout:6/605: mknod d2/d1a/d25/d3c/d31/d38/d6e/d93/cb4 0 2024-02-10T00:00:34.214 INFO:tasks.workunit.client.0.smithi164.stdout:2/394: write d3/d32/d4e/d27/d2a/d7a/d8e/d36/f43 [487841,21009] 0 2024-02-10T00:00:34.215 INFO:tasks.workunit.client.1.smithi183.stdout:6/606: write d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 [636850,4636] 0 2024-02-10T00:00:34.217 INFO:tasks.workunit.client.1.smithi183.stdout:6/607: read d2/fa4 [148108,97730] 0 2024-02-10T00:00:34.218 INFO:tasks.workunit.client.1.smithi183.stdout:6/608: stat d2/d1a/d3a 0 2024-02-10T00:00:34.218 INFO:tasks.workunit.client.0.smithi164.stdout:8/348: mkdir d2/d50/d63 0 2024-02-10T00:00:34.219 INFO:tasks.workunit.client.0.smithi164.stdout:8/349: dread - d2/f39 zero size 2024-02-10T00:00:34.219 INFO:tasks.workunit.client.0.smithi164.stdout:8/350: chown d2/d50/d31/d32 217 1 2024-02-10T00:00:34.220 INFO:tasks.workunit.client.0.smithi164.stdout:5/399: rename d7/d17/d21/d23/d5a/d68/c7e to d7/d17/c80 0 2024-02-10T00:00:34.222 INFO:tasks.workunit.client.0.smithi164.stdout:4/347: unlink d2/d19/d16/d31/d4b/f6f 0 2024-02-10T00:00:34.223 INFO:tasks.workunit.client.1.smithi183.stdout:0/691: rename d14/d1d/d55/f84 to d14/d1d/d59/d71/dfb/ffe 0 2024-02-10T00:00:34.224 INFO:tasks.workunit.client.1.smithi183.stdout:9/700: write d0/d3/d14/d1c/d2d/d4f/d79/f80 [1690280,28982] 0 2024-02-10T00:00:34.225 INFO:tasks.workunit.client.1.smithi183.stdout:9/701: chown d0/d3/d14/d1c/d2d/l37 4138 1 2024-02-10T00:00:34.226 INFO:tasks.workunit.client.1.smithi183.stdout:7/661: mkdir d0/d11/dcb 0 2024-02-10T00:00:34.226 INFO:tasks.workunit.client.1.smithi183.stdout:9/702: dread - d0/d3/d14/d1c/d2d/fd5 zero size 2024-02-10T00:00:34.227 INFO:tasks.workunit.client.0.smithi164.stdout:0/330: truncate d6/d10/d18/f67 216531 0 2024-02-10T00:00:34.227 INFO:tasks.workunit.client.1.smithi183.stdout:5/762: truncate d4/d23/d3e/d80/da1/d9e/d89/f9b 1281569 0 2024-02-10T00:00:34.227 INFO:tasks.workunit.client.1.smithi183.stdout:7/662: chown d0/d11/l99 9444898 1 2024-02-10T00:00:34.228 INFO:tasks.workunit.client.0.smithi164.stdout:1/282: getdents d1/d23/d61 0 2024-02-10T00:00:34.228 INFO:tasks.workunit.client.0.smithi164.stdout:7/415: sync 2024-02-10T00:00:34.229 INFO:tasks.workunit.client.0.smithi164.stdout:9/382: symlink d6/d1c/l71 0 2024-02-10T00:00:34.231 INFO:tasks.workunit.client.0.smithi164.stdout:4/348: write d2/d19/d16/d31/d57/f7a [254324,29412] 0 2024-02-10T00:00:34.231 INFO:tasks.workunit.client.1.smithi183.stdout:2/831: unlink d2/d2c/dab/d99/ddf/d105/fa5 0 2024-02-10T00:00:34.232 INFO:tasks.workunit.client.0.smithi164.stdout:0/331: creat d6/d10/d4a/d60/f6e x:0 0 0 2024-02-10T00:00:34.232 INFO:tasks.workunit.client.1.smithi183.stdout:5/763: readlink d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/l6e 0 2024-02-10T00:00:34.233 INFO:tasks.workunit.client.0.smithi164.stdout:1/283: rmdir d1/d1a/d41 39 2024-02-10T00:00:34.233 INFO:tasks.workunit.client.1.smithi183.stdout:0/692: dwrite d14/d1d/d2d/d31/d6c/f76 [0,4194304] 0 2024-02-10T00:00:34.235 INFO:tasks.workunit.client.1.smithi183.stdout:8/766: dread d0/d45/f66 [0,4194304] 0 2024-02-10T00:00:34.235 INFO:tasks.workunit.client.1.smithi183.stdout:1/644: dwrite d0/d3c/dc9/f28 [4194304,4194304] 0 2024-02-10T00:00:34.235 INFO:tasks.workunit.client.1.smithi183.stdout:7/663: symlink d0/d11/d2f/da3/lcc 0 2024-02-10T00:00:34.236 INFO:tasks.workunit.client.0.smithi164.stdout:2/395: link d3/d24/c85 d3/d32/d4e/d27/d2a/d7a/d8e/d36/c91 0 2024-02-10T00:00:34.236 INFO:tasks.workunit.client.0.smithi164.stdout:0/332: dread d6/d10/d18/d2d/f2f [0,4194304] 0 2024-02-10T00:00:34.237 INFO:tasks.workunit.client.1.smithi183.stdout:9/703: creat d0/d3/d14/d1c/d2d/d4f/db8/fe2 x:0 0 0 2024-02-10T00:00:34.238 INFO:tasks.workunit.client.0.smithi164.stdout:0/333: chown d6/d10/d18/d2d/d35 235010108 1 2024-02-10T00:00:34.239 INFO:tasks.workunit.client.0.smithi164.stdout:7/416: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:34.241 INFO:tasks.workunit.client.0.smithi164.stdout:0/334: chown d6/d10/d18/d2d/d35/c56 232325941 1 2024-02-10T00:00:34.241 INFO:tasks.workunit.client.0.smithi164.stdout:9/383: dwrite d6/d1c/d24/f2a [0,4194304] 0 2024-02-10T00:00:34.241 INFO:tasks.workunit.client.1.smithi183.stdout:3/625: dwrite d7/db/d2a/d33/d59/d52/f64 [0,4194304] 0 2024-02-10T00:00:34.242 INFO:tasks.workunit.client.0.smithi164.stdout:3/319: write d0/d1/dd/f1f [1572023,33310] 0 2024-02-10T00:00:34.242 INFO:tasks.workunit.client.0.smithi164.stdout:8/351: rename d2/d50 to d2/d64 0 2024-02-10T00:00:34.243 INFO:tasks.workunit.client.0.smithi164.stdout:8/352: chown d2/d64/d31/d32/d4d/d60 152350430 1 2024-02-10T00:00:34.243 INFO:tasks.workunit.client.1.smithi183.stdout:3/626: fdatasync d7/db/d2a/f3a 0 2024-02-10T00:00:34.246 INFO:tasks.workunit.client.1.smithi183.stdout:0/693: dwrite d14/d1d/d2d/d31/d68/dcc/ff8 [0,4194304] 0 2024-02-10T00:00:34.246 INFO:tasks.workunit.client.0.smithi164.stdout:0/335: dwrite d6/d3a/d52/f53 [0,4194304] 0 2024-02-10T00:00:34.247 INFO:tasks.workunit.client.1.smithi183.stdout:0/694: write d14/d7a/ffc [749249,124338] 0 2024-02-10T00:00:34.248 INFO:tasks.workunit.client.1.smithi183.stdout:4/759: dwrite de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:34.253 INFO:tasks.workunit.client.1.smithi183.stdout:6/609: write d2/d1a/d25/f8e [778260,21172] 0 2024-02-10T00:00:34.255 INFO:tasks.workunit.client.0.smithi164.stdout:5/400: truncate d7/d17/d3b/d43/f4e 6247 0 2024-02-10T00:00:34.255 INFO:tasks.workunit.client.1.smithi183.stdout:2/832: mkdir d2/d8b/d11f 0 2024-02-10T00:00:34.255 INFO:tasks.workunit.client.0.smithi164.stdout:4/349: getdents d2/d19/d16/d31/d72 0 2024-02-10T00:00:34.255 INFO:tasks.workunit.client.0.smithi164.stdout:7/417: creat d3/d11/d39/d44/f90 x:0 0 0 2024-02-10T00:00:34.256 INFO:tasks.workunit.client.0.smithi164.stdout:1/284: mkdir d1/d64 0 2024-02-10T00:00:34.258 INFO:tasks.workunit.client.1.smithi183.stdout:8/767: fsync d0/d23/f8c 0 2024-02-10T00:00:34.258 INFO:tasks.workunit.client.1.smithi183.stdout:6/610: dwrite d2/d1a/f6f [0,4194304] 0 2024-02-10T00:00:34.259 INFO:tasks.workunit.client.0.smithi164.stdout:9/384: symlink d6/de/d3b/l72 0 2024-02-10T00:00:34.260 INFO:tasks.workunit.client.0.smithi164.stdout:8/353: mkdir d2/d64/d65 0 2024-02-10T00:00:34.260 INFO:tasks.workunit.client.0.smithi164.stdout:9/385: chown d6/d4b/c4c 135366652 1 2024-02-10T00:00:34.260 INFO:tasks.workunit.client.0.smithi164.stdout:2/396: dwrite d3/d32/d4e/f5e [0,4194304] 0 2024-02-10T00:00:34.261 INFO:tasks.workunit.client.0.smithi164.stdout:8/354: chown d2/d64/d31 3974 1 2024-02-10T00:00:34.261 INFO:tasks.workunit.client.0.smithi164.stdout:8/355: chown d2/d64/f2f 104 1 2024-02-10T00:00:34.262 INFO:tasks.workunit.client.0.smithi164.stdout:6/448: link d0/d6/d12/d45/f65 d0/d2b/d3a/f8f 0 2024-02-10T00:00:34.262 INFO:tasks.workunit.client.0.smithi164.stdout:2/397: chown d3/d32/d4e/d27/d2a/d7a/d8e/d36/c5a 506970316 1 2024-02-10T00:00:34.263 INFO:tasks.workunit.client.0.smithi164.stdout:5/401: creat d7/d17/d21/d23/d37/d36/f81 x:0 0 0 2024-02-10T00:00:34.264 INFO:tasks.workunit.client.0.smithi164.stdout:4/350: symlink d2/d2f/d37/d41/d3d/l7f 0 2024-02-10T00:00:34.266 INFO:tasks.workunit.client.0.smithi164.stdout:6/449: write d0/d6/d12/d43/f44 [3346996,5140] 0 2024-02-10T00:00:34.266 INFO:tasks.workunit.client.0.smithi164.stdout:7/418: creat d3/d11/d39/d44/d48/d71/f91 x:0 0 0 2024-02-10T00:00:34.267 INFO:tasks.workunit.client.1.smithi183.stdout:3/627: mkdir d7/db/d2a/d2d/d51/db8 0 2024-02-10T00:00:34.268 INFO:tasks.workunit.client.0.smithi164.stdout:1/285: creat d1/d13/d2b/d54/f65 x:0 0 0 2024-02-10T00:00:34.268 INFO:tasks.workunit.client.0.smithi164.stdout:4/351: chown d2/d2f/d37/d41/l6c 13 1 2024-02-10T00:00:34.269 INFO:tasks.workunit.client.0.smithi164.stdout:0/336: dwrite d6/d10/d18/d2d/f5d [0,4194304] 0 2024-02-10T00:00:34.269 INFO:tasks.workunit.client.0.smithi164.stdout:7/419: chown d3/d5/d2b/c4f 35299874 1 2024-02-10T00:00:34.269 INFO:tasks.workunit.client.1.smithi183.stdout:2/833: rmdir d2/da/d20/d21/d43/d58/d74 39 2024-02-10T00:00:34.270 INFO:tasks.workunit.client.0.smithi164.stdout:8/356: dwrite d2/d64/d31/d32/f3e [0,4194304] 0 2024-02-10T00:00:34.271 INFO:tasks.workunit.client.1.smithi183.stdout:7/664: symlink d0/d11/d2f/dbf/lcd 0 2024-02-10T00:00:34.273 INFO:tasks.workunit.client.1.smithi183.stdout:7/665: write d0/d2/d4/f3c [3693181,13055] 0 2024-02-10T00:00:34.274 INFO:tasks.workunit.client.1.smithi183.stdout:7/666: dread - d0/d11/f98 zero size 2024-02-10T00:00:34.274 INFO:tasks.workunit.client.1.smithi183.stdout:2/834: dwrite d2/d8b/fb3 [0,4194304] 0 2024-02-10T00:00:34.276 INFO:tasks.workunit.client.1.smithi183.stdout:6/611: symlink d2/d1a/d25/d3c/d31/d38/lb5 0 2024-02-10T00:00:34.276 INFO:tasks.workunit.client.1.smithi183.stdout:3/628: readlink d7/db/d2a/d33/d59/d52/la1 0 2024-02-10T00:00:34.277 INFO:tasks.workunit.client.1.smithi183.stdout:5/764: creat d4/d23/d3e/d80/da1/d9e/d27/ffd x:0 0 0 2024-02-10T00:00:34.277 INFO:tasks.workunit.client.1.smithi183.stdout:4/760: truncate de/d22/feb 1346715 0 2024-02-10T00:00:34.278 INFO:tasks.workunit.client.1.smithi183.stdout:4/761: dread - de/d14/d27/f8b zero size 2024-02-10T00:00:34.281 INFO:tasks.workunit.client.0.smithi164.stdout:3/320: symlink d0/d1/dd/l61 0 2024-02-10T00:00:34.281 INFO:tasks.workunit.client.0.smithi164.stdout:5/402: dwrite d7/fc [0,4194304] 0 2024-02-10T00:00:34.281 INFO:tasks.workunit.client.1.smithi183.stdout:9/704: rmdir d0/d3/d14/d1c/d2d/d4f/d79/dd6 0 2024-02-10T00:00:34.282 INFO:tasks.workunit.client.1.smithi183.stdout:2/835: read - d2/d2c/d2f/d72/f97 zero size 2024-02-10T00:00:34.283 INFO:tasks.workunit.client.0.smithi164.stdout:2/398: read d3/f50 [1757436,108548] 0 2024-02-10T00:00:34.283 INFO:tasks.workunit.client.0.smithi164.stdout:2/399: dread - d3/f17 zero size 2024-02-10T00:00:34.283 INFO:tasks.workunit.client.0.smithi164.stdout:4/352: unlink d2/d2f/d37/d41/d3d/d42/f66 0 2024-02-10T00:00:34.285 INFO:tasks.workunit.client.0.smithi164.stdout:7/420: mkdir d3/d11/d39/d44/d48/d50/d92 0 2024-02-10T00:00:34.286 INFO:tasks.workunit.client.1.smithi183.stdout:0/695: creat d14/fff x:0 0 0 2024-02-10T00:00:34.286 INFO:tasks.workunit.client.0.smithi164.stdout:9/386: creat d6/d1c/d24/f73 x:0 0 0 2024-02-10T00:00:34.287 INFO:tasks.workunit.client.0.smithi164.stdout:5/403: rmdir d7/d17 39 2024-02-10T00:00:34.289 INFO:tasks.workunit.client.1.smithi183.stdout:6/612: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fb6 x:0 0 0 2024-02-10T00:00:34.289 INFO:tasks.workunit.client.0.smithi164.stdout:3/321: chown d0/d1/d3c/d3d/d51/c26 2902041 1 2024-02-10T00:00:34.289 INFO:tasks.workunit.client.1.smithi183.stdout:6/613: dread - d2/d1a/d25/d3c/d31/f8a zero size 2024-02-10T00:00:34.290 INFO:tasks.workunit.client.0.smithi164.stdout:7/421: dwrite d3/d5/d2b/d4a/f6b [0,4194304] 0 2024-02-10T00:00:34.292 INFO:tasks.workunit.client.0.smithi164.stdout:4/353: creat d2/d2f/d37/d41/d3d/d42/d47/f80 x:0 0 0 2024-02-10T00:00:34.292 INFO:tasks.workunit.client.1.smithi183.stdout:4/762: rename de/f11 to de/d14/d4e/fee 0 2024-02-10T00:00:34.293 INFO:tasks.workunit.client.0.smithi164.stdout:6/450: creat d0/d3b/f90 x:0 0 0 2024-02-10T00:00:34.294 INFO:tasks.workunit.client.1.smithi183.stdout:9/705: creat d0/d10/fe3 x:0 0 0 2024-02-10T00:00:34.295 INFO:tasks.workunit.client.1.smithi183.stdout:2/836: creat d2/d2c/dab/d99/f120 x:0 0 0 2024-02-10T00:00:34.295 INFO:tasks.workunit.client.0.smithi164.stdout:2/400: symlink d3/l92 0 2024-02-10T00:00:34.296 INFO:tasks.workunit.client.1.smithi183.stdout:0/696: creat d14/d1d/d59/f100 x:0 0 0 2024-02-10T00:00:34.296 INFO:tasks.workunit.client.1.smithi183.stdout:5/765: getdents d4/d23/d3e/d80/da1/d9e/d89/dd4/deb 0 2024-02-10T00:00:34.296 INFO:tasks.workunit.client.1.smithi183.stdout:6/614: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/f4f [0,4194304] 0 2024-02-10T00:00:34.297 INFO:tasks.workunit.client.0.smithi164.stdout:7/422: symlink d3/d11/d39/l93 0 2024-02-10T00:00:34.297 INFO:tasks.workunit.client.0.smithi164.stdout:7/423: readlink d3/d5/d2b/l70 0 2024-02-10T00:00:34.297 INFO:tasks.workunit.client.0.smithi164.stdout:0/337: truncate d6/d10/d18/d2d/d35/f41 520463 0 2024-02-10T00:00:34.298 INFO:tasks.workunit.client.0.smithi164.stdout:4/354: chown d2/d19/c33 178141414 1 2024-02-10T00:00:34.302 INFO:tasks.workunit.client.0.smithi164.stdout:7/424: creat d3/d11/d39/d3a/f94 x:0 0 0 2024-02-10T00:00:34.303 INFO:tasks.workunit.client.1.smithi183.stdout:3/629: creat d7/db/d2a/d33/fb9 x:0 0 0 2024-02-10T00:00:34.304 INFO:tasks.workunit.client.0.smithi164.stdout:9/387: truncate d6/d1c/d24/f5c 182077 0 2024-02-10T00:00:34.305 INFO:tasks.workunit.client.0.smithi164.stdout:5/404: creat d7/d17/d21/d23/d5a/d68/d1f/d59/f82 x:0 0 0 2024-02-10T00:00:34.307 INFO:tasks.workunit.client.0.smithi164.stdout:2/401: mknod d3/d32/d4e/d27/c93 0 2024-02-10T00:00:34.307 INFO:tasks.workunit.client.1.smithi183.stdout:3/630: dwrite d7/db/d2a/d33/d59/fac [0,4194304] 0 2024-02-10T00:00:34.307 INFO:tasks.workunit.client.1.smithi183.stdout:7/667: getdents d0/d11/d2f/da3 0 2024-02-10T00:00:34.308 INFO:tasks.workunit.client.0.smithi164.stdout:2/402: fdatasync d3/f1f 0 2024-02-10T00:00:34.308 INFO:tasks.workunit.client.0.smithi164.stdout:9/388: dwrite d6/f1e [0,4194304] 0 2024-02-10T00:00:34.310 INFO:tasks.workunit.client.0.smithi164.stdout:6/451: rename d0/d2b/d3a/d3d/d42/f75 to d0/d6/d12/f91 0 2024-02-10T00:00:34.310 INFO:tasks.workunit.client.1.smithi183.stdout:6/615: creat d2/d1a/d25/d3c/d8d/fb7 x:0 0 0 2024-02-10T00:00:34.311 INFO:tasks.workunit.client.0.smithi164.stdout:6/452: chown d0/d6/d12/d14/d4b/l6a 8153 1 2024-02-10T00:00:34.313 INFO:tasks.workunit.client.0.smithi164.stdout:5/405: creat d7/d17/f83 x:0 0 0 2024-02-10T00:00:34.313 INFO:tasks.workunit.client.0.smithi164.stdout:2/403: dwrite d3/d24/d51/f79 [0,4194304] 0 2024-02-10T00:00:34.314 INFO:tasks.workunit.client.1.smithi183.stdout:2/837: read d2/da/fee [3414732,50719] 0 2024-02-10T00:00:34.314 INFO:tasks.workunit.client.0.smithi164.stdout:0/338: creat d6/d7/f6f x:0 0 0 2024-02-10T00:00:34.315 INFO:tasks.workunit.client.1.smithi183.stdout:0/697: mkdir d14/d7a/d101 0 2024-02-10T00:00:34.315 INFO:tasks.workunit.client.1.smithi183.stdout:1/645: dread d0/d3/d67/f96 [0,4194304] 0 2024-02-10T00:00:34.315 INFO:tasks.workunit.client.1.smithi183.stdout:2/838: write d2/d2c/dba/df0/fdc [3303242,117831] 0 2024-02-10T00:00:34.316 INFO:tasks.workunit.client.0.smithi164.stdout:5/406: write d7/d17/d21/d23/d37/f4b [4381989,42022] 0 2024-02-10T00:00:34.316 INFO:tasks.workunit.client.0.smithi164.stdout:9/389: mkdir d6/de/d40/d74 0 2024-02-10T00:00:34.320 INFO:tasks.workunit.client.1.smithi183.stdout:6/616: getdents d2/da0 0 2024-02-10T00:00:34.323 INFO:tasks.workunit.client.1.smithi183.stdout:3/631: creat d7/db/fba x:0 0 0 2024-02-10T00:00:34.324 INFO:tasks.workunit.client.0.smithi164.stdout:6/453: rename d0/d6/d12/d43 to d0/d2b/d3a/d3d/d42/d5d/d79/d92 0 2024-02-10T00:00:34.324 INFO:tasks.workunit.client.0.smithi164.stdout:5/407: mkdir d7/d17/d3b/d45/d5c/d84 0 2024-02-10T00:00:34.324 INFO:tasks.workunit.client.0.smithi164.stdout:0/339: write d6/d10/d18/f31 [3180935,14359] 0 2024-02-10T00:00:34.325 INFO:tasks.workunit.client.1.smithi183.stdout:6/617: mknod d2/d1a/d25/d3c/d31/cb8 0 2024-02-10T00:00:34.326 INFO:tasks.workunit.client.0.smithi164.stdout:2/404: creat d3/d32/d4e/d27/f94 x:0 0 0 2024-02-10T00:00:34.326 INFO:tasks.workunit.client.0.smithi164.stdout:2/405: chown d3/f3e 53030 1 2024-02-10T00:00:34.327 INFO:tasks.workunit.client.1.smithi183.stdout:0/698: truncate d14/d1d/d2d/d31/f91 2193661 0 2024-02-10T00:00:34.327 INFO:tasks.workunit.client.1.smithi183.stdout:2/839: truncate d2/d2c/dab/d99/f120 795260 0 2024-02-10T00:00:34.328 INFO:tasks.workunit.client.1.smithi183.stdout:0/699: write d14/d1d/d55/fc2 [3665631,120354] 0 2024-02-10T00:00:34.329 INFO:tasks.workunit.client.1.smithi183.stdout:2/840: readlink d2/d2c/d2f/d60/d8d/d9c/da7/l11c 0 2024-02-10T00:00:34.333 INFO:tasks.workunit.client.0.smithi164.stdout:6/454: mkdir d0/d2b/d3a/d3d/d42/d5d/d79/d92/d93 0 2024-02-10T00:00:34.333 INFO:tasks.workunit.client.0.smithi164.stdout:5/408: mkdir d7/d17/d21/d85 0 2024-02-10T00:00:34.333 INFO:tasks.workunit.client.1.smithi183.stdout:2/841: write d2/da/d5b/f88 [646959,43466] 0 2024-02-10T00:00:34.333 INFO:tasks.workunit.client.1.smithi183.stdout:0/700: symlink d14/d1d/d59/d3c/d93/l102 0 2024-02-10T00:00:34.334 INFO:tasks.workunit.client.0.smithi164.stdout:7/425: read d3/d11/d39/d3a/f7d [3275179,96770] 0 2024-02-10T00:00:34.336 INFO:tasks.workunit.client.0.smithi164.stdout:8/357: sync 2024-02-10T00:00:34.337 INFO:tasks.workunit.client.0.smithi164.stdout:1/286: sync 2024-02-10T00:00:34.337 INFO:tasks.workunit.client.0.smithi164.stdout:5/409: creat d7/d17/d79/f86 x:0 0 0 2024-02-10T00:00:34.337 INFO:tasks.workunit.client.1.smithi183.stdout:0/701: mkdir d14/d3e/d5f/daa/ddd/d103 0 2024-02-10T00:00:34.337 INFO:tasks.workunit.client.1.smithi183.stdout:2/842: dwrite d2/da/f1d [4194304,4194304] 0 2024-02-10T00:00:34.338 INFO:tasks.workunit.client.1.smithi183.stdout:6/618: link d2/d1a/d25/d3c/d31/d38/d6e/d35/c44 d2/d1a/d25/cb9 0 2024-02-10T00:00:34.338 INFO:tasks.workunit.client.1.smithi183.stdout:0/702: fdatasync d14/d1d/d2d/f39 0 2024-02-10T00:00:34.339 INFO:tasks.workunit.client.0.smithi164.stdout:8/358: chown d2/d12/l14 8109 1 2024-02-10T00:00:34.339 INFO:tasks.workunit.client.0.smithi164.stdout:5/410: chown d7/d17/d21/d23/d5a 1240472222 1 2024-02-10T00:00:34.339 INFO:tasks.workunit.client.0.smithi164.stdout:6/455: symlink d0/d2b/d3a/d3d/d42/d5d/d79/l94 0 2024-02-10T00:00:34.339 INFO:tasks.workunit.client.0.smithi164.stdout:8/359: write d2/d64/d31/d32/f56 [844863,100365] 0 2024-02-10T00:00:34.339 INFO:tasks.workunit.client.1.smithi183.stdout:2/843: rmdir d2/d2c/dba/df0 39 2024-02-10T00:00:34.340 INFO:tasks.workunit.client.0.smithi164.stdout:4/355: dread d2/d2f/f21 [0,4194304] 0 2024-02-10T00:00:34.340 INFO:tasks.workunit.client.0.smithi164.stdout:4/356: dread - d2/d2f/d37/d41/f6e zero size 2024-02-10T00:00:34.341 INFO:tasks.workunit.client.0.smithi164.stdout:4/357: read - d2/d2f/d37/d41/d3d/d42/d47/f80 zero size 2024-02-10T00:00:34.341 INFO:tasks.workunit.client.1.smithi183.stdout:6/619: creat d2/d1a/d25/d3c/fba x:0 0 0 2024-02-10T00:00:34.344 INFO:tasks.workunit.client.1.smithi183.stdout:6/620: creat d2/d1a/fbb x:0 0 0 2024-02-10T00:00:34.345 INFO:tasks.workunit.client.0.smithi164.stdout:6/456: mkdir d0/d6/d95 0 2024-02-10T00:00:34.348 INFO:tasks.workunit.client.0.smithi164.stdout:8/360: mkdir d2/d64/d63/d66 0 2024-02-10T00:00:34.353 INFO:tasks.workunit.client.0.smithi164.stdout:5/411: getdents d7/d17/d69 0 2024-02-10T00:00:34.353 INFO:tasks.workunit.client.0.smithi164.stdout:4/358: getdents d2/d2f/d37/d41/d3d/d42/d5f 0 2024-02-10T00:00:34.354 INFO:tasks.workunit.client.0.smithi164.stdout:1/287: getdents d1/d1a/d41/d18/d33 0 2024-02-10T00:00:34.355 INFO:tasks.workunit.client.0.smithi164.stdout:1/288: fsync d1/d13/d1f/f28 0 2024-02-10T00:00:34.355 INFO:tasks.workunit.client.0.smithi164.stdout:8/361: truncate d2/d64/d31/d32/d4d/f5a 111362 0 2024-02-10T00:00:34.357 INFO:tasks.workunit.client.0.smithi164.stdout:4/359: unlink d2/d19/f29 0 2024-02-10T00:00:34.361 INFO:tasks.workunit.client.0.smithi164.stdout:4/360: mkdir d2/d19/d16/d31/d7e/d81 0 2024-02-10T00:00:34.361 INFO:tasks.workunit.client.0.smithi164.stdout:4/361: dread - d2/d2f/d37/d41/d3d/f5c zero size 2024-02-10T00:00:34.362 INFO:tasks.workunit.client.0.smithi164.stdout:8/362: creat d2/f67 x:0 0 0 2024-02-10T00:00:34.362 INFO:tasks.workunit.client.0.smithi164.stdout:4/362: stat d2/d19/l44 0 2024-02-10T00:00:34.362 INFO:tasks.workunit.client.0.smithi164.stdout:8/363: fdatasync d2/f67 0 2024-02-10T00:00:34.363 INFO:tasks.workunit.client.0.smithi164.stdout:4/363: write d2/d19/f11 [2502153,45733] 0 2024-02-10T00:00:34.364 INFO:tasks.workunit.client.0.smithi164.stdout:8/364: mkdir d2/d64/d31/d32/d68 0 2024-02-10T00:00:34.365 INFO:tasks.workunit.client.0.smithi164.stdout:4/364: mknod d2/d19/d16/d31/d72/c82 0 2024-02-10T00:00:34.366 INFO:tasks.workunit.client.0.smithi164.stdout:8/365: getdents d2/d64/d31/d32/d68 0 2024-02-10T00:00:34.367 INFO:tasks.workunit.client.0.smithi164.stdout:8/366: chown d2/d64/d31/d32/c45 2025109 1 2024-02-10T00:00:34.368 INFO:tasks.workunit.client.0.smithi164.stdout:4/365: truncate d2/d2f/d37/d41/f3e 836070 0 2024-02-10T00:00:34.372 INFO:tasks.workunit.client.0.smithi164.stdout:4/366: dwrite d2/d2f/d37/d41/f4e [0,4194304] 0 2024-02-10T00:00:34.373 INFO:tasks.workunit.client.1.smithi183.stdout:0/703: read d14/f37 [1419010,19991] 0 2024-02-10T00:00:34.377 INFO:tasks.workunit.client.0.smithi164.stdout:4/367: dwrite d2/d2f/f77 [0,4194304] 0 2024-02-10T00:00:34.378 INFO:tasks.workunit.client.0.smithi164.stdout:4/368: read f1 [1520566,119667] 0 2024-02-10T00:00:34.379 INFO:tasks.workunit.client.0.smithi164.stdout:4/369: fdatasync d2/d2f/d37/d41/d3d/d42/f5b 0 2024-02-10T00:00:34.379 INFO:tasks.workunit.client.0.smithi164.stdout:4/370: readlink d2/la 0 2024-02-10T00:00:34.380 INFO:tasks.workunit.client.0.smithi164.stdout:4/371: dread - d2/d2f/d37/d41/d3d/d42/f5b zero size 2024-02-10T00:00:34.382 INFO:tasks.workunit.client.0.smithi164.stdout:4/372: chown d2/d19/d16/l23 138 1 2024-02-10T00:00:34.385 INFO:tasks.workunit.client.0.smithi164.stdout:4/373: mkdir d2/d19/d16/d31/d83 0 2024-02-10T00:00:34.387 INFO:tasks.workunit.client.0.smithi164.stdout:4/374: rmdir d2/d2f/d7b 0 2024-02-10T00:00:34.388 INFO:tasks.workunit.client.0.smithi164.stdout:4/375: chown d2/d2f/d37/d41/f35 105 1 2024-02-10T00:00:34.390 INFO:tasks.workunit.client.0.smithi164.stdout:4/376: mkdir d2/d19/d16/d31/d7e/d84 0 2024-02-10T00:00:34.392 INFO:tasks.workunit.client.0.smithi164.stdout:4/377: mkdir d2/d2f/d37/d41/d3d/d56/d85 0 2024-02-10T00:00:34.394 INFO:tasks.workunit.client.0.smithi164.stdout:4/378: mknod d2/d2f/d37/d41/d3d/d56/c86 0 2024-02-10T00:00:34.394 INFO:tasks.workunit.client.0.smithi164.stdout:4/379: fsync d2/d2f/d37/d41/f46 0 2024-02-10T00:00:34.395 INFO:tasks.workunit.client.0.smithi164.stdout:4/380: write d2/d2f/d37/d41/d3d/d42/f5b [1005991,64129] 0 2024-02-10T00:00:34.397 INFO:tasks.workunit.client.0.smithi164.stdout:7/426: dread d3/f5f [0,4194304] 0 2024-02-10T00:00:34.398 INFO:tasks.workunit.client.0.smithi164.stdout:4/381: creat d2/d19/d16/d31/d7e/d81/f87 x:0 0 0 2024-02-10T00:00:34.399 INFO:tasks.workunit.client.0.smithi164.stdout:7/427: creat d3/d26/f95 x:0 0 0 2024-02-10T00:00:34.400 INFO:tasks.workunit.client.1.smithi183.stdout:6/621: sync 2024-02-10T00:00:34.401 INFO:tasks.workunit.client.1.smithi183.stdout:6/622: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/c8c 303 1 2024-02-10T00:00:34.416 INFO:tasks.workunit.client.1.smithi183.stdout:8/768: dwrite d0/d3f/db2/f21 [0,4194304] 0 2024-02-10T00:00:34.421 INFO:tasks.workunit.client.1.smithi183.stdout:8/769: mkdir d0/d4e/df1 0 2024-02-10T00:00:34.421 INFO:tasks.workunit.client.1.smithi183.stdout:8/770: read d0/d45/f66 [1852330,114481] 0 2024-02-10T00:00:34.423 INFO:tasks.workunit.client.1.smithi183.stdout:6/623: dread d2/d1a/d25/d3c/d31/d38/d3f/f4d [0,4194304] 0 2024-02-10T00:00:34.426 INFO:tasks.workunit.client.1.smithi183.stdout:8/771: dwrite d0/d3f/db2/f21 [0,4194304] 0 2024-02-10T00:00:34.431 INFO:tasks.workunit.client.0.smithi164.stdout:2/406: dread d3/f1f [0,4194304] 0 2024-02-10T00:00:34.431 INFO:tasks.workunit.client.1.smithi183.stdout:4/763: dread de/d22/f43 [0,4194304] 0 2024-02-10T00:00:34.432 INFO:tasks.workunit.client.0.smithi164.stdout:7/428: dread d3/f16 [0,4194304] 0 2024-02-10T00:00:34.432 INFO:tasks.workunit.client.0.smithi164.stdout:2/407: dread - d3/d32/d4e/f2f zero size 2024-02-10T00:00:34.433 INFO:tasks.workunit.client.0.smithi164.stdout:2/408: chown d3/d24/f52 2 1 2024-02-10T00:00:34.433 INFO:tasks.workunit.client.1.smithi183.stdout:6/624: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/fbc x:0 0 0 2024-02-10T00:00:34.433 INFO:tasks.workunit.client.1.smithi183.stdout:9/706: write d0/d10/f7c [1257795,77362] 0 2024-02-10T00:00:34.434 INFO:tasks.workunit.client.1.smithi183.stdout:7/668: write d0/d11/d3e/f89 [294342,118515] 0 2024-02-10T00:00:34.435 INFO:tasks.workunit.client.0.smithi164.stdout:2/409: dread d3/f1f [0,4194304] 0 2024-02-10T00:00:34.437 INFO:tasks.workunit.client.1.smithi183.stdout:5/766: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/f88 [0,4194304] 0 2024-02-10T00:00:34.439 INFO:tasks.workunit.client.0.smithi164.stdout:3/322: truncate d0/d1/dd/f1f 503946 0 2024-02-10T00:00:34.439 INFO:tasks.workunit.client.0.smithi164.stdout:7/429: fdatasync d3/d26/f31 0 2024-02-10T00:00:34.440 INFO:tasks.workunit.client.0.smithi164.stdout:7/430: fdatasync d3/d5/d59/f72 0 2024-02-10T00:00:34.440 INFO:tasks.workunit.client.1.smithi183.stdout:1/646: dread d0/d3/d67/fd9 [4194304,4194304] 0 2024-02-10T00:00:34.442 INFO:tasks.workunit.client.1.smithi183.stdout:2/844: write d2/da/d77/dc7/fd2 [1615634,117368] 0 2024-02-10T00:00:34.444 INFO:tasks.workunit.client.1.smithi183.stdout:2/845: chown d2/da/d5b/f8a 4245 1 2024-02-10T00:00:34.445 INFO:tasks.workunit.client.1.smithi183.stdout:3/632: dwrite d7/f20 [0,4194304] 0 2024-02-10T00:00:34.446 INFO:tasks.workunit.client.0.smithi164.stdout:9/390: truncate d6/d1c/d24/d4f/f5a 2220529 0 2024-02-10T00:00:34.447 INFO:tasks.workunit.client.1.smithi183.stdout:8/772: truncate d0/d3f/db2/d24/fbb 158437 0 2024-02-10T00:00:34.448 INFO:tasks.workunit.client.0.smithi164.stdout:0/340: dwrite d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:34.450 INFO:tasks.workunit.client.1.smithi183.stdout:7/669: dwrite d0/d11/d3e/f6a [0,4194304] 0 2024-02-10T00:00:34.450 INFO:tasks.workunit.client.1.smithi183.stdout:1/647: rename d0/d3/d67/d70/cd5 to d0/d3/d7/d3d/d60/d89/ce6 0 2024-02-10T00:00:34.450 INFO:tasks.workunit.client.1.smithi183.stdout:6/625: getdents d2/dab 0 2024-02-10T00:00:34.451 INFO:tasks.workunit.client.0.smithi164.stdout:6/457: truncate d0/d6/d4d/f7d 1505737 0 2024-02-10T00:00:34.451 INFO:tasks.workunit.client.0.smithi164.stdout:5/412: write d7/f32 [1731667,82952] 0 2024-02-10T00:00:34.451 INFO:tasks.workunit.client.0.smithi164.stdout:6/458: fsync d0/f6e 0 2024-02-10T00:00:34.452 INFO:tasks.workunit.client.1.smithi183.stdout:7/670: dread - d0/fa0 zero size 2024-02-10T00:00:34.452 INFO:tasks.workunit.client.1.smithi183.stdout:1/648: fdatasync d0/d3/d7/f19 0 2024-02-10T00:00:34.454 INFO:tasks.workunit.client.0.smithi164.stdout:3/323: creat d0/d1/d3c/d3d/d51/f62 x:0 0 0 2024-02-10T00:00:34.454 INFO:tasks.workunit.client.1.smithi183.stdout:3/633: dwrite d7/db/d2a/f9a [0,4194304] 0 2024-02-10T00:00:34.456 INFO:tasks.workunit.client.0.smithi164.stdout:7/431: rmdir d3/d11/d39/d44/d48 39 2024-02-10T00:00:34.457 INFO:tasks.workunit.client.1.smithi183.stdout:5/767: symlink d4/d23/d2a/lfe 0 2024-02-10T00:00:34.458 INFO:tasks.workunit.client.1.smithi183.stdout:5/768: chown d4/d23/d2a/fd8 61730183 1 2024-02-10T00:00:34.458 INFO:tasks.workunit.client.0.smithi164.stdout:3/324: dwrite d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:34.458 INFO:tasks.workunit.client.0.smithi164.stdout:2/410: creat d3/d32/d4e/d27/d2a/d7a/d8e/d88/f95 x:0 0 0 2024-02-10T00:00:34.459 INFO:tasks.workunit.client.0.smithi164.stdout:9/391: fsync d6/de/f11 0 2024-02-10T00:00:34.459 INFO:tasks.workunit.client.0.smithi164.stdout:1/289: write d1/d13/f19 [2877343,82207] 0 2024-02-10T00:00:34.460 INFO:tasks.workunit.client.0.smithi164.stdout:2/411: read - d3/d32/d4e/d27/f94 zero size 2024-02-10T00:00:34.461 INFO:tasks.workunit.client.1.smithi183.stdout:0/704: link d14/d1d/d2d/d31/f91 d14/d3e/d5f/daa/ddd/f104 0 2024-02-10T00:00:34.463 INFO:tasks.workunit.client.1.smithi183.stdout:2/846: mkdir d2/d2c/dba/df0/d121 0 2024-02-10T00:00:34.463 INFO:tasks.workunit.client.0.smithi164.stdout:8/367: getdents d2/d64/d31/d32 0 2024-02-10T00:00:34.464 INFO:tasks.workunit.client.0.smithi164.stdout:8/368: stat d2/f7 0 2024-02-10T00:00:34.465 INFO:tasks.workunit.client.0.smithi164.stdout:5/413: mkdir d7/d17/d3b/d45/d87 0 2024-02-10T00:00:34.465 INFO:tasks.workunit.client.1.smithi183.stdout:8/773: rmdir d0/d4e/da6 39 2024-02-10T00:00:34.466 INFO:tasks.workunit.client.1.smithi183.stdout:9/707: getdents d0/d10 0 2024-02-10T00:00:34.467 INFO:tasks.workunit.client.0.smithi164.stdout:3/325: creat d0/d1/d3c/f63 x:0 0 0 2024-02-10T00:00:34.467 INFO:tasks.workunit.client.0.smithi164.stdout:1/290: fsync d1/f1b 0 2024-02-10T00:00:34.468 INFO:tasks.workunit.client.0.smithi164.stdout:7/432: dread d3/d5/d2b/d4a/f53 [0,4194304] 0 2024-02-10T00:00:34.468 INFO:tasks.workunit.client.0.smithi164.stdout:9/392: truncate d6/de/d22/f26 2179508 0 2024-02-10T00:00:34.471 INFO:tasks.workunit.client.0.smithi164.stdout:2/412: creat d3/d32/d4e/d27/d2a/d7a/d8e/d36/f96 x:0 0 0 2024-02-10T00:00:34.471 INFO:tasks.workunit.client.0.smithi164.stdout:8/369: symlink d2/d64/d54/l69 0 2024-02-10T00:00:34.472 INFO:tasks.workunit.client.0.smithi164.stdout:3/326: dwrite d0/d1/d3c/d3d/f57 [0,4194304] 0 2024-02-10T00:00:34.482 INFO:tasks.workunit.client.0.smithi164.stdout:4/382: truncate d2/d19/d16/d31/f4d 885436 0 2024-02-10T00:00:34.483 INFO:tasks.workunit.client.0.smithi164.stdout:4/383: chown d2/d2f/d37/d41/d3d/d42/d5f/f67 960326 1 2024-02-10T00:00:34.484 INFO:tasks.workunit.client.1.smithi183.stdout:4/764: dread de/d14/d27/f55 [0,4194304] 0 2024-02-10T00:00:34.484 INFO:tasks.workunit.client.0.smithi164.stdout:4/384: chown d2/d2f/d37/d41/d3d/d56 0 1 2024-02-10T00:00:34.485 INFO:tasks.workunit.client.1.smithi183.stdout:4/765: write de/d14/d27/f21 [2089489,48868] 0 2024-02-10T00:00:34.488 INFO:tasks.workunit.client.0.smithi164.stdout:5/414: unlink d7/d17/d21/d23/d5a/d68/l18 0 2024-02-10T00:00:34.489 INFO:tasks.workunit.client.0.smithi164.stdout:5/415: chown d7/d17/d3b/d45/c73 303 1 2024-02-10T00:00:34.491 INFO:tasks.workunit.client.0.smithi164.stdout:5/416: dread d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:34.491 INFO:tasks.workunit.client.0.smithi164.stdout:5/417: fsync d7/d17/d21/d23/d37/d36/f6d 0 2024-02-10T00:00:34.494 INFO:tasks.workunit.client.0.smithi164.stdout:4/385: rmdir d2/d19/d16/d31/d4b 39 2024-02-10T00:00:34.495 INFO:tasks.workunit.client.0.smithi164.stdout:0/341: dwrite d6/d10/d18/d2d/f51 [0,4194304] 0 2024-02-10T00:00:34.495 INFO:tasks.workunit.client.0.smithi164.stdout:6/459: sync 2024-02-10T00:00:34.497 INFO:tasks.workunit.client.1.smithi183.stdout:5/769: unlink d4/dd/d31/d73/fb7 0 2024-02-10T00:00:34.497 INFO:tasks.workunit.client.0.smithi164.stdout:1/291: creat d1/d13/f66 x:0 0 0 2024-02-10T00:00:34.498 INFO:tasks.workunit.client.0.smithi164.stdout:0/342: dread d6/d10/d18/d1c/f3b [0,4194304] 0 2024-02-10T00:00:34.498 INFO:tasks.workunit.client.1.smithi183.stdout:5/770: fsync d4/d74/fba 0 2024-02-10T00:00:34.498 INFO:tasks.workunit.client.1.smithi183.stdout:6/626: creat d2/d1a/d25/fbd x:0 0 0 2024-02-10T00:00:34.499 INFO:tasks.workunit.client.0.smithi164.stdout:5/418: chown d7/d17/d21/l7d 6702457 1 2024-02-10T00:00:34.500 INFO:tasks.workunit.client.1.smithi183.stdout:7/671: link d0/d2/d50/dad/fa6 d0/d2/fce 0 2024-02-10T00:00:34.502 INFO:tasks.workunit.client.0.smithi164.stdout:0/343: dread d6/d10/d4a/d60/d6c/f46 [0,4194304] 0 2024-02-10T00:00:34.502 INFO:tasks.workunit.client.0.smithi164.stdout:2/413: creat d3/d32/f97 x:0 0 0 2024-02-10T00:00:34.503 INFO:tasks.workunit.client.0.smithi164.stdout:2/414: chown d3/d32/d4e/d27/f2d 11457931 1 2024-02-10T00:00:34.504 INFO:tasks.workunit.client.1.smithi183.stdout:4/766: dread de/d22/feb [0,4194304] 0 2024-02-10T00:00:34.506 INFO:tasks.workunit.client.1.smithi183.stdout:8/774: read d0/d23/f26 [1965919,56390] 0 2024-02-10T00:00:34.506 INFO:tasks.workunit.client.1.smithi183.stdout:1/649: link d0/d3a/l5d d0/le7 0 2024-02-10T00:00:34.506 INFO:tasks.workunit.client.0.smithi164.stdout:6/460: creat d0/d6/d81/f96 x:0 0 0 2024-02-10T00:00:34.506 INFO:tasks.workunit.client.0.smithi164.stdout:3/327: getdents d0/d1/d2/d19/d27 0 2024-02-10T00:00:34.507 INFO:tasks.workunit.client.1.smithi183.stdout:6/627: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe 0 2024-02-10T00:00:34.508 INFO:tasks.workunit.client.1.smithi183.stdout:7/672: creat d0/d11/d2f/dbf/fcf x:0 0 0 2024-02-10T00:00:34.509 INFO:tasks.workunit.client.1.smithi183.stdout:3/634: getdents d7/db 0 2024-02-10T00:00:34.512 INFO:tasks.workunit.client.1.smithi183.stdout:8/775: rename d0/d10/cbf to d0/d10/cf2 0 2024-02-10T00:00:34.513 INFO:tasks.workunit.client.1.smithi183.stdout:2/847: getdents d2/d2c/dba 0 2024-02-10T00:00:34.514 INFO:tasks.workunit.client.1.smithi183.stdout:7/673: symlink d0/d11/d2f/d64/d6b/ld0 0 2024-02-10T00:00:34.514 INFO:tasks.workunit.client.0.smithi164.stdout:6/461: unlink d0/d2b/d3a/d3d/l78 0 2024-02-10T00:00:34.514 INFO:tasks.workunit.client.0.smithi164.stdout:3/328: symlink d0/d1/d2/d19/d27/d30/l64 0 2024-02-10T00:00:34.515 INFO:tasks.workunit.client.0.smithi164.stdout:5/419: rmdir d7/d17/d3b/d45/d87 0 2024-02-10T00:00:34.515 INFO:tasks.workunit.client.1.smithi183.stdout:3/635: symlink d7/db/d2a/d8e/lbb 0 2024-02-10T00:00:34.516 INFO:tasks.workunit.client.1.smithi183.stdout:6/628: rename d2/d1a/d25/d3c/d31/d38/d6e/f9d to d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fbf 0 2024-02-10T00:00:34.517 INFO:tasks.workunit.client.0.smithi164.stdout:2/415: dwrite d3/d26/d64/f6a [0,4194304] 0 2024-02-10T00:00:34.517 INFO:tasks.workunit.client.0.smithi164.stdout:5/420: stat d7/d17/d21/d23/d5a/d68/d1f 0 2024-02-10T00:00:34.517 INFO:tasks.workunit.client.0.smithi164.stdout:3/329: chown d0/d1/d3c/d3d/f47 211393 1 2024-02-10T00:00:34.517 INFO:tasks.workunit.client.0.smithi164.stdout:2/416: readlink d3/l21 0 2024-02-10T00:00:34.518 INFO:tasks.workunit.client.0.smithi164.stdout:7/433: dread d3/d5/fe [0,4194304] 0 2024-02-10T00:00:34.518 INFO:tasks.workunit.client.0.smithi164.stdout:6/462: symlink d0/d2b/d3a/d3d/l97 0 2024-02-10T00:00:34.519 INFO:tasks.workunit.client.0.smithi164.stdout:2/417: write d3/f4a [1538868,93040] 0 2024-02-10T00:00:34.520 INFO:tasks.workunit.client.1.smithi183.stdout:3/636: dwrite d7/db/d2a/d1c/f1e [0,4194304] 0 2024-02-10T00:00:34.521 INFO:tasks.workunit.client.0.smithi164.stdout:2/418: fdatasync d3/d32/d4e/f5e 0 2024-02-10T00:00:34.524 INFO:tasks.workunit.client.1.smithi183.stdout:2/848: dwrite d2/d2c/d2f/d60/d8d/fa9 [0,4194304] 0 2024-02-10T00:00:34.524 INFO:tasks.workunit.client.0.smithi164.stdout:5/421: dwrite d7/d17/d21/d23/d37/f4b [0,4194304] 0 2024-02-10T00:00:34.525 INFO:tasks.workunit.client.1.smithi183.stdout:2/849: fsync d2/d2c/dba/fc9 0 2024-02-10T00:00:34.525 INFO:tasks.workunit.client.1.smithi183.stdout:0/705: dwrite d14/d1d/fba [0,4194304] 0 2024-02-10T00:00:34.526 INFO:tasks.workunit.client.0.smithi164.stdout:1/292: dread d1/f9 [0,4194304] 0 2024-02-10T00:00:34.526 INFO:tasks.workunit.client.1.smithi183.stdout:0/706: fdatasync d14/d3e/d9b/fd5 0 2024-02-10T00:00:34.527 INFO:tasks.workunit.client.0.smithi164.stdout:1/293: write d1/fd [5523017,17420] 0 2024-02-10T00:00:34.527 INFO:tasks.workunit.client.0.smithi164.stdout:9/393: truncate d6/de/d2b/f37 813362 0 2024-02-10T00:00:34.529 INFO:tasks.workunit.client.0.smithi164.stdout:3/330: creat d0/d1/d2/d19/d45/f65 x:0 0 0 2024-02-10T00:00:34.530 INFO:tasks.workunit.client.0.smithi164.stdout:8/370: dwrite d2/d64/f3b [0,4194304] 0 2024-02-10T00:00:34.531 INFO:tasks.workunit.client.0.smithi164.stdout:6/463: rename d0/d2b/l31 to d0/d6/d81/l98 0 2024-02-10T00:00:34.532 INFO:tasks.workunit.client.0.smithi164.stdout:4/386: write d2/d19/d16/d31/f4f [335309,123005] 0 2024-02-10T00:00:34.532 INFO:tasks.workunit.client.0.smithi164.stdout:6/464: write d0/d6/d12/f67 [115128,75312] 0 2024-02-10T00:00:34.533 INFO:tasks.workunit.client.0.smithi164.stdout:6/465: readlink d0/d6/le 0 2024-02-10T00:00:34.535 INFO:tasks.workunit.client.1.smithi183.stdout:4/767: write de/f2c [326684,58280] 0 2024-02-10T00:00:34.536 INFO:tasks.workunit.client.0.smithi164.stdout:8/371: dwrite d2/f4 [12582912,4194304] 0 2024-02-10T00:00:34.537 INFO:tasks.workunit.client.1.smithi183.stdout:9/708: dwrite d0/d3/f24 [0,4194304] 0 2024-02-10T00:00:34.537 INFO:tasks.workunit.client.1.smithi183.stdout:1/650: truncate d0/d3/d67/fdf 245954 0 2024-02-10T00:00:34.540 INFO:tasks.workunit.client.1.smithi183.stdout:7/674: rename d0/d11/d9d/dab to d0/d2/d50/dd1 0 2024-02-10T00:00:34.540 INFO:tasks.workunit.client.1.smithi183.stdout:5/771: dwrite d4/dd/d31/d73/fc2 [0,4194304] 0 2024-02-10T00:00:34.542 INFO:tasks.workunit.client.1.smithi183.stdout:6/629: write d2/d1a/f1f [556392,107025] 0 2024-02-10T00:00:34.544 INFO:tasks.workunit.client.1.smithi183.stdout:0/707: fdatasync d14/d1d/d59/fdc 0 2024-02-10T00:00:34.544 INFO:tasks.workunit.client.0.smithi164.stdout:5/422: symlink d7/d17/l88 0 2024-02-10T00:00:34.544 INFO:tasks.workunit.client.0.smithi164.stdout:2/419: creat d3/d32/d4e/d27/d2a/d7a/d8e/f98 x:0 0 0 2024-02-10T00:00:34.545 INFO:tasks.workunit.client.0.smithi164.stdout:2/420: readlink d3/l76 0 2024-02-10T00:00:34.545 INFO:tasks.workunit.client.0.smithi164.stdout:9/394: mkdir d6/de/d2b/d5b/d75 0 2024-02-10T00:00:34.547 INFO:tasks.workunit.client.1.smithi183.stdout:1/651: dwrite d0/d3/d29/d38/f3b [8388608,4194304] 0 2024-02-10T00:00:34.547 INFO:tasks.workunit.client.1.smithi183.stdout:1/652: chown d0/d3/d29/l9f 1 1 2024-02-10T00:00:34.548 INFO:tasks.workunit.client.0.smithi164.stdout:5/423: dread - d7/d17/d79/f86 zero size 2024-02-10T00:00:34.548 INFO:tasks.workunit.client.0.smithi164.stdout:2/421: write d3/f7 [2462377,111484] 0 2024-02-10T00:00:34.548 INFO:tasks.workunit.client.0.smithi164.stdout:2/422: chown d3/d26 36 1 2024-02-10T00:00:34.548 INFO:tasks.workunit.client.0.smithi164.stdout:3/331: unlink d0/d1/dd/l4a 0 2024-02-10T00:00:34.548 INFO:tasks.workunit.client.1.smithi183.stdout:4/768: fdatasync de/d14/d4e/fee 0 2024-02-10T00:00:34.549 INFO:tasks.workunit.client.0.smithi164.stdout:1/294: dwrite d1/f9 [0,4194304] 0 2024-02-10T00:00:34.550 INFO:tasks.workunit.client.0.smithi164.stdout:6/466: mknod d0/d2b/d3a/d3d/d42/d5d/d79/d92/c99 0 2024-02-10T00:00:34.551 INFO:tasks.workunit.client.1.smithi183.stdout:9/709: write d0/d3/d14/d1c/d2d/d4f/fb1 [855051,9087] 0 2024-02-10T00:00:34.553 INFO:tasks.workunit.client.0.smithi164.stdout:9/395: stat d6/d1c/c28 0 2024-02-10T00:00:34.555 INFO:tasks.workunit.client.1.smithi183.stdout:8/776: rename d0/d23/f2a to d0/d4e/da6/dde/ff3 0 2024-02-10T00:00:34.557 INFO:tasks.workunit.client.1.smithi183.stdout:3/637: mknod d7/db/d2a/d2d/d51/db3/cbc 0 2024-02-10T00:00:34.559 INFO:tasks.workunit.client.0.smithi164.stdout:1/295: creat d1/d23/f67 x:0 0 0 2024-02-10T00:00:34.560 INFO:tasks.workunit.client.0.smithi164.stdout:6/467: fdatasync d0/d6/f1c 0 2024-02-10T00:00:34.560 INFO:tasks.workunit.client.0.smithi164.stdout:3/332: rmdir d0/d3b 39 2024-02-10T00:00:34.560 INFO:tasks.workunit.client.0.smithi164.stdout:2/423: symlink d3/d26/l99 0 2024-02-10T00:00:34.561 INFO:tasks.workunit.client.0.smithi164.stdout:9/396: mkdir d6/de/d2b/d5b/d61/d76 0 2024-02-10T00:00:34.562 INFO:tasks.workunit.client.0.smithi164.stdout:4/387: rmdir d2/d19/d16/d31/d7e/d84 0 2024-02-10T00:00:34.565 INFO:tasks.workunit.client.0.smithi164.stdout:3/333: mkdir d0/d1/d2/d19/d66 0 2024-02-10T00:00:34.566 INFO:tasks.workunit.client.1.smithi183.stdout:9/710: creat d0/d30/d52/fe4 x:0 0 0 2024-02-10T00:00:34.567 INFO:tasks.workunit.client.1.smithi183.stdout:9/711: stat d0/d3/d14/d1c/c59 0 2024-02-10T00:00:34.568 INFO:tasks.workunit.client.1.smithi183.stdout:4/769: dwrite de/d22/f43 [0,4194304] 0 2024-02-10T00:00:34.568 INFO:tasks.workunit.client.0.smithi164.stdout:2/424: symlink d3/d32/d4e/d27/d2a/d7a/d8e/d36/d90/l9a 0 2024-02-10T00:00:34.570 INFO:tasks.workunit.client.1.smithi183.stdout:1/653: rename d0/d3a/c87 to d0/d3/d7/ce8 0 2024-02-10T00:00:34.571 INFO:tasks.workunit.client.0.smithi164.stdout:9/397: link d6/de/d22/f51 d6/de/d2b/d5b/d61/f77 0 2024-02-10T00:00:34.572 INFO:tasks.workunit.client.0.smithi164.stdout:9/398: stat d6/c1b 0 2024-02-10T00:00:34.572 INFO:tasks.workunit.client.1.smithi183.stdout:9/712: dwrite d0/f36 [4194304,4194304] 0 2024-02-10T00:00:34.572 INFO:tasks.workunit.client.0.smithi164.stdout:9/399: readlink d6/d1c/d24/l31 0 2024-02-10T00:00:34.575 INFO:tasks.workunit.client.0.smithi164.stdout:2/425: mknod d3/d32/d4e/d27/d2a/d7a/d8e/d36/c9b 0 2024-02-10T00:00:34.577 INFO:tasks.workunit.client.1.smithi183.stdout:7/675: creat d0/fd2 x:0 0 0 2024-02-10T00:00:34.578 INFO:tasks.workunit.client.0.smithi164.stdout:1/296: link d1/f7 d1/d13/d2b/d52/d56/f68 0 2024-02-10T00:00:34.578 INFO:tasks.workunit.client.0.smithi164.stdout:4/388: creat d2/d19/d16/f88 x:0 0 0 2024-02-10T00:00:34.579 INFO:tasks.workunit.client.0.smithi164.stdout:3/334: truncate d0/d1/d3c/f63 992247 0 2024-02-10T00:00:34.579 INFO:tasks.workunit.client.0.smithi164.stdout:1/297: readlink d1/d1a/d41/d18/l1e 0 2024-02-10T00:00:34.579 INFO:tasks.workunit.client.0.smithi164.stdout:4/389: fdatasync d2/d2f/d37/d41/f6e 0 2024-02-10T00:00:34.580 INFO:tasks.workunit.client.0.smithi164.stdout:1/298: dread - d1/d13/d2b/f5a zero size 2024-02-10T00:00:34.581 INFO:tasks.workunit.client.0.smithi164.stdout:4/390: fdatasync d2/d19/d16/d31/d7e/d81/f87 0 2024-02-10T00:00:34.582 INFO:tasks.workunit.client.0.smithi164.stdout:2/426: creat d3/d26/d64/f9c x:0 0 0 2024-02-10T00:00:34.582 INFO:tasks.workunit.client.1.smithi183.stdout:4/770: creat de/d19/d1c/d61/fef x:0 0 0 2024-02-10T00:00:34.583 INFO:tasks.workunit.client.1.smithi183.stdout:8/777: mknod d0/d23/db1/cf4 0 2024-02-10T00:00:34.583 INFO:tasks.workunit.client.0.smithi164.stdout:9/400: dread d6/de/f11 [0,4194304] 0 2024-02-10T00:00:34.584 INFO:tasks.workunit.client.0.smithi164.stdout:1/299: mknod d1/d1a/d41/d18/c69 0 2024-02-10T00:00:34.585 INFO:tasks.workunit.client.1.smithi183.stdout:6/630: link d2/f19 d2/fc0 0 2024-02-10T00:00:34.585 INFO:tasks.workunit.client.0.smithi164.stdout:3/335: mknod d0/d3b/c67 0 2024-02-10T00:00:34.586 INFO:tasks.workunit.client.1.smithi183.stdout:9/713: write d0/d3/d14/d74/fcd [3961209,121161] 0 2024-02-10T00:00:34.586 INFO:tasks.workunit.client.1.smithi183.stdout:6/631: dread - d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/fbc zero size 2024-02-10T00:00:34.587 INFO:tasks.workunit.client.0.smithi164.stdout:4/391: symlink d2/d19/d16/d31/d83/l89 0 2024-02-10T00:00:34.589 INFO:tasks.workunit.client.1.smithi183.stdout:8/778: unlink d0/d31/cc0 0 2024-02-10T00:00:34.590 INFO:tasks.workunit.client.1.smithi183.stdout:9/714: write d0/d3/d14/d74/da8/faf [510509,20087] 0 2024-02-10T00:00:34.590 INFO:tasks.workunit.client.1.smithi183.stdout:7/676: mkdir d0/d11/d2f/db8/dd3 0 2024-02-10T00:00:34.594 INFO:tasks.workunit.client.1.smithi183.stdout:9/715: dwrite d0/d10/f98 [0,4194304] 0 2024-02-10T00:00:34.595 INFO:tasks.workunit.client.1.smithi183.stdout:4/771: rename de/d14/d27/f55 to de/d19/ff0 0 2024-02-10T00:00:34.596 INFO:tasks.workunit.client.1.smithi183.stdout:1/654: link d0/d3/d7/d3d/l66 d0/d3/d7/d3d/d60/d89/le9 0 2024-02-10T00:00:34.596 INFO:tasks.workunit.client.1.smithi183.stdout:4/772: write de/d14/d27/d40/fd5 [259749,92083] 0 2024-02-10T00:00:34.597 INFO:tasks.workunit.client.1.smithi183.stdout:6/632: truncate d2/d1a/d25/d3c/d31/f79 706081 0 2024-02-10T00:00:34.598 INFO:tasks.workunit.client.1.smithi183.stdout:8/779: creat d0/d3f/db2/ff5 x:0 0 0 2024-02-10T00:00:34.599 INFO:tasks.workunit.client.1.smithi183.stdout:1/655: write d0/d3/d67/d7b/faf [4517304,70242] 0 2024-02-10T00:00:34.601 INFO:tasks.workunit.client.1.smithi183.stdout:1/656: chown d0/d3/d29/l1b 39918 1 2024-02-10T00:00:34.602 INFO:tasks.workunit.client.1.smithi183.stdout:8/780: mkdir d0/d23/df6 0 2024-02-10T00:00:34.602 INFO:tasks.workunit.client.1.smithi183.stdout:9/716: dwrite d0/d10/f53 [0,4194304] 0 2024-02-10T00:00:34.603 INFO:tasks.workunit.client.0.smithi164.stdout:0/344: sync 2024-02-10T00:00:34.604 INFO:tasks.workunit.client.1.smithi183.stdout:8/781: fdatasync d0/d31/f88 0 2024-02-10T00:00:34.604 INFO:tasks.workunit.client.1.smithi183.stdout:6/633: truncate d2/d1a/d25/d3c/fba 648232 0 2024-02-10T00:00:34.606 INFO:tasks.workunit.client.1.smithi183.stdout:4/773: dwrite de/d14/d27/d2e/f88 [0,4194304] 0 2024-02-10T00:00:34.607 INFO:tasks.workunit.client.1.smithi183.stdout:9/717: write d0/d10/fa9 [3318291,24840] 0 2024-02-10T00:00:34.607 INFO:tasks.workunit.client.1.smithi183.stdout:1/657: rmdir d0/d3/d67/d7b 39 2024-02-10T00:00:34.609 INFO:tasks.workunit.client.1.smithi183.stdout:8/782: fsync d0/f2f 0 2024-02-10T00:00:34.610 INFO:tasks.workunit.client.1.smithi183.stdout:9/718: chown d0/d3/d14/d3c/d7b/fd3 59930956 1 2024-02-10T00:00:34.610 INFO:tasks.workunit.client.1.smithi183.stdout:6/634: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fb6 0 1 2024-02-10T00:00:34.612 INFO:tasks.workunit.client.1.smithi183.stdout:1/658: mkdir d0/d3/d7/d3d/d60/d89/de4/dea 0 2024-02-10T00:00:34.612 INFO:tasks.workunit.client.1.smithi183.stdout:9/719: dread - d0/d3/d14/d1c/d2d/d4f/fcb zero size 2024-02-10T00:00:34.613 INFO:tasks.workunit.client.1.smithi183.stdout:8/783: write d0/d4e/f6a [2911450,37359] 0 2024-02-10T00:00:34.614 INFO:tasks.workunit.client.1.smithi183.stdout:4/774: dwrite de/fae [0,4194304] 0 2024-02-10T00:00:34.615 INFO:tasks.workunit.client.1.smithi183.stdout:1/659: creat d0/d3a/feb x:0 0 0 2024-02-10T00:00:34.616 INFO:tasks.workunit.client.0.smithi164.stdout:9/401: creat d6/de/d2b/d5b/d61/d76/f78 x:0 0 0 2024-02-10T00:00:34.617 INFO:tasks.workunit.client.1.smithi183.stdout:4/775: rename de/d14 to de/d14/d27/d40/df1 22 2024-02-10T00:00:34.618 INFO:tasks.workunit.client.0.smithi164.stdout:2/427: rename d3/d24/c6b to d3/d24/c9d 0 2024-02-10T00:00:34.618 INFO:tasks.workunit.client.0.smithi164.stdout:9/402: write d6/de/d2b/d5b/f6c [863728,86061] 0 2024-02-10T00:00:34.618 INFO:tasks.workunit.client.0.smithi164.stdout:4/392: dwrite d2/d2f/d37/d41/d3d/f5c [0,4194304] 0 2024-02-10T00:00:34.619 INFO:tasks.workunit.client.1.smithi183.stdout:6/635: dwrite d2/d1a/d25/d3c/d31/d38/d6e/f84 [0,4194304] 0 2024-02-10T00:00:34.620 INFO:tasks.workunit.client.1.smithi183.stdout:9/720: symlink d0/d3/d14/d1c/d2d/d4f/d89/dc5/le5 0 2024-02-10T00:00:34.621 INFO:tasks.workunit.client.0.smithi164.stdout:2/428: write d3/d32/d4e/d27/d2a/d7a/d8e/d36/f43 [1389804,105475] 0 2024-02-10T00:00:34.624 INFO:tasks.workunit.client.0.smithi164.stdout:4/393: symlink d2/d19/d16/d31/d6d/l8a 0 2024-02-10T00:00:34.625 INFO:tasks.workunit.client.1.smithi183.stdout:9/721: mkdir d0/d3/d14/d1c/d2d/d4f/de6 0 2024-02-10T00:00:34.625 INFO:tasks.workunit.client.1.smithi183.stdout:6/636: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 [0,4194304] 0 2024-02-10T00:00:34.625 INFO:tasks.workunit.client.0.smithi164.stdout:4/394: fdatasync d2/d19/d16/f3a 0 2024-02-10T00:00:34.626 INFO:tasks.workunit.client.1.smithi183.stdout:9/722: chown d0/d3/d14/d1c/d2d/fd5 3 1 2024-02-10T00:00:34.627 INFO:tasks.workunit.client.0.smithi164.stdout:9/403: rename d6/d1c/d24/f60 to d6/f79 0 2024-02-10T00:00:34.628 INFO:tasks.workunit.client.0.smithi164.stdout:0/345: link d6/d10/d18/d2d/c59 d6/d10/d4a/d60/d6c/c70 0 2024-02-10T00:00:34.629 INFO:tasks.workunit.client.1.smithi183.stdout:6/637: unlink d2/d1a/d25/d3c/d31/l90 0 2024-02-10T00:00:34.631 INFO:tasks.workunit.client.1.smithi183.stdout:9/723: mkdir d0/d3/d14/d1c/d2d/d4f/db8/de7 0 2024-02-10T00:00:34.631 INFO:tasks.workunit.client.0.smithi164.stdout:0/346: dwrite d6/d3a/d52/f53 [0,4194304] 0 2024-02-10T00:00:34.632 INFO:tasks.workunit.client.1.smithi183.stdout:6/638: creat d2/d32/fc1 x:0 0 0 2024-02-10T00:00:34.633 INFO:tasks.workunit.client.0.smithi164.stdout:4/395: mkdir d2/d19/d16/d31/d7e/d8b 0 2024-02-10T00:00:34.633 INFO:tasks.workunit.client.1.smithi183.stdout:9/724: creat d0/d3/fe8 x:0 0 0 2024-02-10T00:00:34.634 INFO:tasks.workunit.client.0.smithi164.stdout:4/396: dread - d2/d2f/d37/d41/d3d/d42/f78 zero size 2024-02-10T00:00:34.641 INFO:tasks.workunit.client.0.smithi164.stdout:4/397: fdatasync d2/f1a 0 2024-02-10T00:00:34.647 INFO:tasks.workunit.client.0.smithi164.stdout:4/398: link d2/d2f/d37/f55 d2/d19/d16/d31/d4b/f8c 0 2024-02-10T00:00:34.648 INFO:tasks.workunit.client.0.smithi164.stdout:7/434: sync 2024-02-10T00:00:34.648 INFO:tasks.workunit.client.0.smithi164.stdout:4/399: write d2/d19/d16/f3a [5117005,82793] 0 2024-02-10T00:00:34.652 INFO:tasks.workunit.client.1.smithi183.stdout:2/850: dread d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d [0,4194304] 0 2024-02-10T00:00:34.653 INFO:tasks.workunit.client.0.smithi164.stdout:7/435: dwrite d3/d11/f23 [4194304,4194304] 0 2024-02-10T00:00:34.653 INFO:tasks.workunit.client.1.smithi183.stdout:2/851: creat d2/d2c/dab/d99/f122 x:0 0 0 2024-02-10T00:00:34.654 INFO:tasks.workunit.client.1.smithi183.stdout:2/852: write d2/d2c/d2f/d72/f92 [416199,86449] 0 2024-02-10T00:00:34.655 INFO:tasks.workunit.client.0.smithi164.stdout:7/436: chown d3/d5/d2b/d4a/f53 1984518727 1 2024-02-10T00:00:34.655 INFO:tasks.workunit.client.0.smithi164.stdout:4/400: dwrite d2/f5e [0,4194304] 0 2024-02-10T00:00:34.658 INFO:tasks.workunit.client.0.smithi164.stdout:7/437: creat d3/d5/d2b/d4a/f96 x:0 0 0 2024-02-10T00:00:34.660 INFO:tasks.workunit.client.0.smithi164.stdout:4/401: creat d2/d19/d16/d31/d4b/f8d x:0 0 0 2024-02-10T00:00:34.662 INFO:tasks.workunit.client.0.smithi164.stdout:1/300: dread d1/d1a/d41/d18/f3e [0,4194304] 0 2024-02-10T00:00:34.664 INFO:tasks.workunit.client.0.smithi164.stdout:1/301: creat d1/d13/d2b/d54/f6a x:0 0 0 2024-02-10T00:00:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:1/302: creat d1/d13/d2b/d52/f6b x:0 0 0 2024-02-10T00:00:34.667 INFO:tasks.workunit.client.0.smithi164.stdout:1/303: chown d1/d1a/d41/c3d 1 1 2024-02-10T00:00:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:4/402: getdents d2/d2f/d37/d41/d3d/d42 0 2024-02-10T00:00:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:5/424: sync 2024-02-10T00:00:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:1/304: mknod d1/d13/d1f/c6c 0 2024-02-10T00:00:34.671 INFO:tasks.workunit.client.0.smithi164.stdout:5/425: dread - d7/d17/d79/f86 zero size 2024-02-10T00:00:34.675 INFO:tasks.workunit.client.0.smithi164.stdout:4/403: rename d2/d19/d16/l23 to d2/d19/d16/d31/d7e/l8e 0 2024-02-10T00:00:34.676 INFO:tasks.workunit.client.0.smithi164.stdout:1/305: symlink d1/d13/l6d 0 2024-02-10T00:00:34.677 INFO:tasks.workunit.client.1.smithi183.stdout:5/772: dread d4/d23/d3e/d80/da1/f6b [0,4194304] 0 2024-02-10T00:00:34.678 INFO:tasks.workunit.client.0.smithi164.stdout:4/404: creat d2/d2f/d37/f8f x:0 0 0 2024-02-10T00:00:34.680 INFO:tasks.workunit.client.1.smithi183.stdout:5/773: creat d4/d23/d3e/d80/da1/d9e/d27/d9d/fff x:0 0 0 2024-02-10T00:00:34.682 INFO:tasks.workunit.client.1.smithi183.stdout:5/774: chown d4/d23/d3e/d80/da1/d9e/d27/d9d/ff9 109722 1 2024-02-10T00:00:34.682 INFO:tasks.workunit.client.0.smithi164.stdout:1/306: symlink d1/d13/d2b/d52/d56/l6e 0 2024-02-10T00:00:34.683 INFO:tasks.workunit.client.1.smithi183.stdout:5/775: chown d4/d23/d3e/d80/da1/f60 186257 1 2024-02-10T00:00:34.685 INFO:tasks.workunit.client.0.smithi164.stdout:9/404: getdents d6/de/d2b/d5b 0 2024-02-10T00:00:34.686 INFO:tasks.workunit.client.0.smithi164.stdout:9/405: readlink d6/de/d3b/l72 0 2024-02-10T00:00:34.688 INFO:tasks.workunit.client.1.smithi183.stdout:0/708: dread d14/d1d/d2d/f39 [0,4194304] 0 2024-02-10T00:00:34.690 INFO:tasks.workunit.client.0.smithi164.stdout:8/372: dwrite d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:34.691 INFO:tasks.workunit.client.1.smithi183.stdout:0/709: unlink d14/d1d/d59/l86 0 2024-02-10T00:00:34.691 INFO:tasks.workunit.client.0.smithi164.stdout:1/307: mknod d1/d13/c6f 0 2024-02-10T00:00:34.694 INFO:tasks.workunit.client.0.smithi164.stdout:8/373: mknod d2/d64/d63/c6a 0 2024-02-10T00:00:34.694 INFO:tasks.workunit.client.0.smithi164.stdout:1/308: fsync d1/d1a/d35/f34 0 2024-02-10T00:00:34.694 INFO:tasks.workunit.client.0.smithi164.stdout:4/405: link d2/d19/d16/d31/c65 d2/d2f/d37/d41/d3d/d56/d85/c90 0 2024-02-10T00:00:34.695 INFO:tasks.workunit.client.0.smithi164.stdout:4/406: write d2/d19/d16/f53 [425031,116078] 0 2024-02-10T00:00:34.696 INFO:tasks.workunit.client.0.smithi164.stdout:4/407: stat d2/d19 0 2024-02-10T00:00:34.698 INFO:tasks.workunit.client.0.smithi164.stdout:1/309: fdatasync d1/f6 0 2024-02-10T00:00:34.699 INFO:tasks.workunit.client.0.smithi164.stdout:8/374: dwrite d2/f19 [4194304,4194304] 0 2024-02-10T00:00:34.700 INFO:tasks.workunit.client.1.smithi183.stdout:6/639: sync 2024-02-10T00:00:34.702 INFO:tasks.workunit.client.0.smithi164.stdout:4/408: dwrite d2/d19/d16/f3a [0,4194304] 0 2024-02-10T00:00:34.703 INFO:tasks.workunit.client.1.smithi183.stdout:6/640: unlink d2/d1a/d3a/f48 0 2024-02-10T00:00:34.704 INFO:tasks.workunit.client.1.smithi183.stdout:0/710: read d14/d1d/d2d/d31/f3a [906073,58049] 0 2024-02-10T00:00:34.705 INFO:tasks.workunit.client.1.smithi183.stdout:0/711: write d14/f28 [1791964,107764] 0 2024-02-10T00:00:34.705 INFO:tasks.workunit.client.0.smithi164.stdout:8/375: dwrite d2/d64/f61 [0,4194304] 0 2024-02-10T00:00:34.710 INFO:tasks.workunit.client.0.smithi164.stdout:8/376: rmdir d2/d64/d63/d66 0 2024-02-10T00:00:34.711 INFO:tasks.workunit.client.1.smithi183.stdout:4/776: dread de/d14/d27/d2e/fd4 [0,4194304] 0 2024-02-10T00:00:34.711 INFO:tasks.workunit.client.1.smithi183.stdout:6/641: link d2/f18 d2/d1a/d25/d3c/fc2 0 2024-02-10T00:00:34.713 INFO:tasks.workunit.client.0.smithi164.stdout:8/377: creat d2/d64/d31/d32/d4d/f6b x:0 0 0 2024-02-10T00:00:34.713 INFO:tasks.workunit.client.1.smithi183.stdout:4/777: creat de/d14/d4e/ff2 x:0 0 0 2024-02-10T00:00:34.714 INFO:tasks.workunit.client.1.smithi183.stdout:6/642: fdatasync d2/d1a/d3a/d45/f83 0 2024-02-10T00:00:34.716 INFO:tasks.workunit.client.0.smithi164.stdout:8/378: symlink d2/d64/d63/l6c 0 2024-02-10T00:00:34.717 INFO:tasks.workunit.client.0.smithi164.stdout:8/379: read d2/f7 [499469,114012] 0 2024-02-10T00:00:34.718 INFO:tasks.workunit.client.0.smithi164.stdout:8/380: dread - d2/d64/f42 zero size 2024-02-10T00:00:34.719 INFO:tasks.workunit.client.1.smithi183.stdout:4/778: unlink de/d19/fd7 0 2024-02-10T00:00:34.721 INFO:tasks.workunit.client.1.smithi183.stdout:0/712: getdents d14/d1d/d96/da0 0 2024-02-10T00:00:34.723 INFO:tasks.workunit.client.1.smithi183.stdout:6/643: mknod d2/da0/cc3 0 2024-02-10T00:00:34.726 INFO:tasks.workunit.client.1.smithi183.stdout:0/713: getdents d14/d3e/d5f 0 2024-02-10T00:00:34.727 INFO:tasks.workunit.client.1.smithi183.stdout:0/714: readlink d14/d1d/d55/d6e/d74/l75 0 2024-02-10T00:00:34.727 INFO:tasks.workunit.client.0.smithi164.stdout:3/336: sync 2024-02-10T00:00:34.728 INFO:tasks.workunit.client.1.smithi183.stdout:6/644: getdents d2/d1a/d25/d3c/d31/d38/d6e/d35 0 2024-02-10T00:00:34.729 INFO:tasks.workunit.client.1.smithi183.stdout:6/645: chown d2/d1a/d25/d3c/d31/d66 43942 1 2024-02-10T00:00:34.729 INFO:tasks.workunit.client.0.smithi164.stdout:8/381: dwrite d2/d64/d31/d32/d4d/f6b [0,4194304] 0 2024-02-10T00:00:34.729 INFO:tasks.workunit.client.1.smithi183.stdout:0/715: creat d14/d3e/d92/f105 x:0 0 0 2024-02-10T00:00:34.730 INFO:tasks.workunit.client.1.smithi183.stdout:0/716: readlink d14/d3e/d5f/daa/ddd/lec 0 2024-02-10T00:00:34.730 INFO:tasks.workunit.client.1.smithi183.stdout:0/717: readlink d14/d1d/d59/lc6 0 2024-02-10T00:00:34.731 INFO:tasks.workunit.client.1.smithi183.stdout:6/646: symlink d2/d1a/d3a/lc4 0 2024-02-10T00:00:34.732 INFO:tasks.workunit.client.0.smithi164.stdout:3/337: unlink d0/d1/d3c/d3d/l59 0 2024-02-10T00:00:34.733 INFO:tasks.workunit.client.1.smithi183.stdout:0/718: truncate d14/d1d/d2d/d31/f3a 3315767 0 2024-02-10T00:00:34.734 INFO:tasks.workunit.client.0.smithi164.stdout:8/382: symlink d2/d64/l6d 0 2024-02-10T00:00:34.735 INFO:tasks.workunit.client.1.smithi183.stdout:6/647: rename d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/lac to d2/d1a/d25/d3c/d8d/lc5 0 2024-02-10T00:00:34.735 INFO:tasks.workunit.client.1.smithi183.stdout:6/648: dread - d2/d1a/fbb zero size 2024-02-10T00:00:34.736 INFO:tasks.workunit.client.0.smithi164.stdout:3/338: rename d0/d1/d2/d17/l4d to d0/d1/d2/l68 0 2024-02-10T00:00:34.736 INFO:tasks.workunit.client.1.smithi183.stdout:6/649: chown d2/d1a/d25/d3c/d8d/c8f 7 1 2024-02-10T00:00:34.737 INFO:tasks.workunit.client.1.smithi183.stdout:0/719: link d14/d1d/d2d/d31/d68/da3/cd9 d14/d1d/d55/c106 0 2024-02-10T00:00:34.739 INFO:tasks.workunit.client.1.smithi183.stdout:6/650: truncate d2/d1a/d25/fbd 506926 0 2024-02-10T00:00:34.740 INFO:tasks.workunit.client.0.smithi164.stdout:3/339: link d0/d1/d2/d19/f33 d0/d1/d2/d17/d37/f69 0 2024-02-10T00:00:34.741 INFO:tasks.workunit.client.0.smithi164.stdout:3/340: dread - d0/d1/d2/d19/d45/f4b zero size 2024-02-10T00:00:34.742 INFO:tasks.workunit.client.1.smithi183.stdout:6/651: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lad 54 1 2024-02-10T00:00:34.742 INFO:tasks.workunit.client.0.smithi164.stdout:3/341: write d0/d1/d2/f12 [1263195,16617] 0 2024-02-10T00:00:34.742 INFO:tasks.workunit.client.1.smithi183.stdout:0/720: dwrite d14/d1d/d59/d71/d22/fac [0,4194304] 0 2024-02-10T00:00:34.745 INFO:tasks.workunit.client.0.smithi164.stdout:3/342: rename d0/d1/d2/d19/c28 to d0/d1/d2/d17/d37/c6a 0 2024-02-10T00:00:34.746 INFO:tasks.workunit.client.1.smithi183.stdout:6/652: rename d2/fa4 to d2/d1a/d25/d3c/d31/d38/d3f/d94/fc6 0 2024-02-10T00:00:34.748 INFO:tasks.workunit.client.0.smithi164.stdout:3/343: unlink d0/d1/d2/d19/l2e 0 2024-02-10T00:00:34.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/721: getdents d14 0 2024-02-10T00:00:34.750 INFO:tasks.workunit.client.1.smithi183.stdout:0/722: chown l11 0 1 2024-02-10T00:00:34.753 INFO:tasks.workunit.client.1.smithi183.stdout:6/653: dread d2/d1a/d25/f8e [0,4194304] 0 2024-02-10T00:00:34.753 INFO:tasks.workunit.client.0.smithi164.stdout:3/344: unlink d0/d1/c48 0 2024-02-10T00:00:34.754 INFO:tasks.workunit.client.0.smithi164.stdout:1/310: sync 2024-02-10T00:00:34.756 INFO:tasks.workunit.client.1.smithi183.stdout:0/723: creat d14/d1d/d2d/d31/d68/da3/f107 x:0 0 0 2024-02-10T00:00:34.757 INFO:tasks.workunit.client.1.smithi183.stdout:0/724: write d14/d3e/fca [157632,77383] 0 2024-02-10T00:00:34.757 INFO:tasks.workunit.client.1.smithi183.stdout:9/725: dread d0/d3/d14/d74/da8/faf [0,4194304] 0 2024-02-10T00:00:34.758 INFO:tasks.workunit.client.0.smithi164.stdout:1/311: dwrite d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:34.759 INFO:tasks.workunit.client.0.smithi164.stdout:3/345: mkdir d0/d1/d3c/d3d/d6b 0 2024-02-10T00:00:34.760 INFO:tasks.workunit.client.1.smithi183.stdout:6/654: readlink d2/d1a/d25/d3c/d31/d38/d6e/d34/l37 0 2024-02-10T00:00:34.762 INFO:tasks.workunit.client.0.smithi164.stdout:6/468: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/d92/f8a [0,4194304] 0 2024-02-10T00:00:34.763 INFO:tasks.workunit.client.1.smithi183.stdout:9/726: dwrite d0/d3/d14/d1c/d2d/da3/fe0 [0,4194304] 0 2024-02-10T00:00:34.764 INFO:tasks.workunit.client.0.smithi164.stdout:1/312: mkdir d1/d23/d70 0 2024-02-10T00:00:34.766 INFO:tasks.workunit.client.1.smithi183.stdout:0/725: mkdir d14/d3e/d9b/d108 0 2024-02-10T00:00:34.767 INFO:tasks.workunit.client.1.smithi183.stdout:0/726: chown d14/d43/fb7 9 1 2024-02-10T00:00:34.768 INFO:tasks.workunit.client.1.smithi183.stdout:3/638: dwrite d7/f12 [0,4194304] 0 2024-02-10T00:00:34.770 INFO:tasks.workunit.client.0.smithi164.stdout:0/347: rmdir d6/d10/d4a/d60 39 2024-02-10T00:00:34.771 INFO:tasks.workunit.client.1.smithi183.stdout:6/655: unlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/fbc 0 2024-02-10T00:00:34.772 INFO:tasks.workunit.client.1.smithi183.stdout:6/656: readlink d2/d1a/d25/d3c/d31/d38/d6e/d93/la6 0 2024-02-10T00:00:34.776 INFO:tasks.workunit.client.1.smithi183.stdout:7/677: write d0/d11/d3e/f7c [373671,48481] 0 2024-02-10T00:00:34.777 INFO:tasks.workunit.client.1.smithi183.stdout:7/678: readlink d0/d2/d4/d8/d59/d8a/lbc 0 2024-02-10T00:00:34.782 INFO:tasks.workunit.client.0.smithi164.stdout:7/438: dread d3/f2d [0,4194304] 0 2024-02-10T00:00:34.784 INFO:tasks.workunit.client.0.smithi164.stdout:2/429: getdents d3/d26/d64 0 2024-02-10T00:00:34.784 INFO:tasks.workunit.client.0.smithi164.stdout:7/439: chown d3/d26/l2a 186 1 2024-02-10T00:00:34.784 INFO:tasks.workunit.client.0.smithi164.stdout:5/426: dwrite d7/d17/d3b/d43/f4e [0,4194304] 0 2024-02-10T00:00:34.785 INFO:tasks.workunit.client.0.smithi164.stdout:2/430: write d3/d26/d64/f7e [828683,83100] 0 2024-02-10T00:00:34.786 INFO:tasks.workunit.client.0.smithi164.stdout:0/348: creat d6/d10/d18/d1c/f71 x:0 0 0 2024-02-10T00:00:34.786 INFO:tasks.workunit.client.1.smithi183.stdout:1/660: dwrite d0/d3/f84 [0,4194304] 0 2024-02-10T00:00:34.787 INFO:tasks.workunit.client.0.smithi164.stdout:2/431: rename d3/d32/d4e/d27/d2a/d7a/d8e/d88 to d3/d32/d4e/d27/d2a/d7a/d8e/d88/d9e 22 2024-02-10T00:00:34.790 INFO:tasks.workunit.client.0.smithi164.stdout:9/406: truncate d6/de/d22/f30 404438 0 2024-02-10T00:00:34.792 INFO:tasks.workunit.client.1.smithi183.stdout:5/776: dread d4/dd/f1b [0,4194304] 0 2024-02-10T00:00:34.792 INFO:tasks.workunit.client.1.smithi183.stdout:2/853: dwrite d2/d2c/dba/fda [0,4194304] 0 2024-02-10T00:00:34.793 INFO:tasks.workunit.client.1.smithi183.stdout:8/784: getdents d0/d3f/db2 0 2024-02-10T00:00:34.794 INFO:tasks.workunit.client.0.smithi164.stdout:7/440: mknod d3/d26/d67/c97 0 2024-02-10T00:00:34.795 INFO:tasks.workunit.client.1.smithi183.stdout:8/785: write d0/d27/d75/f7e [1260510,34793] 0 2024-02-10T00:00:34.795 INFO:tasks.workunit.client.0.smithi164.stdout:8/383: dread d2/f11 [4194304,4194304] 0 2024-02-10T00:00:34.799 INFO:tasks.workunit.client.1.smithi183.stdout:5/777: dwrite d4/d23/d3e/d80/da1/d9e/d27/d5d/fbe [0,4194304] 0 2024-02-10T00:00:34.801 INFO:tasks.workunit.client.0.smithi164.stdout:1/313: creat d1/f71 x:0 0 0 2024-02-10T00:00:34.802 INFO:tasks.workunit.client.0.smithi164.stdout:7/441: unlink d3/d28/c73 0 2024-02-10T00:00:34.802 INFO:tasks.workunit.client.0.smithi164.stdout:4/409: sync 2024-02-10T00:00:34.803 INFO:tasks.workunit.client.0.smithi164.stdout:8/384: rmdir d2/d64/d31/d32/d58 39 2024-02-10T00:00:34.803 INFO:tasks.workunit.client.0.smithi164.stdout:1/314: write d1/d23/f67 [981789,93219] 0 2024-02-10T00:00:34.803 INFO:tasks.workunit.client.0.smithi164.stdout:0/349: dread d6/d10/d18/d2d/d35/f41 [0,4194304] 0 2024-02-10T00:00:34.804 INFO:tasks.workunit.client.0.smithi164.stdout:1/315: rename d1 to d1/d1a/d41/d18/d3a/d72 22 2024-02-10T00:00:34.805 INFO:tasks.workunit.client.1.smithi183.stdout:4/779: write de/d19/f95 [1379173,66663] 0 2024-02-10T00:00:34.806 INFO:tasks.workunit.client.0.smithi164.stdout:9/407: symlink d6/de/d40/d74/l7a 0 2024-02-10T00:00:34.806 INFO:tasks.workunit.client.1.smithi183.stdout:4/780: write de/fae [4786810,25088] 0 2024-02-10T00:00:34.806 INFO:tasks.workunit.client.0.smithi164.stdout:8/385: dread d2/f19 [4194304,4194304] 0 2024-02-10T00:00:34.808 INFO:tasks.workunit.client.0.smithi164.stdout:0/350: symlink d6/d3a/l72 0 2024-02-10T00:00:34.810 INFO:tasks.workunit.client.0.smithi164.stdout:0/351: write d6/d10/d18/d2d/d35/d44/d49/f6d [1034759,72162] 0 2024-02-10T00:00:34.811 INFO:tasks.workunit.client.0.smithi164.stdout:5/427: getdents d7/d17 0 2024-02-10T00:00:34.813 INFO:tasks.workunit.client.1.smithi183.stdout:0/727: link d14/d1d/d2d/d31/fcd d14/d3e/d5f/f109 0 2024-02-10T00:00:34.814 INFO:tasks.workunit.client.1.smithi183.stdout:7/679: mknod d0/d11/d88/cd4 0 2024-02-10T00:00:34.814 INFO:tasks.workunit.client.1.smithi183.stdout:0/728: write f6 [3271196,50236] 0 2024-02-10T00:00:34.816 INFO:tasks.workunit.client.0.smithi164.stdout:8/386: rename d2/d64/d31/d32/d4d/f4c to d2/d64/d63/f6e 0 2024-02-10T00:00:34.817 INFO:tasks.workunit.client.0.smithi164.stdout:9/408: dwrite d6/de/d2b/f67 [0,4194304] 0 2024-02-10T00:00:34.819 INFO:tasks.workunit.client.0.smithi164.stdout:9/409: write d6/f7 [4747706,123295] 0 2024-02-10T00:00:34.821 INFO:tasks.workunit.client.0.smithi164.stdout:2/432: getdents d3/d32/d4e/d27 0 2024-02-10T00:00:34.822 INFO:tasks.workunit.client.1.smithi183.stdout:2/854: dread d2/f4a [0,4194304] 0 2024-02-10T00:00:34.822 INFO:tasks.workunit.client.0.smithi164.stdout:2/433: stat d3/d32/d4e/d27/l38 0 2024-02-10T00:00:34.822 INFO:tasks.workunit.client.1.smithi183.stdout:2/855: stat d2/da/d77/f4f 0 2024-02-10T00:00:34.823 INFO:tasks.workunit.client.1.smithi183.stdout:2/856: chown d2/d2c/dba/df0/d121 5 1 2024-02-10T00:00:34.823 INFO:tasks.workunit.client.0.smithi164.stdout:2/434: chown d3/d32/d4e/d27/d2a/d7a/d8e/d36/c89 342876 1 2024-02-10T00:00:34.824 INFO:tasks.workunit.client.0.smithi164.stdout:9/410: creat d6/de/d22/f7b x:0 0 0 2024-02-10T00:00:34.825 INFO:tasks.workunit.client.1.smithi183.stdout:4/781: unlink de/d14/d27/f82 0 2024-02-10T00:00:34.825 INFO:tasks.workunit.client.0.smithi164.stdout:9/411: chown d6/de/d40/d54 279095738 1 2024-02-10T00:00:34.825 INFO:tasks.workunit.client.0.smithi164.stdout:0/352: symlink d6/d10/d18/d2d/d39/l73 0 2024-02-10T00:00:34.826 INFO:tasks.workunit.client.0.smithi164.stdout:1/316: creat d1/d1a/f73 x:0 0 0 2024-02-10T00:00:34.827 INFO:tasks.workunit.client.1.smithi183.stdout:0/729: creat d14/d1d/d55/f10a x:0 0 0 2024-02-10T00:00:34.828 INFO:tasks.workunit.client.1.smithi183.stdout:1/661: mknod d0/d3/d7/d36/d7c/cec 0 2024-02-10T00:00:34.829 INFO:tasks.workunit.client.0.smithi164.stdout:6/469: dread d0/d6/f4f [0,4194304] 0 2024-02-10T00:00:34.829 INFO:tasks.workunit.client.0.smithi164.stdout:0/353: dread d6/d3a/d52/f53 [0,4194304] 0 2024-02-10T00:00:34.829 INFO:tasks.workunit.client.0.smithi164.stdout:9/412: rename d6/de/d22/l4e to d6/d4b/l7c 0 2024-02-10T00:00:34.830 INFO:tasks.workunit.client.1.smithi183.stdout:8/786: creat d0/d23/df6/ff7 x:0 0 0 2024-02-10T00:00:34.830 INFO:tasks.workunit.client.0.smithi164.stdout:8/387: truncate d2/f39 16684 0 2024-02-10T00:00:34.832 INFO:tasks.workunit.client.1.smithi183.stdout:9/727: getdents d0/d3/d14/d48 0 2024-02-10T00:00:34.833 INFO:tasks.workunit.client.1.smithi183.stdout:9/728: chown d0/d3/d14/d3c/d7b/fd3 373143 1 2024-02-10T00:00:34.833 INFO:tasks.workunit.client.1.smithi183.stdout:4/782: creat de/ff3 x:0 0 0 2024-02-10T00:00:34.833 INFO:tasks.workunit.client.1.smithi183.stdout:4/783: chown de/d22/feb 31 1 2024-02-10T00:00:34.835 INFO:tasks.workunit.client.1.smithi183.stdout:0/730: creat d14/d1d/d59/d71/db4/f10b x:0 0 0 2024-02-10T00:00:34.836 INFO:tasks.workunit.client.1.smithi183.stdout:0/731: fdatasync d14/d1d/d59/d3c/d93/fc9 0 2024-02-10T00:00:34.836 INFO:tasks.workunit.client.0.smithi164.stdout:1/317: truncate d1/f71 878974 0 2024-02-10T00:00:34.837 INFO:tasks.workunit.client.1.smithi183.stdout:5/778: rmdir d4/d23/d2a/d5b/def 0 2024-02-10T00:00:34.837 INFO:tasks.workunit.client.1.smithi183.stdout:0/732: dread - d14/d3e/d5f/daa/fd8 zero size 2024-02-10T00:00:34.837 INFO:tasks.workunit.client.0.smithi164.stdout:3/346: sync 2024-02-10T00:00:34.837 INFO:tasks.workunit.client.0.smithi164.stdout:0/354: creat d6/d10/d4a/f74 x:0 0 0 2024-02-10T00:00:34.838 INFO:tasks.workunit.client.0.smithi164.stdout:8/388: creat d2/f6f x:0 0 0 2024-02-10T00:00:34.838 INFO:tasks.workunit.client.0.smithi164.stdout:9/413: truncate d6/de/f3d 431830 0 2024-02-10T00:00:34.838 INFO:tasks.workunit.client.1.smithi183.stdout:6/657: getdents d2/d1a/d25/d3c/d31/d66 0 2024-02-10T00:00:34.839 INFO:tasks.workunit.client.1.smithi183.stdout:9/729: truncate d0/d3/d14/f38 1063230 0 2024-02-10T00:00:34.840 INFO:tasks.workunit.client.0.smithi164.stdout:1/318: dread d1/f9 [0,4194304] 0 2024-02-10T00:00:34.841 INFO:tasks.workunit.client.0.smithi164.stdout:0/355: creat d6/d3a/d52/f75 x:0 0 0 2024-02-10T00:00:34.841 INFO:tasks.workunit.client.0.smithi164.stdout:0/356: dread - d6/d10/d18/f5b zero size 2024-02-10T00:00:34.842 INFO:tasks.workunit.client.1.smithi183.stdout:9/730: fsync d0/d3/d14/d1c/d4b/d51/f75 0 2024-02-10T00:00:34.842 INFO:tasks.workunit.client.0.smithi164.stdout:0/357: fsync d6/d10/d18/d2d/d35/f48 0 2024-02-10T00:00:34.843 INFO:tasks.workunit.client.0.smithi164.stdout:8/389: creat d2/d64/d63/f70 x:0 0 0 2024-02-10T00:00:34.844 INFO:tasks.workunit.client.0.smithi164.stdout:0/358: write d6/d10/d18/f31 [3841126,114865] 0 2024-02-10T00:00:34.844 INFO:tasks.workunit.client.1.smithi183.stdout:0/733: dwrite f6 [0,4194304] 0 2024-02-10T00:00:34.845 INFO:tasks.workunit.client.1.smithi183.stdout:5/779: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/f88 [4194304,4194304] 0 2024-02-10T00:00:34.846 INFO:tasks.workunit.client.1.smithi183.stdout:9/731: chown d0/d3/d14/d1c/d2d/d4f/db8/fe2 29 1 2024-02-10T00:00:34.847 INFO:tasks.workunit.client.1.smithi183.stdout:0/734: read d14/d1d/d2d/d31/d68/dcc/ff8 [1019683,98326] 0 2024-02-10T00:00:34.848 INFO:tasks.workunit.client.1.smithi183.stdout:5/780: write d4/d23/d3e/d80/da1/d9e/d89/f92 [682978,19295] 0 2024-02-10T00:00:34.848 INFO:tasks.workunit.client.1.smithi183.stdout:0/735: fsync d14/d3e/d5f/fb1 0 2024-02-10T00:00:34.849 INFO:tasks.workunit.client.0.smithi164.stdout:1/319: truncate d1/d13/f62 807349 0 2024-02-10T00:00:34.849 INFO:tasks.workunit.client.1.smithi183.stdout:4/784: creat de/d14/d27/ff4 x:0 0 0 2024-02-10T00:00:34.850 INFO:tasks.workunit.client.0.smithi164.stdout:0/359: symlink d6/d10/d4a/l76 0 2024-02-10T00:00:34.850 INFO:tasks.workunit.client.1.smithi183.stdout:6/658: dread d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [0,4194304] 0 2024-02-10T00:00:34.854 INFO:tasks.workunit.client.1.smithi183.stdout:4/785: dwrite de/d19/d20/fb2 [0,4194304] 0 2024-02-10T00:00:34.855 INFO:tasks.workunit.client.0.smithi164.stdout:0/360: mknod d6/d3a/d52/c77 0 2024-02-10T00:00:34.856 INFO:tasks.workunit.client.1.smithi183.stdout:5/781: fdatasync d4/f20 0 2024-02-10T00:00:34.856 INFO:tasks.workunit.client.0.smithi164.stdout:1/320: getdents d1/d13/d2b/d52 0 2024-02-10T00:00:34.858 INFO:tasks.workunit.client.1.smithi183.stdout:6/659: readlink d2/d1a/d3a/l55 0 2024-02-10T00:00:34.859 INFO:tasks.workunit.client.0.smithi164.stdout:1/321: unlink d1/d1a/d35/c5e 0 2024-02-10T00:00:34.860 INFO:tasks.workunit.client.1.smithi183.stdout:0/736: dread d14/d1d/d59/d71/f1b [0,4194304] 0 2024-02-10T00:00:34.862 INFO:tasks.workunit.client.0.smithi164.stdout:1/322: stat d1/d13/f47 0 2024-02-10T00:00:34.865 INFO:tasks.workunit.client.1.smithi183.stdout:0/737: dread d14/d1d/fba [0,4194304] 0 2024-02-10T00:00:34.865 INFO:tasks.workunit.client.1.smithi183.stdout:3/639: dwrite d7/db/d2a/d4d/d63/f81 [0,4194304] 0 2024-02-10T00:00:34.866 INFO:tasks.workunit.client.0.smithi164.stdout:1/323: dwrite d1/d1a/d41/d18/d33/f5b [0,4194304] 0 2024-02-10T00:00:34.867 INFO:tasks.workunit.client.1.smithi183.stdout:3/640: readlink d7/db/d2a/d2d/d51/d8f/lb5 0 2024-02-10T00:00:34.868 INFO:tasks.workunit.client.1.smithi183.stdout:5/782: creat d4/d23/d3e/d80/da1/d9e/d89/dd4/deb/f100 x:0 0 0 2024-02-10T00:00:34.868 INFO:tasks.workunit.client.1.smithi183.stdout:5/783: chown d4/f45 104 1 2024-02-10T00:00:34.874 INFO:tasks.workunit.client.1.smithi183.stdout:2/857: dread d2/f15 [0,4194304] 0 2024-02-10T00:00:34.875 INFO:tasks.workunit.client.1.smithi183.stdout:2/858: read - d2/d2c/dab/d99/f122 zero size 2024-02-10T00:00:34.875 INFO:tasks.workunit.client.1.smithi183.stdout:0/738: link d14/l4e d14/d3e/l10c 0 2024-02-10T00:00:34.876 INFO:tasks.workunit.client.1.smithi183.stdout:8/787: dread d0/d10/d9e/fbe [0,4194304] 0 2024-02-10T00:00:34.877 INFO:tasks.workunit.client.1.smithi183.stdout:8/788: chown d0/d4e/f6a 165 1 2024-02-10T00:00:34.879 INFO:tasks.workunit.client.1.smithi183.stdout:8/789: read d0/d3f/f43 [471477,81406] 0 2024-02-10T00:00:34.884 INFO:tasks.workunit.client.1.smithi183.stdout:7/680: truncate d0/d11/d2f/d64/d6b/f75 2908186 0 2024-02-10T00:00:34.885 INFO:tasks.workunit.client.1.smithi183.stdout:7/681: fsync d0/d11/f82 0 2024-02-10T00:00:34.885 INFO:tasks.workunit.client.0.smithi164.stdout:4/410: dwrite d2/d19/d16/d31/d4b/f8c [0,4194304] 0 2024-02-10T00:00:34.887 INFO:tasks.workunit.client.1.smithi183.stdout:1/662: write d0/d3/d7/d36/d7c/db1/fbe [662980,55946] 0 2024-02-10T00:00:34.889 INFO:tasks.workunit.client.1.smithi183.stdout:1/663: write d0/d3/d7/d3d/f91 [55351,93727] 0 2024-02-10T00:00:34.891 INFO:tasks.workunit.client.1.smithi183.stdout:5/784: getdents d4/d23/d3e 0 2024-02-10T00:00:34.891 INFO:tasks.workunit.client.1.smithi183.stdout:7/682: dwrite d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:34.893 INFO:tasks.workunit.client.1.smithi183.stdout:8/790: creat d0/d27/d36/de3/ff8 x:0 0 0 2024-02-10T00:00:34.899 INFO:tasks.workunit.client.1.smithi183.stdout:2/859: rename d2/d2c/dba/df0/dbd/ff1 to d2/da/d20/d21/d43/d58/d74/f123 0 2024-02-10T00:00:34.900 INFO:tasks.workunit.client.1.smithi183.stdout:2/860: readlink d2/d2c/dba/df0/l102 0 2024-02-10T00:00:34.901 INFO:tasks.workunit.client.1.smithi183.stdout:8/791: write d0/d10/d9e/fbe [6807020,75028] 0 2024-02-10T00:00:34.903 INFO:tasks.workunit.client.0.smithi164.stdout:7/442: sync 2024-02-10T00:00:34.903 INFO:tasks.workunit.client.1.smithi183.stdout:1/664: rename d0/d3/d67/fd2 to d0/d3c/fed 0 2024-02-10T00:00:34.904 INFO:tasks.workunit.client.1.smithi183.stdout:5/785: truncate d4/d23/f86 1040627 0 2024-02-10T00:00:34.907 INFO:tasks.workunit.client.1.smithi183.stdout:8/792: rmdir d0/d23/df6 39 2024-02-10T00:00:34.907 INFO:tasks.workunit.client.1.smithi183.stdout:8/793: readlink d0/d10/d9e/lad 0 2024-02-10T00:00:34.909 INFO:tasks.workunit.client.0.smithi164.stdout:4/411: fsync d2/d19/d16/f3f 0 2024-02-10T00:00:34.909 INFO:tasks.workunit.client.0.smithi164.stdout:2/435: truncate d3/f62 167900 0 2024-02-10T00:00:34.909 INFO:tasks.workunit.client.1.smithi183.stdout:1/665: rename d0/d3/d29/d38/f3b to d0/d3/d7/d36/d7c/fee 0 2024-02-10T00:00:34.909 INFO:tasks.workunit.client.1.smithi183.stdout:1/666: chown d0/d3a 111 1 2024-02-10T00:00:34.910 INFO:tasks.workunit.client.0.smithi164.stdout:6/470: write d0/d2b/d3a/d3d/d42/f84 [689493,108383] 0 2024-02-10T00:00:34.910 INFO:tasks.workunit.client.0.smithi164.stdout:7/443: write d3/d28/f35 [6749211,94603] 0 2024-02-10T00:00:34.910 INFO:tasks.workunit.client.1.smithi183.stdout:5/786: creat d4/d23/d3e/d80/da1/d9e/d27/d37/f101 x:0 0 0 2024-02-10T00:00:34.912 INFO:tasks.workunit.client.0.smithi164.stdout:5/428: dwrite d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:34.913 INFO:tasks.workunit.client.1.smithi183.stdout:8/794: creat d0/d31/db8/ff9 x:0 0 0 2024-02-10T00:00:34.914 INFO:tasks.workunit.client.1.smithi183.stdout:5/787: mkdir d4/d23/d3e/d80/da1/d9e/d27/d9d/d102 0 2024-02-10T00:00:34.914 INFO:tasks.workunit.client.0.smithi164.stdout:3/347: write d0/d1/d3c/f63 [408051,73783] 0 2024-02-10T00:00:34.915 INFO:tasks.workunit.client.1.smithi183.stdout:1/667: mkdir d0/d3/d7/def 0 2024-02-10T00:00:34.915 INFO:tasks.workunit.client.0.smithi164.stdout:7/444: write d3/d11/d39/d44/f90 [770588,3098] 0 2024-02-10T00:00:34.915 INFO:tasks.workunit.client.1.smithi183.stdout:5/788: write d4/d23/d3e/d80/da1/d9e/d27/fcb [1049245,6494] 0 2024-02-10T00:00:34.916 INFO:tasks.workunit.client.1.smithi183.stdout:5/789: read - d4/d23/d3e/d80/da1/d9e/d27/ff4 zero size 2024-02-10T00:00:34.916 INFO:tasks.workunit.client.0.smithi164.stdout:2/436: creat d3/d32/d4e/d27/d2a/d7a/d8e/d36/d54/f9f x:0 0 0 2024-02-10T00:00:34.917 INFO:tasks.workunit.client.1.smithi183.stdout:9/732: sync 2024-02-10T00:00:34.919 INFO:tasks.workunit.client.0.smithi164.stdout:5/429: write d7/d17/d21/d23/d5a/d68/f7c [630429,32303] 0 2024-02-10T00:00:34.921 INFO:tasks.workunit.client.1.smithi183.stdout:1/668: unlink d0/d3c/l56 0 2024-02-10T00:00:34.923 INFO:tasks.workunit.client.0.smithi164.stdout:9/414: dwrite d6/fc [0,4194304] 0 2024-02-10T00:00:34.924 INFO:tasks.workunit.client.0.smithi164.stdout:7/445: fsync d3/d11/d39/d44/d48/f78 0 2024-02-10T00:00:34.924 INFO:tasks.workunit.client.0.smithi164.stdout:4/412: dwrite d2/f5e [4194304,4194304] 0 2024-02-10T00:00:34.925 INFO:tasks.workunit.client.1.smithi183.stdout:1/669: creat d0/d3/d7/d3d/d60/d89/ff0 x:0 0 0 2024-02-10T00:00:34.925 INFO:tasks.workunit.client.0.smithi164.stdout:8/390: dwrite d2/f2c [0,4194304] 0 2024-02-10T00:00:34.927 INFO:tasks.workunit.client.0.smithi164.stdout:6/471: dwrite d0/d6/d12/d57/f7b [0,4194304] 0 2024-02-10T00:00:34.928 INFO:tasks.workunit.client.1.smithi183.stdout:9/733: link d0/d3/d14/d1c/d2d/d4f/d79/f80 d0/d3/d14/d1c/d2d/d4f/fe9 0 2024-02-10T00:00:34.929 INFO:tasks.workunit.client.0.smithi164.stdout:0/361: truncate d6/d10/d18/d2d/f5a 3816860 0 2024-02-10T00:00:34.929 INFO:tasks.workunit.client.0.smithi164.stdout:6/472: write d0/d6/d12/d14/f50 [1659982,85077] 0 2024-02-10T00:00:34.929 INFO:tasks.workunit.client.1.smithi183.stdout:9/734: fdatasync d0/d3/d14/d1c/d2d/fd5 0 2024-02-10T00:00:34.929 INFO:tasks.workunit.client.0.smithi164.stdout:6/473: stat d0/d6/d12/d14/f1e 0 2024-02-10T00:00:34.931 INFO:tasks.workunit.client.0.smithi164.stdout:6/474: dread - d0/d2b/d3a/d3d/d42/d5d/d79/f8b zero size 2024-02-10T00:00:34.932 INFO:tasks.workunit.client.1.smithi183.stdout:4/786: dwrite de/d19/fd1 [0,4194304] 0 2024-02-10T00:00:34.933 INFO:tasks.workunit.client.1.smithi183.stdout:6/660: truncate d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 2975462 0 2024-02-10T00:00:34.934 INFO:tasks.workunit.client.1.smithi183.stdout:1/670: symlink d0/d3a/dd8/lf1 0 2024-02-10T00:00:34.934 INFO:tasks.workunit.client.1.smithi183.stdout:9/735: rmdir d0/d3/d14/d1c 39 2024-02-10T00:00:34.935 INFO:tasks.workunit.client.1.smithi183.stdout:7/683: dread d0/f67 [0,4194304] 0 2024-02-10T00:00:34.936 INFO:tasks.workunit.client.1.smithi183.stdout:4/787: mkdir de/d14/d1d/d2f/da2/d9c/df5 0 2024-02-10T00:00:34.936 INFO:tasks.workunit.client.1.smithi183.stdout:4/788: fsync de/d14/d27/f8b 0 2024-02-10T00:00:34.940 INFO:tasks.workunit.client.0.smithi164.stdout:4/413: stat d2/d19/c73 0 2024-02-10T00:00:34.940 INFO:tasks.workunit.client.0.smithi164.stdout:7/446: fdatasync d3/d11/d39/f47 0 2024-02-10T00:00:34.941 INFO:tasks.workunit.client.0.smithi164.stdout:7/447: stat d3/c24 0 2024-02-10T00:00:34.944 INFO:tasks.workunit.client.0.smithi164.stdout:7/448: dwrite d3/d11/d39/d3a/f66 [0,4194304] 0 2024-02-10T00:00:34.944 INFO:tasks.workunit.client.0.smithi164.stdout:0/362: symlink d6/d10/d18/d2d/d35/d44/d49/l78 0 2024-02-10T00:00:34.945 INFO:tasks.workunit.client.0.smithi164.stdout:0/363: chown d6/d10/d4a/f74 475 1 2024-02-10T00:00:34.946 INFO:tasks.workunit.client.0.smithi164.stdout:2/437: creat d3/d32/fa0 x:0 0 0 2024-02-10T00:00:34.947 INFO:tasks.workunit.client.1.smithi183.stdout:0/739: dwrite d14/d1d/d2d/f79 [0,4194304] 0 2024-02-10T00:00:34.947 INFO:tasks.workunit.client.1.smithi183.stdout:4/789: fsync de/d14/f4a 0 2024-02-10T00:00:34.947 INFO:tasks.workunit.client.1.smithi183.stdout:1/671: chown d0/d3/d7/d3d/d60/d89/le9 240077 1 2024-02-10T00:00:34.949 INFO:tasks.workunit.client.0.smithi164.stdout:6/475: mknod d0/d3b/c9a 0 2024-02-10T00:00:34.950 INFO:tasks.workunit.client.0.smithi164.stdout:7/449: unlink d3/d11/d39/d44/f90 0 2024-02-10T00:00:34.951 INFO:tasks.workunit.client.1.smithi183.stdout:7/684: fdatasync d0/d2/d50/dad/fc5 0 2024-02-10T00:00:34.952 INFO:tasks.workunit.client.0.smithi164.stdout:5/430: creat d7/d17/d21/f89 x:0 0 0 2024-02-10T00:00:34.953 INFO:tasks.workunit.client.0.smithi164.stdout:4/414: symlink d2/l91 0 2024-02-10T00:00:34.953 INFO:tasks.workunit.client.0.smithi164.stdout:8/391: truncate d2/f6f 202430 0 2024-02-10T00:00:34.953 INFO:tasks.workunit.client.1.smithi183.stdout:1/672: dwrite d0/d3/d7/d3d/d99/fe0 [0,4194304] 0 2024-02-10T00:00:34.953 INFO:tasks.workunit.client.0.smithi164.stdout:4/415: stat d2/d19 0 2024-02-10T00:00:34.954 INFO:tasks.workunit.client.0.smithi164.stdout:4/416: chown d2/d19/l18 3688115 1 2024-02-10T00:00:34.954 INFO:tasks.workunit.client.1.smithi183.stdout:9/736: unlink d0/d3/d14/d1c/d2d/d4f/d89/dc5/le5 0 2024-02-10T00:00:34.955 INFO:tasks.workunit.client.1.smithi183.stdout:0/740: creat d14/d1d/d2d/d31/d68/dcc/f10d x:0 0 0 2024-02-10T00:00:34.957 INFO:tasks.workunit.client.1.smithi183.stdout:7/685: creat d0/d11/d2f/da3/fd5 x:0 0 0 2024-02-10T00:00:34.958 INFO:tasks.workunit.client.1.smithi183.stdout:1/673: truncate d0/f8a 309538 0 2024-02-10T00:00:34.958 INFO:tasks.workunit.client.1.smithi183.stdout:1/674: chown d0/d3a/dd8 1662053 1 2024-02-10T00:00:34.960 INFO:tasks.workunit.client.0.smithi164.stdout:6/476: creat d0/d6/f9b x:0 0 0 2024-02-10T00:00:34.960 INFO:tasks.workunit.client.0.smithi164.stdout:7/450: truncate d3/d4d/f55 1121509 0 2024-02-10T00:00:34.960 INFO:tasks.workunit.client.0.smithi164.stdout:2/438: mknod d3/d32/d4e/d27/d2a/d7a/d8e/d8a/ca1 0 2024-02-10T00:00:34.960 INFO:tasks.workunit.client.0.smithi164.stdout:8/392: mkdir d2/d64/d54/d71 0 2024-02-10T00:00:34.961 INFO:tasks.workunit.client.0.smithi164.stdout:2/439: dread - d3/f73 zero size 2024-02-10T00:00:34.962 INFO:tasks.workunit.client.0.smithi164.stdout:5/431: symlink d7/d17/d21/d24/l8a 0 2024-02-10T00:00:34.963 INFO:tasks.workunit.client.1.smithi183.stdout:1/675: dwrite d0/d3/d67/d70/f7d [0,4194304] 0 2024-02-10T00:00:34.966 INFO:tasks.workunit.client.0.smithi164.stdout:5/432: mkdir d7/d17/d21/d23/d37/d36/d8b 0 2024-02-10T00:00:34.967 INFO:tasks.workunit.client.1.smithi183.stdout:4/790: mkdir de/d14/d1d/d2f/da2/d9c/df5/df6 0 2024-02-10T00:00:34.969 INFO:tasks.workunit.client.1.smithi183.stdout:2/861: dwrite d2/d2c/dab/d99/fa3 [0,4194304] 0 2024-02-10T00:00:34.969 INFO:tasks.workunit.client.1.smithi183.stdout:3/641: sync 2024-02-10T00:00:34.969 INFO:tasks.workunit.client.1.smithi183.stdout:0/741: creat d14/d1d/d2d/f10e x:0 0 0 2024-02-10T00:00:34.971 INFO:tasks.workunit.client.1.smithi183.stdout:8/795: truncate d0/d3f/db2/f21 298174 0 2024-02-10T00:00:34.972 INFO:tasks.workunit.client.0.smithi164.stdout:5/433: dwrite d7/d17/d21/f58 [0,4194304] 0 2024-02-10T00:00:34.972 INFO:tasks.workunit.client.1.smithi183.stdout:7/686: fsync d0/f67 0 2024-02-10T00:00:34.972 INFO:tasks.workunit.client.1.smithi183.stdout:8/796: write d0/d3f/d94/fcb [406344,109282] 0 2024-02-10T00:00:34.973 INFO:tasks.workunit.client.1.smithi183.stdout:9/737: symlink d0/d3/d14/lea 0 2024-02-10T00:00:34.975 INFO:tasks.workunit.client.0.smithi164.stdout:5/434: unlink l6 0 2024-02-10T00:00:34.975 INFO:tasks.workunit.client.1.smithi183.stdout:1/676: mknod d0/d3/d29/d38/cf2 0 2024-02-10T00:00:34.977 INFO:tasks.workunit.client.1.smithi183.stdout:7/687: dwrite d0/d11/d2f/fae [0,4194304] 0 2024-02-10T00:00:34.978 INFO:tasks.workunit.client.1.smithi183.stdout:3/642: chown d7/f30 262723 1 2024-02-10T00:00:34.979 INFO:tasks.workunit.client.0.smithi164.stdout:1/324: sync 2024-02-10T00:00:34.979 INFO:tasks.workunit.client.0.smithi164.stdout:1/325: chown l0 46011413 1 2024-02-10T00:00:34.981 INFO:tasks.workunit.client.1.smithi183.stdout:8/797: rename d0/d27/d36/c9a to d0/d31/db8/cfa 0 2024-02-10T00:00:34.982 INFO:tasks.workunit.client.0.smithi164.stdout:5/435: readlink d7/d17/d21/l57 0 2024-02-10T00:00:34.983 INFO:tasks.workunit.client.1.smithi183.stdout:9/738: symlink d0/d3/d14/d1c/d2d/d4f/da4/leb 0 2024-02-10T00:00:34.983 INFO:tasks.workunit.client.1.smithi183.stdout:7/688: dwrite d0/d11/f4f [0,4194304] 0 2024-02-10T00:00:34.984 INFO:tasks.workunit.client.1.smithi183.stdout:3/643: dwrite d7/db/f24 [0,4194304] 0 2024-02-10T00:00:34.985 INFO:tasks.workunit.client.0.smithi164.stdout:5/436: creat d7/d17/d3b/f8c x:0 0 0 2024-02-10T00:00:34.985 INFO:tasks.workunit.client.0.smithi164.stdout:5/437: readlink d7/d17/d21/d23/d37/l49 0 2024-02-10T00:00:34.986 INFO:tasks.workunit.client.0.smithi164.stdout:5/438: fsync d7/d17/d69/f6a 0 2024-02-10T00:00:34.986 INFO:tasks.workunit.client.0.smithi164.stdout:5/439: chown d7/d17/d21/d23/d37/d36/l76 1606 1 2024-02-10T00:00:34.988 INFO:tasks.workunit.client.1.smithi183.stdout:7/689: creat d0/d2/d4/d8/d59/fd6 x:0 0 0 2024-02-10T00:00:34.989 INFO:tasks.workunit.client.1.smithi183.stdout:3/644: creat d7/db/d2a/d2d/d51/fbd x:0 0 0 2024-02-10T00:00:34.991 INFO:tasks.workunit.client.1.smithi183.stdout:1/677: dwrite d0/d3/d7/d36/d7c/fee [8388608,4194304] 0 2024-02-10T00:00:34.992 INFO:tasks.workunit.client.1.smithi183.stdout:9/739: truncate d0/d3/d14/d1c/d4b/d97/daa/fd8 1033104 0 2024-02-10T00:00:34.995 INFO:tasks.workunit.client.1.smithi183.stdout:1/678: creat d0/d3a/ff3 x:0 0 0 2024-02-10T00:00:34.996 INFO:tasks.workunit.client.1.smithi183.stdout:9/740: symlink d0/d30/d52/ddc/lec 0 2024-02-10T00:00:34.997 INFO:tasks.workunit.client.0.smithi164.stdout:5/440: creat d7/d17/d21/d23/d37/d36/d8b/f8d x:0 0 0 2024-02-10T00:00:34.997 INFO:tasks.workunit.client.0.smithi164.stdout:5/441: dread - d7/d17/d21/d24/f4c zero size 2024-02-10T00:00:34.998 INFO:tasks.workunit.client.1.smithi183.stdout:1/679: chown d0/d3/d7/l9a 0 1 2024-02-10T00:00:34.998 INFO:tasks.workunit.client.1.smithi183.stdout:1/680: write d0/f4b [2403129,587] 0 2024-02-10T00:00:34.999 INFO:tasks.workunit.client.1.smithi183.stdout:9/741: creat d0/d3/d14/d1c/d2d/fed x:0 0 0 2024-02-10T00:00:34.999 INFO:tasks.workunit.client.1.smithi183.stdout:7/690: link d0/d2/d4/l2a d0/d11/d2f/dbf/ld7 0 2024-02-10T00:00:35.000 INFO:tasks.workunit.client.1.smithi183.stdout:1/681: write d0/d3/f2d [2379115,13804] 0 2024-02-10T00:00:35.000 INFO:tasks.workunit.client.1.smithi183.stdout:1/682: chown d0/d3 0 1 2024-02-10T00:00:35.001 INFO:tasks.workunit.client.0.smithi164.stdout:5/442: link d7/l11 d7/d17/d69/l8e 0 2024-02-10T00:00:35.002 INFO:tasks.workunit.client.0.smithi164.stdout:5/443: write d7/d17/d3b/d43/f6e [54698,100896] 0 2024-02-10T00:00:35.003 INFO:tasks.workunit.client.1.smithi183.stdout:9/742: mknod d0/d3/d14/d1c/d2d/da3/cee 0 2024-02-10T00:00:35.005 INFO:tasks.workunit.client.0.smithi164.stdout:5/444: mknod d7/d17/d21/d23/d5a/d68/d1f/d59/c8f 0 2024-02-10T00:00:35.005 INFO:tasks.workunit.client.1.smithi183.stdout:1/683: mkdir d0/d3/d7/d3d/d60/d89/de4/df4 0 2024-02-10T00:00:35.006 INFO:tasks.workunit.client.0.smithi164.stdout:9/415: write d6/fc [4468660,83612] 0 2024-02-10T00:00:35.007 INFO:tasks.workunit.client.1.smithi183.stdout:6/661: sync 2024-02-10T00:00:35.007 INFO:tasks.workunit.client.1.smithi183.stdout:6/662: dread - d2/d1a/d25/d3c/d31/f8a zero size 2024-02-10T00:00:35.009 INFO:tasks.workunit.client.1.smithi183.stdout:1/684: getdents d0/d3/d7/d3d/d60 0 2024-02-10T00:00:35.010 INFO:tasks.workunit.client.0.smithi164.stdout:9/416: symlink d6/de/d22/l7d 0 2024-02-10T00:00:35.010 INFO:tasks.workunit.client.1.smithi183.stdout:1/685: dread - d0/d3/d7/d3d/d60/d89/ff0 zero size 2024-02-10T00:00:35.011 INFO:tasks.workunit.client.1.smithi183.stdout:1/686: write d0/f4b [514292,36719] 0 2024-02-10T00:00:35.012 INFO:tasks.workunit.client.0.smithi164.stdout:3/348: dwrite d0/d1/d2/d19/f33 [0,4194304] 0 2024-02-10T00:00:35.013 INFO:tasks.workunit.client.0.smithi164.stdout:0/364: sync 2024-02-10T00:00:35.013 INFO:tasks.workunit.client.0.smithi164.stdout:3/349: readlink d0/d1/d2/d19/l50 0 2024-02-10T00:00:35.015 INFO:tasks.workunit.client.0.smithi164.stdout:0/365: mkdir d6/d7/d14/d79 0 2024-02-10T00:00:35.016 INFO:tasks.workunit.client.0.smithi164.stdout:0/366: chown d6/d10/d18/d1c/f2c 1 1 2024-02-10T00:00:35.016 INFO:tasks.workunit.client.0.smithi164.stdout:3/350: creat d0/d3b/f6c x:0 0 0 2024-02-10T00:00:35.016 INFO:tasks.workunit.client.0.smithi164.stdout:9/417: link d6/de/c17 d6/de/d22/d58/c7e 0 2024-02-10T00:00:35.018 INFO:tasks.workunit.client.0.smithi164.stdout:9/418: mknod d6/de/d40/c7f 0 2024-02-10T00:00:35.021 INFO:tasks.workunit.client.0.smithi164.stdout:3/351: rename d0/d1/d2/d19/d45 to d0/d1/d2/d17/d37/d3f/d4e/d6d 0 2024-02-10T00:00:35.033 INFO:tasks.workunit.client.1.smithi183.stdout:8/798: sync 2024-02-10T00:00:35.034 INFO:tasks.workunit.client.1.smithi183.stdout:8/799: fsync d0/d4e/d6b/fce 0 2024-02-10T00:00:35.036 INFO:tasks.workunit.client.1.smithi183.stdout:8/800: unlink d0/d3f/db2/f7b 0 2024-02-10T00:00:35.046 INFO:tasks.workunit.client.0.smithi164.stdout:2/440: dread d3/f44 [0,4194304] 0 2024-02-10T00:00:35.047 INFO:tasks.workunit.client.0.smithi164.stdout:2/441: dread - d3/d32/d4e/d27/d2a/d7a/d8e/d36/f83 zero size 2024-02-10T00:00:35.049 INFO:tasks.workunit.client.0.smithi164.stdout:2/442: mknod d3/d32/d4e/d27/d2a/d7a/d8e/d36/d90/ca2 0 2024-02-10T00:00:35.049 INFO:tasks.workunit.client.0.smithi164.stdout:2/443: chown d3/d26/d64/f7e 1047931 1 2024-02-10T00:00:35.051 INFO:tasks.workunit.client.1.smithi183.stdout:8/801: read d0/fd [6446867,24170] 0 2024-02-10T00:00:35.052 INFO:tasks.workunit.client.0.smithi164.stdout:2/444: creat d3/d32/d4e/d27/d2a/d7a/fa3 x:0 0 0 2024-02-10T00:00:35.053 INFO:tasks.workunit.client.0.smithi164.stdout:7/451: sync 2024-02-10T00:00:35.053 INFO:tasks.workunit.client.1.smithi183.stdout:8/802: chown d0/d3f/db2/d24/f7a 11 1 2024-02-10T00:00:35.053 INFO:tasks.workunit.client.0.smithi164.stdout:2/445: creat d3/d26/d56/fa4 x:0 0 0 2024-02-10T00:00:35.054 INFO:tasks.workunit.client.0.smithi164.stdout:2/446: fdatasync d3/f61 0 2024-02-10T00:00:35.054 INFO:tasks.workunit.client.0.smithi164.stdout:7/452: mkdir d3/d26/d67/d98 0 2024-02-10T00:00:35.057 INFO:tasks.workunit.client.1.smithi183.stdout:8/803: getdents d0 0 2024-02-10T00:00:35.058 INFO:tasks.workunit.client.1.smithi183.stdout:9/743: dread d0/f5b [0,4194304] 0 2024-02-10T00:00:35.059 INFO:tasks.workunit.client.0.smithi164.stdout:7/453: getdents d3/d11/d39/d44/d6f/d75 0 2024-02-10T00:00:35.060 INFO:tasks.workunit.client.1.smithi183.stdout:8/804: dread - d0/d4e/d53/fe1 zero size 2024-02-10T00:00:35.060 INFO:tasks.workunit.client.1.smithi183.stdout:9/744: mknod d0/d3/cef 0 2024-02-10T00:00:35.062 INFO:tasks.workunit.client.1.smithi183.stdout:8/805: rename d0/d3f/d94/fd7 to d0/d27/d36/de3/ffb 0 2024-02-10T00:00:35.064 INFO:tasks.workunit.client.1.smithi183.stdout:9/745: write d0/d10/f50 [1824984,5558] 0 2024-02-10T00:00:35.065 INFO:tasks.workunit.client.1.smithi183.stdout:7/691: sync 2024-02-10T00:00:35.069 INFO:tasks.workunit.client.1.smithi183.stdout:5/790: dwrite d4/d23/d3e/d80/da1/d9e/d27/fca [0,4194304] 0 2024-02-10T00:00:35.070 INFO:tasks.workunit.client.0.smithi164.stdout:8/393: dread d2/f39 [0,4194304] 0 2024-02-10T00:00:35.071 INFO:tasks.workunit.client.0.smithi164.stdout:9/419: read d6/de/f3d [314986,42086] 0 2024-02-10T00:00:35.071 INFO:tasks.workunit.client.0.smithi164.stdout:8/394: chown d2/d64/d31/d32/d4d 27 1 2024-02-10T00:00:35.072 INFO:tasks.workunit.client.0.smithi164.stdout:8/395: chown d2/d64/d65 7292641 1 2024-02-10T00:00:35.076 INFO:tasks.workunit.client.1.smithi183.stdout:2/862: dread d2/f3e [0,4194304] 0 2024-02-10T00:00:35.077 INFO:tasks.workunit.client.0.smithi164.stdout:4/417: write d2/d2f/d37/d41/d3d/d42/f63 [58015,87612] 0 2024-02-10T00:00:35.078 INFO:tasks.workunit.client.0.smithi164.stdout:7/454: rmdir d3/d11 39 2024-02-10T00:00:35.078 INFO:tasks.workunit.client.1.smithi183.stdout:0/742: write d14/d1d/d59/d71/d22/f41 [4790210,29308] 0 2024-02-10T00:00:35.079 INFO:tasks.workunit.client.0.smithi164.stdout:2/447: sync 2024-02-10T00:00:35.079 INFO:tasks.workunit.client.0.smithi164.stdout:5/445: dread d7/d17/d21/d23/d5a/d68/d1f/f44 [0,4194304] 0 2024-02-10T00:00:35.082 INFO:tasks.workunit.client.0.smithi164.stdout:9/420: read d6/d1c/f1f [1442241,59138] 0 2024-02-10T00:00:35.082 INFO:tasks.workunit.client.0.smithi164.stdout:8/396: rename d2/d64/d63/f6e to d2/d12/f72 0 2024-02-10T00:00:35.082 INFO:tasks.workunit.client.1.smithi183.stdout:1/687: dread d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:35.083 INFO:tasks.workunit.client.0.smithi164.stdout:3/352: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:35.083 INFO:tasks.workunit.client.1.smithi183.stdout:3/645: truncate d7/db/d2a/d2d/f84 3972901 0 2024-02-10T00:00:35.085 INFO:tasks.workunit.client.1.smithi183.stdout:4/791: dwrite de/f7f [0,4194304] 0 2024-02-10T00:00:35.087 INFO:tasks.workunit.client.0.smithi164.stdout:9/421: dwrite d6/de/d2b/d5b/d61/d76/f78 [0,4194304] 0 2024-02-10T00:00:35.089 INFO:tasks.workunit.client.0.smithi164.stdout:8/397: symlink d2/d64/d31/d32/d4d/l73 0 2024-02-10T00:00:35.089 INFO:tasks.workunit.client.1.smithi183.stdout:6/663: write d2/d1a/d25/d3c/fba [1387921,66203] 0 2024-02-10T00:00:35.090 INFO:tasks.workunit.client.1.smithi183.stdout:6/664: chown d2/f19 0 1 2024-02-10T00:00:35.091 INFO:tasks.workunit.client.1.smithi183.stdout:6/665: write d2/d1a/d3a/d45/fb1 [779878,76262] 0 2024-02-10T00:00:35.092 INFO:tasks.workunit.client.1.smithi183.stdout:6/666: read - d2/d1a/d25/d3c/d31/d38/d3f/d94/fa2 zero size 2024-02-10T00:00:35.093 INFO:tasks.workunit.client.0.smithi164.stdout:7/455: rename d3/f2d to d3/d11/d39/d44/d48/d50/d92/f99 0 2024-02-10T00:00:35.094 INFO:tasks.workunit.client.1.smithi183.stdout:6/667: stat d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lad 0 2024-02-10T00:00:35.094 INFO:tasks.workunit.client.1.smithi183.stdout:7/692: fsync d0/d2/d50/dad/f51 0 2024-02-10T00:00:35.095 INFO:tasks.workunit.client.0.smithi164.stdout:1/326: write d1/d13/f14 [3872558,98591] 0 2024-02-10T00:00:35.097 INFO:tasks.workunit.client.1.smithi183.stdout:8/806: dwrite d0/d3f/f79 [0,4194304] 0 2024-02-10T00:00:35.097 INFO:tasks.workunit.client.0.smithi164.stdout:6/477: dwrite d0/d2b/d3a/f8f [0,4194304] 0 2024-02-10T00:00:35.098 INFO:tasks.workunit.client.0.smithi164.stdout:6/478: fdatasync d0/d2b/d3a/f87 0 2024-02-10T00:00:35.099 INFO:tasks.workunit.client.1.smithi183.stdout:1/688: chown d0/d3/d7/d3d/l75 0 1 2024-02-10T00:00:35.100 INFO:tasks.workunit.client.1.smithi183.stdout:8/807: write d0/d27/d75/d5b/f89 [846131,56538] 0 2024-02-10T00:00:35.101 INFO:tasks.workunit.client.1.smithi183.stdout:3/646: readlink d7/db/d2a/l26 0 2024-02-10T00:00:35.103 INFO:tasks.workunit.client.1.smithi183.stdout:7/693: dwrite d0/d11/f1c [4194304,4194304] 0 2024-02-10T00:00:35.104 INFO:tasks.workunit.client.1.smithi183.stdout:1/689: chown d0/d3/d67/d70/f7d 1 1 2024-02-10T00:00:35.105 INFO:tasks.workunit.client.0.smithi164.stdout:0/367: dwrite d6/d10/d18/f67 [0,4194304] 0 2024-02-10T00:00:35.105 INFO:tasks.workunit.client.0.smithi164.stdout:0/368: stat d6/d7/f6f 0 2024-02-10T00:00:35.106 INFO:tasks.workunit.client.1.smithi183.stdout:5/791: mknod d4/dd/c103 0 2024-02-10T00:00:35.106 INFO:tasks.workunit.client.1.smithi183.stdout:2/863: dwrite d2/da/d77/f4f [0,4194304] 0 2024-02-10T00:00:35.106 INFO:tasks.workunit.client.1.smithi183.stdout:9/746: dread d0/d30/d52/ddc/f9f [0,4194304] 0 2024-02-10T00:00:35.107 INFO:tasks.workunit.client.1.smithi183.stdout:0/743: mknod d14/d1d/d2d/d31/dc8/c10f 0 2024-02-10T00:00:35.107 INFO:tasks.workunit.client.1.smithi183.stdout:1/690: write d0/d3/d7/d3d/f91 [692567,93133] 0 2024-02-10T00:00:35.108 INFO:tasks.workunit.client.0.smithi164.stdout:0/369: dwrite d6/d10/d18/d2d/f51 [0,4194304] 0 2024-02-10T00:00:35.109 INFO:tasks.workunit.client.1.smithi183.stdout:9/747: chown d0/d3/d14/d1c/d2d/d4f/d79/f80 103 1 2024-02-10T00:00:35.110 INFO:tasks.workunit.client.1.smithi183.stdout:6/668: truncate d2/fc0 621531 0 2024-02-10T00:00:35.111 INFO:tasks.workunit.client.1.smithi183.stdout:3/647: creat d7/db/d2a/d4d/d63/fbe x:0 0 0 2024-02-10T00:00:35.111 INFO:tasks.workunit.client.1.smithi183.stdout:7/694: readlink d0/d2/l72 0 2024-02-10T00:00:35.112 INFO:tasks.workunit.client.0.smithi164.stdout:5/446: write d7/f19 [966451,79974] 0 2024-02-10T00:00:35.114 INFO:tasks.workunit.client.0.smithi164.stdout:4/418: truncate d2/d2f/f4c 103051 0 2024-02-10T00:00:35.114 INFO:tasks.workunit.client.0.smithi164.stdout:0/370: dwrite d6/d3a/d52/f75 [0,4194304] 0 2024-02-10T00:00:35.114 INFO:tasks.workunit.client.1.smithi183.stdout:0/744: creat d14/d1d/d55/f110 x:0 0 0 2024-02-10T00:00:35.115 INFO:tasks.workunit.client.1.smithi183.stdout:3/648: write d7/db/d2a/d2d/d51/fbd [1003352,25309] 0 2024-02-10T00:00:35.115 INFO:tasks.workunit.client.1.smithi183.stdout:5/792: mkdir d4/d23/d3e/d80/da1/d9e/d27/d37/d104 0 2024-02-10T00:00:35.115 INFO:tasks.workunit.client.1.smithi183.stdout:6/669: write d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fb6 [515331,31682] 0 2024-02-10T00:00:35.117 INFO:tasks.workunit.client.1.smithi183.stdout:4/792: mkdir de/d19/d20/de6/df7 0 2024-02-10T00:00:35.117 INFO:tasks.workunit.client.1.smithi183.stdout:2/864: symlink d2/da/d20/d21/d43/d58/d74/d10e/l124 0 2024-02-10T00:00:35.117 INFO:tasks.workunit.client.0.smithi164.stdout:5/447: write d7/d17/d3b/f6b [495328,93466] 0 2024-02-10T00:00:35.117 INFO:tasks.workunit.client.0.smithi164.stdout:7/456: chown d3/d4d/l57 582102 1 2024-02-10T00:00:35.118 INFO:tasks.workunit.client.0.smithi164.stdout:1/327: truncate d1/f6 539112 0 2024-02-10T00:00:35.119 INFO:tasks.workunit.client.0.smithi164.stdout:6/479: mknod d0/d2b/c9c 0 2024-02-10T00:00:35.119 INFO:tasks.workunit.client.1.smithi183.stdout:9/748: symlink d0/d3/d14/d1c/d2d/d4f/da4/dda/lf0 0 2024-02-10T00:00:35.119 INFO:tasks.workunit.client.1.smithi183.stdout:7/695: creat d0/d11/d2f/dbf/fd8 x:0 0 0 2024-02-10T00:00:35.120 INFO:tasks.workunit.client.0.smithi164.stdout:2/448: sync 2024-02-10T00:00:35.122 INFO:tasks.workunit.client.1.smithi183.stdout:5/793: rename d4/f79 to d4/d74/f105 0 2024-02-10T00:00:35.124 INFO:tasks.workunit.client.1.smithi183.stdout:4/793: fsync de/d14/d27/d2e/f3f 0 2024-02-10T00:00:35.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/749: mknod d0/d3/d14/d1c/d4b/d97/cf1 0 2024-02-10T00:00:35.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/750: stat d0/d3/d14/d1c/d2d/d4f/db8 0 2024-02-10T00:00:35.128 INFO:tasks.workunit.client.1.smithi183.stdout:9/751: dread d0/f5b [0,4194304] 0 2024-02-10T00:00:35.129 INFO:tasks.workunit.client.1.smithi183.stdout:9/752: chown d0/d3/d14/d1c/f45 5109925 1 2024-02-10T00:00:35.129 INFO:tasks.workunit.client.1.smithi183.stdout:3/649: mknod d7/db/d2a/d2d/d51/db8/cbf 0 2024-02-10T00:00:35.130 INFO:tasks.workunit.client.1.smithi183.stdout:3/650: write d7/db/fba [250481,88342] 0 2024-02-10T00:00:35.131 INFO:tasks.workunit.client.0.smithi164.stdout:0/371: rmdir d6/d10/d66 39 2024-02-10T00:00:35.131 INFO:tasks.workunit.client.0.smithi164.stdout:4/419: unlink d2/d2f/d37/d41/d3d/d42/f78 0 2024-02-10T00:00:35.132 INFO:tasks.workunit.client.1.smithi183.stdout:3/651: chown d7/db/d2a/d33/d59/daa/cb2 6249304 1 2024-02-10T00:00:35.132 INFO:tasks.workunit.client.1.smithi183.stdout:3/652: write d7/db/d2a/d8e/fae [264101,81932] 0 2024-02-10T00:00:35.133 INFO:tasks.workunit.client.0.smithi164.stdout:5/448: symlink d7/d17/d21/d23/d37/d36/d8b/l90 0 2024-02-10T00:00:35.133 INFO:tasks.workunit.client.0.smithi164.stdout:6/480: symlink d0/d6/d4d/l9d 0 2024-02-10T00:00:35.133 INFO:tasks.workunit.client.0.smithi164.stdout:5/449: chown d7/d17/f48 169250095 1 2024-02-10T00:00:35.133 INFO:tasks.workunit.client.0.smithi164.stdout:5/450: dread - d7/d17/d21/d23/d5a/f74 zero size 2024-02-10T00:00:35.136 INFO:tasks.workunit.client.1.smithi183.stdout:6/670: link d2/d1a/f1f d2/d1a/d25/d3c/d31/fc7 0 2024-02-10T00:00:35.137 INFO:tasks.workunit.client.1.smithi183.stdout:6/671: stat d2/d1a/d25/d3c/d31/d38/f5d 0 2024-02-10T00:00:35.137 INFO:tasks.workunit.client.0.smithi164.stdout:3/353: link d0/d1/d2/l68 d0/d1/d2/d19/d27/d5f/l6e 0 2024-02-10T00:00:35.138 INFO:tasks.workunit.client.1.smithi183.stdout:5/794: symlink d4/d23/d3e/d80/da1/l106 0 2024-02-10T00:00:35.138 INFO:tasks.workunit.client.0.smithi164.stdout:7/457: mkdir d3/d11/d39/d44/d9a 0 2024-02-10T00:00:35.138 INFO:tasks.workunit.client.0.smithi164.stdout:1/328: mknod d1/d23/d61/c74 0 2024-02-10T00:00:35.139 INFO:tasks.workunit.client.0.smithi164.stdout:7/458: dread - d3/d5/d59/f8c zero size 2024-02-10T00:00:35.139 INFO:tasks.workunit.client.1.smithi183.stdout:1/691: link d0/d3/d7/d3d/d60/d89/l90 d0/d3/d67/d70/dae/lf5 0 2024-02-10T00:00:35.141 INFO:tasks.workunit.client.1.smithi183.stdout:4/794: creat de/d14/d1d/d2f/da2/d9c/ff8 x:0 0 0 2024-02-10T00:00:35.142 INFO:tasks.workunit.client.0.smithi164.stdout:6/481: creat d0/d6/d12/d14/d4b/f9e x:0 0 0 2024-02-10T00:00:35.142 INFO:tasks.workunit.client.0.smithi164.stdout:3/354: chown d0/f10 2972821 1 2024-02-10T00:00:35.143 INFO:tasks.workunit.client.1.smithi183.stdout:0/745: creat d14/d1d/d59/d3c/f111 x:0 0 0 2024-02-10T00:00:35.143 INFO:tasks.workunit.client.0.smithi164.stdout:4/420: symlink d2/d2f/d37/d41/d69/l92 0 2024-02-10T00:00:35.144 INFO:tasks.workunit.client.1.smithi183.stdout:3/653: fsync d7/d98/fa3 0 2024-02-10T00:00:35.146 INFO:tasks.workunit.client.0.smithi164.stdout:7/459: fsync d3/d28/d45/d4b/f6d 0 2024-02-10T00:00:35.147 INFO:tasks.workunit.client.1.smithi183.stdout:2/865: creat d2/da/d20/d21/d43/d58/f125 x:0 0 0 2024-02-10T00:00:35.147 INFO:tasks.workunit.client.1.smithi183.stdout:1/692: fdatasync d0/f9d 0 2024-02-10T00:00:35.147 INFO:tasks.workunit.client.0.smithi164.stdout:3/355: dwrite d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:35.148 INFO:tasks.workunit.client.0.smithi164.stdout:6/482: symlink d0/d2b/d3a/d3d/d6d/l9f 0 2024-02-10T00:00:35.148 INFO:tasks.workunit.client.0.smithi164.stdout:7/460: write d3/d11/d39/d3a/f94 [421795,37592] 0 2024-02-10T00:00:35.149 INFO:tasks.workunit.client.1.smithi183.stdout:9/753: symlink d0/d92/db7/lf2 0 2024-02-10T00:00:35.150 INFO:tasks.workunit.client.1.smithi183.stdout:0/746: write d14/d1d/d55/f5a [1587037,67210] 0 2024-02-10T00:00:35.150 INFO:tasks.workunit.client.0.smithi164.stdout:6/483: write d0/d6/d12/f22 [404999,116060] 0 2024-02-10T00:00:35.150 INFO:tasks.workunit.client.0.smithi164.stdout:1/329: getdents d1/d13/d2b 0 2024-02-10T00:00:35.151 INFO:tasks.workunit.client.0.smithi164.stdout:3/356: unlink d0/d1/d2/d19/d27/d30/l64 0 2024-02-10T00:00:35.151 INFO:tasks.workunit.client.1.smithi183.stdout:0/747: dread - d14/d3e/d9b/fe4 zero size 2024-02-10T00:00:35.151 INFO:tasks.workunit.client.1.smithi183.stdout:0/748: stat d14/d1d/d55/f5a 0 2024-02-10T00:00:35.153 INFO:tasks.workunit.client.0.smithi164.stdout:1/330: mkdir d1/d1a/d75 0 2024-02-10T00:00:35.154 INFO:tasks.workunit.client.1.smithi183.stdout:8/808: dread d0/d31/f88 [0,4194304] 0 2024-02-10T00:00:35.154 INFO:tasks.workunit.client.0.smithi164.stdout:1/331: chown d1/d64 0 1 2024-02-10T00:00:35.155 INFO:tasks.workunit.client.1.smithi183.stdout:2/866: symlink d2/da/d20/d21/d43/d58/d74/d83/l126 0 2024-02-10T00:00:35.156 INFO:tasks.workunit.client.1.smithi183.stdout:0/749: dwrite d14/d1d/d59/d71/d22/f48 [0,4194304] 0 2024-02-10T00:00:35.156 INFO:tasks.workunit.client.0.smithi164.stdout:6/484: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:7/461: dwrite d3/d28/d45/d4b/f6a [0,4194304] 0 2024-02-10T00:00:35.157 INFO:tasks.workunit.client.1.smithi183.stdout:1/693: creat d0/d3/d7/d36/d7c/db1/ff6 x:0 0 0 2024-02-10T00:00:35.159 INFO:tasks.workunit.client.1.smithi183.stdout:9/754: creat d0/d3/d14/d1c/d4b/ff3 x:0 0 0 2024-02-10T00:00:35.160 INFO:tasks.workunit.client.0.smithi164.stdout:1/332: symlink d1/l76 0 2024-02-10T00:00:35.161 INFO:tasks.workunit.client.1.smithi183.stdout:0/750: symlink d14/d3e/d5f/l112 0 2024-02-10T00:00:35.161 INFO:tasks.workunit.client.0.smithi164.stdout:6/485: mknod d0/d2b/d3a/d3d/d42/ca0 0 2024-02-10T00:00:35.161 INFO:tasks.workunit.client.1.smithi183.stdout:0/751: chown d14/d1d/d59/d71/d22/c5b 5947 1 2024-02-10T00:00:35.162 INFO:tasks.workunit.client.0.smithi164.stdout:1/333: creat d1/d13/d2b/d54/f77 x:0 0 0 2024-02-10T00:00:35.162 INFO:tasks.workunit.client.1.smithi183.stdout:9/755: symlink d0/d3/d14/d1c/d2d/da3/lf4 0 2024-02-10T00:00:35.163 INFO:tasks.workunit.client.0.smithi164.stdout:7/462: truncate d3/d4d/f55 535110 0 2024-02-10T00:00:35.164 INFO:tasks.workunit.client.1.smithi183.stdout:9/756: stat d0/d3/d14/d1c/d2d/d4f/lac 0 2024-02-10T00:00:35.164 INFO:tasks.workunit.client.0.smithi164.stdout:6/486: creat d0/d6/fa1 x:0 0 0 2024-02-10T00:00:35.164 INFO:tasks.workunit.client.0.smithi164.stdout:7/463: write d3/d11/d39/d44/d48/d71/f91 [907642,53033] 0 2024-02-10T00:00:35.166 INFO:tasks.workunit.client.1.smithi183.stdout:3/654: getdents d7/db/d2a/d33/d59/d52 0 2024-02-10T00:00:35.166 INFO:tasks.workunit.client.1.smithi183.stdout:0/752: dwrite d14/d1d/d59/d71/f56 [0,4194304] 0 2024-02-10T00:00:35.166 INFO:tasks.workunit.client.0.smithi164.stdout:6/487: chown d0/f1a 50 1 2024-02-10T00:00:35.167 INFO:tasks.workunit.client.0.smithi164.stdout:7/464: rmdir d3/d5/d2b 39 2024-02-10T00:00:35.170 INFO:tasks.workunit.client.1.smithi183.stdout:1/694: mknod d0/d3/d67/d70/dae/dc6/cf7 0 2024-02-10T00:00:35.171 INFO:tasks.workunit.client.1.smithi183.stdout:9/757: symlink d0/d3/lf5 0 2024-02-10T00:00:35.171 INFO:tasks.workunit.client.1.smithi183.stdout:2/867: creat d2/da/d20/d21/d43/d58/f127 x:0 0 0 2024-02-10T00:00:35.171 INFO:tasks.workunit.client.1.smithi183.stdout:1/695: chown d0 2694 1 2024-02-10T00:00:35.172 INFO:tasks.workunit.client.0.smithi164.stdout:6/488: dwrite d0/d6/d12/d14/f61 [0,4194304] 0 2024-02-10T00:00:35.172 INFO:tasks.workunit.client.0.smithi164.stdout:7/465: dwrite d3/d11/d39/f8d [0,4194304] 0 2024-02-10T00:00:35.172 INFO:tasks.workunit.client.1.smithi183.stdout:0/753: dwrite d14/d1d/ff4 [0,4194304] 0 2024-02-10T00:00:35.173 INFO:tasks.workunit.client.0.smithi164.stdout:7/466: chown d3/d11/d39/f47 166 1 2024-02-10T00:00:35.173 INFO:tasks.workunit.client.1.smithi183.stdout:0/754: fsync d14/d1d/d55/fc2 0 2024-02-10T00:00:35.180 INFO:tasks.workunit.client.0.smithi164.stdout:6/489: symlink d0/d6/d4d/la2 0 2024-02-10T00:00:35.182 INFO:tasks.workunit.client.1.smithi183.stdout:0/755: rename d14/d1d/d59/d71/d22/f41 to d14/d7a/d63/f113 0 2024-02-10T00:00:35.182 INFO:tasks.workunit.client.0.smithi164.stdout:7/467: mkdir d3/d5/d9b 0 2024-02-10T00:00:35.186 INFO:tasks.workunit.client.0.smithi164.stdout:7/468: rmdir d3 39 2024-02-10T00:00:35.193 INFO:tasks.workunit.client.0.smithi164.stdout:0/372: sync 2024-02-10T00:00:35.195 INFO:tasks.workunit.client.0.smithi164.stdout:7/469: dwrite d3/d11/f82 [0,4194304] 0 2024-02-10T00:00:35.197 INFO:tasks.workunit.client.0.smithi164.stdout:0/373: stat d6/d7/d14/l3c 0 2024-02-10T00:00:35.198 INFO:tasks.workunit.client.0.smithi164.stdout:0/374: write d6/d10/d4a/f74 [466857,70657] 0 2024-02-10T00:00:35.198 INFO:tasks.workunit.client.0.smithi164.stdout:7/470: mknod d3/d5/d59/c9c 0 2024-02-10T00:00:35.201 INFO:tasks.workunit.client.0.smithi164.stdout:0/375: fdatasync d6/d10/d18/d1c/f3b 0 2024-02-10T00:00:35.207 INFO:tasks.workunit.client.0.smithi164.stdout:0/376: rename d6/d10/d18/d2d/d35/d47 to d6/d3a/d52/d7a 0 2024-02-10T00:00:35.209 INFO:tasks.workunit.client.0.smithi164.stdout:0/377: dread d6/d7/d14/f20 [0,4194304] 0 2024-02-10T00:00:35.212 INFO:tasks.workunit.client.0.smithi164.stdout:0/378: truncate d6/d3a/d52/d7a/f4e 632062 0 2024-02-10T00:00:35.214 INFO:tasks.workunit.client.0.smithi164.stdout:0/379: chown d6/d7/d14/f54 6974839 1 2024-02-10T00:00:35.214 INFO:tasks.workunit.client.0.smithi164.stdout:0/380: fdatasync d6/d7/f58 0 2024-02-10T00:00:35.217 INFO:tasks.workunit.client.0.smithi164.stdout:5/451: dread d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:35.218 INFO:tasks.workunit.client.0.smithi164.stdout:5/452: readlink d7/d17/d21/d23/d37/d36/l5e 0 2024-02-10T00:00:35.218 INFO:tasks.workunit.client.0.smithi164.stdout:5/453: write d7/f1d [532565,75422] 0 2024-02-10T00:00:35.218 INFO:tasks.workunit.client.0.smithi164.stdout:5/454: chown d7/d17 373305 1 2024-02-10T00:00:35.219 INFO:tasks.workunit.client.0.smithi164.stdout:5/455: dread - d7/d17/d21/d23/f72 zero size 2024-02-10T00:00:35.223 INFO:tasks.workunit.client.0.smithi164.stdout:5/456: rename d7/d17/d3b/d45/d5c/c54 to d7/d17/d21/d23/d37/d36/c91 0 2024-02-10T00:00:35.223 INFO:tasks.workunit.client.0.smithi164.stdout:5/457: chown d7/d17/d21/d85 129649351 1 2024-02-10T00:00:35.225 INFO:tasks.workunit.client.0.smithi164.stdout:9/422: dread d6/d4b/f57 [0,4194304] 0 2024-02-10T00:00:35.226 INFO:tasks.workunit.client.0.smithi164.stdout:5/458: rename d7/d17/d3b/d45/d5c/d84 to d7/d17/d69/d92 0 2024-02-10T00:00:35.229 INFO:tasks.workunit.client.0.smithi164.stdout:9/423: dwrite d6/d1c/d24/f73 [0,4194304] 0 2024-02-10T00:00:35.231 INFO:tasks.workunit.client.0.smithi164.stdout:5/459: unlink d7/d17/d21/d23/d37/d36/l5e 0 2024-02-10T00:00:35.233 INFO:tasks.workunit.client.0.smithi164.stdout:9/424: unlink d6/de/d2b/f34 0 2024-02-10T00:00:35.236 INFO:tasks.workunit.client.0.smithi164.stdout:5/460: creat d7/d17/d21/d23/d37/f93 x:0 0 0 2024-02-10T00:00:35.236 INFO:tasks.workunit.client.1.smithi183.stdout:4/795: fdatasync de/f7f 0 2024-02-10T00:00:35.237 INFO:tasks.workunit.client.1.smithi183.stdout:4/796: fdatasync de/f1f 0 2024-02-10T00:00:35.237 INFO:tasks.workunit.client.1.smithi183.stdout:4/797: readlink de/d14/d1d/ldc 0 2024-02-10T00:00:35.241 INFO:tasks.workunit.client.1.smithi183.stdout:4/798: dwrite de/d14/d1d/d7b/fbb [0,4194304] 0 2024-02-10T00:00:35.250 INFO:tasks.workunit.client.0.smithi164.stdout:3/357: sync 2024-02-10T00:00:35.253 INFO:tasks.workunit.client.0.smithi164.stdout:3/358: dwrite d0/d1/d3c/f63 [0,4194304] 0 2024-02-10T00:00:35.255 INFO:tasks.workunit.client.0.smithi164.stdout:3/359: write d0/d1/d2/d17/d37/d3f/d4e/d6d/f65 [299501,4538] 0 2024-02-10T00:00:35.260 INFO:tasks.workunit.client.1.smithi183.stdout:8/809: dread d0/d45/d46/d81/fa7 [0,4194304] 0 2024-02-10T00:00:35.262 INFO:tasks.workunit.client.0.smithi164.stdout:2/449: dread d3/d32/d4e/d27/d2a/d7a/d8e/d36/d54/f55 [0,4194304] 0 2024-02-10T00:00:35.262 INFO:tasks.workunit.client.1.smithi183.stdout:8/810: mkdir d0/d27/d36/de3/dfc 0 2024-02-10T00:00:35.263 INFO:tasks.workunit.client.1.smithi183.stdout:8/811: chown d0/d3f/f79 3221366 1 2024-02-10T00:00:35.264 INFO:tasks.workunit.client.1.smithi183.stdout:8/812: mknod d0/d23/cfd 0 2024-02-10T00:00:35.266 INFO:tasks.workunit.client.1.smithi183.stdout:8/813: mkdir d0/d27/dfe 0 2024-02-10T00:00:35.268 INFO:tasks.workunit.client.1.smithi183.stdout:8/814: chown d0/d3f/db2/l84 584509 1 2024-02-10T00:00:35.270 INFO:tasks.workunit.client.1.smithi183.stdout:8/815: mkdir d0/d23/dff 0 2024-02-10T00:00:35.271 INFO:tasks.workunit.client.0.smithi164.stdout:2/450: dread d3/d24/f39 [0,4194304] 0 2024-02-10T00:00:35.273 INFO:tasks.workunit.client.1.smithi183.stdout:8/816: dwrite d0/d45/fe6 [0,4194304] 0 2024-02-10T00:00:35.275 INFO:tasks.workunit.client.1.smithi183.stdout:8/817: fdatasync d0/d27/f2e 0 2024-02-10T00:00:35.285 INFO:tasks.workunit.client.0.smithi164.stdout:8/398: write d2/d64/d31/d32/d4d/f5a [1069914,103578] 0 2024-02-10T00:00:35.288 INFO:tasks.workunit.client.0.smithi164.stdout:7/471: getdents d3/d11/d39/d44 0 2024-02-10T00:00:35.291 INFO:tasks.workunit.client.0.smithi164.stdout:4/421: write d2/f1a [788142,30054] 0 2024-02-10T00:00:35.292 INFO:tasks.workunit.client.1.smithi183.stdout:7/696: write d0/d11/d88/f91 [3627129,113234] 0 2024-02-10T00:00:35.293 INFO:tasks.workunit.client.0.smithi164.stdout:7/472: symlink d3/d26/d67/l9d 0 2024-02-10T00:00:35.293 INFO:tasks.workunit.client.0.smithi164.stdout:7/473: chown d3/d11/d39/d44/d48/f78 182 1 2024-02-10T00:00:35.297 INFO:tasks.workunit.client.1.smithi183.stdout:5/795: truncate d4/d23/f26 949802 0 2024-02-10T00:00:35.298 INFO:tasks.workunit.client.0.smithi164.stdout:7/474: dwrite d3/d28/f3b [0,4194304] 0 2024-02-10T00:00:35.298 INFO:tasks.workunit.client.0.smithi164.stdout:1/334: sync 2024-02-10T00:00:35.298 INFO:tasks.workunit.client.0.smithi164.stdout:7/475: chown d3/d26/d67/d79 16961 1 2024-02-10T00:00:35.299 INFO:tasks.workunit.client.0.smithi164.stdout:1/335: dread - d1/d13/d2b/f50 zero size 2024-02-10T00:00:35.299 INFO:tasks.workunit.client.1.smithi183.stdout:6/672: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f67 [0,4194304] 0 2024-02-10T00:00:35.299 INFO:tasks.workunit.client.1.smithi183.stdout:5/796: read d4/d23/d3e/d80/da1/d9e/d27/d5d/ff2 [3328368,57381] 0 2024-02-10T00:00:35.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/490: truncate d0/d6/d12/f22 487610 0 2024-02-10T00:00:35.302 INFO:tasks.workunit.client.1.smithi183.stdout:6/673: read d2/d1a/d3a/d45/f83 [2602394,46675] 0 2024-02-10T00:00:35.302 INFO:tasks.workunit.client.0.smithi164.stdout:7/476: dwrite d3/d11/d39/f47 [0,4194304] 0 2024-02-10T00:00:35.303 INFO:tasks.workunit.client.1.smithi183.stdout:3/655: truncate d7/db/d2a/f2b 1711312 0 2024-02-10T00:00:35.303 INFO:tasks.workunit.client.1.smithi183.stdout:9/758: write d0/d3/d14/d1c/d2d/d4f/fe9 [2696905,51473] 0 2024-02-10T00:00:35.305 INFO:tasks.workunit.client.1.smithi183.stdout:8/818: dread d0/d4e/f6a [0,4194304] 0 2024-02-10T00:00:35.305 INFO:tasks.workunit.client.1.smithi183.stdout:1/696: truncate d0/d3a/f80 1234699 0 2024-02-10T00:00:35.307 INFO:tasks.workunit.client.1.smithi183.stdout:1/697: chown d0/d3/d67/d70/dae/dc6 10 1 2024-02-10T00:00:35.307 INFO:tasks.workunit.client.1.smithi183.stdout:2/868: dwrite d2/da/d5b/fc2 [0,4194304] 0 2024-02-10T00:00:35.308 INFO:tasks.workunit.client.1.smithi183.stdout:7/697: creat d0/d2/d4/d8/fd9 x:0 0 0 2024-02-10T00:00:35.308 INFO:tasks.workunit.client.0.smithi164.stdout:1/336: creat d1/d13/d2b/d54/f78 x:0 0 0 2024-02-10T00:00:35.309 INFO:tasks.workunit.client.1.smithi183.stdout:0/756: write d14/d1d/d2d/d31/d6c/d70/f81 [1861317,110468] 0 2024-02-10T00:00:35.309 INFO:tasks.workunit.client.1.smithi183.stdout:4/799: write de/d19/d20/f26 [1103555,10945] 0 2024-02-10T00:00:35.309 INFO:tasks.workunit.client.1.smithi183.stdout:7/698: chown d0/d11/d88/cd4 3 1 2024-02-10T00:00:35.310 INFO:tasks.workunit.client.1.smithi183.stdout:2/869: chown d2/da/d20/d21/d43/d58/d74/d10e/l124 4 1 2024-02-10T00:00:35.313 INFO:tasks.workunit.client.1.smithi183.stdout:5/797: dread - d4/d23/d3e/d80/da1/d9c/d72/da0/fa4 zero size 2024-02-10T00:00:35.313 INFO:tasks.workunit.client.1.smithi183.stdout:5/798: dread - d4/d74/fe5 zero size 2024-02-10T00:00:35.314 INFO:tasks.workunit.client.0.smithi164.stdout:1/337: link d1/d1a/d41/d18/l1e d1/d13/l79 0 2024-02-10T00:00:35.314 INFO:tasks.workunit.client.0.smithi164.stdout:1/338: chown d1/d1a 28 1 2024-02-10T00:00:35.316 INFO:tasks.workunit.client.1.smithi183.stdout:6/674: symlink d2/d1a/d25/d3c/d31/d38/d6e/d93/lc8 0 2024-02-10T00:00:35.318 INFO:tasks.workunit.client.0.smithi164.stdout:1/339: dwrite d1/d13/d2b/d52/f5d [0,4194304] 0 2024-02-10T00:00:35.320 INFO:tasks.workunit.client.0.smithi164.stdout:7/477: dread d3/d5/d2b/f4e [0,4194304] 0 2024-02-10T00:00:35.321 INFO:tasks.workunit.client.1.smithi183.stdout:6/675: dwrite d2/d1a/d25/d3c/d31/d38/d87/f88 [0,4194304] 0 2024-02-10T00:00:35.322 INFO:tasks.workunit.client.1.smithi183.stdout:4/800: unlink de/f72 0 2024-02-10T00:00:35.323 INFO:tasks.workunit.client.1.smithi183.stdout:2/870: fdatasync d2/f3a 0 2024-02-10T00:00:35.324 INFO:tasks.workunit.client.0.smithi164.stdout:5/461: write d7/fd [6849164,90156] 0 2024-02-10T00:00:35.325 INFO:tasks.workunit.client.0.smithi164.stdout:0/381: write d6/d10/d18/d2d/f5a [4390469,80232] 0 2024-02-10T00:00:35.326 INFO:tasks.workunit.client.0.smithi164.stdout:3/360: truncate d0/d1/d2/d19/f29 5085031 0 2024-02-10T00:00:35.326 INFO:tasks.workunit.client.0.smithi164.stdout:0/382: chown d6/d3a 395 1 2024-02-10T00:00:35.326 INFO:tasks.workunit.client.1.smithi183.stdout:3/656: fsync d7/db/d2a/f65 0 2024-02-10T00:00:35.327 INFO:tasks.workunit.client.0.smithi164.stdout:2/451: truncate d3/d32/d4e/d27/d2a/f31 1341360 0 2024-02-10T00:00:35.328 INFO:tasks.workunit.client.1.smithi183.stdout:9/759: symlink d0/d3/d14/d1c/d2d/d4f/lf6 0 2024-02-10T00:00:35.328 INFO:tasks.workunit.client.1.smithi183.stdout:4/801: dwrite de/d22/f28 [0,4194304] 0 2024-02-10T00:00:35.328 INFO:tasks.workunit.client.1.smithi183.stdout:3/657: write d7/db/d2a/f69 [3696918,19254] 0 2024-02-10T00:00:35.328 INFO:tasks.workunit.client.0.smithi164.stdout:0/383: write d6/d10/d18/f67 [949022,53933] 0 2024-02-10T00:00:35.329 INFO:tasks.workunit.client.0.smithi164.stdout:9/425: sync 2024-02-10T00:00:35.330 INFO:tasks.workunit.client.0.smithi164.stdout:5/462: dread d7/d17/d21/f29 [0,4194304] 0 2024-02-10T00:00:35.332 INFO:tasks.workunit.client.1.smithi183.stdout:6/676: mknod d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/cc9 0 2024-02-10T00:00:35.332 INFO:tasks.workunit.client.0.smithi164.stdout:1/340: creat d1/d13/d1f/f7a x:0 0 0 2024-02-10T00:00:35.332 INFO:tasks.workunit.client.0.smithi164.stdout:0/384: dwrite d6/f2a [0,4194304] 0 2024-02-10T00:00:35.333 INFO:tasks.workunit.client.0.smithi164.stdout:0/385: chown d6/d10/d18/d1c/f2c 177 1 2024-02-10T00:00:35.334 INFO:tasks.workunit.client.0.smithi164.stdout:4/422: rename d2/d2f/f4c to d2/d2f/d37/d71/f93 0 2024-02-10T00:00:35.334 INFO:tasks.workunit.client.0.smithi164.stdout:4/423: fdatasync d2/fb 0 2024-02-10T00:00:35.335 INFO:tasks.workunit.client.1.smithi183.stdout:0/757: link d14/d1d/d59/d71/db4/f10b d14/d1d/d2d/d31/d68/dcc/f114 0 2024-02-10T00:00:35.335 INFO:tasks.workunit.client.1.smithi183.stdout:0/758: fsync d14/d1d/d55/fc2 0 2024-02-10T00:00:35.336 INFO:tasks.workunit.client.1.smithi183.stdout:0/759: dread - d14/d1d/d59/d3c/ff6 zero size 2024-02-10T00:00:35.337 INFO:tasks.workunit.client.1.smithi183.stdout:2/871: creat d2/da/d20/d21/d43/d58/d74/d10e/f128 x:0 0 0 2024-02-10T00:00:35.340 INFO:tasks.workunit.client.0.smithi164.stdout:9/426: unlink d6/de/d3b/f6e 0 2024-02-10T00:00:35.341 INFO:tasks.workunit.client.1.smithi183.stdout:3/658: mknod d7/d98/cc0 0 2024-02-10T00:00:35.342 INFO:tasks.workunit.client.0.smithi164.stdout:1/341: fdatasync d1/f9 0 2024-02-10T00:00:35.343 INFO:tasks.workunit.client.1.smithi183.stdout:4/802: rename de/d19/ff0 to de/d14/d1d/d7b/ff9 0 2024-02-10T00:00:35.344 INFO:tasks.workunit.client.1.smithi183.stdout:4/803: read - de/d14/d27/fe8 zero size 2024-02-10T00:00:35.344 INFO:tasks.workunit.client.1.smithi183.stdout:4/804: chown de/f12 3608 1 2024-02-10T00:00:35.345 INFO:tasks.workunit.client.1.smithi183.stdout:4/805: chown de/d14/d1d/d2f/da2/d9c/f9e 65520 1 2024-02-10T00:00:35.347 INFO:tasks.workunit.client.0.smithi164.stdout:8/399: sync 2024-02-10T00:00:35.347 INFO:tasks.workunit.client.0.smithi164.stdout:2/452: rename d3/f19 to d3/d26/d64/fa5 0 2024-02-10T00:00:35.351 INFO:tasks.workunit.client.0.smithi164.stdout:5/463: symlink d7/d17/d21/d23/d37/l94 0 2024-02-10T00:00:35.352 INFO:tasks.workunit.client.0.smithi164.stdout:6/491: dread d0/d6/d12/f4e [0,4194304] 0 2024-02-10T00:00:35.352 INFO:tasks.workunit.client.0.smithi164.stdout:5/464: chown d7/d17/d21/d23/d5a/d68/d1f/d59 3 1 2024-02-10T00:00:35.352 INFO:tasks.workunit.client.0.smithi164.stdout:6/492: stat d0/d2b 0 2024-02-10T00:00:35.353 INFO:tasks.workunit.client.0.smithi164.stdout:7/478: link d3/d5/f30 d3/d11/d39/d44/d6f/f9e 0 2024-02-10T00:00:35.353 INFO:tasks.workunit.client.1.smithi183.stdout:6/677: link d2/d1a/d3a/d45/f83 d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fca 0 2024-02-10T00:00:35.353 INFO:tasks.workunit.client.1.smithi183.stdout:5/799: creat d4/dd/d31/d73/f107 x:0 0 0 2024-02-10T00:00:35.353 INFO:tasks.workunit.client.1.smithi183.stdout:4/806: mknod de/d19/d20/de6/cfa 0 2024-02-10T00:00:35.354 INFO:tasks.workunit.client.0.smithi164.stdout:7/479: write d3/d28/f3b [3944308,34267] 0 2024-02-10T00:00:35.354 INFO:tasks.workunit.client.1.smithi183.stdout:4/807: read - de/d22/fac zero size 2024-02-10T00:00:35.355 INFO:tasks.workunit.client.1.smithi183.stdout:4/808: fdatasync de/d14/d27/d40/fea 0 2024-02-10T00:00:35.356 INFO:tasks.workunit.client.0.smithi164.stdout:4/424: rename d2/d19/d16/d31/d76 to d2/d5a/d94 0 2024-02-10T00:00:35.356 INFO:tasks.workunit.client.0.smithi164.stdout:8/400: mknod d2/d64/d54/c74 0 2024-02-10T00:00:35.358 INFO:tasks.workunit.client.0.smithi164.stdout:8/401: write d2/f67 [169753,66591] 0 2024-02-10T00:00:35.358 INFO:tasks.workunit.client.0.smithi164.stdout:3/361: truncate d0/d1/d2/d19/f56 787350 0 2024-02-10T00:00:35.358 INFO:tasks.workunit.client.1.smithi183.stdout:2/872: unlink d2/d2c/d2f/d60/d8d/d9c/da7/dd4/c10f 0 2024-02-10T00:00:35.359 INFO:tasks.workunit.client.1.smithi183.stdout:9/760: truncate d0/d30/fc9 36446 0 2024-02-10T00:00:35.359 INFO:tasks.workunit.client.1.smithi183.stdout:3/659: truncate d7/db/d2a/d1c/f7c 933802 0 2024-02-10T00:00:35.360 INFO:tasks.workunit.client.1.smithi183.stdout:0/760: truncate d14/d1d/d2d/f39 1221401 0 2024-02-10T00:00:35.360 INFO:tasks.workunit.client.0.smithi164.stdout:3/362: dread d0/d1/dd/f1f [0,4194304] 0 2024-02-10T00:00:35.363 INFO:tasks.workunit.client.1.smithi183.stdout:3/660: write d7/db/d2a/f79 [3220284,25884] 0 2024-02-10T00:00:35.364 INFO:tasks.workunit.client.0.smithi164.stdout:3/363: write d0/d1/d3c/d3d/d51/f55 [800542,74606] 0 2024-02-10T00:00:35.364 INFO:tasks.workunit.client.0.smithi164.stdout:9/427: rename d6/de/d22/f7b to d6/de/d2b/f80 0 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.1.smithi183.stdout:2/873: chown d2/da/d20/d21/fcf 43204604 1 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.1.smithi183.stdout:4/809: dwrite de/d19/d1c/fe2 [0,4194304] 0 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.1.smithi183.stdout:3/661: write d7/db/d2a/f9a [541561,117873] 0 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.1.smithi183.stdout:6/678: fsync d2/d1a/d25/d3c/d31/f79 0 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.1.smithi183.stdout:4/810: write de/d14/d27/ff4 [175833,109365] 0 2024-02-10T00:00:35.365 INFO:tasks.workunit.client.0.smithi164.stdout:5/465: creat d7/d17/d79/d7b/f95 x:0 0 0 2024-02-10T00:00:35.366 INFO:tasks.workunit.client.1.smithi183.stdout:0/761: creat d14/d3e/dd4/f115 x:0 0 0 2024-02-10T00:00:35.367 INFO:tasks.workunit.client.0.smithi164.stdout:3/364: mknod d0/d1/d2/d17/d37/c6f 0 2024-02-10T00:00:35.368 INFO:tasks.workunit.client.0.smithi164.stdout:3/365: read d0/d1/d2/d17/d37/f69 [3113090,84792] 0 2024-02-10T00:00:35.368 INFO:tasks.workunit.client.1.smithi183.stdout:8/819: dread d0/d10/f19 [0,4194304] 0 2024-02-10T00:00:35.369 INFO:tasks.workunit.client.0.smithi164.stdout:6/493: write d0/f5 [1331506,34935] 0 2024-02-10T00:00:35.370 INFO:tasks.workunit.client.0.smithi164.stdout:7/480: write d3/d11/d39/f47 [4349815,103717] 0 2024-02-10T00:00:35.370 INFO:tasks.workunit.client.0.smithi164.stdout:1/342: getdents d1/d1a/d41/d18/d3a 0 2024-02-10T00:00:35.371 INFO:tasks.workunit.client.0.smithi164.stdout:0/386: getdents d6/d10/d4a/d60 0 2024-02-10T00:00:35.372 INFO:tasks.workunit.client.0.smithi164.stdout:5/466: symlink d7/d17/d69/l96 0 2024-02-10T00:00:35.373 INFO:tasks.workunit.client.1.smithi183.stdout:5/800: rename d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/ff0 to d4/d23/d3e/d80/da1/d9e/d27/f108 0 2024-02-10T00:00:35.375 INFO:tasks.workunit.client.1.smithi183.stdout:9/761: creat d0/d3/d14/ff7 x:0 0 0 2024-02-10T00:00:35.377 INFO:tasks.workunit.client.1.smithi183.stdout:4/811: creat de/d14/d1d/d7b/ffb x:0 0 0 2024-02-10T00:00:35.377 INFO:tasks.workunit.client.0.smithi164.stdout:0/387: dwrite f3 [4194304,4194304] 0 2024-02-10T00:00:35.377 INFO:tasks.workunit.client.0.smithi164.stdout:0/388: readlink d6/d10/d18/d1c/l64 0 2024-02-10T00:00:35.377 INFO:tasks.workunit.client.0.smithi164.stdout:6/494: creat d0/d2b/d3a/d3d/fa3 x:0 0 0 2024-02-10T00:00:35.378 INFO:tasks.workunit.client.1.smithi183.stdout:6/679: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/lcb 0 2024-02-10T00:00:35.379 INFO:tasks.workunit.client.1.smithi183.stdout:2/874: symlink d2/d2c/d2f/d60/d8d/d9c/dd1/l129 0 2024-02-10T00:00:35.381 INFO:tasks.workunit.client.0.smithi164.stdout:6/495: dwrite d0/d3b/f90 [0,4194304] 0 2024-02-10T00:00:35.381 INFO:tasks.workunit.client.1.smithi183.stdout:8/820: creat d0/d27/d75/d5b/d85/f100 x:0 0 0 2024-02-10T00:00:35.382 INFO:tasks.workunit.client.0.smithi164.stdout:6/496: dread - d0/d6/d81/f96 zero size 2024-02-10T00:00:35.382 INFO:tasks.workunit.client.1.smithi183.stdout:8/821: dread - d0/fc2 zero size 2024-02-10T00:00:35.382 INFO:tasks.workunit.client.0.smithi164.stdout:5/467: creat d7/d17/d79/f97 x:0 0 0 2024-02-10T00:00:35.383 INFO:tasks.workunit.client.0.smithi164.stdout:5/468: dread - d7/d17/d21/d23/d5a/d68/d1f/f61 zero size 2024-02-10T00:00:35.383 INFO:tasks.workunit.client.0.smithi164.stdout:4/425: getdents d2/d19/d16/d31/d6d 0 2024-02-10T00:00:35.384 INFO:tasks.workunit.client.1.smithi183.stdout:4/812: readlink de/d19/d1c/d61/l8c 0 2024-02-10T00:00:35.384 INFO:tasks.workunit.client.1.smithi183.stdout:6/680: dwrite d2/d1a/d25/d3c/faf [0,4194304] 0 2024-02-10T00:00:35.384 INFO:tasks.workunit.client.0.smithi164.stdout:4/426: write d2/f8 [3815927,81115] 0 2024-02-10T00:00:35.385 INFO:tasks.workunit.client.0.smithi164.stdout:4/427: fdatasync d2/d19/d16/d31/f70 0 2024-02-10T00:00:35.385 INFO:tasks.workunit.client.0.smithi164.stdout:7/481: mknod d3/d11/d39/d44/d9a/c9f 0 2024-02-10T00:00:35.386 INFO:tasks.workunit.client.1.smithi183.stdout:0/762: read d14/d1d/d2d/d31/f3a [336572,68962] 0 2024-02-10T00:00:35.386 INFO:tasks.workunit.client.1.smithi183.stdout:9/762: mkdir d0/d3/d14/d1c/d2d/d4f/da4/dda/ddf/df8 0 2024-02-10T00:00:35.388 INFO:tasks.workunit.client.0.smithi164.stdout:7/482: write d3/d11/d39/f8d [670092,12732] 0 2024-02-10T00:00:35.388 INFO:tasks.workunit.client.1.smithi183.stdout:4/813: creat de/d14/d27/d40/ffc x:0 0 0 2024-02-10T00:00:35.388 INFO:tasks.workunit.client.0.smithi164.stdout:4/428: creat d2/d2f/d37/d41/f95 x:0 0 0 2024-02-10T00:00:35.389 INFO:tasks.workunit.client.1.smithi183.stdout:8/822: dwrite d0/d45/f66 [0,4194304] 0 2024-02-10T00:00:35.389 INFO:tasks.workunit.client.1.smithi183.stdout:4/814: chown de/d19/c3b 3645 1 2024-02-10T00:00:35.390 INFO:tasks.workunit.client.0.smithi164.stdout:1/343: dread d1/d13/f47 [0,4194304] 0 2024-02-10T00:00:35.391 INFO:tasks.workunit.client.1.smithi183.stdout:9/763: creat d0/d30/ff9 x:0 0 0 2024-02-10T00:00:35.391 INFO:tasks.workunit.client.0.smithi164.stdout:7/483: dread d3/d28/f3b [0,4194304] 0 2024-02-10T00:00:35.392 INFO:tasks.workunit.client.1.smithi183.stdout:8/823: chown d0/d3f/db2/d24/fbb 341350528 1 2024-02-10T00:00:35.393 INFO:tasks.workunit.client.0.smithi164.stdout:4/429: creat d2/d5a/d94/f96 x:0 0 0 2024-02-10T00:00:35.393 INFO:tasks.workunit.client.0.smithi164.stdout:0/389: truncate d6/d10/f61 959223 0 2024-02-10T00:00:35.394 INFO:tasks.workunit.client.1.smithi183.stdout:0/763: truncate d14/d3e/d5f/fb1 196143 0 2024-02-10T00:00:35.394 INFO:tasks.workunit.client.1.smithi183.stdout:5/801: dwrite d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/fc3 [0,4194304] 0 2024-02-10T00:00:35.396 INFO:tasks.workunit.client.0.smithi164.stdout:7/484: dwrite d3/d26/d67/f86 [0,4194304] 0 2024-02-10T00:00:35.396 INFO:tasks.workunit.client.0.smithi164.stdout:4/430: symlink d2/d19/d16/d31/d6d/l97 0 2024-02-10T00:00:35.397 INFO:tasks.workunit.client.1.smithi183.stdout:4/815: link de/d14/d27/d2e/f88 de/d19/d1c/dd0/ffd 0 2024-02-10T00:00:35.398 INFO:tasks.workunit.client.0.smithi164.stdout:1/344: fdatasync d1/d13/d2b/d52/d56/f68 0 2024-02-10T00:00:35.399 INFO:tasks.workunit.client.0.smithi164.stdout:7/485: write d3/d28/f3b [2597191,22011] 0 2024-02-10T00:00:35.400 INFO:tasks.workunit.client.1.smithi183.stdout:0/764: dwrite d14/d1d/d2d/d31/d6c/fb2 [0,4194304] 0 2024-02-10T00:00:35.400 INFO:tasks.workunit.client.0.smithi164.stdout:0/390: symlink d6/l7b 0 2024-02-10T00:00:35.401 INFO:tasks.workunit.client.0.smithi164.stdout:4/431: mknod d2/d2f/d37/c98 0 2024-02-10T00:00:35.402 INFO:tasks.workunit.client.0.smithi164.stdout:4/432: fsync d2/d2f/d37/d41/d3d/f52 0 2024-02-10T00:00:35.403 INFO:tasks.workunit.client.1.smithi183.stdout:5/802: creat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/f109 x:0 0 0 2024-02-10T00:00:35.404 INFO:tasks.workunit.client.0.smithi164.stdout:0/391: write d6/d10/d4a/d60/d6c/f46 [863549,52214] 0 2024-02-10T00:00:35.405 INFO:tasks.workunit.client.1.smithi183.stdout:0/765: creat d14/d3e/d5f/f116 x:0 0 0 2024-02-10T00:00:35.408 INFO:tasks.workunit.client.1.smithi183.stdout:0/766: read d14/d1d/d2d/d31/d6c/f76 [3035469,6927] 0 2024-02-10T00:00:35.408 INFO:tasks.workunit.client.1.smithi183.stdout:5/803: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/f48 [0,4194304] 0 2024-02-10T00:00:35.411 INFO:tasks.workunit.client.0.smithi164.stdout:4/433: mknod d2/d2f/d37/d41/d3d/d56/d85/c99 0 2024-02-10T00:00:35.413 INFO:tasks.workunit.client.1.smithi183.stdout:7/699: dwrite d0/d2/d3/f90 [0,4194304] 0 2024-02-10T00:00:35.415 INFO:tasks.workunit.client.1.smithi183.stdout:4/816: getdents de/d14/da4 0 2024-02-10T00:00:35.416 INFO:tasks.workunit.client.1.smithi183.stdout:5/804: symlink d4/d23/d3e/d80/da1/d9c/l10a 0 2024-02-10T00:00:35.419 INFO:tasks.workunit.client.1.smithi183.stdout:7/700: dwrite d0/f67 [0,4194304] 0 2024-02-10T00:00:35.420 INFO:tasks.workunit.client.1.smithi183.stdout:0/767: truncate d14/d1d/d2d/d31/d68/dcc/ff8 4947163 0 2024-02-10T00:00:35.421 INFO:tasks.workunit.client.0.smithi164.stdout:6/497: sync 2024-02-10T00:00:35.421 INFO:tasks.workunit.client.1.smithi183.stdout:4/817: mkdir de/d14/d1d/d7b/dfe 0 2024-02-10T00:00:35.422 INFO:tasks.workunit.client.1.smithi183.stdout:5/805: dwrite d4/d74/fe5 [0,4194304] 0 2024-02-10T00:00:35.423 INFO:tasks.workunit.client.1.smithi183.stdout:7/701: creat d0/d2/d4/d8/d59/fda x:0 0 0 2024-02-10T00:00:35.423 INFO:tasks.workunit.client.0.smithi164.stdout:6/498: fsync d0/d6/f54 0 2024-02-10T00:00:35.424 INFO:tasks.workunit.client.0.smithi164.stdout:6/499: dread - d0/d6/f9b zero size 2024-02-10T00:00:35.425 INFO:tasks.workunit.client.0.smithi164.stdout:6/500: creat d0/d2b/fa4 x:0 0 0 2024-02-10T00:00:35.426 INFO:tasks.workunit.client.1.smithi183.stdout:0/768: rename d14/d1d/d2d/d31/c3b to d14/d1d/d59/d71/dcb/c117 0 2024-02-10T00:00:35.428 INFO:tasks.workunit.client.1.smithi183.stdout:7/702: mkdir d0/d11/d2f/ddb 0 2024-02-10T00:00:35.430 INFO:tasks.workunit.client.0.smithi164.stdout:6/501: getdents d0/d6/d12/d14/d4b 0 2024-02-10T00:00:35.431 INFO:tasks.workunit.client.0.smithi164.stdout:6/502: write d0/d6/d12/d14/f24 [885913,69961] 0 2024-02-10T00:00:35.432 INFO:tasks.workunit.client.0.smithi164.stdout:6/503: read d0/d6/d12/d14/f1e [2231418,88082] 0 2024-02-10T00:00:35.433 INFO:tasks.workunit.client.1.smithi183.stdout:4/818: creat de/d19/d20/de6/df7/fff x:0 0 0 2024-02-10T00:00:35.433 INFO:tasks.workunit.client.1.smithi183.stdout:0/769: write d14/d1d/d59/d71/dfb/ffe [3145276,84643] 0 2024-02-10T00:00:35.434 INFO:tasks.workunit.client.1.smithi183.stdout:7/703: fsync d0/d2/d50/dad/fa6 0 2024-02-10T00:00:35.434 INFO:tasks.workunit.client.1.smithi183.stdout:0/770: fdatasync d14/d1d/d2d/f8a 0 2024-02-10T00:00:35.435 INFO:tasks.workunit.client.1.smithi183.stdout:0/771: readlink d14/d1d/d55/d6e/d74/l9e 0 2024-02-10T00:00:35.436 INFO:tasks.workunit.client.0.smithi164.stdout:6/504: mknod d0/d6/d12/d14/ca5 0 2024-02-10T00:00:35.436 INFO:tasks.workunit.client.1.smithi183.stdout:0/772: dread - d14/d43/fed zero size 2024-02-10T00:00:35.436 INFO:tasks.workunit.client.1.smithi183.stdout:4/819: creat de/d19/d1c/dd0/f100 x:0 0 0 2024-02-10T00:00:35.436 INFO:tasks.workunit.client.1.smithi183.stdout:0/773: dread - d14/d1d/d59/fd1 zero size 2024-02-10T00:00:35.440 INFO:tasks.workunit.client.1.smithi183.stdout:7/704: creat d0/d11/d2f/fdc x:0 0 0 2024-02-10T00:00:35.443 INFO:tasks.workunit.client.1.smithi183.stdout:0/774: truncate d14/d1d/d2d/d31/f6d 930820 0 2024-02-10T00:00:35.444 INFO:tasks.workunit.client.1.smithi183.stdout:0/775: read - d14/d1d/d59/d3c/d93/ff0 zero size 2024-02-10T00:00:35.445 INFO:tasks.workunit.client.1.smithi183.stdout:7/705: rename d0/d2/d50/d5d/fc6 to d0/d11/d3e/fdd 0 2024-02-10T00:00:35.448 INFO:tasks.workunit.client.1.smithi183.stdout:0/776: rename d14/d7a/f62 to d14/d3e/d5f/f118 0 2024-02-10T00:00:35.448 INFO:tasks.workunit.client.1.smithi183.stdout:0/777: readlink d14/d1d/d2d/d31/d68/dcc/lea 0 2024-02-10T00:00:35.449 INFO:tasks.workunit.client.1.smithi183.stdout:0/778: chown d14/d7a/d63/f65 13945404 1 2024-02-10T00:00:35.450 INFO:tasks.workunit.client.1.smithi183.stdout:7/706: rmdir d0/d11/d2f/db8/dd3 0 2024-02-10T00:00:35.452 INFO:tasks.workunit.client.1.smithi183.stdout:0/779: truncate d14/d1d/d2d/d31/d6c/de3/fb8 453023 0 2024-02-10T00:00:35.452 INFO:tasks.workunit.client.0.smithi164.stdout:7/486: dread d3/f9 [0,4194304] 0 2024-02-10T00:00:35.452 INFO:tasks.workunit.client.1.smithi183.stdout:0/780: write d14/d43/fda [518087,108734] 0 2024-02-10T00:00:35.463 INFO:tasks.workunit.client.1.smithi183.stdout:3/662: dread d7/f9 [0,4194304] 0 2024-02-10T00:00:35.464 INFO:tasks.workunit.client.1.smithi183.stdout:3/663: dread - d7/db/d2a/d1c/f5c zero size 2024-02-10T00:00:35.465 INFO:tasks.workunit.client.0.smithi164.stdout:2/453: rename d3/d32/d4e/d27/d2a to d3/da6 0 2024-02-10T00:00:35.468 INFO:tasks.workunit.client.1.smithi183.stdout:0/781: dread d14/d1d/d59/d71/d22/f44 [0,4194304] 0 2024-02-10T00:00:35.469 INFO:tasks.workunit.client.1.smithi183.stdout:0/782: write d14/d1d/d55/f5a [917308,6808] 0 2024-02-10T00:00:35.470 INFO:tasks.workunit.client.0.smithi164.stdout:8/402: rename d2/l2b to d2/d64/d54/d5f/l75 0 2024-02-10T00:00:35.470 INFO:tasks.workunit.client.1.smithi183.stdout:0/783: chown d14/d3e/d5f/daa/de6 559703445 1 2024-02-10T00:00:35.471 INFO:tasks.workunit.client.0.smithi164.stdout:8/403: fsync d2/d64/d31/d32/f4b 0 2024-02-10T00:00:35.471 INFO:tasks.workunit.client.0.smithi164.stdout:8/404: stat d2/d64/f42 0 2024-02-10T00:00:35.476 INFO:tasks.workunit.client.1.smithi183.stdout:8/824: sync 2024-02-10T00:00:35.476 INFO:tasks.workunit.client.1.smithi183.stdout:8/825: fdatasync d0/d45/fa5 0 2024-02-10T00:00:35.477 INFO:tasks.workunit.client.0.smithi164.stdout:2/454: truncate d3/da6/d7a/d8e/d36/f83 539541 0 2024-02-10T00:00:35.477 INFO:tasks.workunit.client.1.smithi183.stdout:8/826: write d0/d27/d75/d5b/d85/fb6 [2184865,32884] 0 2024-02-10T00:00:35.479 INFO:tasks.workunit.client.0.smithi164.stdout:4/434: dread d2/d2f/d37/d71/f93 [0,4194304] 0 2024-02-10T00:00:35.481 INFO:tasks.workunit.client.1.smithi183.stdout:0/784: chown d14/d1d/d59/d71/c30 7093278 1 2024-02-10T00:00:35.483 INFO:tasks.workunit.client.1.smithi183.stdout:1/698: write d0/d3/d7/d36/f4d [3815621,104924] 0 2024-02-10T00:00:35.487 INFO:tasks.workunit.client.0.smithi164.stdout:5/469: truncate d7/f19 2597678 0 2024-02-10T00:00:35.487 INFO:tasks.workunit.client.0.smithi164.stdout:9/428: dwrite d6/de/d2b/d5b/d61/f6d [0,4194304] 0 2024-02-10T00:00:35.490 INFO:tasks.workunit.client.0.smithi164.stdout:9/429: fsync d6/de/d40/f56 0 2024-02-10T00:00:35.490 INFO:tasks.workunit.client.0.smithi164.stdout:3/366: dwrite d0/f43 [0,4194304] 0 2024-02-10T00:00:35.494 INFO:tasks.workunit.client.0.smithi164.stdout:1/345: truncate d1/d13/d2b/f2e 1877784 0 2024-02-10T00:00:35.495 INFO:tasks.workunit.client.0.smithi164.stdout:1/346: write d1/d23/f32 [205182,37825] 0 2024-02-10T00:00:35.500 INFO:tasks.workunit.client.1.smithi183.stdout:9/764: dread d0/d3/d14/d3c/fae [0,4194304] 0 2024-02-10T00:00:35.503 INFO:tasks.workunit.client.1.smithi183.stdout:6/681: write d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [958365,39072] 0 2024-02-10T00:00:35.504 INFO:tasks.workunit.client.1.smithi183.stdout:2/875: truncate d2/f15 855192 0 2024-02-10T00:00:35.504 INFO:tasks.workunit.client.0.smithi164.stdout:7/487: truncate d3/f13 2154432 0 2024-02-10T00:00:35.505 INFO:tasks.workunit.client.1.smithi183.stdout:9/765: dwrite d0/d30/d52/f66 [0,4194304] 0 2024-02-10T00:00:35.505 INFO:tasks.workunit.client.1.smithi183.stdout:8/827: mknod d0/d45/d46/d81/c101 0 2024-02-10T00:00:35.507 INFO:tasks.workunit.client.0.smithi164.stdout:4/435: dread d2/d19/f11 [0,4194304] 0 2024-02-10T00:00:35.508 INFO:tasks.workunit.client.0.smithi164.stdout:4/436: chown d2/d19/d16/d31/d57/f7a 15168595 1 2024-02-10T00:00:35.508 INFO:tasks.workunit.client.1.smithi183.stdout:9/766: write d0/d3/d14/d1c/f45 [1962071,128345] 0 2024-02-10T00:00:35.511 INFO:tasks.workunit.client.1.smithi183.stdout:4/820: dread de/d14/d27/f21 [0,4194304] 0 2024-02-10T00:00:35.512 INFO:tasks.workunit.client.0.smithi164.stdout:9/430: creat d6/de/d40/f81 x:0 0 0 2024-02-10T00:00:35.514 INFO:tasks.workunit.client.0.smithi164.stdout:7/488: unlink d3/d26/c62 0 2024-02-10T00:00:35.516 INFO:tasks.workunit.client.0.smithi164.stdout:5/470: mknod d7/d17/d21/d23/c98 0 2024-02-10T00:00:35.518 INFO:tasks.workunit.client.0.smithi164.stdout:0/392: rename d6/d10/d18/l2b to d6/d7/l7c 0 2024-02-10T00:00:35.518 INFO:tasks.workunit.client.0.smithi164.stdout:0/393: stat d6/d7/f24 0 2024-02-10T00:00:35.518 INFO:tasks.workunit.client.0.smithi164.stdout:2/455: symlink d3/d32/d4e/d27/la7 0 2024-02-10T00:00:35.519 INFO:tasks.workunit.client.0.smithi164.stdout:7/489: readlink d3/d26/l85 0 2024-02-10T00:00:35.520 INFO:tasks.workunit.client.0.smithi164.stdout:4/437: fdatasync d2/d2f/d37/d41/f3e 0 2024-02-10T00:00:35.520 INFO:tasks.workunit.client.1.smithi183.stdout:5/806: dwrite d4/d23/d3e/d80/da1/d9e/f99 [0,4194304] 0 2024-02-10T00:00:35.521 INFO:tasks.workunit.client.0.smithi164.stdout:5/471: symlink d7/d17/d21/d23/d5a/d68/l99 0 2024-02-10T00:00:35.521 INFO:tasks.workunit.client.1.smithi183.stdout:0/785: dread d14/d1d/d2d/f8f [0,4194304] 0 2024-02-10T00:00:35.523 INFO:tasks.workunit.client.0.smithi164.stdout:0/394: creat d6/d3a/f7d x:0 0 0 2024-02-10T00:00:35.523 INFO:tasks.workunit.client.1.smithi183.stdout:1/699: dread d0/d3/d67/fc8 [0,4194304] 0 2024-02-10T00:00:35.524 INFO:tasks.workunit.client.0.smithi164.stdout:2/456: read d3/d32/d4e/d27/f74 [614371,47607] 0 2024-02-10T00:00:35.525 INFO:tasks.workunit.client.0.smithi164.stdout:7/490: dwrite d3/d5/f8b [0,4194304] 0 2024-02-10T00:00:35.525 INFO:tasks.workunit.client.0.smithi164.stdout:4/438: mkdir d2/d19/d16/d31/d72/d9a 0 2024-02-10T00:00:35.526 INFO:tasks.workunit.client.0.smithi164.stdout:2/457: write d3/f7 [1406532,71553] 0 2024-02-10T00:00:35.528 INFO:tasks.workunit.client.1.smithi183.stdout:0/786: dread d14/d1d/d59/d71/d22/f48 [0,4194304] 0 2024-02-10T00:00:35.528 INFO:tasks.workunit.client.0.smithi164.stdout:6/505: rename d0/c83 to d0/d2b/d3a/ca6 0 2024-02-10T00:00:35.528 INFO:tasks.workunit.client.0.smithi164.stdout:1/347: rename d1/d1a/d41/d18/d33 to d1/d1a/d41/d18/d33/d7b 22 2024-02-10T00:00:35.529 INFO:tasks.workunit.client.1.smithi183.stdout:7/707: dwrite d0/d11/d2f/da3/fb2 [0,4194304] 0 2024-02-10T00:00:35.529 INFO:tasks.workunit.client.1.smithi183.stdout:5/807: dwrite d4/d23/d3e/d80/da1/d9e/d27/d37/f101 [0,4194304] 0 2024-02-10T00:00:35.529 INFO:tasks.workunit.client.1.smithi183.stdout:0/787: chown d14/d3e/d5f/f116 15959474 1 2024-02-10T00:00:35.533 INFO:tasks.workunit.client.0.smithi164.stdout:8/405: truncate d2/f4 15320387 0 2024-02-10T00:00:35.535 INFO:tasks.workunit.client.0.smithi164.stdout:0/395: creat d6/d10/d4a/d60/d6c/f7e x:0 0 0 2024-02-10T00:00:35.539 INFO:tasks.workunit.client.0.smithi164.stdout:1/348: dread d1/f4e [0,4194304] 0 2024-02-10T00:00:35.539 INFO:tasks.workunit.client.1.smithi183.stdout:6/682: rmdir d2/d1a/d25/d3c/d31/d38/d6e/d35 39 2024-02-10T00:00:35.539 INFO:tasks.workunit.client.1.smithi183.stdout:3/664: rename d7/d98/cc0 to d7/db/d2a/d33/cc1 0 2024-02-10T00:00:35.540 INFO:tasks.workunit.client.0.smithi164.stdout:1/349: chown d1/d13/d2b/d54/d60 378650230 1 2024-02-10T00:00:35.541 INFO:tasks.workunit.client.0.smithi164.stdout:9/431: rename d6/de/d3b to d6/de/d2b/d5b/d61/d76/d82 0 2024-02-10T00:00:35.541 INFO:tasks.workunit.client.1.smithi183.stdout:8/828: mkdir d0/d4e/da6/dde/d102 0 2024-02-10T00:00:35.542 INFO:tasks.workunit.client.0.smithi164.stdout:9/432: write d6/de/d2b/f3c [997588,37153] 0 2024-02-10T00:00:35.543 INFO:tasks.workunit.client.0.smithi164.stdout:6/506: mkdir d0/d2b/d3a/d3d/da7 0 2024-02-10T00:00:35.544 INFO:tasks.workunit.client.0.smithi164.stdout:1/350: dwrite d1/d13/d2b/d54/f77 [0,4194304] 0 2024-02-10T00:00:35.544 INFO:tasks.workunit.client.1.smithi183.stdout:8/829: dread d0/d10/d9e/fbe [4194304,4194304] 0 2024-02-10T00:00:35.545 INFO:tasks.workunit.client.1.smithi183.stdout:4/821: unlink de/d14/d1d/d2f/c5f 0 2024-02-10T00:00:35.545 INFO:tasks.workunit.client.1.smithi183.stdout:8/830: fsync d0/d31/fe8 0 2024-02-10T00:00:35.545 INFO:tasks.workunit.client.0.smithi164.stdout:3/367: sync 2024-02-10T00:00:35.546 INFO:tasks.workunit.client.0.smithi164.stdout:8/406: symlink d2/d64/d31/d32/d4d/l76 0 2024-02-10T00:00:35.546 INFO:tasks.workunit.client.0.smithi164.stdout:3/368: dread - d0/d1/d2/d17/f54 zero size 2024-02-10T00:00:35.547 INFO:tasks.workunit.client.0.smithi164.stdout:0/396: creat d6/d10/d18/d2d/f7f x:0 0 0 2024-02-10T00:00:35.549 INFO:tasks.workunit.client.1.smithi183.stdout:1/700: creat d0/d3/d7/d3d/dcb/ff8 x:0 0 0 2024-02-10T00:00:35.550 INFO:tasks.workunit.client.1.smithi183.stdout:1/701: write d0/d3/d7/d3d/dcb/fd1 [782193,66681] 0 2024-02-10T00:00:35.550 INFO:tasks.workunit.client.1.smithi183.stdout:5/808: dread - d4/d23/f3b zero size 2024-02-10T00:00:35.551 INFO:tasks.workunit.client.1.smithi183.stdout:7/708: creat d0/d11/d2f/d64/d6b/fde x:0 0 0 2024-02-10T00:00:35.551 INFO:tasks.workunit.client.1.smithi183.stdout:0/788: fdatasync d14/d1d/d2d/d31/d6c/de3/ffd 0 2024-02-10T00:00:35.552 INFO:tasks.workunit.client.1.smithi183.stdout:7/709: write d0/d2/d4/fb9 [717031,83059] 0 2024-02-10T00:00:35.554 INFO:tasks.workunit.client.0.smithi164.stdout:6/507: fsync d0/fb 0 2024-02-10T00:00:35.554 INFO:tasks.workunit.client.0.smithi164.stdout:1/351: creat d1/d23/f7c x:0 0 0 2024-02-10T00:00:35.555 INFO:tasks.workunit.client.0.smithi164.stdout:0/397: creat d6/d3a/d52/d7a/f80 x:0 0 0 2024-02-10T00:00:35.555 INFO:tasks.workunit.client.0.smithi164.stdout:7/491: link d3/d28/d45/d4b/l7f d3/d4d/d5d/la0 0 2024-02-10T00:00:35.557 INFO:tasks.workunit.client.0.smithi164.stdout:0/398: chown d6/d10/d18/d2d/d39 29 1 2024-02-10T00:00:35.558 INFO:tasks.workunit.client.0.smithi164.stdout:5/472: dread d7/d17/d3b/d43/f53 [0,4194304] 0 2024-02-10T00:00:35.558 INFO:tasks.workunit.client.1.smithi183.stdout:3/665: rename d7/db/d2a/d2d/d6a/f6c to d7/db/d2a/d33/d59/db6/fc2 0 2024-02-10T00:00:35.560 INFO:tasks.workunit.client.1.smithi183.stdout:9/767: mknod d0/d3/d14/d74/cfa 0 2024-02-10T00:00:35.560 INFO:tasks.workunit.client.0.smithi164.stdout:6/508: creat d0/d2b/d3a/d3d/d42/fa8 x:0 0 0 2024-02-10T00:00:35.561 INFO:tasks.workunit.client.0.smithi164.stdout:9/433: truncate d6/d1c/d24/d4f/f5a 2533387 0 2024-02-10T00:00:35.563 INFO:tasks.workunit.client.0.smithi164.stdout:3/369: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:35.563 INFO:tasks.workunit.client.0.smithi164.stdout:1/352: rename d1/d1a/f45 to d1/d23/f7d 0 2024-02-10T00:00:35.563 INFO:tasks.workunit.client.1.smithi183.stdout:1/702: creat d0/d3c/ff9 x:0 0 0 2024-02-10T00:00:35.564 INFO:tasks.workunit.client.0.smithi164.stdout:1/353: dread - d1/d13/d2b/d52/f6b zero size 2024-02-10T00:00:35.564 INFO:tasks.workunit.client.0.smithi164.stdout:7/492: symlink d3/d4d/d5d/la1 0 2024-02-10T00:00:35.567 INFO:tasks.workunit.client.1.smithi183.stdout:1/703: readlink d0/d3/d29/lcc 0 2024-02-10T00:00:35.567 INFO:tasks.workunit.client.1.smithi183.stdout:3/666: dwrite d7/db/d2a/d4d/d63/fbe [0,4194304] 0 2024-02-10T00:00:35.568 INFO:tasks.workunit.client.0.smithi164.stdout:1/354: fdatasync d1/d13/d2b/d52/f6b 0 2024-02-10T00:00:35.568 INFO:tasks.workunit.client.1.smithi183.stdout:2/876: truncate d2/d2c/dba/df0/dbd/fdb 115545 0 2024-02-10T00:00:35.568 INFO:tasks.workunit.client.1.smithi183.stdout:6/683: unlink d2/d1a/d25/fbd 0 2024-02-10T00:00:35.568 INFO:tasks.workunit.client.0.smithi164.stdout:0/399: symlink d6/d10/d18/d1c/l81 0 2024-02-10T00:00:35.570 INFO:tasks.workunit.client.0.smithi164.stdout:5/473: creat d7/d17/d21/d23/d5a/d68/d1f/f9a x:0 0 0 2024-02-10T00:00:35.571 INFO:tasks.workunit.client.1.smithi183.stdout:6/684: read d2/d1a/d25/d3c/d31/fc7 [6873965,109497] 0 2024-02-10T00:00:35.572 INFO:tasks.workunit.client.0.smithi164.stdout:9/434: mknod d6/de/d40/d74/c83 0 2024-02-10T00:00:35.573 INFO:tasks.workunit.client.1.smithi183.stdout:9/768: rename d0/d30/d52/lb0 to d0/d3/d14/d1c/d4b/lfb 0 2024-02-10T00:00:35.573 INFO:tasks.workunit.client.0.smithi164.stdout:9/435: chown d6/de/d22/l7d 1331199 1 2024-02-10T00:00:35.574 INFO:tasks.workunit.client.0.smithi164.stdout:3/370: truncate d0/f10 2266290 0 2024-02-10T00:00:35.574 INFO:tasks.workunit.client.0.smithi164.stdout:0/400: dread d6/d7/d14/f1b [0,4194304] 0 2024-02-10T00:00:35.575 INFO:tasks.workunit.client.0.smithi164.stdout:0/401: fdatasync d6/d7/f6f 0 2024-02-10T00:00:35.576 INFO:tasks.workunit.client.1.smithi183.stdout:2/877: fsync d2/d2c/d2f/d60/d8d/d9c/ffe 0 2024-02-10T00:00:35.577 INFO:tasks.workunit.client.0.smithi164.stdout:1/355: rename d1/d23/f32 to d1/d23/d70/f7e 0 2024-02-10T00:00:35.579 INFO:tasks.workunit.client.1.smithi183.stdout:6/685: creat d2/d1a/d25/d3c/d31/d38/d87/fcc x:0 0 0 2024-02-10T00:00:35.580 INFO:tasks.workunit.client.1.smithi183.stdout:9/769: creat d0/d3/d14/d3c/d7b/ffc x:0 0 0 2024-02-10T00:00:35.580 INFO:tasks.workunit.client.0.smithi164.stdout:5/474: rmdir d7/d17/d3b/d45 39 2024-02-10T00:00:35.581 INFO:tasks.workunit.client.1.smithi183.stdout:7/710: creat d0/d2/fdf x:0 0 0 2024-02-10T00:00:35.583 INFO:tasks.workunit.client.0.smithi164.stdout:3/371: readlink d0/l9 0 2024-02-10T00:00:35.585 INFO:tasks.workunit.client.0.smithi164.stdout:5/475: dwrite d7/d17/d21/d23/d5a/f74 [0,4194304] 0 2024-02-10T00:00:35.586 INFO:tasks.workunit.client.0.smithi164.stdout:0/402: chown d6/d10/d18/d2d/d35/c57 69 1 2024-02-10T00:00:35.587 INFO:tasks.workunit.client.0.smithi164.stdout:5/476: write d7/d17/d21/f89 [173302,120612] 0 2024-02-10T00:00:35.587 INFO:tasks.workunit.client.1.smithi183.stdout:7/711: dread d0/d11/d3e/f7c [0,4194304] 0 2024-02-10T00:00:35.587 INFO:tasks.workunit.client.0.smithi164.stdout:1/356: creat d1/d23/f7f x:0 0 0 2024-02-10T00:00:35.588 INFO:tasks.workunit.client.1.smithi183.stdout:6/686: mknod d2/da0/ccd 0 2024-02-10T00:00:35.589 INFO:tasks.workunit.client.0.smithi164.stdout:8/407: dread d2/f49 [0,4194304] 0 2024-02-10T00:00:35.591 INFO:tasks.workunit.client.0.smithi164.stdout:0/403: dread d6/d10/d18/d2d/f2f [4194304,4194304] 0 2024-02-10T00:00:35.591 INFO:tasks.workunit.client.1.smithi183.stdout:0/789: link d14/d1d/d2d/d31/d6c/de3/c9a d14/d1d/d59/d3c/c119 0 2024-02-10T00:00:35.591 INFO:tasks.workunit.client.1.smithi183.stdout:7/712: dwrite d0/d2/d4/fb9 [0,4194304] 0 2024-02-10T00:00:35.595 INFO:tasks.workunit.client.1.smithi183.stdout:2/878: link d2/d2c/d2f/d72/f92 d2/d2c/dba/de9/f12a 0 2024-02-10T00:00:35.596 INFO:tasks.workunit.client.1.smithi183.stdout:2/879: read - d2/da/d20/d21/d43/d58/f125 zero size 2024-02-10T00:00:35.597 INFO:tasks.workunit.client.1.smithi183.stdout:2/880: stat d2/d2c/d2f/f115 0 2024-02-10T00:00:35.597 INFO:tasks.workunit.client.0.smithi164.stdout:4/439: sync 2024-02-10T00:00:35.598 INFO:tasks.workunit.client.0.smithi164.stdout:2/458: truncate d3/f3e 651655 0 2024-02-10T00:00:35.598 INFO:tasks.workunit.client.0.smithi164.stdout:4/440: chown d2/d2f/d37/d71/f93 2 1 2024-02-10T00:00:35.599 INFO:tasks.workunit.client.0.smithi164.stdout:2/459: chown d3/d26/d56 7804 1 2024-02-10T00:00:35.599 INFO:tasks.workunit.client.0.smithi164.stdout:4/441: write d2/d19/d16/d31/d57/f59 [1611559,40771] 0 2024-02-10T00:00:35.605 INFO:tasks.workunit.client.0.smithi164.stdout:7/493: rename d3/d11/d39/d44/d48/d71/l89 to d3/d11/d39/d44/d6f/la2 0 2024-02-10T00:00:35.607 INFO:tasks.workunit.client.0.smithi164.stdout:1/357: mkdir d1/d13/d80 0 2024-02-10T00:00:35.608 INFO:tasks.workunit.client.0.smithi164.stdout:0/404: rename d6/d10/d18/d2d/d39/l73 to d6/d3a/d52/d7a/l82 0 2024-02-10T00:00:35.610 INFO:tasks.workunit.client.0.smithi164.stdout:7/494: chown d3/d4d/d5d/la0 6 1 2024-02-10T00:00:35.610 INFO:tasks.workunit.client.0.smithi164.stdout:0/405: read d6/d10/d4a/f74 [385328,61761] 0 2024-02-10T00:00:35.612 INFO:tasks.workunit.client.1.smithi183.stdout:8/831: dwrite d0/d27/f2e [0,4194304] 0 2024-02-10T00:00:35.613 INFO:tasks.workunit.client.1.smithi183.stdout:8/832: fsync d0/d3f/db2/d24/f28 0 2024-02-10T00:00:35.614 INFO:tasks.workunit.client.0.smithi164.stdout:9/436: dread d6/f7 [0,4194304] 0 2024-02-10T00:00:35.615 INFO:tasks.workunit.client.0.smithi164.stdout:0/406: dwrite d6/d10/d18/d2d/f5a [0,4194304] 0 2024-02-10T00:00:35.615 INFO:tasks.workunit.client.1.smithi183.stdout:5/809: dread d4/d23/d3e/d80/da1/f8f [0,4194304] 0 2024-02-10T00:00:35.615 INFO:tasks.workunit.client.0.smithi164.stdout:9/437: fsync f2 0 2024-02-10T00:00:35.616 INFO:tasks.workunit.client.0.smithi164.stdout:0/407: fdatasync d6/d10/d4a/d60/d6c/f46 0 2024-02-10T00:00:35.617 INFO:tasks.workunit.client.0.smithi164.stdout:0/408: write d6/d10/d4a/d60/d6c/f7e [590902,96278] 0 2024-02-10T00:00:35.619 INFO:tasks.workunit.client.1.smithi183.stdout:4/822: write de/d19/fe0 [501499,1398] 0 2024-02-10T00:00:35.620 INFO:tasks.workunit.client.1.smithi183.stdout:4/823: write de/d14/d4e/ff2 [232221,102303] 0 2024-02-10T00:00:35.620 INFO:tasks.workunit.client.1.smithi183.stdout:4/824: readlink de/lec 0 2024-02-10T00:00:35.621 INFO:tasks.workunit.client.0.smithi164.stdout:6/509: truncate d0/d6/d12/f67 1052939 0 2024-02-10T00:00:35.621 INFO:tasks.workunit.client.1.smithi183.stdout:4/825: fdatasync de/d14/d27/f37 0 2024-02-10T00:00:35.621 INFO:tasks.workunit.client.0.smithi164.stdout:6/510: write d0/d2b/d3a/f55 [3108615,9173] 0 2024-02-10T00:00:35.622 INFO:tasks.workunit.client.1.smithi183.stdout:2/881: creat d2/d2c/dba/df0/dbe/f12b x:0 0 0 2024-02-10T00:00:35.622 INFO:tasks.workunit.client.1.smithi183.stdout:1/704: getdents d0/d3/d67/d7b 0 2024-02-10T00:00:35.623 INFO:tasks.workunit.client.1.smithi183.stdout:2/882: stat d2/d2c/d2f/d60/d8d/d9c/da7/dd4/f5d 0 2024-02-10T00:00:35.623 INFO:tasks.workunit.client.0.smithi164.stdout:4/442: rename d2/d2f/d37/d41/f34 to d2/d19/d16/d31/d57/f9b 0 2024-02-10T00:00:35.627 INFO:tasks.workunit.client.1.smithi183.stdout:3/667: truncate d7/f12 4460013 0 2024-02-10T00:00:35.628 INFO:tasks.workunit.client.1.smithi183.stdout:9/770: dread d0/d3/d14/d1c/d2d/d4f/fb1 [4194304,4194304] 0 2024-02-10T00:00:35.629 INFO:tasks.workunit.client.1.smithi183.stdout:6/687: creat d2/d1a/d3a/fce x:0 0 0 2024-02-10T00:00:35.634 INFO:tasks.workunit.client.0.smithi164.stdout:0/409: symlink d6/d10/d18/d2d/l83 0 2024-02-10T00:00:35.635 INFO:tasks.workunit.client.0.smithi164.stdout:6/511: chown d0/l15 8 1 2024-02-10T00:00:35.635 INFO:tasks.workunit.client.1.smithi183.stdout:5/810: fsync d4/d23/d3e/d80/da1/d9c/d72/da0/fa4 0 2024-02-10T00:00:35.637 INFO:tasks.workunit.client.1.smithi183.stdout:0/790: dwrite d14/d1d/d59/d3c/ff6 [0,4194304] 0 2024-02-10T00:00:35.637 INFO:tasks.workunit.client.0.smithi164.stdout:6/512: chown d0/d2b/d3a/d3d/d42/d5d/d66 112506559 1 2024-02-10T00:00:35.637 INFO:tasks.workunit.client.1.smithi183.stdout:7/713: rmdir d0/d11/dcb 0 2024-02-10T00:00:35.638 INFO:tasks.workunit.client.0.smithi164.stdout:3/372: dwrite d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:35.639 INFO:tasks.workunit.client.0.smithi164.stdout:4/443: mknod d2/d2f/d37/d41/d3d/d56/c9c 0 2024-02-10T00:00:35.640 INFO:tasks.workunit.client.0.smithi164.stdout:7/495: symlink d3/d11/d39/d44/d48/la3 0 2024-02-10T00:00:35.640 INFO:tasks.workunit.client.1.smithi183.stdout:9/771: mknod d0/d3/d14/d1c/d4b/cfd 0 2024-02-10T00:00:35.643 INFO:tasks.workunit.client.0.smithi164.stdout:6/513: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/d92/f7a [0,4194304] 0 2024-02-10T00:00:35.645 INFO:tasks.workunit.client.0.smithi164.stdout:0/410: rename d6/f2a to d6/d10/d18/d2d/f84 0 2024-02-10T00:00:35.646 INFO:tasks.workunit.client.0.smithi164.stdout:0/411: write d6/d10/d18/d2d/f7f [753128,42120] 0 2024-02-10T00:00:35.646 INFO:tasks.workunit.client.0.smithi164.stdout:0/412: read - d6/d10/d18/d1c/f71 zero size 2024-02-10T00:00:35.647 INFO:tasks.workunit.client.0.smithi164.stdout:5/477: truncate d7/fd 6151461 0 2024-02-10T00:00:35.648 INFO:tasks.workunit.client.0.smithi164.stdout:5/478: write d7/d17/d21/d24/f3d [3812216,75992] 0 2024-02-10T00:00:35.648 INFO:tasks.workunit.client.0.smithi164.stdout:3/373: symlink d0/d1/dd/l70 0 2024-02-10T00:00:35.648 INFO:tasks.workunit.client.1.smithi183.stdout:4/826: truncate de/d19/d20/fba 4310972 0 2024-02-10T00:00:35.649 INFO:tasks.workunit.client.0.smithi164.stdout:9/438: creat d6/d1c/d24/f84 x:0 0 0 2024-02-10T00:00:35.649 INFO:tasks.workunit.client.1.smithi183.stdout:0/791: mkdir d14/d1d/d2d/d11a 0 2024-02-10T00:00:35.652 INFO:tasks.workunit.client.0.smithi164.stdout:9/439: dread f2 [0,4194304] 0 2024-02-10T00:00:35.656 INFO:tasks.workunit.client.1.smithi183.stdout:3/668: mknod d7/db/d2a/d2d/d51/dab/da9/cc3 0 2024-02-10T00:00:35.656 INFO:tasks.workunit.client.1.smithi183.stdout:7/714: mknod d0/d2/d50/d5d/ce0 0 2024-02-10T00:00:35.656 INFO:tasks.workunit.client.1.smithi183.stdout:6/688: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/fcf x:0 0 0 2024-02-10T00:00:35.657 INFO:tasks.workunit.client.1.smithi183.stdout:9/772: mkdir d0/d3/d14/d1c/d2d/d4f/d89/dc5/dfe 0 2024-02-10T00:00:35.657 INFO:tasks.workunit.client.1.smithi183.stdout:0/792: mkdir d14/d1d/d55/d6e/d74/d11b 0 2024-02-10T00:00:35.659 INFO:tasks.workunit.client.1.smithi183.stdout:7/715: stat d0/d2/d4/d8/d59/d8a/lbc 0 2024-02-10T00:00:35.659 INFO:tasks.workunit.client.0.smithi164.stdout:1/358: dwrite d1/d13/f62 [0,4194304] 0 2024-02-10T00:00:35.659 INFO:tasks.workunit.client.1.smithi183.stdout:9/773: chown d0/d3/d14/d1c/d2d/d4f/db8/de7 545027 1 2024-02-10T00:00:35.660 INFO:tasks.workunit.client.1.smithi183.stdout:3/669: readlink d7/l32 0 2024-02-10T00:00:35.660 INFO:tasks.workunit.client.1.smithi183.stdout:0/793: write d14/d1d/d96/da0/fad [616932,30234] 0 2024-02-10T00:00:35.660 INFO:tasks.workunit.client.0.smithi164.stdout:1/359: readlink d1/d1a/d41/d18/d3a/l49 0 2024-02-10T00:00:35.660 INFO:tasks.workunit.client.1.smithi183.stdout:5/811: creat d4/d23/f10b x:0 0 0 2024-02-10T00:00:35.661 INFO:tasks.workunit.client.0.smithi164.stdout:0/413: mknod d6/d10/d18/d2d/d35/d44/c85 0 2024-02-10T00:00:35.665 INFO:tasks.workunit.client.1.smithi183.stdout:8/833: dwrite d0/d27/f44 [0,4194304] 0 2024-02-10T00:00:35.665 INFO:tasks.workunit.client.0.smithi164.stdout:9/440: rename d6/de/d40/d54/l68 to d6/de/d2b/d5b/d61/d76/l85 0 2024-02-10T00:00:35.666 INFO:tasks.workunit.client.1.smithi183.stdout:0/794: symlink d14/d1d/d2d/l11c 0 2024-02-10T00:00:35.668 INFO:tasks.workunit.client.0.smithi164.stdout:6/514: mkdir d0/d2b/d3a/d3d/da7/da9 0 2024-02-10T00:00:35.669 INFO:tasks.workunit.client.1.smithi183.stdout:6/689: getdents d2 0 2024-02-10T00:00:35.669 INFO:tasks.workunit.client.0.smithi164.stdout:5/479: symlink d7/d17/d21/d85/l9b 0 2024-02-10T00:00:35.670 INFO:tasks.workunit.client.1.smithi183.stdout:5/812: mkdir d4/d10c 0 2024-02-10T00:00:35.670 INFO:tasks.workunit.client.0.smithi164.stdout:5/480: chown d7/d17/d21/d23/d5a/d68/d1f/f44 82289955 1 2024-02-10T00:00:35.670 INFO:tasks.workunit.client.0.smithi164.stdout:5/481: chown d7/fc 717810 1 2024-02-10T00:00:35.672 INFO:tasks.workunit.client.1.smithi183.stdout:0/795: write d14/d1d/d2d/d31/d6c/d70/fd6 [3631343,64589] 0 2024-02-10T00:00:35.672 INFO:tasks.workunit.client.0.smithi164.stdout:0/414: rename l2 to d6/d3a/d52/d7a/l86 0 2024-02-10T00:00:35.672 INFO:tasks.workunit.client.0.smithi164.stdout:2/460: sync 2024-02-10T00:00:35.673 INFO:tasks.workunit.client.0.smithi164.stdout:0/415: fdatasync d6/d10/d18/d2d/f37 0 2024-02-10T00:00:35.674 INFO:tasks.workunit.client.1.smithi183.stdout:9/774: dread d0/f2f [0,4194304] 0 2024-02-10T00:00:35.674 INFO:tasks.workunit.client.0.smithi164.stdout:8/408: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:35.674 INFO:tasks.workunit.client.1.smithi183.stdout:8/834: creat d0/d3f/db2/de9/f103 x:0 0 0 2024-02-10T00:00:35.675 INFO:tasks.workunit.client.0.smithi164.stdout:1/360: symlink d1/d1a/d75/l81 0 2024-02-10T00:00:35.676 INFO:tasks.workunit.client.0.smithi164.stdout:6/515: creat d0/d2b/d3a/d3d/d42/d5d/d79/faa x:0 0 0 2024-02-10T00:00:35.677 INFO:tasks.workunit.client.1.smithi183.stdout:5/813: truncate d4/d23/d2a/d5b/f65 2588848 0 2024-02-10T00:00:35.677 INFO:tasks.workunit.client.1.smithi183.stdout:6/690: creat d2/d1a/d25/d3c/d31/d38/d6e/d93/fd0 x:0 0 0 2024-02-10T00:00:35.678 INFO:tasks.workunit.client.0.smithi164.stdout:2/461: write d3/d32/d4e/d27/f94 [1038825,128013] 0 2024-02-10T00:00:35.678 INFO:tasks.workunit.client.0.smithi164.stdout:8/409: rename d2/d64/d31/d32/d4d/d60 to d2/d64/d31/d32/d4d/d60/d77 22 2024-02-10T00:00:35.678 INFO:tasks.workunit.client.1.smithi183.stdout:6/691: write d2/d1a/d3a/fce [65646,54254] 0 2024-02-10T00:00:35.679 INFO:tasks.workunit.client.0.smithi164.stdout:0/416: unlink d6/d10/d18/d1c/l64 0 2024-02-10T00:00:35.681 INFO:tasks.workunit.client.1.smithi183.stdout:9/775: unlink d0/c54 0 2024-02-10T00:00:35.682 INFO:tasks.workunit.client.0.smithi164.stdout:9/441: link d6/f1e d6/f86 0 2024-02-10T00:00:35.682 INFO:tasks.workunit.client.1.smithi183.stdout:1/705: dwrite d0/d3a/fa7 [0,4194304] 0 2024-02-10T00:00:35.683 INFO:tasks.workunit.client.0.smithi164.stdout:1/361: creat d1/d13/d2b/d52/f82 x:0 0 0 2024-02-10T00:00:35.683 INFO:tasks.workunit.client.1.smithi183.stdout:9/776: write d0/d3/d14/d1c/d4b/d51/f75 [790900,53758] 0 2024-02-10T00:00:35.684 INFO:tasks.workunit.client.0.smithi164.stdout:0/417: dwrite d6/d3a/f7d [0,4194304] 0 2024-02-10T00:00:35.684 INFO:tasks.workunit.client.1.smithi183.stdout:9/777: stat d0/c33 0 2024-02-10T00:00:35.684 INFO:tasks.workunit.client.1.smithi183.stdout:2/883: sync 2024-02-10T00:00:35.685 INFO:tasks.workunit.client.1.smithi183.stdout:5/814: symlink d4/d23/dc4/l10d 0 2024-02-10T00:00:35.685 INFO:tasks.workunit.client.0.smithi164.stdout:6/516: mkdir d0/d6/d12/d45/dab 0 2024-02-10T00:00:35.685 INFO:tasks.workunit.client.0.smithi164.stdout:0/418: fdatasync d6/d10/d4a/d60/d6c/f7e 0 2024-02-10T00:00:35.686 INFO:tasks.workunit.client.0.smithi164.stdout:6/517: chown d0/d2b/d3a/d3d/f74 0 1 2024-02-10T00:00:35.690 INFO:tasks.workunit.client.0.smithi164.stdout:0/419: dread d6/d3a/d52/f75 [0,4194304] 0 2024-02-10T00:00:35.692 INFO:tasks.workunit.client.0.smithi164.stdout:9/442: creat d6/d1c/f87 x:0 0 0 2024-02-10T00:00:35.692 INFO:tasks.workunit.client.0.smithi164.stdout:6/518: dwrite d0/d6/f59 [0,4194304] 0 2024-02-10T00:00:35.693 INFO:tasks.workunit.client.0.smithi164.stdout:8/410: dread d2/f6f [0,4194304] 0 2024-02-10T00:00:35.693 INFO:tasks.workunit.client.1.smithi183.stdout:5/815: rmdir d4/d23/d3e/d80/da1/d9c/d72/da0 39 2024-02-10T00:00:35.695 INFO:tasks.workunit.client.1.smithi183.stdout:9/778: truncate d0/d92/db7/fdb 1001943 0 2024-02-10T00:00:35.695 INFO:tasks.workunit.client.1.smithi183.stdout:7/716: dread d0/d2/d4/f3c [0,4194304] 0 2024-02-10T00:00:35.697 INFO:tasks.workunit.client.0.smithi164.stdout:9/443: dwrite d6/de/d2b/f65 [0,4194304] 0 2024-02-10T00:00:35.699 INFO:tasks.workunit.client.1.smithi183.stdout:5/816: mkdir d4/d23/d10e 0 2024-02-10T00:00:35.701 INFO:tasks.workunit.client.0.smithi164.stdout:9/444: creat d6/de/d40/f88 x:0 0 0 2024-02-10T00:00:35.702 INFO:tasks.workunit.client.0.smithi164.stdout:8/411: mkdir d2/d64/d54/d71/d78 0 2024-02-10T00:00:35.703 INFO:tasks.workunit.client.0.smithi164.stdout:5/482: dread d7/f19 [0,4194304] 0 2024-02-10T00:00:35.704 INFO:tasks.workunit.client.0.smithi164.stdout:5/483: chown d7/d17/d21/l42 44 1 2024-02-10T00:00:35.704 INFO:tasks.workunit.client.0.smithi164.stdout:6/519: rmdir d0/d6/d12/d45/dab 0 2024-02-10T00:00:35.705 INFO:tasks.workunit.client.0.smithi164.stdout:9/445: readlink d6/de/d2b/d5b/d61/d76/d82/l48 0 2024-02-10T00:00:35.705 INFO:tasks.workunit.client.1.smithi183.stdout:9/779: truncate d0/d30/ff9 893873 0 2024-02-10T00:00:35.706 INFO:tasks.workunit.client.0.smithi164.stdout:5/484: fdatasync d7/d17/d21/d23/f72 0 2024-02-10T00:00:35.707 INFO:tasks.workunit.client.0.smithi164.stdout:6/520: write d0/d6/f9b [968353,31631] 0 2024-02-10T00:00:35.707 INFO:tasks.workunit.client.1.smithi183.stdout:9/780: chown d0/d3/d14/d3c/d7b/f87 1400112650 1 2024-02-10T00:00:35.708 INFO:tasks.workunit.client.1.smithi183.stdout:7/717: getdents d0/d2/d50 0 2024-02-10T00:00:35.709 INFO:tasks.workunit.client.1.smithi183.stdout:9/781: creat d0/d3/d14/d48/fff x:0 0 0 2024-02-10T00:00:35.710 INFO:tasks.workunit.client.0.smithi164.stdout:0/420: dread d6/d10/d18/d1c/f2c [0,4194304] 0 2024-02-10T00:00:35.711 INFO:tasks.workunit.client.0.smithi164.stdout:9/446: write d6/f86 [2319372,75285] 0 2024-02-10T00:00:35.711 INFO:tasks.workunit.client.0.smithi164.stdout:0/421: chown d6/d3a/f7d 18 1 2024-02-10T00:00:35.711 INFO:tasks.workunit.client.1.smithi183.stdout:5/817: getdents d4/d23/d3e/d80/da1/d9e/d27/d5d/d91 0 2024-02-10T00:00:35.712 INFO:tasks.workunit.client.1.smithi183.stdout:7/718: rmdir d0/d11/d88/d94 39 2024-02-10T00:00:35.712 INFO:tasks.workunit.client.0.smithi164.stdout:8/412: creat d2/d64/d31/d32/d58/f79 x:0 0 0 2024-02-10T00:00:35.712 INFO:tasks.workunit.client.0.smithi164.stdout:8/413: chown d2/d64/l43 19894 1 2024-02-10T00:00:35.716 INFO:tasks.workunit.client.0.smithi164.stdout:5/485: mknod d7/d17/d69/c9c 0 2024-02-10T00:00:35.716 INFO:tasks.workunit.client.0.smithi164.stdout:0/422: mkdir d6/d3a/d87 0 2024-02-10T00:00:35.718 INFO:tasks.workunit.client.1.smithi183.stdout:7/719: getdents d0/d2/d4 0 2024-02-10T00:00:35.718 INFO:tasks.workunit.client.1.smithi183.stdout:6/692: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fca [0,4194304] 0 2024-02-10T00:00:35.721 INFO:tasks.workunit.client.1.smithi183.stdout:6/693: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/ld1 0 2024-02-10T00:00:35.725 INFO:tasks.workunit.client.0.smithi164.stdout:7/496: dwrite d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:35.725 INFO:tasks.workunit.client.0.smithi164.stdout:5/486: mknod d7/d17/d21/d23/d5a/d68/d1f/c9d 0 2024-02-10T00:00:35.726 INFO:tasks.workunit.client.0.smithi164.stdout:6/521: truncate d0/fb 1422925 0 2024-02-10T00:00:35.727 INFO:tasks.workunit.client.0.smithi164.stdout:1/362: dread d1/f11 [0,4194304] 0 2024-02-10T00:00:35.727 INFO:tasks.workunit.client.0.smithi164.stdout:0/423: mkdir d6/d10/d4a/d88 0 2024-02-10T00:00:35.728 INFO:tasks.workunit.client.0.smithi164.stdout:8/414: mknod d2/d64/d31/c7a 0 2024-02-10T00:00:35.729 INFO:tasks.workunit.client.0.smithi164.stdout:5/487: fdatasync d7/d17/d21/d23/d5a/d68/d1f/f4a 0 2024-02-10T00:00:35.730 INFO:tasks.workunit.client.1.smithi183.stdout:6/694: dread d2/d1a/f1f [4194304,4194304] 0 2024-02-10T00:00:35.730 INFO:tasks.workunit.client.0.smithi164.stdout:1/363: write d1/d1a/d41/f58 [618852,31976] 0 2024-02-10T00:00:35.730 INFO:tasks.workunit.client.0.smithi164.stdout:0/424: mknod d6/d3a/c89 0 2024-02-10T00:00:35.733 INFO:tasks.workunit.client.1.smithi183.stdout:5/818: dread d4/d74/fba [0,4194304] 0 2024-02-10T00:00:35.733 INFO:tasks.workunit.client.0.smithi164.stdout:5/488: write d7/d17/d21/d23/d5a/f74 [1594764,89569] 0 2024-02-10T00:00:35.734 INFO:tasks.workunit.client.1.smithi183.stdout:5/819: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fc6 [962779,55204] 0 2024-02-10T00:00:35.735 INFO:tasks.workunit.client.1.smithi183.stdout:5/820: chown d4/d74 361378 1 2024-02-10T00:00:35.735 INFO:tasks.workunit.client.0.smithi164.stdout:7/497: dwrite d3/d11/d39/d44/d48/d71/f91 [0,4194304] 0 2024-02-10T00:00:35.736 INFO:tasks.workunit.client.0.smithi164.stdout:6/522: dwrite d0/d6/d12/d57/f58 [0,4194304] 0 2024-02-10T00:00:35.737 INFO:tasks.workunit.client.0.smithi164.stdout:5/489: dread - d7/d17/d21/d23/d37/d36/f81 zero size 2024-02-10T00:00:35.737 INFO:tasks.workunit.client.0.smithi164.stdout:7/498: chown d3/d4d/d5d/l87 1440364996 1 2024-02-10T00:00:35.738 INFO:tasks.workunit.client.0.smithi164.stdout:5/490: dread - d7/d17/f83 zero size 2024-02-10T00:00:35.740 INFO:tasks.workunit.client.1.smithi183.stdout:1/706: dread d0/d3/fa [0,4194304] 0 2024-02-10T00:00:35.741 INFO:tasks.workunit.client.0.smithi164.stdout:1/364: dwrite d1/d23/d70/f7e [0,4194304] 0 2024-02-10T00:00:35.741 INFO:tasks.workunit.client.0.smithi164.stdout:5/491: chown d7/d17/d21/d23/d5a/d68/d1f/d59/l60 442 1 2024-02-10T00:00:35.743 INFO:tasks.workunit.client.0.smithi164.stdout:6/523: rename d0/d6/d12/c64 to d0/d2b/d3a/d3d/d42/d5d/d66/cac 0 2024-02-10T00:00:35.744 INFO:tasks.workunit.client.1.smithi183.stdout:4/827: truncate de/d19/d20/f5d 798006 0 2024-02-10T00:00:35.744 INFO:tasks.workunit.client.0.smithi164.stdout:4/444: truncate d2/d19/d16/d31/d4b/f50 686652 0 2024-02-10T00:00:35.745 INFO:tasks.workunit.client.0.smithi164.stdout:6/524: fdatasync d0/d6/d12/d14/f24 0 2024-02-10T00:00:35.747 INFO:tasks.workunit.client.0.smithi164.stdout:4/445: write d2/d2f/d37/d41/f6e [198314,3895] 0 2024-02-10T00:00:35.747 INFO:tasks.workunit.client.0.smithi164.stdout:5/492: dwrite d7/d17/d21/d23/d37/d36/f6d [0,4194304] 0 2024-02-10T00:00:35.748 INFO:tasks.workunit.client.1.smithi183.stdout:3/670: truncate d7/db/d2a/d33/d59/d52/f64 4615532 0 2024-02-10T00:00:35.748 INFO:tasks.workunit.client.0.smithi164.stdout:4/446: dread - d2/d2f/d37/f8f zero size 2024-02-10T00:00:35.750 INFO:tasks.workunit.client.0.smithi164.stdout:4/447: write d2/d2f/d37/d41/f6e [968595,114399] 0 2024-02-10T00:00:35.751 INFO:tasks.workunit.client.1.smithi183.stdout:9/782: sync 2024-02-10T00:00:35.751 INFO:tasks.workunit.client.1.smithi183.stdout:9/783: write d0/d3/d14/ff7 [103162,94495] 0 2024-02-10T00:00:35.752 INFO:tasks.workunit.client.1.smithi183.stdout:5/821: symlink d4/d23/d3e/d80/da1/d9c/d72/da0/da9/l10f 0 2024-02-10T00:00:35.752 INFO:tasks.workunit.client.0.smithi164.stdout:3/374: dwrite d0/d1/d2/d19/f56 [0,4194304] 0 2024-02-10T00:00:35.754 INFO:tasks.workunit.client.1.smithi183.stdout:1/707: rename d0/l97 to d0/d3a/lfa 0 2024-02-10T00:00:35.754 INFO:tasks.workunit.client.1.smithi183.stdout:7/720: dread d0/d2/d50/d5d/f55 [0,4194304] 0 2024-02-10T00:00:35.756 INFO:tasks.workunit.client.0.smithi164.stdout:2/462: truncate d3/da6/d7a/d8e/d36/f43 334624 0 2024-02-10T00:00:35.761 INFO:tasks.workunit.client.1.smithi183.stdout:0/796: dwrite d14/d1d/d2d/d31/d6c/de3/f94 [0,4194304] 0 2024-02-10T00:00:35.761 INFO:tasks.workunit.client.1.smithi183.stdout:8/835: dwrite d0/d27/d36/fc4 [0,4194304] 0 2024-02-10T00:00:35.763 INFO:tasks.workunit.client.1.smithi183.stdout:2/884: dwrite d2/d2c/dba/de9/f12a [0,4194304] 0 2024-02-10T00:00:35.763 INFO:tasks.workunit.client.1.smithi183.stdout:0/797: write d14/d1d/d59/d71/db4/fd3 [205226,25846] 0 2024-02-10T00:00:35.764 INFO:tasks.workunit.client.0.smithi164.stdout:9/447: sync 2024-02-10T00:00:35.765 INFO:tasks.workunit.client.0.smithi164.stdout:7/499: write d3/d26/f31 [4078320,124473] 0 2024-02-10T00:00:35.765 INFO:tasks.workunit.client.1.smithi183.stdout:9/784: read d0/d3/d14/d3c/f60 [3086641,120856] 0 2024-02-10T00:00:35.766 INFO:tasks.workunit.client.1.smithi183.stdout:5/822: symlink d4/d74/l110 0 2024-02-10T00:00:35.767 INFO:tasks.workunit.client.1.smithi183.stdout:1/708: mknod d0/d3/d29/dc4/cfb 0 2024-02-10T00:00:35.767 INFO:tasks.workunit.client.1.smithi183.stdout:7/721: fdatasync d0/d11/d9d/faf 0 2024-02-10T00:00:35.769 INFO:tasks.workunit.client.1.smithi183.stdout:8/836: dwrite d0/d27/d36/fc4 [0,4194304] 0 2024-02-10T00:00:35.770 INFO:tasks.workunit.client.0.smithi164.stdout:9/448: dread d6/f3e [0,4194304] 0 2024-02-10T00:00:35.770 INFO:tasks.workunit.client.1.smithi183.stdout:6/695: write d2/d1a/f1f [2000366,125494] 0 2024-02-10T00:00:35.771 INFO:tasks.workunit.client.0.smithi164.stdout:0/425: dwrite d6/d7/d14/f54 [0,4194304] 0 2024-02-10T00:00:35.771 INFO:tasks.workunit.client.0.smithi164.stdout:0/426: chown d6/d10/d18 377 1 2024-02-10T00:00:35.772 INFO:tasks.workunit.client.1.smithi183.stdout:6/696: dread - d2/d1a/d25/d3c/d31/f8a zero size 2024-02-10T00:00:35.772 INFO:tasks.workunit.client.0.smithi164.stdout:1/365: write d1/f1b [1539668,62276] 0 2024-02-10T00:00:35.773 INFO:tasks.workunit.client.1.smithi183.stdout:7/722: dwrite d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:35.774 INFO:tasks.workunit.client.1.smithi183.stdout:2/885: symlink d2/da/d20/d21/d43/l12c 0 2024-02-10T00:00:35.775 INFO:tasks.workunit.client.1.smithi183.stdout:0/798: mkdir d14/d1d/d59/d71/dcb/d11d 0 2024-02-10T00:00:35.779 INFO:tasks.workunit.client.1.smithi183.stdout:2/886: dwrite d2/da/f11b [0,4194304] 0 2024-02-10T00:00:35.779 INFO:tasks.workunit.client.1.smithi183.stdout:2/887: dread - d2/da/d77/dc7/db5/fd9 zero size 2024-02-10T00:00:35.781 INFO:tasks.workunit.client.0.smithi164.stdout:4/448: symlink d2/d19/d16/d31/l9d 0 2024-02-10T00:00:35.782 INFO:tasks.workunit.client.0.smithi164.stdout:3/375: mknod d0/d1/d2/d19/d27/d5f/c71 0 2024-02-10T00:00:35.782 INFO:tasks.workunit.client.1.smithi183.stdout:4/828: truncate de/d14/d27/fe8 281548 0 2024-02-10T00:00:35.782 INFO:tasks.workunit.client.1.smithi183.stdout:1/709: write d0/d3/d7/d36/d7c/db1/fce [1510054,130299] 0 2024-02-10T00:00:35.784 INFO:tasks.workunit.client.0.smithi164.stdout:5/493: creat d7/d17/d3b/f9e x:0 0 0 2024-02-10T00:00:35.784 INFO:tasks.workunit.client.1.smithi183.stdout:6/697: unlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/ca1 0 2024-02-10T00:00:35.785 INFO:tasks.workunit.client.1.smithi183.stdout:7/723: unlink d0/d2/d50/dad/la2 0 2024-02-10T00:00:35.786 INFO:tasks.workunit.client.1.smithi183.stdout:0/799: creat d14/d1d/f11e x:0 0 0 2024-02-10T00:00:35.788 INFO:tasks.workunit.client.0.smithi164.stdout:1/366: symlink d1/d13/d80/l83 0 2024-02-10T00:00:35.789 INFO:tasks.workunit.client.0.smithi164.stdout:0/427: rename d6/d10/l33 to d6/d10/d4a/d60/d6c/l8a 0 2024-02-10T00:00:35.789 INFO:tasks.workunit.client.1.smithi183.stdout:8/837: dwrite d0/f52 [0,4194304] 0 2024-02-10T00:00:35.790 INFO:tasks.workunit.client.0.smithi164.stdout:3/376: mknod d0/d1/d3c/c72 0 2024-02-10T00:00:35.790 INFO:tasks.workunit.client.1.smithi183.stdout:8/838: chown d0/d10/l25 10 1 2024-02-10T00:00:35.790 INFO:tasks.workunit.client.0.smithi164.stdout:3/377: chown d0/d1/dd/f1f 7910 1 2024-02-10T00:00:35.792 INFO:tasks.workunit.client.1.smithi183.stdout:5/823: stat d4/dd/d31/d73/f98 0 2024-02-10T00:00:35.793 INFO:tasks.workunit.client.1.smithi183.stdout:4/829: creat de/d14/d1d/d2f/da2/d9c/f101 x:0 0 0 2024-02-10T00:00:35.794 INFO:tasks.workunit.client.1.smithi183.stdout:1/710: rename d0/d3/d29/l42 to d0/d3/d7/d3d/dcb/lfc 0 2024-02-10T00:00:35.794 INFO:tasks.workunit.client.0.smithi164.stdout:1/367: rename d1/d23/f7f to d1/d23/f84 0 2024-02-10T00:00:35.796 INFO:tasks.workunit.client.1.smithi183.stdout:8/839: symlink d0/d4e/d53/l104 0 2024-02-10T00:00:35.797 INFO:tasks.workunit.client.0.smithi164.stdout:4/449: rename d2/d2f/d37/d41/l6c to d2/d19/d16/d31/d7e/l9e 0 2024-02-10T00:00:35.797 INFO:tasks.workunit.client.0.smithi164.stdout:5/494: fsync d7/d17/d21/d23/f2d 0 2024-02-10T00:00:35.798 INFO:tasks.workunit.client.1.smithi183.stdout:5/824: mknod d4/d23/d3e/d80/d96/c111 0 2024-02-10T00:00:35.798 INFO:tasks.workunit.client.0.smithi164.stdout:3/378: creat d0/d1/d2/d19/f73 x:0 0 0 2024-02-10T00:00:35.800 INFO:tasks.workunit.client.1.smithi183.stdout:1/711: fdatasync d0/d3/d67/f96 0 2024-02-10T00:00:35.801 INFO:tasks.workunit.client.1.smithi183.stdout:1/712: readlink d0/d3/d67/l2e 0 2024-02-10T00:00:35.801 INFO:tasks.workunit.client.1.smithi183.stdout:1/713: dread - d0/d3c/ff9 zero size 2024-02-10T00:00:35.802 INFO:tasks.workunit.client.1.smithi183.stdout:5/825: mknod d4/d23/d3e/d80/c112 0 2024-02-10T00:00:35.803 INFO:tasks.workunit.client.0.smithi164.stdout:5/495: unlink d7/f62 0 2024-02-10T00:00:35.803 INFO:tasks.workunit.client.0.smithi164.stdout:1/368: getdents d1/d1a/d41/d18/d3a 0 2024-02-10T00:00:35.803 INFO:tasks.workunit.client.0.smithi164.stdout:1/369: readlink d1/d1a/d41/l12 0 2024-02-10T00:00:35.804 INFO:tasks.workunit.client.0.smithi164.stdout:1/370: write d1/d13/f19 [3554385,107708] 0 2024-02-10T00:00:35.805 INFO:tasks.workunit.client.1.smithi183.stdout:6/698: rename d2/d1a/d3a/c75 to d2/d1a/cd2 0 2024-02-10T00:00:35.807 INFO:tasks.workunit.client.0.smithi164.stdout:5/496: creat d7/d17/d3b/d43/f9f x:0 0 0 2024-02-10T00:00:35.807 INFO:tasks.workunit.client.1.smithi183.stdout:8/840: unlink d0/d3f/db2/c22 0 2024-02-10T00:00:35.808 INFO:tasks.workunit.client.1.smithi183.stdout:8/841: chown d0/d23/db1/cc6 177878 1 2024-02-10T00:00:35.809 INFO:tasks.workunit.client.0.smithi164.stdout:1/371: dwrite d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:35.811 INFO:tasks.workunit.client.1.smithi183.stdout:6/699: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/ld3 0 2024-02-10T00:00:35.811 INFO:tasks.workunit.client.1.smithi183.stdout:0/800: dread d14/d1d/d55/f5a [0,4194304] 0 2024-02-10T00:00:35.811 INFO:tasks.workunit.client.0.smithi164.stdout:1/372: write d1/d1a/d41/f5f [944321,89990] 0 2024-02-10T00:00:35.812 INFO:tasks.workunit.client.1.smithi183.stdout:8/842: read - d0/d23/df6/ff7 zero size 2024-02-10T00:00:35.813 INFO:tasks.workunit.client.0.smithi164.stdout:5/497: dwrite d7/d17/f3f [0,4194304] 0 2024-02-10T00:00:35.813 INFO:tasks.workunit.client.0.smithi164.stdout:3/379: link d0/d1/d2/d17/d37/d3f/d4e/d6d/f4b d0/d1/d3c/d3d/d6b/f74 0 2024-02-10T00:00:35.813 INFO:tasks.workunit.client.0.smithi164.stdout:4/450: truncate d2/d2f/d37/d41/d3d/f52 3220079 0 2024-02-10T00:00:35.813 INFO:tasks.workunit.client.0.smithi164.stdout:1/373: write d1/d1a/d41/f5f [1733115,96662] 0 2024-02-10T00:00:35.814 INFO:tasks.workunit.client.0.smithi164.stdout:4/451: chown d2/d5a/d94 2567 1 2024-02-10T00:00:35.814 INFO:tasks.workunit.client.1.smithi183.stdout:5/826: unlink d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f69 0 2024-02-10T00:00:35.815 INFO:tasks.workunit.client.0.smithi164.stdout:5/498: symlink d7/d17/d79/la0 0 2024-02-10T00:00:35.817 INFO:tasks.workunit.client.1.smithi183.stdout:0/801: creat d14/f11f x:0 0 0 2024-02-10T00:00:35.819 INFO:tasks.workunit.client.0.smithi164.stdout:4/452: truncate d2/d19/d16/d31/f4d 917569 0 2024-02-10T00:00:35.820 INFO:tasks.workunit.client.1.smithi183.stdout:5/827: truncate d4/d23/d2a/fd8 469154 0 2024-02-10T00:00:35.820 INFO:tasks.workunit.client.0.smithi164.stdout:1/374: creat d1/d1a/f85 x:0 0 0 2024-02-10T00:00:35.820 INFO:tasks.workunit.client.0.smithi164.stdout:4/453: write d2/d19/d16/d31/d4b/f8c [1636358,103775] 0 2024-02-10T00:00:35.821 INFO:tasks.workunit.client.1.smithi183.stdout:5/828: write d4/d23/d3e/d80/da1/f60 [8201358,47145] 0 2024-02-10T00:00:35.822 INFO:tasks.workunit.client.1.smithi183.stdout:6/700: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [0,4194304] 0 2024-02-10T00:00:35.822 INFO:tasks.workunit.client.0.smithi164.stdout:4/454: write d2/d19/f11 [1861204,103927] 0 2024-02-10T00:00:35.823 INFO:tasks.workunit.client.0.smithi164.stdout:4/455: stat d2/d19/d16/d31/d4b 0 2024-02-10T00:00:35.824 INFO:tasks.workunit.client.0.smithi164.stdout:9/449: dread d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:35.824 INFO:tasks.workunit.client.0.smithi164.stdout:1/375: rename d1/d1a/d75/l81 to d1/d13/d2b/l86 0 2024-02-10T00:00:35.825 INFO:tasks.workunit.client.0.smithi164.stdout:9/450: fsync d6/f35 0 2024-02-10T00:00:35.827 INFO:tasks.workunit.client.1.smithi183.stdout:6/701: dwrite d2/d1a/d25/f8e [0,4194304] 0 2024-02-10T00:00:35.828 INFO:tasks.workunit.client.1.smithi183.stdout:6/702: chown d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7f 223782 1 2024-02-10T00:00:35.828 INFO:tasks.workunit.client.0.smithi164.stdout:4/456: dwrite d2/d2f/d37/d41/d3d/f5c [0,4194304] 0 2024-02-10T00:00:35.829 INFO:tasks.workunit.client.0.smithi164.stdout:1/376: rename d1/c20 to d1/d1a/d41/d18/d33/c87 0 2024-02-10T00:00:35.832 INFO:tasks.workunit.client.0.smithi164.stdout:9/451: rename d6/de/d2b/d5b/d61/d76/d82/l48 to d6/de/d2b/d5b/l89 0 2024-02-10T00:00:35.832 INFO:tasks.workunit.client.0.smithi164.stdout:9/452: write d6/f1e [2814388,70210] 0 2024-02-10T00:00:35.833 INFO:tasks.workunit.client.0.smithi164.stdout:8/415: dread d2/d64/f61 [0,4194304] 0 2024-02-10T00:00:35.833 INFO:tasks.workunit.client.0.smithi164.stdout:9/453: dread - d6/de/d40/f56 zero size 2024-02-10T00:00:35.834 INFO:tasks.workunit.client.0.smithi164.stdout:4/457: mknod d2/d2f/d37/d41/d3d/d42/d5f/c9f 0 2024-02-10T00:00:35.835 INFO:tasks.workunit.client.0.smithi164.stdout:4/458: fsync d2/d2f/d37/d41/d3d/d42/d47/f80 0 2024-02-10T00:00:35.836 INFO:tasks.workunit.client.0.smithi164.stdout:4/459: write d2/d19/d16/d31/d57/f59 [3553503,19135] 0 2024-02-10T00:00:35.836 INFO:tasks.workunit.client.1.smithi183.stdout:6/703: symlink d2/d1a/d25/d3c/d31/d66/ld4 0 2024-02-10T00:00:35.837 INFO:tasks.workunit.client.0.smithi164.stdout:4/460: readlink d2/d19/l18 0 2024-02-10T00:00:35.837 INFO:tasks.workunit.client.0.smithi164.stdout:4/461: write d2/d2f/d37/d41/f95 [339594,65487] 0 2024-02-10T00:00:35.839 INFO:tasks.workunit.client.0.smithi164.stdout:7/500: sync 2024-02-10T00:00:35.840 INFO:tasks.workunit.client.1.smithi183.stdout:6/704: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fd5 x:0 0 0 2024-02-10T00:00:35.843 INFO:tasks.workunit.client.1.smithi183.stdout:1/714: sync 2024-02-10T00:00:35.843 INFO:tasks.workunit.client.0.smithi164.stdout:8/416: creat d2/d64/f7b x:0 0 0 2024-02-10T00:00:35.845 INFO:tasks.workunit.client.1.smithi183.stdout:8/843: dread d0/d3f/d94/fcb [0,4194304] 0 2024-02-10T00:00:35.845 INFO:tasks.workunit.client.1.smithi183.stdout:2/888: dread d2/d2c/f90 [0,4194304] 0 2024-02-10T00:00:35.845 INFO:tasks.workunit.client.0.smithi164.stdout:9/454: rename d6/de/f49 to d6/d1c/d24/d4f/f8a 0 2024-02-10T00:00:35.845 INFO:tasks.workunit.client.1.smithi183.stdout:6/705: truncate d2/d1a/d25/d3c/d31/d38/d6e/f97 925335 0 2024-02-10T00:00:35.846 INFO:tasks.workunit.client.1.smithi183.stdout:8/844: dread - d0/d31/fe8 zero size 2024-02-10T00:00:35.846 INFO:tasks.workunit.client.0.smithi164.stdout:4/462: creat d2/d2f/d37/d41/d3d/fa0 x:0 0 0 2024-02-10T00:00:35.848 INFO:tasks.workunit.client.1.smithi183.stdout:1/715: dwrite d0/d3a/f7a [0,4194304] 0 2024-02-10T00:00:35.851 INFO:tasks.workunit.client.1.smithi183.stdout:8/845: dwrite d0/d45/fa5 [0,4194304] 0 2024-02-10T00:00:35.852 INFO:tasks.workunit.client.1.smithi183.stdout:8/846: chown d0/d4e/d53/c8a 707 1 2024-02-10T00:00:35.853 INFO:tasks.workunit.client.0.smithi164.stdout:8/417: creat d2/d64/d54/f7c x:0 0 0 2024-02-10T00:00:35.854 INFO:tasks.workunit.client.0.smithi164.stdout:8/418: fdatasync d2/d64/d31/d32/d58/f79 0 2024-02-10T00:00:35.854 INFO:tasks.workunit.client.0.smithi164.stdout:8/419: chown d2/lf 19877 1 2024-02-10T00:00:35.855 INFO:tasks.workunit.client.0.smithi164.stdout:7/501: creat d3/d11/d39/d44/d48/fa4 x:0 0 0 2024-02-10T00:00:35.856 INFO:tasks.workunit.client.0.smithi164.stdout:8/420: fdatasync d2/d64/d31/d32/d4d/f6b 0 2024-02-10T00:00:35.857 INFO:tasks.workunit.client.0.smithi164.stdout:9/455: dwrite d6/d1c/d24/f33 [4194304,4194304] 0 2024-02-10T00:00:35.859 INFO:tasks.workunit.client.0.smithi164.stdout:4/463: symlink d2/d19/d16/d31/la1 0 2024-02-10T00:00:35.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/421: fsync d2/f39 0 2024-02-10T00:00:35.862 INFO:tasks.workunit.client.1.smithi183.stdout:8/847: unlink d0/d3f/db2/d24/f59 0 2024-02-10T00:00:35.863 INFO:tasks.workunit.client.1.smithi183.stdout:8/848: chown d0/d3f/db2/de9/lcc 481550220 1 2024-02-10T00:00:35.866 INFO:tasks.workunit.client.1.smithi183.stdout:2/889: getdents d2/d2c/dba/df0/dbe 0 2024-02-10T00:00:35.867 INFO:tasks.workunit.client.1.smithi183.stdout:1/716: link d0/fc5 d0/d3a/ddb/ffd 0 2024-02-10T00:00:35.867 INFO:tasks.workunit.client.1.smithi183.stdout:8/849: symlink d0/d23/l105 0 2024-02-10T00:00:35.868 INFO:tasks.workunit.client.0.smithi164.stdout:9/456: dwrite f2 [4194304,4194304] 0 2024-02-10T00:00:35.871 INFO:tasks.workunit.client.1.smithi183.stdout:1/717: dwrite d0/f4b [0,4194304] 0 2024-02-10T00:00:35.873 INFO:tasks.workunit.client.1.smithi183.stdout:8/850: link d0/d4e/l60 d0/d4e/d6b/l106 0 2024-02-10T00:00:35.876 INFO:tasks.workunit.client.1.smithi183.stdout:8/851: symlink d0/d31/db8/l107 0 2024-02-10T00:00:35.879 INFO:tasks.workunit.client.1.smithi183.stdout:8/852: rename d0/d45/d46 to d0/d31/d108 0 2024-02-10T00:00:35.883 INFO:tasks.workunit.client.1.smithi183.stdout:8/853: dread d0/d31/d108/d81/fa7 [0,4194304] 0 2024-02-10T00:00:35.884 INFO:tasks.workunit.client.1.smithi183.stdout:2/890: read d2/da/d19/fb4 [867986,73565] 0 2024-02-10T00:00:35.884 INFO:tasks.workunit.client.1.smithi183.stdout:2/891: chown d2/da/d19/cad 0 1 2024-02-10T00:00:35.885 INFO:tasks.workunit.client.1.smithi183.stdout:8/854: creat d0/d31/f109 x:0 0 0 2024-02-10T00:00:35.887 INFO:tasks.workunit.client.1.smithi183.stdout:2/892: creat d2/d2c/dab/d99/ddf/d105/f12d x:0 0 0 2024-02-10T00:00:35.887 INFO:tasks.workunit.client.1.smithi183.stdout:2/893: fdatasync d2/d2c/dab/d99/f122 0 2024-02-10T00:00:35.888 INFO:tasks.workunit.client.1.smithi183.stdout:8/855: mknod d0/d3f/d94/c10a 0 2024-02-10T00:00:35.891 INFO:tasks.workunit.client.1.smithi183.stdout:2/894: dwrite d2/d2c/dab/f95 [4194304,4194304] 0 2024-02-10T00:00:35.892 INFO:tasks.workunit.client.1.smithi183.stdout:2/895: stat d2/da/d20/d21/d43/d58 0 2024-02-10T00:00:35.893 INFO:tasks.workunit.client.1.smithi183.stdout:2/896: dread - d2/d2c/d104/f109 zero size 2024-02-10T00:00:35.895 INFO:tasks.workunit.client.1.smithi183.stdout:2/897: write d2/f3e [1619147,76015] 0 2024-02-10T00:00:35.897 INFO:tasks.workunit.client.1.smithi183.stdout:2/898: mknod d2/d2c/d2f/d60/d8d/c12e 0 2024-02-10T00:00:35.899 INFO:tasks.workunit.client.1.smithi183.stdout:2/899: mkdir d2/d2c/d2f/d72/d12f 0 2024-02-10T00:00:35.900 INFO:tasks.workunit.client.1.smithi183.stdout:2/900: chown d2/d2c/d2f/d60/d8d/la6 32649015 1 2024-02-10T00:00:35.901 INFO:tasks.workunit.client.1.smithi183.stdout:7/724: fdatasync d0/d11/f36 0 2024-02-10T00:00:35.903 INFO:tasks.workunit.client.1.smithi183.stdout:2/901: creat d2/d2c/d2f/d60/d8d/d9c/dd1/f130 x:0 0 0 2024-02-10T00:00:35.904 INFO:tasks.workunit.client.1.smithi183.stdout:2/902: chown d2/d2c/dab/d99/ddf 108657 1 2024-02-10T00:00:35.905 INFO:tasks.workunit.client.0.smithi164.stdout:6/525: truncate d0/d6/d12/f91 1075129 0 2024-02-10T00:00:35.906 INFO:tasks.workunit.client.0.smithi164.stdout:8/422: dread d2/d64/d31/d32/d4d/f6b [0,4194304] 0 2024-02-10T00:00:35.906 INFO:tasks.workunit.client.1.smithi183.stdout:7/725: creat d0/fe1 x:0 0 0 2024-02-10T00:00:35.907 INFO:tasks.workunit.client.1.smithi183.stdout:2/903: symlink d2/d2c/d2f/d60/d8d/l131 0 2024-02-10T00:00:35.908 INFO:tasks.workunit.client.1.smithi183.stdout:2/904: chown d2/da/f7d 799442 1 2024-02-10T00:00:35.909 INFO:tasks.workunit.client.1.smithi183.stdout:2/905: write d2/d2c/dba/fda [110763,61177] 0 2024-02-10T00:00:35.909 INFO:tasks.workunit.client.1.smithi183.stdout:7/726: symlink d0/d11/d2f/d64/le2 0 2024-02-10T00:00:35.910 INFO:tasks.workunit.client.0.smithi164.stdout:0/428: readlink d6/d10/d4a/d60/d6c/l8a 0 2024-02-10T00:00:35.910 INFO:tasks.workunit.client.0.smithi164.stdout:2/463: dwrite d3/d32/d4e/d27/f28 [0,4194304] 0 2024-02-10T00:00:35.914 INFO:tasks.workunit.client.1.smithi183.stdout:3/671: truncate d7/db/d2a/d1c/f1e 1484665 0 2024-02-10T00:00:35.914 INFO:tasks.workunit.client.0.smithi164.stdout:6/526: symlink d0/d6/d12/d57/lad 0 2024-02-10T00:00:35.915 INFO:tasks.workunit.client.0.smithi164.stdout:8/423: mkdir d2/d64/d7d 0 2024-02-10T00:00:35.916 INFO:tasks.workunit.client.0.smithi164.stdout:8/424: chown d2/d64/f3b 747 1 2024-02-10T00:00:35.917 INFO:tasks.workunit.client.1.smithi183.stdout:4/830: rmdir de/d14/d27 39 2024-02-10T00:00:35.917 INFO:tasks.workunit.client.0.smithi164.stdout:0/429: symlink d6/d7/d14/l8b 0 2024-02-10T00:00:35.921 INFO:tasks.workunit.client.0.smithi164.stdout:5/499: dread d7/f1d [4194304,4194304] 0 2024-02-10T00:00:35.922 INFO:tasks.workunit.client.0.smithi164.stdout:5/500: dread - d7/d17/d21/d23/f5f zero size 2024-02-10T00:00:35.922 INFO:tasks.workunit.client.1.smithi183.stdout:7/727: dread d0/d2/d50/dad/f51 [0,4194304] 0 2024-02-10T00:00:35.923 INFO:tasks.workunit.client.1.smithi183.stdout:9/785: dwrite d0/d3/d14/d74/da8/fba [0,4194304] 0 2024-02-10T00:00:35.924 INFO:tasks.workunit.client.1.smithi183.stdout:9/786: fdatasync d0/d3/d14/d3c/d7b/f87 0 2024-02-10T00:00:35.925 INFO:tasks.workunit.client.0.smithi164.stdout:2/464: rmdir d3/d24/d5b 39 2024-02-10T00:00:35.926 INFO:tasks.workunit.client.1.smithi183.stdout:3/672: mkdir d7/db/d2a/d4d/d63/dc4 0 2024-02-10T00:00:35.928 INFO:tasks.workunit.client.0.smithi164.stdout:3/380: write d0/d1/d3c/f63 [4961564,83953] 0 2024-02-10T00:00:35.929 INFO:tasks.workunit.client.1.smithi183.stdout:7/728: symlink d0/d11/d88/le3 0 2024-02-10T00:00:35.930 INFO:tasks.workunit.client.1.smithi183.stdout:9/787: mkdir d0/d3/d14/d1c/d2d/d4f/db8/de7/d100 0 2024-02-10T00:00:35.931 INFO:tasks.workunit.client.0.smithi164.stdout:6/527: link d0/d6/d12/d14/f61 d0/d2b/d3a/d3d/d42/d5d/d79/fae 0 2024-02-10T00:00:35.932 INFO:tasks.workunit.client.1.smithi183.stdout:9/788: write d0/d3/d14/d1c/f45 [157,956] 0 2024-02-10T00:00:35.932 INFO:tasks.workunit.client.1.smithi183.stdout:3/673: truncate d7/db/d2a/d33/f36 2433649 0 2024-02-10T00:00:35.932 INFO:tasks.workunit.client.1.smithi183.stdout:3/674: chown d7/db/d2a/da5 6272314 1 2024-02-10T00:00:35.936 INFO:tasks.workunit.client.0.smithi164.stdout:8/425: symlink d2/d64/d7d/l7e 0 2024-02-10T00:00:35.936 INFO:tasks.workunit.client.0.smithi164.stdout:4/464: dread d2/d2f/d37/d41/f95 [0,4194304] 0 2024-02-10T00:00:35.937 INFO:tasks.workunit.client.1.smithi183.stdout:3/675: dwrite d7/db/d2a/d4d/d63/f81 [0,4194304] 0 2024-02-10T00:00:35.938 INFO:tasks.workunit.client.1.smithi183.stdout:3/676: write d7/db/d2a/f88 [672632,75171] 0 2024-02-10T00:00:35.940 INFO:tasks.workunit.client.1.smithi183.stdout:6/706: rmdir d2/d1a/d3a 39 2024-02-10T00:00:35.942 INFO:tasks.workunit.client.0.smithi164.stdout:9/457: readlink d6/de/d2b/d5b/l89 0 2024-02-10T00:00:35.945 INFO:tasks.workunit.client.0.smithi164.stdout:7/502: truncate d3/f9 4457376 0 2024-02-10T00:00:35.946 INFO:tasks.workunit.client.0.smithi164.stdout:1/377: dwrite d1/d13/d2b/d52/d56/f68 [0,4194304] 0 2024-02-10T00:00:35.948 INFO:tasks.workunit.client.0.smithi164.stdout:3/381: mknod d0/d1/d3c/d3d/d51/c75 0 2024-02-10T00:00:35.953 INFO:tasks.workunit.client.1.smithi183.stdout:1/718: truncate d0/d3/d67/f94 2028246 0 2024-02-10T00:00:35.954 INFO:tasks.workunit.client.0.smithi164.stdout:5/501: rename d7/d17/d21/d24/f4c to d7/d17/d21/d23/d37/fa1 0 2024-02-10T00:00:35.954 INFO:tasks.workunit.client.0.smithi164.stdout:1/378: truncate d1/d13/f47 2083913 0 2024-02-10T00:00:35.955 INFO:tasks.workunit.client.0.smithi164.stdout:5/502: stat d7/d17/d21/l2f 0 2024-02-10T00:00:35.955 INFO:tasks.workunit.client.0.smithi164.stdout:3/382: readlink d0/d1/d2/d17/d37/d3f/l4c 0 2024-02-10T00:00:35.956 INFO:tasks.workunit.client.0.smithi164.stdout:8/426: mknod d2/d64/d65/c7f 0 2024-02-10T00:00:35.958 INFO:tasks.workunit.client.0.smithi164.stdout:8/427: read d2/f7 [612453,30467] 0 2024-02-10T00:00:35.959 INFO:tasks.workunit.client.1.smithi183.stdout:3/677: mknod d7/db/d2a/d1c/cc5 0 2024-02-10T00:00:35.960 INFO:tasks.workunit.client.0.smithi164.stdout:7/503: rename d3/d11/d39/d44/d9a/c9f to d3/d28/d45/ca5 0 2024-02-10T00:00:35.960 INFO:tasks.workunit.client.0.smithi164.stdout:5/503: dwrite d7/d17/d21/d23/d37/d36/f6d [0,4194304] 0 2024-02-10T00:00:35.961 INFO:tasks.workunit.client.1.smithi183.stdout:0/802: stat d14/d7a/f7e 0 2024-02-10T00:00:35.961 INFO:tasks.workunit.client.0.smithi164.stdout:6/528: creat d0/d3b/faf x:0 0 0 2024-02-10T00:00:35.961 INFO:tasks.workunit.client.1.smithi183.stdout:9/789: getdents d0/d3/d14/d1c/d2d/d4f/da4/dda 0 2024-02-10T00:00:35.962 INFO:tasks.workunit.client.0.smithi164.stdout:6/529: read - d0/d6/d12/d14/f8d zero size 2024-02-10T00:00:35.962 INFO:tasks.workunit.client.1.smithi183.stdout:6/707: link d2/d1a/d25/d3c/d31/d38/d6e/c58 d2/d1a/d25/d3c/d31/cd6 0 2024-02-10T00:00:35.963 INFO:tasks.workunit.client.0.smithi164.stdout:3/383: unlink d0/l9 0 2024-02-10T00:00:35.963 INFO:tasks.workunit.client.0.smithi164.stdout:1/379: symlink d1/l88 0 2024-02-10T00:00:35.963 INFO:tasks.workunit.client.0.smithi164.stdout:3/384: chown d0/d1/dd/l61 245630 1 2024-02-10T00:00:35.966 INFO:tasks.workunit.client.1.smithi183.stdout:9/790: dwrite d0/d3/d14/d1c/d2d/fd5 [0,4194304] 0 2024-02-10T00:00:35.967 INFO:tasks.workunit.client.1.smithi183.stdout:0/803: mknod d14/d1d/d96/c120 0 2024-02-10T00:00:35.967 INFO:tasks.workunit.client.0.smithi164.stdout:8/428: rename d2/d64/d31 to d2/d64/d65/d80 0 2024-02-10T00:00:35.967 INFO:tasks.workunit.client.0.smithi164.stdout:6/530: dwrite d0/d6/d12/d45/f65 [0,4194304] 0 2024-02-10T00:00:35.968 INFO:tasks.workunit.client.0.smithi164.stdout:1/380: dread d1/d1a/d41/fb [0,4194304] 0 2024-02-10T00:00:35.968 INFO:tasks.workunit.client.0.smithi164.stdout:7/504: rmdir d3/d5/d59 39 2024-02-10T00:00:35.968 INFO:tasks.workunit.client.1.smithi183.stdout:9/791: fsync d0/d3/d14/d1c/d2d/d4f/d79/f80 0 2024-02-10T00:00:35.969 INFO:tasks.workunit.client.1.smithi183.stdout:3/678: getdents d7/db/d2a/d33/d59/daa 0 2024-02-10T00:00:35.970 INFO:tasks.workunit.client.0.smithi164.stdout:5/504: rmdir d7/d17/d79 39 2024-02-10T00:00:35.970 INFO:tasks.workunit.client.1.smithi183.stdout:3/679: chown d7/db/d2a/d2d/lad 0 1 2024-02-10T00:00:35.971 INFO:tasks.workunit.client.0.smithi164.stdout:6/531: dwrite d0/d2b/d3a/f53 [4194304,4194304] 0 2024-02-10T00:00:35.973 INFO:tasks.workunit.client.1.smithi183.stdout:9/792: dwrite d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:35.975 INFO:tasks.workunit.client.0.smithi164.stdout:3/385: symlink d0/d1/dd/l76 0 2024-02-10T00:00:35.975 INFO:tasks.workunit.client.1.smithi183.stdout:9/793: chown d0/d3/d14/d1c/d2d/d4f/d89/lb9 203345 1 2024-02-10T00:00:35.975 INFO:tasks.workunit.client.1.smithi183.stdout:0/804: rename d14/d7a to d14/d3e/d5f/daa/ddd/d121 0 2024-02-10T00:00:35.978 INFO:tasks.workunit.client.0.smithi164.stdout:3/386: dwrite d0/f43 [0,4194304] 0 2024-02-10T00:00:35.978 INFO:tasks.workunit.client.0.smithi164.stdout:1/381: rename d1/d1a/d41/d18/d33/f4d to d1/d64/f89 0 2024-02-10T00:00:35.979 INFO:tasks.workunit.client.0.smithi164.stdout:1/382: fdatasync d1/d1a/f22 0 2024-02-10T00:00:35.980 INFO:tasks.workunit.client.0.smithi164.stdout:5/505: creat d7/d17/d69/fa2 x:0 0 0 2024-02-10T00:00:35.980 INFO:tasks.workunit.client.0.smithi164.stdout:1/383: dread - d1/d13/f66 zero size 2024-02-10T00:00:35.984 INFO:tasks.workunit.client.0.smithi164.stdout:7/505: mknod d3/d5/d59/ca6 0 2024-02-10T00:00:35.988 INFO:tasks.workunit.client.1.smithi183.stdout:3/680: fsync d7/db/d2a/f88 0 2024-02-10T00:00:35.989 INFO:tasks.workunit.client.0.smithi164.stdout:7/506: mkdir d3/d26/da7 0 2024-02-10T00:00:35.991 INFO:tasks.workunit.client.0.smithi164.stdout:5/506: creat d7/d17/d21/d24/fa3 x:0 0 0 2024-02-10T00:00:35.991 INFO:tasks.workunit.client.1.smithi183.stdout:8/856: write d0/d3f/db2/d24/f32 [702612,35736] 0 2024-02-10T00:00:35.993 INFO:tasks.workunit.client.0.smithi164.stdout:7/507: dwrite d3/d26/f31 [0,4194304] 0 2024-02-10T00:00:35.999 INFO:tasks.workunit.client.1.smithi183.stdout:2/906: dwrite d2/da/d20/d21/df2/f106 [0,4194304] 0 2024-02-10T00:00:36.000 INFO:tasks.workunit.client.0.smithi164.stdout:7/508: dread d3/d28/d45/d4b/f6d [0,4194304] 0 2024-02-10T00:00:36.001 INFO:tasks.workunit.client.1.smithi183.stdout:8/857: mknod d0/c10b 0 2024-02-10T00:00:36.001 INFO:tasks.workunit.client.1.smithi183.stdout:7/729: dread d0/d2/d4/d8/f13 [0,4194304] 0 2024-02-10T00:00:36.003 INFO:tasks.workunit.client.0.smithi164.stdout:7/509: creat d3/d26/d67/d98/fa8 x:0 0 0 2024-02-10T00:00:36.003 INFO:tasks.workunit.client.1.smithi183.stdout:2/907: mkdir d2/d2c/dab/d132 0 2024-02-10T00:00:36.005 INFO:tasks.workunit.client.0.smithi164.stdout:7/510: getdents d3/d11/d39/d44/d48/d50 0 2024-02-10T00:00:36.006 INFO:tasks.workunit.client.0.smithi164.stdout:7/511: write d3/d11/d39/d3a/f66 [3690240,119520] 0 2024-02-10T00:00:36.011 INFO:tasks.workunit.client.0.smithi164.stdout:7/512: dwrite d3/d11/d39/d44/d48/d50/d92/f99 [0,4194304] 0 2024-02-10T00:00:36.012 INFO:tasks.workunit.client.1.smithi183.stdout:4/831: truncate de/d14/da4/fbf 1246813 0 2024-02-10T00:00:36.012 INFO:tasks.workunit.client.0.smithi164.stdout:7/513: write d3/d28/d51/f64 [5482371,16780] 0 2024-02-10T00:00:36.013 INFO:tasks.workunit.client.1.smithi183.stdout:4/832: fsync de/d19/d20/de6/fbe 0 2024-02-10T00:00:36.016 INFO:tasks.workunit.client.0.smithi164.stdout:7/514: dwrite d3/d11/f82 [0,4194304] 0 2024-02-10T00:00:36.016 INFO:tasks.workunit.client.1.smithi183.stdout:5/829: truncate d4/d23/d2a/fd8 746167 0 2024-02-10T00:00:36.018 INFO:tasks.workunit.client.1.smithi183.stdout:4/833: write de/d14/d27/d2e/f74 [34393,35637] 0 2024-02-10T00:00:36.019 INFO:tasks.workunit.client.0.smithi164.stdout:6/532: fsync d0/d6/f10 0 2024-02-10T00:00:36.020 INFO:tasks.workunit.client.0.smithi164.stdout:7/515: creat d3/d28/fa9 x:0 0 0 2024-02-10T00:00:36.022 INFO:tasks.workunit.client.1.smithi183.stdout:5/830: dwrite d4/d74/f7e [4194304,4194304] 0 2024-02-10T00:00:36.023 INFO:tasks.workunit.client.0.smithi164.stdout:0/430: truncate d6/d7/f6b 987244 0 2024-02-10T00:00:36.025 INFO:tasks.workunit.client.0.smithi164.stdout:6/533: truncate d0/d6/fa1 635441 0 2024-02-10T00:00:36.027 INFO:tasks.workunit.client.0.smithi164.stdout:6/534: creat d0/d6/d81/fb0 x:0 0 0 2024-02-10T00:00:36.028 INFO:tasks.workunit.client.0.smithi164.stdout:0/431: rmdir d6/d3a/d87 0 2024-02-10T00:00:36.029 INFO:tasks.workunit.client.0.smithi164.stdout:0/432: readlink d6/d7/d14/l16 0 2024-02-10T00:00:36.029 INFO:tasks.workunit.client.0.smithi164.stdout:6/535: creat d0/d2b/d3a/d3d/d42/d5d/d79/fb1 x:0 0 0 2024-02-10T00:00:36.030 INFO:tasks.workunit.client.0.smithi164.stdout:6/536: chown d0/d6/f9b 52333896 1 2024-02-10T00:00:36.031 INFO:tasks.workunit.client.0.smithi164.stdout:0/433: mknod d6/d10/d18/d2d/c8c 0 2024-02-10T00:00:36.032 INFO:tasks.workunit.client.0.smithi164.stdout:0/434: mknod d6/d10/d66/c8d 0 2024-02-10T00:00:36.034 INFO:tasks.workunit.client.0.smithi164.stdout:6/537: dwrite d0/f6e [4194304,4194304] 0 2024-02-10T00:00:36.036 INFO:tasks.workunit.client.0.smithi164.stdout:0/435: dread f3 [4194304,4194304] 0 2024-02-10T00:00:36.037 INFO:tasks.workunit.client.0.smithi164.stdout:6/538: mknod d0/d6/d12/d14/d4b/cb2 0 2024-02-10T00:00:36.039 INFO:tasks.workunit.client.1.smithi183.stdout:4/834: dread de/d19/d1c/fc1 [0,4194304] 0 2024-02-10T00:00:36.040 INFO:tasks.workunit.client.0.smithi164.stdout:0/436: rmdir d6/d10/d18/d1c 39 2024-02-10T00:00:36.040 INFO:tasks.workunit.client.0.smithi164.stdout:0/437: readlink d6/d3a/l72 0 2024-02-10T00:00:36.040 INFO:tasks.workunit.client.1.smithi183.stdout:4/835: readlink de/d19/l38 0 2024-02-10T00:00:36.042 INFO:tasks.workunit.client.0.smithi164.stdout:0/438: creat d6/d3a/d52/f8e x:0 0 0 2024-02-10T00:00:36.043 INFO:tasks.workunit.client.1.smithi183.stdout:4/836: creat de/d14/d1d/d2f/da2/d9c/df5/f102 x:0 0 0 2024-02-10T00:00:36.045 INFO:tasks.workunit.client.1.smithi183.stdout:4/837: symlink de/d14/d1d/l103 0 2024-02-10T00:00:36.045 INFO:tasks.workunit.client.1.smithi183.stdout:4/838: readlink de/d14/d1d/l103 0 2024-02-10T00:00:36.045 INFO:tasks.workunit.client.0.smithi164.stdout:0/439: rename d6/d10/d18/f5b to d6/d10/d18/d2d/f8f 0 2024-02-10T00:00:36.047 INFO:tasks.workunit.client.1.smithi183.stdout:1/719: write d0/d3/d7/f8d [254458,49445] 0 2024-02-10T00:00:36.047 INFO:tasks.workunit.client.1.smithi183.stdout:6/708: write d2/d1a/d25/d3c/d31/d38/d3f/f4d [859439,53730] 0 2024-02-10T00:00:36.048 INFO:tasks.workunit.client.0.smithi164.stdout:0/440: dread d6/d10/d18/d2d/f84 [0,4194304] 0 2024-02-10T00:00:36.048 INFO:tasks.workunit.client.1.smithi183.stdout:4/839: mknod de/d14/d27/d2e/c104 0 2024-02-10T00:00:36.049 INFO:tasks.workunit.client.1.smithi183.stdout:4/840: readlink de/d19/l8a 0 2024-02-10T00:00:36.050 INFO:tasks.workunit.client.1.smithi183.stdout:1/720: unlink d0/d3c/dc9/d86/lcf 0 2024-02-10T00:00:36.051 INFO:tasks.workunit.client.0.smithi164.stdout:0/441: mkdir d6/d10/d18/d2d/d35/d44/d90 0 2024-02-10T00:00:36.051 INFO:tasks.workunit.client.0.smithi164.stdout:0/442: chown d6/d10/d4a/d60 3101867 1 2024-02-10T00:00:36.051 INFO:tasks.workunit.client.1.smithi183.stdout:1/721: chown d0/d3c/ff9 160447 1 2024-02-10T00:00:36.053 INFO:tasks.workunit.client.0.smithi164.stdout:0/443: dread d6/d10/f61 [0,4194304] 0 2024-02-10T00:00:36.055 INFO:tasks.workunit.client.1.smithi183.stdout:4/841: link de/fd8 de/d14/d27/f105 0 2024-02-10T00:00:36.055 INFO:tasks.workunit.client.0.smithi164.stdout:0/444: creat d6/d10/d18/d2d/d35/d44/d49/f91 x:0 0 0 2024-02-10T00:00:36.055 INFO:tasks.workunit.client.0.smithi164.stdout:0/445: stat f1 0 2024-02-10T00:00:36.056 INFO:tasks.workunit.client.1.smithi183.stdout:6/709: truncate d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 2899501 0 2024-02-10T00:00:36.056 INFO:tasks.workunit.client.1.smithi183.stdout:1/722: dwrite d0/d3/d7/d3d/fac [0,4194304] 0 2024-02-10T00:00:36.057 INFO:tasks.workunit.client.1.smithi183.stdout:6/710: write d2/d1a/fbb [724115,54533] 0 2024-02-10T00:00:36.060 INFO:tasks.workunit.client.1.smithi183.stdout:1/723: rename d0/d3/d7/d36 to d0/d3/d67/d7b/dfe 0 2024-02-10T00:00:36.065 INFO:tasks.workunit.client.1.smithi183.stdout:1/724: unlink d0/d3/d67/d7b/dfe/l8c 0 2024-02-10T00:00:36.068 INFO:tasks.workunit.client.1.smithi183.stdout:1/725: dwrite d0/d3/d67/d7b/f98 [0,4194304] 0 2024-02-10T00:00:36.070 INFO:tasks.workunit.client.1.smithi183.stdout:1/726: write d0/d3c/dc9/f28 [8432111,84598] 0 2024-02-10T00:00:36.073 INFO:tasks.workunit.client.1.smithi183.stdout:1/727: creat d0/d3/d7/d3d/d60/d89/fff x:0 0 0 2024-02-10T00:00:36.074 INFO:tasks.workunit.client.0.smithi164.stdout:5/507: sync 2024-02-10T00:00:36.074 INFO:tasks.workunit.client.0.smithi164.stdout:3/387: sync 2024-02-10T00:00:36.074 INFO:tasks.workunit.client.0.smithi164.stdout:2/465: truncate d3/d32/d4e/d27/f28 1541969 0 2024-02-10T00:00:36.074 INFO:tasks.workunit.client.0.smithi164.stdout:2/466: chown d3 2 1 2024-02-10T00:00:36.075 INFO:tasks.workunit.client.0.smithi164.stdout:5/508: chown d7/d17/d21/d23/d37/fa1 1 1 2024-02-10T00:00:36.075 INFO:tasks.workunit.client.0.smithi164.stdout:9/458: dread d6/de/d22/f51 [0,4194304] 0 2024-02-10T00:00:36.076 INFO:tasks.workunit.client.1.smithi183.stdout:1/728: mkdir d0/d3/d67/d7b/dfe/d7c/db1/d100 0 2024-02-10T00:00:36.079 INFO:tasks.workunit.client.0.smithi164.stdout:2/467: creat d3/d26/d56/fa8 x:0 0 0 2024-02-10T00:00:36.079 INFO:tasks.workunit.client.0.smithi164.stdout:3/388: creat d0/d1/d3c/d3d/d6b/f77 x:0 0 0 2024-02-10T00:00:36.080 INFO:tasks.workunit.client.1.smithi183.stdout:1/729: dwrite d0/d3/f12 [0,4194304] 0 2024-02-10T00:00:36.081 INFO:tasks.workunit.client.1.smithi183.stdout:1/730: chown d0/d3/d7/d3d/d60/c79 416 1 2024-02-10T00:00:36.081 INFO:tasks.workunit.client.0.smithi164.stdout:9/459: dwrite d6/d1c/d24/f2a [0,4194304] 0 2024-02-10T00:00:36.085 INFO:tasks.workunit.client.1.smithi183.stdout:1/731: mknod d0/d3a/c101 0 2024-02-10T00:00:36.085 INFO:tasks.workunit.client.1.smithi183.stdout:7/730: sync 2024-02-10T00:00:36.086 INFO:tasks.workunit.client.0.smithi164.stdout:2/468: dwrite d3/d32/d4e/f5e [0,4194304] 0 2024-02-10T00:00:36.086 INFO:tasks.workunit.client.0.smithi164.stdout:3/389: mknod d0/d1/d2/d19/d27/d5f/c78 0 2024-02-10T00:00:36.086 INFO:tasks.workunit.client.0.smithi164.stdout:3/390: readlink d0/d1/dd/l70 0 2024-02-10T00:00:36.086 INFO:tasks.workunit.client.0.smithi164.stdout:2/469: chown d3/d32/c3c 3 1 2024-02-10T00:00:36.087 INFO:tasks.workunit.client.0.smithi164.stdout:2/470: read - d3/da6/d7a/d8e/d36/d54/f9f zero size 2024-02-10T00:00:36.088 INFO:tasks.workunit.client.0.smithi164.stdout:9/460: rename d6/d1c to d6/d41/d8b 0 2024-02-10T00:00:36.088 INFO:tasks.workunit.client.0.smithi164.stdout:2/471: dread - d3/da6/d7a/d8e/d36/f96 zero size 2024-02-10T00:00:36.088 INFO:tasks.workunit.client.1.smithi183.stdout:3/681: dread d7/f55 [0,4194304] 0 2024-02-10T00:00:36.089 INFO:tasks.workunit.client.1.smithi183.stdout:7/731: dread d0/d2/d3/f90 [0,4194304] 0 2024-02-10T00:00:36.090 INFO:tasks.workunit.client.1.smithi183.stdout:1/732: dwrite d0/d3/f2d [8388608,4194304] 0 2024-02-10T00:00:36.093 INFO:tasks.workunit.client.0.smithi164.stdout:3/391: chown d0/d1/d3c/d3d/d51/l23 50571591 1 2024-02-10T00:00:36.093 INFO:tasks.workunit.client.0.smithi164.stdout:3/392: dread - d0/d1/d2/d19/f73 zero size 2024-02-10T00:00:36.094 INFO:tasks.workunit.client.0.smithi164.stdout:3/393: dread - d0/d1/d3c/d3d/d6b/f74 zero size 2024-02-10T00:00:36.097 INFO:tasks.workunit.client.0.smithi164.stdout:2/472: mknod d3/da6/d7a/d8e/d88/ca9 0 2024-02-10T00:00:36.097 INFO:tasks.workunit.client.1.smithi183.stdout:3/682: unlink d7/db/d2a/d4d/d63/f81 0 2024-02-10T00:00:36.098 INFO:tasks.workunit.client.1.smithi183.stdout:0/805: write d14/d1d/d55/f110 [265491,64664] 0 2024-02-10T00:00:36.099 INFO:tasks.workunit.client.1.smithi183.stdout:1/733: creat d0/d3/da9/f102 x:0 0 0 2024-02-10T00:00:36.099 INFO:tasks.workunit.client.0.smithi164.stdout:9/461: rename d6/de/d22/l64 to d6/de/d40/l8c 0 2024-02-10T00:00:36.101 INFO:tasks.workunit.client.1.smithi183.stdout:7/732: mkdir d0/d11/dc3/de4 0 2024-02-10T00:00:36.101 INFO:tasks.workunit.client.1.smithi183.stdout:7/733: fdatasync d0/d2/d4/d8/fd9 0 2024-02-10T00:00:36.104 INFO:tasks.workunit.client.0.smithi164.stdout:4/465: dwrite d2/d19/d16/d31/f4d [0,4194304] 0 2024-02-10T00:00:36.104 INFO:tasks.workunit.client.0.smithi164.stdout:7/516: dread d3/d11/d39/d44/d6f/f9e [0,4194304] 0 2024-02-10T00:00:36.106 INFO:tasks.workunit.client.1.smithi183.stdout:1/734: symlink d0/d3/d7/d3d/d60/d89/l103 0 2024-02-10T00:00:36.107 INFO:tasks.workunit.client.0.smithi164.stdout:2/473: symlink d3/d26/d56/laa 0 2024-02-10T00:00:36.108 INFO:tasks.workunit.client.0.smithi164.stdout:5/509: dread d7/d17/d21/d23/d5a/d68/f7c [0,4194304] 0 2024-02-10T00:00:36.109 INFO:tasks.workunit.client.1.smithi183.stdout:0/806: rename d14/d1d/ff4 to d14/d43/f122 0 2024-02-10T00:00:36.110 INFO:tasks.workunit.client.0.smithi164.stdout:4/466: dwrite d2/d19/d16/d31/f74 [0,4194304] 0 2024-02-10T00:00:36.111 INFO:tasks.workunit.client.1.smithi183.stdout:1/735: dwrite d0/d3/d67/d70/fb7 [0,4194304] 0 2024-02-10T00:00:36.111 INFO:tasks.workunit.client.1.smithi183.stdout:3/683: truncate d7/db/d2a/f3a 3952486 0 2024-02-10T00:00:36.112 INFO:tasks.workunit.client.0.smithi164.stdout:0/446: dread f1 [4194304,4194304] 0 2024-02-10T00:00:36.112 INFO:tasks.workunit.client.0.smithi164.stdout:8/429: write d2/f6f [609339,33292] 0 2024-02-10T00:00:36.113 INFO:tasks.workunit.client.0.smithi164.stdout:8/430: write d2/d64/f51 [123326,122063] 0 2024-02-10T00:00:36.114 INFO:tasks.workunit.client.0.smithi164.stdout:8/431: write d2/d12/f17 [4031572,8601] 0 2024-02-10T00:00:36.115 INFO:tasks.workunit.client.0.smithi164.stdout:8/432: dread - d2/d64/d65/d80/d32/d58/f79 zero size 2024-02-10T00:00:36.117 INFO:tasks.workunit.client.0.smithi164.stdout:1/384: truncate d1/d1a/d41/f58 370994 0 2024-02-10T00:00:36.118 INFO:tasks.workunit.client.1.smithi183.stdout:1/736: mknod d0/d3/d67/d7b/dfe/c104 0 2024-02-10T00:00:36.124 INFO:tasks.workunit.client.1.smithi183.stdout:1/737: creat d0/d3a/f105 x:0 0 0 2024-02-10T00:00:36.124 INFO:tasks.workunit.client.1.smithi183.stdout:7/734: rename d0/d11/d2f/fdc to d0/d2/d3/fe5 0 2024-02-10T00:00:36.125 INFO:tasks.workunit.client.1.smithi183.stdout:7/735: chown d0/d11/d2f/da3/lcc 52012639 1 2024-02-10T00:00:36.125 INFO:tasks.workunit.client.1.smithi183.stdout:9/794: truncate d0/d3/d14/d1c/d2d/d4f/f5a 1312911 0 2024-02-10T00:00:36.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/795: write d0/d3/d14/d1c/d2d/d4f/db8/fe2 [1037236,61765] 0 2024-02-10T00:00:36.128 INFO:tasks.workunit.client.1.smithi183.stdout:2/908: truncate d2/da/f1d 8337716 0 2024-02-10T00:00:36.131 INFO:tasks.workunit.client.1.smithi183.stdout:5/831: write d4/f13 [5060505,91014] 0 2024-02-10T00:00:36.131 INFO:tasks.workunit.client.1.smithi183.stdout:3/684: dread d7/db/d2a/d2d/d51/fbd [0,4194304] 0 2024-02-10T00:00:36.131 INFO:tasks.workunit.client.0.smithi164.stdout:3/394: rename d0/d1/d2/l68 to d0/d1/d3c/d3d/l79 0 2024-02-10T00:00:36.131 INFO:tasks.workunit.client.0.smithi164.stdout:7/517: dwrite d3/d11/d39/d3a/f7d [0,4194304] 0 2024-02-10T00:00:36.135 INFO:tasks.workunit.client.0.smithi164.stdout:6/539: dwrite d0/f21 [0,4194304] 0 2024-02-10T00:00:36.136 INFO:tasks.workunit.client.1.smithi183.stdout:5/832: dwrite d4/d23/d3e/d80/da1/d9c/d72/da0/da9/fdd [0,4194304] 0 2024-02-10T00:00:36.138 INFO:tasks.workunit.client.1.smithi183.stdout:4/842: truncate de/d14/d27/f1b 4276173 0 2024-02-10T00:00:36.138 INFO:tasks.workunit.client.1.smithi183.stdout:6/711: write d2/fc0 [100229,100157] 0 2024-02-10T00:00:36.141 INFO:tasks.workunit.client.0.smithi164.stdout:0/447: chown d6/d3a/d52/d7a/f4e 6339 1 2024-02-10T00:00:36.141 INFO:tasks.workunit.client.0.smithi164.stdout:0/448: read f3 [7793287,14770] 0 2024-02-10T00:00:36.143 INFO:tasks.workunit.client.1.smithi183.stdout:1/738: mknod d0/d3/d29/c106 0 2024-02-10T00:00:36.144 INFO:tasks.workunit.client.1.smithi183.stdout:1/739: write d0/d3a/f7a [4884654,115536] 0 2024-02-10T00:00:36.145 INFO:tasks.workunit.client.0.smithi164.stdout:1/385: dwrite d1/d1a/d41/d18/f3e [0,4194304] 0 2024-02-10T00:00:36.147 INFO:tasks.workunit.client.0.smithi164.stdout:6/540: mkdir d0/d3b/d56/db3 0 2024-02-10T00:00:36.147 INFO:tasks.workunit.client.1.smithi183.stdout:7/736: mkdir d0/d2/d4/d8/d59/de6 0 2024-02-10T00:00:36.148 INFO:tasks.workunit.client.1.smithi183.stdout:7/737: dread - d0/d2/d4/d8/d59/fda zero size 2024-02-10T00:00:36.149 INFO:tasks.workunit.client.0.smithi164.stdout:8/433: mkdir d2/d81 0 2024-02-10T00:00:36.150 INFO:tasks.workunit.client.1.smithi183.stdout:3/685: mknod d7/db/d2a/d2d/d51/db3/cc6 0 2024-02-10T00:00:36.151 INFO:tasks.workunit.client.0.smithi164.stdout:6/541: dwrite d0/d2b/d3a/f87 [0,4194304] 0 2024-02-10T00:00:36.152 INFO:tasks.workunit.client.0.smithi164.stdout:2/474: rename d3/d32/f71 to d3/da6/d7a/d8e/d36/fab 0 2024-02-10T00:00:36.152 INFO:tasks.workunit.client.0.smithi164.stdout:6/542: stat d0/d2b/d3a/d3d/l97 0 2024-02-10T00:00:36.153 INFO:tasks.workunit.client.1.smithi183.stdout:4/843: rmdir de/d14/d27/d2e 39 2024-02-10T00:00:36.153 INFO:tasks.workunit.client.1.smithi183.stdout:4/844: readlink de/l87 0 2024-02-10T00:00:36.154 INFO:tasks.workunit.client.1.smithi183.stdout:4/845: fsync de/d19/fe0 0 2024-02-10T00:00:36.154 INFO:tasks.workunit.client.0.smithi164.stdout:1/386: mknod d1/d23/c8a 0 2024-02-10T00:00:36.155 INFO:tasks.workunit.client.0.smithi164.stdout:1/387: chown d1/d1a/d41/f5f 107 1 2024-02-10T00:00:36.155 INFO:tasks.workunit.client.0.smithi164.stdout:1/388: dread - d1/d13/d2b/f50 zero size 2024-02-10T00:00:36.156 INFO:tasks.workunit.client.0.smithi164.stdout:1/389: readlink d1/l76 0 2024-02-10T00:00:36.158 INFO:tasks.workunit.client.0.smithi164.stdout:4/467: rename d2/d19/d16/d31/d7e/d8b to d2/d2f/d37/d41/d3d/d42/da2 0 2024-02-10T00:00:36.160 INFO:tasks.workunit.client.0.smithi164.stdout:8/434: mkdir d2/d64/d65/d80/d82 0 2024-02-10T00:00:36.161 INFO:tasks.workunit.client.0.smithi164.stdout:8/435: chown d2/d12/c47 48 1 2024-02-10T00:00:36.161 INFO:tasks.workunit.client.1.smithi183.stdout:7/738: symlink d0/d11/le7 0 2024-02-10T00:00:36.162 INFO:tasks.workunit.client.0.smithi164.stdout:8/436: write d2/d64/d65/d80/d32/f55 [337673,3525] 0 2024-02-10T00:00:36.162 INFO:tasks.workunit.client.1.smithi183.stdout:7/739: write d0/d11/d2f/f34 [2736304,61832] 0 2024-02-10T00:00:36.163 INFO:tasks.workunit.client.0.smithi164.stdout:1/390: fsync d1/d23/f7d 0 2024-02-10T00:00:36.163 INFO:tasks.workunit.client.1.smithi183.stdout:3/686: creat d7/db/d2a/d33/fc7 x:0 0 0 2024-02-10T00:00:36.164 INFO:tasks.workunit.client.1.smithi183.stdout:3/687: write d7/db/d2a/d2d/f5b [1422725,82649] 0 2024-02-10T00:00:36.165 INFO:tasks.workunit.client.1.smithi183.stdout:3/688: write d7/db/d2a/f79 [1570464,28658] 0 2024-02-10T00:00:36.165 INFO:tasks.workunit.client.1.smithi183.stdout:3/689: readlink d7/db/d2a/d33/d59/d52/l7d 0 2024-02-10T00:00:36.168 INFO:tasks.workunit.client.0.smithi164.stdout:6/543: mkdir d0/d2b/d3a/d3d/d42/d5d/d79/d92/d93/db4 0 2024-02-10T00:00:36.168 INFO:tasks.workunit.client.0.smithi164.stdout:6/544: dread - d0/d2b/fa4 zero size 2024-02-10T00:00:36.169 INFO:tasks.workunit.client.0.smithi164.stdout:4/468: rename d2/d2f/d37/d41/d3d/f5c to d2/d19/d16/d31/d7e/fa3 0 2024-02-10T00:00:36.170 INFO:tasks.workunit.client.1.smithi183.stdout:3/690: dread - d7/db/d2a/d1c/f7a zero size 2024-02-10T00:00:36.170 INFO:tasks.workunit.client.0.smithi164.stdout:0/449: dread d6/d10/d4a/f74 [0,4194304] 0 2024-02-10T00:00:36.170 INFO:tasks.workunit.client.0.smithi164.stdout:1/391: mknod d1/d1a/d35/c8b 0 2024-02-10T00:00:36.171 INFO:tasks.workunit.client.0.smithi164.stdout:1/392: chown d1/d23/f84 192766867 1 2024-02-10T00:00:36.175 INFO:tasks.workunit.client.0.smithi164.stdout:8/437: rmdir d2/d64/d65/d80/d32/d4d/d60 0 2024-02-10T00:00:36.176 INFO:tasks.workunit.client.0.smithi164.stdout:0/450: mkdir d6/d10/d18/d1c/d92 0 2024-02-10T00:00:36.177 INFO:tasks.workunit.client.0.smithi164.stdout:4/469: dwrite d2/d2f/d37/d41/d3d/d42/d47/f80 [0,4194304] 0 2024-02-10T00:00:36.178 INFO:tasks.workunit.client.0.smithi164.stdout:1/393: dwrite d1/f9 [0,4194304] 0 2024-02-10T00:00:36.180 INFO:tasks.workunit.client.0.smithi164.stdout:8/438: creat d2/d64/f83 x:0 0 0 2024-02-10T00:00:36.181 INFO:tasks.workunit.client.0.smithi164.stdout:0/451: symlink d6/d10/d18/d2d/d39/l93 0 2024-02-10T00:00:36.182 INFO:tasks.workunit.client.0.smithi164.stdout:8/439: creat d2/d64/d65/d80/d82/f84 x:0 0 0 2024-02-10T00:00:36.185 INFO:tasks.workunit.client.0.smithi164.stdout:0/452: link d6/d3a/d52/d7a/f80 d6/d3a/d52/d7a/f94 0 2024-02-10T00:00:36.185 INFO:tasks.workunit.client.0.smithi164.stdout:8/440: dread d2/f4 [0,4194304] 0 2024-02-10T00:00:36.189 INFO:tasks.workunit.client.0.smithi164.stdout:0/453: dwrite d6/d10/d4a/d60/d6c/f46 [0,4194304] 0 2024-02-10T00:00:36.195 INFO:tasks.workunit.client.0.smithi164.stdout:0/454: mkdir d6/d10/d18/d2d/d35/d44/d49/d95 0 2024-02-10T00:00:36.207 INFO:tasks.workunit.client.0.smithi164.stdout:3/395: fdatasync d0/d1/d2/d19/d27/f2c 0 2024-02-10T00:00:36.208 INFO:tasks.workunit.client.0.smithi164.stdout:2/475: dread d3/d32/d4e/f59 [0,4194304] 0 2024-02-10T00:00:36.211 INFO:tasks.workunit.client.0.smithi164.stdout:2/476: creat d3/d24/d5b/fac x:0 0 0 2024-02-10T00:00:36.212 INFO:tasks.workunit.client.1.smithi183.stdout:1/740: fsync d0/d3a/f105 0 2024-02-10T00:00:36.212 INFO:tasks.workunit.client.0.smithi164.stdout:3/396: dwrite d0/d1/d3c/d3d/d51/f55 [0,4194304] 0 2024-02-10T00:00:36.217 INFO:tasks.workunit.client.0.smithi164.stdout:2/477: truncate d3/da6/d7a/d8e/f41 2383332 0 2024-02-10T00:00:36.217 INFO:tasks.workunit.client.0.smithi164.stdout:4/470: dread d2/d2f/f54 [0,4194304] 0 2024-02-10T00:00:36.218 INFO:tasks.workunit.client.1.smithi183.stdout:0/807: dwrite d14/d3e/d5f/fb1 [0,4194304] 0 2024-02-10T00:00:36.219 INFO:tasks.workunit.client.0.smithi164.stdout:7/518: truncate d3/d11/d39/d3a/f94 1036030 0 2024-02-10T00:00:36.219 INFO:tasks.workunit.client.0.smithi164.stdout:5/510: dwrite d7/f19 [0,4194304] 0 2024-02-10T00:00:36.220 INFO:tasks.workunit.client.0.smithi164.stdout:9/462: dwrite d6/de/d22/f26 [0,4194304] 0 2024-02-10T00:00:36.221 INFO:tasks.workunit.client.0.smithi164.stdout:3/397: symlink d0/d1/d2/d17/d37/d3f/d4e/d6d/l7a 0 2024-02-10T00:00:36.223 INFO:tasks.workunit.client.0.smithi164.stdout:2/478: rmdir d3/d26/d56 39 2024-02-10T00:00:36.224 INFO:tasks.workunit.client.0.smithi164.stdout:2/479: dread - d3/d24/d5b/f6e zero size 2024-02-10T00:00:36.225 INFO:tasks.workunit.client.0.smithi164.stdout:4/471: mkdir d2/d19/da4 0 2024-02-10T00:00:36.225 INFO:tasks.workunit.client.1.smithi183.stdout:9/796: write d0/d3/d14/d74/da8/fbd [1235677,42526] 0 2024-02-10T00:00:36.225 INFO:tasks.workunit.client.1.smithi183.stdout:2/909: write d2/f15 [1863619,91658] 0 2024-02-10T00:00:36.225 INFO:tasks.workunit.client.1.smithi183.stdout:5/833: write d4/dd/d31/d73/f7a [162303,80315] 0 2024-02-10T00:00:36.226 INFO:tasks.workunit.client.1.smithi183.stdout:7/740: write d0/d11/d9d/faf [876468,72121] 0 2024-02-10T00:00:36.229 INFO:tasks.workunit.client.0.smithi164.stdout:1/394: dread d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:36.230 INFO:tasks.workunit.client.1.smithi183.stdout:1/741: write d0/d3/fa4 [331614,47858] 0 2024-02-10T00:00:36.230 INFO:tasks.workunit.client.1.smithi183.stdout:3/691: dread d7/f12 [0,4194304] 0 2024-02-10T00:00:36.232 INFO:tasks.workunit.client.1.smithi183.stdout:1/742: dread - d0/d3a/f105 zero size 2024-02-10T00:00:36.232 INFO:tasks.workunit.client.1.smithi183.stdout:4/846: dwrite de/d22/feb [0,4194304] 0 2024-02-10T00:00:36.232 INFO:tasks.workunit.client.1.smithi183.stdout:8/858: dwrite d0/d3f/db2/d24/fbb [0,4194304] 0 2024-02-10T00:00:36.233 INFO:tasks.workunit.client.0.smithi164.stdout:6/545: truncate d0/d2b/d3a/f8f 2926529 0 2024-02-10T00:00:36.234 INFO:tasks.workunit.client.0.smithi164.stdout:1/395: dwrite d1/f1b [0,4194304] 0 2024-02-10T00:00:36.235 INFO:tasks.workunit.client.1.smithi183.stdout:4/847: write de/d14/d1d/d2f/da2/d9c/df5/f102 [841392,17156] 0 2024-02-10T00:00:36.237 INFO:tasks.workunit.client.0.smithi164.stdout:1/396: dread d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:36.237 INFO:tasks.workunit.client.1.smithi183.stdout:2/910: creat d2/d2c/dba/df0/f133 x:0 0 0 2024-02-10T00:00:36.238 INFO:tasks.workunit.client.1.smithi183.stdout:2/911: readlink d2/d2c/d2f/d60/d8d/la6 0 2024-02-10T00:00:36.238 INFO:tasks.workunit.client.1.smithi183.stdout:7/741: creat d0/d11/d9d/fe8 x:0 0 0 2024-02-10T00:00:36.239 INFO:tasks.workunit.client.1.smithi183.stdout:7/742: write d0/d2/d50/d5d/f78 [1556593,78420] 0 2024-02-10T00:00:36.246 INFO:tasks.workunit.client.1.smithi183.stdout:0/808: rmdir d14/d3e/d5f/daa/ddd/d121/d101 0 2024-02-10T00:00:36.248 INFO:tasks.workunit.client.1.smithi183.stdout:8/859: mknod d0/d3f/db2/c10c 0 2024-02-10T00:00:36.248 INFO:tasks.workunit.client.0.smithi164.stdout:1/397: dread d1/f4e [0,4194304] 0 2024-02-10T00:00:36.249 INFO:tasks.workunit.client.0.smithi164.stdout:9/463: creat d6/de/d2b/d5b/f8d x:0 0 0 2024-02-10T00:00:36.250 INFO:tasks.workunit.client.1.smithi183.stdout:3/692: rename d7/db/d2a/d33/cc1 to d7/db/d2a/d4d/d63/dc4/cc8 0 2024-02-10T00:00:36.251 INFO:tasks.workunit.client.0.smithi164.stdout:7/519: mkdir d3/d5/d9b/daa 0 2024-02-10T00:00:36.251 INFO:tasks.workunit.client.1.smithi183.stdout:4/848: getdents de/d14/d1d/d2f/da2/d9c/df5/df6 0 2024-02-10T00:00:36.251 INFO:tasks.workunit.client.1.smithi183.stdout:3/693: read - d7/db/d2a/d33/fc7 zero size 2024-02-10T00:00:36.253 INFO:tasks.workunit.client.0.smithi164.stdout:3/398: mknod d0/d3b/c7b 0 2024-02-10T00:00:36.254 INFO:tasks.workunit.client.0.smithi164.stdout:3/399: write d0/d1/d2/d17/f54 [468312,46259] 0 2024-02-10T00:00:36.254 INFO:tasks.workunit.client.0.smithi164.stdout:6/546: mknod d0/d2b/cb5 0 2024-02-10T00:00:36.255 INFO:tasks.workunit.client.0.smithi164.stdout:3/400: fsync d0/d1/d3c/d3d/f47 0 2024-02-10T00:00:36.256 INFO:tasks.workunit.client.0.smithi164.stdout:3/401: stat d0/d1/d2/d19/d27/d5f 0 2024-02-10T00:00:36.256 INFO:tasks.workunit.client.0.smithi164.stdout:1/398: symlink d1/d23/d37/l8c 0 2024-02-10T00:00:36.257 INFO:tasks.workunit.client.0.smithi164.stdout:3/402: fdatasync d0/d1/d2/f12 0 2024-02-10T00:00:36.257 INFO:tasks.workunit.client.0.smithi164.stdout:8/441: sync 2024-02-10T00:00:36.257 INFO:tasks.workunit.client.0.smithi164.stdout:9/464: symlink d6/de/d2b/d5b/d61/l8e 0 2024-02-10T00:00:36.257 INFO:tasks.workunit.client.0.smithi164.stdout:3/403: stat d0/d1/d2/d17/d37/f69 0 2024-02-10T00:00:36.258 INFO:tasks.workunit.client.0.smithi164.stdout:2/480: unlink d3/d32/d4e/d27/c93 0 2024-02-10T00:00:36.259 INFO:tasks.workunit.client.0.smithi164.stdout:7/520: mkdir d3/d5/d2b/dab 0 2024-02-10T00:00:36.261 INFO:tasks.workunit.client.0.smithi164.stdout:2/481: dread d3/d32/d4e/f59 [0,4194304] 0 2024-02-10T00:00:36.262 INFO:tasks.workunit.client.0.smithi164.stdout:9/465: creat d6/de/d2b/d5b/d61/f8f x:0 0 0 2024-02-10T00:00:36.264 INFO:tasks.workunit.client.0.smithi164.stdout:4/472: rmdir d2/d19/d16/d31/d72/d9a 0 2024-02-10T00:00:36.265 INFO:tasks.workunit.client.0.smithi164.stdout:6/547: symlink d0/d6/d12/lb6 0 2024-02-10T00:00:36.266 INFO:tasks.workunit.client.1.smithi183.stdout:0/809: mknod d14/d1d/d2d/d31/dc8/c123 0 2024-02-10T00:00:36.266 INFO:tasks.workunit.client.1.smithi183.stdout:4/849: chown de/d19/fd1 448373233 1 2024-02-10T00:00:36.266 INFO:tasks.workunit.client.1.smithi183.stdout:1/743: link d0/d3/d29/d38/l41 d0/d3/d7/d3d/dcb/l107 0 2024-02-10T00:00:36.266 INFO:tasks.workunit.client.0.smithi164.stdout:7/521: rmdir d3/d11/d39/d44/d48 39 2024-02-10T00:00:36.267 INFO:tasks.workunit.client.0.smithi164.stdout:1/399: fsync d1/d13/d2b/f2e 0 2024-02-10T00:00:36.269 INFO:tasks.workunit.client.1.smithi183.stdout:1/744: write d0/d3/d7/d3d/dcb/ff8 [947452,61522] 0 2024-02-10T00:00:36.269 INFO:tasks.workunit.client.1.smithi183.stdout:8/860: unlink d0/d31/d108/l6d 0 2024-02-10T00:00:36.270 INFO:tasks.workunit.client.1.smithi183.stdout:0/810: read d14/d43/f78 [433349,31341] 0 2024-02-10T00:00:36.271 INFO:tasks.workunit.client.0.smithi164.stdout:9/466: dread d6/de/d2b/d5b/f6c [0,4194304] 0 2024-02-10T00:00:36.271 INFO:tasks.workunit.client.1.smithi183.stdout:5/834: dread f1 [0,4194304] 0 2024-02-10T00:00:36.273 INFO:tasks.workunit.client.1.smithi183.stdout:8/861: rmdir d0/d4e/da6 39 2024-02-10T00:00:36.273 INFO:tasks.workunit.client.0.smithi164.stdout:7/522: rmdir d3/d28/d45 39 2024-02-10T00:00:36.274 INFO:tasks.workunit.client.0.smithi164.stdout:1/400: symlink d1/d23/l8d 0 2024-02-10T00:00:36.276 INFO:tasks.workunit.client.0.smithi164.stdout:2/482: unlink d3/d32/d4e/d27/f2d 0 2024-02-10T00:00:36.276 INFO:tasks.workunit.client.1.smithi183.stdout:0/811: dwrite d14/d43/fb7 [0,4194304] 0 2024-02-10T00:00:36.277 INFO:tasks.workunit.client.1.smithi183.stdout:4/850: read de/d14/d27/f21 [1338509,10960] 0 2024-02-10T00:00:36.278 INFO:tasks.workunit.client.0.smithi164.stdout:2/483: dread d3/d26/d64/f75 [0,4194304] 0 2024-02-10T00:00:36.278 INFO:tasks.workunit.client.0.smithi164.stdout:4/473: link d2/d2f/d37/d71/f79 d2/d2f/d37/d41/d3d/fa5 0 2024-02-10T00:00:36.279 INFO:tasks.workunit.client.1.smithi183.stdout:5/835: rename d4/d23/d3e/d80/da1/d9e/d27/d37/d46/l5a to d4/d23/d3e/d80/da1/l113 0 2024-02-10T00:00:36.279 INFO:tasks.workunit.client.0.smithi164.stdout:1/401: symlink d1/d13/d2b/d52/l8e 0 2024-02-10T00:00:36.279 INFO:tasks.workunit.client.1.smithi183.stdout:8/862: dread d0/d27/f44 [0,4194304] 0 2024-02-10T00:00:36.280 INFO:tasks.workunit.client.0.smithi164.stdout:1/402: chown d1/d1a/d41/d18/c69 1964164 1 2024-02-10T00:00:36.280 INFO:tasks.workunit.client.1.smithi183.stdout:0/812: symlink d14/d1d/d59/d3c/d93/l124 0 2024-02-10T00:00:36.280 INFO:tasks.workunit.client.1.smithi183.stdout:5/836: write d4/d23/d4a/fbb [3609844,85909] 0 2024-02-10T00:00:36.282 INFO:tasks.workunit.client.0.smithi164.stdout:2/484: fsync d3/d32/d4e/f3f 0 2024-02-10T00:00:36.283 INFO:tasks.workunit.client.1.smithi183.stdout:6/712: dread d2/d1a/d25/d3c/d31/d38/d6e/d35/f69 [0,4194304] 0 2024-02-10T00:00:36.283 INFO:tasks.workunit.client.1.smithi183.stdout:8/863: creat d0/d27/d36/f10d x:0 0 0 2024-02-10T00:00:36.284 INFO:tasks.workunit.client.0.smithi164.stdout:9/467: creat d6/d41/d8b/f90 x:0 0 0 2024-02-10T00:00:36.284 INFO:tasks.workunit.client.1.smithi183.stdout:4/851: link de/d19/d1c/fc1 de/d14/d4e/dd3/f106 0 2024-02-10T00:00:36.285 INFO:tasks.workunit.client.0.smithi164.stdout:1/403: unlink d1/d13/d2b/d52/l8e 0 2024-02-10T00:00:36.286 INFO:tasks.workunit.client.0.smithi164.stdout:7/523: link d3/d4d/d5d/l80 d3/d5/d9b/lac 0 2024-02-10T00:00:36.286 INFO:tasks.workunit.client.0.smithi164.stdout:1/404: write d1/d13/d2b/f5a [905647,76446] 0 2024-02-10T00:00:36.286 INFO:tasks.workunit.client.1.smithi183.stdout:0/813: dwrite d14/d1d/d59/d3c/d93/ff0 [0,4194304] 0 2024-02-10T00:00:36.287 INFO:tasks.workunit.client.0.smithi164.stdout:1/405: write d1/d1a/f73 [484688,112127] 0 2024-02-10T00:00:36.288 INFO:tasks.workunit.client.0.smithi164.stdout:2/485: unlink d3/f11 0 2024-02-10T00:00:36.289 INFO:tasks.workunit.client.1.smithi183.stdout:8/864: creat d0/d27/d75/d5b/f10e x:0 0 0 2024-02-10T00:00:36.289 INFO:tasks.workunit.client.0.smithi164.stdout:9/468: stat d6/de/c17 0 2024-02-10T00:00:36.290 INFO:tasks.workunit.client.0.smithi164.stdout:2/486: dread - d3/da6/d7a/d8e/d88/f95 zero size 2024-02-10T00:00:36.290 INFO:tasks.workunit.client.1.smithi183.stdout:8/865: dread - d0/d3f/db2/de9/fae zero size 2024-02-10T00:00:36.290 INFO:tasks.workunit.client.1.smithi183.stdout:6/713: symlink d2/d1a/d25/d3c/d31/d38/d87/ld7 0 2024-02-10T00:00:36.291 INFO:tasks.workunit.client.1.smithi183.stdout:4/852: creat de/d19/d1c/d61/f107 x:0 0 0 2024-02-10T00:00:36.292 INFO:tasks.workunit.client.1.smithi183.stdout:0/814: creat d14/d1d/d2d/d31/d6c/d70/f125 x:0 0 0 2024-02-10T00:00:36.292 INFO:tasks.workunit.client.1.smithi183.stdout:4/853: fdatasync de/d14/d1d/d7b/fbb 0 2024-02-10T00:00:36.293 INFO:tasks.workunit.client.0.smithi164.stdout:2/487: mkdir d3/d24/d51/dad 0 2024-02-10T00:00:36.294 INFO:tasks.workunit.client.0.smithi164.stdout:2/488: write d3/d32/d4e/d27/f94 [919149,89807] 0 2024-02-10T00:00:36.295 INFO:tasks.workunit.client.1.smithi183.stdout:5/837: getdents d4/d23/d3e/d80/da1/d9c/d72/da0/da9 0 2024-02-10T00:00:36.301 INFO:tasks.workunit.client.1.smithi183.stdout:2/912: sync 2024-02-10T00:00:36.301 INFO:tasks.workunit.client.1.smithi183.stdout:7/743: sync 2024-02-10T00:00:36.301 INFO:tasks.workunit.client.1.smithi183.stdout:0/815: unlink d14/d3e/d92/f105 0 2024-02-10T00:00:36.302 INFO:tasks.workunit.client.1.smithi183.stdout:0/816: readlink d14/d1d/d96/da0/la2 0 2024-02-10T00:00:36.302 INFO:tasks.workunit.client.1.smithi183.stdout:4/854: mkdir de/d14/d27/d40/d108 0 2024-02-10T00:00:36.303 INFO:tasks.workunit.client.1.smithi183.stdout:4/855: stat de/fae 0 2024-02-10T00:00:36.304 INFO:tasks.workunit.client.1.smithi183.stdout:5/838: creat d4/d23/d4a/d36/f114 x:0 0 0 2024-02-10T00:00:36.305 INFO:tasks.workunit.client.1.smithi183.stdout:2/913: read - d2/d2c/d2f/d60/d8d/fa8 zero size 2024-02-10T00:00:36.307 INFO:tasks.workunit.client.1.smithi183.stdout:5/839: dread - d4/d23/d3e/d80/da1/d9e/d27/f108 zero size 2024-02-10T00:00:36.307 INFO:tasks.workunit.client.1.smithi183.stdout:4/856: dread de/d14/d4e/ff2 [0,4194304] 0 2024-02-10T00:00:36.307 INFO:tasks.workunit.client.1.smithi183.stdout:2/914: write d2/f15 [873172,60470] 0 2024-02-10T00:00:36.309 INFO:tasks.workunit.client.1.smithi183.stdout:0/817: dwrite d14/d3e/d9b/fe4 [0,4194304] 0 2024-02-10T00:00:36.312 INFO:tasks.workunit.client.1.smithi183.stdout:7/744: link d0/d11/l31 d0/d2/d4/d8/d59/le9 0 2024-02-10T00:00:36.313 INFO:tasks.workunit.client.1.smithi183.stdout:5/840: dread d4/d23/d4a/ff3 [0,4194304] 0 2024-02-10T00:00:36.314 INFO:tasks.workunit.client.1.smithi183.stdout:4/857: mkdir de/d14/d1d/d2f/da2/d109 0 2024-02-10T00:00:36.314 INFO:tasks.workunit.client.0.smithi164.stdout:3/404: dread d0/d1/d3c/f63 [0,4194304] 0 2024-02-10T00:00:36.315 INFO:tasks.workunit.client.0.smithi164.stdout:3/405: write d0/d1/d3c/d3d/f47 [1876330,74541] 0 2024-02-10T00:00:36.315 INFO:tasks.workunit.client.0.smithi164.stdout:5/511: truncate d7/f32 4123562 0 2024-02-10T00:00:36.317 INFO:tasks.workunit.client.0.smithi164.stdout:6/548: rmdir d0/d2b 39 2024-02-10T00:00:36.318 INFO:tasks.workunit.client.1.smithi183.stdout:9/797: dread d0/d3/d14/d1c/d2d/d4f/f5a [0,4194304] 0 2024-02-10T00:00:36.321 INFO:tasks.workunit.client.0.smithi164.stdout:4/474: dread d2/d19/d16/f3f [0,4194304] 0 2024-02-10T00:00:36.321 INFO:tasks.workunit.client.1.smithi183.stdout:3/694: write d7/db/d2a/f44 [4293204,57968] 0 2024-02-10T00:00:36.321 INFO:tasks.workunit.client.0.smithi164.stdout:4/475: readlink d2/d19/ld 0 2024-02-10T00:00:36.322 INFO:tasks.workunit.client.1.smithi183.stdout:2/915: dread d2/f3a [0,4194304] 0 2024-02-10T00:00:36.324 INFO:tasks.workunit.client.0.smithi164.stdout:8/442: dwrite d2/f39 [0,4194304] 0 2024-02-10T00:00:36.324 INFO:tasks.workunit.client.1.smithi183.stdout:2/916: chown d2/da/d5b/l85 6 1 2024-02-10T00:00:36.325 INFO:tasks.workunit.client.1.smithi183.stdout:2/917: fdatasync d2/f3e 0 2024-02-10T00:00:36.326 INFO:tasks.workunit.client.0.smithi164.stdout:0/455: sync 2024-02-10T00:00:36.327 INFO:tasks.workunit.client.1.smithi183.stdout:1/745: dwrite d0/f8a [0,4194304] 0 2024-02-10T00:00:36.327 INFO:tasks.workunit.client.0.smithi164.stdout:0/456: fsync d6/d10/d18/d2d/f7f 0 2024-02-10T00:00:36.328 INFO:tasks.workunit.client.1.smithi183.stdout:8/866: truncate d0/d10/d9e/fb9 5292532 0 2024-02-10T00:00:36.328 INFO:tasks.workunit.client.1.smithi183.stdout:2/918: readlink d2/da/d5b/lce 0 2024-02-10T00:00:36.329 INFO:tasks.workunit.client.1.smithi183.stdout:6/714: dread d2/d1a/f49 [0,4194304] 0 2024-02-10T00:00:36.330 INFO:tasks.workunit.client.1.smithi183.stdout:3/695: dwrite d7/db/d2a/f88 [0,4194304] 0 2024-02-10T00:00:36.331 INFO:tasks.workunit.client.0.smithi164.stdout:3/406: rename d0/d1/d3c/d3d/f58 to d0/d1/d3c/f7c 0 2024-02-10T00:00:36.331 INFO:tasks.workunit.client.1.smithi183.stdout:0/818: write d14/f28 [377204,84051] 0 2024-02-10T00:00:36.332 INFO:tasks.workunit.client.0.smithi164.stdout:4/476: dread f1 [0,4194304] 0 2024-02-10T00:00:36.332 INFO:tasks.workunit.client.1.smithi183.stdout:0/819: readlink d14/d1d/d59/d3c/dc0/le5 0 2024-02-10T00:00:36.335 INFO:tasks.workunit.client.1.smithi183.stdout:4/858: rename de/d19/d1c/d61/fbc to de/d14/d1d/d2f/da2/f10a 0 2024-02-10T00:00:36.337 INFO:tasks.workunit.client.1.smithi183.stdout:7/745: dwrite d0/d2/f17 [0,4194304] 0 2024-02-10T00:00:36.337 INFO:tasks.workunit.client.1.smithi183.stdout:8/867: write d0/d4e/fa1 [766881,112451] 0 2024-02-10T00:00:36.340 INFO:tasks.workunit.client.1.smithi183.stdout:3/696: mkdir d7/d98/dc9 0 2024-02-10T00:00:36.340 INFO:tasks.workunit.client.1.smithi183.stdout:0/820: dwrite d14/d1d/d2d/d31/d6c/d70/f81 [0,4194304] 0 2024-02-10T00:00:36.341 INFO:tasks.workunit.client.0.smithi164.stdout:2/489: getdents d3/d32/d4e/d27 0 2024-02-10T00:00:36.342 INFO:tasks.workunit.client.1.smithi183.stdout:0/821: dread - d14/d1d/d2d/d31/d68/dcc/f10d zero size 2024-02-10T00:00:36.342 INFO:tasks.workunit.client.0.smithi164.stdout:1/406: write d1/d13/f47 [1358853,8545] 0 2024-02-10T00:00:36.342 INFO:tasks.workunit.client.0.smithi164.stdout:4/477: chown d2/d19/c75 7 1 2024-02-10T00:00:36.343 INFO:tasks.workunit.client.0.smithi164.stdout:9/469: write d6/d41/d8b/d24/d4f/f5a [1446388,104248] 0 2024-02-10T00:00:36.343 INFO:tasks.workunit.client.0.smithi164.stdout:0/457: rename d6/d10/d18/d2d/d35/c56 to d6/d10/d18/d2d/d35/d44/d49/d95/c96 0 2024-02-10T00:00:36.344 INFO:tasks.workunit.client.1.smithi183.stdout:0/822: fsync d14/d1d/d59/d71/f27 0 2024-02-10T00:00:36.344 INFO:tasks.workunit.client.1.smithi183.stdout:1/746: rename d0/d3a/ddb to d0/d3a/dd8/d108 0 2024-02-10T00:00:36.344 INFO:tasks.workunit.client.1.smithi183.stdout:0/823: readlink d14/d3e/d5f/daa/ddd/lec 0 2024-02-10T00:00:36.344 INFO:tasks.workunit.client.0.smithi164.stdout:3/407: creat d0/d1/d2/d17/d37/d3f/d4e/d6d/f7d x:0 0 0 2024-02-10T00:00:36.345 INFO:tasks.workunit.client.1.smithi183.stdout:0/824: dread - d14/d3e/dd4/f115 zero size 2024-02-10T00:00:36.345 INFO:tasks.workunit.client.0.smithi164.stdout:0/458: fdatasync d6/d10/d4a/d60/f6e 0 2024-02-10T00:00:36.346 INFO:tasks.workunit.client.1.smithi183.stdout:0/825: write d14/d1d/d59/d71/dfb/ffe [2390942,4069] 0 2024-02-10T00:00:36.346 INFO:tasks.workunit.client.1.smithi183.stdout:6/715: symlink d2/d1a/ld8 0 2024-02-10T00:00:36.347 INFO:tasks.workunit.client.0.smithi164.stdout:7/524: dwrite d3/d11/d39/d44/d6f/f9e [0,4194304] 0 2024-02-10T00:00:36.348 INFO:tasks.workunit.client.0.smithi164.stdout:7/525: chown d3/d26/l2a 14 1 2024-02-10T00:00:36.348 INFO:tasks.workunit.client.1.smithi183.stdout:7/746: symlink d0/d2/d4/d8/d59/d8a/lea 0 2024-02-10T00:00:36.349 INFO:tasks.workunit.client.0.smithi164.stdout:5/512: link d7/d17/d21/f58 d7/d17/d21/d85/fa4 0 2024-02-10T00:00:36.349 INFO:tasks.workunit.client.1.smithi183.stdout:7/747: chown d0/d2/d50/d5d/f78 50305548 1 2024-02-10T00:00:36.350 INFO:tasks.workunit.client.0.smithi164.stdout:6/549: rmdir d0/d2b/d3a/d3d/da7 39 2024-02-10T00:00:36.350 INFO:tasks.workunit.client.0.smithi164.stdout:1/407: mknod d1/d23/d61/c8f 0 2024-02-10T00:00:36.350 INFO:tasks.workunit.client.1.smithi183.stdout:6/716: dread d2/d1a/d25/f8e [0,4194304] 0 2024-02-10T00:00:36.351 INFO:tasks.workunit.client.0.smithi164.stdout:4/478: creat d2/d2f/d37/d41/d3d/d42/d47/fa6 x:0 0 0 2024-02-10T00:00:36.351 INFO:tasks.workunit.client.0.smithi164.stdout:9/470: dwrite d6/d41/d8b/d24/f2a [4194304,4194304] 0 2024-02-10T00:00:36.352 INFO:tasks.workunit.client.1.smithi183.stdout:3/697: rename d7/db/f61 to d7/db/fca 0 2024-02-10T00:00:36.354 INFO:tasks.workunit.client.0.smithi164.stdout:9/471: chown d6/de/d22 1370370 1 2024-02-10T00:00:36.354 INFO:tasks.workunit.client.0.smithi164.stdout:1/408: write d1/d13/d2b/d52/d56/f68 [1679212,72302] 0 2024-02-10T00:00:36.355 INFO:tasks.workunit.client.0.smithi164.stdout:4/479: dread d2/d2f/d37/d41/f95 [0,4194304] 0 2024-02-10T00:00:36.355 INFO:tasks.workunit.client.1.smithi183.stdout:6/717: dwrite d2/f65 [0,4194304] 0 2024-02-10T00:00:36.355 INFO:tasks.workunit.client.0.smithi164.stdout:1/409: fdatasync d1/f9 0 2024-02-10T00:00:36.356 INFO:tasks.workunit.client.1.smithi183.stdout:8/868: symlink d0/d4e/l10f 0 2024-02-10T00:00:36.357 INFO:tasks.workunit.client.0.smithi164.stdout:3/408: dread d0/f43 [0,4194304] 0 2024-02-10T00:00:36.357 INFO:tasks.workunit.client.0.smithi164.stdout:4/480: write d2/d2f/d37/d41/f35 [3488403,44873] 0 2024-02-10T00:00:36.357 INFO:tasks.workunit.client.0.smithi164.stdout:2/490: creat d3/d26/fae x:0 0 0 2024-02-10T00:00:36.358 INFO:tasks.workunit.client.0.smithi164.stdout:4/481: fdatasync d2/d19/d16/d31/d57/f7a 0 2024-02-10T00:00:36.360 INFO:tasks.workunit.client.1.smithi183.stdout:3/698: write d7/db/fba [850658,82092] 0 2024-02-10T00:00:36.361 INFO:tasks.workunit.client.0.smithi164.stdout:9/472: fdatasync d6/d4b/f57 0 2024-02-10T00:00:36.361 INFO:tasks.workunit.client.0.smithi164.stdout:1/410: dwrite d1/d13/d2b/d52/d56/f68 [0,4194304] 0 2024-02-10T00:00:36.361 INFO:tasks.workunit.client.1.smithi183.stdout:6/718: symlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/ld9 0 2024-02-10T00:00:36.362 INFO:tasks.workunit.client.0.smithi164.stdout:1/411: read d1/d1a/d41/d18/f3e [3650461,117024] 0 2024-02-10T00:00:36.363 INFO:tasks.workunit.client.1.smithi183.stdout:8/869: mknod d0/d4e/d6b/c110 0 2024-02-10T00:00:36.366 INFO:tasks.workunit.client.0.smithi164.stdout:1/412: dwrite d1/d13/d2b/d54/f77 [4194304,4194304] 0 2024-02-10T00:00:36.367 INFO:tasks.workunit.client.1.smithi183.stdout:7/748: dread d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:36.368 INFO:tasks.workunit.client.1.smithi183.stdout:6/719: unlink d2/d1a/d25/d3c/d31/fc7 0 2024-02-10T00:00:36.369 INFO:tasks.workunit.client.0.smithi164.stdout:5/513: rename d7/f32 to d7/d17/d21/d23/d5a/d68/d1f/fa5 0 2024-02-10T00:00:36.369 INFO:tasks.workunit.client.1.smithi183.stdout:6/720: chown d2/d1a/f49 229 1 2024-02-10T00:00:36.369 INFO:tasks.workunit.client.1.smithi183.stdout:8/870: stat d0/d23/cfd 0 2024-02-10T00:00:36.370 INFO:tasks.workunit.client.1.smithi183.stdout:0/826: link d14/d1d/d55/d6e/d74/l9e d14/d43/dee/l126 0 2024-02-10T00:00:36.371 INFO:tasks.workunit.client.0.smithi164.stdout:1/413: dwrite d1/f11 [4194304,4194304] 0 2024-02-10T00:00:36.372 INFO:tasks.workunit.client.1.smithi183.stdout:0/827: write d14/d3e/d5f/daa/ddd/d121/d63/f65 [52112,29295] 0 2024-02-10T00:00:36.373 INFO:tasks.workunit.client.1.smithi183.stdout:7/749: dwrite d0/d2/d4/fb9 [0,4194304] 0 2024-02-10T00:00:36.373 INFO:tasks.workunit.client.0.smithi164.stdout:9/473: stat d6/d41/d8b/f1d 0 2024-02-10T00:00:36.374 INFO:tasks.workunit.client.1.smithi183.stdout:7/750: stat d0/d2/d4/d8/d59/cb7 0 2024-02-10T00:00:36.374 INFO:tasks.workunit.client.1.smithi183.stdout:3/699: fdatasync d7/db/d2a/d2d/f2f 0 2024-02-10T00:00:36.375 INFO:tasks.workunit.client.0.smithi164.stdout:5/514: read d7/d17/d3b/f6b [504529,104695] 0 2024-02-10T00:00:36.380 INFO:tasks.workunit.client.0.smithi164.stdout:2/491: creat d3/d26/faf x:0 0 0 2024-02-10T00:00:36.381 INFO:tasks.workunit.client.1.smithi183.stdout:8/871: dwrite d0/d3f/d94/fcb [0,4194304] 0 2024-02-10T00:00:36.381 INFO:tasks.workunit.client.1.smithi183.stdout:3/700: dwrite f6 [4194304,4194304] 0 2024-02-10T00:00:36.382 INFO:tasks.workunit.client.1.smithi183.stdout:8/872: write d0/d27/f68 [5870637,106065] 0 2024-02-10T00:00:36.385 INFO:tasks.workunit.client.1.smithi183.stdout:9/798: truncate d0/d3/d14/d74/da8/faf 1017659 0 2024-02-10T00:00:36.389 INFO:tasks.workunit.client.0.smithi164.stdout:4/482: getdents d2/d19/d16/d31/d7e/d81 0 2024-02-10T00:00:36.390 INFO:tasks.workunit.client.1.smithi183.stdout:2/919: dwrite d2/da/d20/d21/fcf [0,4194304] 0 2024-02-10T00:00:36.390 INFO:tasks.workunit.client.1.smithi183.stdout:5/841: dwrite d4/d23/d2a/fd8 [0,4194304] 0 2024-02-10T00:00:36.391 INFO:tasks.workunit.client.1.smithi183.stdout:4/859: dwrite de/d14/d4e/dd3/f106 [0,4194304] 0 2024-02-10T00:00:36.393 INFO:tasks.workunit.client.1.smithi183.stdout:7/751: chown d0/d2/d4/d8/d59/d8a/fa9 1664 1 2024-02-10T00:00:36.398 INFO:tasks.workunit.client.0.smithi164.stdout:4/483: creat d2/d2f/d37/d45/fa7 x:0 0 0 2024-02-10T00:00:36.399 INFO:tasks.workunit.client.0.smithi164.stdout:2/492: getdents d3/da6/d7a/d8e/d36/d90 0 2024-02-10T00:00:36.400 INFO:tasks.workunit.client.0.smithi164.stdout:8/443: sync 2024-02-10T00:00:36.403 INFO:tasks.workunit.client.0.smithi164.stdout:8/444: creat d2/d64/d65/f85 x:0 0 0 2024-02-10T00:00:36.403 INFO:tasks.workunit.client.0.smithi164.stdout:9/474: dread d6/d4b/f57 [0,4194304] 0 2024-02-10T00:00:36.404 INFO:tasks.workunit.client.1.smithi183.stdout:4/860: chown de/d14/d27/d2e/c104 7291 1 2024-02-10T00:00:36.404 INFO:tasks.workunit.client.1.smithi183.stdout:7/752: write d0/d2/d4/f3c [4213562,64835] 0 2024-02-10T00:00:36.405 INFO:tasks.workunit.client.1.smithi183.stdout:4/861: write de/d14/d27/d40/f57 [1266602,6649] 0 2024-02-10T00:00:36.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/493: creat d3/d26/fb0 x:0 0 0 2024-02-10T00:00:36.406 INFO:tasks.workunit.client.1.smithi183.stdout:8/873: creat d0/d27/dfe/f111 x:0 0 0 2024-02-10T00:00:36.408 INFO:tasks.workunit.client.1.smithi183.stdout:9/799: symlink d0/d3/d14/d1c/l101 0 2024-02-10T00:00:36.408 INFO:tasks.workunit.client.1.smithi183.stdout:2/920: mknod d2/d2c/dab/d132/c134 0 2024-02-10T00:00:36.409 INFO:tasks.workunit.client.0.smithi164.stdout:4/484: getdents d2/d19 0 2024-02-10T00:00:36.409 INFO:tasks.workunit.client.0.smithi164.stdout:4/485: dread - d2/d2f/d37/d41/d3d/fa0 zero size 2024-02-10T00:00:36.410 INFO:tasks.workunit.client.1.smithi183.stdout:5/842: creat d4/d23/d3e/d80/da1/d9e/d27/d9d/d102/f115 x:0 0 0 2024-02-10T00:00:36.412 INFO:tasks.workunit.client.0.smithi164.stdout:9/475: creat d6/de/d22/d69/f91 x:0 0 0 2024-02-10T00:00:36.412 INFO:tasks.workunit.client.0.smithi164.stdout:8/445: truncate d2/f4 11901838 0 2024-02-10T00:00:36.412 INFO:tasks.workunit.client.1.smithi183.stdout:5/843: fdatasync d4/dd/d31/d73/f7a 0 2024-02-10T00:00:36.413 INFO:tasks.workunit.client.1.smithi183.stdout:4/862: unlink de/d14/d1d/d2f/da2/d9c/f9e 0 2024-02-10T00:00:36.414 INFO:tasks.workunit.client.0.smithi164.stdout:4/486: dwrite d2/f1a [0,4194304] 0 2024-02-10T00:00:36.415 INFO:tasks.workunit.client.1.smithi183.stdout:5/844: chown d4/d23/d3e/d80/da1/d9e/d27/d5d/lcc 694159 1 2024-02-10T00:00:36.415 INFO:tasks.workunit.client.1.smithi183.stdout:2/921: dwrite d2/d2c/dab/d99/ddf/d105/fe3 [0,4194304] 0 2024-02-10T00:00:36.415 INFO:tasks.workunit.client.1.smithi183.stdout:7/753: read d0/f32 [1074357,13564] 0 2024-02-10T00:00:36.420 INFO:tasks.workunit.client.1.smithi183.stdout:3/701: rename d7/db/d2a/d33/d59/l57 to d7/db/d2a/da5/lcb 0 2024-02-10T00:00:36.420 INFO:tasks.workunit.client.1.smithi183.stdout:8/874: creat d0/d31/d108/d81/f112 x:0 0 0 2024-02-10T00:00:36.421 INFO:tasks.workunit.client.1.smithi183.stdout:2/922: read d2/d2c/d2f/d60/d8d/d9c/da7/fbc [522457,5986] 0 2024-02-10T00:00:36.421 INFO:tasks.workunit.client.1.smithi183.stdout:3/702: fsync d7/db/d2a/d2d/f92 0 2024-02-10T00:00:36.422 INFO:tasks.workunit.client.1.smithi183.stdout:3/703: dread - d7/db/d2a/d2d/f92 zero size 2024-02-10T00:00:36.423 INFO:tasks.workunit.client.0.smithi164.stdout:2/494: rename d3/d24/c9d to d3/d24/d51/cb1 0 2024-02-10T00:00:36.423 INFO:tasks.workunit.client.1.smithi183.stdout:7/754: chown d0/d2/d3/c10 58 1 2024-02-10T00:00:36.423 INFO:tasks.workunit.client.0.smithi164.stdout:2/495: write d3/d32/d4e/f5e [1911730,26454] 0 2024-02-10T00:00:36.424 INFO:tasks.workunit.client.1.smithi183.stdout:3/704: write d7/f20 [2327187,25985] 0 2024-02-10T00:00:36.424 INFO:tasks.workunit.client.1.smithi183.stdout:7/755: write d0/f1 [452767,59169] 0 2024-02-10T00:00:36.425 INFO:tasks.workunit.client.1.smithi183.stdout:3/705: write d7/db/fba [780121,68509] 0 2024-02-10T00:00:36.426 INFO:tasks.workunit.client.1.smithi183.stdout:9/800: creat d0/d3/d14/d74/d90/f102 x:0 0 0 2024-02-10T00:00:36.426 INFO:tasks.workunit.client.1.smithi183.stdout:8/875: dread - d0/d3f/db2/ff5 zero size 2024-02-10T00:00:36.427 INFO:tasks.workunit.client.1.smithi183.stdout:8/876: dread - d0/d27/dfe/f111 zero size 2024-02-10T00:00:36.427 INFO:tasks.workunit.client.1.smithi183.stdout:9/801: write d0/d3/d14/d74/da8/fba [4983203,71189] 0 2024-02-10T00:00:36.429 INFO:tasks.workunit.client.0.smithi164.stdout:2/496: rename d3/d26/c70 to d3/da6/d7a/d8e/d36/cb2 0 2024-02-10T00:00:36.430 INFO:tasks.workunit.client.0.smithi164.stdout:8/446: creat d2/d64/d65/d80/f86 x:0 0 0 2024-02-10T00:00:36.431 INFO:tasks.workunit.client.0.smithi164.stdout:6/550: sync 2024-02-10T00:00:36.432 INFO:tasks.workunit.client.1.smithi183.stdout:7/756: write d0/d11/d3e/f70 [727025,129428] 0 2024-02-10T00:00:36.433 INFO:tasks.workunit.client.0.smithi164.stdout:8/447: mkdir d2/d64/d65/d87 0 2024-02-10T00:00:36.434 INFO:tasks.workunit.client.0.smithi164.stdout:6/551: symlink d0/d6/d12/d57/lb7 0 2024-02-10T00:00:36.434 INFO:tasks.workunit.client.1.smithi183.stdout:9/802: unlink d0/d30/d52/ddc/lec 0 2024-02-10T00:00:36.435 INFO:tasks.workunit.client.1.smithi183.stdout:9/803: fdatasync d0/d3/d14/d1c/d4b/d97/daa/dcf/fd1 0 2024-02-10T00:00:36.436 INFO:tasks.workunit.client.0.smithi164.stdout:2/497: getdents d3/da6 0 2024-02-10T00:00:36.437 INFO:tasks.workunit.client.1.smithi183.stdout:7/757: symlink d0/d2/d4/leb 0 2024-02-10T00:00:36.438 INFO:tasks.workunit.client.0.smithi164.stdout:2/498: readlink d3/d32/l80 0 2024-02-10T00:00:36.439 INFO:tasks.workunit.client.1.smithi183.stdout:9/804: creat d0/f103 x:0 0 0 2024-02-10T00:00:36.440 INFO:tasks.workunit.client.0.smithi164.stdout:6/552: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/fb1 [0,4194304] 0 2024-02-10T00:00:36.440 INFO:tasks.workunit.client.0.smithi164.stdout:6/553: stat d0/d2b/d3a/d3d/d42 0 2024-02-10T00:00:36.441 INFO:tasks.workunit.client.1.smithi183.stdout:9/805: symlink d0/d3/d14/d1c/d4b/d97/daa/l104 0 2024-02-10T00:00:36.441 INFO:tasks.workunit.client.0.smithi164.stdout:2/499: unlink d3/da6/d7a/d8e/d36/c7b 0 2024-02-10T00:00:36.441 INFO:tasks.workunit.client.1.smithi183.stdout:9/806: fdatasync d0/d3/d14/d1c/d2d/fed 0 2024-02-10T00:00:36.442 INFO:tasks.workunit.client.0.smithi164.stdout:2/500: write d3/d26/d64/f7e [1739943,45381] 0 2024-02-10T00:00:36.443 INFO:tasks.workunit.client.0.smithi164.stdout:6/554: read d0/d6/d12/d14/f1e [456405,95127] 0 2024-02-10T00:00:36.443 INFO:tasks.workunit.client.1.smithi183.stdout:9/807: creat d0/d10/f105 x:0 0 0 2024-02-10T00:00:36.444 INFO:tasks.workunit.client.0.smithi164.stdout:6/555: write d0/d2b/d3a/f5e [452799,64394] 0 2024-02-10T00:00:36.444 INFO:tasks.workunit.client.0.smithi164.stdout:2/501: rmdir d3/d32/d4e 39 2024-02-10T00:00:36.445 INFO:tasks.workunit.client.0.smithi164.stdout:6/556: write d0/d2b/d3a/f55 [3476964,65892] 0 2024-02-10T00:00:36.447 INFO:tasks.workunit.client.1.smithi183.stdout:4/863: dread de/d14/d27/d2e/f74 [0,4194304] 0 2024-02-10T00:00:36.449 INFO:tasks.workunit.client.0.smithi164.stdout:6/557: creat d0/d3b/fb8 x:0 0 0 2024-02-10T00:00:36.449 INFO:tasks.workunit.client.1.smithi183.stdout:4/864: mknod de/d14/d1d/d2f/da2/db6/c10b 0 2024-02-10T00:00:36.450 INFO:tasks.workunit.client.1.smithi183.stdout:4/865: dread - de/d22/f63 zero size 2024-02-10T00:00:36.451 INFO:tasks.workunit.client.0.smithi164.stdout:2/502: dwrite d3/d32/d4e/d27/f28 [0,4194304] 0 2024-02-10T00:00:36.451 INFO:tasks.workunit.client.0.smithi164.stdout:6/558: symlink d0/d2b/d3a/d3d/d6d/lb9 0 2024-02-10T00:00:36.451 INFO:tasks.workunit.client.0.smithi164.stdout:8/448: dread d2/d64/d65/d80/d32/d4d/f5a [0,4194304] 0 2024-02-10T00:00:36.452 INFO:tasks.workunit.client.0.smithi164.stdout:8/449: stat d2/d64/d65/d80/d32/d68 0 2024-02-10T00:00:36.454 INFO:tasks.workunit.client.0.smithi164.stdout:2/503: symlink d3/da6/d7a/d8e/d36/d90/lb3 0 2024-02-10T00:00:36.455 INFO:tasks.workunit.client.0.smithi164.stdout:8/450: creat d2/d64/d65/d80/d32/d4d/f88 x:0 0 0 2024-02-10T00:00:36.457 INFO:tasks.workunit.client.0.smithi164.stdout:2/504: symlink d3/da6/d7a/lb4 0 2024-02-10T00:00:36.458 INFO:tasks.workunit.client.0.smithi164.stdout:8/451: truncate d2/f7 591391 0 2024-02-10T00:00:36.459 INFO:tasks.workunit.client.0.smithi164.stdout:6/559: truncate d0/d2b/d3a/d3d/d42/d5d/d79/faa 791841 0 2024-02-10T00:00:36.460 INFO:tasks.workunit.client.0.smithi164.stdout:2/505: symlink d3/da6/d7a/d8e/d36/lb5 0 2024-02-10T00:00:36.461 INFO:tasks.workunit.client.0.smithi164.stdout:6/560: readlink d0/d6/d12/d45/l72 0 2024-02-10T00:00:36.462 INFO:tasks.workunit.client.0.smithi164.stdout:8/452: mknod d2/d64/d54/d71/d78/c89 0 2024-02-10T00:00:36.463 INFO:tasks.workunit.client.0.smithi164.stdout:2/506: mkdir d3/da6/d7a/d8e/db6 0 2024-02-10T00:00:36.463 INFO:tasks.workunit.client.0.smithi164.stdout:3/409: sync 2024-02-10T00:00:36.464 INFO:tasks.workunit.client.0.smithi164.stdout:6/561: symlink d0/d2b/d3a/d3d/d42/d5d/d79/lba 0 2024-02-10T00:00:36.467 INFO:tasks.workunit.client.0.smithi164.stdout:2/507: dwrite d3/f7 [0,4194304] 0 2024-02-10T00:00:36.469 INFO:tasks.workunit.client.0.smithi164.stdout:3/410: truncate d0/d1/d2/d17/d37/f3a 1533697 0 2024-02-10T00:00:36.473 INFO:tasks.workunit.client.0.smithi164.stdout:3/411: dwrite d0/d1/d3c/d3d/d51/f62 [0,4194304] 0 2024-02-10T00:00:36.475 INFO:tasks.workunit.client.0.smithi164.stdout:6/562: link d0/d6/d4d/l9d d0/d6/d12/d45/lbb 0 2024-02-10T00:00:36.478 INFO:tasks.workunit.client.0.smithi164.stdout:3/412: getdents d0/d1/d2/d17/d37 0 2024-02-10T00:00:36.478 INFO:tasks.workunit.client.0.smithi164.stdout:3/413: dread - d0/d3b/f6c zero size 2024-02-10T00:00:36.481 INFO:tasks.workunit.client.0.smithi164.stdout:3/414: rmdir d0/d1/d2/d17/d37/d3f/d4e/d6d 39 2024-02-10T00:00:36.482 INFO:tasks.workunit.client.0.smithi164.stdout:3/415: stat d0/d1/d2/c1a 0 2024-02-10T00:00:36.484 INFO:tasks.workunit.client.1.smithi183.stdout:5/845: sync 2024-02-10T00:00:36.484 INFO:tasks.workunit.client.0.smithi164.stdout:3/416: creat d0/d1/d2/d17/f7e x:0 0 0 2024-02-10T00:00:36.486 INFO:tasks.workunit.client.1.smithi183.stdout:5/846: mknod d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded/c116 0 2024-02-10T00:00:36.488 INFO:tasks.workunit.client.1.smithi183.stdout:5/847: symlink d4/d74/l117 0 2024-02-10T00:00:36.488 INFO:tasks.workunit.client.0.smithi164.stdout:0/459: dread d6/d3a/d52/f53 [0,4194304] 0 2024-02-10T00:00:36.489 INFO:tasks.workunit.client.0.smithi164.stdout:3/417: dwrite d0/d3b/f6c [0,4194304] 0 2024-02-10T00:00:36.492 INFO:tasks.workunit.client.0.smithi164.stdout:0/460: getdents d6/d10/d18/d2d/d35/d44 0 2024-02-10T00:00:36.492 INFO:tasks.workunit.client.0.smithi164.stdout:3/418: dwrite d0/d3b/f6c [0,4194304] 0 2024-02-10T00:00:36.497 INFO:tasks.workunit.client.0.smithi164.stdout:0/461: mkdir d6/d3a/d97 0 2024-02-10T00:00:36.498 INFO:tasks.workunit.client.0.smithi164.stdout:0/462: dread - d6/d3a/d52/f8e zero size 2024-02-10T00:00:36.502 INFO:tasks.workunit.client.0.smithi164.stdout:3/419: dwrite d0/d1/d2/d17/d37/d3f/d4e/d6d/f7d [0,4194304] 0 2024-02-10T00:00:36.503 INFO:tasks.workunit.client.0.smithi164.stdout:0/463: dwrite d6/d10/d4a/d60/f6e [0,4194304] 0 2024-02-10T00:00:36.504 INFO:tasks.workunit.client.1.smithi183.stdout:1/747: truncate d0/d3/d67/d7b/dfe/f4d 1464542 0 2024-02-10T00:00:36.505 INFO:tasks.workunit.client.1.smithi183.stdout:1/748: fsync d0/d3/da9/fda 0 2024-02-10T00:00:36.509 INFO:tasks.workunit.client.0.smithi164.stdout:3/420: dwrite d0/d1/d3c/f7c [0,4194304] 0 2024-02-10T00:00:36.511 INFO:tasks.workunit.client.1.smithi183.stdout:1/749: mknod d0/d3/d67/d7b/dfe/d7c/db1/c109 0 2024-02-10T00:00:36.512 INFO:tasks.workunit.client.1.smithi183.stdout:1/750: chown d0/d3c/dc9/l6d 971 1 2024-02-10T00:00:36.515 INFO:tasks.workunit.client.1.smithi183.stdout:1/751: unlink d0/d3/d29/d38/l7e 0 2024-02-10T00:00:36.519 INFO:tasks.workunit.client.1.smithi183.stdout:1/752: dwrite d0/d3/da9/fab [0,4194304] 0 2024-02-10T00:00:36.523 INFO:tasks.workunit.client.0.smithi164.stdout:2/508: sync 2024-02-10T00:00:36.524 INFO:tasks.workunit.client.0.smithi164.stdout:2/509: chown d3/d32/d4e/d27/f2c 25716225 1 2024-02-10T00:00:36.525 INFO:tasks.workunit.client.0.smithi164.stdout:2/510: chown d3/da6/d7a/d8e/d36/d90/l9a 15 1 2024-02-10T00:00:36.526 INFO:tasks.workunit.client.0.smithi164.stdout:0/464: dread d6/d10/d18/d2d/f7f [0,4194304] 0 2024-02-10T00:00:36.529 INFO:tasks.workunit.client.0.smithi164.stdout:7/526: truncate d3/d11/d39/d3a/f7d 2089132 0 2024-02-10T00:00:36.530 INFO:tasks.workunit.client.0.smithi164.stdout:7/527: write d3/d26/f31 [1957876,126375] 0 2024-02-10T00:00:36.530 INFO:tasks.workunit.client.0.smithi164.stdout:2/511: mknod d3/d26/cb7 0 2024-02-10T00:00:36.531 INFO:tasks.workunit.client.0.smithi164.stdout:1/414: write d1/d23/f7c [3485045,16385] 0 2024-02-10T00:00:36.532 INFO:tasks.workunit.client.0.smithi164.stdout:5/515: write d7/d17/d21/d23/d37/d36/f67 [1623708,38241] 0 2024-02-10T00:00:36.533 INFO:tasks.workunit.client.0.smithi164.stdout:0/465: creat d6/d10/d18/d2d/d35/d44/f98 x:0 0 0 2024-02-10T00:00:36.536 INFO:tasks.workunit.client.0.smithi164.stdout:2/512: dwrite d3/d32/d4e/f5e [4194304,4194304] 0 2024-02-10T00:00:36.536 INFO:tasks.workunit.client.0.smithi164.stdout:7/528: creat d3/d11/d39/d44/fad x:0 0 0 2024-02-10T00:00:36.538 INFO:tasks.workunit.client.0.smithi164.stdout:7/529: chown d3/d5/d2b/d4a/f53 5 1 2024-02-10T00:00:36.538 INFO:tasks.workunit.client.0.smithi164.stdout:7/530: chown c2 58 1 2024-02-10T00:00:36.539 INFO:tasks.workunit.client.0.smithi164.stdout:5/516: creat d7/d17/d21/d23/fa6 x:0 0 0 2024-02-10T00:00:36.541 INFO:tasks.workunit.client.0.smithi164.stdout:1/415: truncate d1/d13/d2b/d52/f82 1006445 0 2024-02-10T00:00:36.541 INFO:tasks.workunit.client.0.smithi164.stdout:5/517: write d7/d17/d3b/f8c [195156,96985] 0 2024-02-10T00:00:36.542 INFO:tasks.workunit.client.0.smithi164.stdout:7/531: rename d3/d26/d67/d79 to d3/d11/d39/dae 0 2024-02-10T00:00:36.542 INFO:tasks.workunit.client.1.smithi183.stdout:2/923: dread d2/d8b/fb3 [0,4194304] 0 2024-02-10T00:00:36.545 INFO:tasks.workunit.client.0.smithi164.stdout:1/416: getdents d1/d13/d1f 0 2024-02-10T00:00:36.545 INFO:tasks.workunit.client.0.smithi164.stdout:5/518: getdents d7/d17/d21/d23/d5a/d68/d1f/d70 0 2024-02-10T00:00:36.546 INFO:tasks.workunit.client.0.smithi164.stdout:1/417: write d1/d1a/d41/f5f [2427154,2173] 0 2024-02-10T00:00:36.547 INFO:tasks.workunit.client.1.smithi183.stdout:2/924: dwrite d2/da/d20/d21/d43/d58/d74/d10e/f128 [0,4194304] 0 2024-02-10T00:00:36.547 INFO:tasks.workunit.client.0.smithi164.stdout:1/418: chown d1/f71 58 1 2024-02-10T00:00:36.548 INFO:tasks.workunit.client.0.smithi164.stdout:1/419: chown d1/l88 6312 1 2024-02-10T00:00:36.548 INFO:tasks.workunit.client.1.smithi183.stdout:2/925: write d2/da/d77/dc7/fd2 [445443,61348] 0 2024-02-10T00:00:36.549 INFO:tasks.workunit.client.0.smithi164.stdout:5/519: dwrite d7/d17/f1c [0,4194304] 0 2024-02-10T00:00:36.550 INFO:tasks.workunit.client.1.smithi183.stdout:2/926: fdatasync d2/d2c/d2f/d60/d8d/d9c/dd1/f130 0 2024-02-10T00:00:36.550 INFO:tasks.workunit.client.0.smithi164.stdout:5/520: write d7/d17/d3b/d43/f4e [542555,95357] 0 2024-02-10T00:00:36.553 INFO:tasks.workunit.client.1.smithi183.stdout:2/927: unlink d2/d2c/l98 0 2024-02-10T00:00:36.553 INFO:tasks.workunit.client.1.smithi183.stdout:2/928: read d2/d8b/fb3 [505067,51333] 0 2024-02-10T00:00:36.554 INFO:tasks.workunit.client.1.smithi183.stdout:2/929: stat d2/da/d20/d21/d43/l12c 0 2024-02-10T00:00:36.556 INFO:tasks.workunit.client.1.smithi183.stdout:2/930: readlink d2/da/d20/d21/d36/ldd 0 2024-02-10T00:00:36.560 INFO:tasks.workunit.client.1.smithi183.stdout:2/931: unlink d2/da/d20/d21/d43/d58/d74/d83/dc4/fe1 0 2024-02-10T00:00:36.563 INFO:tasks.workunit.client.1.smithi183.stdout:2/932: creat d2/da/d20/d21/d43/d58/d74/d83/f135 x:0 0 0 2024-02-10T00:00:36.570 INFO:tasks.workunit.client.1.smithi183.stdout:2/933: mkdir d2/da/d20/d21/d43/d136 0 2024-02-10T00:00:36.571 INFO:tasks.workunit.client.1.smithi183.stdout:2/934: rmdir d2/da/d5b 39 2024-02-10T00:00:36.572 INFO:tasks.workunit.client.0.smithi164.stdout:1/420: symlink d1/d1a/d75/l90 0 2024-02-10T00:00:36.573 INFO:tasks.workunit.client.0.smithi164.stdout:5/521: write d7/f1d [4706870,108606] 0 2024-02-10T00:00:36.574 INFO:tasks.workunit.client.0.smithi164.stdout:5/522: chown d7/d17/d21/d23/d37 3 1 2024-02-10T00:00:36.575 INFO:tasks.workunit.client.0.smithi164.stdout:1/421: symlink d1/d1a/d41/d18/l91 0 2024-02-10T00:00:36.577 INFO:tasks.workunit.client.1.smithi183.stdout:2/935: creat d2/da/d20/f137 x:0 0 0 2024-02-10T00:00:36.577 INFO:tasks.workunit.client.1.smithi183.stdout:2/936: chown d2/da/d20/d21 238 1 2024-02-10T00:00:36.578 INFO:tasks.workunit.client.0.smithi164.stdout:5/523: truncate d7/d17/d79/d7b/f95 248695 0 2024-02-10T00:00:36.578 INFO:tasks.workunit.client.0.smithi164.stdout:1/422: dread d1/d13/d2b/d52/d56/f68 [0,4194304] 0 2024-02-10T00:00:36.581 INFO:tasks.workunit.client.0.smithi164.stdout:1/423: unlink d1/d23/l40 0 2024-02-10T00:00:36.582 INFO:tasks.workunit.client.0.smithi164.stdout:1/424: stat d1/d13/d2b/d52/f5d 0 2024-02-10T00:00:36.582 INFO:tasks.workunit.client.0.smithi164.stdout:5/524: rmdir d7/d17/d3b/d45 39 2024-02-10T00:00:36.587 INFO:tasks.workunit.client.0.smithi164.stdout:5/525: getdents d7/d17/d21/d23/d5a/d68 0 2024-02-10T00:00:36.587 INFO:tasks.workunit.client.1.smithi183.stdout:2/937: dread d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:36.588 INFO:tasks.workunit.client.1.smithi183.stdout:2/938: dread - d2/d2c/d2f/d60/d8d/d9c/dd1/f130 zero size 2024-02-10T00:00:36.589 INFO:tasks.workunit.client.0.smithi164.stdout:5/526: getdents d7/d17/d21/d23/d5a/d68 0 2024-02-10T00:00:36.591 INFO:tasks.workunit.client.1.smithi183.stdout:2/939: dwrite d2/da/d19/d31/f47 [0,4194304] 0 2024-02-10T00:00:36.593 INFO:tasks.workunit.client.0.smithi164.stdout:5/527: rename d7/d17/d3b/d43/c55 to d7/d17/d3b/d45/d5c/ca7 0 2024-02-10T00:00:36.783 INFO:tasks.workunit.client.1.smithi183.stdout:6/721: dwrite d2/d1a/d25/d3c/d31/d66/f71 [0,4194304] 0 2024-02-10T00:00:36.784 INFO:tasks.workunit.client.1.smithi183.stdout:6/722: fdatasync d2/d1a/d25/d3c/d31/d38/d3f/f4d 0 2024-02-10T00:00:36.786 INFO:tasks.workunit.client.1.smithi183.stdout:0/828: dread d14/d1d/d2d/d31/d6c/d70/fd6 [0,4194304] 0 2024-02-10T00:00:36.787 INFO:tasks.workunit.client.1.smithi183.stdout:6/723: mknod d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/cda 0 2024-02-10T00:00:36.789 INFO:tasks.workunit.client.1.smithi183.stdout:0/829: mknod d14/d3e/d5f/daa/de6/c127 0 2024-02-10T00:00:36.793 INFO:tasks.workunit.client.1.smithi183.stdout:0/830: dwrite d14/d1d/d59/d71/d22/f35 [0,4194304] 0 2024-02-10T00:00:36.794 INFO:tasks.workunit.client.1.smithi183.stdout:0/831: stat d14/d1d/d96/da0/cdf 0 2024-02-10T00:00:36.795 INFO:tasks.workunit.client.0.smithi164.stdout:9/476: write d6/de/f3d [163521,88596] 0 2024-02-10T00:00:36.799 INFO:tasks.workunit.client.0.smithi164.stdout:4/487: dwrite d2/d2f/d37/d41/d3d/f52 [0,4194304] 0 2024-02-10T00:00:36.800 INFO:tasks.workunit.client.0.smithi164.stdout:4/488: fsync d2/d19/d16/d31/d4b/f8c 0 2024-02-10T00:00:36.801 INFO:tasks.workunit.client.0.smithi164.stdout:9/477: mknod d6/d41/d8b/c92 0 2024-02-10T00:00:36.801 INFO:tasks.workunit.client.1.smithi183.stdout:0/832: creat d14/d1d/d2d/d11a/f128 x:0 0 0 2024-02-10T00:00:36.802 INFO:tasks.workunit.client.1.smithi183.stdout:0/833: dread - d14/d1d/d59/fd1 zero size 2024-02-10T00:00:36.809 INFO:tasks.workunit.client.0.smithi164.stdout:9/478: dread d6/fc [4194304,4194304] 0 2024-02-10T00:00:36.809 INFO:tasks.workunit.client.0.smithi164.stdout:9/479: stat d6/de/d22/l7d 0 2024-02-10T00:00:36.813 INFO:tasks.workunit.client.0.smithi164.stdout:9/480: dwrite d6/f35 [0,4194304] 0 2024-02-10T00:00:36.813 INFO:tasks.workunit.client.0.smithi164.stdout:1/425: fdatasync d1/d13/d2b/d52/d56/f68 0 2024-02-10T00:00:36.814 INFO:tasks.workunit.client.1.smithi183.stdout:8/877: truncate d0/d27/d75/d5b/f99 3345121 0 2024-02-10T00:00:36.815 INFO:tasks.workunit.client.1.smithi183.stdout:8/878: chown d0/c10b 8811 1 2024-02-10T00:00:36.816 INFO:tasks.workunit.client.1.smithi183.stdout:9/808: truncate d0/d3/d14/d1c/d4b/d51/f75 715588 0 2024-02-10T00:00:36.817 INFO:tasks.workunit.client.1.smithi183.stdout:9/809: fdatasync d0/d3/d14/d74/fd4 0 2024-02-10T00:00:36.819 INFO:tasks.workunit.client.1.smithi183.stdout:9/810: write d0/d3/d14/d74/da8/fbd [3324459,55860] 0 2024-02-10T00:00:36.820 INFO:tasks.workunit.client.1.smithi183.stdout:0/834: mkdir d14/d1d/d2d/d31/d68/d129 0 2024-02-10T00:00:36.821 INFO:tasks.workunit.client.1.smithi183.stdout:4/866: dwrite de/d14/d1d/d2f/da2/f10a [4194304,4194304] 0 2024-02-10T00:00:36.822 INFO:tasks.workunit.client.1.smithi183.stdout:0/835: stat d14/d1d/d59/fdc 0 2024-02-10T00:00:36.822 INFO:tasks.workunit.client.0.smithi164.stdout:5/528: fdatasync d7/d17/d3b/f8c 0 2024-02-10T00:00:36.823 INFO:tasks.workunit.client.1.smithi183.stdout:3/706: dread d7/db/d2a/f99 [0,4194304] 0 2024-02-10T00:00:36.825 INFO:tasks.workunit.client.1.smithi183.stdout:1/753: truncate d0/d3/d7/d3d/d60/d89/fbd 158085 0 2024-02-10T00:00:36.828 INFO:tasks.workunit.client.1.smithi183.stdout:3/707: dwrite d7/db/d2a/f9a [0,4194304] 0 2024-02-10T00:00:36.828 INFO:tasks.workunit.client.0.smithi164.stdout:8/453: rmdir d2/d64 39 2024-02-10T00:00:36.828 INFO:tasks.workunit.client.0.smithi164.stdout:6/563: dwrite d0/d6/d12/f27 [0,4194304] 0 2024-02-10T00:00:36.829 INFO:tasks.workunit.client.0.smithi164.stdout:3/421: write d0/d1/d3c/d3d/d6b/f74 [331565,11242] 0 2024-02-10T00:00:36.830 INFO:tasks.workunit.client.1.smithi183.stdout:5/848: write d4/d23/d3e/d80/da1/d9e/d27/fca [411010,89593] 0 2024-02-10T00:00:36.831 INFO:tasks.workunit.client.0.smithi164.stdout:3/422: dread - d0/d1/d2/d19/f73 zero size 2024-02-10T00:00:36.831 INFO:tasks.workunit.client.1.smithi183.stdout:5/849: chown d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f6c 2800 1 2024-02-10T00:00:36.832 INFO:tasks.workunit.client.0.smithi164.stdout:2/513: write d3/f6 [3245057,113420] 0 2024-02-10T00:00:36.833 INFO:tasks.workunit.client.1.smithi183.stdout:5/850: stat d4/d23/d3e/d80/da1/d9e/d27/d37/d46/cce 0 2024-02-10T00:00:36.834 INFO:tasks.workunit.client.0.smithi164.stdout:2/514: chown d3/d32/d4e/d27/f28 20089001 1 2024-02-10T00:00:36.835 INFO:tasks.workunit.client.0.smithi164.stdout:0/466: dwrite d6/d3a/d52/d7a/f4e [0,4194304] 0 2024-02-10T00:00:36.836 INFO:tasks.workunit.client.0.smithi164.stdout:0/467: chown d6/d10/d18/d1c/f2c 56311109 1 2024-02-10T00:00:36.839 INFO:tasks.workunit.client.0.smithi164.stdout:2/515: dwrite d3/f73 [0,4194304] 0 2024-02-10T00:00:36.841 INFO:tasks.workunit.client.1.smithi183.stdout:2/940: write d2/d2c/d2f/d60/d8d/d9c/fb2 [445014,120530] 0 2024-02-10T00:00:36.842 INFO:tasks.workunit.client.1.smithi183.stdout:6/724: truncate d2/fc0 1518476 0 2024-02-10T00:00:36.842 INFO:tasks.workunit.client.1.smithi183.stdout:2/941: chown d2/d2c/d2f/d60/d8d/fa8 5 1 2024-02-10T00:00:36.843 INFO:tasks.workunit.client.1.smithi183.stdout:2/942: readlink d2/l10 0 2024-02-10T00:00:36.844 INFO:tasks.workunit.client.1.smithi183.stdout:2/943: read - d2/d2c/d2f/d60/d8d/d9c/dd1/f130 zero size 2024-02-10T00:00:36.846 INFO:tasks.workunit.client.1.smithi183.stdout:8/879: link d0/d27/dfe/f111 d0/d23/f113 0 2024-02-10T00:00:36.847 INFO:tasks.workunit.client.0.smithi164.stdout:1/426: rename d1/d1a/f22 to d1/d23/f92 0 2024-02-10T00:00:36.848 INFO:tasks.workunit.client.1.smithi183.stdout:2/944: dwrite d2/da/d19/f7a [0,4194304] 0 2024-02-10T00:00:36.849 INFO:tasks.workunit.client.0.smithi164.stdout:5/529: unlink d7/fc 0 2024-02-10T00:00:36.852 INFO:tasks.workunit.client.0.smithi164.stdout:6/564: mkdir d0/d2b/d3a/d3d/d42/d5d/d79/dbc 0 2024-02-10T00:00:36.853 INFO:tasks.workunit.client.0.smithi164.stdout:3/423: mkdir d0/d1/d2/d19/d27/d30/d7f 0 2024-02-10T00:00:36.854 INFO:tasks.workunit.client.0.smithi164.stdout:3/424: fsync d0/d1/d2/d19/f73 0 2024-02-10T00:00:36.854 INFO:tasks.workunit.client.0.smithi164.stdout:3/425: write d0/d1/d2/d17/f7e [20132,1749] 0 2024-02-10T00:00:36.857 INFO:tasks.workunit.client.1.smithi183.stdout:9/811: creat d0/d3/d14/d1c/d2d/d4f/da4/f106 x:0 0 0 2024-02-10T00:00:36.858 INFO:tasks.workunit.client.1.smithi183.stdout:4/867: symlink de/d19/d20/de6/df7/l10c 0 2024-02-10T00:00:36.858 INFO:tasks.workunit.client.1.smithi183.stdout:5/851: truncate d4/d23/d4a/f53 1442658 0 2024-02-10T00:00:36.860 INFO:tasks.workunit.client.0.smithi164.stdout:0/468: rename d6/d10/d18/d2d/d35/d44/d49/l62 to d6/d3a/d97/l99 0 2024-02-10T00:00:36.860 INFO:tasks.workunit.client.0.smithi164.stdout:2/516: dread d3/d26/d64/f7e [0,4194304] 0 2024-02-10T00:00:36.860 INFO:tasks.workunit.client.1.smithi183.stdout:2/945: creat d2/da/d77/dc7/f138 x:0 0 0 2024-02-10T00:00:36.861 INFO:tasks.workunit.client.0.smithi164.stdout:1/427: creat d1/d1a/d41/d18/d3a/f93 x:0 0 0 2024-02-10T00:00:36.862 INFO:tasks.workunit.client.0.smithi164.stdout:5/530: mkdir d7/d17/d69/d92/da8 0 2024-02-10T00:00:36.862 INFO:tasks.workunit.client.0.smithi164.stdout:5/531: chown d7/d17/d21/f58 17 1 2024-02-10T00:00:36.863 INFO:tasks.workunit.client.1.smithi183.stdout:3/708: unlink d7/db/d2a/d33/d59/daa/cb2 0 2024-02-10T00:00:36.863 INFO:tasks.workunit.client.0.smithi164.stdout:5/532: chown d7/l14 455 1 2024-02-10T00:00:36.864 INFO:tasks.workunit.client.1.smithi183.stdout:3/709: chown d7/db/d2a/d4d/d63/fbe 2 1 2024-02-10T00:00:36.864 INFO:tasks.workunit.client.1.smithi183.stdout:9/812: unlink d0/d10/f105 0 2024-02-10T00:00:36.865 INFO:tasks.workunit.client.0.smithi164.stdout:4/489: truncate d2/f8 1058696 0 2024-02-10T00:00:36.866 INFO:tasks.workunit.client.0.smithi164.stdout:1/428: dwrite d1/d23/f55 [0,4194304] 0 2024-02-10T00:00:36.867 INFO:tasks.workunit.client.1.smithi183.stdout:4/868: mkdir de/d14/d27/d2e/d10d 0 2024-02-10T00:00:36.867 INFO:tasks.workunit.client.1.smithi183.stdout:4/869: fdatasync de/d14/d4e/f94 0 2024-02-10T00:00:36.868 INFO:tasks.workunit.client.0.smithi164.stdout:7/532: rmdir d3/d11/d39/dae 0 2024-02-10T00:00:36.868 INFO:tasks.workunit.client.0.smithi164.stdout:6/565: dread d0/d6/f54 [0,4194304] 0 2024-02-10T00:00:36.870 INFO:tasks.workunit.client.1.smithi183.stdout:2/946: mkdir d2/d2c/d2f/d60/d8d/d9c/d139 0 2024-02-10T00:00:36.872 INFO:tasks.workunit.client.0.smithi164.stdout:0/469: rename d6/d7/d14/c23 to d6/d10/d18/d2d/c9a 0 2024-02-10T00:00:36.872 INFO:tasks.workunit.client.0.smithi164.stdout:9/481: write d6/de/d40/f46 [4554425,83372] 0 2024-02-10T00:00:36.872 INFO:tasks.workunit.client.1.smithi183.stdout:1/754: dread d0/d3/f2d [4194304,4194304] 0 2024-02-10T00:00:36.873 INFO:tasks.workunit.client.1.smithi183.stdout:5/852: creat d4/dd/f118 x:0 0 0 2024-02-10T00:00:36.873 INFO:tasks.workunit.client.0.smithi164.stdout:8/454: creat d2/f8a x:0 0 0 2024-02-10T00:00:36.874 INFO:tasks.workunit.client.1.smithi183.stdout:0/836: dread d14/d1d/d2d/d31/d6c/de3/ffd [0,4194304] 0 2024-02-10T00:00:36.875 INFO:tasks.workunit.client.1.smithi183.stdout:3/710: creat d7/db/d2a/d2d/fcc x:0 0 0 2024-02-10T00:00:36.876 INFO:tasks.workunit.client.0.smithi164.stdout:5/533: symlink d7/d17/d3b/d45/d5c/la9 0 2024-02-10T00:00:36.879 INFO:tasks.workunit.client.1.smithi183.stdout:2/947: dwrite d2/da/fee [0,4194304] 0 2024-02-10T00:00:36.881 INFO:tasks.workunit.client.1.smithi183.stdout:1/755: link d0/f13 d0/d3/d7/d3d/d60/d89/de4/f10a 0 2024-02-10T00:00:36.881 INFO:tasks.workunit.client.1.smithi183.stdout:1/756: chown d0/d3a 499899 1 2024-02-10T00:00:36.882 INFO:tasks.workunit.client.0.smithi164.stdout:7/533: mkdir d3/d26/d67/d98/daf 0 2024-02-10T00:00:36.882 INFO:tasks.workunit.client.0.smithi164.stdout:6/566: mkdir d0/d2b/d3a/d3d/d42/d5d/d79/dbd 0 2024-02-10T00:00:36.882 INFO:tasks.workunit.client.1.smithi183.stdout:2/948: readlink d2/d2c/d2f/l30 0 2024-02-10T00:00:36.883 INFO:tasks.workunit.client.0.smithi164.stdout:2/517: mkdir d3/da6/d7a/d8e/db6/db8 0 2024-02-10T00:00:36.883 INFO:tasks.workunit.client.1.smithi183.stdout:8/880: dread d0/d3f/f43 [0,4194304] 0 2024-02-10T00:00:36.886 INFO:tasks.workunit.client.1.smithi183.stdout:2/949: dwrite d2/da/d20/d21/d43/f103 [0,4194304] 0 2024-02-10T00:00:36.887 INFO:tasks.workunit.client.1.smithi183.stdout:8/881: write d0/fd [2950233,119841] 0 2024-02-10T00:00:36.887 INFO:tasks.workunit.client.0.smithi164.stdout:3/426: rmdir d0/d1/d2/d19/d27/d30/d7f 0 2024-02-10T00:00:36.888 INFO:tasks.workunit.client.0.smithi164.stdout:3/427: chown d0/d1/d2/d19/c5d 52 1 2024-02-10T00:00:36.888 INFO:tasks.workunit.client.0.smithi164.stdout:5/534: symlink d7/d17/d69/laa 0 2024-02-10T00:00:36.889 INFO:tasks.workunit.client.0.smithi164.stdout:7/534: fsync d3/d5/fe 0 2024-02-10T00:00:36.889 INFO:tasks.workunit.client.0.smithi164.stdout:3/428: write d0/d1/d2/d17/f54 [180973,118471] 0 2024-02-10T00:00:36.891 INFO:tasks.workunit.client.0.smithi164.stdout:6/567: truncate d0/d6/f10 2770815 0 2024-02-10T00:00:36.891 INFO:tasks.workunit.client.0.smithi164.stdout:2/518: write d3/d24/d5b/f6e [615948,71962] 0 2024-02-10T00:00:36.893 INFO:tasks.workunit.client.0.smithi164.stdout:9/482: rename d6/de/f21 to d6/de/d40/d74/f93 0 2024-02-10T00:00:36.894 INFO:tasks.workunit.client.0.smithi164.stdout:8/455: rmdir d2/d64/d54/d71 39 2024-02-10T00:00:36.895 INFO:tasks.workunit.client.0.smithi164.stdout:5/535: rmdir d7/d17/d3b/d45 39 2024-02-10T00:00:36.897 INFO:tasks.workunit.client.0.smithi164.stdout:3/429: creat d0/d1/d2/d19/d27/f80 x:0 0 0 2024-02-10T00:00:36.898 INFO:tasks.workunit.client.0.smithi164.stdout:0/470: truncate d6/d7/f58 155796 0 2024-02-10T00:00:36.899 INFO:tasks.workunit.client.0.smithi164.stdout:2/519: fsync d3/d26/d64/f7e 0 2024-02-10T00:00:36.901 INFO:tasks.workunit.client.0.smithi164.stdout:2/520: read d3/d32/d4e/d27/f74 [369168,111280] 0 2024-02-10T00:00:36.902 INFO:tasks.workunit.client.0.smithi164.stdout:7/535: fdatasync d3/d4d/f55 0 2024-02-10T00:00:36.902 INFO:tasks.workunit.client.1.smithi183.stdout:0/837: dread d14/f20 [0,4194304] 0 2024-02-10T00:00:36.905 INFO:tasks.workunit.client.0.smithi164.stdout:0/471: rename d6/d3a/d52/d7a/f80 to d6/d10/d18/d2d/d39/f9b 0 2024-02-10T00:00:36.906 INFO:tasks.workunit.client.1.smithi183.stdout:8/882: unlink d0/d10/f19 0 2024-02-10T00:00:36.907 INFO:tasks.workunit.client.1.smithi183.stdout:8/883: write d0/d3f/db2/d24/fd3 [1098152,114022] 0 2024-02-10T00:00:36.912 INFO:tasks.workunit.client.0.smithi164.stdout:4/490: dread d2/d19/f15 [0,4194304] 0 2024-02-10T00:00:36.913 INFO:tasks.workunit.client.0.smithi164.stdout:5/536: mkdir d7/d17/d3b/d45/dab 0 2024-02-10T00:00:36.914 INFO:tasks.workunit.client.1.smithi183.stdout:0/838: truncate d14/d3e/d92/f42 254603 0 2024-02-10T00:00:36.914 INFO:tasks.workunit.client.0.smithi164.stdout:4/491: read d2/d2f/f54 [136995,40996] 0 2024-02-10T00:00:36.914 INFO:tasks.workunit.client.0.smithi164.stdout:5/537: write d7/f1d [1030816,44625] 0 2024-02-10T00:00:36.915 INFO:tasks.workunit.client.0.smithi164.stdout:5/538: chown d7/d17/d69/f6a 463782585 1 2024-02-10T00:00:36.916 INFO:tasks.workunit.client.1.smithi183.stdout:2/950: symlink d2/d2c/d2f/d60/d8d/d10b/l13a 0 2024-02-10T00:00:36.916 INFO:tasks.workunit.client.1.smithi183.stdout:9/813: sync 2024-02-10T00:00:36.917 INFO:tasks.workunit.client.0.smithi164.stdout:3/430: mkdir d0/d1/d2/d19/d66/d81 0 2024-02-10T00:00:36.918 INFO:tasks.workunit.client.1.smithi183.stdout:0/839: creat d14/d3e/d5f/f12a x:0 0 0 2024-02-10T00:00:36.919 INFO:tasks.workunit.client.1.smithi183.stdout:8/884: mkdir d0/d3f/db2/d114 0 2024-02-10T00:00:36.919 INFO:tasks.workunit.client.1.smithi183.stdout:8/885: stat d0/d4e/f6a 0 2024-02-10T00:00:36.920 INFO:tasks.workunit.client.1.smithi183.stdout:9/814: creat d0/d3/d14/d74/da8/f107 x:0 0 0 2024-02-10T00:00:36.920 INFO:tasks.workunit.client.1.smithi183.stdout:9/815: readlink d0/d30/lb2 0 2024-02-10T00:00:36.922 INFO:tasks.workunit.client.1.smithi183.stdout:7/758: truncate d0/d2/d4/f3c 2629819 0 2024-02-10T00:00:36.925 INFO:tasks.workunit.client.0.smithi164.stdout:8/456: dread d2/d64/d65/d80/d32/d58/f5c [0,4194304] 0 2024-02-10T00:00:36.925 INFO:tasks.workunit.client.0.smithi164.stdout:6/568: link d0/d2b/f36 d0/fbe 0 2024-02-10T00:00:36.925 INFO:tasks.workunit.client.0.smithi164.stdout:8/457: chown d2 97 1 2024-02-10T00:00:36.926 INFO:tasks.workunit.client.1.smithi183.stdout:6/725: truncate d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae 2122164 0 2024-02-10T00:00:36.927 INFO:tasks.workunit.client.1.smithi183.stdout:0/840: symlink d14/d1d/d59/d71/dfb/l12b 0 2024-02-10T00:00:36.928 INFO:tasks.workunit.client.0.smithi164.stdout:1/429: write d1/fd [681183,98035] 0 2024-02-10T00:00:36.930 INFO:tasks.workunit.client.1.smithi183.stdout:9/816: read d0/d3/d14/d3c/f60 [1290573,91420] 0 2024-02-10T00:00:36.931 INFO:tasks.workunit.client.0.smithi164.stdout:9/483: dread d6/de/d2b/f65 [0,4194304] 0 2024-02-10T00:00:36.933 INFO:tasks.workunit.client.1.smithi183.stdout:6/726: write d2/d1a/d3a/d45/fb1 [1292936,40622] 0 2024-02-10T00:00:36.934 INFO:tasks.workunit.client.0.smithi164.stdout:2/521: mkdir d3/d26/d56/db9 0 2024-02-10T00:00:36.934 INFO:tasks.workunit.client.0.smithi164.stdout:2/522: chown d3/da6/d7a/d8e/d88/f95 2 1 2024-02-10T00:00:36.936 INFO:tasks.workunit.client.1.smithi183.stdout:0/841: symlink d14/d1d/d2d/l12c 0 2024-02-10T00:00:36.936 INFO:tasks.workunit.client.1.smithi183.stdout:4/870: dwrite de/d14/da4/fa9 [0,4194304] 0 2024-02-10T00:00:36.937 INFO:tasks.workunit.client.1.smithi183.stdout:8/886: mknod d0/d23/c115 0 2024-02-10T00:00:36.941 INFO:tasks.workunit.client.0.smithi164.stdout:4/492: creat d2/d19/d16/d31/d72/fa8 x:0 0 0 2024-02-10T00:00:36.942 INFO:tasks.workunit.client.1.smithi183.stdout:9/817: dwrite d0/d3/d14/f46 [0,4194304] 0 2024-02-10T00:00:36.942 INFO:tasks.workunit.client.1.smithi183.stdout:3/711: dwrite d7/f12 [0,4194304] 0 2024-02-10T00:00:36.942 INFO:tasks.workunit.client.0.smithi164.stdout:3/431: mkdir d0/d1/d3c/d3d/d51/d82 0 2024-02-10T00:00:36.943 INFO:tasks.workunit.client.1.smithi183.stdout:5/853: dwrite d4/d23/d3e/d80/da1/f8a [0,4194304] 0 2024-02-10T00:00:36.944 INFO:tasks.workunit.client.0.smithi164.stdout:7/536: symlink d3/d11/d39/d44/d9a/lb0 0 2024-02-10T00:00:36.944 INFO:tasks.workunit.client.0.smithi164.stdout:7/537: fsync d3/d11/f18 0 2024-02-10T00:00:36.945 INFO:tasks.workunit.client.0.smithi164.stdout:6/569: mkdir d0/d6/d12/d14/d4b/dbf 0 2024-02-10T00:00:36.946 INFO:tasks.workunit.client.1.smithi183.stdout:2/951: truncate d2/da/d19/fb4 1333707 0 2024-02-10T00:00:36.946 INFO:tasks.workunit.client.1.smithi183.stdout:7/759: dread d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:36.946 INFO:tasks.workunit.client.0.smithi164.stdout:8/458: symlink d2/d64/d65/d80/d32/d4d/l8b 0 2024-02-10T00:00:36.947 INFO:tasks.workunit.client.0.smithi164.stdout:3/432: dwrite d0/d1/d3c/d3d/d51/f62 [0,4194304] 0 2024-02-10T00:00:36.951 INFO:tasks.workunit.client.1.smithi183.stdout:0/842: chown f3 250 1 2024-02-10T00:00:36.951 INFO:tasks.workunit.client.0.smithi164.stdout:8/459: dwrite d2/f67 [0,4194304] 0 2024-02-10T00:00:36.952 INFO:tasks.workunit.client.1.smithi183.stdout:0/843: dread - d14/d1d/d59/fd1 zero size 2024-02-10T00:00:36.956 INFO:tasks.workunit.client.0.smithi164.stdout:2/523: symlink d3/d24/d51/lba 0 2024-02-10T00:00:36.958 INFO:tasks.workunit.client.1.smithi183.stdout:6/727: rename d2/d1a/d25/d3c/d31/d38/d6e/f84 to d2/dab/fdb 0 2024-02-10T00:00:36.958 INFO:tasks.workunit.client.0.smithi164.stdout:5/539: mknod d7/cac 0 2024-02-10T00:00:36.958 INFO:tasks.workunit.client.0.smithi164.stdout:4/493: creat d2/d2f/d37/d45/fa9 x:0 0 0 2024-02-10T00:00:36.958 INFO:tasks.workunit.client.1.smithi183.stdout:1/757: sync 2024-02-10T00:00:36.959 INFO:tasks.workunit.client.1.smithi183.stdout:1/758: fsync d0/f8e 0 2024-02-10T00:00:36.961 INFO:tasks.workunit.client.1.smithi183.stdout:9/818: mknod d0/d92/db7/c108 0 2024-02-10T00:00:36.961 INFO:tasks.workunit.client.0.smithi164.stdout:6/570: unlink d0/d6/d12/d14/d4b/f6b 0 2024-02-10T00:00:36.962 INFO:tasks.workunit.client.0.smithi164.stdout:4/494: dwrite d2/d2f/d37/d45/fa9 [0,4194304] 0 2024-02-10T00:00:36.963 INFO:tasks.workunit.client.1.smithi183.stdout:0/844: read d14/d1d/d2d/f79 [3967273,11754] 0 2024-02-10T00:00:36.963 INFO:tasks.workunit.client.1.smithi183.stdout:3/712: dwrite d7/f5a [0,4194304] 0 2024-02-10T00:00:36.970 INFO:tasks.workunit.client.0.smithi164.stdout:8/460: creat d2/d81/f8c x:0 0 0 2024-02-10T00:00:36.970 INFO:tasks.workunit.client.1.smithi183.stdout:2/952: rename d2/d2c/d2f/d60/d8d/d9c/da7/cfb to d2/d2c/dab/c13b 0 2024-02-10T00:00:36.971 INFO:tasks.workunit.client.1.smithi183.stdout:2/953: chown d2/d2c/d2f/d60/d8d/d9c/dd1 281663377 1 2024-02-10T00:00:36.974 INFO:tasks.workunit.client.1.smithi183.stdout:6/728: mknod d2/da0/cdc 0 2024-02-10T00:00:36.974 INFO:tasks.workunit.client.1.smithi183.stdout:1/759: mknod d0/d3/d67/d7b/c10b 0 2024-02-10T00:00:36.974 INFO:tasks.workunit.client.0.smithi164.stdout:6/571: creat d0/d2b/d3a/d3d/d6d/fc0 x:0 0 0 2024-02-10T00:00:36.975 INFO:tasks.workunit.client.0.smithi164.stdout:8/461: dwrite d2/f39 [0,4194304] 0 2024-02-10T00:00:36.975 INFO:tasks.workunit.client.0.smithi164.stdout:0/472: getdents d6/d10/d18/d2d/d35/d44 0 2024-02-10T00:00:36.975 INFO:tasks.workunit.client.0.smithi164.stdout:1/430: creat d1/f94 x:0 0 0 2024-02-10T00:00:36.975 INFO:tasks.workunit.client.0.smithi164.stdout:6/572: readlink d0/l15 0 2024-02-10T00:00:36.975 INFO:tasks.workunit.client.1.smithi183.stdout:8/887: sync 2024-02-10T00:00:36.976 INFO:tasks.workunit.client.0.smithi164.stdout:8/462: chown d2/d64/d65/d80/d32 7 1 2024-02-10T00:00:36.977 INFO:tasks.workunit.client.0.smithi164.stdout:2/524: link d3/d26/d64/f9c d3/d24/d51/fbb 0 2024-02-10T00:00:36.978 INFO:tasks.workunit.client.0.smithi164.stdout:5/540: symlink d7/d17/d21/lad 0 2024-02-10T00:00:36.979 INFO:tasks.workunit.client.1.smithi183.stdout:0/845: creat d14/d3e/d9b/f12d x:0 0 0 2024-02-10T00:00:36.980 INFO:tasks.workunit.client.0.smithi164.stdout:1/431: dwrite d1/d13/d1f/f28 [0,4194304] 0 2024-02-10T00:00:36.980 INFO:tasks.workunit.client.0.smithi164.stdout:7/538: truncate d3/d11/d39/d44/fad 662599 0 2024-02-10T00:00:36.980 INFO:tasks.workunit.client.1.smithi183.stdout:3/713: chown d7/db/d2a/d33/d59/db6/fc2 173936371 1 2024-02-10T00:00:36.981 INFO:tasks.workunit.client.0.smithi164.stdout:1/432: write d1/d13/d2b/d54/f65 [241150,32783] 0 2024-02-10T00:00:36.981 INFO:tasks.workunit.client.0.smithi164.stdout:6/573: mknod d0/d6/d12/d57/cc1 0 2024-02-10T00:00:36.982 INFO:tasks.workunit.client.0.smithi164.stdout:6/574: readlink d0/d3b/d56/l76 0 2024-02-10T00:00:36.982 INFO:tasks.workunit.client.1.smithi183.stdout:7/760: creat d0/d11/d88/fec x:0 0 0 2024-02-10T00:00:36.982 INFO:tasks.workunit.client.1.smithi183.stdout:9/819: mkdir d0/d3/d14/d1c/d109 0 2024-02-10T00:00:36.983 INFO:tasks.workunit.client.0.smithi164.stdout:8/463: creat d2/d12/f8d x:0 0 0 2024-02-10T00:00:36.985 INFO:tasks.workunit.client.1.smithi183.stdout:0/846: fdatasync d14/d1d/d2d/f8f 0 2024-02-10T00:00:36.991 INFO:tasks.workunit.client.1.smithi183.stdout:2/954: symlink d2/da/l13c 0 2024-02-10T00:00:36.991 INFO:tasks.workunit.client.1.smithi183.stdout:7/761: mkdir d0/d11/d2f/db8/ded 0 2024-02-10T00:00:36.991 INFO:tasks.workunit.client.1.smithi183.stdout:7/762: dread - d0/d11/d88/fec zero size 2024-02-10T00:00:36.992 INFO:tasks.workunit.client.0.smithi164.stdout:2/525: fdatasync d3/f44 0 2024-02-10T00:00:36.992 INFO:tasks.workunit.client.0.smithi164.stdout:8/464: symlink d2/d12/l8e 0 2024-02-10T00:00:36.992 INFO:tasks.workunit.client.0.smithi164.stdout:5/541: truncate d7/d17/d21/d23/d5a/d68/d1f/fa5 1874254 0 2024-02-10T00:00:36.993 INFO:tasks.workunit.client.1.smithi183.stdout:7/763: dread d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:36.994 INFO:tasks.workunit.client.0.smithi164.stdout:2/526: write d3/d32/d4e/f2f [571104,60398] 0 2024-02-10T00:00:36.995 INFO:tasks.workunit.client.1.smithi183.stdout:8/888: rename d0/l8 to d0/d10/l116 0 2024-02-10T00:00:36.996 INFO:tasks.workunit.client.1.smithi183.stdout:9/820: creat d0/d3/d14/d1c/d2d/d4f/d89/dc5/f10a x:0 0 0 2024-02-10T00:00:36.997 INFO:tasks.workunit.client.0.smithi164.stdout:2/527: symlink d3/d24/d5b/lbc 0 2024-02-10T00:00:36.998 INFO:tasks.workunit.client.0.smithi164.stdout:6/575: link d0/d2b/cb5 d0/d6/d12/d14/cc2 0 2024-02-10T00:00:36.999 INFO:tasks.workunit.client.0.smithi164.stdout:2/528: write d3/d26/d56/fa4 [130235,54194] 0 2024-02-10T00:00:36.999 INFO:tasks.workunit.client.0.smithi164.stdout:8/465: getdents d2/d64/d65/d80/d32/d68 0 2024-02-10T00:00:37.000 INFO:tasks.workunit.client.1.smithi183.stdout:2/955: write d2/d8b/fb3 [1835690,127612] 0 2024-02-10T00:00:37.001 INFO:tasks.workunit.client.0.smithi164.stdout:5/542: creat d7/d17/d21/d24/fae x:0 0 0 2024-02-10T00:00:37.001 INFO:tasks.workunit.client.1.smithi183.stdout:6/729: sync 2024-02-10T00:00:37.001 INFO:tasks.workunit.client.0.smithi164.stdout:5/543: dread - d7/d17/d21/d23/d37/fa1 zero size 2024-02-10T00:00:37.002 INFO:tasks.workunit.client.0.smithi164.stdout:6/576: rmdir d0/d2b/d3a/d3d/d42/d5d 39 2024-02-10T00:00:37.002 INFO:tasks.workunit.client.0.smithi164.stdout:5/544: fdatasync d7/d17/d21/d23/d37/f4b 0 2024-02-10T00:00:37.003 INFO:tasks.workunit.client.1.smithi183.stdout:7/764: rmdir d0/d11/d2f/da3 39 2024-02-10T00:00:37.003 INFO:tasks.workunit.client.0.smithi164.stdout:2/529: rmdir d3/d24 39 2024-02-10T00:00:37.004 INFO:tasks.workunit.client.1.smithi183.stdout:5/854: dread d4/dd/f14 [4194304,4194304] 0 2024-02-10T00:00:37.004 INFO:tasks.workunit.client.0.smithi164.stdout:5/545: read - d7/d17/d21/d24/fae zero size 2024-02-10T00:00:37.005 INFO:tasks.workunit.client.1.smithi183.stdout:9/821: truncate d0/d10/f5f 736552 0 2024-02-10T00:00:37.006 INFO:tasks.workunit.client.0.smithi164.stdout:6/577: mkdir d0/d6/d4d/dc3 0 2024-02-10T00:00:37.007 INFO:tasks.workunit.client.0.smithi164.stdout:6/578: chown d0/d2b/d3a/d3d/fa3 0 1 2024-02-10T00:00:37.007 INFO:tasks.workunit.client.1.smithi183.stdout:7/765: fdatasync d0/d2/d50/d5d/f8e 0 2024-02-10T00:00:37.008 INFO:tasks.workunit.client.0.smithi164.stdout:2/530: mkdir d3/da6/d7a/d8e/d36/dbd 0 2024-02-10T00:00:37.008 INFO:tasks.workunit.client.1.smithi183.stdout:5/855: dwrite d4/d23/d3e/d80/da1/d9e/d27/d37/f101 [0,4194304] 0 2024-02-10T00:00:37.009 INFO:tasks.workunit.client.0.smithi164.stdout:5/546: mkdir d7/daf 0 2024-02-10T00:00:37.009 INFO:tasks.workunit.client.0.smithi164.stdout:5/547: stat d7/d17/d21/f89 0 2024-02-10T00:00:37.010 INFO:tasks.workunit.client.1.smithi183.stdout:5/856: chown d4/d23/d3e/d80/da1/d9e/d27/ff4 3998 1 2024-02-10T00:00:37.010 INFO:tasks.workunit.client.1.smithi183.stdout:0/847: getdents d14/d1d/d2d/d11a 0 2024-02-10T00:00:37.011 INFO:tasks.workunit.client.0.smithi164.stdout:6/579: unlink d0/d6/d12/d14/c16 0 2024-02-10T00:00:37.011 INFO:tasks.workunit.client.1.smithi183.stdout:6/730: creat d2/d1a/d3a/d45/fdd x:0 0 0 2024-02-10T00:00:37.012 INFO:tasks.workunit.client.0.smithi164.stdout:8/466: dread d2/d64/d65/d80/d32/f56 [0,4194304] 0 2024-02-10T00:00:37.012 INFO:tasks.workunit.client.1.smithi183.stdout:7/766: mknod d0/d11/cee 0 2024-02-10T00:00:37.013 INFO:tasks.workunit.client.0.smithi164.stdout:2/531: rename d3/d32/d4e/f2f to d3/da6/d7a/d8e/db6/fbe 0 2024-02-10T00:00:37.013 INFO:tasks.workunit.client.1.smithi183.stdout:7/767: chown d0/d11/d2f/dbf/fcf 22291 1 2024-02-10T00:00:37.014 INFO:tasks.workunit.client.1.smithi183.stdout:0/848: readlink d14/d1d/d2d/d31/d68/da3/lef 0 2024-02-10T00:00:37.014 INFO:tasks.workunit.client.0.smithi164.stdout:5/548: dwrite d7/d17/d79/f97 [0,4194304] 0 2024-02-10T00:00:37.014 INFO:tasks.workunit.client.0.smithi164.stdout:2/532: write d3/d26/d64/f6a [163299,51355] 0 2024-02-10T00:00:37.015 INFO:tasks.workunit.client.1.smithi183.stdout:9/822: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:37.016 INFO:tasks.workunit.client.0.smithi164.stdout:8/467: fsync d2/d12/f72 0 2024-02-10T00:00:37.019 INFO:tasks.workunit.client.0.smithi164.stdout:2/533: mknod d3/d32/d4e/d27/cbf 0 2024-02-10T00:00:37.020 INFO:tasks.workunit.client.1.smithi183.stdout:5/857: rename d4/d23/d3e/d80/da1/d9c/d72/da0/lc1 to d4/d23/d3e/d80/da1/d9e/d27/d9d/l119 0 2024-02-10T00:00:37.020 INFO:tasks.workunit.client.1.smithi183.stdout:0/849: fsync d14/d43/f78 0 2024-02-10T00:00:37.023 INFO:tasks.workunit.client.0.smithi164.stdout:8/468: link d2/d64/d65/d80/d32/f4b d2/d64/d65/d80/d32/d58/f8f 0 2024-02-10T00:00:37.024 INFO:tasks.workunit.client.1.smithi183.stdout:6/731: rename d2/d1a/la8 to d2/d1a/d25/d3c/d31/d38/lde 0 2024-02-10T00:00:37.025 INFO:tasks.workunit.client.0.smithi164.stdout:2/534: symlink d3/lc0 0 2024-02-10T00:00:37.025 INFO:tasks.workunit.client.1.smithi183.stdout:0/850: fdatasync d14/d1d/d59/d71/d22/f48 0 2024-02-10T00:00:37.027 INFO:tasks.workunit.client.0.smithi164.stdout:2/535: creat d3/d26/d64/fc1 x:0 0 0 2024-02-10T00:00:37.029 INFO:tasks.workunit.client.0.smithi164.stdout:8/469: creat d2/d64/d54/d71/f90 x:0 0 0 2024-02-10T00:00:37.030 INFO:tasks.workunit.client.1.smithi183.stdout:7/768: truncate d0/d2/d4/fbe 17832 0 2024-02-10T00:00:37.030 INFO:tasks.workunit.client.1.smithi183.stdout:7/769: dread - d0/fe1 zero size 2024-02-10T00:00:37.031 INFO:tasks.workunit.client.0.smithi164.stdout:2/536: symlink d3/da6/d7a/d8e/d88/lc2 0 2024-02-10T00:00:37.032 INFO:tasks.workunit.client.0.smithi164.stdout:2/537: chown d3/da6/d7a/d8e/db6 1975 1 2024-02-10T00:00:37.032 INFO:tasks.workunit.client.0.smithi164.stdout:5/549: dread d7/d17/d21/d23/f2d [0,4194304] 0 2024-02-10T00:00:37.033 INFO:tasks.workunit.client.0.smithi164.stdout:2/538: fdatasync d3/da6/d7a/d8e/d36/f3b 0 2024-02-10T00:00:37.033 INFO:tasks.workunit.client.0.smithi164.stdout:5/550: dread - d7/d17/d69/fa2 zero size 2024-02-10T00:00:37.034 INFO:tasks.workunit.client.1.smithi183.stdout:6/732: getdents d2/d1a/d3a 0 2024-02-10T00:00:37.034 INFO:tasks.workunit.client.1.smithi183.stdout:7/770: rmdir d0/d11/d88/d94 39 2024-02-10T00:00:37.037 INFO:tasks.workunit.client.0.smithi164.stdout:5/551: symlink d7/d17/d21/d23/d5a/d68/d1f/d70/lb0 0 2024-02-10T00:00:37.037 INFO:tasks.workunit.client.1.smithi183.stdout:6/733: creat d2/d1a/d25/d3c/d31/d66/fdf x:0 0 0 2024-02-10T00:00:37.037 INFO:tasks.workunit.client.1.smithi183.stdout:7/771: fdatasync d0/d11/d3e/fdd 0 2024-02-10T00:00:37.039 INFO:tasks.workunit.client.1.smithi183.stdout:7/772: truncate d0/d11/f57 771557 0 2024-02-10T00:00:37.040 INFO:tasks.workunit.client.0.smithi164.stdout:5/552: dwrite d7/f7f [0,4194304] 0 2024-02-10T00:00:37.041 INFO:tasks.workunit.client.1.smithi183.stdout:6/734: rename d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fca to d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fe0 0 2024-02-10T00:00:37.044 INFO:tasks.workunit.client.1.smithi183.stdout:6/735: creat d2/d1a/d25/d3c/d31/fe1 x:0 0 0 2024-02-10T00:00:37.044 INFO:tasks.workunit.client.1.smithi183.stdout:7/773: symlink d0/d11/d2f/d64/lef 0 2024-02-10T00:00:37.045 INFO:tasks.workunit.client.0.smithi164.stdout:5/553: link d7/d17/d21/d23/f72 d7/d17/d79/fb1 0 2024-02-10T00:00:37.046 INFO:tasks.workunit.client.1.smithi183.stdout:6/736: fsync d2/f15 0 2024-02-10T00:00:37.046 INFO:tasks.workunit.client.0.smithi164.stdout:3/433: sync 2024-02-10T00:00:37.048 INFO:tasks.workunit.client.1.smithi183.stdout:7/774: symlink d0/d2/d50/lf0 0 2024-02-10T00:00:37.049 INFO:tasks.workunit.client.1.smithi183.stdout:7/775: chown d0/d2/fce 11 1 2024-02-10T00:00:37.050 INFO:tasks.workunit.client.0.smithi164.stdout:3/434: mknod d0/d1/d2/d19/d27/d30/c83 0 2024-02-10T00:00:37.051 INFO:tasks.workunit.client.1.smithi183.stdout:6/737: mknod d2/d1a/d25/d3c/d31/d38/d6e/d34/ce2 0 2024-02-10T00:00:37.052 INFO:tasks.workunit.client.1.smithi183.stdout:1/760: dread d0/d3/d29/f4c [0,4194304] 0 2024-02-10T00:00:37.056 INFO:tasks.workunit.client.1.smithi183.stdout:1/761: dwrite d0/d3/d7/d3d/dcb/fd1 [0,4194304] 0 2024-02-10T00:00:37.057 INFO:tasks.workunit.client.0.smithi164.stdout:9/484: truncate d6/de/d2b/d5b/d61/f77 3422276 0 2024-02-10T00:00:37.057 INFO:tasks.workunit.client.1.smithi183.stdout:1/762: fdatasync d0/d3/d67/d70/fb7 0 2024-02-10T00:00:37.058 INFO:tasks.workunit.client.0.smithi164.stdout:9/485: write d6/d41/d8b/f1d [3277976,30622] 0 2024-02-10T00:00:37.058 INFO:tasks.workunit.client.0.smithi164.stdout:5/554: truncate d7/d17/d21/d23/d5a/d68/d1f/d59/f82 165885 0 2024-02-10T00:00:37.058 INFO:tasks.workunit.client.1.smithi183.stdout:6/738: symlink d2/d1a/d3a/le3 0 2024-02-10T00:00:37.059 INFO:tasks.workunit.client.0.smithi164.stdout:3/435: truncate d0/d1/d2/d19/f29 3677084 0 2024-02-10T00:00:37.062 INFO:tasks.workunit.client.0.smithi164.stdout:9/486: fsync d6/de/d2b/f37 0 2024-02-10T00:00:37.063 INFO:tasks.workunit.client.0.smithi164.stdout:9/487: chown d6/de/d40/d74/c83 0 1 2024-02-10T00:00:37.063 INFO:tasks.workunit.client.1.smithi183.stdout:1/763: creat d0/d3/d67/d70/f10c x:0 0 0 2024-02-10T00:00:37.064 INFO:tasks.workunit.client.0.smithi164.stdout:8/470: dread d2/f29 [0,4194304] 0 2024-02-10T00:00:37.065 INFO:tasks.workunit.client.1.smithi183.stdout:4/871: truncate de/d22/f28 2759775 0 2024-02-10T00:00:37.066 INFO:tasks.workunit.client.0.smithi164.stdout:3/436: rename d0/d1/d3c/d3d/d51 to d0/d1/d2/d19/d66/d84 0 2024-02-10T00:00:37.067 INFO:tasks.workunit.client.1.smithi183.stdout:1/764: dwrite d0/d3/d7/d3d/fac [0,4194304] 0 2024-02-10T00:00:37.069 INFO:tasks.workunit.client.0.smithi164.stdout:7/539: dread d3/f1d [0,4194304] 0 2024-02-10T00:00:37.070 INFO:tasks.workunit.client.0.smithi164.stdout:0/473: write d6/d3a/d52/d7a/f94 [340500,22339] 0 2024-02-10T00:00:37.070 INFO:tasks.workunit.client.0.smithi164.stdout:7/540: readlink d3/d11/d39/d3a/l4c 0 2024-02-10T00:00:37.076 INFO:tasks.workunit.client.0.smithi164.stdout:1/433: write d1/f6 [76045,122354] 0 2024-02-10T00:00:37.076 INFO:tasks.workunit.client.1.smithi183.stdout:2/956: write d2/da/f7d [3077594,96335] 0 2024-02-10T00:00:37.078 INFO:tasks.workunit.client.1.smithi183.stdout:2/957: chown d2/da/d77/dc7/f138 1205500 1 2024-02-10T00:00:37.078 INFO:tasks.workunit.client.1.smithi183.stdout:3/714: dwrite d7/db/f13 [0,4194304] 0 2024-02-10T00:00:37.079 INFO:tasks.workunit.client.1.smithi183.stdout:2/958: read - d2/d2c/dba/fc9 zero size 2024-02-10T00:00:37.080 INFO:tasks.workunit.client.1.smithi183.stdout:4/872: symlink de/d22/l10e 0 2024-02-10T00:00:37.081 INFO:tasks.workunit.client.0.smithi164.stdout:6/580: write d0/f17 [2138069,52879] 0 2024-02-10T00:00:37.083 INFO:tasks.workunit.client.1.smithi183.stdout:1/765: unlink d0/d3/da9/fab 0 2024-02-10T00:00:37.087 INFO:tasks.workunit.client.0.smithi164.stdout:8/471: truncate d2/f49 60878 0 2024-02-10T00:00:37.087 INFO:tasks.workunit.client.0.smithi164.stdout:3/437: fdatasync d0/d1/f11 0 2024-02-10T00:00:37.089 INFO:tasks.workunit.client.1.smithi183.stdout:5/858: getdents d4/d23/d3e/d80/da1/d9e/d27/d9d 0 2024-02-10T00:00:37.089 INFO:tasks.workunit.client.1.smithi183.stdout:9/823: truncate d0/d10/fa9 1686648 0 2024-02-10T00:00:37.090 INFO:tasks.workunit.client.0.smithi164.stdout:0/474: dread - d6/f3d zero size 2024-02-10T00:00:37.090 INFO:tasks.workunit.client.0.smithi164.stdout:5/555: truncate d7/d17/d21/d23/d37/d36/f81 293063 0 2024-02-10T00:00:37.092 INFO:tasks.workunit.client.0.smithi164.stdout:6/581: stat d0/d6/d12/d45/c4c 0 2024-02-10T00:00:37.093 INFO:tasks.workunit.client.1.smithi183.stdout:0/851: dwrite d14/d3e/d5f/daa/ddd/f104 [0,4194304] 0 2024-02-10T00:00:37.093 INFO:tasks.workunit.client.0.smithi164.stdout:2/539: dwrite d3/d32/d4e/d27/f74 [0,4194304] 0 2024-02-10T00:00:37.093 INFO:tasks.workunit.client.1.smithi183.stdout:0/852: chown d14/d1d/d55 4312781 1 2024-02-10T00:00:37.094 INFO:tasks.workunit.client.1.smithi183.stdout:0/853: chown d14/d1d/d2d/d31/d6c 125344 1 2024-02-10T00:00:37.095 INFO:tasks.workunit.client.0.smithi164.stdout:8/472: rename d2/d12/l14 to d2/d64/d65/l91 0 2024-02-10T00:00:37.095 INFO:tasks.workunit.client.1.smithi183.stdout:0/854: write d14/d1d/d2d/d31/d6c/de3/f94 [3693101,110496] 0 2024-02-10T00:00:37.096 INFO:tasks.workunit.client.1.smithi183.stdout:6/739: rename d2/d1a/d25/d3c/d31/fa7 to d2/d1a/d25/d3c/d31/d38/d6e/d34/fe4 0 2024-02-10T00:00:37.096 INFO:tasks.workunit.client.0.smithi164.stdout:9/488: rmdir d6/de/d40/d54 0 2024-02-10T00:00:37.098 INFO:tasks.workunit.client.0.smithi164.stdout:9/489: write d6/de/d22/f26 [5005573,50450] 0 2024-02-10T00:00:37.102 INFO:tasks.workunit.client.1.smithi183.stdout:7/776: write d0/d2/d4/d8/d59/d8a/fa9 [999251,110894] 0 2024-02-10T00:00:37.104 INFO:tasks.workunit.client.0.smithi164.stdout:1/434: mkdir d1/d95 0 2024-02-10T00:00:37.105 INFO:tasks.workunit.client.0.smithi164.stdout:5/556: symlink d7/d17/d21/d85/lb2 0 2024-02-10T00:00:37.106 INFO:tasks.workunit.client.0.smithi164.stdout:4/495: sync 2024-02-10T00:00:37.106 INFO:tasks.workunit.client.0.smithi164.stdout:4/496: chown d2/d2f/f51 204 1 2024-02-10T00:00:37.107 INFO:tasks.workunit.client.0.smithi164.stdout:4/497: write d2/d19/d16/f53 [1102411,54494] 0 2024-02-10T00:00:37.108 INFO:tasks.workunit.client.0.smithi164.stdout:2/540: symlink d3/da6/d7a/d8e/d36/d90/lc3 0 2024-02-10T00:00:37.109 INFO:tasks.workunit.client.1.smithi183.stdout:5/859: mknod d4/d23/d4a/c11a 0 2024-02-10T00:00:37.113 INFO:tasks.workunit.client.0.smithi164.stdout:3/438: rename d0/d1/d3c/d3d/f47 to d0/d1/d2/d19/d27/d5f/f85 0 2024-02-10T00:00:37.113 INFO:tasks.workunit.client.1.smithi183.stdout:2/959: creat d2/d8b/d11f/f13d x:0 0 0 2024-02-10T00:00:37.114 INFO:tasks.workunit.client.1.smithi183.stdout:6/740: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/c86 1637372145 1 2024-02-10T00:00:37.116 INFO:tasks.workunit.client.0.smithi164.stdout:9/490: creat d6/de/d2b/d5b/f94 x:0 0 0 2024-02-10T00:00:37.117 INFO:tasks.workunit.client.0.smithi164.stdout:0/475: symlink d6/d10/d18/d2d/d35/l9c 0 2024-02-10T00:00:37.117 INFO:tasks.workunit.client.0.smithi164.stdout:9/491: write d6/d41/d8b/d24/f84 [533135,51752] 0 2024-02-10T00:00:37.118 INFO:tasks.workunit.client.0.smithi164.stdout:3/439: dread d0/d1/dd/f1f [0,4194304] 0 2024-02-10T00:00:37.118 INFO:tasks.workunit.client.1.smithi183.stdout:4/873: creat de/d14/d27/d40/d108/f10f x:0 0 0 2024-02-10T00:00:37.119 INFO:tasks.workunit.client.0.smithi164.stdout:3/440: write d0/d1/d3c/f7c [4614118,86396] 0 2024-02-10T00:00:37.119 INFO:tasks.workunit.client.1.smithi183.stdout:4/874: write de/d14/d1d/d2f/da2/d9c/df5/f102 [1799404,37974] 0 2024-02-10T00:00:37.120 INFO:tasks.workunit.client.1.smithi183.stdout:4/875: chown de/d14/d4e/fee 1774 1 2024-02-10T00:00:37.120 INFO:tasks.workunit.client.1.smithi183.stdout:4/876: fdatasync de/fe3 0 2024-02-10T00:00:37.121 INFO:tasks.workunit.client.1.smithi183.stdout:0/855: mkdir d14/d1d/d2d/d31/d68/d129/d12e 0 2024-02-10T00:00:37.122 INFO:tasks.workunit.client.0.smithi164.stdout:1/435: write d1/d23/f92 [1290935,104988] 0 2024-02-10T00:00:37.122 INFO:tasks.workunit.client.1.smithi183.stdout:4/877: write de/d19/d1c/fc1 [3674209,111161] 0 2024-02-10T00:00:37.122 INFO:tasks.workunit.client.0.smithi164.stdout:5/557: mkdir d7/d17/d3b/d45/db3 0 2024-02-10T00:00:37.123 INFO:tasks.workunit.client.1.smithi183.stdout:9/824: rename d0/d3/d14/d3c/ldd to d0/d30/d52/ddc/de1/l10b 0 2024-02-10T00:00:37.124 INFO:tasks.workunit.client.0.smithi164.stdout:3/441: dwrite d0/d1/d3c/d3d/d6b/f74 [0,4194304] 0 2024-02-10T00:00:37.124 INFO:tasks.workunit.client.1.smithi183.stdout:9/825: write d0/d10/f53 [50675,75861] 0 2024-02-10T00:00:37.125 INFO:tasks.workunit.client.1.smithi183.stdout:3/715: creat d7/db/d2a/d1c/fcd x:0 0 0 2024-02-10T00:00:37.125 INFO:tasks.workunit.client.0.smithi164.stdout:2/541: write d3/d24/d5b/f8f [195540,82209] 0 2024-02-10T00:00:37.126 INFO:tasks.workunit.client.1.smithi183.stdout:3/716: chown d7/db/d2a/d2d/d51/d8f/ca6 446494 1 2024-02-10T00:00:37.127 INFO:tasks.workunit.client.0.smithi164.stdout:2/542: stat d3/da6/f31 0 2024-02-10T00:00:37.127 INFO:tasks.workunit.client.0.smithi164.stdout:8/473: mknod d2/d64/d65/d80/c92 0 2024-02-10T00:00:37.130 INFO:tasks.workunit.client.0.smithi164.stdout:9/492: creat d6/de/d40/f95 x:0 0 0 2024-02-10T00:00:37.131 INFO:tasks.workunit.client.1.smithi183.stdout:0/856: mknod d14/d1d/d55/c12f 0 2024-02-10T00:00:37.132 INFO:tasks.workunit.client.0.smithi164.stdout:7/541: sync 2024-02-10T00:00:37.132 INFO:tasks.workunit.client.0.smithi164.stdout:1/436: chown d1/d13/l4b 411707 1 2024-02-10T00:00:37.134 INFO:tasks.workunit.client.1.smithi183.stdout:6/741: stat d2/d1a/d3a/d45/caa 0 2024-02-10T00:00:37.135 INFO:tasks.workunit.client.1.smithi183.stdout:4/878: symlink de/d14/d27/d2e/d10d/l110 0 2024-02-10T00:00:37.136 INFO:tasks.workunit.client.1.smithi183.stdout:4/879: write de/d19/fd1 [1849048,71201] 0 2024-02-10T00:00:37.136 INFO:tasks.workunit.client.0.smithi164.stdout:1/437: dread d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:37.137 INFO:tasks.workunit.client.1.smithi183.stdout:5/860: getdents d4/d23/d3e/d80/da1/d9c/d72/da0 0 2024-02-10T00:00:37.139 INFO:tasks.workunit.client.0.smithi164.stdout:2/543: fsync d3/d24/f46 0 2024-02-10T00:00:37.140 INFO:tasks.workunit.client.0.smithi164.stdout:0/476: mkdir d6/d10/d18/d2d/d35/d44/d90/d9d 0 2024-02-10T00:00:37.141 INFO:tasks.workunit.client.1.smithi183.stdout:4/880: dwrite de/d19/f30 [4194304,4194304] 0 2024-02-10T00:00:37.141 INFO:tasks.workunit.client.0.smithi164.stdout:9/493: mknod d6/de/d22/d58/c96 0 2024-02-10T00:00:37.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/766: write d0/d3/d7/d3d/f5b [667456,11473] 0 2024-02-10T00:00:37.142 INFO:tasks.workunit.client.1.smithi183.stdout:8/889: truncate d0/d3f/f79 327193 0 2024-02-10T00:00:37.144 INFO:tasks.workunit.client.0.smithi164.stdout:7/542: unlink d3/d5/d2b/d4a/f96 0 2024-02-10T00:00:37.144 INFO:tasks.workunit.client.1.smithi183.stdout:2/960: write d2/d2c/d2f/d60/fb9 [446441,98613] 0 2024-02-10T00:00:37.146 INFO:tasks.workunit.client.0.smithi164.stdout:1/438: mknod d1/d1a/d41/d18/d33/c96 0 2024-02-10T00:00:37.147 INFO:tasks.workunit.client.0.smithi164.stdout:4/498: write d2/d2f/d37/d71/f93 [854131,120953] 0 2024-02-10T00:00:37.148 INFO:tasks.workunit.client.1.smithi183.stdout:7/777: rename d0/d2/fdf to d0/d2/d50/ff1 0 2024-02-10T00:00:37.149 INFO:tasks.workunit.client.0.smithi164.stdout:2/544: write d3/da6/d7a/d8e/d36/d54/f55 [3802496,51388] 0 2024-02-10T00:00:37.149 INFO:tasks.workunit.client.0.smithi164.stdout:0/477: symlink d6/d10/d18/d2d/d35/d44/d49/l9e 0 2024-02-10T00:00:37.151 INFO:tasks.workunit.client.1.smithi183.stdout:7/778: dread d0/d11/f36 [0,4194304] 0 2024-02-10T00:00:37.151 INFO:tasks.workunit.client.0.smithi164.stdout:9/494: fdatasync d6/de/d2b/f80 0 2024-02-10T00:00:37.151 INFO:tasks.workunit.client.1.smithi183.stdout:9/826: link d0/d3/d14/d1c/d2d/d4f/d89/f9b d0/d3/d14/d1c/f10c 0 2024-02-10T00:00:37.152 INFO:tasks.workunit.client.0.smithi164.stdout:0/478: stat d6/d7/d14/l16 0 2024-02-10T00:00:37.152 INFO:tasks.workunit.client.0.smithi164.stdout:3/442: dread d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:37.152 INFO:tasks.workunit.client.1.smithi183.stdout:9/827: write d0/d3/d14/d1c/d4b/d51/f7d [826371,19529] 0 2024-02-10T00:00:37.153 INFO:tasks.workunit.client.0.smithi164.stdout:6/582: getdents d0/d2b/d3a/d3d/d42/d5d 0 2024-02-10T00:00:37.153 INFO:tasks.workunit.client.1.smithi183.stdout:5/861: creat d4/d23/d3e/d80/f11b x:0 0 0 2024-02-10T00:00:37.153 INFO:tasks.workunit.client.0.smithi164.stdout:1/439: dwrite d1/d13/d2b/d52/f6b [0,4194304] 0 2024-02-10T00:00:37.154 INFO:tasks.workunit.client.1.smithi183.stdout:5/862: readlink d4/d23/d4a/d36/l77 0 2024-02-10T00:00:37.157 INFO:tasks.workunit.client.1.smithi183.stdout:4/881: unlink de/d14/d27/d2e/f3f 0 2024-02-10T00:00:37.158 INFO:tasks.workunit.client.0.smithi164.stdout:1/440: write d1/d1a/f85 [278314,46487] 0 2024-02-10T00:00:37.158 INFO:tasks.workunit.client.0.smithi164.stdout:4/499: mkdir d2/d19/d16/daa 0 2024-02-10T00:00:37.159 INFO:tasks.workunit.client.0.smithi164.stdout:0/479: rmdir d6/d3a/d97 39 2024-02-10T00:00:37.159 INFO:tasks.workunit.client.1.smithi183.stdout:8/890: fsync d0/d27/d75/d5b/fe0 0 2024-02-10T00:00:37.159 INFO:tasks.workunit.client.0.smithi164.stdout:5/558: dread d7/d17/d21/d23/d5a/f74 [0,4194304] 0 2024-02-10T00:00:37.160 INFO:tasks.workunit.client.0.smithi164.stdout:2/545: dwrite d3/d26/d56/fa4 [0,4194304] 0 2024-02-10T00:00:37.161 INFO:tasks.workunit.client.1.smithi183.stdout:3/717: rename d7/f12 to d7/db/d2a/d2d/d6a/fce 0 2024-02-10T00:00:37.161 INFO:tasks.workunit.client.0.smithi164.stdout:0/480: read d6/d3a/d52/d7a/f4e [2738670,69940] 0 2024-02-10T00:00:37.162 INFO:tasks.workunit.client.0.smithi164.stdout:5/559: write d7/d17/d21/d23/d37/f4b [4192351,112946] 0 2024-02-10T00:00:37.163 INFO:tasks.workunit.client.0.smithi164.stdout:9/495: mknod d6/de/d2b/d5b/d61/d76/d82/c97 0 2024-02-10T00:00:37.163 INFO:tasks.workunit.client.0.smithi164.stdout:5/560: stat d7/d17/d21/l3c 0 2024-02-10T00:00:37.164 INFO:tasks.workunit.client.0.smithi164.stdout:3/443: symlink d0/d1/d2/d19/d27/d30/l86 0 2024-02-10T00:00:37.165 INFO:tasks.workunit.client.0.smithi164.stdout:0/481: write d6/d10/d4a/d60/d6c/f7e [584730,32820] 0 2024-02-10T00:00:37.166 INFO:tasks.workunit.client.0.smithi164.stdout:8/474: dread d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:37.167 INFO:tasks.workunit.client.0.smithi164.stdout:4/500: dwrite d2/d19/d16/f3f [0,4194304] 0 2024-02-10T00:00:37.168 INFO:tasks.workunit.client.1.smithi183.stdout:6/742: rename d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c9c to d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/ce5 0 2024-02-10T00:00:37.168 INFO:tasks.workunit.client.1.smithi183.stdout:9/828: dread d0/d3/d14/d1c/f10c [0,4194304] 0 2024-02-10T00:00:37.169 INFO:tasks.workunit.client.1.smithi183.stdout:9/829: write d0/d3/d14/d74/da8/fba [5347062,40360] 0 2024-02-10T00:00:37.169 INFO:tasks.workunit.client.1.smithi183.stdout:9/830: chown d0/d92/db7 5 1 2024-02-10T00:00:37.170 INFO:tasks.workunit.client.1.smithi183.stdout:9/831: chown d0/d3/d14/d1c/cbc 118591 1 2024-02-10T00:00:37.170 INFO:tasks.workunit.client.1.smithi183.stdout:8/891: symlink d0/d4e/d6b/l117 0 2024-02-10T00:00:37.172 INFO:tasks.workunit.client.1.smithi183.stdout:7/779: creat d0/d2/d4/ff2 x:0 0 0 2024-02-10T00:00:37.173 INFO:tasks.workunit.client.1.smithi183.stdout:7/780: write d0/d11/d3e/f89 [4326834,51703] 0 2024-02-10T00:00:37.179 INFO:tasks.workunit.client.0.smithi164.stdout:4/501: dread d2/d2f/d37/d71/f93 [0,4194304] 0 2024-02-10T00:00:37.180 INFO:tasks.workunit.client.0.smithi164.stdout:1/441: dread d1/d1a/f73 [0,4194304] 0 2024-02-10T00:00:37.180 INFO:tasks.workunit.client.0.smithi164.stdout:5/561: mknod d7/d17/d21/d23/d5a/cb4 0 2024-02-10T00:00:37.182 INFO:tasks.workunit.client.1.smithi183.stdout:6/743: chown d2/d1a/d3a/l55 61 1 2024-02-10T00:00:37.183 INFO:tasks.workunit.client.1.smithi183.stdout:2/961: dwrite d2/d8b/feb [0,4194304] 0 2024-02-10T00:00:37.183 INFO:tasks.workunit.client.0.smithi164.stdout:0/482: fdatasync d6/d10/d18/d2d/d35/f41 0 2024-02-10T00:00:37.184 INFO:tasks.workunit.client.0.smithi164.stdout:7/543: write d3/d11/d39/d44/fad [1092243,43876] 0 2024-02-10T00:00:37.185 INFO:tasks.workunit.client.1.smithi183.stdout:4/882: truncate de/d19/d1c/f36 4292552 0 2024-02-10T00:00:37.185 INFO:tasks.workunit.client.1.smithi183.stdout:0/857: sync 2024-02-10T00:00:37.185 INFO:tasks.workunit.client.1.smithi183.stdout:4/883: chown de/fe3 14944 1 2024-02-10T00:00:37.186 INFO:tasks.workunit.client.0.smithi164.stdout:6/583: write d0/d2b/d3a/d3d/d42/d5d/d79/fae [1123460,67213] 0 2024-02-10T00:00:37.186 INFO:tasks.workunit.client.1.smithi183.stdout:4/884: write de/d19/fe0 [660550,104150] 0 2024-02-10T00:00:37.187 INFO:tasks.workunit.client.0.smithi164.stdout:1/442: dread d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:37.187 INFO:tasks.workunit.client.0.smithi164.stdout:8/475: write d2/d12/f24 [379013,2871] 0 2024-02-10T00:00:37.187 INFO:tasks.workunit.client.0.smithi164.stdout:6/584: write d0/d2b/f7e [122817,79749] 0 2024-02-10T00:00:37.187 INFO:tasks.workunit.client.1.smithi183.stdout:9/832: symlink d0/d3/l10d 0 2024-02-10T00:00:37.188 INFO:tasks.workunit.client.1.smithi183.stdout:9/833: write d0/d3/d14/d48/fff [1015854,17106] 0 2024-02-10T00:00:37.188 INFO:tasks.workunit.client.1.smithi183.stdout:8/892: symlink d0/d4e/d53/l118 0 2024-02-10T00:00:37.190 INFO:tasks.workunit.client.0.smithi164.stdout:3/444: creat d0/d1/d2/d19/d66/d84/d82/f87 x:0 0 0 2024-02-10T00:00:37.190 INFO:tasks.workunit.client.0.smithi164.stdout:5/562: rmdir d7/d17/d21/d23/d5a/d68/d1f/d70 39 2024-02-10T00:00:37.191 INFO:tasks.workunit.client.0.smithi164.stdout:8/476: dread d2/d64/d65/d80/d32/d58/f5c [0,4194304] 0 2024-02-10T00:00:37.193 INFO:tasks.workunit.client.1.smithi183.stdout:5/863: getdents d4/d23/d3e/d80/da1 0 2024-02-10T00:00:37.194 INFO:tasks.workunit.client.0.smithi164.stdout:7/544: fdatasync d3/d11/d39/d44/d48/f78 0 2024-02-10T00:00:37.194 INFO:tasks.workunit.client.0.smithi164.stdout:1/443: chown d1/d1a/d41/d18/l1e 64054 1 2024-02-10T00:00:37.195 INFO:tasks.workunit.client.0.smithi164.stdout:4/502: getdents d2/d19/d16/daa 0 2024-02-10T00:00:37.195 INFO:tasks.workunit.client.1.smithi183.stdout:6/744: creat d2/d1a/d25/d3c/d31/d38/d3f/d5e/fe6 x:0 0 0 2024-02-10T00:00:37.196 INFO:tasks.workunit.client.0.smithi164.stdout:2/546: getdents d3/d24 0 2024-02-10T00:00:37.196 INFO:tasks.workunit.client.0.smithi164.stdout:1/444: write d1/f7 [4018469,65307] 0 2024-02-10T00:00:37.197 INFO:tasks.workunit.client.1.smithi183.stdout:4/885: symlink de/d14/d1d/d2f/da2/d9c/df5/l111 0 2024-02-10T00:00:37.198 INFO:tasks.workunit.client.0.smithi164.stdout:0/483: dwrite d6/f15 [0,4194304] 0 2024-02-10T00:00:37.198 INFO:tasks.workunit.client.0.smithi164.stdout:2/547: readlink d3/d24/d51/lba 0 2024-02-10T00:00:37.199 INFO:tasks.workunit.client.1.smithi183.stdout:1/767: rename d0/d3/f12 to d0/d3/d7/f10d 0 2024-02-10T00:00:37.199 INFO:tasks.workunit.client.1.smithi183.stdout:3/718: dwrite d7/db/d2a/d2d/d51/f97 [0,4194304] 0 2024-02-10T00:00:37.200 INFO:tasks.workunit.client.1.smithi183.stdout:8/893: dread - d0/d3f/db2/f2c zero size 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.1.smithi183.stdout:1/768: write d0/d3/f84 [2796454,34785] 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.1.smithi183.stdout:9/834: symlink d0/d3/d14/d1c/d2d/l10e 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.1.smithi183.stdout:5/864: fsync d4/d23/d3e/d80/da1/d9e/d27/f108 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.1.smithi183.stdout:2/962: symlink d2/da/d20/d21/d36/dfa/l13e 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.0.smithi164.stdout:7/545: dwrite d3/d11/d39/d44/d48/d50/d92/f99 [4194304,4194304] 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.0.smithi164.stdout:5/563: mknod d7/d17/d3b/d45/dab/cb5 0 2024-02-10T00:00:37.205 INFO:tasks.workunit.client.0.smithi164.stdout:5/564: read - d7/d17/d79/f86 zero size 2024-02-10T00:00:37.206 INFO:tasks.workunit.client.0.smithi164.stdout:4/503: mkdir d2/d2f/d37/d45/dab 0 2024-02-10T00:00:37.206 INFO:tasks.workunit.client.0.smithi164.stdout:4/504: readlink d2/l91 0 2024-02-10T00:00:37.206 INFO:tasks.workunit.client.1.smithi183.stdout:6/745: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/le7 0 2024-02-10T00:00:37.206 INFO:tasks.workunit.client.0.smithi164.stdout:9/496: sync 2024-02-10T00:00:37.207 INFO:tasks.workunit.client.0.smithi164.stdout:0/484: mknod d6/d3a/d52/c9f 0 2024-02-10T00:00:37.207 INFO:tasks.workunit.client.1.smithi183.stdout:4/886: mkdir de/d19/d8d/d112 0 2024-02-10T00:00:37.207 INFO:tasks.workunit.client.1.smithi183.stdout:5/865: dread - d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded/ffb zero size 2024-02-10T00:00:37.207 INFO:tasks.workunit.client.0.smithi164.stdout:9/497: chown d6/de/d22/d58/c63 1574 1 2024-02-10T00:00:37.209 INFO:tasks.workunit.client.0.smithi164.stdout:3/445: link d0/d1/d2/d19/f56 d0/d1/d2/d19/d66/d84/f88 0 2024-02-10T00:00:37.209 INFO:tasks.workunit.client.1.smithi183.stdout:3/719: write d7/db/fca [650965,84806] 0 2024-02-10T00:00:37.210 INFO:tasks.workunit.client.1.smithi183.stdout:8/894: dwrite d0/d27/d75/d5b/fe0 [0,4194304] 0 2024-02-10T00:00:37.210 INFO:tasks.workunit.client.1.smithi183.stdout:1/769: dwrite d0/d3/d7/d3d/fac [0,4194304] 0 2024-02-10T00:00:37.211 INFO:tasks.workunit.client.0.smithi164.stdout:7/546: symlink d3/d26/d67/d98/lb1 0 2024-02-10T00:00:37.213 INFO:tasks.workunit.client.0.smithi164.stdout:5/565: creat d7/d17/d3b/d45/d5c/fb6 x:0 0 0 2024-02-10T00:00:37.213 INFO:tasks.workunit.client.0.smithi164.stdout:5/566: fsync d7/d17/f3f 0 2024-02-10T00:00:37.214 INFO:tasks.workunit.client.1.smithi183.stdout:2/963: mkdir d2/d2c/dab/d132/d13f 0 2024-02-10T00:00:37.214 INFO:tasks.workunit.client.1.smithi183.stdout:6/746: creat d2/d1a/d25/d3c/fe8 x:0 0 0 2024-02-10T00:00:37.215 INFO:tasks.workunit.client.0.smithi164.stdout:5/567: read d7/d17/d21/f89 [187950,21356] 0 2024-02-10T00:00:37.215 INFO:tasks.workunit.client.0.smithi164.stdout:0/485: symlink d6/d10/d66/la0 0 2024-02-10T00:00:37.215 INFO:tasks.workunit.client.0.smithi164.stdout:5/568: chown d7/d17/d21/d23/c66 919 1 2024-02-10T00:00:37.216 INFO:tasks.workunit.client.1.smithi183.stdout:0/858: getdents d14/d3e/d92 0 2024-02-10T00:00:37.216 INFO:tasks.workunit.client.1.smithi183.stdout:4/887: dwrite de/d14/d1d/d2f/da2/d9c/f101 [0,4194304] 0 2024-02-10T00:00:37.218 INFO:tasks.workunit.client.1.smithi183.stdout:4/888: fsync de/d14/d1d/fbd 0 2024-02-10T00:00:37.220 INFO:tasks.workunit.client.1.smithi183.stdout:4/889: write de/d14/d1d/d7b/f8f [2637188,98207] 0 2024-02-10T00:00:37.222 INFO:tasks.workunit.client.1.smithi183.stdout:4/890: stat de/d19/d20/de6/df7 0 2024-02-10T00:00:37.224 INFO:tasks.workunit.client.0.smithi164.stdout:0/486: dread d6/d3a/d52/d7a/f94 [0,4194304] 0 2024-02-10T00:00:37.225 INFO:tasks.workunit.client.0.smithi164.stdout:7/547: write d3/f16 [4333600,40901] 0 2024-02-10T00:00:37.225 INFO:tasks.workunit.client.1.smithi183.stdout:5/866: rename d4/d23/d2a/ce0 to d4/d10c/c11c 0 2024-02-10T00:00:37.225 INFO:tasks.workunit.client.1.smithi183.stdout:0/859: mkdir d14/d3e/d5f/daa/ddd/d130 0 2024-02-10T00:00:37.226 INFO:tasks.workunit.client.1.smithi183.stdout:5/867: stat d4/dd/f25 0 2024-02-10T00:00:37.226 INFO:tasks.workunit.client.1.smithi183.stdout:6/747: unlink d2/d1a/d25/d3c/d31/d38/d3f/d5e/fe6 0 2024-02-10T00:00:37.227 INFO:tasks.workunit.client.0.smithi164.stdout:8/477: dwrite d2/d64/d65/d80/d32/d58/f8f [0,4194304] 0 2024-02-10T00:00:37.227 INFO:tasks.workunit.client.0.smithi164.stdout:1/445: rmdir d1/d13/d2b/d54/d60 0 2024-02-10T00:00:37.228 INFO:tasks.workunit.client.1.smithi183.stdout:4/891: dwrite de/d22/fac [0,4194304] 0 2024-02-10T00:00:37.228 INFO:tasks.workunit.client.0.smithi164.stdout:4/505: symlink d2/d19/d16/daa/lac 0 2024-02-10T00:00:37.229 INFO:tasks.workunit.client.1.smithi183.stdout:2/964: creat d2/d2c/dba/df0/dbe/de7/f140 x:0 0 0 2024-02-10T00:00:37.233 INFO:tasks.workunit.client.1.smithi183.stdout:0/860: dwrite d14/d3e/d5f/daa/ddd/f104 [0,4194304] 0 2024-02-10T00:00:37.234 INFO:tasks.workunit.client.1.smithi183.stdout:1/770: rename d0/f8e to d0/d3/d67/d7b/dfe/d7c/db1/d100/f10e 0 2024-02-10T00:00:37.235 INFO:tasks.workunit.client.0.smithi164.stdout:2/548: link d3/l1d d3/da6/d7a/d8e/d8a/lc4 0 2024-02-10T00:00:37.235 INFO:tasks.workunit.client.0.smithi164.stdout:0/487: rmdir d6/d10/d18/d2d/d39 39 2024-02-10T00:00:37.235 INFO:tasks.workunit.client.0.smithi164.stdout:7/548: mknod d3/d11/cb2 0 2024-02-10T00:00:37.235 INFO:tasks.workunit.client.0.smithi164.stdout:2/549: dread - d3/d32/fa0 zero size 2024-02-10T00:00:37.237 INFO:tasks.workunit.client.0.smithi164.stdout:6/585: dread d0/d2b/d3a/d3d/d42/d5d/d79/d92/f8a [4194304,4194304] 0 2024-02-10T00:00:37.237 INFO:tasks.workunit.client.0.smithi164.stdout:2/550: dread - d3/da6/d7a/d8e/d36/f96 zero size 2024-02-10T00:00:37.237 INFO:tasks.workunit.client.1.smithi183.stdout:7/781: rmdir d0/d2 39 2024-02-10T00:00:37.238 INFO:tasks.workunit.client.1.smithi183.stdout:7/782: write d0/d11/d2f/dbf/fd8 [58931,119283] 0 2024-02-10T00:00:37.240 INFO:tasks.workunit.client.0.smithi164.stdout:5/569: mknod d7/d17/d69/d92/da8/cb7 0 2024-02-10T00:00:37.241 INFO:tasks.workunit.client.0.smithi164.stdout:6/586: dwrite d0/d6/d12/d14/f61 [0,4194304] 0 2024-02-10T00:00:37.244 INFO:tasks.workunit.client.1.smithi183.stdout:0/861: rmdir d14/d1d/d55/d6e/d74 39 2024-02-10T00:00:37.245 INFO:tasks.workunit.client.1.smithi183.stdout:9/835: dread d0/d3/d14/d74/da8/fbd [0,4194304] 0 2024-02-10T00:00:37.245 INFO:tasks.workunit.client.0.smithi164.stdout:6/587: dwrite d0/d2b/d3a/d3d/f74 [0,4194304] 0 2024-02-10T00:00:37.246 INFO:tasks.workunit.client.1.smithi183.stdout:9/836: dread - d0/d30/d52/fe4 zero size 2024-02-10T00:00:37.247 INFO:tasks.workunit.client.0.smithi164.stdout:3/446: creat d0/d1/f89 x:0 0 0 2024-02-10T00:00:37.247 INFO:tasks.workunit.client.0.smithi164.stdout:8/478: mkdir d2/d64/d65/d80/d32/d93 0 2024-02-10T00:00:37.248 INFO:tasks.workunit.client.0.smithi164.stdout:8/479: fdatasync d2/d64/d65/d80/d32/d58/f79 0 2024-02-10T00:00:37.248 INFO:tasks.workunit.client.1.smithi183.stdout:6/748: rename d2/f7 to d2/d1a/d25/d3c/d8d/fe9 0 2024-02-10T00:00:37.249 INFO:tasks.workunit.client.1.smithi183.stdout:1/771: symlink d0/d3/d67/d70/dae/l10f 0 2024-02-10T00:00:37.249 INFO:tasks.workunit.client.1.smithi183.stdout:7/783: symlink d0/d11/d2f/db8/lf3 0 2024-02-10T00:00:37.249 INFO:tasks.workunit.client.1.smithi183.stdout:7/784: dread - d0/d11/d2f/dbf/fcf zero size 2024-02-10T00:00:37.249 INFO:tasks.workunit.client.0.smithi164.stdout:8/480: chown d2/d64/d65 5 1 2024-02-10T00:00:37.251 INFO:tasks.workunit.client.0.smithi164.stdout:1/446: link d1/d1a/d41/d18/f3e d1/d23/f97 0 2024-02-10T00:00:37.251 INFO:tasks.workunit.client.1.smithi183.stdout:8/895: truncate d0/d3f/f79 675695 0 2024-02-10T00:00:37.254 INFO:tasks.workunit.client.0.smithi164.stdout:4/506: link d2/d5a/d94/f96 d2/d2f/d37/d41/d3d/d42/d5f/fad 0 2024-02-10T00:00:37.254 INFO:tasks.workunit.client.1.smithi183.stdout:8/896: dread d0/d27/d75/d5b/fe0 [0,4194304] 0 2024-02-10T00:00:37.255 INFO:tasks.workunit.client.1.smithi183.stdout:8/897: chown d0/d3f/db2/d24/f28 759603732 1 2024-02-10T00:00:37.256 INFO:tasks.workunit.client.0.smithi164.stdout:9/498: sync 2024-02-10T00:00:37.257 INFO:tasks.workunit.client.1.smithi183.stdout:4/892: rename de/d22/fac to de/d14/d1d/d2f/da2/db6/f113 0 2024-02-10T00:00:37.257 INFO:tasks.workunit.client.1.smithi183.stdout:6/749: fsync d2/d1a/d25/d3c/f42 0 2024-02-10T00:00:37.260 INFO:tasks.workunit.client.0.smithi164.stdout:8/481: mknod d2/d64/d54/d71/d78/c94 0 2024-02-10T00:00:37.261 INFO:tasks.workunit.client.0.smithi164.stdout:8/482: read d2/d64/d65/d80/d32/f4b [3437221,83097] 0 2024-02-10T00:00:37.261 INFO:tasks.workunit.client.0.smithi164.stdout:2/551: truncate d3/d26/d64/fa5 1724144 0 2024-02-10T00:00:37.262 INFO:tasks.workunit.client.1.smithi183.stdout:0/862: mknod d14/d3e/d5f/daa/ddd/d130/c131 0 2024-02-10T00:00:37.263 INFO:tasks.workunit.client.0.smithi164.stdout:2/552: chown d3/d26/d64/f9c 796993 1 2024-02-10T00:00:37.263 INFO:tasks.workunit.client.0.smithi164.stdout:2/553: fsync d3/fd 0 2024-02-10T00:00:37.264 INFO:tasks.workunit.client.1.smithi183.stdout:0/863: readlink d14/d1d/d59/d71/d22/l54 0 2024-02-10T00:00:37.266 INFO:tasks.workunit.client.1.smithi183.stdout:6/750: dread d2/d32/f41 [0,4194304] 0 2024-02-10T00:00:37.267 INFO:tasks.workunit.client.0.smithi164.stdout:5/570: truncate d7/d17/d21/d23/d5a/d68/d1f/fa5 2684613 0 2024-02-10T00:00:37.267 INFO:tasks.workunit.client.0.smithi164.stdout:5/571: stat d7/d17/d3b/d45/d5c/f6f 0 2024-02-10T00:00:37.267 INFO:tasks.workunit.client.0.smithi164.stdout:9/499: creat d6/d41/d8b/d24/d4f/f98 x:0 0 0 2024-02-10T00:00:37.269 INFO:tasks.workunit.client.0.smithi164.stdout:5/572: write d7/d17/d3b/d43/f6e [155355,88746] 0 2024-02-10T00:00:37.269 INFO:tasks.workunit.client.0.smithi164.stdout:3/447: symlink d0/d1/d2/d19/d66/d81/l8a 0 2024-02-10T00:00:37.269 INFO:tasks.workunit.client.1.smithi183.stdout:6/751: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fea x:0 0 0 2024-02-10T00:00:37.270 INFO:tasks.workunit.client.0.smithi164.stdout:7/549: creat d3/d11/d39/d44/fb3 x:0 0 0 2024-02-10T00:00:37.270 INFO:tasks.workunit.client.1.smithi183.stdout:6/752: dread - d2/d1a/d25/d3c/d31/d38/fb2 zero size 2024-02-10T00:00:37.271 INFO:tasks.workunit.client.0.smithi164.stdout:4/507: symlink d2/d2f/lae 0 2024-02-10T00:00:37.273 INFO:tasks.workunit.client.0.smithi164.stdout:2/554: creat d3/da6/d7a/d8e/d88/fc5 x:0 0 0 2024-02-10T00:00:37.274 INFO:tasks.workunit.client.0.smithi164.stdout:6/588: creat d0/d6/d12/d45/fc4 x:0 0 0 2024-02-10T00:00:37.274 INFO:tasks.workunit.client.0.smithi164.stdout:0/488: getdents d6/d10/d18/d2d/d35 0 2024-02-10T00:00:37.280 INFO:tasks.workunit.client.1.smithi183.stdout:4/893: read de/f12 [390331,119066] 0 2024-02-10T00:00:37.292 INFO:tasks.workunit.client.0.smithi164.stdout:3/448: symlink d0/d1/dd/l8b 0 2024-02-10T00:00:37.292 INFO:tasks.workunit.client.0.smithi164.stdout:1/447: link d1/d1a/f2c d1/d23/f98 0 2024-02-10T00:00:37.298 INFO:tasks.workunit.client.1.smithi183.stdout:5/868: dread d4/d23/d3e/d80/d96/ff7 [0,4194304] 0 2024-02-10T00:00:37.298 INFO:tasks.workunit.client.1.smithi183.stdout:8/898: dread d0/d27/d75/d5b/f5d [0,4194304] 0 2024-02-10T00:00:37.299 INFO:tasks.workunit.client.0.smithi164.stdout:4/508: creat d2/d19/d16/d31/d57/faf x:0 0 0 2024-02-10T00:00:37.299 INFO:tasks.workunit.client.0.smithi164.stdout:8/483: unlink d2/d64/d65/d80/d32/d58/f8f 0 2024-02-10T00:00:37.299 INFO:tasks.workunit.client.0.smithi164.stdout:2/555: creat d3/d32/d4e/fc6 x:0 0 0 2024-02-10T00:00:37.299 INFO:tasks.workunit.client.0.smithi164.stdout:6/589: rename d0/d6/d81/fb0 to d0/d6/d95/fc5 0 2024-02-10T00:00:37.300 INFO:tasks.workunit.client.0.smithi164.stdout:1/448: write d1/f7 [4748589,108923] 0 2024-02-10T00:00:37.300 INFO:tasks.workunit.client.0.smithi164.stdout:7/550: mknod d3/d11/d39/d44/cb4 0 2024-02-10T00:00:37.300 INFO:tasks.workunit.client.0.smithi164.stdout:7/551: stat d3/d5/fe 0 2024-02-10T00:00:37.300 INFO:tasks.workunit.client.0.smithi164.stdout:7/552: chown d3/d11/d39/d44/d6f/l76 7648014 1 2024-02-10T00:00:37.300 INFO:tasks.workunit.client.1.smithi183.stdout:8/899: fsync d0/d31/f88 0 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:4/509: symlink d2/d19/d16/d31/d4b/lb0 0 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/590: rmdir d0 39 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:7/553: chown d3/d11/d39/d44/fad 14732409 1 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:1/449: creat d1/d23/d37/f99 x:0 0 0 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/591: chown d0/d2b/d3a/d3d/d42/d5d/d79/dbc 46307 1 2024-02-10T00:00:37.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/592: chown d0/d3b/d56/c8e 113573315 1 2024-02-10T00:00:37.302 INFO:tasks.workunit.client.1.smithi183.stdout:5/869: link d4/d23/d3e/d80/da1/d9e/d27/d38/f48 d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/f11d 0 2024-02-10T00:00:37.302 INFO:tasks.workunit.client.0.smithi164.stdout:0/489: truncate d6/d3a/d52/f8e 151187 0 2024-02-10T00:00:37.303 INFO:tasks.workunit.client.0.smithi164.stdout:0/490: write d6/d10/d18/f67 [2170334,11022] 0 2024-02-10T00:00:37.303 INFO:tasks.workunit.client.0.smithi164.stdout:0/491: stat d6/f3d 0 2024-02-10T00:00:37.305 INFO:tasks.workunit.client.1.smithi183.stdout:8/900: link d0/d31/f88 d0/d27/d36/de3/ded/f119 0 2024-02-10T00:00:37.306 INFO:tasks.workunit.client.0.smithi164.stdout:4/510: link d2/fb d2/d19/d16/d31/d6d/fb1 0 2024-02-10T00:00:37.306 INFO:tasks.workunit.client.0.smithi164.stdout:4/511: read - d2/d5a/d94/f96 zero size 2024-02-10T00:00:37.307 INFO:tasks.workunit.client.1.smithi183.stdout:8/901: write d0/d27/d36/f10d [852012,52599] 0 2024-02-10T00:00:37.307 INFO:tasks.workunit.client.0.smithi164.stdout:3/449: getdents d0/d1/d2/d19/d27 0 2024-02-10T00:00:37.308 INFO:tasks.workunit.client.0.smithi164.stdout:4/512: read - d2/d19/d16/d31/d4b/f8d zero size 2024-02-10T00:00:37.308 INFO:tasks.workunit.client.0.smithi164.stdout:3/450: chown d0/d1/d2/d17/d37/d3f 1 1 2024-02-10T00:00:37.308 INFO:tasks.workunit.client.0.smithi164.stdout:0/492: rmdir d6/d10/d66 39 2024-02-10T00:00:37.309 INFO:tasks.workunit.client.0.smithi164.stdout:2/556: truncate d3/da6/d7a/d8e/d36/f96 969143 0 2024-02-10T00:00:37.311 INFO:tasks.workunit.client.0.smithi164.stdout:1/450: mkdir d1/d1a/d9a 0 2024-02-10T00:00:37.313 INFO:tasks.workunit.client.0.smithi164.stdout:6/593: symlink d0/d2b/d3a/d3d/d42/d5d/d79/dbd/lc6 0 2024-02-10T00:00:37.315 INFO:tasks.workunit.client.1.smithi183.stdout:8/902: symlink d0/d10/d9e/l11a 0 2024-02-10T00:00:37.315 INFO:tasks.workunit.client.1.smithi183.stdout:6/753: dread d2/d1a/d25/d3c/d31/f70 [0,4194304] 0 2024-02-10T00:00:37.316 INFO:tasks.workunit.client.1.smithi183.stdout:3/720: dread d7/db/f41 [0,4194304] 0 2024-02-10T00:00:37.316 INFO:tasks.workunit.client.1.smithi183.stdout:8/903: readlink d0/d4e/d6b/l117 0 2024-02-10T00:00:37.318 INFO:tasks.workunit.client.1.smithi183.stdout:1/772: sync 2024-02-10T00:00:37.320 INFO:tasks.workunit.client.1.smithi183.stdout:1/773: chown d0/d3/d29/d38 953611 1 2024-02-10T00:00:37.321 INFO:tasks.workunit.client.1.smithi183.stdout:7/785: rmdir d0 39 2024-02-10T00:00:37.322 INFO:tasks.workunit.client.1.smithi183.stdout:2/965: dwrite d2/da/d20/d21/d36/f4b [0,4194304] 0 2024-02-10T00:00:37.324 INFO:tasks.workunit.client.1.smithi183.stdout:0/864: truncate d14/d3e/d5f/daa/ddd/d121/ffc 1562215 0 2024-02-10T00:00:37.325 INFO:tasks.workunit.client.1.smithi183.stdout:6/754: dwrite d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:37.326 INFO:tasks.workunit.client.1.smithi183.stdout:8/904: rmdir d0/d3f/d94 39 2024-02-10T00:00:37.328 INFO:tasks.workunit.client.0.smithi164.stdout:4/513: mkdir d2/d2f/d37/d41/d3d/d56/db2 0 2024-02-10T00:00:37.329 INFO:tasks.workunit.client.1.smithi183.stdout:3/721: write d7/db/d2a/d2d/d51/fbd [1660835,93296] 0 2024-02-10T00:00:37.330 INFO:tasks.workunit.client.1.smithi183.stdout:8/905: dread - d0/d31/d108/ff0 zero size 2024-02-10T00:00:37.331 INFO:tasks.workunit.client.1.smithi183.stdout:6/755: read d2/fb0 [3087811,92876] 0 2024-02-10T00:00:37.331 INFO:tasks.workunit.client.1.smithi183.stdout:1/774: creat d0/d3/d67/d7b/dfe/f110 x:0 0 0 2024-02-10T00:00:37.331 INFO:tasks.workunit.client.0.smithi164.stdout:5/573: sync 2024-02-10T00:00:37.332 INFO:tasks.workunit.client.1.smithi183.stdout:9/837: dwrite d0/d3/d14/d1c/d2d/f4d [0,4194304] 0 2024-02-10T00:00:37.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/894: dwrite de/d19/d20/fba [4194304,4194304] 0 2024-02-10T00:00:37.336 INFO:tasks.workunit.client.1.smithi183.stdout:5/870: dread d4/dd/d31/d73/fd2 [0,4194304] 0 2024-02-10T00:00:37.337 INFO:tasks.workunit.client.0.smithi164.stdout:6/594: dread d0/d2b/d3a/f55 [0,4194304] 0 2024-02-10T00:00:37.337 INFO:tasks.workunit.client.0.smithi164.stdout:9/500: truncate d6/f3e 158278 0 2024-02-10T00:00:37.338 INFO:tasks.workunit.client.1.smithi183.stdout:0/865: dwrite d14/d1d/d96/da0/fad [0,4194304] 0 2024-02-10T00:00:37.339 INFO:tasks.workunit.client.1.smithi183.stdout:0/866: fdatasync d14/d1d/f11e 0 2024-02-10T00:00:37.341 INFO:tasks.workunit.client.1.smithi183.stdout:6/756: mknod d2/da0/ceb 0 2024-02-10T00:00:37.342 INFO:tasks.workunit.client.1.smithi183.stdout:9/838: dread d0/d3/d14/d48/fff [0,4194304] 0 2024-02-10T00:00:37.344 INFO:tasks.workunit.client.1.smithi183.stdout:8/906: dwrite d0/d45/fe6 [0,4194304] 0 2024-02-10T00:00:37.344 INFO:tasks.workunit.client.0.smithi164.stdout:7/554: getdents d3/d5/d59 0 2024-02-10T00:00:37.345 INFO:tasks.workunit.client.1.smithi183.stdout:1/775: unlink d0/d3/d7/d3d/d60/d89/c92 0 2024-02-10T00:00:37.347 INFO:tasks.workunit.client.1.smithi183.stdout:4/895: unlink de/c81 0 2024-02-10T00:00:37.348 INFO:tasks.workunit.client.0.smithi164.stdout:8/484: sync 2024-02-10T00:00:37.352 INFO:tasks.workunit.client.1.smithi183.stdout:2/966: link d2/d2c/dab/d99/ddf/d105/dae/fec d2/da/d20/d21/d43/d136/f141 0 2024-02-10T00:00:37.355 INFO:tasks.workunit.client.0.smithi164.stdout:5/574: rmdir d7/d17/d21 39 2024-02-10T00:00:37.357 INFO:tasks.workunit.client.1.smithi183.stdout:8/907: chown d0/d4e/l70 341343414 1 2024-02-10T00:00:37.357 INFO:tasks.workunit.client.0.smithi164.stdout:6/595: symlink d0/d2b/d3a/d3d/d42/d5d/d79/dbd/lc7 0 2024-02-10T00:00:37.358 INFO:tasks.workunit.client.0.smithi164.stdout:2/557: mknod d3/d24/d51/dad/cc7 0 2024-02-10T00:00:37.359 INFO:tasks.workunit.client.1.smithi183.stdout:4/896: rename de/d22/l42 to de/d14/d1d/d2f/da2/l114 0 2024-02-10T00:00:37.359 INFO:tasks.workunit.client.0.smithi164.stdout:7/555: creat d3/d26/d67/fb5 x:0 0 0 2024-02-10T00:00:37.360 INFO:tasks.workunit.client.1.smithi183.stdout:6/757: dwrite d2/d1a/d25/d3c/d31/d66/f71 [0,4194304] 0 2024-02-10T00:00:37.361 INFO:tasks.workunit.client.1.smithi183.stdout:4/897: read de/d19/d20/de6/fbe [11086,37094] 0 2024-02-10T00:00:37.362 INFO:tasks.workunit.client.0.smithi164.stdout:4/514: creat d2/d2f/d37/d45/dab/fb3 x:0 0 0 2024-02-10T00:00:37.364 INFO:tasks.workunit.client.1.smithi183.stdout:3/722: link d7/db/d2a/d33/l34 d7/db/d2a/d2d/d51/lcf 0 2024-02-10T00:00:37.364 INFO:tasks.workunit.client.0.smithi164.stdout:4/515: write d2/d19/d16/d31/d4b/f8d [977917,128932] 0 2024-02-10T00:00:37.364 INFO:tasks.workunit.client.0.smithi164.stdout:2/558: mkdir d3/da6/d7a/d8e/d8a/dc8 0 2024-02-10T00:00:37.365 INFO:tasks.workunit.client.1.smithi183.stdout:9/839: truncate d0/d3/d14/d1c/d2d/d4f/d79/f80 2048992 0 2024-02-10T00:00:37.366 INFO:tasks.workunit.client.0.smithi164.stdout:9/501: dread d6/de/d22/f51 [0,4194304] 0 2024-02-10T00:00:37.366 INFO:tasks.workunit.client.1.smithi183.stdout:9/840: chown d0/d3/d14/d1c/l4a 1245 1 2024-02-10T00:00:37.367 INFO:tasks.workunit.client.1.smithi183.stdout:2/967: creat d2/da/f142 x:0 0 0 2024-02-10T00:00:37.369 INFO:tasks.workunit.client.0.smithi164.stdout:1/451: link d1/d1a/d75/l90 d1/d13/l9b 0 2024-02-10T00:00:37.370 INFO:tasks.workunit.client.1.smithi183.stdout:6/758: rename d2/d1a/d25/d3c/d31/d38/d6e/d34/c8c to d2/da0/cec 0 2024-02-10T00:00:37.370 INFO:tasks.workunit.client.1.smithi183.stdout:9/841: dwrite d0/d3/d14/d74/da8/fba [4194304,4194304] 0 2024-02-10T00:00:37.371 INFO:tasks.workunit.client.0.smithi164.stdout:5/575: link d7/d17/d21/d23/d37/d36/f6d d7/d17/d21/d23/d37/d36/d8b/fb8 0 2024-02-10T00:00:37.372 INFO:tasks.workunit.client.1.smithi183.stdout:9/842: stat d0/d3/d14/d1c/d4b/d51 0 2024-02-10T00:00:37.373 INFO:tasks.workunit.client.0.smithi164.stdout:5/576: write d7/d17/d21/d23/d37/d36/f46 [4757752,73080] 0 2024-02-10T00:00:37.373 INFO:tasks.workunit.client.0.smithi164.stdout:1/452: dwrite d1/d23/f92 [0,4194304] 0 2024-02-10T00:00:37.373 INFO:tasks.workunit.client.1.smithi183.stdout:4/898: mknod de/d14/c115 0 2024-02-10T00:00:37.374 INFO:tasks.workunit.client.1.smithi183.stdout:0/867: dread d14/f37 [0,4194304] 0 2024-02-10T00:00:37.374 INFO:tasks.workunit.client.0.smithi164.stdout:4/516: getdents d2/d2f/d37/d71 0 2024-02-10T00:00:37.375 INFO:tasks.workunit.client.0.smithi164.stdout:9/502: getdents d6/de/d2b/d5b/d61/d76 0 2024-02-10T00:00:37.375 INFO:tasks.workunit.client.0.smithi164.stdout:1/453: write d1/d1a/d41/d18/d33/f5b [2673820,31543] 0 2024-02-10T00:00:37.375 INFO:tasks.workunit.client.1.smithi183.stdout:5/871: link d4/d23/d3e/d80/da1/d9c/d72/ca2 d4/d23/d3e/d80/da1/d9c/d72/c11e 0 2024-02-10T00:00:37.376 INFO:tasks.workunit.client.0.smithi164.stdout:5/577: rmdir d7/d17/d3b/d43 39 2024-02-10T00:00:37.376 INFO:tasks.workunit.client.0.smithi164.stdout:4/517: read - d2/d19/d16/d31/f70 zero size 2024-02-10T00:00:37.377 INFO:tasks.workunit.client.0.smithi164.stdout:5/578: chown d7/f1d 4091 1 2024-02-10T00:00:37.378 INFO:tasks.workunit.client.1.smithi183.stdout:6/759: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fb6 [0,4194304] 0 2024-02-10T00:00:37.379 INFO:tasks.workunit.client.1.smithi183.stdout:2/968: creat d2/da/d19/d31/de2/de8/f143 x:0 0 0 2024-02-10T00:00:37.379 INFO:tasks.workunit.client.0.smithi164.stdout:1/454: dread d1/d23/f92 [0,4194304] 0 2024-02-10T00:00:37.380 INFO:tasks.workunit.client.0.smithi164.stdout:1/455: chown d1/d23/f55 5 1 2024-02-10T00:00:37.380 INFO:tasks.workunit.client.1.smithi183.stdout:4/899: mknod de/c116 0 2024-02-10T00:00:37.381 INFO:tasks.workunit.client.1.smithi183.stdout:0/868: dread d14/d3e/d5f/daa/ddd/f104 [0,4194304] 0 2024-02-10T00:00:37.381 INFO:tasks.workunit.client.1.smithi183.stdout:4/900: write de/d14/d1d/fbd [783607,96034] 0 2024-02-10T00:00:37.381 INFO:tasks.workunit.client.0.smithi164.stdout:1/456: read d1/d23/f67 [187867,11897] 0 2024-02-10T00:00:37.382 INFO:tasks.workunit.client.0.smithi164.stdout:1/457: chown d1/d23/f67 27819277 1 2024-02-10T00:00:37.382 INFO:tasks.workunit.client.1.smithi183.stdout:0/869: dread - d14/d3e/d5f/daa/fd8 zero size 2024-02-10T00:00:37.382 INFO:tasks.workunit.client.1.smithi183.stdout:3/723: mkdir d7/d98/dc9/dd0 0 2024-02-10T00:00:37.383 INFO:tasks.workunit.client.1.smithi183.stdout:3/724: stat d7/db/d2a/d8e/fae 0 2024-02-10T00:00:37.384 INFO:tasks.workunit.client.1.smithi183.stdout:3/725: stat d7/db/d2a/f99 0 2024-02-10T00:00:37.386 INFO:tasks.workunit.client.0.smithi164.stdout:4/518: unlink d2/d19/c20 0 2024-02-10T00:00:37.388 INFO:tasks.workunit.client.1.smithi183.stdout:8/908: rename d0/d4e/da6/dde/d102 to d0/d23/db1/d11b 0 2024-02-10T00:00:37.388 INFO:tasks.workunit.client.1.smithi183.stdout:4/901: mkdir de/d14/d1d/d2f/da2/d9c/df5/d117 0 2024-02-10T00:00:37.388 INFO:tasks.workunit.client.1.smithi183.stdout:9/843: getdents d0/d3/d14/d1c/d2d/d4f/da4/dda/ddf/df8 0 2024-02-10T00:00:37.390 INFO:tasks.workunit.client.1.smithi183.stdout:3/726: creat d7/db/d2a/d4d/d63/fd1 x:0 0 0 2024-02-10T00:00:37.390 INFO:tasks.workunit.client.0.smithi164.stdout:5/579: mknod d7/d17/d21/d23/cb9 0 2024-02-10T00:00:37.392 INFO:tasks.workunit.client.1.smithi183.stdout:9/844: write d0/f5b [1444286,117880] 0 2024-02-10T00:00:37.392 INFO:tasks.workunit.client.1.smithi183.stdout:3/727: fsync d7/f30 0 2024-02-10T00:00:37.393 INFO:tasks.workunit.client.1.smithi183.stdout:4/902: creat de/d19/d8d/f118 x:0 0 0 2024-02-10T00:00:37.393 INFO:tasks.workunit.client.1.smithi183.stdout:1/776: sync 2024-02-10T00:00:37.394 INFO:tasks.workunit.client.1.smithi183.stdout:8/909: creat d0/d3f/db2/de9/f11c x:0 0 0 2024-02-10T00:00:37.396 INFO:tasks.workunit.client.1.smithi183.stdout:9/845: creat d0/d30/d52/ddc/de1/f10f x:0 0 0 2024-02-10T00:00:37.399 INFO:tasks.workunit.client.1.smithi183.stdout:7/786: dread d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:37.400 INFO:tasks.workunit.client.1.smithi183.stdout:3/728: mknod d7/db/d2a/da5/cd2 0 2024-02-10T00:00:37.400 INFO:tasks.workunit.client.1.smithi183.stdout:1/777: dwrite d0/d3/d7/d3d/d60/d89/ff0 [0,4194304] 0 2024-02-10T00:00:37.400 INFO:tasks.workunit.client.1.smithi183.stdout:4/903: chown de/d14/d1d/cda 318503 1 2024-02-10T00:00:37.401 INFO:tasks.workunit.client.0.smithi164.stdout:6/596: truncate d0/d6/f9b 1212734 0 2024-02-10T00:00:37.401 INFO:tasks.workunit.client.0.smithi164.stdout:0/493: dwrite d6/d10/d66/f6a [0,4194304] 0 2024-02-10T00:00:37.402 INFO:tasks.workunit.client.1.smithi183.stdout:1/778: chown d0/d3c/dc9/c54 36 1 2024-02-10T00:00:37.402 INFO:tasks.workunit.client.1.smithi183.stdout:9/846: creat d0/d3/d14/d1c/d2d/d4f/d89/dc5/f110 x:0 0 0 2024-02-10T00:00:37.402 INFO:tasks.workunit.client.0.smithi164.stdout:1/458: fdatasync d1/d1a/f2c 0 2024-02-10T00:00:37.402 INFO:tasks.workunit.client.0.smithi164.stdout:3/451: dwrite d0/d1/d2/d19/f29 [4194304,4194304] 0 2024-02-10T00:00:37.403 INFO:tasks.workunit.client.1.smithi183.stdout:9/847: chown d0/d3/d14/d1c/f10c 26 1 2024-02-10T00:00:37.404 INFO:tasks.workunit.client.0.smithi164.stdout:4/519: dread d2/d19/f11 [0,4194304] 0 2024-02-10T00:00:37.405 INFO:tasks.workunit.client.0.smithi164.stdout:8/485: dwrite d2/f11 [4194304,4194304] 0 2024-02-10T00:00:37.407 INFO:tasks.workunit.client.1.smithi183.stdout:5/872: read d4/fa [208348,27825] 0 2024-02-10T00:00:37.408 INFO:tasks.workunit.client.0.smithi164.stdout:1/459: rmdir d1/d1a/d41/d18/d33 39 2024-02-10T00:00:37.408 INFO:tasks.workunit.client.0.smithi164.stdout:3/452: read d0/d1/d2/d17/d37/d3f/d4e/d6d/f7d [1805704,93270] 0 2024-02-10T00:00:37.412 INFO:tasks.workunit.client.0.smithi164.stdout:4/520: mknod d2/d2f/d37/d71/cb4 0 2024-02-10T00:00:37.412 INFO:tasks.workunit.client.0.smithi164.stdout:2/559: dwrite d3/d32/d4e/f3d [4194304,4194304] 0 2024-02-10T00:00:37.412 INFO:tasks.workunit.client.0.smithi164.stdout:8/486: write d2/d64/d65/d80/d32/d4d/f57 [946195,81275] 0 2024-02-10T00:00:37.412 INFO:tasks.workunit.client.0.smithi164.stdout:4/521: fdatasync d2/d19/d16/d31/d57/f59 0 2024-02-10T00:00:37.413 INFO:tasks.workunit.client.1.smithi183.stdout:7/787: creat d0/d11/d2f/da3/ff4 x:0 0 0 2024-02-10T00:00:37.413 INFO:tasks.workunit.client.0.smithi164.stdout:8/487: write d2/d64/f83 [771055,16800] 0 2024-02-10T00:00:37.414 INFO:tasks.workunit.client.1.smithi183.stdout:3/729: rmdir d7/db/d2a/d33/d59/d52 39 2024-02-10T00:00:37.417 INFO:tasks.workunit.client.0.smithi164.stdout:1/460: mknod d1/d1a/d41/d18/d3a/c9c 0 2024-02-10T00:00:37.418 INFO:tasks.workunit.client.1.smithi183.stdout:3/730: mkdir d7/db/d2a/d2d/d51/d8f/dd3 0 2024-02-10T00:00:37.421 INFO:tasks.workunit.client.1.smithi183.stdout:5/873: getdents d4 0 2024-02-10T00:00:37.421 INFO:tasks.workunit.client.0.smithi164.stdout:3/453: unlink d0/l21 0 2024-02-10T00:00:37.421 INFO:tasks.workunit.client.1.smithi183.stdout:7/788: mknod d0/d2/d4/d8/dc1/cf5 0 2024-02-10T00:00:37.423 INFO:tasks.workunit.client.1.smithi183.stdout:0/870: dread d14/d3e/d5f/daa/ddd/d121/d63/f113 [0,4194304] 0 2024-02-10T00:00:37.426 INFO:tasks.workunit.client.0.smithi164.stdout:2/560: creat d3/d32/d4e/fc9 x:0 0 0 2024-02-10T00:00:37.428 INFO:tasks.workunit.client.1.smithi183.stdout:7/789: creat d0/d11/dc3/ff6 x:0 0 0 2024-02-10T00:00:37.428 INFO:tasks.workunit.client.1.smithi183.stdout:0/871: creat d14/d1d/d59/d71/dcb/f132 x:0 0 0 2024-02-10T00:00:37.429 INFO:tasks.workunit.client.0.smithi164.stdout:4/522: mkdir d2/d2f/d37/d41/d3d/d42/da2/db5 0 2024-02-10T00:00:37.429 INFO:tasks.workunit.client.0.smithi164.stdout:1/461: mkdir d1/d23/d61/d9d 0 2024-02-10T00:00:37.429 INFO:tasks.workunit.client.0.smithi164.stdout:8/488: creat d2/d81/f95 x:0 0 0 2024-02-10T00:00:37.430 INFO:tasks.workunit.client.1.smithi183.stdout:5/874: mkdir d4/d23/d10e/d11f 0 2024-02-10T00:00:37.430 INFO:tasks.workunit.client.0.smithi164.stdout:2/561: rmdir d3/d24/d51/dad 39 2024-02-10T00:00:37.432 INFO:tasks.workunit.client.1.smithi183.stdout:5/875: write d4/d23/d3e/d80/da1/f60 [2262275,99184] 0 2024-02-10T00:00:37.433 INFO:tasks.workunit.client.0.smithi164.stdout:8/489: unlink d2/c8 0 2024-02-10T00:00:37.433 INFO:tasks.workunit.client.1.smithi183.stdout:7/790: unlink d0/c85 0 2024-02-10T00:00:37.434 INFO:tasks.workunit.client.1.smithi183.stdout:3/731: getdents d7/db/d2a/d2d/d51/db3 0 2024-02-10T00:00:37.434 INFO:tasks.workunit.client.1.smithi183.stdout:0/872: dwrite d14/d1d/f11e [0,4194304] 0 2024-02-10T00:00:37.435 INFO:tasks.workunit.client.1.smithi183.stdout:7/791: write d0/d11/f4f [627523,9392] 0 2024-02-10T00:00:37.436 INFO:tasks.workunit.client.1.smithi183.stdout:5/876: fsync d4/fe4 0 2024-02-10T00:00:37.437 INFO:tasks.workunit.client.1.smithi183.stdout:7/792: read - d0/d2/d4/d8/fd9 zero size 2024-02-10T00:00:37.438 INFO:tasks.workunit.client.0.smithi164.stdout:8/490: unlink d2/c5 0 2024-02-10T00:00:37.438 INFO:tasks.workunit.client.0.smithi164.stdout:2/562: dread d3/da6/d7a/d8e/d36/f83 [0,4194304] 0 2024-02-10T00:00:37.438 INFO:tasks.workunit.client.1.smithi183.stdout:0/873: symlink d14/d1d/d59/d71/db4/l133 0 2024-02-10T00:00:37.439 INFO:tasks.workunit.client.0.smithi164.stdout:1/462: dwrite d1/d13/f19 [8388608,4194304] 0 2024-02-10T00:00:37.439 INFO:tasks.workunit.client.1.smithi183.stdout:7/793: rmdir d0/d11/d88/db1 39 2024-02-10T00:00:37.440 INFO:tasks.workunit.client.0.smithi164.stdout:4/523: dwrite d2/d19/d16/d31/d57/f59 [0,4194304] 0 2024-02-10T00:00:37.440 INFO:tasks.workunit.client.1.smithi183.stdout:5/877: read d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fb5 [134993,20857] 0 2024-02-10T00:00:37.441 INFO:tasks.workunit.client.0.smithi164.stdout:3/454: dwrite d0/d1/d2/d19/d66/d84/d82/f87 [0,4194304] 0 2024-02-10T00:00:37.442 INFO:tasks.workunit.client.0.smithi164.stdout:4/524: readlink d2/d2f/d37/d41/d3d/l7f 0 2024-02-10T00:00:37.442 INFO:tasks.workunit.client.0.smithi164.stdout:8/491: symlink d2/d64/d54/d71/l96 0 2024-02-10T00:00:37.443 INFO:tasks.workunit.client.1.smithi183.stdout:5/878: dread d4/d23/d3e/d80/da1/f8a [0,4194304] 0 2024-02-10T00:00:37.444 INFO:tasks.workunit.client.1.smithi183.stdout:5/879: write d4/dd/d31/d73/f98 [307139,15905] 0 2024-02-10T00:00:37.445 INFO:tasks.workunit.client.1.smithi183.stdout:5/880: write d4/f13 [4307854,117027] 0 2024-02-10T00:00:37.446 INFO:tasks.workunit.client.0.smithi164.stdout:1/463: dwrite d1/d23/f55 [4194304,4194304] 0 2024-02-10T00:00:37.446 INFO:tasks.workunit.client.1.smithi183.stdout:0/874: mkdir d14/d1d/d59/d71/d134 0 2024-02-10T00:00:37.447 INFO:tasks.workunit.client.0.smithi164.stdout:3/455: mknod d0/d1/d2/d17/d37/d3f/d4e/c8c 0 2024-02-10T00:00:37.447 INFO:tasks.workunit.client.1.smithi183.stdout:0/875: write d14/d1d/d2d/d31/d6c/de3/f94 [2549164,36168] 0 2024-02-10T00:00:37.449 INFO:tasks.workunit.client.0.smithi164.stdout:7/556: sync 2024-02-10T00:00:37.449 INFO:tasks.workunit.client.1.smithi183.stdout:4/904: dread de/d14/d4e/f94 [0,4194304] 0 2024-02-10T00:00:37.451 INFO:tasks.workunit.client.0.smithi164.stdout:1/464: symlink d1/d13/d2b/d54/l9e 0 2024-02-10T00:00:37.453 INFO:tasks.workunit.client.1.smithi183.stdout:3/732: dread d7/db/d2a/f2b [0,4194304] 0 2024-02-10T00:00:37.453 INFO:tasks.workunit.client.1.smithi183.stdout:3/733: stat d7/db/d2a/d2d/c74 0 2024-02-10T00:00:37.454 INFO:tasks.workunit.client.0.smithi164.stdout:3/456: dwrite d0/d1/d2/d17/d37/d3f/d4e/d6d/f4b [0,4194304] 0 2024-02-10T00:00:37.454 INFO:tasks.workunit.client.0.smithi164.stdout:3/457: chown d0/d1/d2/d19/f29 19326477 1 2024-02-10T00:00:37.455 INFO:tasks.workunit.client.1.smithi183.stdout:5/881: mknod d4/d23/c120 0 2024-02-10T00:00:37.456 INFO:tasks.workunit.client.1.smithi183.stdout:3/734: rmdir d7/db/d2a/d2d/d51/db3 39 2024-02-10T00:00:37.458 INFO:tasks.workunit.client.1.smithi183.stdout:5/882: creat d4/d10c/f121 x:0 0 0 2024-02-10T00:00:37.459 INFO:tasks.workunit.client.0.smithi164.stdout:4/525: getdents d2/d2f/d37/d41/d3d/d56 0 2024-02-10T00:00:37.459 INFO:tasks.workunit.client.1.smithi183.stdout:5/883: write d4/d23/d3e/d80/da1/d9e/d27/d37/f101 [4638150,85008] 0 2024-02-10T00:00:37.462 INFO:tasks.workunit.client.1.smithi183.stdout:3/735: mknod d7/db/d2a/d2d/d51/db3/cd4 0 2024-02-10T00:00:37.463 INFO:tasks.workunit.client.0.smithi164.stdout:3/458: unlink d0/d3b/f6c 0 2024-02-10T00:00:37.466 INFO:tasks.workunit.client.1.smithi183.stdout:5/884: symlink d4/d23/d10e/d11f/l122 0 2024-02-10T00:00:37.466 INFO:tasks.workunit.client.1.smithi183.stdout:3/736: creat d7/db/d2a/d4d/d63/fd5 x:0 0 0 2024-02-10T00:00:37.467 INFO:tasks.workunit.client.0.smithi164.stdout:4/526: creat d2/d2f/d37/d41/d69/fb6 x:0 0 0 2024-02-10T00:00:37.468 INFO:tasks.workunit.client.0.smithi164.stdout:7/557: dread d3/f9 [0,4194304] 0 2024-02-10T00:00:37.470 INFO:tasks.workunit.client.1.smithi183.stdout:9/848: dread d0/d3/d14/d1c/d4b/f65 [0,4194304] 0 2024-02-10T00:00:37.470 INFO:tasks.workunit.client.0.smithi164.stdout:3/459: unlink d0/d1/dd/f1f 0 2024-02-10T00:00:37.471 INFO:tasks.workunit.client.0.smithi164.stdout:3/460: fdatasync d0/d1/d2/d19/d66/d84/f62 0 2024-02-10T00:00:37.471 INFO:tasks.workunit.client.0.smithi164.stdout:4/527: creat d2/d2f/d37/d41/d3d/d42/d47/fb7 x:0 0 0 2024-02-10T00:00:37.472 INFO:tasks.workunit.client.0.smithi164.stdout:4/528: dread - d2/d2f/d37/d41/d3d/d42/d5f/fad zero size 2024-02-10T00:00:37.473 INFO:tasks.workunit.client.0.smithi164.stdout:4/529: fsync d2/d2f/d37/d45/fa7 0 2024-02-10T00:00:37.480 INFO:tasks.workunit.client.0.smithi164.stdout:4/530: creat d2/d19/d16/d31/fb8 x:0 0 0 2024-02-10T00:00:37.481 INFO:tasks.workunit.client.0.smithi164.stdout:9/503: dwrite d6/f3e [0,4194304] 0 2024-02-10T00:00:37.483 INFO:tasks.workunit.client.0.smithi164.stdout:4/531: mknod d2/d2f/d37/d41/cb9 0 2024-02-10T00:00:37.486 INFO:tasks.workunit.client.0.smithi164.stdout:9/504: link d6/de/f3d d6/d41/f99 0 2024-02-10T00:00:37.486 INFO:tasks.workunit.client.0.smithi164.stdout:9/505: chown d6/d41/d8b/d24/f84 1113819 1 2024-02-10T00:00:37.488 INFO:tasks.workunit.client.0.smithi164.stdout:4/532: rename d2/d2f/d37/d41/d3d/d42/d47/fb7 to d2/d2f/d37/d71/fba 0 2024-02-10T00:00:37.491 INFO:tasks.workunit.client.0.smithi164.stdout:4/533: creat d2/d2f/d37/d41/d3d/d56/d85/fbb x:0 0 0 2024-02-10T00:00:37.492 INFO:tasks.workunit.client.1.smithi183.stdout:1/779: rmdir d0 39 2024-02-10T00:00:37.494 INFO:tasks.workunit.client.1.smithi183.stdout:8/910: dread d0/d27/f44 [0,4194304] 0 2024-02-10T00:00:37.494 INFO:tasks.workunit.client.0.smithi164.stdout:4/534: mknod d2/d19/d16/cbc 0 2024-02-10T00:00:37.494 INFO:tasks.workunit.client.1.smithi183.stdout:2/969: rename d2/da/d19/d31/de2 to d2/d2c/dba/df0/d8f/d144 0 2024-02-10T00:00:37.495 INFO:tasks.workunit.client.1.smithi183.stdout:6/760: dwrite d2/f15 [0,4194304] 0 2024-02-10T00:00:37.496 INFO:tasks.workunit.client.0.smithi164.stdout:4/535: mkdir d2/d2f/d37/d45/dab/dbd 0 2024-02-10T00:00:37.497 INFO:tasks.workunit.client.1.smithi183.stdout:6/761: write d2/d1a/d25/d3c/d31/d38/d3f/d94/fa2 [399912,111034] 0 2024-02-10T00:00:37.500 INFO:tasks.workunit.client.0.smithi164.stdout:6/597: dread d0/d6/d4d/f7d [0,4194304] 0 2024-02-10T00:00:37.504 INFO:tasks.workunit.client.0.smithi164.stdout:5/580: dread d7/d17/f3f [0,4194304] 0 2024-02-10T00:00:37.508 INFO:tasks.workunit.client.0.smithi164.stdout:5/581: rename d7/d17/d21/d23/d37/d36/f67 to d7/d17/d3b/d43/fba 0 2024-02-10T00:00:37.509 INFO:tasks.workunit.client.1.smithi183.stdout:3/737: creat d7/db/d2a/d2d/d51/dab/fd6 x:0 0 0 2024-02-10T00:00:37.510 INFO:tasks.workunit.client.1.smithi183.stdout:5/885: symlink d4/d23/d3e/d80/da1/d9e/d89/l123 0 2024-02-10T00:00:37.510 INFO:tasks.workunit.client.1.smithi183.stdout:9/849: fsync d0/d3/d14/d3c/fae 0 2024-02-10T00:00:37.511 INFO:tasks.workunit.client.1.smithi183.stdout:5/886: write d4/d23/f94 [1071803,113148] 0 2024-02-10T00:00:37.512 INFO:tasks.workunit.client.1.smithi183.stdout:9/850: chown d0/d3/d14/d1c/d4b/f65 288992 1 2024-02-10T00:00:37.512 INFO:tasks.workunit.client.0.smithi164.stdout:5/582: link d7/d17/d21/d24/f3d d7/d17/d21/d23/d5a/d68/d1f/fbb 0 2024-02-10T00:00:37.513 INFO:tasks.workunit.client.1.smithi183.stdout:8/911: write d0/d31/d108/d81/fa7 [5347361,128545] 0 2024-02-10T00:00:37.514 INFO:tasks.workunit.client.0.smithi164.stdout:5/583: write d7/d17/d3b/d43/fba [246164,67733] 0 2024-02-10T00:00:37.515 INFO:tasks.workunit.client.1.smithi183.stdout:2/970: unlink d2/d2c/dab/d99/ddf/d105/f4e 0 2024-02-10T00:00:37.516 INFO:tasks.workunit.client.1.smithi183.stdout:3/738: symlink d7/db/d2a/d2d/d6a/ld7 0 2024-02-10T00:00:37.518 INFO:tasks.workunit.client.1.smithi183.stdout:1/780: unlink d0/d3a/fb6 0 2024-02-10T00:00:37.519 INFO:tasks.workunit.client.1.smithi183.stdout:9/851: mknod d0/d3/d14/d3c/d7b/c111 0 2024-02-10T00:00:37.520 INFO:tasks.workunit.client.0.smithi164.stdout:1/465: dread d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:37.521 INFO:tasks.workunit.client.0.smithi164.stdout:1/466: chown d1/d13/f62 103371 1 2024-02-10T00:00:37.522 INFO:tasks.workunit.client.1.smithi183.stdout:8/912: mkdir d0/d23/db1/d11d 0 2024-02-10T00:00:37.523 INFO:tasks.workunit.client.1.smithi183.stdout:2/971: creat d2/d2c/dab/d99/f145 x:0 0 0 2024-02-10T00:00:37.523 INFO:tasks.workunit.client.0.smithi164.stdout:0/494: dread d6/d10/d18/d2d/f5d [0,4194304] 0 2024-02-10T00:00:37.523 INFO:tasks.workunit.client.0.smithi164.stdout:0/495: chown d6/d3a/d52 244433912 1 2024-02-10T00:00:37.524 INFO:tasks.workunit.client.1.smithi183.stdout:1/781: dwrite d0/d3/d7/d3d/d60/d89/fff [0,4194304] 0 2024-02-10T00:00:37.524 INFO:tasks.workunit.client.1.smithi183.stdout:8/913: write d0/d3f/db2/de9/fae [942288,117631] 0 2024-02-10T00:00:37.525 INFO:tasks.workunit.client.1.smithi183.stdout:1/782: dread - d0/f9d zero size 2024-02-10T00:00:37.528 INFO:tasks.workunit.client.1.smithi183.stdout:7/794: rename d0/d2/d4/l8c to d0/d11/d2f/d64/lf7 0 2024-02-10T00:00:37.536 INFO:tasks.workunit.client.0.smithi164.stdout:7/558: dread d3/d5/d59/f72 [0,4194304] 0 2024-02-10T00:00:37.541 INFO:tasks.workunit.client.0.smithi164.stdout:9/506: sync 2024-02-10T00:00:37.542 INFO:tasks.workunit.client.1.smithi183.stdout:8/914: chown d0/d3f/f79 944862937 1 2024-02-10T00:00:37.544 INFO:tasks.workunit.client.1.smithi183.stdout:8/915: dread - d0/d3f/db2/ff5 zero size 2024-02-10T00:00:37.545 INFO:tasks.workunit.client.1.smithi183.stdout:0/876: dwrite d14/d1d/d2d/d31/d68/dcc/f114 [0,4194304] 0 2024-02-10T00:00:37.545 INFO:tasks.workunit.client.0.smithi164.stdout:8/492: write d2/f49 [42190,12235] 0 2024-02-10T00:00:37.546 INFO:tasks.workunit.client.1.smithi183.stdout:0/877: chown d14/d1d/d59/d71/d22/f35 192 1 2024-02-10T00:00:37.546 INFO:tasks.workunit.client.0.smithi164.stdout:2/563: dwrite d3/da6/f31 [0,4194304] 0 2024-02-10T00:00:37.547 INFO:tasks.workunit.client.1.smithi183.stdout:1/783: creat d0/d3/d29/d38/f111 x:0 0 0 2024-02-10T00:00:37.550 INFO:tasks.workunit.client.1.smithi183.stdout:3/739: creat d7/db/d2a/d33/d59/fd8 x:0 0 0 2024-02-10T00:00:37.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/762: sync 2024-02-10T00:00:37.553 INFO:tasks.workunit.client.0.smithi164.stdout:3/461: dwrite d0/d1/dd/f31 [0,4194304] 0 2024-02-10T00:00:37.559 INFO:tasks.workunit.client.1.smithi183.stdout:2/972: creat d2/da/d5b/f146 x:0 0 0 2024-02-10T00:00:37.559 INFO:tasks.workunit.client.0.smithi164.stdout:9/507: mknod d6/de/d2b/c9a 0 2024-02-10T00:00:37.562 INFO:tasks.workunit.client.1.smithi183.stdout:5/887: truncate d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/fb0 317240 0 2024-02-10T00:00:37.563 INFO:tasks.workunit.client.0.smithi164.stdout:7/559: unlink d3/d11/d39/d3a/f94 0 2024-02-10T00:00:37.565 INFO:tasks.workunit.client.0.smithi164.stdout:6/598: write d0/d2b/f36 [2423360,65205] 0 2024-02-10T00:00:37.565 INFO:tasks.workunit.client.0.smithi164.stdout:6/599: dread - d0/d6/d12/d45/fc4 zero size 2024-02-10T00:00:37.566 INFO:tasks.workunit.client.0.smithi164.stdout:5/584: rename d7/d17/d3b to d7/d17/d21/d24/dbc 0 2024-02-10T00:00:37.570 INFO:tasks.workunit.client.0.smithi164.stdout:8/493: creat d2/d64/f97 x:0 0 0 2024-02-10T00:00:37.571 INFO:tasks.workunit.client.0.smithi164.stdout:0/496: dwrite d6/d10/d4a/f74 [0,4194304] 0 2024-02-10T00:00:37.576 INFO:tasks.workunit.client.1.smithi183.stdout:0/878: creat d14/d1d/d96/f135 x:0 0 0 2024-02-10T00:00:37.577 INFO:tasks.workunit.client.0.smithi164.stdout:9/508: creat d6/de/d2b/d5b/f9b x:0 0 0 2024-02-10T00:00:37.578 INFO:tasks.workunit.client.0.smithi164.stdout:9/509: chown d6/fc 29749 1 2024-02-10T00:00:37.579 INFO:tasks.workunit.client.0.smithi164.stdout:9/510: dread - d6/de/d40/f95 zero size 2024-02-10T00:00:37.579 INFO:tasks.workunit.client.1.smithi183.stdout:1/784: mkdir d0/d3a/dd8/d108/d112 0 2024-02-10T00:00:37.579 INFO:tasks.workunit.client.0.smithi164.stdout:6/600: creat d0/d6/d95/fc8 x:0 0 0 2024-02-10T00:00:37.580 INFO:tasks.workunit.client.1.smithi183.stdout:9/852: dwrite d0/d30/ff9 [0,4194304] 0 2024-02-10T00:00:37.582 INFO:tasks.workunit.client.1.smithi183.stdout:2/973: creat d2/d2c/dab/d99/ddf/d105/f147 x:0 0 0 2024-02-10T00:00:37.584 INFO:tasks.workunit.client.0.smithi164.stdout:7/560: truncate d3/d11/d39/d44/fb3 458464 0 2024-02-10T00:00:37.586 INFO:tasks.workunit.client.0.smithi164.stdout:3/462: dread d0/d1/d2/f12 [0,4194304] 0 2024-02-10T00:00:37.586 INFO:tasks.workunit.client.1.smithi183.stdout:4/905: rename de/l68 to de/d14/d27/l119 0 2024-02-10T00:00:37.587 INFO:tasks.workunit.client.1.smithi183.stdout:4/906: chown de/d14/d1d/d7b/dfe 2934919 1 2024-02-10T00:00:37.587 INFO:tasks.workunit.client.0.smithi164.stdout:1/467: rename d1/d13/d2b/d54/f65 to d1/d1a/d41/d18/f9f 0 2024-02-10T00:00:37.588 INFO:tasks.workunit.client.1.smithi183.stdout:1/785: unlink d0/d3/d67/d70/dae/cd3 0 2024-02-10T00:00:37.589 INFO:tasks.workunit.client.1.smithi183.stdout:9/853: fsync d0/d3/d14/d1c/d2d/d4f/f5a 0 2024-02-10T00:00:37.590 INFO:tasks.workunit.client.0.smithi164.stdout:3/463: dwrite d0/d1/f89 [0,4194304] 0 2024-02-10T00:00:37.591 INFO:tasks.workunit.client.1.smithi183.stdout:8/916: creat d0/d3f/db2/dee/f11e x:0 0 0 2024-02-10T00:00:37.591 INFO:tasks.workunit.client.1.smithi183.stdout:2/974: rmdir d2/da/d77/dc7/db5 39 2024-02-10T00:00:37.592 INFO:tasks.workunit.client.0.smithi164.stdout:5/585: creat d7/d17/d21/fbd x:0 0 0 2024-02-10T00:00:37.592 INFO:tasks.workunit.client.1.smithi183.stdout:2/975: chown d2/da/d20/l2b 0 1 2024-02-10T00:00:37.593 INFO:tasks.workunit.client.1.smithi183.stdout:7/795: dread d0/d2/d50/d5d/f8e [0,4194304] 0 2024-02-10T00:00:37.596 INFO:tasks.workunit.client.0.smithi164.stdout:3/464: dwrite d0/d1/d2/d19/f73 [0,4194304] 0 2024-02-10T00:00:37.596 INFO:tasks.workunit.client.0.smithi164.stdout:6/601: link d0/d6/le d0/d2b/d3a/d3d/d6d/lc9 0 2024-02-10T00:00:37.597 INFO:tasks.workunit.client.1.smithi183.stdout:9/854: symlink d0/d3/d14/d1c/d4b/d97/daa/dcf/l112 0 2024-02-10T00:00:37.598 INFO:tasks.workunit.client.0.smithi164.stdout:4/536: dwrite d2/d19/d16/f38 [0,4194304] 0 2024-02-10T00:00:37.599 INFO:tasks.workunit.client.1.smithi183.stdout:0/879: creat d14/d1d/d59/d71/f136 x:0 0 0 2024-02-10T00:00:37.599 INFO:tasks.workunit.client.0.smithi164.stdout:7/561: mkdir d3/d28/d45/db6 0 2024-02-10T00:00:37.600 INFO:tasks.workunit.client.0.smithi164.stdout:1/468: creat d1/d23/d61/d9d/fa0 x:0 0 0 2024-02-10T00:00:37.603 INFO:tasks.workunit.client.0.smithi164.stdout:4/537: dread d2/d2f/d37/d41/f3e [0,4194304] 0 2024-02-10T00:00:37.603 INFO:tasks.workunit.client.1.smithi183.stdout:5/888: getdents d4/d23/d3e/d80/da1/d9e/d27/d5d 0 2024-02-10T00:00:37.603 INFO:tasks.workunit.client.0.smithi164.stdout:2/564: sync 2024-02-10T00:00:37.605 INFO:tasks.workunit.client.1.smithi183.stdout:9/855: unlink d0/d3/d14/d1c/d4b/d97/daa/dcf/l112 0 2024-02-10T00:00:37.607 INFO:tasks.workunit.client.1.smithi183.stdout:3/740: dread d7/db/d2a/d33/f36 [0,4194304] 0 2024-02-10T00:00:37.608 INFO:tasks.workunit.client.1.smithi183.stdout:6/763: rename d2/d1a/d3a to d2/d1a/d25/d3c/d31/d38/d6e/ded 0 2024-02-10T00:00:37.609 INFO:tasks.workunit.client.1.smithi183.stdout:3/741: read d7/db/d2a/d8e/fae [43038,42099] 0 2024-02-10T00:00:37.610 INFO:tasks.workunit.client.0.smithi164.stdout:6/602: symlink d0/d3b/d56/db3/lca 0 2024-02-10T00:00:37.610 INFO:tasks.workunit.client.1.smithi183.stdout:6/764: chown d2/d1a/d25/d3c/d31/d66/fdf 337945907 1 2024-02-10T00:00:37.610 INFO:tasks.workunit.client.1.smithi183.stdout:7/796: mkdir d0/d2/d50/dad/df8 0 2024-02-10T00:00:37.611 INFO:tasks.workunit.client.1.smithi183.stdout:4/907: truncate de/d14/d1d/d7b/ffb 446151 0 2024-02-10T00:00:37.616 INFO:tasks.workunit.client.1.smithi183.stdout:9/856: mknod d0/d3/d14/d1c/d2d/d4f/da4/c113 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.1.smithi183.stdout:7/797: unlink d0/d2/l72 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.1.smithi183.stdout:2/976: truncate d2/da/d20/d21/d43/d58/f125 73565 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:4/538: rename d2/d2f/d37/d41/d3d/d42/d47/c68 to d2/d19/d16/daa/cbe 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:4/539: fdatasync d2/d19/d16/f53 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:2/565: symlink d3/da6/d7a/d8e/lca 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:3/465: truncate d0/d1/d2/f12 2325274 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:6/603: read d0/d6/d12/d57/f7b [275798,2468] 0 2024-02-10T00:00:37.617 INFO:tasks.workunit.client.0.smithi164.stdout:4/540: fsync d2/d2f/d37/d41/d3d/d42/d5f/f67 0 2024-02-10T00:00:37.618 INFO:tasks.workunit.client.0.smithi164.stdout:4/541: write d2/d19/d16/d31/d7e/d81/f87 [735849,3514] 0 2024-02-10T00:00:37.618 INFO:tasks.workunit.client.1.smithi183.stdout:4/908: symlink de/d22/l11a 0 2024-02-10T00:00:37.618 INFO:tasks.workunit.client.1.smithi183.stdout:4/909: write de/d19/d1c/fe2 [1826411,112734] 0 2024-02-10T00:00:37.619 INFO:tasks.workunit.client.0.smithi164.stdout:3/466: fsync d0/d1/d2/fe 0 2024-02-10T00:00:37.620 INFO:tasks.workunit.client.0.smithi164.stdout:1/469: dread d1/d1a/d41/f5f [0,4194304] 0 2024-02-10T00:00:37.622 INFO:tasks.workunit.client.1.smithi183.stdout:8/917: rename d0/d31/d108 to d0/d11f 0 2024-02-10T00:00:37.623 INFO:tasks.workunit.client.0.smithi164.stdout:4/542: link d2/c4 d2/d19/d16/d31/cbf 0 2024-02-10T00:00:37.626 INFO:tasks.workunit.client.1.smithi183.stdout:7/798: mknod d0/d11/d2f/ddb/cf9 0 2024-02-10T00:00:37.627 INFO:tasks.workunit.client.0.smithi164.stdout:4/543: dwrite d2/d19/d16/d31/d7e/d81/f87 [0,4194304] 0 2024-02-10T00:00:37.629 INFO:tasks.workunit.client.0.smithi164.stdout:5/586: getdents d7/d17/d21/d24 0 2024-02-10T00:00:37.631 INFO:tasks.workunit.client.1.smithi183.stdout:6/765: truncate d2/d1a/d25/d3c/d31/f8a 132974 0 2024-02-10T00:00:37.635 INFO:tasks.workunit.client.1.smithi183.stdout:1/786: sync 2024-02-10T00:00:37.635 INFO:tasks.workunit.client.1.smithi183.stdout:2/977: rename d2/d2c/d2f/d60/d8d/d9c to d2/d2c/dba/df0/d8f/d148 0 2024-02-10T00:00:37.636 INFO:tasks.workunit.client.0.smithi164.stdout:4/544: creat d2/d19/d16/d31/d7e/fc0 x:0 0 0 2024-02-10T00:00:37.639 INFO:tasks.workunit.client.1.smithi183.stdout:4/910: mknod de/d14/d1d/d2f/da2/d9c/df5/d117/c11b 0 2024-02-10T00:00:37.640 INFO:tasks.workunit.client.0.smithi164.stdout:9/511: sync 2024-02-10T00:00:37.640 INFO:tasks.workunit.client.0.smithi164.stdout:0/497: dwrite d6/d3a/d52/d7a/f4e [4194304,4194304] 0 2024-02-10T00:00:37.641 INFO:tasks.workunit.client.1.smithi183.stdout:5/889: dread d4/dd/d31/f83 [0,4194304] 0 2024-02-10T00:00:37.642 INFO:tasks.workunit.client.0.smithi164.stdout:5/587: mkdir d7/d17/d21/d23/d5a/d68/d1f/dbe 0 2024-02-10T00:00:37.642 INFO:tasks.workunit.client.0.smithi164.stdout:5/588: write d7/f7f [1116804,127338] 0 2024-02-10T00:00:37.642 INFO:tasks.workunit.client.1.smithi183.stdout:5/890: write d4/d23/d3e/d80/da1/f60 [4020756,51951] 0 2024-02-10T00:00:37.643 INFO:tasks.workunit.client.1.smithi183.stdout:5/891: stat d4/d23/d4a/cde 0 2024-02-10T00:00:37.644 INFO:tasks.workunit.client.1.smithi183.stdout:3/742: getdents d7/db/d2a/d2d/d51 0 2024-02-10T00:00:37.645 INFO:tasks.workunit.client.1.smithi183.stdout:5/892: write d4/dd/d31/d73/f107 [37848,37137] 0 2024-02-10T00:00:37.645 INFO:tasks.workunit.client.0.smithi164.stdout:8/494: mkdir d2/d64/d65/d98 0 2024-02-10T00:00:37.650 INFO:tasks.workunit.client.1.smithi183.stdout:0/880: truncate d14/d43/f122 1289952 0 2024-02-10T00:00:37.651 INFO:tasks.workunit.client.1.smithi183.stdout:0/881: chown d14/d1d/d55/dfa 769 1 2024-02-10T00:00:37.652 INFO:tasks.workunit.client.0.smithi164.stdout:9/512: unlink d6/de/d2b/d5b/d61/d76/d82/l72 0 2024-02-10T00:00:37.652 INFO:tasks.workunit.client.1.smithi183.stdout:9/857: dread d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:37.654 INFO:tasks.workunit.client.0.smithi164.stdout:3/467: creat d0/d1/dd/f8d x:0 0 0 2024-02-10T00:00:37.657 INFO:tasks.workunit.client.0.smithi164.stdout:7/562: write d3/d4d/f55 [1491778,115379] 0 2024-02-10T00:00:37.657 INFO:tasks.workunit.client.1.smithi183.stdout:2/978: truncate d2/d2c/dba/df0/d8f/d148/da7/fe6 192725 0 2024-02-10T00:00:37.658 INFO:tasks.workunit.client.0.smithi164.stdout:6/604: rmdir d0/d3b 39 2024-02-10T00:00:37.659 INFO:tasks.workunit.client.1.smithi183.stdout:2/979: stat d2/da/d20/d21/d43/d58/d74/l89 0 2024-02-10T00:00:37.659 INFO:tasks.workunit.client.1.smithi183.stdout:5/893: fsync d4/d74/fd1 0 2024-02-10T00:00:37.660 INFO:tasks.workunit.client.1.smithi183.stdout:3/743: symlink d7/db/d2a/d2d/d51/db8/ld9 0 2024-02-10T00:00:37.661 INFO:tasks.workunit.client.1.smithi183.stdout:2/980: read - d2/da/d20/f137 zero size 2024-02-10T00:00:37.661 INFO:tasks.workunit.client.1.smithi183.stdout:1/787: dwrite d0/d3/d67/fd9 [8388608,4194304] 0 2024-02-10T00:00:37.661 INFO:tasks.workunit.client.1.smithi183.stdout:9/858: rmdir d0/d3/d14/d1c/d4b/d51 39 2024-02-10T00:00:37.662 INFO:tasks.workunit.client.0.smithi164.stdout:2/566: write d3/f62 [226203,63032] 0 2024-02-10T00:00:37.663 INFO:tasks.workunit.client.1.smithi183.stdout:7/799: write d0/d2/d50/ff1 [42355,15203] 0 2024-02-10T00:00:37.663 INFO:tasks.workunit.client.1.smithi183.stdout:4/911: symlink de/d14/d1d/d2f/da2/d109/l11c 0 2024-02-10T00:00:37.664 INFO:tasks.workunit.client.0.smithi164.stdout:5/589: creat d7/d17/d21/d23/d5a/d68/d1f/d70/fbf x:0 0 0 2024-02-10T00:00:37.665 INFO:tasks.workunit.client.1.smithi183.stdout:7/800: write d0/d11/d2f/f66 [2599221,118656] 0 2024-02-10T00:00:37.665 INFO:tasks.workunit.client.1.smithi183.stdout:5/894: creat d4/dd/d71/f124 x:0 0 0 2024-02-10T00:00:37.665 INFO:tasks.workunit.client.0.smithi164.stdout:5/590: dread - d7/d17/d21/d24/fa3 zero size 2024-02-10T00:00:37.665 INFO:tasks.workunit.client.0.smithi164.stdout:1/470: sync 2024-02-10T00:00:37.666 INFO:tasks.workunit.client.1.smithi183.stdout:5/895: chown d4/d74/f105 63941250 1 2024-02-10T00:00:37.667 INFO:tasks.workunit.client.0.smithi164.stdout:1/471: write d1/f11 [6753809,29661] 0 2024-02-10T00:00:37.667 INFO:tasks.workunit.client.1.smithi183.stdout:3/744: dread - d7/db/d2a/d2d/f9b zero size 2024-02-10T00:00:37.667 INFO:tasks.workunit.client.1.smithi183.stdout:6/766: truncate d2/d1a/d25/d3c/d8d/fb7 355802 0 2024-02-10T00:00:37.668 INFO:tasks.workunit.client.0.smithi164.stdout:1/472: fsync d1/d13/d2b/f50 0 2024-02-10T00:00:37.668 INFO:tasks.workunit.client.0.smithi164.stdout:8/495: unlink d2/l16 0 2024-02-10T00:00:37.668 INFO:tasks.workunit.client.1.smithi183.stdout:6/767: readlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/ld9 0 2024-02-10T00:00:37.670 INFO:tasks.workunit.client.1.smithi183.stdout:1/788: mkdir d0/d3/d67/d7b/d113 0 2024-02-10T00:00:37.670 INFO:tasks.workunit.client.1.smithi183.stdout:2/981: symlink d2/da/d20/d21/d36/l149 0 2024-02-10T00:00:37.670 INFO:tasks.workunit.client.0.smithi164.stdout:7/563: dread d3/d4d/f55 [0,4194304] 0 2024-02-10T00:00:37.674 INFO:tasks.workunit.client.1.smithi183.stdout:9/859: write d0/d3/d14/d74/da8/fbd [3305400,123582] 0 2024-02-10T00:00:37.674 INFO:tasks.workunit.client.1.smithi183.stdout:0/882: dread d14/f17 [0,4194304] 0 2024-02-10T00:00:37.675 INFO:tasks.workunit.client.1.smithi183.stdout:8/918: getdents d0/d10/d9e/da4 0 2024-02-10T00:00:37.676 INFO:tasks.workunit.client.0.smithi164.stdout:0/498: write d6/d10/d18/d1c/f3b [570453,100190] 0 2024-02-10T00:00:37.678 INFO:tasks.workunit.client.0.smithi164.stdout:4/545: truncate d2/d2f/d37/d41/d3d/d42/d47/f80 3130644 0 2024-02-10T00:00:37.679 INFO:tasks.workunit.client.1.smithi183.stdout:7/801: dread d0/d2/d50/d5d/f78 [0,4194304] 0 2024-02-10T00:00:37.683 INFO:tasks.workunit.client.0.smithi164.stdout:3/468: unlink d0/d1/d2/d19/d66/d84/c26 0 2024-02-10T00:00:37.684 INFO:tasks.workunit.client.1.smithi183.stdout:5/896: mknod d4/d23/d3e/c125 0 2024-02-10T00:00:37.684 INFO:tasks.workunit.client.0.smithi164.stdout:6/605: dwrite d0/d6/d12/f1f [0,4194304] 0 2024-02-10T00:00:37.685 INFO:tasks.workunit.client.0.smithi164.stdout:3/469: write d0/d1/d3c/d3d/f57 [4731836,28869] 0 2024-02-10T00:00:37.691 INFO:tasks.workunit.client.1.smithi183.stdout:6/768: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:37.692 INFO:tasks.workunit.client.0.smithi164.stdout:0/499: write d6/d3a/d52/f53 [4891887,6350] 0 2024-02-10T00:00:37.692 INFO:tasks.workunit.client.0.smithi164.stdout:4/546: write f1 [172587,28800] 0 2024-02-10T00:00:37.693 INFO:tasks.workunit.client.1.smithi183.stdout:2/982: mkdir d2/d2c/d2f/d60/d14a 0 2024-02-10T00:00:37.696 INFO:tasks.workunit.client.0.smithi164.stdout:3/470: readlink d0/d1/d2/d19/d27/d5f/l6e 0 2024-02-10T00:00:37.696 INFO:tasks.workunit.client.1.smithi183.stdout:1/789: symlink d0/d3/d67/d7b/dfe/l114 0 2024-02-10T00:00:37.696 INFO:tasks.workunit.client.0.smithi164.stdout:2/567: link d3/d26/l8d d3/d24/lcb 0 2024-02-10T00:00:37.697 INFO:tasks.workunit.client.1.smithi183.stdout:0/883: symlink d14/d43/l137 0 2024-02-10T00:00:37.697 INFO:tasks.workunit.client.0.smithi164.stdout:4/547: dwrite d2/d19/d16/d31/d57/f7a [0,4194304] 0 2024-02-10T00:00:37.698 INFO:tasks.workunit.client.0.smithi164.stdout:9/513: getdents d6/de/d22 0 2024-02-10T00:00:37.701 INFO:tasks.workunit.client.1.smithi183.stdout:7/802: unlink d0/d11/l2e 0 2024-02-10T00:00:37.701 INFO:tasks.workunit.client.0.smithi164.stdout:5/591: truncate d7/d17/d21/d23/f5f 247844 0 2024-02-10T00:00:37.703 INFO:tasks.workunit.client.0.smithi164.stdout:0/500: creat d6/d3a/d52/d7a/fa1 x:0 0 0 2024-02-10T00:00:37.704 INFO:tasks.workunit.client.0.smithi164.stdout:0/501: write d6/d7/fc [5044952,72761] 0 2024-02-10T00:00:37.705 INFO:tasks.workunit.client.0.smithi164.stdout:6/606: symlink d0/d2b/d3a/d3d/d42/lcb 0 2024-02-10T00:00:37.708 INFO:tasks.workunit.client.1.smithi183.stdout:8/919: unlink d0/d31/f88 0 2024-02-10T00:00:37.708 INFO:tasks.workunit.client.0.smithi164.stdout:1/473: rename d1/d13/d2b/f4a to d1/fa1 0 2024-02-10T00:00:37.708 INFO:tasks.workunit.client.0.smithi164.stdout:0/502: dwrite d6/d3a/f7d [0,4194304] 0 2024-02-10T00:00:37.709 INFO:tasks.workunit.client.0.smithi164.stdout:0/503: readlink d6/d7/d14/l3c 0 2024-02-10T00:00:37.710 INFO:tasks.workunit.client.1.smithi183.stdout:0/884: creat d14/d1d/d2d/d31/f138 x:0 0 0 2024-02-10T00:00:37.710 INFO:tasks.workunit.client.0.smithi164.stdout:8/496: mkdir d2/d64/d65/d80/d32/d99 0 2024-02-10T00:00:37.714 INFO:tasks.workunit.client.1.smithi183.stdout:5/897: read d4/d23/d3e/d80/da1/d9e/f43 [1412000,5545] 0 2024-02-10T00:00:37.716 INFO:tasks.workunit.client.1.smithi183.stdout:0/885: dwrite d14/d1d/d2d/d31/d6c/d70/f125 [0,4194304] 0 2024-02-10T00:00:37.717 INFO:tasks.workunit.client.0.smithi164.stdout:3/471: rmdir d0 39 2024-02-10T00:00:37.717 INFO:tasks.workunit.client.1.smithi183.stdout:1/790: truncate d0/d3/d7/f23 3103116 0 2024-02-10T00:00:37.717 INFO:tasks.workunit.client.1.smithi183.stdout:4/912: getdents de/d14/d1d/d2f/da2/d9c 0 2024-02-10T00:00:37.718 INFO:tasks.workunit.client.0.smithi164.stdout:2/568: creat d3/da6/d7a/d8e/d36/fcc x:0 0 0 2024-02-10T00:00:37.718 INFO:tasks.workunit.client.1.smithi183.stdout:3/745: getdents d7/db/d2a/da5 0 2024-02-10T00:00:37.719 INFO:tasks.workunit.client.0.smithi164.stdout:2/569: chown d3/f44 277 1 2024-02-10T00:00:37.719 INFO:tasks.workunit.client.0.smithi164.stdout:4/548: mkdir d2/d19/dc1 0 2024-02-10T00:00:37.719 INFO:tasks.workunit.client.1.smithi183.stdout:9/860: getdents d0/d3/d14/d1c 0 2024-02-10T00:00:37.721 INFO:tasks.workunit.client.1.smithi183.stdout:8/920: read d0/d3f/db2/de9/fae [211242,42854] 0 2024-02-10T00:00:37.725 INFO:tasks.workunit.client.1.smithi183.stdout:5/898: creat d4/d23/d3e/d80/d96/f126 x:0 0 0 2024-02-10T00:00:37.727 INFO:tasks.workunit.client.1.smithi183.stdout:9/861: dwrite d0/d3/d14/d74/da8/fba [4194304,4194304] 0 2024-02-10T00:00:37.728 INFO:tasks.workunit.client.0.smithi164.stdout:7/564: rename d3/d28/d45 to d3/d5/d9b/db7 0 2024-02-10T00:00:37.728 INFO:tasks.workunit.client.1.smithi183.stdout:5/899: chown d4/d23/d3e/d80/da1 420836 1 2024-02-10T00:00:37.728 INFO:tasks.workunit.client.1.smithi183.stdout:0/886: readlink d14/d43/dee/l126 0 2024-02-10T00:00:37.729 INFO:tasks.workunit.client.0.smithi164.stdout:0/504: write d6/d10/d18/d2d/f2e [8314855,44668] 0 2024-02-10T00:00:37.729 INFO:tasks.workunit.client.1.smithi183.stdout:8/921: dwrite d0/d3f/db2/de9/f11c [0,4194304] 0 2024-02-10T00:00:37.731 INFO:tasks.workunit.client.1.smithi183.stdout:3/746: rmdir d7/db/d2a/da5 39 2024-02-10T00:00:37.734 INFO:tasks.workunit.client.0.smithi164.stdout:7/565: unlink d3/f22 0 2024-02-10T00:00:37.734 INFO:tasks.workunit.client.0.smithi164.stdout:8/497: write d2/f19 [4990639,30112] 0 2024-02-10T00:00:37.736 INFO:tasks.workunit.client.1.smithi183.stdout:2/983: sync 2024-02-10T00:00:37.737 INFO:tasks.workunit.client.0.smithi164.stdout:5/592: creat d7/d17/fc0 x:0 0 0 2024-02-10T00:00:37.738 INFO:tasks.workunit.client.1.smithi183.stdout:7/803: dread d0/d2/d4/d8/f4d [0,4194304] 0 2024-02-10T00:00:37.738 INFO:tasks.workunit.client.0.smithi164.stdout:3/472: creat d0/d1/d2/f8e x:0 0 0 2024-02-10T00:00:37.740 INFO:tasks.workunit.client.1.smithi183.stdout:6/769: dread d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [0,4194304] 0 2024-02-10T00:00:37.740 INFO:tasks.workunit.client.0.smithi164.stdout:6/607: mknod d0/d2b/d3a/d3d/da7/da9/ccc 0 2024-02-10T00:00:37.741 INFO:tasks.workunit.client.1.smithi183.stdout:5/900: mkdir d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/d127 0 2024-02-10T00:00:37.741 INFO:tasks.workunit.client.1.smithi183.stdout:3/747: mknod d7/db/d2a/d4d/cda 0 2024-02-10T00:00:37.741 INFO:tasks.workunit.client.1.smithi183.stdout:1/791: truncate d0/d3/d67/d70/f10c 299990 0 2024-02-10T00:00:37.742 INFO:tasks.workunit.client.0.smithi164.stdout:1/474: write d1/f4e [254194,86086] 0 2024-02-10T00:00:37.742 INFO:tasks.workunit.client.1.smithi183.stdout:2/984: dwrite d2/d2c/dab/d99/fa3 [0,4194304] 0 2024-02-10T00:00:37.742 INFO:tasks.workunit.client.1.smithi183.stdout:1/792: readlink d0/l2 0 2024-02-10T00:00:37.743 INFO:tasks.workunit.client.1.smithi183.stdout:1/793: chown d0/f5a 1139 1 2024-02-10T00:00:37.743 INFO:tasks.workunit.client.1.smithi183.stdout:0/887: rename d14/d3e/lc1 to d14/d1d/d55/d6e/d74/d11b/l139 0 2024-02-10T00:00:37.744 INFO:tasks.workunit.client.1.smithi183.stdout:6/770: read d2/dab/fdb [2329011,110064] 0 2024-02-10T00:00:37.745 INFO:tasks.workunit.client.0.smithi164.stdout:2/570: dwrite d3/da6/d7a/d8e/d36/d54/f65 [0,4194304] 0 2024-02-10T00:00:37.746 INFO:tasks.workunit.client.0.smithi164.stdout:9/514: rename d6/d41/c5e to d6/de/d40/c9c 0 2024-02-10T00:00:37.747 INFO:tasks.workunit.client.0.smithi164.stdout:7/566: write d3/d4d/f55 [2424677,101914] 0 2024-02-10T00:00:37.749 INFO:tasks.workunit.client.1.smithi183.stdout:3/748: chown d7/c3d 508 1 2024-02-10T00:00:37.750 INFO:tasks.workunit.client.1.smithi183.stdout:4/913: dwrite de/d14/d27/fb9 [0,4194304] 0 2024-02-10T00:00:37.750 INFO:tasks.workunit.client.0.smithi164.stdout:0/505: truncate d6/d10/d18/d2d/d39/f9b 186435 0 2024-02-10T00:00:37.751 INFO:tasks.workunit.client.0.smithi164.stdout:3/473: truncate d0/d1/d2/d19/f33 3569203 0 2024-02-10T00:00:37.751 INFO:tasks.workunit.client.0.smithi164.stdout:9/515: dwrite d6/de/d2b/d5b/d61/d76/f78 [0,4194304] 0 2024-02-10T00:00:37.752 INFO:tasks.workunit.client.1.smithi183.stdout:0/888: creat d14/d3e/d5f/daa/de6/f13a x:0 0 0 2024-02-10T00:00:37.752 INFO:tasks.workunit.client.0.smithi164.stdout:1/475: fsync d1/d23/f84 0 2024-02-10T00:00:37.753 INFO:tasks.workunit.client.1.smithi183.stdout:9/862: rmdir d0/d3/d14/d1c/d2d/d4f/d89/dc5/dfe 0 2024-02-10T00:00:37.753 INFO:tasks.workunit.client.0.smithi164.stdout:0/506: write d6/d10/d18/d2d/d35/d44/f98 [630562,81708] 0 2024-02-10T00:00:37.754 INFO:tasks.workunit.client.0.smithi164.stdout:1/476: write d1/f1b [1136702,26345] 0 2024-02-10T00:00:37.755 INFO:tasks.workunit.client.0.smithi164.stdout:2/571: symlink d3/da6/d7a/d8e/d36/d90/lcd 0 2024-02-10T00:00:37.755 INFO:tasks.workunit.client.0.smithi164.stdout:7/567: fsync d3/f1d 0 2024-02-10T00:00:37.755 INFO:tasks.workunit.client.0.smithi164.stdout:0/507: read d6/d10/d18/d1c/f3b [698899,62427] 0 2024-02-10T00:00:37.757 INFO:tasks.workunit.client.1.smithi183.stdout:7/804: creat d0/d11/d2f/db8/ded/ffa x:0 0 0 2024-02-10T00:00:37.759 INFO:tasks.workunit.client.1.smithi183.stdout:5/901: unlink d4/d23/d3e/d80/da1/d9e/d89/f9b 0 2024-02-10T00:00:37.759 INFO:tasks.workunit.client.0.smithi164.stdout:3/474: unlink d0/d1/d2/d19/d27/d5f/c78 0 2024-02-10T00:00:37.761 INFO:tasks.workunit.client.1.smithi183.stdout:4/914: symlink de/l11d 0 2024-02-10T00:00:37.761 INFO:tasks.workunit.client.0.smithi164.stdout:4/549: rename d2/f8 to d2/d2f/d37/d41/d3d/d42/da2/fc2 0 2024-02-10T00:00:37.762 INFO:tasks.workunit.client.1.smithi183.stdout:0/889: mknod d14/d1d/d2d/d31/d68/dcc/c13b 0 2024-02-10T00:00:37.763 INFO:tasks.workunit.client.1.smithi183.stdout:9/863: mknod d0/d3/d14/d1c/d2d/d4f/db8/c114 0 2024-02-10T00:00:37.763 INFO:tasks.workunit.client.0.smithi164.stdout:1/477: symlink d1/d64/la2 0 2024-02-10T00:00:37.764 INFO:tasks.workunit.client.1.smithi183.stdout:6/771: fsync d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f83 0 2024-02-10T00:00:37.764 INFO:tasks.workunit.client.1.smithi183.stdout:9/864: chown d0/d3/d14/d1c/d2d/d4f/fb1 65735321 1 2024-02-10T00:00:37.767 INFO:tasks.workunit.client.0.smithi164.stdout:9/516: symlink d6/l9d 0 2024-02-10T00:00:37.770 INFO:tasks.workunit.client.0.smithi164.stdout:6/608: rename d0/d6/d4d to d0/d6/d95/dcd 0 2024-02-10T00:00:37.772 INFO:tasks.workunit.client.0.smithi164.stdout:0/508: mkdir d6/d7/d14/d79/da2 0 2024-02-10T00:00:37.773 INFO:tasks.workunit.client.1.smithi183.stdout:1/794: truncate d0/d3/da9/fda 155446 0 2024-02-10T00:00:37.773 INFO:tasks.workunit.client.1.smithi183.stdout:7/805: rename d0/d11/d3e/ca1 to d0/d11/d2f/dbf/cfb 0 2024-02-10T00:00:37.774 INFO:tasks.workunit.client.1.smithi183.stdout:9/865: write d0/d3/d14/d1c/d2d/d4f/fd2 [1598797,89402] 0 2024-02-10T00:00:37.775 INFO:tasks.workunit.client.0.smithi164.stdout:3/475: mkdir d0/d8f 0 2024-02-10T00:00:37.776 INFO:tasks.workunit.client.0.smithi164.stdout:9/517: creat d6/d4b/f9e x:0 0 0 2024-02-10T00:00:37.776 INFO:tasks.workunit.client.1.smithi183.stdout:1/795: chown d0/d3/d67/d7b/dfe/f4d 765832663 1 2024-02-10T00:00:37.777 INFO:tasks.workunit.client.0.smithi164.stdout:2/572: truncate d3/d32/d4e/fc6 110657 0 2024-02-10T00:00:37.777 INFO:tasks.workunit.client.0.smithi164.stdout:0/509: rmdir d6/d10/d18/d2d/d35 39 2024-02-10T00:00:37.778 INFO:tasks.workunit.client.1.smithi183.stdout:4/915: truncate de/d14/d4e/f94 3121582 0 2024-02-10T00:00:37.779 INFO:tasks.workunit.client.0.smithi164.stdout:4/550: truncate d2/d19/d16/d31/f70 688901 0 2024-02-10T00:00:37.780 INFO:tasks.workunit.client.0.smithi164.stdout:9/518: creat d6/de/d40/f9f x:0 0 0 2024-02-10T00:00:37.780 INFO:tasks.workunit.client.0.smithi164.stdout:4/551: write d2/d19/d16/d31/d7e/d81/f87 [1228709,63160] 0 2024-02-10T00:00:37.780 INFO:tasks.workunit.client.1.smithi183.stdout:7/806: mkdir d0/d11/d9d/dfc 0 2024-02-10T00:00:37.781 INFO:tasks.workunit.client.0.smithi164.stdout:2/573: unlink d3/da6/d7a/d8e/c68 0 2024-02-10T00:00:37.782 INFO:tasks.workunit.client.1.smithi183.stdout:7/807: write d0/d2/d50/dad/fc5 [453964,6791] 0 2024-02-10T00:00:37.782 INFO:tasks.workunit.client.0.smithi164.stdout:0/510: mknod d6/d7/d14/ca3 0 2024-02-10T00:00:37.784 INFO:tasks.workunit.client.0.smithi164.stdout:2/574: write d3/d32/d4e/f67 [877989,97987] 0 2024-02-10T00:00:37.784 INFO:tasks.workunit.client.1.smithi183.stdout:9/866: rmdir d0/d3/d14/d48 39 2024-02-10T00:00:37.785 INFO:tasks.workunit.client.0.smithi164.stdout:7/568: dread d3/d11/d39/d3a/f7d [0,4194304] 0 2024-02-10T00:00:37.785 INFO:tasks.workunit.client.0.smithi164.stdout:9/519: creat d6/de/fa0 x:0 0 0 2024-02-10T00:00:37.786 INFO:tasks.workunit.client.1.smithi183.stdout:4/916: symlink de/d22/l11e 0 2024-02-10T00:00:37.787 INFO:tasks.workunit.client.0.smithi164.stdout:2/575: dread - d3/d26/d64/f9c zero size 2024-02-10T00:00:37.787 INFO:tasks.workunit.client.1.smithi183.stdout:7/808: creat d0/d11/d2f/db8/ded/ffd x:0 0 0 2024-02-10T00:00:37.787 INFO:tasks.workunit.client.1.smithi183.stdout:1/796: mkdir d0/d3/d7/def/d115 0 2024-02-10T00:00:37.788 INFO:tasks.workunit.client.0.smithi164.stdout:4/552: dwrite d2/d2f/d37/d41/d69/fb6 [0,4194304] 0 2024-02-10T00:00:37.789 INFO:tasks.workunit.client.0.smithi164.stdout:2/576: write d3/f1f [2118074,65761] 0 2024-02-10T00:00:37.790 INFO:tasks.workunit.client.1.smithi183.stdout:9/867: creat d0/d30/d52/ddc/de1/f115 x:0 0 0 2024-02-10T00:00:37.790 INFO:tasks.workunit.client.0.smithi164.stdout:2/577: chown d3/cc 277648 1 2024-02-10T00:00:37.790 INFO:tasks.workunit.client.0.smithi164.stdout:4/553: chown d2/d2f/d37/d41/d3d/d42/d5f/fad 7837674 1 2024-02-10T00:00:37.790 INFO:tasks.workunit.client.0.smithi164.stdout:2/578: readlink d3/d32/l40 0 2024-02-10T00:00:37.791 INFO:tasks.workunit.client.1.smithi183.stdout:4/917: creat de/d19/d1c/d61/f11f x:0 0 0 2024-02-10T00:00:37.791 INFO:tasks.workunit.client.0.smithi164.stdout:3/476: dread d0/d1/d2/d17/f54 [0,4194304] 0 2024-02-10T00:00:37.791 INFO:tasks.workunit.client.0.smithi164.stdout:5/593: sync 2024-02-10T00:00:37.792 INFO:tasks.workunit.client.1.smithi183.stdout:8/922: dread d0/f1e [0,4194304] 0 2024-02-10T00:00:37.792 INFO:tasks.workunit.client.0.smithi164.stdout:2/579: chown d3/d32/d4e/d27/f74 29585 1 2024-02-10T00:00:37.792 INFO:tasks.workunit.client.1.smithi183.stdout:1/797: mknod d0/d3c/dc9/c116 0 2024-02-10T00:00:37.793 INFO:tasks.workunit.client.1.smithi183.stdout:7/809: mknod d0/d2/d50/dad/df8/cfe 0 2024-02-10T00:00:37.793 INFO:tasks.workunit.client.0.smithi164.stdout:9/520: truncate d6/d4b/f57 3516620 0 2024-02-10T00:00:37.794 INFO:tasks.workunit.client.0.smithi164.stdout:3/477: readlink d0/d1/d2/d19/d66/d84/l23 0 2024-02-10T00:00:37.794 INFO:tasks.workunit.client.0.smithi164.stdout:5/594: dread - d7/d17/d21/d24/dbc/d45/d5c/fb6 zero size 2024-02-10T00:00:37.794 INFO:tasks.workunit.client.0.smithi164.stdout:9/521: fdatasync d6/f3e 0 2024-02-10T00:00:37.794 INFO:tasks.workunit.client.0.smithi164.stdout:4/554: symlink d2/d2f/d37/d41/d3d/d42/lc3 0 2024-02-10T00:00:37.796 INFO:tasks.workunit.client.0.smithi164.stdout:5/595: chown d7/d17/d69/f6a 203679 1 2024-02-10T00:00:37.796 INFO:tasks.workunit.client.0.smithi164.stdout:9/522: chown d6/de/d40/d74/l7a 93 1 2024-02-10T00:00:37.796 INFO:tasks.workunit.client.0.smithi164.stdout:4/555: chown d2/d19/d16/daa/lac 5490 1 2024-02-10T00:00:37.796 INFO:tasks.workunit.client.0.smithi164.stdout:9/523: stat d6/de/f6a 0 2024-02-10T00:00:37.797 INFO:tasks.workunit.client.0.smithi164.stdout:8/498: dread d2/f4 [8388608,4194304] 0 2024-02-10T00:00:37.797 INFO:tasks.workunit.client.1.smithi183.stdout:1/798: creat d0/d3a/dd8/d108/f117 x:0 0 0 2024-02-10T00:00:37.798 INFO:tasks.workunit.client.1.smithi183.stdout:1/799: chown d0/d3/d7/f19 5 1 2024-02-10T00:00:37.800 INFO:tasks.workunit.client.1.smithi183.stdout:1/800: read d0/f5a [1091024,96962] 0 2024-02-10T00:00:37.800 INFO:tasks.workunit.client.1.smithi183.stdout:7/810: mkdir d0/d11/d88/d94/dff 0 2024-02-10T00:00:37.801 INFO:tasks.workunit.client.0.smithi164.stdout:3/478: dwrite d0/d1/d3c/f63 [0,4194304] 0 2024-02-10T00:00:37.802 INFO:tasks.workunit.client.1.smithi183.stdout:2/985: dread d2/da/d5b/f8a [0,4194304] 0 2024-02-10T00:00:37.803 INFO:tasks.workunit.client.1.smithi183.stdout:8/923: rename d0/d4e/da6/dde/de7 to d0/d4e/d53/d120 0 2024-02-10T00:00:37.803 INFO:tasks.workunit.client.0.smithi164.stdout:5/596: read d7/d17/d21/f29 [30065,56190] 0 2024-02-10T00:00:37.804 INFO:tasks.workunit.client.0.smithi164.stdout:9/524: dwrite d6/d41/d8b/d24/f73 [4194304,4194304] 0 2024-02-10T00:00:37.804 INFO:tasks.workunit.client.0.smithi164.stdout:9/525: fsync d6/d41/d8b/d24/d4f/f98 0 2024-02-10T00:00:37.805 INFO:tasks.workunit.client.1.smithi183.stdout:6/772: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f67 [0,4194304] 0 2024-02-10T00:00:37.806 INFO:tasks.workunit.client.1.smithi183.stdout:1/801: symlink d0/d3a/l118 0 2024-02-10T00:00:37.808 INFO:tasks.workunit.client.0.smithi164.stdout:2/580: getdents d3/d32 0 2024-02-10T00:00:37.808 INFO:tasks.workunit.client.1.smithi183.stdout:2/986: dwrite d2/da/d20/d21/ff6 [0,4194304] 0 2024-02-10T00:00:37.810 INFO:tasks.workunit.client.1.smithi183.stdout:0/890: dread d14/d43/f122 [0,4194304] 0 2024-02-10T00:00:37.811 INFO:tasks.workunit.client.0.smithi164.stdout:9/526: dwrite d6/de/d2b/d5b/d61/f6d [0,4194304] 0 2024-02-10T00:00:37.812 INFO:tasks.workunit.client.0.smithi164.stdout:8/499: creat d2/d64/d65/d80/d32/d93/f9a x:0 0 0 2024-02-10T00:00:37.814 INFO:tasks.workunit.client.1.smithi183.stdout:6/773: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d34/dee 0 2024-02-10T00:00:37.814 INFO:tasks.workunit.client.1.smithi183.stdout:1/802: truncate d0/fc5 1140221 0 2024-02-10T00:00:37.815 INFO:tasks.workunit.client.0.smithi164.stdout:2/581: dwrite d3/f7 [0,4194304] 0 2024-02-10T00:00:37.815 INFO:tasks.workunit.client.0.smithi164.stdout:6/609: sync 2024-02-10T00:00:37.820 INFO:tasks.workunit.client.1.smithi183.stdout:8/924: getdents d0/d3f/db2/dee 0 2024-02-10T00:00:37.820 INFO:tasks.workunit.client.0.smithi164.stdout:3/479: rename d0/d1/d2/d17/d37/d3f/d4e/d6d/f4b to d0/d1/d2/d17/d37/f90 0 2024-02-10T00:00:37.822 INFO:tasks.workunit.client.0.smithi164.stdout:8/500: fdatasync d2/f41 0 2024-02-10T00:00:37.824 INFO:tasks.workunit.client.1.smithi183.stdout:2/987: dread d2/da/f17 [0,4194304] 0 2024-02-10T00:00:37.825 INFO:tasks.workunit.client.1.smithi183.stdout:0/891: link d14/d43/f78 d14/d1d/d59/d3c/f13c 0 2024-02-10T00:00:37.828 INFO:tasks.workunit.client.0.smithi164.stdout:3/480: creat d0/d1/d3c/d3d/f91 x:0 0 0 2024-02-10T00:00:37.829 INFO:tasks.workunit.client.1.smithi183.stdout:2/988: creat d2/d2c/dba/df0/dbd/f14b x:0 0 0 2024-02-10T00:00:37.831 INFO:tasks.workunit.client.1.smithi183.stdout:6/774: creat d2/d1a/d25/d3c/d31/d38/d6e/ded/fef x:0 0 0 2024-02-10T00:00:37.833 INFO:tasks.workunit.client.1.smithi183.stdout:6/775: write d2/d1a/d25/d3c/d31/d38/d3f/f4d [1384384,42846] 0 2024-02-10T00:00:37.833 INFO:tasks.workunit.client.1.smithi183.stdout:0/892: symlink d14/d3e/l13d 0 2024-02-10T00:00:37.834 INFO:tasks.workunit.client.1.smithi183.stdout:2/989: mkdir d2/d2c/d2f/dbb/d14c 0 2024-02-10T00:00:37.834 INFO:tasks.workunit.client.1.smithi183.stdout:8/925: dread d0/d27/d75/d5b/f89 [0,4194304] 0 2024-02-10T00:00:37.835 INFO:tasks.workunit.client.1.smithi183.stdout:2/990: chown d2/da/d20/d21/d43/f103 75 1 2024-02-10T00:00:37.836 INFO:tasks.workunit.client.1.smithi183.stdout:6/776: creat d2/d1a/d25/d3c/d8d/ff0 x:0 0 0 2024-02-10T00:00:37.836 INFO:tasks.workunit.client.0.smithi164.stdout:1/478: dwrite d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:37.838 INFO:tasks.workunit.client.0.smithi164.stdout:1/479: fdatasync d1/d13/d2b/d54/f77 0 2024-02-10T00:00:37.839 INFO:tasks.workunit.client.0.smithi164.stdout:4/556: dread d2/d19/d16/f53 [0,4194304] 0 2024-02-10T00:00:37.840 INFO:tasks.workunit.client.0.smithi164.stdout:5/597: link d7/d17/d21/d23/d5a/d68/d1f/d59/f82 d7/d17/d21/d23/fc1 0 2024-02-10T00:00:37.840 INFO:tasks.workunit.client.0.smithi164.stdout:1/480: fdatasync d1/d13/d1f/f7a 0 2024-02-10T00:00:37.841 INFO:tasks.workunit.client.1.smithi183.stdout:3/749: write d7/db/d2a/d33/f56 [3909127,114420] 0 2024-02-10T00:00:37.842 INFO:tasks.workunit.client.0.smithi164.stdout:7/569: dread d3/d5/d2b/d4a/f6b [0,4194304] 0 2024-02-10T00:00:37.842 INFO:tasks.workunit.client.1.smithi183.stdout:3/750: write d7/db/d2a/f44 [489602,30152] 0 2024-02-10T00:00:37.842 INFO:tasks.workunit.client.1.smithi183.stdout:0/893: creat d14/d1d/d59/d71/dcb/d11d/f13e x:0 0 0 2024-02-10T00:00:37.843 INFO:tasks.workunit.client.1.smithi183.stdout:9/868: sync 2024-02-10T00:00:37.844 INFO:tasks.workunit.client.1.smithi183.stdout:4/918: sync 2024-02-10T00:00:37.846 INFO:tasks.workunit.client.0.smithi164.stdout:7/570: dwrite d3/d11/d39/d44/d6f/f9e [4194304,4194304] 0 2024-02-10T00:00:37.847 INFO:tasks.workunit.client.1.smithi183.stdout:6/777: mkdir d2/da0/df1 0 2024-02-10T00:00:37.848 INFO:tasks.workunit.client.0.smithi164.stdout:3/481: rmdir d0/d1/d2/d17/d37/d3f/d4e/d6d 39 2024-02-10T00:00:37.850 INFO:tasks.workunit.client.0.smithi164.stdout:2/582: rename d3/d24/d51 to d3/da6/d7a/d8e/db6/dce 0 2024-02-10T00:00:37.850 INFO:tasks.workunit.client.1.smithi183.stdout:5/902: dwrite d4/d23/d4a/d36/fb8 [0,4194304] 0 2024-02-10T00:00:37.852 INFO:tasks.workunit.client.1.smithi183.stdout:5/903: write d4/d23/d3e/d80/da1/d9e/d89/dd4/deb/f100 [876874,22489] 0 2024-02-10T00:00:37.854 INFO:tasks.workunit.client.1.smithi183.stdout:5/904: chown d4/d23/d3e/d80/d96/c111 602 1 2024-02-10T00:00:37.855 INFO:tasks.workunit.client.1.smithi183.stdout:5/905: fsync d4/d74/f7e 0 2024-02-10T00:00:37.855 INFO:tasks.workunit.client.0.smithi164.stdout:6/610: creat d0/d3b/fce x:0 0 0 2024-02-10T00:00:37.855 INFO:tasks.workunit.client.1.smithi183.stdout:3/751: dwrite d7/db/d2a/d2d/d6a/fce [0,4194304] 0 2024-02-10T00:00:37.857 INFO:tasks.workunit.client.0.smithi164.stdout:7/571: dread d3/d11/d39/d44/fad [0,4194304] 0 2024-02-10T00:00:37.858 INFO:tasks.workunit.client.0.smithi164.stdout:1/481: unlink d1/d1a/d41/d18/d3a/f51 0 2024-02-10T00:00:37.858 INFO:tasks.workunit.client.1.smithi183.stdout:9/869: symlink d0/d30/db5/l116 0 2024-02-10T00:00:37.859 INFO:tasks.workunit.client.1.smithi183.stdout:4/919: mkdir de/d19/d8d/d112/d120 0 2024-02-10T00:00:37.860 INFO:tasks.workunit.client.0.smithi164.stdout:3/482: write d0/f5e [21630,109291] 0 2024-02-10T00:00:37.861 INFO:tasks.workunit.client.1.smithi183.stdout:6/778: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/dee/ff2 x:0 0 0 2024-02-10T00:00:37.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/501: truncate d2/d64/d65/d80/d32/d4d/f88 58151 0 2024-02-10T00:00:37.862 INFO:tasks.workunit.client.0.smithi164.stdout:0/511: dread d6/d10/d4a/d60/d6c/f46 [0,4194304] 0 2024-02-10T00:00:37.863 INFO:tasks.workunit.client.1.smithi183.stdout:5/906: fsync d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fd7 0 2024-02-10T00:00:37.863 INFO:tasks.workunit.client.0.smithi164.stdout:4/557: rename d2/d2f/d37/d41/d3d/d42/d47/fa6 to d2/d2f/d37/d45/dab/dbd/fc4 0 2024-02-10T00:00:37.863 INFO:tasks.workunit.client.1.smithi183.stdout:0/894: truncate d14/d1d/d59/d3c/f111 522968 0 2024-02-10T00:00:37.865 INFO:tasks.workunit.client.0.smithi164.stdout:6/611: symlink d0/d2b/d3a/d3d/d42/d5d/d79/d92/d93/lcf 0 2024-02-10T00:00:37.867 INFO:tasks.workunit.client.1.smithi183.stdout:5/907: dread d4/d23/f26 [0,4194304] 0 2024-02-10T00:00:37.871 INFO:tasks.workunit.client.0.smithi164.stdout:8/502: mknod d2/d64/d65/c9b 0 2024-02-10T00:00:37.871 INFO:tasks.workunit.client.1.smithi183.stdout:6/779: rename d2/d1a/d25/d3c/d31/d38/d6e/f97 to d2/d1a/d25/ff3 0 2024-02-10T00:00:37.871 INFO:tasks.workunit.client.0.smithi164.stdout:0/512: chown d6/d10/d18/d1c/l29 3480 1 2024-02-10T00:00:37.872 INFO:tasks.workunit.client.0.smithi164.stdout:0/513: stat d6/d10/d18/d2d/f5a 0 2024-02-10T00:00:37.874 INFO:tasks.workunit.client.1.smithi183.stdout:6/780: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fb6 [0,4194304] 0 2024-02-10T00:00:37.875 INFO:tasks.workunit.client.0.smithi164.stdout:3/483: creat d0/d1/d2/d17/d37/d3f/d4e/d6d/f92 x:0 0 0 2024-02-10T00:00:37.875 INFO:tasks.workunit.client.0.smithi164.stdout:9/527: sync 2024-02-10T00:00:37.876 INFO:tasks.workunit.client.0.smithi164.stdout:9/528: write d6/f86 [2565726,26631] 0 2024-02-10T00:00:37.877 INFO:tasks.workunit.client.0.smithi164.stdout:9/529: write d6/f7 [2352574,105083] 0 2024-02-10T00:00:37.877 INFO:tasks.workunit.client.1.smithi183.stdout:1/803: dread d0/d3/d67/d70/fc7 [0,4194304] 0 2024-02-10T00:00:37.878 INFO:tasks.workunit.client.1.smithi183.stdout:6/781: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/ff4 x:0 0 0 2024-02-10T00:00:37.878 INFO:tasks.workunit.client.1.smithi183.stdout:6/782: stat d2/d1a/d25/d3c/d8d 0 2024-02-10T00:00:37.880 INFO:tasks.workunit.client.1.smithi183.stdout:6/783: mknod d2/d1a/d25/d3c/d31/d38/cf5 0 2024-02-10T00:00:37.881 INFO:tasks.workunit.client.0.smithi164.stdout:4/558: creat d2/d19/d16/fc5 x:0 0 0 2024-02-10T00:00:37.882 INFO:tasks.workunit.client.1.smithi183.stdout:1/804: dwrite d0/d3/d67/fc8 [0,4194304] 0 2024-02-10T00:00:37.883 INFO:tasks.workunit.client.0.smithi164.stdout:9/530: symlink d6/de/d2b/d5b/d61/la1 0 2024-02-10T00:00:37.884 INFO:tasks.workunit.client.0.smithi164.stdout:9/531: readlink d6/de/d2b/d5b/d61/l8e 0 2024-02-10T00:00:37.885 INFO:tasks.workunit.client.0.smithi164.stdout:4/559: dwrite d2/f1a [0,4194304] 0 2024-02-10T00:00:37.885 INFO:tasks.workunit.client.1.smithi183.stdout:6/784: mknod d2/d1a/d25/d3c/d31/cf6 0 2024-02-10T00:00:37.887 INFO:tasks.workunit.client.0.smithi164.stdout:0/514: rename d6/d10/d18/d1c/l29 to d6/d10/d18/la4 0 2024-02-10T00:00:37.887 INFO:tasks.workunit.client.1.smithi183.stdout:6/785: symlink d2/d1a/d25/d3c/d31/d66/lf7 0 2024-02-10T00:00:37.890 INFO:tasks.workunit.client.1.smithi183.stdout:6/786: creat d2/d32/ff8 x:0 0 0 2024-02-10T00:00:37.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/560: mkdir d2/d2f/d37/d71/dc6 0 2024-02-10T00:00:37.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/561: read - d2/d19/d16/f88 zero size 2024-02-10T00:00:37.891 INFO:tasks.workunit.client.1.smithi183.stdout:6/787: write d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fea [490923,106720] 0 2024-02-10T00:00:37.892 INFO:tasks.workunit.client.0.smithi164.stdout:9/532: rename d6/de/d22/d58/c63 to d6/de/d40/d74/ca2 0 2024-02-10T00:00:37.892 INFO:tasks.workunit.client.1.smithi183.stdout:6/788: fdatasync d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fd5 0 2024-02-10T00:00:37.893 INFO:tasks.workunit.client.0.smithi164.stdout:8/503: link d2/d12/c2a d2/d64/d65/d80/c9c 0 2024-02-10T00:00:37.893 INFO:tasks.workunit.client.1.smithi183.stdout:6/789: stat d2/d1a/d25/d3c/d31 0 2024-02-10T00:00:37.897 INFO:tasks.workunit.client.0.smithi164.stdout:8/504: mknod d2/d64/d54/d71/d78/c9d 0 2024-02-10T00:00:37.898 INFO:tasks.workunit.client.0.smithi164.stdout:0/515: creat d6/fa5 x:0 0 0 2024-02-10T00:00:37.900 INFO:tasks.workunit.client.1.smithi183.stdout:6/790: write d2/d1a/d25/d3c/d31/f70 [2895660,87712] 0 2024-02-10T00:00:37.901 INFO:tasks.workunit.client.1.smithi183.stdout:7/811: dwrite d0/d2/d50/d5d/f78 [0,4194304] 0 2024-02-10T00:00:37.901 INFO:tasks.workunit.client.0.smithi164.stdout:0/516: mkdir d6/d7/d14/da6 0 2024-02-10T00:00:37.902 INFO:tasks.workunit.client.1.smithi183.stdout:4/920: sync 2024-02-10T00:00:37.903 INFO:tasks.workunit.client.1.smithi183.stdout:4/921: write de/d14/d27/d40/ffc [563910,19041] 0 2024-02-10T00:00:37.904 INFO:tasks.workunit.client.0.smithi164.stdout:9/533: creat d6/fa3 x:0 0 0 2024-02-10T00:00:37.904 INFO:tasks.workunit.client.0.smithi164.stdout:8/505: dwrite d2/f11 [4194304,4194304] 0 2024-02-10T00:00:37.904 INFO:tasks.workunit.client.1.smithi183.stdout:7/812: mkdir d0/d2/d100 0 2024-02-10T00:00:37.905 INFO:tasks.workunit.client.0.smithi164.stdout:8/506: dread - d2/d64/d63/f70 zero size 2024-02-10T00:00:37.905 INFO:tasks.workunit.client.0.smithi164.stdout:0/517: write d6/d10/f1d [2578574,34003] 0 2024-02-10T00:00:37.910 INFO:tasks.workunit.client.0.smithi164.stdout:9/534: rename d6/de/d2b/d5b/f9b to d6/de/d2b/d5b/d61/d76/d82/fa4 0 2024-02-10T00:00:37.911 INFO:tasks.workunit.client.0.smithi164.stdout:0/518: creat d6/d3a/d52/fa7 x:0 0 0 2024-02-10T00:00:37.915 INFO:tasks.workunit.client.0.smithi164.stdout:9/535: dwrite d6/de/d22/d69/f91 [0,4194304] 0 2024-02-10T00:00:37.918 INFO:tasks.workunit.client.1.smithi183.stdout:0/895: dread d14/d43/fb7 [0,4194304] 0 2024-02-10T00:00:37.921 INFO:tasks.workunit.client.1.smithi183.stdout:8/926: dwrite d0/d27/d75/d5b/fc1 [0,4194304] 0 2024-02-10T00:00:37.921 INFO:tasks.workunit.client.1.smithi183.stdout:2/991: dwrite d2/f8 [0,4194304] 0 2024-02-10T00:00:37.923 INFO:tasks.workunit.client.0.smithi164.stdout:8/507: unlink d2/d64/d65/d80/d32/d4d/f88 0 2024-02-10T00:00:37.923 INFO:tasks.workunit.client.1.smithi183.stdout:0/896: creat d14/d1d/d2d/d31/d6c/de3/f13f x:0 0 0 2024-02-10T00:00:37.926 INFO:tasks.workunit.client.0.smithi164.stdout:5/598: dwrite d7/d17/d21/d23/f5f [0,4194304] 0 2024-02-10T00:00:37.927 INFO:tasks.workunit.client.0.smithi164.stdout:5/599: chown d7/d17/d21/d23/d5a/d68/d1f/d70/lb0 22107208 1 2024-02-10T00:00:37.928 INFO:tasks.workunit.client.0.smithi164.stdout:5/600: readlink d7/d17/l88 0 2024-02-10T00:00:37.928 INFO:tasks.workunit.client.1.smithi183.stdout:0/897: mknod d14/d1d/d55/dfa/c140 0 2024-02-10T00:00:37.929 INFO:tasks.workunit.client.0.smithi164.stdout:8/508: chown d2/f29 9 1 2024-02-10T00:00:37.929 INFO:tasks.workunit.client.1.smithi183.stdout:6/791: getdents d2/da0 0 2024-02-10T00:00:37.933 INFO:tasks.workunit.client.1.smithi183.stdout:8/927: getdents d0/d10/d9e 0 2024-02-10T00:00:37.933 INFO:tasks.workunit.client.1.smithi183.stdout:6/792: symlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lf9 0 2024-02-10T00:00:37.934 INFO:tasks.workunit.client.1.smithi183.stdout:8/928: dread - d0/d31/f109 zero size 2024-02-10T00:00:37.934 INFO:tasks.workunit.client.1.smithi183.stdout:6/793: fdatasync d2/d32/ff8 0 2024-02-10T00:00:37.934 INFO:tasks.workunit.client.1.smithi183.stdout:3/752: fsync d7/db/d2a/d2d/d6a/fce 0 2024-02-10T00:00:37.936 INFO:tasks.workunit.client.0.smithi164.stdout:7/572: dwrite d3/d11/d39/d44/d48/d71/f91 [4194304,4194304] 0 2024-02-10T00:00:37.938 INFO:tasks.workunit.client.0.smithi164.stdout:1/482: dread d1/f9 [0,4194304] 0 2024-02-10T00:00:37.938 INFO:tasks.workunit.client.0.smithi164.stdout:5/601: unlink d7/d17/d21/d23/d5a/d68/d1f/d70/fbf 0 2024-02-10T00:00:37.939 INFO:tasks.workunit.client.1.smithi183.stdout:1/805: dread d0/d3/d67/d70/f10c [0,4194304] 0 2024-02-10T00:00:37.939 INFO:tasks.workunit.client.1.smithi183.stdout:1/806: chown d0/d3c/fd7 2044211637 1 2024-02-10T00:00:37.940 INFO:tasks.workunit.client.1.smithi183.stdout:1/807: write d0/d3/d67/d70/fb7 [225462,32630] 0 2024-02-10T00:00:37.940 INFO:tasks.workunit.client.1.smithi183.stdout:1/808: readlink d0/d3/d29/l59 0 2024-02-10T00:00:37.941 INFO:tasks.workunit.client.0.smithi164.stdout:9/536: truncate d6/d4b/f9e 112720 0 2024-02-10T00:00:37.941 INFO:tasks.workunit.client.0.smithi164.stdout:2/583: write d3/f3e [427961,75208] 0 2024-02-10T00:00:37.941 INFO:tasks.workunit.client.1.smithi183.stdout:0/898: read d14/d1d/d59/d3c/ff6 [3499241,111708] 0 2024-02-10T00:00:37.942 INFO:tasks.workunit.client.1.smithi183.stdout:0/899: fdatasync d14/f11f 0 2024-02-10T00:00:37.942 INFO:tasks.workunit.client.0.smithi164.stdout:1/483: dwrite d1/d1a/d41/fe [0,4194304] 0 2024-02-10T00:00:37.944 INFO:tasks.workunit.client.0.smithi164.stdout:1/484: dread - d1/d13/d2b/d54/f6a zero size 2024-02-10T00:00:37.944 INFO:tasks.workunit.client.0.smithi164.stdout:6/612: truncate d0/d6/d12/d14/f61 5207694 0 2024-02-10T00:00:37.946 INFO:tasks.workunit.client.1.smithi183.stdout:6/794: dwrite d2/fb0 [0,4194304] 0 2024-02-10T00:00:37.946 INFO:tasks.workunit.client.0.smithi164.stdout:6/613: fsync d0/d2b/d3a/d3d/d42/d5d/d79/fb1 0 2024-02-10T00:00:37.948 INFO:tasks.workunit.client.1.smithi183.stdout:9/870: write d0/d92/db7/fdb [1433636,40644] 0 2024-02-10T00:00:37.953 INFO:tasks.workunit.client.1.smithi183.stdout:5/908: dwrite d4/dd/f25 [0,4194304] 0 2024-02-10T00:00:37.955 INFO:tasks.workunit.client.1.smithi183.stdout:3/753: dread d7/f55 [4194304,4194304] 0 2024-02-10T00:00:37.956 INFO:tasks.workunit.client.1.smithi183.stdout:4/922: dwrite de/d14/d27/d2e/f88 [0,4194304] 0 2024-02-10T00:00:37.956 INFO:tasks.workunit.client.1.smithi183.stdout:7/813: dwrite d0/d2/d50/dad/f97 [0,4194304] 0 2024-02-10T00:00:37.957 INFO:tasks.workunit.client.1.smithi183.stdout:6/795: creat d2/ffa x:0 0 0 2024-02-10T00:00:37.957 INFO:tasks.workunit.client.0.smithi164.stdout:4/562: truncate d2/d19/d16/f38 5014928 0 2024-02-10T00:00:37.958 INFO:tasks.workunit.client.1.smithi183.stdout:9/871: rename d0/d3/l10d to d0/d3/d14/d1c/d2d/d4f/db8/l117 0 2024-02-10T00:00:37.958 INFO:tasks.workunit.client.0.smithi164.stdout:4/563: write d2/d19/d16/d31/d57/faf [921465,15458] 0 2024-02-10T00:00:37.958 INFO:tasks.workunit.client.0.smithi164.stdout:0/519: link d6/d10/f61 d6/d10/d18/fa8 0 2024-02-10T00:00:37.959 INFO:tasks.workunit.client.1.smithi183.stdout:1/809: read d0/d3/d7/f4a [2808602,74302] 0 2024-02-10T00:00:37.960 INFO:tasks.workunit.client.1.smithi183.stdout:5/909: unlink d4/dd/d71/f84 0 2024-02-10T00:00:37.961 INFO:tasks.workunit.client.1.smithi183.stdout:4/923: mkdir de/d22/d121 0 2024-02-10T00:00:37.963 INFO:tasks.workunit.client.0.smithi164.stdout:5/602: creat d7/d17/d69/d92/fc2 x:0 0 0 2024-02-10T00:00:37.963 INFO:tasks.workunit.client.0.smithi164.stdout:0/520: dwrite d6/d10/d4a/d60/d6c/f7e [0,4194304] 0 2024-02-10T00:00:37.963 INFO:tasks.workunit.client.1.smithi183.stdout:0/900: truncate d14/d1d/d59/fd1 476667 0 2024-02-10T00:00:37.963 INFO:tasks.workunit.client.1.smithi183.stdout:4/924: stat de/d14/d4e/c7e 0 2024-02-10T00:00:37.964 INFO:tasks.workunit.client.0.smithi164.stdout:5/603: chown d7/d17/d21/d23/d5a/d68/d1f/f4a 5167325 1 2024-02-10T00:00:37.965 INFO:tasks.workunit.client.0.smithi164.stdout:9/537: mkdir d6/de/d2b/d5b/d61/d76/da5 0 2024-02-10T00:00:37.965 INFO:tasks.workunit.client.0.smithi164.stdout:8/509: mkdir d2/d64/d65/d80/d32/d99/d9e 0 2024-02-10T00:00:37.965 INFO:tasks.workunit.client.1.smithi183.stdout:0/901: chown d14/d1d/d59/d71/dfb 7689 1 2024-02-10T00:00:37.966 INFO:tasks.workunit.client.1.smithi183.stdout:9/872: dwrite d0/d3/d14/d1c/d2d/da3/fe0 [4194304,4194304] 0 2024-02-10T00:00:37.967 INFO:tasks.workunit.client.0.smithi164.stdout:0/521: dread d6/d10/d66/f6a [0,4194304] 0 2024-02-10T00:00:37.968 INFO:tasks.workunit.client.0.smithi164.stdout:0/522: write d6/d10/f69 [347002,10836] 0 2024-02-10T00:00:37.969 INFO:tasks.workunit.client.1.smithi183.stdout:7/814: mkdir d0/d2/d4/d101 0 2024-02-10T00:00:37.971 INFO:tasks.workunit.client.0.smithi164.stdout:6/614: rename d0/d2b/d3a/d3d/d42/d5d/d79/d92 to d0/d2b/d3a/dd0 0 2024-02-10T00:00:37.976 INFO:tasks.workunit.client.1.smithi183.stdout:0/902: creat d14/d3e/d5f/daa/ddd/f141 x:0 0 0 2024-02-10T00:00:37.977 INFO:tasks.workunit.client.0.smithi164.stdout:8/510: dwrite d2/d64/f61 [4194304,4194304] 0 2024-02-10T00:00:37.978 INFO:tasks.workunit.client.0.smithi164.stdout:8/511: chown d2/d12/c1e 44662 1 2024-02-10T00:00:37.980 INFO:tasks.workunit.client.0.smithi164.stdout:9/538: mknod d6/de/d2b/d5b/d61/d76/ca6 0 2024-02-10T00:00:37.980 INFO:tasks.workunit.client.0.smithi164.stdout:0/523: unlink d6/d10/d18/d2d/l34 0 2024-02-10T00:00:37.981 INFO:tasks.workunit.client.0.smithi164.stdout:6/615: creat d0/d3b/d56/db3/fd1 x:0 0 0 2024-02-10T00:00:37.982 INFO:tasks.workunit.client.1.smithi183.stdout:9/873: fsync d0/d3/d14/d74/da8/faf 0 2024-02-10T00:00:37.983 INFO:tasks.workunit.client.1.smithi183.stdout:0/903: mkdir d14/d1d/d59/d71/dcb/d11d/d142 0 2024-02-10T00:00:37.983 INFO:tasks.workunit.client.0.smithi164.stdout:5/604: mkdir d7/d17/dc3 0 2024-02-10T00:00:37.983 INFO:tasks.workunit.client.0.smithi164.stdout:2/584: sync 2024-02-10T00:00:37.985 INFO:tasks.workunit.client.1.smithi183.stdout:2/992: dwrite d2/d2c/d2f/d72/ff3 [0,4194304] 0 2024-02-10T00:00:37.985 INFO:tasks.workunit.client.0.smithi164.stdout:2/585: write d3/d26/d56/fa4 [1823792,105834] 0 2024-02-10T00:00:37.986 INFO:tasks.workunit.client.0.smithi164.stdout:8/512: creat d2/d64/d65/d80/d32/d4d/f9f x:0 0 0 2024-02-10T00:00:37.988 INFO:tasks.workunit.client.1.smithi183.stdout:4/925: creat de/d19/d20/f122 x:0 0 0 2024-02-10T00:00:37.991 INFO:tasks.workunit.client.1.smithi183.stdout:2/993: creat d2/da/d20/d21/df2/f14d x:0 0 0 2024-02-10T00:00:37.992 INFO:tasks.workunit.client.1.smithi183.stdout:2/994: write d2/d2c/dba/df0/d8f/d148/fb2 [323220,89615] 0 2024-02-10T00:00:37.994 INFO:tasks.workunit.client.1.smithi183.stdout:0/904: mkdir d14/d1d/d55/d6e/d143 0 2024-02-10T00:00:37.994 INFO:tasks.workunit.client.1.smithi183.stdout:0/905: dread - d14/d1d/d59/fdc zero size 2024-02-10T00:00:37.998 INFO:tasks.workunit.client.0.smithi164.stdout:2/586: mknod d3/d32/d4e/ccf 0 2024-02-10T00:00:37.998 INFO:tasks.workunit.client.0.smithi164.stdout:8/513: fsync d2/f6f 0 2024-02-10T00:00:37.999 INFO:tasks.workunit.client.0.smithi164.stdout:5/605: creat d7/d17/d21/d23/d5a/d68/d1f/dbe/fc4 x:0 0 0 2024-02-10T00:00:38.000 INFO:tasks.workunit.client.1.smithi183.stdout:2/995: symlink d2/da/d19/l14e 0 2024-02-10T00:00:38.001 INFO:tasks.workunit.client.0.smithi164.stdout:2/587: fdatasync d3/d32/d4e/d27/f28 0 2024-02-10T00:00:38.001 INFO:tasks.workunit.client.1.smithi183.stdout:0/906: truncate d14/d1d/d2d/d31/d68/da3/f107 849404 0 2024-02-10T00:00:38.001 INFO:tasks.workunit.client.0.smithi164.stdout:8/514: mkdir d2/d64/d65/d80/d32/d99/da0 0 2024-02-10T00:00:38.002 INFO:tasks.workunit.client.1.smithi183.stdout:0/907: chown d14/d1d/d55/d6e/d74/l9e 0 1 2024-02-10T00:00:38.003 INFO:tasks.workunit.client.1.smithi183.stdout:0/908: fsync d14/d1d/d59/d71/f56 0 2024-02-10T00:00:38.003 INFO:tasks.workunit.client.1.smithi183.stdout:2/996: creat d2/da/d20/f14f x:0 0 0 2024-02-10T00:00:38.004 INFO:tasks.workunit.client.1.smithi183.stdout:2/997: write d2/d8b/fb3 [5002086,62996] 0 2024-02-10T00:00:38.004 INFO:tasks.workunit.client.1.smithi183.stdout:0/909: chown d14/d1d/d59/d71/db4/lbe 4 1 2024-02-10T00:00:38.004 INFO:tasks.workunit.client.0.smithi164.stdout:2/588: rename d3/f6d to d3/da6/d7a/d8e/db6/db8/fd0 0 2024-02-10T00:00:38.006 INFO:tasks.workunit.client.0.smithi164.stdout:8/515: symlink d2/d64/d65/d80/d32/d99/d9e/la1 0 2024-02-10T00:00:38.007 INFO:tasks.workunit.client.0.smithi164.stdout:8/516: fdatasync d2/d64/d54/d71/f90 0 2024-02-10T00:00:38.007 INFO:tasks.workunit.client.1.smithi183.stdout:2/998: dread - d2/d2c/dba/df0/d8f/d148/ff7 zero size 2024-02-10T00:00:38.007 INFO:tasks.workunit.client.0.smithi164.stdout:2/589: symlink d3/da6/d7a/d8e/db6/ld1 0 2024-02-10T00:00:38.007 INFO:tasks.workunit.client.0.smithi164.stdout:8/517: chown d2/d64/f83 61726 1 2024-02-10T00:00:38.009 INFO:tasks.workunit.client.0.smithi164.stdout:2/590: symlink d3/d32/d4e/ld2 0 2024-02-10T00:00:38.010 INFO:tasks.workunit.client.1.smithi183.stdout:2/999: creat d2/d2c/dab/d99/ddf/d105/f150 x:0 0 0 2024-02-10T00:00:38.011 INFO:tasks.workunit.client.0.smithi164.stdout:8/518: creat d2/d64/d65/d80/d82/fa2 x:0 0 0 2024-02-10T00:00:38.011 INFO:tasks.workunit.client.0.smithi164.stdout:8/519: readlink d2/d64/d65/d80/l53 0 2024-02-10T00:00:38.012 INFO:tasks.workunit.client.0.smithi164.stdout:2/591: mknod d3/da6/d7a/d8e/d36/dbd/cd3 0 2024-02-10T00:00:38.012 INFO:tasks.workunit.client.0.smithi164.stdout:8/520: mknod d2/d64/d54/d5f/ca3 0 2024-02-10T00:00:38.014 INFO:tasks.workunit.client.0.smithi164.stdout:8/521: readlink d2/d64/d54/d5f/l75 0 2024-02-10T00:00:38.014 INFO:tasks.workunit.client.0.smithi164.stdout:8/522: write d2/d12/f17 [314665,34541] 0 2024-02-10T00:00:38.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/592: mknod d3/da6/d7a/d8e/db6/dce/dad/cd4 0 2024-02-10T00:00:38.017 INFO:tasks.workunit.client.0.smithi164.stdout:2/593: creat d3/da6/d7a/d8e/db6/db8/fd5 x:0 0 0 2024-02-10T00:00:38.018 INFO:tasks.workunit.client.0.smithi164.stdout:2/594: readlink d3/l21 0 2024-02-10T00:00:38.019 INFO:tasks.workunit.client.0.smithi164.stdout:2/595: mknod d3/d26/d56/cd6 0 2024-02-10T00:00:38.021 INFO:tasks.workunit.client.0.smithi164.stdout:2/596: symlink d3/da6/d7a/d8e/db6/dce/ld7 0 2024-02-10T00:00:38.023 INFO:tasks.workunit.client.0.smithi164.stdout:5/606: read d7/d17/d21/d23/d37/f4b [1151727,49959] 0 2024-02-10T00:00:38.024 INFO:tasks.workunit.client.0.smithi164.stdout:2/597: dwrite f2 [0,4194304] 0 2024-02-10T00:00:38.028 INFO:tasks.workunit.client.0.smithi164.stdout:2/598: stat d3/lc0 0 2024-02-10T00:00:38.028 INFO:tasks.workunit.client.0.smithi164.stdout:2/599: read d3/d32/d4e/f67 [606261,49923] 0 2024-02-10T00:00:38.028 INFO:tasks.workunit.client.0.smithi164.stdout:5/607: rmdir d7/d17/d21/d24/dbc/d43 39 2024-02-10T00:00:38.028 INFO:tasks.workunit.client.0.smithi164.stdout:2/600: dread - d3/da6/d7a/d8e/db6/db8/fd0 zero size 2024-02-10T00:00:38.028 INFO:tasks.workunit.client.0.smithi164.stdout:5/608: mkdir d7/d17/d79/d7b/dc5 0 2024-02-10T00:00:38.029 INFO:tasks.workunit.client.0.smithi164.stdout:5/609: dread - d7/d17/f83 zero size 2024-02-10T00:00:38.030 INFO:tasks.workunit.client.0.smithi164.stdout:2/601: creat d3/d32/fd8 x:0 0 0 2024-02-10T00:00:38.030 INFO:tasks.workunit.client.0.smithi164.stdout:5/610: fdatasync d7/d17/d21/d23/d5a/f74 0 2024-02-10T00:00:38.031 INFO:tasks.workunit.client.0.smithi164.stdout:2/602: write d3/d24/d5b/f6e [1431751,124060] 0 2024-02-10T00:00:38.033 INFO:tasks.workunit.client.0.smithi164.stdout:5/611: creat d7/d17/d21/d23/d37/d36/d8b/fc6 x:0 0 0 2024-02-10T00:00:38.034 INFO:tasks.workunit.client.0.smithi164.stdout:2/603: truncate d3/da6/d7a/d8e/db6/dce/fbb 21954 0 2024-02-10T00:00:38.035 INFO:tasks.workunit.client.0.smithi164.stdout:5/612: read d7/d17/d21/d23/d5a/d68/d1f/f44 [129352,64331] 0 2024-02-10T00:00:38.036 INFO:tasks.workunit.client.0.smithi164.stdout:5/613: chown d7/d17/d21/d24/dbc/d45/d5c/fb6 3185 1 2024-02-10T00:00:38.037 INFO:tasks.workunit.client.0.smithi164.stdout:5/614: dread - d7/d17/d21/d23/d37/d36/d8b/fc6 zero size 2024-02-10T00:00:38.038 INFO:tasks.workunit.client.0.smithi164.stdout:5/615: creat d7/d17/d21/d85/fc7 x:0 0 0 2024-02-10T00:00:38.043 INFO:tasks.workunit.client.0.smithi164.stdout:5/616: rename d7/d17/d21/d24/dbc/d43/fba to d7/d17/d21/d23/d5a/d68/d1f/dbe/fc8 0 2024-02-10T00:00:38.045 INFO:tasks.workunit.client.0.smithi164.stdout:5/617: dread d7/d17/d21/d23/d5a/d68/d1f/d59/f82 [0,4194304] 0 2024-02-10T00:00:38.049 INFO:tasks.workunit.client.0.smithi164.stdout:5/618: dwrite d7/d17/d69/f6a [0,4194304] 0 2024-02-10T00:00:38.051 INFO:tasks.workunit.client.0.smithi164.stdout:5/619: dread - d7/d17/d79/fb1 zero size 2024-02-10T00:00:38.051 INFO:tasks.workunit.client.0.smithi164.stdout:5/620: fdatasync d7/f1d 0 2024-02-10T00:00:38.055 INFO:tasks.workunit.client.0.smithi164.stdout:5/621: dwrite d7/d17/d21/d85/fc7 [0,4194304] 0 2024-02-10T00:00:38.056 INFO:tasks.workunit.client.0.smithi164.stdout:5/622: write d7/f1d [1032922,35413] 0 2024-02-10T00:00:38.060 INFO:tasks.workunit.client.0.smithi164.stdout:5/623: dwrite d7/d17/f83 [0,4194304] 0 2024-02-10T00:00:38.064 INFO:tasks.workunit.client.0.smithi164.stdout:5/624: symlink d7/d17/d21/d24/dbc/d43/lc9 0 2024-02-10T00:00:38.071 INFO:tasks.workunit.client.0.smithi164.stdout:6/616: dread d0/d6/f28 [4194304,4194304] 0 2024-02-10T00:00:38.077 INFO:tasks.workunit.client.0.smithi164.stdout:7/573: write d3/f38 [1578869,77927] 0 2024-02-10T00:00:38.077 INFO:tasks.workunit.client.1.smithi183.stdout:8/929: write d0/d3f/db2/fd6 [56994,27170] 0 2024-02-10T00:00:38.078 INFO:tasks.workunit.client.1.smithi183.stdout:6/796: write d2/d1a/d25/f8e [3218422,113817] 0 2024-02-10T00:00:38.080 INFO:tasks.workunit.client.1.smithi183.stdout:8/930: mknod d0/d3f/db2/dee/c121 0 2024-02-10T00:00:38.082 INFO:tasks.workunit.client.0.smithi164.stdout:1/485: truncate d1/d1a/f2c 4078154 0 2024-02-10T00:00:38.083 INFO:tasks.workunit.client.0.smithi164.stdout:9/539: rmdir d6 39 2024-02-10T00:00:38.083 INFO:tasks.workunit.client.0.smithi164.stdout:3/484: dread d0/d1/d2/d19/f33 [0,4194304] 0 2024-02-10T00:00:38.084 INFO:tasks.workunit.client.0.smithi164.stdout:4/564: truncate d2/d2f/d37/d41/f6e 1190543 0 2024-02-10T00:00:38.084 INFO:tasks.workunit.client.1.smithi183.stdout:6/797: creat d2/ffb x:0 0 0 2024-02-10T00:00:38.084 INFO:tasks.workunit.client.1.smithi183.stdout:3/754: truncate d7/db/d2a/d33/f72 2205325 0 2024-02-10T00:00:38.085 INFO:tasks.workunit.client.1.smithi183.stdout:1/810: truncate d0/d3/d67/d7b/dfe/d7c/fee 3851481 0 2024-02-10T00:00:38.085 INFO:tasks.workunit.client.1.smithi183.stdout:6/798: read - d2/d32/ff8 zero size 2024-02-10T00:00:38.086 INFO:tasks.workunit.client.1.smithi183.stdout:8/931: unlink d0/d27/d75/l5c 0 2024-02-10T00:00:38.087 INFO:tasks.workunit.client.1.smithi183.stdout:7/815: truncate d0/d11/f1c 4097697 0 2024-02-10T00:00:38.088 INFO:tasks.workunit.client.0.smithi164.stdout:0/524: write d6/d3a/d52/f8e [1006725,111006] 0 2024-02-10T00:00:38.090 INFO:tasks.workunit.client.1.smithi183.stdout:5/910: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/f48 [0,4194304] 0 2024-02-10T00:00:38.090 INFO:tasks.workunit.client.1.smithi183.stdout:6/799: readlink d2/d1a/d25/d3c/d31/d38/d6e/ded/l46 0 2024-02-10T00:00:38.093 INFO:tasks.workunit.client.1.smithi183.stdout:7/816: creat d0/d11/d2f/db8/f102 x:0 0 0 2024-02-10T00:00:38.095 INFO:tasks.workunit.client.1.smithi183.stdout:3/755: dwrite d7/db/d2a/d2d/d51/f97 [0,4194304] 0 2024-02-10T00:00:38.096 INFO:tasks.workunit.client.0.smithi164.stdout:8/523: truncate d2/d64/d65/d80/d32/d4d/f57 887590 0 2024-02-10T00:00:38.096 INFO:tasks.workunit.client.1.smithi183.stdout:8/932: mkdir d0/d3f/d94/d122 0 2024-02-10T00:00:38.097 INFO:tasks.workunit.client.1.smithi183.stdout:4/926: truncate de/d14/d27/f21 3237194 0 2024-02-10T00:00:38.097 INFO:tasks.workunit.client.1.smithi183.stdout:9/874: dwrite d0/d3/d14/d1c/d2d/d4f/d89/f9b [0,4194304] 0 2024-02-10T00:00:38.099 INFO:tasks.workunit.client.1.smithi183.stdout:0/910: write d14/d1d/d2d/d31/d6c/f76 [1532199,100619] 0 2024-02-10T00:00:38.100 INFO:tasks.workunit.client.0.smithi164.stdout:9/540: read d6/de/d2b/f38 [2115396,96100] 0 2024-02-10T00:00:38.100 INFO:tasks.workunit.client.1.smithi183.stdout:5/911: creat d4/d23/d3e/d80/f128 x:0 0 0 2024-02-10T00:00:38.100 INFO:tasks.workunit.client.1.smithi183.stdout:7/817: mkdir d0/d11/d9d/d103 0 2024-02-10T00:00:38.105 INFO:tasks.workunit.client.1.smithi183.stdout:1/811: dread d0/d3/d7/f19 [0,4194304] 0 2024-02-10T00:00:38.106 INFO:tasks.workunit.client.1.smithi183.stdout:1/812: read - d0/d3/d67/d7b/dfe/f110 zero size 2024-02-10T00:00:38.107 INFO:tasks.workunit.client.0.smithi164.stdout:4/565: mkdir d2/d19/d16/d31/d72/dc7 0 2024-02-10T00:00:38.114 INFO:tasks.workunit.client.0.smithi164.stdout:9/541: mkdir d6/de/d2b/d5b/da7 0 2024-02-10T00:00:38.115 INFO:tasks.workunit.client.0.smithi164.stdout:6/617: dwrite d0/fc [0,4194304] 0 2024-02-10T00:00:38.116 INFO:tasks.workunit.client.0.smithi164.stdout:9/542: write d6/d41/d8b/d24/f2a [4990337,11588] 0 2024-02-10T00:00:38.117 INFO:tasks.workunit.client.0.smithi164.stdout:6/618: readlink d0/d2b/d3a/d3d/d42/lcb 0 2024-02-10T00:00:38.117 INFO:tasks.workunit.client.1.smithi183.stdout:7/818: read d0/d11/d2f/d64/d6b/f86 [564823,110289] 0 2024-02-10T00:00:38.119 INFO:tasks.workunit.client.1.smithi183.stdout:6/800: link d2/d1a/d25/d3c/d8d/fe9 d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/ffc 0 2024-02-10T00:00:38.121 INFO:tasks.workunit.client.0.smithi164.stdout:7/574: write d3/f13 [1422489,78339] 0 2024-02-10T00:00:38.121 INFO:tasks.workunit.client.0.smithi164.stdout:0/525: creat d6/d10/d18/d2d/d35/d44/d90/fa9 x:0 0 0 2024-02-10T00:00:38.122 INFO:tasks.workunit.client.0.smithi164.stdout:8/524: mknod d2/d64/d65/d80/d32/d99/da0/ca4 0 2024-02-10T00:00:38.122 INFO:tasks.workunit.client.0.smithi164.stdout:8/525: fdatasync d2/d64/d65/d80/f86 0 2024-02-10T00:00:38.124 INFO:tasks.workunit.client.0.smithi164.stdout:1/486: rename d1/f4e to d1/d1a/fa3 0 2024-02-10T00:00:38.125 INFO:tasks.workunit.client.0.smithi164.stdout:1/487: chown d1/d1a/d41/d18/l27 16803 1 2024-02-10T00:00:38.125 INFO:tasks.workunit.client.1.smithi183.stdout:0/911: unlink d14/d1d/d59/d3c/c119 0 2024-02-10T00:00:38.125 INFO:tasks.workunit.client.1.smithi183.stdout:0/912: chown d14/d1d/d59/d3c/l9f 817 1 2024-02-10T00:00:38.130 INFO:tasks.workunit.client.1.smithi183.stdout:1/813: fsync d0/d3/d7/d3d/d60/d89/fbd 0 2024-02-10T00:00:38.131 INFO:tasks.workunit.client.1.smithi183.stdout:1/814: chown d0/d3/d67/d7b/dfe/d7c/db1/fce 14735 1 2024-02-10T00:00:38.131 INFO:tasks.workunit.client.1.smithi183.stdout:4/927: truncate de/d19/f69 15031 0 2024-02-10T00:00:38.132 INFO:tasks.workunit.client.0.smithi164.stdout:7/575: read d3/d11/d39/d44/fb3 [33336,77022] 0 2024-02-10T00:00:38.133 INFO:tasks.workunit.client.0.smithi164.stdout:4/566: rename d2/d2f/f77 to d2/d2f/d37/d71/dc6/fc8 0 2024-02-10T00:00:38.134 INFO:tasks.workunit.client.1.smithi183.stdout:4/928: symlink de/d14/d27/d40/l123 0 2024-02-10T00:00:38.134 INFO:tasks.workunit.client.0.smithi164.stdout:1/488: mkdir d1/d13/d2b/d52/da4 0 2024-02-10T00:00:38.134 INFO:tasks.workunit.client.0.smithi164.stdout:4/567: chown d2/d2f/d37/d41/d3d/d42/f7c 126660 1 2024-02-10T00:00:38.135 INFO:tasks.workunit.client.0.smithi164.stdout:3/485: getdents d0/d1/d2/d19/d27/d5f 0 2024-02-10T00:00:38.136 INFO:tasks.workunit.client.1.smithi183.stdout:7/819: creat d0/d11/d2f/f104 x:0 0 0 2024-02-10T00:00:38.137 INFO:tasks.workunit.client.1.smithi183.stdout:6/801: truncate d2/d1a/d25/d3c/d31/d66/fdf 891439 0 2024-02-10T00:00:38.138 INFO:tasks.workunit.client.0.smithi164.stdout:1/489: creat d1/d13/d2b/d52/fa5 x:0 0 0 2024-02-10T00:00:38.139 INFO:tasks.workunit.client.0.smithi164.stdout:4/568: dwrite d2/d19/f48 [0,4194304] 0 2024-02-10T00:00:38.140 INFO:tasks.workunit.client.1.smithi183.stdout:7/820: dwrite d0/d11/d2f/fae [4194304,4194304] 0 2024-02-10T00:00:38.141 INFO:tasks.workunit.client.1.smithi183.stdout:1/815: rename d0/d3/d7/d3d/d60/d89/de4/f10a to d0/d3a/dd8/f119 0 2024-02-10T00:00:38.141 INFO:tasks.workunit.client.0.smithi164.stdout:8/526: getdents d2/d12 0 2024-02-10T00:00:38.142 INFO:tasks.workunit.client.0.smithi164.stdout:8/527: chown d2/d64/d63 50 1 2024-02-10T00:00:38.142 INFO:tasks.workunit.client.0.smithi164.stdout:4/569: rmdir d2/d5a/d94 39 2024-02-10T00:00:38.142 INFO:tasks.workunit.client.1.smithi183.stdout:1/816: write d0/d3/d7/f8d [790907,100168] 0 2024-02-10T00:00:38.143 INFO:tasks.workunit.client.0.smithi164.stdout:8/528: chown d2/d64/d65/c7f 68 1 2024-02-10T00:00:38.143 INFO:tasks.workunit.client.0.smithi164.stdout:1/490: mkdir d1/d13/d2b/d52/da6 0 2024-02-10T00:00:38.146 INFO:tasks.workunit.client.0.smithi164.stdout:8/529: fsync d2/d64/d65/d80/d32/f56 0 2024-02-10T00:00:38.147 INFO:tasks.workunit.client.0.smithi164.stdout:4/570: dwrite d2/d19/d16/d31/f74 [0,4194304] 0 2024-02-10T00:00:38.148 INFO:tasks.workunit.client.0.smithi164.stdout:3/486: getdents d0/d1/d2/d17/d37/d3f/d4e/d6d 0 2024-02-10T00:00:38.149 INFO:tasks.workunit.client.0.smithi164.stdout:1/491: rename d1/d13/f14 to d1/d13/d2b/d52/da6/fa7 0 2024-02-10T00:00:38.156 INFO:tasks.workunit.client.1.smithi183.stdout:9/875: write d0/d3/d14/d1c/d4b/d97/daa/fd8 [1362243,51885] 0 2024-02-10T00:00:38.156 INFO:tasks.workunit.client.1.smithi183.stdout:8/933: write d0/d23/f95 [1736755,62849] 0 2024-02-10T00:00:38.156 INFO:tasks.workunit.client.1.smithi183.stdout:5/912: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/f87 [788092,81378] 0 2024-02-10T00:00:38.156 INFO:tasks.workunit.client.0.smithi164.stdout:3/487: creat d0/d1/d2/d19/d27/d5f/f93 x:0 0 0 2024-02-10T00:00:38.157 INFO:tasks.workunit.client.0.smithi164.stdout:4/571: rename d2/d2f/f51 to d2/d19/fc9 0 2024-02-10T00:00:38.157 INFO:tasks.workunit.client.0.smithi164.stdout:4/572: stat d2/d2f/d37/d41/d3d/d42/f63 0 2024-02-10T00:00:38.158 INFO:tasks.workunit.client.0.smithi164.stdout:5/625: sync 2024-02-10T00:00:38.159 INFO:tasks.workunit.client.0.smithi164.stdout:3/488: readlink d0/d1/d2/d19/l44 0 2024-02-10T00:00:38.160 INFO:tasks.workunit.client.0.smithi164.stdout:5/626: write d7/d17/d21/d85/fc7 [3754678,9387] 0 2024-02-10T00:00:38.161 INFO:tasks.workunit.client.0.smithi164.stdout:1/492: symlink d1/d1a/d41/d18/d33/la8 0 2024-02-10T00:00:38.161 INFO:tasks.workunit.client.1.smithi183.stdout:4/929: write de/d14/d27/fe8 [552006,24439] 0 2024-02-10T00:00:38.162 INFO:tasks.workunit.client.1.smithi183.stdout:7/821: rmdir d0/d11 39 2024-02-10T00:00:38.163 INFO:tasks.workunit.client.1.smithi183.stdout:0/913: dwrite d14/d1d/d59/d3c/f111 [0,4194304] 0 2024-02-10T00:00:38.164 INFO:tasks.workunit.client.1.smithi183.stdout:3/756: truncate d7/fe 2395201 0 2024-02-10T00:00:38.167 INFO:tasks.workunit.client.1.smithi183.stdout:5/913: rmdir d4/d23/d3e/d80/da1/d9c 39 2024-02-10T00:00:38.167 INFO:tasks.workunit.client.1.smithi183.stdout:8/934: write d0/d23/f26 [2909700,121396] 0 2024-02-10T00:00:38.167 INFO:tasks.workunit.client.1.smithi183.stdout:6/802: dwrite d2/d1a/d25/ff3 [0,4194304] 0 2024-02-10T00:00:38.168 INFO:tasks.workunit.client.0.smithi164.stdout:0/526: dwrite d6/d10/d18/d2d/d35/f41 [0,4194304] 0 2024-02-10T00:00:38.169 INFO:tasks.workunit.client.1.smithi183.stdout:6/803: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/d61 151546 1 2024-02-10T00:00:38.171 INFO:tasks.workunit.client.0.smithi164.stdout:7/576: truncate d3/d11/d39/d44/d48/d50/d92/f99 3812582 0 2024-02-10T00:00:38.171 INFO:tasks.workunit.client.1.smithi183.stdout:1/817: getdents d0/d3/d29 0 2024-02-10T00:00:38.172 INFO:tasks.workunit.client.0.smithi164.stdout:0/527: dwrite d6/d10/d18/d2d/f5a [0,4194304] 0 2024-02-10T00:00:38.173 INFO:tasks.workunit.client.1.smithi183.stdout:5/914: chown d4/d23/d3e/d80/da1/d9c/d72/lf1 1 1 2024-02-10T00:00:38.173 INFO:tasks.workunit.client.0.smithi164.stdout:0/528: write d6/d7/f6f [59845,38767] 0 2024-02-10T00:00:38.175 INFO:tasks.workunit.client.0.smithi164.stdout:3/489: mkdir d0/d1/d3c/d3d/d94 0 2024-02-10T00:00:38.177 INFO:tasks.workunit.client.1.smithi183.stdout:4/930: truncate de/d14/da4/fbf 4473 0 2024-02-10T00:00:38.178 INFO:tasks.workunit.client.0.smithi164.stdout:5/627: creat d7/d17/d21/d23/d37/d36/fca x:0 0 0 2024-02-10T00:00:38.180 INFO:tasks.workunit.client.1.smithi183.stdout:6/804: chown d2/fc0 2015 1 2024-02-10T00:00:38.180 INFO:tasks.workunit.client.0.smithi164.stdout:9/543: dread d6/d41/d8b/d24/f73 [0,4194304] 0 2024-02-10T00:00:38.181 INFO:tasks.workunit.client.1.smithi183.stdout:3/757: mknod d7/db/d2a/d33/cdb 0 2024-02-10T00:00:38.181 INFO:tasks.workunit.client.0.smithi164.stdout:1/493: unlink d1/d1a/d41/d18/d33/f5b 0 2024-02-10T00:00:38.182 INFO:tasks.workunit.client.0.smithi164.stdout:1/494: chown d1/d1a/d35/l5c 6 1 2024-02-10T00:00:38.182 INFO:tasks.workunit.client.0.smithi164.stdout:1/495: readlink d1/d64/la2 0 2024-02-10T00:00:38.183 INFO:tasks.workunit.client.0.smithi164.stdout:0/529: fsync d6/d10/d66/f6a 0 2024-02-10T00:00:38.184 INFO:tasks.workunit.client.0.smithi164.stdout:0/530: fdatasync d6/d10/d4a/d60/f6e 0 2024-02-10T00:00:38.184 INFO:tasks.workunit.client.1.smithi183.stdout:5/915: symlink d4/d23/d3e/d80/da1/d9e/d89/dd4/deb/l129 0 2024-02-10T00:00:38.185 INFO:tasks.workunit.client.0.smithi164.stdout:3/490: mkdir d0/d1/d2/d19/d66/d81/d95 0 2024-02-10T00:00:38.187 INFO:tasks.workunit.client.1.smithi183.stdout:4/931: unlink de/d14/d27/d2e/d10d/l110 0 2024-02-10T00:00:38.187 INFO:tasks.workunit.client.0.smithi164.stdout:5/628: rename d7/d17/d21/d23/d37/f4b to d7/d17/d21/d24/dbc/d45/db3/fcb 0 2024-02-10T00:00:38.189 INFO:tasks.workunit.client.1.smithi183.stdout:6/805: rename d2/d1a/d25/d3c/d31/f70 to d2/da0/ffd 0 2024-02-10T00:00:38.190 INFO:tasks.workunit.client.1.smithi183.stdout:3/758: creat d7/db/d2a/d8e/fdc x:0 0 0 2024-02-10T00:00:38.191 INFO:tasks.workunit.client.0.smithi164.stdout:3/491: write d0/d1/d2/d19/d27/d5f/f85 [4169060,41960] 0 2024-02-10T00:00:38.192 INFO:tasks.workunit.client.1.smithi183.stdout:5/916: creat d4/d23/d3e/d80/da1/d9c/d72/da0/f12a x:0 0 0 2024-02-10T00:00:38.192 INFO:tasks.workunit.client.0.smithi164.stdout:2/604: dread d3/d32/d4e/d27/f74 [0,4194304] 0 2024-02-10T00:00:38.193 INFO:tasks.workunit.client.0.smithi164.stdout:9/544: rename d6/l9d to d6/de/d22/d69/la8 0 2024-02-10T00:00:38.193 INFO:tasks.workunit.client.0.smithi164.stdout:3/492: write d0/d1/d2/d17/d37/d3f/d4e/d6d/f92 [266923,1380] 0 2024-02-10T00:00:38.194 INFO:tasks.workunit.client.0.smithi164.stdout:2/605: chown d3/da6/d7a/d8e/lca 3 1 2024-02-10T00:00:38.194 INFO:tasks.workunit.client.0.smithi164.stdout:3/493: fsync d0/d1/f89 0 2024-02-10T00:00:38.194 INFO:tasks.workunit.client.0.smithi164.stdout:5/629: symlink d7/d17/d21/d24/dbc/d45/db3/lcc 0 2024-02-10T00:00:38.195 INFO:tasks.workunit.client.1.smithi183.stdout:1/818: link d0/d3/d67/fdf d0/d3/d67/d7b/dfe/d7c/f11a 0 2024-02-10T00:00:38.195 INFO:tasks.workunit.client.0.smithi164.stdout:9/545: chown d6/de/d22/f51 1480263 1 2024-02-10T00:00:38.195 INFO:tasks.workunit.client.1.smithi183.stdout:3/759: dwrite d7/db/d2a/d2d/d6a/fce [0,4194304] 0 2024-02-10T00:00:38.197 INFO:tasks.workunit.client.0.smithi164.stdout:2/606: mkdir d3/d24/d5b/dd9 0 2024-02-10T00:00:38.197 INFO:tasks.workunit.client.0.smithi164.stdout:1/496: truncate d1/d13/d2b/d54/f6a 698170 0 2024-02-10T00:00:38.199 INFO:tasks.workunit.client.0.smithi164.stdout:9/546: fsync d6/de/d2b/d5b/d61/d76/d82/fa4 0 2024-02-10T00:00:38.199 INFO:tasks.workunit.client.0.smithi164.stdout:6/619: sync 2024-02-10T00:00:38.200 INFO:tasks.workunit.client.0.smithi164.stdout:5/630: truncate d7/d17/d79/fb1 345312 0 2024-02-10T00:00:38.203 INFO:tasks.workunit.client.0.smithi164.stdout:0/531: getdents d6/d3a/d52 0 2024-02-10T00:00:38.206 INFO:tasks.workunit.client.0.smithi164.stdout:0/532: write d6/d10/d18/d2d/d35/d44/f98 [1637507,122370] 0 2024-02-10T00:00:38.206 INFO:tasks.workunit.client.0.smithi164.stdout:6/620: rename d0/d2b/fa4 to d0/d2b/d3a/d3d/d6d/fd2 0 2024-02-10T00:00:38.206 INFO:tasks.workunit.client.1.smithi183.stdout:4/932: dread de/d14/d1d/d7b/ff9 [0,4194304] 0 2024-02-10T00:00:38.206 INFO:tasks.workunit.client.0.smithi164.stdout:5/631: dwrite d7/d17/d21/d24/dbc/d43/f4e [0,4194304] 0 2024-02-10T00:00:38.210 INFO:tasks.workunit.client.0.smithi164.stdout:3/494: creat d0/d1/d2/d17/d37/d3f/d4e/f96 x:0 0 0 2024-02-10T00:00:38.211 INFO:tasks.workunit.client.0.smithi164.stdout:3/495: readlink d0/d1/d2/d17/d37/d3f/d4e/d6d/l7a 0 2024-02-10T00:00:38.211 INFO:tasks.workunit.client.0.smithi164.stdout:6/621: creat d0/d3b/d56/fd3 x:0 0 0 2024-02-10T00:00:38.212 INFO:tasks.workunit.client.1.smithi183.stdout:4/933: dwrite de/d14/d4e/ff2 [0,4194304] 0 2024-02-10T00:00:38.212 INFO:tasks.workunit.client.1.smithi183.stdout:6/806: dread d2/da0/ffd [0,4194304] 0 2024-02-10T00:00:38.213 INFO:tasks.workunit.client.0.smithi164.stdout:0/533: dread d6/d10/d18/d1c/f2c [0,4194304] 0 2024-02-10T00:00:38.213 INFO:tasks.workunit.client.0.smithi164.stdout:0/534: chown f3 866885194 1 2024-02-10T00:00:38.213 INFO:tasks.workunit.client.0.smithi164.stdout:5/632: mkdir d7/d17/d69/d92/da8/dcd 0 2024-02-10T00:00:38.216 INFO:tasks.workunit.client.1.smithi183.stdout:4/934: mknod de/d22/d121/c124 0 2024-02-10T00:00:38.217 INFO:tasks.workunit.client.0.smithi164.stdout:7/577: sync 2024-02-10T00:00:38.218 INFO:tasks.workunit.client.0.smithi164.stdout:6/622: dwrite d0/d6/f28 [0,4194304] 0 2024-02-10T00:00:38.220 INFO:tasks.workunit.client.0.smithi164.stdout:7/578: creat d3/d26/d67/d98/fb8 x:0 0 0 2024-02-10T00:00:38.221 INFO:tasks.workunit.client.1.smithi183.stdout:8/935: dread d0/d45/f49 [0,4194304] 0 2024-02-10T00:00:38.222 INFO:tasks.workunit.client.0.smithi164.stdout:8/530: write d2/d64/d65/d80/d32/f38 [4282675,120096] 0 2024-02-10T00:00:38.223 INFO:tasks.workunit.client.1.smithi183.stdout:9/876: write d0/f5 [2713433,60650] 0 2024-02-10T00:00:38.223 INFO:tasks.workunit.client.1.smithi183.stdout:8/936: chown d0/d27/d36/l9d 588585731 1 2024-02-10T00:00:38.223 INFO:tasks.workunit.client.0.smithi164.stdout:6/623: mkdir d0/d3b/dd4 0 2024-02-10T00:00:38.223 INFO:tasks.workunit.client.0.smithi164.stdout:6/624: dread - d0/d3b/faf zero size 2024-02-10T00:00:38.224 INFO:tasks.workunit.client.1.smithi183.stdout:8/937: chown d0/d3f/db2/d24/fd3 1394650 1 2024-02-10T00:00:38.224 INFO:tasks.workunit.client.1.smithi183.stdout:9/877: write d0/d30/d52/ddc/de1/f115 [822680,123513] 0 2024-02-10T00:00:38.224 INFO:tasks.workunit.client.0.smithi164.stdout:6/625: dread - d0/d6/d12/d14/f8c zero size 2024-02-10T00:00:38.227 INFO:tasks.workunit.client.0.smithi164.stdout:8/531: creat d2/d64/d63/fa5 x:0 0 0 2024-02-10T00:00:38.227 INFO:tasks.workunit.client.1.smithi183.stdout:8/938: creat d0/d3f/db2/de9/f123 x:0 0 0 2024-02-10T00:00:38.228 INFO:tasks.workunit.client.1.smithi183.stdout:8/939: write d0/d31/db8/ff9 [785920,100651] 0 2024-02-10T00:00:38.229 INFO:tasks.workunit.client.1.smithi183.stdout:9/878: symlink d0/d3/d14/d74/d90/l118 0 2024-02-10T00:00:38.229 INFO:tasks.workunit.client.0.smithi164.stdout:6/626: dwrite d0/d2b/d3a/dd0/f7a [0,4194304] 0 2024-02-10T00:00:38.231 INFO:tasks.workunit.client.1.smithi183.stdout:8/940: creat d0/d3f/d94/d122/f124 x:0 0 0 2024-02-10T00:00:38.231 INFO:tasks.workunit.client.1.smithi183.stdout:8/941: chown d0/d3f/db2/dee 7610 1 2024-02-10T00:00:38.231 INFO:tasks.workunit.client.1.smithi183.stdout:9/879: mknod d0/d3/d14/d3c/c119 0 2024-02-10T00:00:38.232 INFO:tasks.workunit.client.1.smithi183.stdout:8/942: write d0/d27/f68 [6827252,112500] 0 2024-02-10T00:00:38.232 INFO:tasks.workunit.client.1.smithi183.stdout:0/914: truncate d14/f28 2068246 0 2024-02-10T00:00:38.233 INFO:tasks.workunit.client.1.smithi183.stdout:8/943: write d0/d4e/fa1 [1405125,29325] 0 2024-02-10T00:00:38.234 INFO:tasks.workunit.client.0.smithi164.stdout:4/573: truncate d2/d2f/d37/d41/f4e 3464842 0 2024-02-10T00:00:38.236 INFO:tasks.workunit.client.1.smithi183.stdout:9/880: dwrite d0/d30/d52/ddc/fc6 [0,4194304] 0 2024-02-10T00:00:38.238 INFO:tasks.workunit.client.1.smithi183.stdout:7/822: write d0/d11/d3e/f49 [2820862,16603] 0 2024-02-10T00:00:38.242 INFO:tasks.workunit.client.1.smithi183.stdout:5/917: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fb5 [1091776,115451] 0 2024-02-10T00:00:38.244 INFO:tasks.workunit.client.0.smithi164.stdout:2/607: write d3/da6/d7a/d8e/d36/f83 [7848,110203] 0 2024-02-10T00:00:38.244 INFO:tasks.workunit.client.1.smithi183.stdout:5/918: write d4/dd/d31/d73/f98 [880309,26679] 0 2024-02-10T00:00:38.247 INFO:tasks.workunit.client.1.smithi183.stdout:1/819: dwrite d0/d3/d67/f94 [0,4194304] 0 2024-02-10T00:00:38.247 INFO:tasks.workunit.client.1.smithi183.stdout:5/919: read - d4/d23/d3e/d80/d96/f126 zero size 2024-02-10T00:00:38.247 INFO:tasks.workunit.client.1.smithi183.stdout:3/760: dwrite d7/db/d2a/d2d/d51/d8f/fa2 [0,4194304] 0 2024-02-10T00:00:38.248 INFO:tasks.workunit.client.0.smithi164.stdout:0/535: write d6/d7/d14/f1b [1035770,107437] 0 2024-02-10T00:00:38.249 INFO:tasks.workunit.client.0.smithi164.stdout:9/547: dwrite d6/de/d2b/d5b/d61/f77 [0,4194304] 0 2024-02-10T00:00:38.250 INFO:tasks.workunit.client.0.smithi164.stdout:1/497: dwrite d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:38.253 INFO:tasks.workunit.client.0.smithi164.stdout:3/496: dread d0/f10 [0,4194304] 0 2024-02-10T00:00:38.253 INFO:tasks.workunit.client.0.smithi164.stdout:6/627: creat d0/d6/d95/dcd/dc3/fd5 x:0 0 0 2024-02-10T00:00:38.254 INFO:tasks.workunit.client.1.smithi183.stdout:7/823: mkdir d0/d11/d9d/d103/d105 0 2024-02-10T00:00:38.255 INFO:tasks.workunit.client.0.smithi164.stdout:1/498: readlink d1/d13/l9b 0 2024-02-10T00:00:38.255 INFO:tasks.workunit.client.0.smithi164.stdout:2/608: dread d3/f23 [0,4194304] 0 2024-02-10T00:00:38.256 INFO:tasks.workunit.client.0.smithi164.stdout:8/532: fsync d2/d64/d63/fa5 0 2024-02-10T00:00:38.257 INFO:tasks.workunit.client.0.smithi164.stdout:4/574: dwrite d2/d2f/d37/d41/f95 [0,4194304] 0 2024-02-10T00:00:38.257 INFO:tasks.workunit.client.0.smithi164.stdout:0/536: mkdir d6/d7/d14/da6/daa 0 2024-02-10T00:00:38.258 INFO:tasks.workunit.client.1.smithi183.stdout:7/824: chown d0/d11/d3e/f6d 4638112 1 2024-02-10T00:00:38.258 INFO:tasks.workunit.client.0.smithi164.stdout:3/497: stat d0/d1/dd/l61 0 2024-02-10T00:00:38.259 INFO:tasks.workunit.client.0.smithi164.stdout:6/628: readlink d0/d6/d95/dcd/l9d 0 2024-02-10T00:00:38.259 INFO:tasks.workunit.client.0.smithi164.stdout:9/548: mknod d6/de/d2b/d5b/d61/d76/da5/ca9 0 2024-02-10T00:00:38.260 INFO:tasks.workunit.client.0.smithi164.stdout:8/533: fdatasync d2/d64/d65/d80/d82/f84 0 2024-02-10T00:00:38.261 INFO:tasks.workunit.client.0.smithi164.stdout:2/609: symlink d3/da6/d7a/d8e/db6/db8/lda 0 2024-02-10T00:00:38.261 INFO:tasks.workunit.client.1.smithi183.stdout:3/761: truncate d7/db/d2a/d33/d59/d52/f64 1479570 0 2024-02-10T00:00:38.262 INFO:tasks.workunit.client.1.smithi183.stdout:7/825: symlink d0/d11/l106 0 2024-02-10T00:00:38.262 INFO:tasks.workunit.client.1.smithi183.stdout:7/826: dread - d0/fa0 zero size 2024-02-10T00:00:38.265 INFO:tasks.workunit.client.0.smithi164.stdout:7/579: dwrite d3/d11/f14 [0,4194304] 0 2024-02-10T00:00:38.266 INFO:tasks.workunit.client.0.smithi164.stdout:9/549: symlink d6/de/d22/d58/laa 0 2024-02-10T00:00:38.266 INFO:tasks.workunit.client.0.smithi164.stdout:3/498: symlink d0/d1/d2/d19/d27/d30/l97 0 2024-02-10T00:00:38.267 INFO:tasks.workunit.client.1.smithi183.stdout:7/827: dwrite d0/d11/d2f/db8/f102 [0,4194304] 0 2024-02-10T00:00:38.267 INFO:tasks.workunit.client.0.smithi164.stdout:4/575: fsync d2/d19/d16/d31/d4b/f50 0 2024-02-10T00:00:38.268 INFO:tasks.workunit.client.0.smithi164.stdout:3/499: chown d0/d1/d2/d19/d27/f2c 246 1 2024-02-10T00:00:38.273 INFO:tasks.workunit.client.1.smithi183.stdout:1/820: dread d0/d3a/dd8/f119 [0,4194304] 0 2024-02-10T00:00:38.274 INFO:tasks.workunit.client.1.smithi183.stdout:5/920: dread d4/dd/d31/f4d [0,4194304] 0 2024-02-10T00:00:38.274 INFO:tasks.workunit.client.0.smithi164.stdout:1/499: truncate d1/d23/d61/d9d/fa0 408996 0 2024-02-10T00:00:38.274 INFO:tasks.workunit.client.1.smithi183.stdout:1/821: stat d0/d3/d7/def 0 2024-02-10T00:00:38.275 INFO:tasks.workunit.client.1.smithi183.stdout:1/822: write d0/d3/d7/d3d/d60/d89/fff [2289340,105593] 0 2024-02-10T00:00:38.276 INFO:tasks.workunit.client.0.smithi164.stdout:1/500: write d1/d1a/f85 [1300571,33581] 0 2024-02-10T00:00:38.276 INFO:tasks.workunit.client.0.smithi164.stdout:5/633: dread d7/f19 [0,4194304] 0 2024-02-10T00:00:38.276 INFO:tasks.workunit.client.0.smithi164.stdout:1/501: chown d1/f94 26174046 1 2024-02-10T00:00:38.278 INFO:tasks.workunit.client.0.smithi164.stdout:7/580: mkdir d3/d11/d39/d44/d6f/d75/db9 0 2024-02-10T00:00:38.280 INFO:tasks.workunit.client.0.smithi164.stdout:1/502: fdatasync d1/d1a/d41/d18/f30 0 2024-02-10T00:00:38.281 INFO:tasks.workunit.client.1.smithi183.stdout:6/807: dread d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f83 [0,4194304] 0 2024-02-10T00:00:38.283 INFO:tasks.workunit.client.1.smithi183.stdout:9/881: dread d0/d3/d14/d1c/d2d/d4f/fd2 [0,4194304] 0 2024-02-10T00:00:38.284 INFO:tasks.workunit.client.1.smithi183.stdout:9/882: write d0/d3/d14/ff7 [846607,105875] 0 2024-02-10T00:00:38.284 INFO:tasks.workunit.client.1.smithi183.stdout:9/883: chown d0/d92 3863430 1 2024-02-10T00:00:38.284 INFO:tasks.workunit.client.0.smithi164.stdout:7/581: creat d3/d11/d39/d3a/fba x:0 0 0 2024-02-10T00:00:38.285 INFO:tasks.workunit.client.1.smithi183.stdout:7/828: mkdir d0/d2/d100/d107 0 2024-02-10T00:00:38.285 INFO:tasks.workunit.client.1.smithi183.stdout:7/829: stat d0/d2/d50/d5d/l96 0 2024-02-10T00:00:38.287 INFO:tasks.workunit.client.1.smithi183.stdout:6/808: rename d2/d1a/d25/d3c/d31/d38/d6e/d93 to d2/d1a/d25/d3c/d8d/dfe 0 2024-02-10T00:00:38.288 INFO:tasks.workunit.client.0.smithi164.stdout:2/610: rename d3/f16 to d3/d24/fdb 0 2024-02-10T00:00:38.289 INFO:tasks.workunit.client.1.smithi183.stdout:5/921: read d4/d23/f21 [1944698,52415] 0 2024-02-10T00:00:38.289 INFO:tasks.workunit.client.0.smithi164.stdout:5/634: mkdir d7/daf/dce 0 2024-02-10T00:00:38.292 INFO:tasks.workunit.client.1.smithi183.stdout:6/809: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [0,4194304] 0 2024-02-10T00:00:38.292 INFO:tasks.workunit.client.1.smithi183.stdout:5/922: rmdir d4/d23/d3e/d80/da1/d9e/d27/d9d 39 2024-02-10T00:00:38.293 INFO:tasks.workunit.client.0.smithi164.stdout:2/611: mkdir d3/da6/d7a/d8e/d88/ddc 0 2024-02-10T00:00:38.294 INFO:tasks.workunit.client.0.smithi164.stdout:1/503: dwrite d1/d13/d2b/d52/da6/fa7 [4194304,4194304] 0 2024-02-10T00:00:38.294 INFO:tasks.workunit.client.1.smithi183.stdout:7/830: truncate d0/d11/d2f/da3/ff4 685228 0 2024-02-10T00:00:38.294 INFO:tasks.workunit.client.1.smithi183.stdout:9/884: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:38.295 INFO:tasks.workunit.client.1.smithi183.stdout:6/810: fsync d2/d1a/d25/d3c/d8d/fe9 0 2024-02-10T00:00:38.296 INFO:tasks.workunit.client.1.smithi183.stdout:6/811: dread - d2/d1a/d25/d3c/d31/fe1 zero size 2024-02-10T00:00:38.298 INFO:tasks.workunit.client.1.smithi183.stdout:7/831: fdatasync d0/d2/d50/dad/f9b 0 2024-02-10T00:00:38.299 INFO:tasks.workunit.client.1.smithi183.stdout:6/812: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fff x:0 0 0 2024-02-10T00:00:38.300 INFO:tasks.workunit.client.1.smithi183.stdout:7/832: dread d0/d2/d50/dad/f9b [0,4194304] 0 2024-02-10T00:00:38.301 INFO:tasks.workunit.client.1.smithi183.stdout:7/833: chown d0/d2/f65 208381 1 2024-02-10T00:00:38.303 INFO:tasks.workunit.client.1.smithi183.stdout:4/935: sync 2024-02-10T00:00:38.304 INFO:tasks.workunit.client.1.smithi183.stdout:5/923: rename d4/d23/d3e/d80/da1/d9e/d27/d37/d46/fb2 to d4/d23/d3e/d80/da1/d9e/d27/d37/d46/d4e/f12b 0 2024-02-10T00:00:38.306 INFO:tasks.workunit.client.1.smithi183.stdout:4/936: symlink de/d14/d27/d2e/d10d/l125 0 2024-02-10T00:00:38.306 INFO:tasks.workunit.client.1.smithi183.stdout:6/813: mkdir d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/d100 0 2024-02-10T00:00:38.309 INFO:tasks.workunit.client.1.smithi183.stdout:9/885: rename d0/d3/d14/d74/da8/fc3 to d0/d10/f11a 0 2024-02-10T00:00:38.309 INFO:tasks.workunit.client.1.smithi183.stdout:5/924: creat d4/d10c/f12c x:0 0 0 2024-02-10T00:00:38.310 INFO:tasks.workunit.client.1.smithi183.stdout:4/937: mkdir de/d14/d1d/d126 0 2024-02-10T00:00:38.312 INFO:tasks.workunit.client.1.smithi183.stdout:5/925: fdatasync d4/d23/d4a/d36/fb8 0 2024-02-10T00:00:38.312 INFO:tasks.workunit.client.1.smithi183.stdout:4/938: symlink de/d14/l127 0 2024-02-10T00:00:38.314 INFO:tasks.workunit.client.1.smithi183.stdout:9/886: dwrite d0/d3/d14/d3c/fae [0,4194304] 0 2024-02-10T00:00:38.315 INFO:tasks.workunit.client.1.smithi183.stdout:4/939: mkdir de/d14/d1d/d126/d128 0 2024-02-10T00:00:38.316 INFO:tasks.workunit.client.0.smithi164.stdout:0/537: sync 2024-02-10T00:00:38.316 INFO:tasks.workunit.client.0.smithi164.stdout:0/538: dread - d6/d3a/d52/fa7 zero size 2024-02-10T00:00:38.319 INFO:tasks.workunit.client.1.smithi183.stdout:9/887: rmdir d0/d3/d14/d1c/d4b/d97/daa 39 2024-02-10T00:00:38.319 INFO:tasks.workunit.client.0.smithi164.stdout:0/539: unlink d6/d7/d14/c22 0 2024-02-10T00:00:38.320 INFO:tasks.workunit.client.1.smithi183.stdout:9/888: write d0/d3/d14/d1c/d4b/ff3 [153439,66128] 0 2024-02-10T00:00:38.321 INFO:tasks.workunit.client.1.smithi183.stdout:5/926: truncate d4/d23/d3e/d80/da1/d9e/f43 4861190 0 2024-02-10T00:00:38.322 INFO:tasks.workunit.client.1.smithi183.stdout:4/940: symlink de/d14/d1d/d7b/l129 0 2024-02-10T00:00:38.325 INFO:tasks.workunit.client.1.smithi183.stdout:9/889: rename d0/d3/d14/d3c/c71 to d0/d3/d14/d1c/d2d/c11b 0 2024-02-10T00:00:38.327 INFO:tasks.workunit.client.1.smithi183.stdout:5/927: getdents d4/d23/d3e/d80/da1/d9e/d27/d37 0 2024-02-10T00:00:38.329 INFO:tasks.workunit.client.1.smithi183.stdout:4/941: rename de/d19/d1c/d61 to de/d14/d1d/d2f/da2/d109/d12a 0 2024-02-10T00:00:38.329 INFO:tasks.workunit.client.1.smithi183.stdout:9/890: dread d0/d3/f29 [0,4194304] 0 2024-02-10T00:00:38.330 INFO:tasks.workunit.client.1.smithi183.stdout:5/928: symlink d4/d23/d3e/d80/da1/d9e/d89/l12d 0 2024-02-10T00:00:38.330 INFO:tasks.workunit.client.1.smithi183.stdout:5/929: write d4/d23/d4a/d36/fb8 [842000,47773] 0 2024-02-10T00:00:38.331 INFO:tasks.workunit.client.1.smithi183.stdout:4/942: creat de/d22/f12b x:0 0 0 2024-02-10T00:00:38.332 INFO:tasks.workunit.client.0.smithi164.stdout:9/550: dread d6/de/d2b/f67 [0,4194304] 0 2024-02-10T00:00:38.332 INFO:tasks.workunit.client.0.smithi164.stdout:8/534: dread d2/d64/f51 [0,4194304] 0 2024-02-10T00:00:38.332 INFO:tasks.workunit.client.0.smithi164.stdout:9/551: dread - d6/de/d2b/d5b/f8d zero size 2024-02-10T00:00:38.333 INFO:tasks.workunit.client.1.smithi183.stdout:4/943: write de/d14/d1d/d2f/da2/d9c/ff8 [599999,129512] 0 2024-02-10T00:00:38.333 INFO:tasks.workunit.client.0.smithi164.stdout:9/552: stat d6/f7 0 2024-02-10T00:00:38.333 INFO:tasks.workunit.client.0.smithi164.stdout:8/535: readlink d2/d64/d54/d71/l96 0 2024-02-10T00:00:38.333 INFO:tasks.workunit.client.0.smithi164.stdout:2/612: sync 2024-02-10T00:00:38.334 INFO:tasks.workunit.client.1.smithi183.stdout:5/930: dread - d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/dc0/fc8 zero size 2024-02-10T00:00:38.334 INFO:tasks.workunit.client.0.smithi164.stdout:8/536: chown d2/d64/d65/d80/d32/d99/da0/ca4 9437337 1 2024-02-10T00:00:38.334 INFO:tasks.workunit.client.1.smithi183.stdout:0/915: write d14/d3e/d5f/daa/ddd/d121/d63/fe7 [863021,97945] 0 2024-02-10T00:00:38.335 INFO:tasks.workunit.client.1.smithi183.stdout:8/944: sync 2024-02-10T00:00:38.335 INFO:tasks.workunit.client.1.smithi183.stdout:0/916: dread - d14/d1d/d2d/d31/f138 zero size 2024-02-10T00:00:38.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/944: symlink de/d14/d1d/d2f/l12c 0 2024-02-10T00:00:38.336 INFO:tasks.workunit.client.1.smithi183.stdout:0/917: write d14/d1d/d96/da0/fe9 [475393,45767] 0 2024-02-10T00:00:38.337 INFO:tasks.workunit.client.0.smithi164.stdout:8/537: creat d2/d64/d65/fa6 x:0 0 0 2024-02-10T00:00:38.337 INFO:tasks.workunit.client.1.smithi183.stdout:0/918: chown d14/d1d/d2d/d31/d6c/f76 267245 1 2024-02-10T00:00:38.338 INFO:tasks.workunit.client.0.smithi164.stdout:8/538: write d2/d64/d65/d80/d32/f56 [352837,5122] 0 2024-02-10T00:00:38.339 INFO:tasks.workunit.client.0.smithi164.stdout:8/539: dread - d2/d64/d63/f70 zero size 2024-02-10T00:00:38.339 INFO:tasks.workunit.client.1.smithi183.stdout:0/919: mknod d14/d1d/c144 0 2024-02-10T00:00:38.339 INFO:tasks.workunit.client.0.smithi164.stdout:9/553: link d6/de/d2b/d5b/d61/d76/l85 d6/de/lab 0 2024-02-10T00:00:38.340 INFO:tasks.workunit.client.1.smithi183.stdout:4/945: dwrite de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:38.343 INFO:tasks.workunit.client.1.smithi183.stdout:4/946: mknod de/d14/d27/d2e/c12d 0 2024-02-10T00:00:38.346 INFO:tasks.workunit.client.1.smithi183.stdout:0/920: dwrite d14/d1d/d2d/d31/d6c/de3/f13f [0,4194304] 0 2024-02-10T00:00:38.347 INFO:tasks.workunit.client.0.smithi164.stdout:9/554: unlink d6/d41/d8b/d24/f33 0 2024-02-10T00:00:38.347 INFO:tasks.workunit.client.0.smithi164.stdout:8/540: getdents d2/d64/d65/d87 0 2024-02-10T00:00:38.347 INFO:tasks.workunit.client.0.smithi164.stdout:9/555: readlink d6/d41/d8b/d24/l31 0 2024-02-10T00:00:38.347 INFO:tasks.workunit.client.0.smithi164.stdout:8/541: stat d2/d64/f83 0 2024-02-10T00:00:38.347 INFO:tasks.workunit.client.0.smithi164.stdout:8/542: write d2/d64/d65/d80/d32/f38 [4327848,34260] 0 2024-02-10T00:00:38.350 INFO:tasks.workunit.client.0.smithi164.stdout:9/556: dwrite d6/d41/d8b/d24/f2a [0,4194304] 0 2024-02-10T00:00:38.352 INFO:tasks.workunit.client.1.smithi183.stdout:0/921: mknod d14/d3e/d5f/daa/ddd/d121/c145 0 2024-02-10T00:00:38.354 INFO:tasks.workunit.client.0.smithi164.stdout:6/629: truncate d0/d6/f4f 4839493 0 2024-02-10T00:00:38.355 INFO:tasks.workunit.client.0.smithi164.stdout:9/557: dwrite d6/de/d22/d69/f91 [0,4194304] 0 2024-02-10T00:00:38.356 INFO:tasks.workunit.client.1.smithi183.stdout:0/922: dwrite d14/d3e/d9b/f12d [0,4194304] 0 2024-02-10T00:00:38.360 INFO:tasks.workunit.client.0.smithi164.stdout:9/558: mkdir d6/de/d22/d58/dac 0 2024-02-10T00:00:38.363 INFO:tasks.workunit.client.0.smithi164.stdout:5/635: write d7/d17/d21/d24/dbc/d43/f53 [905870,6147] 0 2024-02-10T00:00:38.363 INFO:tasks.workunit.client.0.smithi164.stdout:1/504: truncate d1/d23/f98 4427348 0 2024-02-10T00:00:38.366 INFO:tasks.workunit.client.0.smithi164.stdout:9/559: stat d6/f70 0 2024-02-10T00:00:38.368 INFO:tasks.workunit.client.0.smithi164.stdout:7/582: dwrite d3/d28/f61 [0,4194304] 0 2024-02-10T00:00:38.371 INFO:tasks.workunit.client.0.smithi164.stdout:0/540: dwrite d6/d10/d18/d2d/f2f [4194304,4194304] 0 2024-02-10T00:00:38.371 INFO:tasks.workunit.client.0.smithi164.stdout:6/630: link d0/d6/d12/d45/f65 d0/d3b/d56/fd6 0 2024-02-10T00:00:38.373 INFO:tasks.workunit.client.0.smithi164.stdout:0/541: write d6/d10/d18/d2d/f2e [8108383,113059] 0 2024-02-10T00:00:38.375 INFO:tasks.workunit.client.0.smithi164.stdout:6/631: creat d0/d3b/d56/fd7 x:0 0 0 2024-02-10T00:00:38.375 INFO:tasks.workunit.client.0.smithi164.stdout:5/636: link d7/d17/d21/f29 d7/d17/d21/d23/d37/d36/d8b/fcf 0 2024-02-10T00:00:38.377 INFO:tasks.workunit.client.0.smithi164.stdout:3/500: dread d0/d1/dd/f31 [0,4194304] 0 2024-02-10T00:00:38.378 INFO:tasks.workunit.client.0.smithi164.stdout:0/542: rmdir d6/d10/d18/d2d/d35/d44/d49/d95 39 2024-02-10T00:00:38.379 INFO:tasks.workunit.client.0.smithi164.stdout:2/613: dread d3/f15 [4194304,4194304] 0 2024-02-10T00:00:38.383 INFO:tasks.workunit.client.0.smithi164.stdout:5/637: symlink d7/d17/d69/ld0 0 2024-02-10T00:00:38.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/543: sync 2024-02-10T00:00:38.385 INFO:tasks.workunit.client.1.smithi183.stdout:9/891: sync 2024-02-10T00:00:38.385 INFO:tasks.workunit.client.1.smithi183.stdout:8/945: sync 2024-02-10T00:00:38.386 INFO:tasks.workunit.client.0.smithi164.stdout:7/583: rename d3/d5/d2b/d4a/f53 to d3/d11/d39/d44/d48/fbb 0 2024-02-10T00:00:38.387 INFO:tasks.workunit.client.0.smithi164.stdout:2/614: stat d3/d32/l80 0 2024-02-10T00:00:38.387 INFO:tasks.workunit.client.1.smithi183.stdout:8/946: write d0/d11f/d81/fa7 [6198188,16913] 0 2024-02-10T00:00:38.387 INFO:tasks.workunit.client.1.smithi183.stdout:9/892: dread - d0/d3/d14/d1c/d2d/d4f/fcb zero size 2024-02-10T00:00:38.388 INFO:tasks.workunit.client.1.smithi183.stdout:9/893: chown d0/d3/d14/d1c/d2d/d4f/lc1 525203250 1 2024-02-10T00:00:38.388 INFO:tasks.workunit.client.0.smithi164.stdout:3/501: dwrite d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:38.388 INFO:tasks.workunit.client.0.smithi164.stdout:2/615: fsync d3/da6/d7a/d8e/d36/f3b 0 2024-02-10T00:00:38.388 INFO:tasks.workunit.client.0.smithi164.stdout:6/632: unlink d0/d2b/d3a/d3d/d42/d5d/d79/fae 0 2024-02-10T00:00:38.389 INFO:tasks.workunit.client.0.smithi164.stdout:5/638: creat d7/d17/d21/d24/dbc/d45/dab/fd1 x:0 0 0 2024-02-10T00:00:38.390 INFO:tasks.workunit.client.0.smithi164.stdout:2/616: write d3/da6/d7a/d8e/d88/f95 [236327,45850] 0 2024-02-10T00:00:38.391 INFO:tasks.workunit.client.1.smithi183.stdout:9/894: truncate d0/d3/d14/f38 452460 0 2024-02-10T00:00:38.391 INFO:tasks.workunit.client.0.smithi164.stdout:8/544: creat d2/d64/d7d/fa7 x:0 0 0 2024-02-10T00:00:38.391 INFO:tasks.workunit.client.0.smithi164.stdout:0/543: symlink d6/d10/lab 0 2024-02-10T00:00:38.392 INFO:tasks.workunit.client.1.smithi183.stdout:5/931: fsync d4/d23/dc4/fdf 0 2024-02-10T00:00:38.393 INFO:tasks.workunit.client.0.smithi164.stdout:0/544: fdatasync d6/d10/f1d 0 2024-02-10T00:00:38.393 INFO:tasks.workunit.client.1.smithi183.stdout:0/923: dread d14/d1d/d59/d71/f27 [0,4194304] 0 2024-02-10T00:00:38.394 INFO:tasks.workunit.client.1.smithi183.stdout:5/932: write d4/d23/d4a/d36/f114 [730916,45807] 0 2024-02-10T00:00:38.395 INFO:tasks.workunit.client.0.smithi164.stdout:0/545: write d6/d10/d18/d2d/f7f [1366672,48812] 0 2024-02-10T00:00:38.395 INFO:tasks.workunit.client.0.smithi164.stdout:3/502: rename d0/d1/d2/c16 to d0/c98 0 2024-02-10T00:00:38.396 INFO:tasks.workunit.client.0.smithi164.stdout:5/639: truncate d7/d17/d21/d23/d37/d36/f81 1171796 0 2024-02-10T00:00:38.397 INFO:tasks.workunit.client.0.smithi164.stdout:0/546: dread - d6/d10/d18/d2d/f8f zero size 2024-02-10T00:00:38.397 INFO:tasks.workunit.client.0.smithi164.stdout:8/545: dwrite d2/d64/d65/f85 [0,4194304] 0 2024-02-10T00:00:38.398 INFO:tasks.workunit.client.0.smithi164.stdout:5/640: readlink d7/d17/d21/d85/lb2 0 2024-02-10T00:00:38.399 INFO:tasks.workunit.client.0.smithi164.stdout:0/547: fdatasync d6/d10/d18/d2d/f37 0 2024-02-10T00:00:38.399 INFO:tasks.workunit.client.0.smithi164.stdout:2/617: rename d3/cc to d3/da6/d7a/d8e/d36/d90/cdd 0 2024-02-10T00:00:38.400 INFO:tasks.workunit.client.1.smithi183.stdout:0/924: link d14/d1d/d59/d71/db4/lce d14/d1d/d2d/d31/de0/l146 0 2024-02-10T00:00:38.400 INFO:tasks.workunit.client.1.smithi183.stdout:0/925: dread - d14/d1d/d96/f135 zero size 2024-02-10T00:00:38.401 INFO:tasks.workunit.client.0.smithi164.stdout:8/546: mknod d2/d64/d54/d71/d78/ca8 0 2024-02-10T00:00:38.402 INFO:tasks.workunit.client.0.smithi164.stdout:0/548: dread d6/d7/f6f [0,4194304] 0 2024-02-10T00:00:38.403 INFO:tasks.workunit.client.1.smithi183.stdout:3/762: write d7/fe [2240045,97886] 0 2024-02-10T00:00:38.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/618: chown d3/d24/c85 15867454 1 2024-02-10T00:00:38.408 INFO:tasks.workunit.client.0.smithi164.stdout:3/503: link d0/d1/d2/d19/d27/d5f/f93 d0/d1/d2/d19/d66/d81/f99 0 2024-02-10T00:00:38.408 INFO:tasks.workunit.client.1.smithi183.stdout:1/823: dwrite d0/d3/d67/d7b/dfe/d7c/f11a [0,4194304] 0 2024-02-10T00:00:38.409 INFO:tasks.workunit.client.0.smithi164.stdout:0/549: creat d6/d10/d4a/d60/fac x:0 0 0 2024-02-10T00:00:38.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/560: dread d6/d41/d8b/d24/f4a [0,4194304] 0 2024-02-10T00:00:38.410 INFO:tasks.workunit.client.1.smithi183.stdout:5/933: getdents d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d 0 2024-02-10T00:00:38.410 INFO:tasks.workunit.client.0.smithi164.stdout:3/504: dread - d0/d1/d3c/d3d/d6b/f77 zero size 2024-02-10T00:00:38.411 INFO:tasks.workunit.client.0.smithi164.stdout:9/561: stat d6/d41 0 2024-02-10T00:00:38.411 INFO:tasks.workunit.client.0.smithi164.stdout:8/547: dwrite d2/d64/d65/d80/d32/d58/f5c [0,4194304] 0 2024-02-10T00:00:38.411 INFO:tasks.workunit.client.1.smithi183.stdout:5/934: readlink d4/d23/d3e/d80/da1/d9e/d27/d5d/ld0 0 2024-02-10T00:00:38.412 INFO:tasks.workunit.client.0.smithi164.stdout:0/550: chown d6/d10/d4a/d60/d6c/l8a 3312633 1 2024-02-10T00:00:38.413 INFO:tasks.workunit.client.1.smithi183.stdout:7/834: truncate d0/f53 146750 0 2024-02-10T00:00:38.413 INFO:tasks.workunit.client.0.smithi164.stdout:8/548: stat d2/d64/d7d/fa7 0 2024-02-10T00:00:38.413 INFO:tasks.workunit.client.0.smithi164.stdout:2/619: rename d3/d26/d64/fc1 to d3/da6/d7a/d8e/d36/fde 0 2024-02-10T00:00:38.414 INFO:tasks.workunit.client.1.smithi183.stdout:7/835: write d0/d2/d50/dad/fc5 [315387,89344] 0 2024-02-10T00:00:38.414 INFO:tasks.workunit.client.0.smithi164.stdout:2/620: chown d3/da6/d7a/d8e/db6/db8/fd0 0 1 2024-02-10T00:00:38.420 INFO:tasks.workunit.client.1.smithi183.stdout:6/814: dread d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/f99 [4194304,4194304] 0 2024-02-10T00:00:38.422 INFO:tasks.workunit.client.1.smithi183.stdout:1/824: creat d0/d3/d67/d7b/dfe/d7c/db1/f11b x:0 0 0 2024-02-10T00:00:38.423 INFO:tasks.workunit.client.1.smithi183.stdout:1/825: dread - d0/d3/d29/dc4/fd6 zero size 2024-02-10T00:00:38.424 INFO:tasks.workunit.client.1.smithi183.stdout:6/815: dwrite d2/d32/fc1 [0,4194304] 0 2024-02-10T00:00:38.426 INFO:tasks.workunit.client.1.smithi183.stdout:7/836: readlink d0/d2/d4/l2a 0 2024-02-10T00:00:38.427 INFO:tasks.workunit.client.0.smithi164.stdout:0/551: symlink d6/d10/d18/d2d/d39/lad 0 2024-02-10T00:00:38.427 INFO:tasks.workunit.client.1.smithi183.stdout:8/947: sync 2024-02-10T00:00:38.428 INFO:tasks.workunit.client.0.smithi164.stdout:2/621: rmdir d3/d32/d4e 39 2024-02-10T00:00:38.429 INFO:tasks.workunit.client.1.smithi183.stdout:0/926: link d14/d1d/d96/da0/cdf d14/d3e/d5f/daa/c147 0 2024-02-10T00:00:38.429 INFO:tasks.workunit.client.1.smithi183.stdout:5/935: dwrite d4/dd/d31/d73/fc2 [0,4194304] 0 2024-02-10T00:00:38.430 INFO:tasks.workunit.client.1.smithi183.stdout:1/826: mknod d0/d3/da9/c11c 0 2024-02-10T00:00:38.433 INFO:tasks.workunit.client.1.smithi183.stdout:6/816: mknod d2/d1a/d25/d3c/d31/d38/d6e/d35/c101 0 2024-02-10T00:00:38.436 INFO:tasks.workunit.client.1.smithi183.stdout:7/837: write d0/d2/d3/fe5 [588460,72381] 0 2024-02-10T00:00:38.436 INFO:tasks.workunit.client.1.smithi183.stdout:0/927: mkdir d14/d3e/d5f/daa/ddd/d121/d63/d148 0 2024-02-10T00:00:38.437 INFO:tasks.workunit.client.1.smithi183.stdout:9/895: link d0/d10/f11a d0/d3/d14/d1c/d2d/d4f/d79/f11c 0 2024-02-10T00:00:38.438 INFO:tasks.workunit.client.1.smithi183.stdout:9/896: chown d0/d92/db7/lf2 9 1 2024-02-10T00:00:38.438 INFO:tasks.workunit.client.1.smithi183.stdout:6/817: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/d102 0 2024-02-10T00:00:38.439 INFO:tasks.workunit.client.1.smithi183.stdout:9/897: write d0/d3/d14/d1c/d2d/fd5 [825161,83067] 0 2024-02-10T00:00:38.440 INFO:tasks.workunit.client.1.smithi183.stdout:6/818: fdatasync d2/d1a/d25/d3c/d31/d38/d87/f6a 0 2024-02-10T00:00:38.441 INFO:tasks.workunit.client.1.smithi183.stdout:6/819: write d2/f5a [559098,113628] 0 2024-02-10T00:00:38.443 INFO:tasks.workunit.client.0.smithi164.stdout:1/505: dwrite d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:38.444 INFO:tasks.workunit.client.0.smithi164.stdout:9/562: mkdir d6/d41/d8b/dad 0 2024-02-10T00:00:38.444 INFO:tasks.workunit.client.0.smithi164.stdout:4/576: dread d2/d2f/d37/d71/dc6/fc8 [0,4194304] 0 2024-02-10T00:00:38.445 INFO:tasks.workunit.client.1.smithi183.stdout:8/948: mkdir d0/d27/d36/de3/ded/d125 0 2024-02-10T00:00:38.446 INFO:tasks.workunit.client.1.smithi183.stdout:4/947: dread de/d14/d27/f1b [0,4194304] 0 2024-02-10T00:00:38.446 INFO:tasks.workunit.client.0.smithi164.stdout:0/552: getdents d6/d10/d18/d2d/d35/d44 0 2024-02-10T00:00:38.447 INFO:tasks.workunit.client.0.smithi164.stdout:2/622: write d3/da6/d7a/d8e/db6/db8/fd0 [862057,31567] 0 2024-02-10T00:00:38.447 INFO:tasks.workunit.client.1.smithi183.stdout:7/838: link d0/d11/f36 d0/d2/d4/d8/d59/f108 0 2024-02-10T00:00:38.448 INFO:tasks.workunit.client.0.smithi164.stdout:1/506: mkdir d1/d23/d37/da9 0 2024-02-10T00:00:38.449 INFO:tasks.workunit.client.0.smithi164.stdout:4/577: creat d2/d2f/d37/d45/dab/dbd/fca x:0 0 0 2024-02-10T00:00:38.452 INFO:tasks.workunit.client.1.smithi183.stdout:5/936: rename d4/d23/d3e/d80/da1/d9e/d27/d5d/lcc to d4/d23/d3e/d80/da1/d9e/d27/d38/l12e 0 2024-02-10T00:00:38.452 INFO:tasks.workunit.client.1.smithi183.stdout:8/949: unlink d0/d45/f66 0 2024-02-10T00:00:38.453 INFO:tasks.workunit.client.1.smithi183.stdout:8/950: dread - d0/d23/f8c zero size 2024-02-10T00:00:38.454 INFO:tasks.workunit.client.1.smithi183.stdout:8/951: fdatasync d0/d10/f1a 0 2024-02-10T00:00:38.454 INFO:tasks.workunit.client.1.smithi183.stdout:8/952: fsync d0/d45/fa5 0 2024-02-10T00:00:38.455 INFO:tasks.workunit.client.1.smithi183.stdout:7/839: mkdir d0/d2/d4/d8/d59/d8a/d109 0 2024-02-10T00:00:38.456 INFO:tasks.workunit.client.1.smithi183.stdout:8/953: write d0/d4e/fa1 [1435159,87318] 0 2024-02-10T00:00:38.457 INFO:tasks.workunit.client.1.smithi183.stdout:9/898: rename d0/d3/d14/d74/d90 to d0/d3/d14/d1c/d2d/d4f/de6/d11d 0 2024-02-10T00:00:38.458 INFO:tasks.workunit.client.0.smithi164.stdout:9/563: rename f2 to d6/de/d2b/d5b/d61/d76/da5/fae 0 2024-02-10T00:00:38.459 INFO:tasks.workunit.client.1.smithi183.stdout:4/948: dwrite de/d19/d20/f5e [0,4194304] 0 2024-02-10T00:00:38.459 INFO:tasks.workunit.client.0.smithi164.stdout:9/564: write d6/de/d2b/f80 [713464,109151] 0 2024-02-10T00:00:38.461 INFO:tasks.workunit.client.0.smithi164.stdout:2/623: symlink d3/da6/d7a/ldf 0 2024-02-10T00:00:38.462 INFO:tasks.workunit.client.0.smithi164.stdout:2/624: dread - d3/da6/d7a/d8e/d36/fde zero size 2024-02-10T00:00:38.464 INFO:tasks.workunit.client.1.smithi183.stdout:4/949: dwrite de/d14/d27/f37 [0,4194304] 0 2024-02-10T00:00:38.470 INFO:tasks.workunit.client.1.smithi183.stdout:7/840: mkdir d0/d2/d4/d8/d59/d8a/d10a 0 2024-02-10T00:00:38.471 INFO:tasks.workunit.client.1.smithi183.stdout:8/954: mkdir d0/d23/db1/d11b/d126 0 2024-02-10T00:00:38.474 INFO:tasks.workunit.client.1.smithi183.stdout:6/820: rename d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/l72 to d2/d32/l103 0 2024-02-10T00:00:38.476 INFO:tasks.workunit.client.0.smithi164.stdout:4/578: rename d2/d2f/d37/d41/d69/l92 to d2/d19/d16/d31/d72/dc7/lcb 0 2024-02-10T00:00:38.477 INFO:tasks.workunit.client.0.smithi164.stdout:9/565: unlink d6/de/d2b/d5b/d61/f8f 0 2024-02-10T00:00:38.478 INFO:tasks.workunit.client.0.smithi164.stdout:5/641: truncate d7/d17/d21/d23/f2d 2280098 0 2024-02-10T00:00:38.479 INFO:tasks.workunit.client.0.smithi164.stdout:6/633: dread d0/d2b/d3a/d3d/d42/d5d/d79/fb1 [0,4194304] 0 2024-02-10T00:00:38.483 INFO:tasks.workunit.client.0.smithi164.stdout:3/505: write d0/d1/d2/d19/d66/d84/f88 [388858,74104] 0 2024-02-10T00:00:38.483 INFO:tasks.workunit.client.0.smithi164.stdout:5/642: dwrite d7/d17/d69/d92/fc2 [0,4194304] 0 2024-02-10T00:00:38.486 INFO:tasks.workunit.client.0.smithi164.stdout:1/507: creat d1/d13/d2b/d52/da4/faa x:0 0 0 2024-02-10T00:00:38.488 INFO:tasks.workunit.client.0.smithi164.stdout:4/579: stat d2/d19/d16/d31/c65 0 2024-02-10T00:00:38.488 INFO:tasks.workunit.client.1.smithi183.stdout:0/928: rmdir d14/d1d/d59/d71 39 2024-02-10T00:00:38.490 INFO:tasks.workunit.client.0.smithi164.stdout:6/634: rmdir d0/d2b/d3a 39 2024-02-10T00:00:38.492 INFO:tasks.workunit.client.0.smithi164.stdout:7/584: sync 2024-02-10T00:00:38.493 INFO:tasks.workunit.client.1.smithi183.stdout:3/763: truncate d7/db/d2a/d2d/d6a/fce 2057084 0 2024-02-10T00:00:38.493 INFO:tasks.workunit.client.0.smithi164.stdout:7/585: stat d3/d11/d39/d44/d48/l60 0 2024-02-10T00:00:38.493 INFO:tasks.workunit.client.0.smithi164.stdout:2/625: write d3/d32/d4e/f59 [166203,109462] 0 2024-02-10T00:00:38.494 INFO:tasks.workunit.client.0.smithi164.stdout:5/643: mkdir d7/d17/d79/dd2 0 2024-02-10T00:00:38.495 INFO:tasks.workunit.client.0.smithi164.stdout:0/553: getdents d6/d10/d66 0 2024-02-10T00:00:38.496 INFO:tasks.workunit.client.0.smithi164.stdout:1/508: symlink d1/d23/d61/lab 0 2024-02-10T00:00:38.499 INFO:tasks.workunit.client.0.smithi164.stdout:5/644: dwrite d7/d17/fc0 [0,4194304] 0 2024-02-10T00:00:38.503 INFO:tasks.workunit.client.1.smithi183.stdout:1/827: write d0/d3/da9/fda [1194198,120499] 0 2024-02-10T00:00:38.504 INFO:tasks.workunit.client.0.smithi164.stdout:3/506: mkdir d0/d8f/d9a 0 2024-02-10T00:00:38.506 INFO:tasks.workunit.client.0.smithi164.stdout:7/586: rename d3/d28/d51/l8f to d3/d26/d67/d98/daf/lbc 0 2024-02-10T00:00:38.507 INFO:tasks.workunit.client.0.smithi164.stdout:0/554: fdatasync d6/d3a/d52/f75 0 2024-02-10T00:00:38.508 INFO:tasks.workunit.client.1.smithi183.stdout:9/899: dread d0/fc0 [0,4194304] 0 2024-02-10T00:00:38.509 INFO:tasks.workunit.client.0.smithi164.stdout:4/580: truncate d2/d19/d16/d31/d57/f9b 235443 0 2024-02-10T00:00:38.511 INFO:tasks.workunit.client.0.smithi164.stdout:6/635: creat d0/d2b/d3a/d3d/da7/fd8 x:0 0 0 2024-02-10T00:00:38.512 INFO:tasks.workunit.client.0.smithi164.stdout:6/636: stat d0/d6/d12/c38 0 2024-02-10T00:00:38.513 INFO:tasks.workunit.client.0.smithi164.stdout:3/507: mkdir d0/d1/d2/d17/d37/d9b 0 2024-02-10T00:00:38.513 INFO:tasks.workunit.client.0.smithi164.stdout:3/508: chown d0/f10 0 1 2024-02-10T00:00:38.514 INFO:tasks.workunit.client.0.smithi164.stdout:3/509: dread - d0/d1/dd/f8d zero size 2024-02-10T00:00:38.515 INFO:tasks.workunit.client.0.smithi164.stdout:3/510: readlink d0/d1/d2/d19/d66/d84/l23 0 2024-02-10T00:00:38.515 INFO:tasks.workunit.client.0.smithi164.stdout:7/587: rmdir d3/d5 39 2024-02-10T00:00:38.515 INFO:tasks.workunit.client.0.smithi164.stdout:3/511: stat d0/d1/d2/d19/d66/d84/f88 0 2024-02-10T00:00:38.516 INFO:tasks.workunit.client.0.smithi164.stdout:3/512: chown d0/d1/d2/d17/d37/d3f/d4e/c8c 1 1 2024-02-10T00:00:38.519 INFO:tasks.workunit.client.0.smithi164.stdout:0/555: chown d6/d10/d18/la4 1833506917 1 2024-02-10T00:00:38.521 INFO:tasks.workunit.client.0.smithi164.stdout:9/566: getdents d6/d41/d8b 0 2024-02-10T00:00:38.522 INFO:tasks.workunit.client.0.smithi164.stdout:1/509: dwrite d1/d23/f97 [0,4194304] 0 2024-02-10T00:00:38.522 INFO:tasks.workunit.client.0.smithi164.stdout:0/556: write d6/d10/d18/d2d/f5a [4180760,66093] 0 2024-02-10T00:00:38.522 INFO:tasks.workunit.client.0.smithi164.stdout:5/645: mkdir d7/d17/d69/d92/da8/dcd/dd3 0 2024-02-10T00:00:38.523 INFO:tasks.workunit.client.0.smithi164.stdout:6/637: mknod d0/d2b/d3a/dd0/d93/cd9 0 2024-02-10T00:00:38.524 INFO:tasks.workunit.client.0.smithi164.stdout:1/510: write d1/d13/d2b/d52/f6b [4433080,117647] 0 2024-02-10T00:00:38.525 INFO:tasks.workunit.client.0.smithi164.stdout:5/646: dread - d7/d17/d21/d24/dbc/d45/d5c/f6f zero size 2024-02-10T00:00:38.526 INFO:tasks.workunit.client.0.smithi164.stdout:8/549: sync 2024-02-10T00:00:38.526 INFO:tasks.workunit.client.0.smithi164.stdout:4/581: write d2/fb [6369001,73836] 0 2024-02-10T00:00:38.528 INFO:tasks.workunit.client.0.smithi164.stdout:5/647: write d7/d17/d21/d23/d37/d36/f46 [2710596,84342] 0 2024-02-10T00:00:38.529 INFO:tasks.workunit.client.0.smithi164.stdout:5/648: chown d7/d17/d69/d92/da8/dcd/dd3 1211 1 2024-02-10T00:00:38.530 INFO:tasks.workunit.client.0.smithi164.stdout:5/649: fdatasync d7/d17/d21/d24/dbc/d45/d5c/f6f 0 2024-02-10T00:00:38.531 INFO:tasks.workunit.client.0.smithi164.stdout:5/650: write d7/d17/d21/d23/d5a/d68/d1f/f4a [4917473,34598] 0 2024-02-10T00:00:38.531 INFO:tasks.workunit.client.0.smithi164.stdout:2/626: rename d3/da6/d7a/d8e/d88/fc5 to d3/d32/d4e/d27/fe0 0 2024-02-10T00:00:38.533 INFO:tasks.workunit.client.1.smithi183.stdout:0/929: mknod d14/d3e/d5f/daa/de6/c149 0 2024-02-10T00:00:38.534 INFO:tasks.workunit.client.1.smithi183.stdout:3/764: mkdir d7/db/d2a/d33/d59/daa/ddd 0 2024-02-10T00:00:38.535 INFO:tasks.workunit.client.1.smithi183.stdout:1/828: mkdir d0/d3/d7/d3d/dcb/d11d 0 2024-02-10T00:00:38.535 INFO:tasks.workunit.client.0.smithi164.stdout:6/638: rmdir d0/d6 39 2024-02-10T00:00:38.536 INFO:tasks.workunit.client.0.smithi164.stdout:6/639: chown d0/d2b/d3a/d3d/d42/d5d 20189 1 2024-02-10T00:00:38.537 INFO:tasks.workunit.client.1.smithi183.stdout:5/937: creat d4/dd/d31/d73/f12f x:0 0 0 2024-02-10T00:00:38.537 INFO:tasks.workunit.client.0.smithi164.stdout:8/550: mkdir d2/d64/d65/da9 0 2024-02-10T00:00:38.538 INFO:tasks.workunit.client.1.smithi183.stdout:5/938: stat d4/d74/fe5 0 2024-02-10T00:00:38.538 INFO:tasks.workunit.client.0.smithi164.stdout:8/551: fdatasync d2/f19 0 2024-02-10T00:00:38.538 INFO:tasks.workunit.client.0.smithi164.stdout:9/567: mknod d6/caf 0 2024-02-10T00:00:38.539 INFO:tasks.workunit.client.0.smithi164.stdout:8/552: stat d2/d64/d7d 0 2024-02-10T00:00:38.539 INFO:tasks.workunit.client.1.smithi183.stdout:8/955: mkdir d0/d3f/d127 0 2024-02-10T00:00:38.539 INFO:tasks.workunit.client.1.smithi183.stdout:5/939: write d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/fb5 [1013632,120346] 0 2024-02-10T00:00:38.540 INFO:tasks.workunit.client.0.smithi164.stdout:4/582: mkdir d2/d2f/d37/d41/dcc 0 2024-02-10T00:00:38.540 INFO:tasks.workunit.client.0.smithi164.stdout:8/553: readlink d2/d64/d65/d80/l36 0 2024-02-10T00:00:38.541 INFO:tasks.workunit.client.1.smithi183.stdout:7/841: creat d0/d2/f10b x:0 0 0 2024-02-10T00:00:38.542 INFO:tasks.workunit.client.0.smithi164.stdout:2/627: rmdir d3/d32/d4e/d27 39 2024-02-10T00:00:38.543 INFO:tasks.workunit.client.1.smithi183.stdout:8/956: mkdir d0/d3f/d94/d128 0 2024-02-10T00:00:38.545 INFO:tasks.workunit.client.0.smithi164.stdout:6/640: rename d0/f21 to d0/d2b/d3a/dd0/d93/db4/fda 0 2024-02-10T00:00:38.545 INFO:tasks.workunit.client.0.smithi164.stdout:6/641: fdatasync d0/d3b/f90 0 2024-02-10T00:00:38.546 INFO:tasks.workunit.client.1.smithi183.stdout:9/900: creat d0/d3/d14/d1c/d2d/d4f/f11e x:0 0 0 2024-02-10T00:00:38.548 INFO:tasks.workunit.client.1.smithi183.stdout:5/940: unlink d4/d23/d4a/l6a 0 2024-02-10T00:00:38.549 INFO:tasks.workunit.client.1.smithi183.stdout:5/941: read d4/d23/d3e/d80/da1/f5c [703917,5158] 0 2024-02-10T00:00:38.550 INFO:tasks.workunit.client.1.smithi183.stdout:4/950: getdents de/d14/d4e/dd3 0 2024-02-10T00:00:38.551 INFO:tasks.workunit.client.1.smithi183.stdout:0/930: creat d14/d1d/d59/f14a x:0 0 0 2024-02-10T00:00:38.551 INFO:tasks.workunit.client.0.smithi164.stdout:7/588: getdents d3/d11/d39/d44/d48/d71 0 2024-02-10T00:00:38.552 INFO:tasks.workunit.client.1.smithi183.stdout:5/942: write d4/d23/d3e/d80/da1/d9e/d27/d37/d46/ded/ff6 [476426,111880] 0 2024-02-10T00:00:38.552 INFO:tasks.workunit.client.0.smithi164.stdout:2/628: mkdir d3/da6/d7a/de1 0 2024-02-10T00:00:38.553 INFO:tasks.workunit.client.0.smithi164.stdout:1/511: link d1/d1a/d35/f34 d1/d13/d1f/fac 0 2024-02-10T00:00:38.554 INFO:tasks.workunit.client.0.smithi164.stdout:0/557: truncate d6/d10/d18/d2d/d35/d44/d90/fa9 620577 0 2024-02-10T00:00:38.558 INFO:tasks.workunit.client.0.smithi164.stdout:8/554: symlink d2/d81/laa 0 2024-02-10T00:00:38.558 INFO:tasks.workunit.client.0.smithi164.stdout:3/513: link d0/c20 d0/d1/d2/d19/d27/d30/c9c 0 2024-02-10T00:00:38.559 INFO:tasks.workunit.client.0.smithi164.stdout:5/651: creat d7/fd4 x:0 0 0 2024-02-10T00:00:38.559 INFO:tasks.workunit.client.1.smithi183.stdout:6/821: write d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f83 [4744412,18222] 0 2024-02-10T00:00:38.560 INFO:tasks.workunit.client.0.smithi164.stdout:3/514: write d0/d1/d2/d17/d37/d3f/d4e/f96 [984607,54667] 0 2024-02-10T00:00:38.563 INFO:tasks.workunit.client.1.smithi183.stdout:7/842: creat d0/d2/d50/dad/f10c x:0 0 0 2024-02-10T00:00:38.565 INFO:tasks.workunit.client.1.smithi183.stdout:8/957: creat d0/d23/db1/d11b/f129 x:0 0 0 2024-02-10T00:00:38.566 INFO:tasks.workunit.client.1.smithi183.stdout:9/901: creat d0/d3/d14/d1c/d2d/d4f/da4/dda/f11f x:0 0 0 2024-02-10T00:00:38.567 INFO:tasks.workunit.client.1.smithi183.stdout:9/902: read - d0/d3/d14/d1c/d2d/d4f/da4/f106 zero size 2024-02-10T00:00:38.570 INFO:tasks.workunit.client.0.smithi164.stdout:1/512: creat d1/d13/d1f/fad x:0 0 0 2024-02-10T00:00:38.571 INFO:tasks.workunit.client.0.smithi164.stdout:1/513: fdatasync d1/d13/f47 0 2024-02-10T00:00:38.573 INFO:tasks.workunit.client.1.smithi183.stdout:3/765: write d7/db/d2a/f3a [4403309,98670] 0 2024-02-10T00:00:38.573 INFO:tasks.workunit.client.0.smithi164.stdout:4/583: rename d2/d2f/c22 to d2/d2f/d37/d41/d3d/d56/d85/ccd 0 2024-02-10T00:00:38.574 INFO:tasks.workunit.client.0.smithi164.stdout:0/558: dwrite d6/d10/d18/d2d/f5d [0,4194304] 0 2024-02-10T00:00:38.576 INFO:tasks.workunit.client.0.smithi164.stdout:9/568: creat d6/d41/d8b/d24/fb0 x:0 0 0 2024-02-10T00:00:38.577 INFO:tasks.workunit.client.1.smithi183.stdout:5/943: mkdir d4/d23/d10e/d130 0 2024-02-10T00:00:38.577 INFO:tasks.workunit.client.1.smithi183.stdout:1/829: dwrite d0/d3/d7/f10d [0,4194304] 0 2024-02-10T00:00:38.578 INFO:tasks.workunit.client.1.smithi183.stdout:7/843: chown d0/d11/d2f/d64/d6b/f75 776 1 2024-02-10T00:00:38.578 INFO:tasks.workunit.client.1.smithi183.stdout:7/844: chown d0/d2/d50 163993 1 2024-02-10T00:00:38.579 INFO:tasks.workunit.client.1.smithi183.stdout:7/845: read - d0/d2/d4/ff2 zero size 2024-02-10T00:00:38.582 INFO:tasks.workunit.client.0.smithi164.stdout:8/555: dwrite d2/f49 [0,4194304] 0 2024-02-10T00:00:38.582 INFO:tasks.workunit.client.0.smithi164.stdout:5/652: mknod d7/d17/d79/cd5 0 2024-02-10T00:00:38.582 INFO:tasks.workunit.client.0.smithi164.stdout:1/514: dread d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:38.582 INFO:tasks.workunit.client.1.smithi183.stdout:4/951: dread de/d14/d1d/f59 [0,4194304] 0 2024-02-10T00:00:38.582 INFO:tasks.workunit.client.1.smithi183.stdout:8/958: symlink d0/d23/dff/l12a 0 2024-02-10T00:00:38.583 INFO:tasks.workunit.client.1.smithi183.stdout:8/959: read - d0/d11f/ff0 zero size 2024-02-10T00:00:38.583 INFO:tasks.workunit.client.0.smithi164.stdout:8/556: write d2/d64/d65/d80/d32/d93/f9a [841952,42141] 0 2024-02-10T00:00:38.584 INFO:tasks.workunit.client.0.smithi164.stdout:8/557: chown d2/d64/d7d 285058 1 2024-02-10T00:00:38.585 INFO:tasks.workunit.client.0.smithi164.stdout:4/584: rename d2/d2f/d37/d45/dab/fb3 to d2/d2f/d37/d41/d3d/fce 0 2024-02-10T00:00:38.586 INFO:tasks.workunit.client.1.smithi183.stdout:8/960: dwrite d0/d3f/db2/d24/f28 [0,4194304] 0 2024-02-10T00:00:38.587 INFO:tasks.workunit.client.1.smithi183.stdout:0/931: rename d14/d1d/d2d/f39 to d14/d3e/d5f/daa/ddd/d121/f14b 0 2024-02-10T00:00:38.588 INFO:tasks.workunit.client.1.smithi183.stdout:5/944: rmdir d4/d23/d3e/d80/da1/d9e/d27/d38/d4f 39 2024-02-10T00:00:38.589 INFO:tasks.workunit.client.1.smithi183.stdout:7/846: mknod d0/d2/d50/d5d/c10d 0 2024-02-10T00:00:38.590 INFO:tasks.workunit.client.0.smithi164.stdout:2/629: creat d3/d32/fe2 x:0 0 0 2024-02-10T00:00:38.590 INFO:tasks.workunit.client.0.smithi164.stdout:2/630: fsync d3/da6/d7a/d8e/d36/fcc 0 2024-02-10T00:00:38.594 INFO:tasks.workunit.client.1.smithi183.stdout:4/952: mknod de/d22/c12e 0 2024-02-10T00:00:38.594 INFO:tasks.workunit.client.1.smithi183.stdout:8/961: rmdir d0/d27 39 2024-02-10T00:00:38.595 INFO:tasks.workunit.client.1.smithi183.stdout:4/953: dread - de/d14/d1d/d2f/da2/d109/d12a/f11f zero size 2024-02-10T00:00:38.596 INFO:tasks.workunit.client.0.smithi164.stdout:3/515: symlink d0/d1/l9d 0 2024-02-10T00:00:38.596 INFO:tasks.workunit.client.0.smithi164.stdout:1/515: symlink d1/d23/lae 0 2024-02-10T00:00:38.596 INFO:tasks.workunit.client.0.smithi164.stdout:5/653: unlink d7/d17/d79/la0 0 2024-02-10T00:00:38.596 INFO:tasks.workunit.client.0.smithi164.stdout:6/642: link d0/d6/d12/c20 d0/d6/cdb 0 2024-02-10T00:00:38.598 INFO:tasks.workunit.client.0.smithi164.stdout:3/516: chown d0/d1/dd/l76 6000488 1 2024-02-10T00:00:38.598 INFO:tasks.workunit.client.0.smithi164.stdout:2/631: getdents d3/da6/d7a/d8e/d8a/dc8 0 2024-02-10T00:00:38.600 INFO:tasks.workunit.client.0.smithi164.stdout:1/516: unlink d1/d1a/d41/d18/d3a/f93 0 2024-02-10T00:00:38.601 INFO:tasks.workunit.client.1.smithi183.stdout:6/822: getdents d2/d1a/d25/d3c/d8d/dfe 0 2024-02-10T00:00:38.602 INFO:tasks.workunit.client.1.smithi183.stdout:9/903: getdents d0/d3/d14/d3c/d7b 0 2024-02-10T00:00:38.603 INFO:tasks.workunit.client.0.smithi164.stdout:8/558: rmdir d2/d64/d65/d87 0 2024-02-10T00:00:38.604 INFO:tasks.workunit.client.1.smithi183.stdout:7/847: mkdir d0/d11/d9d/d103/d105/d10e 0 2024-02-10T00:00:38.604 INFO:tasks.workunit.client.0.smithi164.stdout:8/559: chown d2/d64/d65/d80/d32/d4d/f6b 6961717 1 2024-02-10T00:00:38.604 INFO:tasks.workunit.client.0.smithi164.stdout:6/643: dwrite d0/d6/d12/f4e [0,4194304] 0 2024-02-10T00:00:38.605 INFO:tasks.workunit.client.1.smithi183.stdout:1/830: getdents d0 0 2024-02-10T00:00:38.606 INFO:tasks.workunit.client.1.smithi183.stdout:4/954: mkdir de/d14/d1d/d7b/dfe/d12f 0 2024-02-10T00:00:38.606 INFO:tasks.workunit.client.0.smithi164.stdout:5/654: rename d7/d17/d21/d24/dbc/d45/dab to d7/d17/d79/dd6 0 2024-02-10T00:00:38.607 INFO:tasks.workunit.client.1.smithi183.stdout:8/962: getdents d0/d27/d36/de3/dfc 0 2024-02-10T00:00:38.607 INFO:tasks.workunit.client.1.smithi183.stdout:4/955: write de/d22/f43 [261273,80773] 0 2024-02-10T00:00:38.609 INFO:tasks.workunit.client.0.smithi164.stdout:2/632: creat d3/d24/d5b/fe3 x:0 0 0 2024-02-10T00:00:38.610 INFO:tasks.workunit.client.1.smithi183.stdout:9/904: rename d0/d30/c8b to d0/d3/d14/d1c/d2d/d4f/db8/de7/d100/c120 0 2024-02-10T00:00:38.610 INFO:tasks.workunit.client.0.smithi164.stdout:5/655: dwrite d7/d17/d21/d23/fa6 [0,4194304] 0 2024-02-10T00:00:38.611 INFO:tasks.workunit.client.0.smithi164.stdout:6/644: mkdir d0/d2b/d3a/d3d/d42/d5d/d66/ddc 0 2024-02-10T00:00:38.611 INFO:tasks.workunit.client.1.smithi183.stdout:7/848: creat d0/d2/d4/f10f x:0 0 0 2024-02-10T00:00:38.612 INFO:tasks.workunit.client.1.smithi183.stdout:1/831: dwrite d0/d3/d67/d7b/faf [0,4194304] 0 2024-02-10T00:00:38.613 INFO:tasks.workunit.client.1.smithi183.stdout:4/956: symlink de/d22/d121/l130 0 2024-02-10T00:00:38.614 INFO:tasks.workunit.client.0.smithi164.stdout:3/517: unlink d0/d1/d2/d19/d66/d84/c24 0 2024-02-10T00:00:38.615 INFO:tasks.workunit.client.0.smithi164.stdout:5/656: dread d7/d17/d21/d85/fc7 [0,4194304] 0 2024-02-10T00:00:38.615 INFO:tasks.workunit.client.0.smithi164.stdout:2/633: rmdir d3/d24 39 2024-02-10T00:00:38.616 INFO:tasks.workunit.client.1.smithi183.stdout:1/832: symlink d0/d3/d67/d7b/l11e 0 2024-02-10T00:00:38.617 INFO:tasks.workunit.client.1.smithi183.stdout:1/833: fsync d0/d3/d67/d7b/dfe/d7c/db1/fbe 0 2024-02-10T00:00:38.618 INFO:tasks.workunit.client.1.smithi183.stdout:1/834: stat d0/d3c/dc9/c116 0 2024-02-10T00:00:38.619 INFO:tasks.workunit.client.0.smithi164.stdout:6/645: rename d0/d6/d12/d14/d4b/l7c to d0/d2b/d3a/d3d/d42/d5d/d79/dbc/ldd 0 2024-02-10T00:00:38.620 INFO:tasks.workunit.client.0.smithi164.stdout:3/518: creat d0/d1/d3c/d3d/d6b/f9e x:0 0 0 2024-02-10T00:00:38.620 INFO:tasks.workunit.client.1.smithi183.stdout:9/905: truncate d0/d3/d14/d74/da8/f107 963221 0 2024-02-10T00:00:38.621 INFO:tasks.workunit.client.0.smithi164.stdout:3/519: stat d0/d1/l9d 0 2024-02-10T00:00:38.621 INFO:tasks.workunit.client.1.smithi183.stdout:7/849: getdents d0/d2/d50 0 2024-02-10T00:00:38.621 INFO:tasks.workunit.client.0.smithi164.stdout:3/520: chown d0/d1/dd/f31 189782384 1 2024-02-10T00:00:38.622 INFO:tasks.workunit.client.1.smithi183.stdout:3/766: dread d7/db/d2a/d33/d59/f8b [0,4194304] 0 2024-02-10T00:00:38.623 INFO:tasks.workunit.client.1.smithi183.stdout:3/767: stat d7/db/d2a/d2d/d6a/ld7 0 2024-02-10T00:00:38.624 INFO:tasks.workunit.client.1.smithi183.stdout:1/835: rename d0/d3/d67/fc8 to d0/d3a/dd8/f11f 0 2024-02-10T00:00:38.625 INFO:tasks.workunit.client.1.smithi183.stdout:4/957: truncate de/d14/d1d/d2f/da2/d109/d12a/fef 321058 0 2024-02-10T00:00:38.627 INFO:tasks.workunit.client.1.smithi183.stdout:9/906: mkdir d0/d30/db5/d121 0 2024-02-10T00:00:38.628 INFO:tasks.workunit.client.0.smithi164.stdout:2/634: mknod d3/da6/d7a/d8e/d36/d90/ce4 0 2024-02-10T00:00:38.628 INFO:tasks.workunit.client.0.smithi164.stdout:6/646: creat d0/d3b/d56/db3/fde x:0 0 0 2024-02-10T00:00:38.629 INFO:tasks.workunit.client.1.smithi183.stdout:8/963: dread d0/d27/d36/de3/ded/f119 [0,4194304] 0 2024-02-10T00:00:38.629 INFO:tasks.workunit.client.0.smithi164.stdout:3/521: creat d0/d1/d2/d19/d66/d81/f9f x:0 0 0 2024-02-10T00:00:38.629 INFO:tasks.workunit.client.0.smithi164.stdout:6/647: chown d0/d3b/d56/fd3 952157 1 2024-02-10T00:00:38.630 INFO:tasks.workunit.client.1.smithi183.stdout:8/964: write d0/d27/d75/f7e [50290,81867] 0 2024-02-10T00:00:38.631 INFO:tasks.workunit.client.1.smithi183.stdout:4/958: unlink de/d14/d1d/l6e 0 2024-02-10T00:00:38.632 INFO:tasks.workunit.client.1.smithi183.stdout:9/907: mknod d0/d3/d14/d3c/d7b/c122 0 2024-02-10T00:00:38.632 INFO:tasks.workunit.client.0.smithi164.stdout:2/635: fsync d3/da6/d7a/d8e/d36/f43 0 2024-02-10T00:00:38.633 INFO:tasks.workunit.client.0.smithi164.stdout:2/636: write d3/d26/fb0 [261655,75857] 0 2024-02-10T00:00:38.633 INFO:tasks.workunit.client.0.smithi164.stdout:6/648: dread d0/d2b/d3a/dd0/f7a [0,4194304] 0 2024-02-10T00:00:38.634 INFO:tasks.workunit.client.0.smithi164.stdout:4/585: sync 2024-02-10T00:00:38.635 INFO:tasks.workunit.client.1.smithi183.stdout:4/959: rmdir de/d19/d8d 39 2024-02-10T00:00:38.640 INFO:tasks.workunit.client.0.smithi164.stdout:9/569: write d6/d41/d8b/f2e [737643,4257] 0 2024-02-10T00:00:38.640 INFO:tasks.workunit.client.0.smithi164.stdout:7/589: dwrite d3/d11/d39/d44/d48/d50/d92/f99 [0,4194304] 0 2024-02-10T00:00:38.640 INFO:tasks.workunit.client.1.smithi183.stdout:6/823: dread d2/d1a/f49 [0,4194304] 0 2024-02-10T00:00:38.640 INFO:tasks.workunit.client.1.smithi183.stdout:8/965: read d0/d4e/f4f [3204625,80841] 0 2024-02-10T00:00:38.640 INFO:tasks.workunit.client.1.smithi183.stdout:7/850: rename d0/d11/l31 to d0/d11/d2f/l110 0 2024-02-10T00:00:38.642 INFO:tasks.workunit.client.1.smithi183.stdout:6/824: symlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/l104 0 2024-02-10T00:00:38.643 INFO:tasks.workunit.client.0.smithi164.stdout:0/559: truncate f1 1984299 0 2024-02-10T00:00:38.645 INFO:tasks.workunit.client.1.smithi183.stdout:3/768: rename d7/db/d2a/d2d/d6a to d7/db/d2a/d4d/dde 0 2024-02-10T00:00:38.645 INFO:tasks.workunit.client.1.smithi183.stdout:8/966: dread d0/d3f/db2/d24/f69 [0,4194304] 0 2024-02-10T00:00:38.646 INFO:tasks.workunit.client.1.smithi183.stdout:7/851: symlink d0/d11/d9d/d103/d105/l111 0 2024-02-10T00:00:38.647 INFO:tasks.workunit.client.0.smithi164.stdout:5/657: rename d7/d17/d79/dd6 to d7/d17/d79/d7b/dc5/dd7 0 2024-02-10T00:00:38.648 INFO:tasks.workunit.client.1.smithi183.stdout:6/825: read - d2/d1a/d25/d3c/d31/d38/f5d zero size 2024-02-10T00:00:38.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/590: dread d3/f16 [0,4194304] 0 2024-02-10T00:00:38.651 INFO:tasks.workunit.client.1.smithi183.stdout:7/852: dwrite d0/d2/d50/dad/fc5 [0,4194304] 0 2024-02-10T00:00:38.651 INFO:tasks.workunit.client.0.smithi164.stdout:8/560: dwrite d2/d64/f2d [0,4194304] 0 2024-02-10T00:00:38.652 INFO:tasks.workunit.client.1.smithi183.stdout:3/769: creat d7/db/d2a/d2d/fdf x:0 0 0 2024-02-10T00:00:38.653 INFO:tasks.workunit.client.0.smithi164.stdout:7/591: write d3/d11/d39/d44/d6f/f9e [1922579,123869] 0 2024-02-10T00:00:38.653 INFO:tasks.workunit.client.0.smithi164.stdout:6/649: read d0/d6/f4f [3802474,121194] 0 2024-02-10T00:00:38.654 INFO:tasks.workunit.client.0.smithi164.stdout:6/650: chown d0/d2b/d3a/d3d/da7 10109248 1 2024-02-10T00:00:38.656 INFO:tasks.workunit.client.1.smithi183.stdout:6/826: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fbf [0,4194304] 0 2024-02-10T00:00:38.657 INFO:tasks.workunit.client.0.smithi164.stdout:5/658: creat d7/d17/d21/d23/d5a/d68/fd8 x:0 0 0 2024-02-10T00:00:38.659 INFO:tasks.workunit.client.0.smithi164.stdout:1/517: dread d1/d13/f62 [0,4194304] 0 2024-02-10T00:00:38.660 INFO:tasks.workunit.client.1.smithi183.stdout:6/827: symlink d2/d1a/d25/d3c/d31/l105 0 2024-02-10T00:00:38.667 INFO:tasks.workunit.client.0.smithi164.stdout:4/586: mkdir d2/d19/d16/d31/dcf 0 2024-02-10T00:00:38.667 INFO:tasks.workunit.client.0.smithi164.stdout:2/637: mknod d3/d24/ce5 0 2024-02-10T00:00:38.668 INFO:tasks.workunit.client.0.smithi164.stdout:4/587: write d2/d19/f48 [56304,50870] 0 2024-02-10T00:00:38.669 INFO:tasks.workunit.client.1.smithi183.stdout:5/945: write f1 [888659,654] 0 2024-02-10T00:00:38.669 INFO:tasks.workunit.client.1.smithi183.stdout:0/932: write d14/d1d/d2d/d31/f91 [1185386,73585] 0 2024-02-10T00:00:38.670 INFO:tasks.workunit.client.0.smithi164.stdout:1/518: mknod d1/d23/d37/caf 0 2024-02-10T00:00:38.671 INFO:tasks.workunit.client.1.smithi183.stdout:5/946: mkdir d4/d10c/d131 0 2024-02-10T00:00:38.673 INFO:tasks.workunit.client.0.smithi164.stdout:8/561: symlink d2/d64/d65/d80/d32/lab 0 2024-02-10T00:00:38.673 INFO:tasks.workunit.client.1.smithi183.stdout:1/836: dread d0/fc5 [0,4194304] 0 2024-02-10T00:00:38.674 INFO:tasks.workunit.client.1.smithi183.stdout:1/837: read - d0/d3/d7/d3d/dcb/fe1 zero size 2024-02-10T00:00:38.675 INFO:tasks.workunit.client.1.smithi183.stdout:6/828: rename d2/d1a/d25/d3c/d31/d38/d3f/d94/fa2 to d2/d1a/d25/d3c/d31/d38/d6e/d34/f106 0 2024-02-10T00:00:38.676 INFO:tasks.workunit.client.1.smithi183.stdout:3/770: dread d7/db/fca [0,4194304] 0 2024-02-10T00:00:38.677 INFO:tasks.workunit.client.0.smithi164.stdout:3/522: rename d0/d1/d2/d19/d27/d5f/f93 to d0/fa0 0 2024-02-10T00:00:38.677 INFO:tasks.workunit.client.0.smithi164.stdout:7/592: fdatasync d3/d5/d2b/f4e 0 2024-02-10T00:00:38.680 INFO:tasks.workunit.client.1.smithi183.stdout:6/829: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fff [0,4194304] 0 2024-02-10T00:00:38.682 INFO:tasks.workunit.client.0.smithi164.stdout:6/651: truncate d0/d6/d95/fc8 441470 0 2024-02-10T00:00:38.682 INFO:tasks.workunit.client.0.smithi164.stdout:6/652: chown d0 153517 1 2024-02-10T00:00:38.682 INFO:tasks.workunit.client.1.smithi183.stdout:5/947: mkdir d4/d23/d3e/d80/da1/d9e/d27/d38/d132 0 2024-02-10T00:00:38.686 INFO:tasks.workunit.client.1.smithi183.stdout:9/908: write d0/d3/d14/d1c/f5c [5330404,116827] 0 2024-02-10T00:00:38.687 INFO:tasks.workunit.client.1.smithi183.stdout:9/909: fdatasync d0/d3/d14/d1c/d2d/d4f/da4/dda/f11f 0 2024-02-10T00:00:38.688 INFO:tasks.workunit.client.1.smithi183.stdout:1/838: creat d0/d3/d67/d7b/dfe/d7c/f120 x:0 0 0 2024-02-10T00:00:38.689 INFO:tasks.workunit.client.0.smithi164.stdout:9/570: rename d6/de/d2b/f65 to d6/d41/fb1 0 2024-02-10T00:00:38.689 INFO:tasks.workunit.client.0.smithi164.stdout:9/571: write d6/de/d40/f6f [931844,17165] 0 2024-02-10T00:00:38.690 INFO:tasks.workunit.client.0.smithi164.stdout:9/572: write d6/d41/d8b/f1d [140083,62828] 0 2024-02-10T00:00:38.692 INFO:tasks.workunit.client.1.smithi183.stdout:1/839: dread d0/d3/d67/f94 [0,4194304] 0 2024-02-10T00:00:38.692 INFO:tasks.workunit.client.0.smithi164.stdout:4/588: unlink d2/d19/d16/f25 0 2024-02-10T00:00:38.694 INFO:tasks.workunit.client.1.smithi183.stdout:0/933: creat d14/d1d/d2d/d31/d68/f14c x:0 0 0 2024-02-10T00:00:38.694 INFO:tasks.workunit.client.0.smithi164.stdout:8/562: mkdir d2/d64/d65/d80/d32/d68/dac 0 2024-02-10T00:00:38.696 INFO:tasks.workunit.client.1.smithi183.stdout:8/967: dwrite d0/d27/f8b [4194304,4194304] 0 2024-02-10T00:00:38.699 INFO:tasks.workunit.client.1.smithi183.stdout:4/960: truncate de/d14/d1d/d2f/da2/d109/d12a/fef 986381 0 2024-02-10T00:00:38.701 INFO:tasks.workunit.client.0.smithi164.stdout:5/659: write d7/d17/d21/d23/fc1 [112585,80893] 0 2024-02-10T00:00:38.703 INFO:tasks.workunit.client.0.smithi164.stdout:0/560: dwrite d6/d7/f58 [0,4194304] 0 2024-02-10T00:00:38.704 INFO:tasks.workunit.client.1.smithi183.stdout:9/910: unlink d0/d3/l4 0 2024-02-10T00:00:38.704 INFO:tasks.workunit.client.1.smithi183.stdout:3/771: dwrite d7/db/d2a/d8e/fae [0,4194304] 0 2024-02-10T00:00:38.705 INFO:tasks.workunit.client.0.smithi164.stdout:7/593: mkdir d3/d11/d39/d44/dbd 0 2024-02-10T00:00:38.710 INFO:tasks.workunit.client.0.smithi164.stdout:2/638: truncate d3/d26/d56/fa4 2198413 0 2024-02-10T00:00:38.713 INFO:tasks.workunit.client.1.smithi183.stdout:9/911: dread - d0/d3/d14/d1c/d4b/d97/daa/dcf/fd1 zero size 2024-02-10T00:00:38.714 INFO:tasks.workunit.client.0.smithi164.stdout:1/519: link d1/d1a/d35/c8b d1/d13/d2b/d52/da4/cb0 0 2024-02-10T00:00:38.714 INFO:tasks.workunit.client.0.smithi164.stdout:4/589: creat d2/d2f/d37/d41/d3d/d42/d47/fd0 x:0 0 0 2024-02-10T00:00:38.715 INFO:tasks.workunit.client.0.smithi164.stdout:6/653: symlink d0/d6/d12/d14/d4b/dbf/ldf 0 2024-02-10T00:00:38.715 INFO:tasks.workunit.client.1.smithi183.stdout:3/772: dwrite d7/f5a [4194304,4194304] 0 2024-02-10T00:00:38.717 INFO:tasks.workunit.client.1.smithi183.stdout:8/968: truncate d0/d27/d75/d5b/f99 3747593 0 2024-02-10T00:00:38.719 INFO:tasks.workunit.client.1.smithi183.stdout:9/912: symlink d0/d3/d14/d1c/d2d/d4f/da4/dda/l123 0 2024-02-10T00:00:38.719 INFO:tasks.workunit.client.1.smithi183.stdout:7/853: sync 2024-02-10T00:00:38.719 INFO:tasks.workunit.client.0.smithi164.stdout:7/594: creat d3/d11/d39/d44/d48/d71/fbe x:0 0 0 2024-02-10T00:00:38.720 INFO:tasks.workunit.client.1.smithi183.stdout:3/773: readlink d7/l15 0 2024-02-10T00:00:38.720 INFO:tasks.workunit.client.0.smithi164.stdout:3/523: dwrite d0/d1/d2/d19/d66/d84/f88 [4194304,4194304] 0 2024-02-10T00:00:38.721 INFO:tasks.workunit.client.1.smithi183.stdout:6/830: getdents d2/d1a/d25/d3c/d31 0 2024-02-10T00:00:38.721 INFO:tasks.workunit.client.0.smithi164.stdout:8/563: truncate d2/f20 6150306 0 2024-02-10T00:00:38.723 INFO:tasks.workunit.client.1.smithi183.stdout:4/961: link de/d14/d27/d40/fea de/d19/d20/f131 0 2024-02-10T00:00:38.724 INFO:tasks.workunit.client.1.smithi183.stdout:8/969: creat d0/d11f/f12b x:0 0 0 2024-02-10T00:00:38.725 INFO:tasks.workunit.client.0.smithi164.stdout:6/654: rename d0/d6/d12/d57/lb7 to d0/d6/d95/le0 0 2024-02-10T00:00:38.725 INFO:tasks.workunit.client.1.smithi183.stdout:8/970: stat d0/d45 0 2024-02-10T00:00:38.726 INFO:tasks.workunit.client.1.smithi183.stdout:7/854: dwrite d0/d11/fca [0,4194304] 0 2024-02-10T00:00:38.727 INFO:tasks.workunit.client.1.smithi183.stdout:9/913: unlink d0/d3/d14/d1c/d2d/c49 0 2024-02-10T00:00:38.728 INFO:tasks.workunit.client.1.smithi183.stdout:9/914: chown d0/d3/d14/d1c/d2d/fd5 7 1 2024-02-10T00:00:38.731 INFO:tasks.workunit.client.0.smithi164.stdout:3/524: dwrite d0/d1/d3c/d3d/d6b/f74 [0,4194304] 0 2024-02-10T00:00:38.732 INFO:tasks.workunit.client.0.smithi164.stdout:8/564: creat d2/d64/d65/d80/d82/fad x:0 0 0 2024-02-10T00:00:38.733 INFO:tasks.workunit.client.0.smithi164.stdout:9/573: getdents d6/d41/d8b/d24/d4f 0 2024-02-10T00:00:38.733 INFO:tasks.workunit.client.0.smithi164.stdout:7/595: mkdir d3/dbf 0 2024-02-10T00:00:38.733 INFO:tasks.workunit.client.1.smithi183.stdout:6/831: symlink d2/d1a/d25/d3c/d8d/l107 0 2024-02-10T00:00:38.734 INFO:tasks.workunit.client.1.smithi183.stdout:6/832: write d2/d32/fc1 [182704,130648] 0 2024-02-10T00:00:38.735 INFO:tasks.workunit.client.0.smithi164.stdout:0/561: getdents d6/d3a 0 2024-02-10T00:00:38.735 INFO:tasks.workunit.client.0.smithi164.stdout:7/596: write d3/f9 [3106355,83175] 0 2024-02-10T00:00:38.735 INFO:tasks.workunit.client.0.smithi164.stdout:0/562: stat d6/d3a/d52/fa7 0 2024-02-10T00:00:38.735 INFO:tasks.workunit.client.1.smithi183.stdout:8/971: mkdir d0/d3f/d94/d122/d12c 0 2024-02-10T00:00:38.736 INFO:tasks.workunit.client.0.smithi164.stdout:0/563: fdatasync d6/d3a/d52/fa7 0 2024-02-10T00:00:38.737 INFO:tasks.workunit.client.0.smithi164.stdout:2/639: dread d3/d32/d4e/f67 [0,4194304] 0 2024-02-10T00:00:38.738 INFO:tasks.workunit.client.1.smithi183.stdout:4/962: symlink de/d14/d1d/d2f/l132 0 2024-02-10T00:00:38.740 INFO:tasks.workunit.client.1.smithi183.stdout:1/840: dread d0/d3/d7/f4a [0,4194304] 0 2024-02-10T00:00:38.740 INFO:tasks.workunit.client.1.smithi183.stdout:6/833: creat d2/f108 x:0 0 0 2024-02-10T00:00:38.742 INFO:tasks.workunit.client.1.smithi183.stdout:6/834: write d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fea [815313,19964] 0 2024-02-10T00:00:38.743 INFO:tasks.workunit.client.1.smithi183.stdout:8/972: mkdir d0/d11f/d12d 0 2024-02-10T00:00:38.743 INFO:tasks.workunit.client.1.smithi183.stdout:7/855: truncate d0/d11/f36 3917295 0 2024-02-10T00:00:38.743 INFO:tasks.workunit.client.1.smithi183.stdout:5/948: write d4/dd/f75 [358249,122695] 0 2024-02-10T00:00:38.744 INFO:tasks.workunit.client.1.smithi183.stdout:9/915: fdatasync d0/d3/d14/d1c/d4b/d51/f75 0 2024-02-10T00:00:38.745 INFO:tasks.workunit.client.1.smithi183.stdout:6/835: write d2/d1a/d25/d3c/d31/d38/d3f/f4d [1440919,112605] 0 2024-02-10T00:00:38.745 INFO:tasks.workunit.client.1.smithi183.stdout:4/963: mknod de/d14/d1d/d2f/da2/c133 0 2024-02-10T00:00:38.746 INFO:tasks.workunit.client.1.smithi183.stdout:1/841: chown d0/d3/d7/d3d/d60/d89/l90 2 1 2024-02-10T00:00:38.747 INFO:tasks.workunit.client.1.smithi183.stdout:1/842: read d0/d3/f2d [1335512,95793] 0 2024-02-10T00:00:38.748 INFO:tasks.workunit.client.0.smithi164.stdout:8/565: mknod d2/d64/d65/d80/d32/d99/da0/cae 0 2024-02-10T00:00:38.748 INFO:tasks.workunit.client.0.smithi164.stdout:3/525: readlink d0/d1/d2/d19/d66/d84/l23 0 2024-02-10T00:00:38.749 INFO:tasks.workunit.client.0.smithi164.stdout:0/564: rename d6/d3a/c89 to d6/d7/d14/da6/cae 0 2024-02-10T00:00:38.750 INFO:tasks.workunit.client.1.smithi183.stdout:8/973: mkdir d0/d10/d9e/da4/d12e 0 2024-02-10T00:00:38.751 INFO:tasks.workunit.client.0.smithi164.stdout:3/526: creat d0/d1/d3c/fa1 x:0 0 0 2024-02-10T00:00:38.753 INFO:tasks.workunit.client.1.smithi183.stdout:9/916: mknod d0/d3/d14/d1c/d4b/c124 0 2024-02-10T00:00:38.754 INFO:tasks.workunit.client.0.smithi164.stdout:2/640: rename d3/d26/faf to d3/d24/d5b/dd9/fe6 0 2024-02-10T00:00:38.755 INFO:tasks.workunit.client.0.smithi164.stdout:8/566: symlink d2/d64/d65/d80/d32/d68/laf 0 2024-02-10T00:00:38.755 INFO:tasks.workunit.client.1.smithi183.stdout:5/949: dread d4/d74/f105 [0,4194304] 0 2024-02-10T00:00:38.755 INFO:tasks.workunit.client.0.smithi164.stdout:2/641: chown d3/d26/d56/cd6 7531 1 2024-02-10T00:00:38.756 INFO:tasks.workunit.client.1.smithi183.stdout:5/950: write d4/d23/d2a/f58 [2252304,10122] 0 2024-02-10T00:00:38.757 INFO:tasks.workunit.client.0.smithi164.stdout:2/642: stat d3/da6/l6c 0 2024-02-10T00:00:38.758 INFO:tasks.workunit.client.0.smithi164.stdout:6/655: dread d0/d2b/d3a/f53 [4194304,4194304] 0 2024-02-10T00:00:38.758 INFO:tasks.workunit.client.0.smithi164.stdout:3/527: dwrite d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:38.758 INFO:tasks.workunit.client.0.smithi164.stdout:2/643: readlink d3/da6/l6c 0 2024-02-10T00:00:38.758 INFO:tasks.workunit.client.1.smithi183.stdout:7/856: mknod d0/d11/d88/d94/dff/c112 0 2024-02-10T00:00:38.759 INFO:tasks.workunit.client.1.smithi183.stdout:9/917: rmdir d0/d92/db7 39 2024-02-10T00:00:38.760 INFO:tasks.workunit.client.0.smithi164.stdout:8/567: mkdir d2/d64/d65/d80/d32/d93/db0 0 2024-02-10T00:00:38.760 INFO:tasks.workunit.client.0.smithi164.stdout:6/656: fdatasync d0/d2b/d3a/d3d/fa3 0 2024-02-10T00:00:38.760 INFO:tasks.workunit.client.0.smithi164.stdout:3/528: stat d0/d1/d2/d19/d66/d84 0 2024-02-10T00:00:38.760 INFO:tasks.workunit.client.0.smithi164.stdout:6/657: chown d0/f17 41294 1 2024-02-10T00:00:38.760 INFO:tasks.workunit.client.0.smithi164.stdout:1/520: dread d1/d13/d1f/fac [0,4194304] 0 2024-02-10T00:00:38.761 INFO:tasks.workunit.client.1.smithi183.stdout:1/843: dread d0/d3/d29/f51 [0,4194304] 0 2024-02-10T00:00:38.761 INFO:tasks.workunit.client.0.smithi164.stdout:0/565: getdents d6/d10/d18 0 2024-02-10T00:00:38.762 INFO:tasks.workunit.client.0.smithi164.stdout:3/529: read - d0/d1/d2/f8e zero size 2024-02-10T00:00:38.762 INFO:tasks.workunit.client.0.smithi164.stdout:1/521: fdatasync d1/d23/f7d 0 2024-02-10T00:00:38.762 INFO:tasks.workunit.client.0.smithi164.stdout:2/644: mknod d3/da6/d7a/d8e/d8a/ce7 0 2024-02-10T00:00:38.762 INFO:tasks.workunit.client.1.smithi183.stdout:8/974: mkdir d0/d3f/db2/d12f 0 2024-02-10T00:00:38.762 INFO:tasks.workunit.client.0.smithi164.stdout:6/658: mkdir d0/d2b/d3a/d3d/da7/da9/de1 0 2024-02-10T00:00:38.767 INFO:tasks.workunit.client.1.smithi183.stdout:8/975: mkdir d0/d23/db1/d130 0 2024-02-10T00:00:38.767 INFO:tasks.workunit.client.1.smithi183.stdout:0/934: dwrite d14/d3e/d5f/daa/ddd/d121/f14b [0,4194304] 0 2024-02-10T00:00:38.772 INFO:tasks.workunit.client.1.smithi183.stdout:9/918: truncate d0/d10/f5f 418470 0 2024-02-10T00:00:38.772 INFO:tasks.workunit.client.1.smithi183.stdout:0/935: chown d14/d1d/d2d/d31/d68/dcc/ff8 1004513 1 2024-02-10T00:00:38.774 INFO:tasks.workunit.client.1.smithi183.stdout:5/951: link d4/d23/d3e/d80/da1/d9e/f39 d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/f133 0 2024-02-10T00:00:38.776 INFO:tasks.workunit.client.1.smithi183.stdout:3/774: dread d7/db/d2a/d1c/f1e [0,4194304] 0 2024-02-10T00:00:38.777 INFO:tasks.workunit.client.1.smithi183.stdout:7/857: getdents d0/d2/d50/dd1 0 2024-02-10T00:00:38.778 INFO:tasks.workunit.client.1.smithi183.stdout:8/976: truncate d0/d27/d75/d5b/f10e 603002 0 2024-02-10T00:00:38.780 INFO:tasks.workunit.client.1.smithi183.stdout:3/775: creat d7/db/d2a/d8e/fe0 x:0 0 0 2024-02-10T00:00:38.783 INFO:tasks.workunit.client.1.smithi183.stdout:3/776: write d7/db/d2a/d8e/fdc [514073,17644] 0 2024-02-10T00:00:38.785 INFO:tasks.workunit.client.1.smithi183.stdout:9/919: dwrite d0/d3/d14/d48/fff [0,4194304] 0 2024-02-10T00:00:38.785 INFO:tasks.workunit.client.0.smithi164.stdout:1/522: mknod d1/d1a/d35/cb1 0 2024-02-10T00:00:38.786 INFO:tasks.workunit.client.0.smithi164.stdout:6/659: chown d0/d6/d12/d57 48119 1 2024-02-10T00:00:38.787 INFO:tasks.workunit.client.0.smithi164.stdout:5/660: truncate d7/d17/d21/d23/fa6 4942671 0 2024-02-10T00:00:38.787 INFO:tasks.workunit.client.0.smithi164.stdout:4/590: truncate d2/d2f/d37/d41/d3d/d42/f63 4918099 0 2024-02-10T00:00:38.791 INFO:tasks.workunit.client.1.smithi183.stdout:4/964: dread de/d19/fd1 [0,4194304] 0 2024-02-10T00:00:38.795 INFO:tasks.workunit.client.1.smithi183.stdout:1/844: dread d0/d3/d67/d70/fb7 [0,4194304] 0 2024-02-10T00:00:38.795 INFO:tasks.workunit.client.1.smithi183.stdout:0/936: truncate d14/d1d/d55/fc2 1726687 0 2024-02-10T00:00:38.798 INFO:tasks.workunit.client.1.smithi183.stdout:6/836: dwrite d2/d1a/d25/d3c/d8d/fb7 [0,4194304] 0 2024-02-10T00:00:38.799 INFO:tasks.workunit.client.1.smithi183.stdout:5/952: write d4/d23/d3e/d80/d96/ff7 [1202176,120291] 0 2024-02-10T00:00:38.800 INFO:tasks.workunit.client.1.smithi183.stdout:5/953: write d4/d10c/f121 [275753,34623] 0 2024-02-10T00:00:38.803 INFO:tasks.workunit.client.0.smithi164.stdout:9/574: sync 2024-02-10T00:00:38.804 INFO:tasks.workunit.client.1.smithi183.stdout:7/858: dwrite d0/d2/d50/dad/f61 [0,4194304] 0 2024-02-10T00:00:38.809 INFO:tasks.workunit.client.0.smithi164.stdout:4/591: write d2/d2f/d37/d45/fa9 [280098,103006] 0 2024-02-10T00:00:38.814 INFO:tasks.workunit.client.0.smithi164.stdout:9/575: dwrite d6/de/d2b/d5b/d61/d76/d82/fa4 [0,4194304] 0 2024-02-10T00:00:38.838 INFO:tasks.workunit.client.1.smithi183.stdout:5/954: dread d4/f45 [0,4194304] 0 2024-02-10T00:00:38.839 INFO:tasks.workunit.client.0.smithi164.stdout:3/530: dread d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:38.840 INFO:tasks.workunit.client.0.smithi164.stdout:3/531: stat d0/d1/d2/d17/d37/f90 0 2024-02-10T00:00:38.844 INFO:tasks.workunit.client.0.smithi164.stdout:5/661: dread d7/d17/d21/d23/d37/d36/f6d [0,4194304] 0 2024-02-10T00:00:38.847 INFO:tasks.workunit.client.0.smithi164.stdout:2/645: rename d3/d26/d64/f9c to d3/d24/d5b/dd9/fe8 0 2024-02-10T00:00:38.854 INFO:tasks.workunit.client.0.smithi164.stdout:7/597: truncate d3/d5/d9b/db7/d4b/f6a 1419285 0 2024-02-10T00:00:38.868 INFO:tasks.workunit.client.0.smithi164.stdout:8/568: sync 2024-02-10T00:00:38.869 INFO:tasks.workunit.client.0.smithi164.stdout:8/569: write d2/d64/d65/d80/d82/fad [559130,27059] 0 2024-02-10T00:00:38.880 INFO:tasks.workunit.client.1.smithi183.stdout:3/777: symlink d7/db/d2a/d33/d59/db6/le1 0 2024-02-10T00:00:38.890 INFO:tasks.workunit.client.1.smithi183.stdout:4/965: unlink de/d14/da4/fbf 0 2024-02-10T00:00:38.890 INFO:tasks.workunit.client.1.smithi183.stdout:3/778: write d7/db/d2a/f99 [1215134,50345] 0 2024-02-10T00:00:38.910 INFO:tasks.workunit.client.0.smithi164.stdout:0/566: sync 2024-02-10T00:00:38.911 INFO:tasks.workunit.client.0.smithi164.stdout:0/567: dread - d6/d10/d18/d1c/f71 zero size 2024-02-10T00:00:38.928 INFO:tasks.workunit.client.1.smithi183.stdout:1/845: creat d0/d3/d67/d70/f121 x:0 0 0 2024-02-10T00:00:38.932 INFO:tasks.workunit.client.1.smithi183.stdout:1/846: dwrite d0/d3c/f73 [0,4194304] 0 2024-02-10T00:00:38.936 INFO:tasks.workunit.client.1.smithi183.stdout:3/779: symlink d7/d98/dc9/le2 0 2024-02-10T00:00:38.941 INFO:tasks.workunit.client.1.smithi183.stdout:3/780: dread d7/db/d2a/d8e/fdc [0,4194304] 0 2024-02-10T00:00:38.942 INFO:tasks.workunit.client.1.smithi183.stdout:5/955: dread d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d/fe9 [0,4194304] 0 2024-02-10T00:00:38.943 INFO:tasks.workunit.client.1.smithi183.stdout:5/956: dread - d4/d23/d3e/d80/da1/d9c/d72/da0/f12a zero size 2024-02-10T00:00:38.944 INFO:tasks.workunit.client.0.smithi164.stdout:9/576: mknod d6/d4b/cb2 0 2024-02-10T00:00:38.947 INFO:tasks.workunit.client.0.smithi164.stdout:3/532: rmdir d0/d1/d2/d19/d27/d5f 39 2024-02-10T00:00:38.948 INFO:tasks.workunit.client.1.smithi183.stdout:7/859: rmdir d0/d2/d4/d8/d59/d8a/d10a 0 2024-02-10T00:00:38.949 INFO:tasks.workunit.client.0.smithi164.stdout:5/662: creat d7/d17/d21/d23/d5a/d68/fd9 x:0 0 0 2024-02-10T00:00:38.951 INFO:tasks.workunit.client.0.smithi164.stdout:1/523: rename d1/d13/l6d to d1/d1a/d75/lb2 0 2024-02-10T00:00:38.953 INFO:tasks.workunit.client.0.smithi164.stdout:8/570: unlink d2/d64/f7b 0 2024-02-10T00:00:38.953 INFO:tasks.workunit.client.0.smithi164.stdout:5/663: dwrite d7/d17/d21/d24/dbc/d43/f4e [0,4194304] 0 2024-02-10T00:00:38.955 INFO:tasks.workunit.client.0.smithi164.stdout:5/664: chown d7/d17/d21/d23/d5a/d68/d1f/f4a 37 1 2024-02-10T00:00:38.955 INFO:tasks.workunit.client.1.smithi183.stdout:7/860: mkdir d0/d11/d9d/d113 0 2024-02-10T00:00:38.956 INFO:tasks.workunit.client.1.smithi183.stdout:7/861: stat d0/d11/d2f/db8/f102 0 2024-02-10T00:00:38.957 INFO:tasks.workunit.client.0.smithi164.stdout:4/592: fdatasync d2/d2f/d37/d41/d3d/d42/f63 0 2024-02-10T00:00:38.958 INFO:tasks.workunit.client.0.smithi164.stdout:9/577: mknod d6/de/cb3 0 2024-02-10T00:00:38.959 INFO:tasks.workunit.client.0.smithi164.stdout:5/665: dwrite d7/d17/d21/d23/d5a/f74 [0,4194304] 0 2024-02-10T00:00:38.967 INFO:tasks.workunit.client.0.smithi164.stdout:1/524: creat d1/d23/d61/fb3 x:0 0 0 2024-02-10T00:00:38.972 INFO:tasks.workunit.client.0.smithi164.stdout:6/660: truncate d0/d6/d95/dcd/dc3/fd5 982224 0 2024-02-10T00:00:38.972 INFO:tasks.workunit.client.0.smithi164.stdout:6/661: read d0/d6/f28 [2914165,98904] 0 2024-02-10T00:00:38.973 INFO:tasks.workunit.client.0.smithi164.stdout:4/593: symlink d2/d19/d16/d31/d7e/ld1 0 2024-02-10T00:00:38.975 INFO:tasks.workunit.client.0.smithi164.stdout:4/594: write d2/d2f/d37/d41/d3d/d42/d5f/f67 [2755899,14181] 0 2024-02-10T00:00:38.977 INFO:tasks.workunit.client.0.smithi164.stdout:1/525: symlink d1/d23/d61/d9d/lb4 0 2024-02-10T00:00:38.978 INFO:tasks.workunit.client.1.smithi183.stdout:9/920: dwrite d0/d3/d14/d1c/d2d/d4f/d79/f85 [0,4194304] 0 2024-02-10T00:00:38.978 INFO:tasks.workunit.client.1.smithi183.stdout:0/937: dwrite d14/d43/f122 [0,4194304] 0 2024-02-10T00:00:38.978 INFO:tasks.workunit.client.1.smithi183.stdout:6/837: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [0,4194304] 0 2024-02-10T00:00:38.980 INFO:tasks.workunit.client.0.smithi164.stdout:3/533: creat d0/d1/d2/d19/d27/fa2 x:0 0 0 2024-02-10T00:00:38.980 INFO:tasks.workunit.client.1.smithi183.stdout:8/977: rename d0/f2f to d0/d27/d75/f131 0 2024-02-10T00:00:38.981 INFO:tasks.workunit.client.0.smithi164.stdout:3/534: write d0/d1/d3c/d3d/d6b/f77 [609509,17603] 0 2024-02-10T00:00:38.983 INFO:tasks.workunit.client.0.smithi164.stdout:7/598: rename d3/l77 to d3/d11/d39/d44/d6f/lc0 0 2024-02-10T00:00:38.984 INFO:tasks.workunit.client.1.smithi183.stdout:6/838: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [0,4194304] 0 2024-02-10T00:00:38.987 INFO:tasks.workunit.client.0.smithi164.stdout:5/666: creat d7/d17/d21/d23/d37/fda x:0 0 0 2024-02-10T00:00:38.989 INFO:tasks.workunit.client.0.smithi164.stdout:7/599: creat d3/d26/d67/d98/fc1 x:0 0 0 2024-02-10T00:00:38.992 INFO:tasks.workunit.client.0.smithi164.stdout:6/662: rename d0/d2b/d3a/d3d/d6d/lc9 to d0/d2b/d3a/d3d/d42/d5d/d79/dbd/le2 0 2024-02-10T00:00:38.995 INFO:tasks.workunit.client.0.smithi164.stdout:7/600: rename d3/d4d/l57 to d3/d11/d39/d3a/lc2 0 2024-02-10T00:00:38.998 INFO:tasks.workunit.client.0.smithi164.stdout:7/601: mknod d3/dbf/cc3 0 2024-02-10T00:00:38.998 INFO:tasks.workunit.client.1.smithi183.stdout:4/966: creat de/d19/d8d/d112/d120/f134 x:0 0 0 2024-02-10T00:00:38.999 INFO:tasks.workunit.client.0.smithi164.stdout:6/663: truncate d0/d2b/d3a/d3d/d42/fa8 149950 0 2024-02-10T00:00:38.999 INFO:tasks.workunit.client.1.smithi183.stdout:1/847: creat d0/d3/d7/d3d/dcb/d11d/f122 x:0 0 0 2024-02-10T00:00:38.999 INFO:tasks.workunit.client.0.smithi164.stdout:7/602: symlink d3/d5/d59/lc4 0 2024-02-10T00:00:39.000 INFO:tasks.workunit.client.0.smithi164.stdout:6/664: symlink d0/d3b/d56/db3/le3 0 2024-02-10T00:00:39.001 INFO:tasks.workunit.client.1.smithi183.stdout:7/862: symlink d0/d2/d50/d5d/l114 0 2024-02-10T00:00:39.001 INFO:tasks.workunit.client.0.smithi164.stdout:7/603: readlink d3/d11/d39/d44/d6f/la2 0 2024-02-10T00:00:39.002 INFO:tasks.workunit.client.0.smithi164.stdout:7/604: chown d3/d26/d67/f86 7618 1 2024-02-10T00:00:39.006 INFO:tasks.workunit.client.0.smithi164.stdout:5/667: getdents d7/d17/d21/d23/d5a/d68 0 2024-02-10T00:00:39.006 INFO:tasks.workunit.client.0.smithi164.stdout:5/668: chown d7/d17/d21/d24/l8a 1836 1 2024-02-10T00:00:39.008 INFO:tasks.workunit.client.0.smithi164.stdout:6/665: creat d0/d6/d12/d14/fe4 x:0 0 0 2024-02-10T00:00:39.012 INFO:tasks.workunit.client.0.smithi164.stdout:6/666: readlink d0/d6/d12/d14/l1d 0 2024-02-10T00:00:39.012 INFO:tasks.workunit.client.0.smithi164.stdout:5/669: symlink d7/d17/d79/d7b/dc5/dd7/ldb 0 2024-02-10T00:00:39.012 INFO:tasks.workunit.client.0.smithi164.stdout:6/667: chown d0/d2b/d3a/dd0/d93/db4 22566 1 2024-02-10T00:00:39.013 INFO:tasks.workunit.client.0.smithi164.stdout:5/670: chown d7/d17/d21/f58 1367 1 2024-02-10T00:00:39.013 INFO:tasks.workunit.client.0.smithi164.stdout:7/605: truncate d3/d11/f18 884906 0 2024-02-10T00:00:39.013 INFO:tasks.workunit.client.0.smithi164.stdout:6/668: chown d0/d6/d12/d14/d4b/l6c 818504 1 2024-02-10T00:00:39.013 INFO:tasks.workunit.client.0.smithi164.stdout:7/606: dread - d3/d5/d59/f8c zero size 2024-02-10T00:00:39.014 INFO:tasks.workunit.client.0.smithi164.stdout:5/671: stat d7/d17/d21/d23/d37/d36/f81 0 2024-02-10T00:00:39.015 INFO:tasks.workunit.client.0.smithi164.stdout:6/669: creat d0/d3b/d56/db3/fe5 x:0 0 0 2024-02-10T00:00:39.015 INFO:tasks.workunit.client.0.smithi164.stdout:5/672: stat d7/d17/d79/d7b/dc5/dd7/fd1 0 2024-02-10T00:00:39.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/646: truncate d3/f3e 1667331 0 2024-02-10T00:00:39.017 INFO:tasks.workunit.client.0.smithi164.stdout:7/607: creat d3/d26/da7/fc5 x:0 0 0 2024-02-10T00:00:39.017 INFO:tasks.workunit.client.0.smithi164.stdout:2/647: write d3/da6/d7a/d8e/db6/db8/fd0 [782011,49836] 0 2024-02-10T00:00:39.017 INFO:tasks.workunit.client.1.smithi183.stdout:4/967: symlink de/d14/da4/l135 0 2024-02-10T00:00:39.017 INFO:tasks.workunit.client.0.smithi164.stdout:2/648: fdatasync d3/f73 0 2024-02-10T00:00:39.018 INFO:tasks.workunit.client.0.smithi164.stdout:2/649: chown d3/d32/d4e/ld2 127 1 2024-02-10T00:00:39.018 INFO:tasks.workunit.client.0.smithi164.stdout:6/670: creat d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 x:0 0 0 2024-02-10T00:00:39.020 INFO:tasks.workunit.client.0.smithi164.stdout:5/673: rename d7/d17/d21/d23/d5a/d68/f7c to d7/d17/d79/fdc 0 2024-02-10T00:00:39.021 INFO:tasks.workunit.client.1.smithi183.stdout:6/839: dread d2/d1a/f6f [0,4194304] 0 2024-02-10T00:00:39.022 INFO:tasks.workunit.client.0.smithi164.stdout:0/568: dread d6/d3a/d52/f75 [0,4194304] 0 2024-02-10T00:00:39.023 INFO:tasks.workunit.client.1.smithi183.stdout:6/840: write d2/d1a/d25/d3c/d31/d38/d87/f7c [621393,114953] 0 2024-02-10T00:00:39.023 INFO:tasks.workunit.client.0.smithi164.stdout:9/578: write d6/de/d22/f30 [1252489,33757] 0 2024-02-10T00:00:39.023 INFO:tasks.workunit.client.0.smithi164.stdout:0/569: read - d6/d10/d4a/d60/fac zero size 2024-02-10T00:00:39.024 INFO:tasks.workunit.client.1.smithi183.stdout:6/841: readlink d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/le7 0 2024-02-10T00:00:39.024 INFO:tasks.workunit.client.0.smithi164.stdout:9/579: readlink d6/de/d40/d74/l7a 0 2024-02-10T00:00:39.025 INFO:tasks.workunit.client.0.smithi164.stdout:8/571: truncate d2/f67 4191601 0 2024-02-10T00:00:39.026 INFO:tasks.workunit.client.0.smithi164.stdout:8/572: stat d2/d64/d7d 0 2024-02-10T00:00:39.027 INFO:tasks.workunit.client.0.smithi164.stdout:7/608: mknod d3/d26/d67/cc6 0 2024-02-10T00:00:39.027 INFO:tasks.workunit.client.0.smithi164.stdout:1/526: write d1/d13/d2b/d52/f5d [5141618,38299] 0 2024-02-10T00:00:39.031 INFO:tasks.workunit.client.1.smithi183.stdout:5/957: dwrite d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/fb0 [0,4194304] 0 2024-02-10T00:00:39.031 INFO:tasks.workunit.client.1.smithi183.stdout:9/921: dwrite d0/d3/d14/d1c/d2d/d4f/d79/f11c [0,4194304] 0 2024-02-10T00:00:39.032 INFO:tasks.workunit.client.1.smithi183.stdout:0/938: link d14/d1d/d59/d3c/dc0/le5 d14/d1d/d2d/l14d 0 2024-02-10T00:00:39.035 INFO:tasks.workunit.client.1.smithi183.stdout:3/781: rename d7/f30 to d7/db/d2a/d33/d59/fe3 0 2024-02-10T00:00:39.037 INFO:tasks.workunit.client.1.smithi183.stdout:8/978: rmdir d0/d3f/d94/d128 0 2024-02-10T00:00:39.040 INFO:tasks.workunit.client.1.smithi183.stdout:7/863: truncate d0/d11/d2f/d64/f93 1190104 0 2024-02-10T00:00:39.041 INFO:tasks.workunit.client.0.smithi164.stdout:6/671: symlink d0/d2b/d3a/d3d/d6d/le7 0 2024-02-10T00:00:39.042 INFO:tasks.workunit.client.1.smithi183.stdout:4/968: dwrite de/d14/d27/d2e/fc2 [0,4194304] 0 2024-02-10T00:00:39.044 INFO:tasks.workunit.client.1.smithi183.stdout:6/842: dwrite d2/d1a/d25/d3c/d31/d38/f5d [0,4194304] 0 2024-02-10T00:00:39.044 INFO:tasks.workunit.client.1.smithi183.stdout:5/958: mknod d4/d23/d3e/d80/da1/d9e/d27/d37/c134 0 2024-02-10T00:00:39.045 INFO:tasks.workunit.client.1.smithi183.stdout:5/959: readlink d4/l3a 0 2024-02-10T00:00:39.046 INFO:tasks.workunit.client.0.smithi164.stdout:2/650: rename d3/da6/d7a/d8e/d36/c9b to d3/da6/d7a/d8e/d8a/ce9 0 2024-02-10T00:00:39.046 INFO:tasks.workunit.client.0.smithi164.stdout:4/595: sync 2024-02-10T00:00:39.046 INFO:tasks.workunit.client.0.smithi164.stdout:5/674: rmdir d7/d17/d21/d24/dbc/d45/d5c 39 2024-02-10T00:00:39.047 INFO:tasks.workunit.client.0.smithi164.stdout:9/580: symlink d6/de/d40/d74/lb4 0 2024-02-10T00:00:39.048 INFO:tasks.workunit.client.0.smithi164.stdout:9/581: write d6/de/d22/f26 [6099348,30831] 0 2024-02-10T00:00:39.051 INFO:tasks.workunit.client.1.smithi183.stdout:3/782: write d7/db/d2a/f99 [1855807,27137] 0 2024-02-10T00:00:39.053 INFO:tasks.workunit.client.0.smithi164.stdout:6/672: creat d0/d6/d12/d14/d4b/dbf/fe8 x:0 0 0 2024-02-10T00:00:39.053 INFO:tasks.workunit.client.0.smithi164.stdout:0/570: getdents d6/d10/d66 0 2024-02-10T00:00:39.055 INFO:tasks.workunit.client.0.smithi164.stdout:4/596: unlink d2/d2f/d37/d41/d3d/d42/d5f/f67 0 2024-02-10T00:00:39.056 INFO:tasks.workunit.client.1.smithi183.stdout:9/922: link d0/d3/c1a d0/d3/d14/d1c/d2d/c125 0 2024-02-10T00:00:39.057 INFO:tasks.workunit.client.0.smithi164.stdout:4/597: write d2/d2f/d37/d41/d69/fb6 [303480,115308] 0 2024-02-10T00:00:39.057 INFO:tasks.workunit.client.0.smithi164.stdout:4/598: write d2/d19/d16/f88 [630067,33604] 0 2024-02-10T00:00:39.058 INFO:tasks.workunit.client.1.smithi183.stdout:0/939: creat d14/d1d/d59/f14e x:0 0 0 2024-02-10T00:00:39.058 INFO:tasks.workunit.client.1.smithi183.stdout:4/969: mknod de/d19/d20/c136 0 2024-02-10T00:00:39.059 INFO:tasks.workunit.client.0.smithi164.stdout:5/675: rename d7/d17/d79/d7b/dc5/dd7/cb5 to d7/d17/d21/d24/dbc/d45/db3/cdd 0 2024-02-10T00:00:39.059 INFO:tasks.workunit.client.1.smithi183.stdout:6/843: fsync d2/d1a/d25/d3c/d31/d38/d6e/f2e 0 2024-02-10T00:00:39.059 INFO:tasks.workunit.client.0.smithi164.stdout:5/676: read d7/d17/d69/d92/fc2 [3635187,50204] 0 2024-02-10T00:00:39.060 INFO:tasks.workunit.client.1.smithi183.stdout:6/844: write d2/d1a/d25/d3c/d8d/ff0 [578610,94227] 0 2024-02-10T00:00:39.061 INFO:tasks.workunit.client.0.smithi164.stdout:9/582: write d6/fc [4272522,103569] 0 2024-02-10T00:00:39.061 INFO:tasks.workunit.client.0.smithi164.stdout:6/673: stat d0/d6/d12/d45/f65 0 2024-02-10T00:00:39.062 INFO:tasks.workunit.client.1.smithi183.stdout:1/848: sync 2024-02-10T00:00:39.062 INFO:tasks.workunit.client.0.smithi164.stdout:6/674: chown d0/d2b/d3a/f55 58750253 1 2024-02-10T00:00:39.062 INFO:tasks.workunit.client.1.smithi183.stdout:5/960: creat d4/d23/d3e/d80/da1/d9e/d27/d38/d132/f135 x:0 0 0 2024-02-10T00:00:39.063 INFO:tasks.workunit.client.1.smithi183.stdout:5/961: fsync d4/d23/d2a/fd8 0 2024-02-10T00:00:39.064 INFO:tasks.workunit.client.1.smithi183.stdout:1/849: write d0/d3/d67/d7b/dfe/f25 [1838500,95834] 0 2024-02-10T00:00:39.064 INFO:tasks.workunit.client.0.smithi164.stdout:8/573: creat d2/d64/d65/d80/fb1 x:0 0 0 2024-02-10T00:00:39.066 INFO:tasks.workunit.client.1.smithi183.stdout:1/850: chown d0/d3a/dd8/f11f 24940848 1 2024-02-10T00:00:39.066 INFO:tasks.workunit.client.1.smithi183.stdout:4/970: creat de/d14/d1d/d7b/dcb/f137 x:0 0 0 2024-02-10T00:00:39.066 INFO:tasks.workunit.client.0.smithi164.stdout:8/574: dread - d2/d64/d54/f7c zero size 2024-02-10T00:00:39.066 INFO:tasks.workunit.client.0.smithi164.stdout:7/609: dread d3/d11/d39/d44/fad [0,4194304] 0 2024-02-10T00:00:39.066 INFO:tasks.workunit.client.0.smithi164.stdout:4/599: fsync d2/d2f/d37/d41/d3d/d42/d5f/fad 0 2024-02-10T00:00:39.068 INFO:tasks.workunit.client.1.smithi183.stdout:8/979: link d0/d10/d9e/da4/fd2 d0/f132 0 2024-02-10T00:00:39.068 INFO:tasks.workunit.client.1.smithi183.stdout:8/980: write d0/d3f/db2/d24/fd3 [185379,61807] 0 2024-02-10T00:00:39.069 INFO:tasks.workunit.client.0.smithi164.stdout:0/571: dwrite d6/d10/d18/d1c/f2c [0,4194304] 0 2024-02-10T00:00:39.069 INFO:tasks.workunit.client.1.smithi183.stdout:0/940: dread d14/d1d/d59/d71/db4/fd3 [0,4194304] 0 2024-02-10T00:00:39.070 INFO:tasks.workunit.client.0.smithi164.stdout:5/677: mkdir d7/d17/d79/dde 0 2024-02-10T00:00:39.072 INFO:tasks.workunit.client.0.smithi164.stdout:9/583: mknod d6/d41/cb5 0 2024-02-10T00:00:39.073 INFO:tasks.workunit.client.0.smithi164.stdout:6/675: chown d0/l35 1829 1 2024-02-10T00:00:39.074 INFO:tasks.workunit.client.1.smithi183.stdout:1/851: mknod d0/d3/d7/d3d/dcb/d11d/c123 0 2024-02-10T00:00:39.074 INFO:tasks.workunit.client.1.smithi183.stdout:4/971: mknod de/d19/d8d/c138 0 2024-02-10T00:00:39.075 INFO:tasks.workunit.client.1.smithi183.stdout:9/923: dread d0/d3/d14/d1c/d2d/d4f/fb1 [4194304,4194304] 0 2024-02-10T00:00:39.075 INFO:tasks.workunit.client.1.smithi183.stdout:4/972: chown de/d22/lb3 1120115 1 2024-02-10T00:00:39.076 INFO:tasks.workunit.client.0.smithi164.stdout:7/610: mknod d3/d26/d67/d98/daf/cc7 0 2024-02-10T00:00:39.081 INFO:tasks.workunit.client.0.smithi164.stdout:1/527: truncate d1/d23/f97 210371 0 2024-02-10T00:00:39.082 INFO:tasks.workunit.client.1.smithi183.stdout:9/924: dwrite d0/d10/fe3 [0,4194304] 0 2024-02-10T00:00:39.082 INFO:tasks.workunit.client.1.smithi183.stdout:4/973: dwrite de/d19/d20/f122 [0,4194304] 0 2024-02-10T00:00:39.085 INFO:tasks.workunit.client.0.smithi164.stdout:4/600: mknod d2/d2f/d37/d41/d3d/d56/cd2 0 2024-02-10T00:00:39.086 INFO:tasks.workunit.client.1.smithi183.stdout:0/941: creat d14/d1d/d59/d71/dcb/f14f x:0 0 0 2024-02-10T00:00:39.087 INFO:tasks.workunit.client.0.smithi164.stdout:3/535: sync 2024-02-10T00:00:39.088 INFO:tasks.workunit.client.1.smithi183.stdout:6/845: creat d2/d1a/d25/f109 x:0 0 0 2024-02-10T00:00:39.089 INFO:tasks.workunit.client.0.smithi164.stdout:2/651: getdents d3/d24/d5b 0 2024-02-10T00:00:39.089 INFO:tasks.workunit.client.1.smithi183.stdout:9/925: rmdir d0/d30/d52/ddc 39 2024-02-10T00:00:39.089 INFO:tasks.workunit.client.1.smithi183.stdout:1/852: dread d0/d3/d7/d3d/f5b [0,4194304] 0 2024-02-10T00:00:39.094 INFO:tasks.workunit.client.0.smithi164.stdout:8/575: mkdir d2/d64/d65/d80/d32/db2 0 2024-02-10T00:00:39.094 INFO:tasks.workunit.client.0.smithi164.stdout:1/528: creat d1/d13/d80/fb5 x:0 0 0 2024-02-10T00:00:39.095 INFO:tasks.workunit.client.0.smithi164.stdout:1/529: chown d1/f11 642077 1 2024-02-10T00:00:39.095 INFO:tasks.workunit.client.1.smithi183.stdout:7/864: dread d0/f44 [0,4194304] 0 2024-02-10T00:00:39.096 INFO:tasks.workunit.client.1.smithi183.stdout:5/962: link d4/dd/d31/lec d4/d23/d3e/d80/da1/d9e/d27/d5d/l136 0 2024-02-10T00:00:39.097 INFO:tasks.workunit.client.0.smithi164.stdout:8/576: dwrite d2/d64/f97 [0,4194304] 0 2024-02-10T00:00:39.098 INFO:tasks.workunit.client.0.smithi164.stdout:0/572: mknod d6/caf 0 2024-02-10T00:00:39.098 INFO:tasks.workunit.client.1.smithi183.stdout:0/942: creat d14/d1d/d2d/d11a/f150 x:0 0 0 2024-02-10T00:00:39.101 INFO:tasks.workunit.client.1.smithi183.stdout:1/853: creat d0/d3/d67/d70/f124 x:0 0 0 2024-02-10T00:00:39.102 INFO:tasks.workunit.client.1.smithi183.stdout:7/865: dread d0/d2/d50/ff1 [0,4194304] 0 2024-02-10T00:00:39.102 INFO:tasks.workunit.client.0.smithi164.stdout:5/678: write d7/d17/d21/d85/fc7 [5075607,68133] 0 2024-02-10T00:00:39.103 INFO:tasks.workunit.client.0.smithi164.stdout:8/577: dwrite d2/d64/d65/d80/d82/fa2 [0,4194304] 0 2024-02-10T00:00:39.104 INFO:tasks.workunit.client.0.smithi164.stdout:8/578: chown d2/d64/d65/d80/d32/d99/da0/cae 1735 1 2024-02-10T00:00:39.104 INFO:tasks.workunit.client.0.smithi164.stdout:6/676: truncate d0/d6/d12/f67 1443322 0 2024-02-10T00:00:39.105 INFO:tasks.workunit.client.1.smithi183.stdout:4/974: truncate de/d14/d1d/d7b/dcb/fe1 925700 0 2024-02-10T00:00:39.105 INFO:tasks.workunit.client.0.smithi164.stdout:8/579: dread d2/d64/f51 [0,4194304] 0 2024-02-10T00:00:39.110 INFO:tasks.workunit.client.1.smithi183.stdout:3/783: truncate d7/db/d2a/f3a 1286997 0 2024-02-10T00:00:39.111 INFO:tasks.workunit.client.0.smithi164.stdout:3/536: dwrite d0/d1/dd/f52 [0,4194304] 0 2024-02-10T00:00:39.111 INFO:tasks.workunit.client.0.smithi164.stdout:7/611: link d3/d11/d39/d44/d48/d50/l6c d3/d11/lc8 0 2024-02-10T00:00:39.112 INFO:tasks.workunit.client.1.smithi183.stdout:1/854: readlink d0/d3/d7/d3d/dcb/l107 0 2024-02-10T00:00:39.114 INFO:tasks.workunit.client.1.smithi183.stdout:5/963: mkdir d4/d10c/d131/d137 0 2024-02-10T00:00:39.114 INFO:tasks.workunit.client.0.smithi164.stdout:2/652: creat d3/d32/fea x:0 0 0 2024-02-10T00:00:39.115 INFO:tasks.workunit.client.0.smithi164.stdout:5/679: mknod d7/d17/d21/d23/d5a/d68/d1f/cdf 0 2024-02-10T00:00:39.115 INFO:tasks.workunit.client.0.smithi164.stdout:9/584: write d6/de/f14 [111974,120027] 0 2024-02-10T00:00:39.117 INFO:tasks.workunit.client.1.smithi183.stdout:1/855: truncate d0/d3/d7/d3d/d60/d89/fbd 445906 0 2024-02-10T00:00:39.117 INFO:tasks.workunit.client.0.smithi164.stdout:1/530: creat d1/d1a/d41/d18/fb6 x:0 0 0 2024-02-10T00:00:39.118 INFO:tasks.workunit.client.0.smithi164.stdout:1/531: stat d1/d13/d2b/d52/c48 0 2024-02-10T00:00:39.118 INFO:tasks.workunit.client.0.smithi164.stdout:7/612: symlink d3/d26/d67/lc9 0 2024-02-10T00:00:39.120 INFO:tasks.workunit.client.1.smithi183.stdout:5/964: link d4/dd/d31/d73/f107 d4/d23/d3e/d80/da1/d9e/d27/d38/d4f/f138 0 2024-02-10T00:00:39.120 INFO:tasks.workunit.client.0.smithi164.stdout:4/601: write d2/d19/d16/d31/f36 [1554232,85601] 0 2024-02-10T00:00:39.121 INFO:tasks.workunit.client.0.smithi164.stdout:4/602: write d2/f5e [1884910,81308] 0 2024-02-10T00:00:39.122 INFO:tasks.workunit.client.0.smithi164.stdout:9/585: mkdir d6/de/d40/db6 0 2024-02-10T00:00:39.123 INFO:tasks.workunit.client.0.smithi164.stdout:9/586: fdatasync d6/de/d40/f9f 0 2024-02-10T00:00:39.124 INFO:tasks.workunit.client.0.smithi164.stdout:7/613: dwrite d3/d26/d67/d98/fc1 [0,4194304] 0 2024-02-10T00:00:39.125 INFO:tasks.workunit.client.0.smithi164.stdout:8/580: getdents d2/d64/d65/d80/d32/d93 0 2024-02-10T00:00:39.127 INFO:tasks.workunit.client.0.smithi164.stdout:4/603: mknod d2/d2f/d37/d41/cd3 0 2024-02-10T00:00:39.127 INFO:tasks.workunit.client.0.smithi164.stdout:8/581: write d2/d64/d65/d80/fb1 [450675,85301] 0 2024-02-10T00:00:39.128 INFO:tasks.workunit.client.0.smithi164.stdout:1/532: truncate d1/d1a/d41/f58 209935 0 2024-02-10T00:00:39.130 INFO:tasks.workunit.client.0.smithi164.stdout:7/614: symlink d3/d26/d67/d98/daf/lca 0 2024-02-10T00:00:39.132 INFO:tasks.workunit.client.1.smithi183.stdout:1/856: fsync d0/d3/d67/d70/f124 0 2024-02-10T00:00:39.134 INFO:tasks.workunit.client.0.smithi164.stdout:9/587: rename d6/d4b to d6/de/d2b/d5b/d61/d76/d82/db7 0 2024-02-10T00:00:39.134 INFO:tasks.workunit.client.0.smithi164.stdout:2/653: getdents d3/da6/d7a/d8e/d36/dbd 0 2024-02-10T00:00:39.135 INFO:tasks.workunit.client.1.smithi183.stdout:9/926: write d0/d3/f4e [280176,8436] 0 2024-02-10T00:00:39.136 INFO:tasks.workunit.client.0.smithi164.stdout:4/604: mknod d2/d19/d16/daa/cd4 0 2024-02-10T00:00:39.136 INFO:tasks.workunit.client.1.smithi183.stdout:6/846: dwrite d2/d1a/d25/d3c/d31/f8a [0,4194304] 0 2024-02-10T00:00:39.136 INFO:tasks.workunit.client.1.smithi183.stdout:1/857: write d0/d3/d67/d70/f124 [900766,123852] 0 2024-02-10T00:00:39.137 INFO:tasks.workunit.client.0.smithi164.stdout:8/582: mknod d2/d64/d54/d71/cb3 0 2024-02-10T00:00:39.139 INFO:tasks.workunit.client.0.smithi164.stdout:1/533: rename d1/d13/d2b/d52/da6 to d1/d13/d2b/d52/db7 0 2024-02-10T00:00:39.139 INFO:tasks.workunit.client.1.smithi183.stdout:4/975: rename de/d14/d1d/d7b to de/d14/d1d/d2f/d139 0 2024-02-10T00:00:39.139 INFO:tasks.workunit.client.1.smithi183.stdout:6/847: chown d2/d1a/d25/d3c/d31/l105 5 1 2024-02-10T00:00:39.139 INFO:tasks.workunit.client.1.smithi183.stdout:0/943: dwrite d14/d1d/d2d/d31/fcd [0,4194304] 0 2024-02-10T00:00:39.140 INFO:tasks.workunit.client.0.smithi164.stdout:3/537: dread d0/d1/d2/d17/d37/f69 [0,4194304] 0 2024-02-10T00:00:39.140 INFO:tasks.workunit.client.0.smithi164.stdout:7/615: mknod d3/d11/d39/ccb 0 2024-02-10T00:00:39.141 INFO:tasks.workunit.client.0.smithi164.stdout:2/654: dwrite d3/d26/fb0 [0,4194304] 0 2024-02-10T00:00:39.142 INFO:tasks.workunit.client.1.smithi183.stdout:4/976: chown de/d14/d1d/d2f/da2/d9c/df5/d117 618510 1 2024-02-10T00:00:39.142 INFO:tasks.workunit.client.1.smithi183.stdout:0/944: dread - d14/d3e/d5f/daa/ddd/f141 zero size 2024-02-10T00:00:39.143 INFO:tasks.workunit.client.0.smithi164.stdout:4/605: rename d2/d2f/d37/d71/f79 to d2/d19/d16/d31/d6d/fd5 0 2024-02-10T00:00:39.144 INFO:tasks.workunit.client.0.smithi164.stdout:0/573: truncate d6/d7/d14/f1b 8583 0 2024-02-10T00:00:39.144 INFO:tasks.workunit.client.0.smithi164.stdout:7/616: read d3/d11/f82 [4004749,61726] 0 2024-02-10T00:00:39.145 INFO:tasks.workunit.client.1.smithi183.stdout:5/965: rename d4/dd/f1b to d4/d23/d3e/d80/da1/d9e/d89/dd4/deb/f139 0 2024-02-10T00:00:39.145 INFO:tasks.workunit.client.0.smithi164.stdout:0/574: chown d6/l1a 620 1 2024-02-10T00:00:39.146 INFO:tasks.workunit.client.1.smithi183.stdout:6/848: truncate d2/f18 655593 0 2024-02-10T00:00:39.146 INFO:tasks.workunit.client.1.smithi183.stdout:7/866: dwrite d0/d11/d3e/f7c [0,4194304] 0 2024-02-10T00:00:39.146 INFO:tasks.workunit.client.0.smithi164.stdout:6/677: truncate d0/f5 4099163 0 2024-02-10T00:00:39.147 INFO:tasks.workunit.client.1.smithi183.stdout:1/858: mkdir d0/d3/d7/d3d/d125 0 2024-02-10T00:00:39.148 INFO:tasks.workunit.client.1.smithi183.stdout:5/966: write d4/d23/d3e/d80/d96/f126 [524909,126701] 0 2024-02-10T00:00:39.148 INFO:tasks.workunit.client.1.smithi183.stdout:6/849: readlink d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/ld9 0 2024-02-10T00:00:39.149 INFO:tasks.workunit.client.1.smithi183.stdout:6/850: read - d2/ffa zero size 2024-02-10T00:00:39.151 INFO:tasks.workunit.client.0.smithi164.stdout:6/678: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 [0,4194304] 0 2024-02-10T00:00:39.151 INFO:tasks.workunit.client.1.smithi183.stdout:8/981: sync 2024-02-10T00:00:39.152 INFO:tasks.workunit.client.1.smithi183.stdout:7/867: dwrite d0/d11/d2f/db8/ded/ffd [0,4194304] 0 2024-02-10T00:00:39.156 INFO:tasks.workunit.client.1.smithi183.stdout:0/945: link d14/d1d/f2b d14/d3e/d5f/daa/de6/f151 0 2024-02-10T00:00:39.157 INFO:tasks.workunit.client.0.smithi164.stdout:7/617: rename d3/d11/d39/d44/d48/fa4 to d3/d4d/d5d/fcc 0 2024-02-10T00:00:39.158 INFO:tasks.workunit.client.1.smithi183.stdout:9/927: getdents d0/d30/d52 0 2024-02-10T00:00:39.158 INFO:tasks.workunit.client.1.smithi183.stdout:0/946: stat d14/d1d/d55/dfa/c140 0 2024-02-10T00:00:39.159 INFO:tasks.workunit.client.1.smithi183.stdout:7/868: dwrite d0/d11/d3e/f49 [0,4194304] 0 2024-02-10T00:00:39.159 INFO:tasks.workunit.client.1.smithi183.stdout:6/851: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/dee/f10a x:0 0 0 2024-02-10T00:00:39.160 INFO:tasks.workunit.client.0.smithi164.stdout:9/588: link d6/de/d2b/d5b/d61/l8e d6/de/d2b/lb8 0 2024-02-10T00:00:39.160 INFO:tasks.workunit.client.1.smithi183.stdout:7/869: write d0/d11/d9d/fe8 [44960,116064] 0 2024-02-10T00:00:39.160 INFO:tasks.workunit.client.0.smithi164.stdout:6/679: mkdir d0/d6/d81/de9 0 2024-02-10T00:00:39.161 INFO:tasks.workunit.client.0.smithi164.stdout:8/583: link d2/d64/d65/c9b d2/d64/d65/da9/cb4 0 2024-02-10T00:00:39.163 INFO:tasks.workunit.client.0.smithi164.stdout:7/618: readlink d3/d5/d9b/lac 0 2024-02-10T00:00:39.164 INFO:tasks.workunit.client.0.smithi164.stdout:9/589: mknod d6/de/d2b/d5b/cb9 0 2024-02-10T00:00:39.164 INFO:tasks.workunit.client.1.smithi183.stdout:8/982: symlink d0/d11f/d12d/l133 0 2024-02-10T00:00:39.165 INFO:tasks.workunit.client.1.smithi183.stdout:0/947: mknod d14/d1d/d55/d6e/d74/c152 0 2024-02-10T00:00:39.166 INFO:tasks.workunit.client.0.smithi164.stdout:1/534: truncate d1/d1a/d41/d18/f30 1096479 0 2024-02-10T00:00:39.166 INFO:tasks.workunit.client.0.smithi164.stdout:7/619: truncate d3/d11/d39/d3a/f7d 1500941 0 2024-02-10T00:00:39.168 INFO:tasks.workunit.client.0.smithi164.stdout:2/655: truncate d3/d32/d4e/d27/f28 1380785 0 2024-02-10T00:00:39.168 INFO:tasks.workunit.client.1.smithi183.stdout:5/967: rename d4/d23/d4a/c11a to d4/d23/d3e/d80/da1/d9e/d27/d38/c13a 0 2024-02-10T00:00:39.169 INFO:tasks.workunit.client.0.smithi164.stdout:9/590: dwrite d6/de/d2b/f3c [0,4194304] 0 2024-02-10T00:00:39.169 INFO:tasks.workunit.client.1.smithi183.stdout:7/870: readlink d0/d11/d3e/l63 0 2024-02-10T00:00:39.170 INFO:tasks.workunit.client.1.smithi183.stdout:8/983: read d0/d27/f44 [2202644,31358] 0 2024-02-10T00:00:39.170 INFO:tasks.workunit.client.1.smithi183.stdout:3/784: sync 2024-02-10T00:00:39.173 INFO:tasks.workunit.client.1.smithi183.stdout:9/928: getdents d0/d92 0 2024-02-10T00:00:39.173 INFO:tasks.workunit.client.1.smithi183.stdout:9/929: dread - d0/d3/d14/d3c/d7b/fd3 zero size 2024-02-10T00:00:39.174 INFO:tasks.workunit.client.1.smithi183.stdout:8/984: unlink d0/c10b 0 2024-02-10T00:00:39.176 INFO:tasks.workunit.client.1.smithi183.stdout:7/871: mknod d0/d11/d2f/db8/ded/c115 0 2024-02-10T00:00:39.179 INFO:tasks.workunit.client.0.smithi164.stdout:7/620: rmdir d3/d11/d39/d44/d6f/d75/db9 0 2024-02-10T00:00:39.181 INFO:tasks.workunit.client.1.smithi183.stdout:9/930: mkdir d0/d3/d14/d1c/d126 0 2024-02-10T00:00:39.183 INFO:tasks.workunit.client.0.smithi164.stdout:7/621: dwrite d3/d11/f23 [0,4194304] 0 2024-02-10T00:00:39.183 INFO:tasks.workunit.client.0.smithi164.stdout:0/575: dread d6/d10/d4a/d60/d6c/f46 [0,4194304] 0 2024-02-10T00:00:39.184 INFO:tasks.workunit.client.1.smithi183.stdout:8/985: rename d0/fc2 to d0/d23/db1/d130/f134 0 2024-02-10T00:00:39.184 INFO:tasks.workunit.client.1.smithi183.stdout:8/986: stat d0/d23/l105 0 2024-02-10T00:00:39.185 INFO:tasks.workunit.client.0.smithi164.stdout:0/576: chown d6/d10/f69 2616 1 2024-02-10T00:00:39.185 INFO:tasks.workunit.client.1.smithi183.stdout:5/968: getdents d4/d23/d3e/d80/da1/d9e/d27/d5d/d6d 0 2024-02-10T00:00:39.186 INFO:tasks.workunit.client.0.smithi164.stdout:7/622: mknod d3/dbf/ccd 0 2024-02-10T00:00:39.187 INFO:tasks.workunit.client.1.smithi183.stdout:8/987: creat d0/d27/dfe/f135 x:0 0 0 2024-02-10T00:00:39.187 INFO:tasks.workunit.client.0.smithi164.stdout:2/656: dread d3/fe [0,4194304] 0 2024-02-10T00:00:39.188 INFO:tasks.workunit.client.1.smithi183.stdout:5/969: creat d4/d23/d3e/d80/da1/d9e/d27/d37/f13b x:0 0 0 2024-02-10T00:00:39.189 INFO:tasks.workunit.client.1.smithi183.stdout:9/931: getdents d0/d3/d14/d1c/d2d/d4f/da4 0 2024-02-10T00:00:39.190 INFO:tasks.workunit.client.1.smithi183.stdout:8/988: symlink d0/d10/d9e/l136 0 2024-02-10T00:00:39.190 INFO:tasks.workunit.client.0.smithi164.stdout:7/623: creat d3/d5/d59/fce x:0 0 0 2024-02-10T00:00:39.191 INFO:tasks.workunit.client.0.smithi164.stdout:7/624: write d3/d5/fe [3686716,109091] 0 2024-02-10T00:00:39.192 INFO:tasks.workunit.client.1.smithi183.stdout:5/970: mkdir d4/d23/d3e/d80/d96/d13c 0 2024-02-10T00:00:39.193 INFO:tasks.workunit.client.1.smithi183.stdout:9/932: mkdir d0/d3/d14/d1c/d2d/d4f/d89/dc5/d127 0 2024-02-10T00:00:39.194 INFO:tasks.workunit.client.0.smithi164.stdout:2/657: rmdir d3/da6/d7a/d8e/d88/ddc 0 2024-02-10T00:00:39.195 INFO:tasks.workunit.client.1.smithi183.stdout:5/971: creat d4/d23/d3e/d80/d96/dd9/f13d x:0 0 0 2024-02-10T00:00:39.195 INFO:tasks.workunit.client.1.smithi183.stdout:5/972: fsync d4/d23/dc4/fdf 0 2024-02-10T00:00:39.195 INFO:tasks.workunit.client.0.smithi164.stdout:7/625: mkdir d3/d5/d2b/dab/dcf 0 2024-02-10T00:00:39.196 INFO:tasks.workunit.client.1.smithi183.stdout:9/933: creat d0/d3/d14/d1c/d2d/d4f/d89/dc5/f128 x:0 0 0 2024-02-10T00:00:39.196 INFO:tasks.workunit.client.0.smithi164.stdout:7/626: write d3/d11/d39/d44/d48/d50/d92/f99 [2670688,14634] 0 2024-02-10T00:00:39.197 INFO:tasks.workunit.client.1.smithi183.stdout:5/973: readlink d4/d23/l68 0 2024-02-10T00:00:39.197 INFO:tasks.workunit.client.0.smithi164.stdout:7/627: chown d3/d5/d59/lc4 103 1 2024-02-10T00:00:39.197 INFO:tasks.workunit.client.0.smithi164.stdout:2/658: unlink d3/d32/d4e/fc9 0 2024-02-10T00:00:39.199 INFO:tasks.workunit.client.1.smithi183.stdout:9/934: truncate d0/d3/d14/d74/fd4 866612 0 2024-02-10T00:00:39.200 INFO:tasks.workunit.client.1.smithi183.stdout:9/935: chown d0/d3/d14/d74/da8 108346 1 2024-02-10T00:00:39.201 INFO:tasks.workunit.client.1.smithi183.stdout:5/974: dwrite d4/dd/f75 [0,4194304] 0 2024-02-10T00:00:39.201 INFO:tasks.workunit.client.0.smithi164.stdout:7/628: creat d3/d11/d39/d44/fd0 x:0 0 0 2024-02-10T00:00:39.202 INFO:tasks.workunit.client.0.smithi164.stdout:2/659: link d3/d26/l53 d3/da6/d7a/d8e/d8a/dc8/leb 0 2024-02-10T00:00:39.204 INFO:tasks.workunit.client.0.smithi164.stdout:2/660: fdatasync d3/da6/d7a/d8e/f41 0 2024-02-10T00:00:39.208 INFO:tasks.workunit.client.0.smithi164.stdout:2/661: symlink d3/da6/d7a/d8e/d36/lec 0 2024-02-10T00:00:39.209 INFO:tasks.workunit.client.1.smithi183.stdout:5/975: link d4/d23/d3e/d80/d96/ccd d4/d23/d3e/d80/da1/d9e/d27/d37/c13e 0 2024-02-10T00:00:39.211 INFO:tasks.workunit.client.1.smithi183.stdout:5/976: creat d4/d10c/d131/f13f x:0 0 0 2024-02-10T00:00:39.212 INFO:tasks.workunit.client.0.smithi164.stdout:7/629: dread d3/f1d [0,4194304] 0 2024-02-10T00:00:39.213 INFO:tasks.workunit.client.1.smithi183.stdout:5/977: write d4/d23/d3e/d80/da1/d9e/d89/dd4/deb/f100 [1391169,91402] 0 2024-02-10T00:00:39.213 INFO:tasks.workunit.client.0.smithi164.stdout:2/662: link d3/da6/d7a/d8e/d36/lec d3/d24/led 0 2024-02-10T00:00:39.214 INFO:tasks.workunit.client.0.smithi164.stdout:2/663: write d3/d32/fe2 [616110,24326] 0 2024-02-10T00:00:39.215 INFO:tasks.workunit.client.0.smithi164.stdout:7/630: creat d3/d11/d39/d44/d6f/d75/fd1 x:0 0 0 2024-02-10T00:00:39.216 INFO:tasks.workunit.client.1.smithi183.stdout:5/978: mkdir d4/dd/d31/d73/d140 0 2024-02-10T00:00:39.216 INFO:tasks.workunit.client.0.smithi164.stdout:3/538: dread d0/d1/d3c/f63 [0,4194304] 0 2024-02-10T00:00:39.218 INFO:tasks.workunit.client.1.smithi183.stdout:5/979: mknod d4/d10c/c141 0 2024-02-10T00:00:39.218 INFO:tasks.workunit.client.0.smithi164.stdout:7/631: creat d3/d5/d9b/daa/fd2 x:0 0 0 2024-02-10T00:00:39.218 INFO:tasks.workunit.client.0.smithi164.stdout:7/632: read - d3/d28/fa9 zero size 2024-02-10T00:00:39.219 INFO:tasks.workunit.client.1.smithi183.stdout:5/980: creat d4/d10c/d131/f142 x:0 0 0 2024-02-10T00:00:39.222 INFO:tasks.workunit.client.0.smithi164.stdout:7/633: creat d3/d11/d39/d44/d6f/fd3 x:0 0 0 2024-02-10T00:00:39.222 INFO:tasks.workunit.client.1.smithi183.stdout:5/981: truncate d4/d23/d3e/d80/da1/d9e/d27/d37/d46/f6c 1686534 0 2024-02-10T00:00:39.224 INFO:tasks.workunit.client.1.smithi183.stdout:5/982: symlink d4/d23/d3e/d80/da1/d9e/d27/d5d/l143 0 2024-02-10T00:00:39.227 INFO:tasks.workunit.client.0.smithi164.stdout:5/680: sync 2024-02-10T00:00:39.228 INFO:tasks.workunit.client.1.smithi183.stdout:5/983: dwrite f1 [0,4194304] 0 2024-02-10T00:00:39.231 INFO:tasks.workunit.client.1.smithi183.stdout:5/984: rmdir d4/dd/d31 39 2024-02-10T00:00:39.231 INFO:tasks.workunit.client.0.smithi164.stdout:5/681: symlink d7/d17/d21/d24/dbc/d45/d5c/le0 0 2024-02-10T00:00:39.232 INFO:tasks.workunit.client.1.smithi183.stdout:5/985: stat d4/d23/d3e/d80/da1/d9e/d27/d5d/d91/c93 0 2024-02-10T00:00:39.234 INFO:tasks.workunit.client.1.smithi183.stdout:5/986: symlink d4/d10c/l144 0 2024-02-10T00:00:39.236 INFO:tasks.workunit.client.1.smithi183.stdout:5/987: dread d4/d23/d4a/ff3 [0,4194304] 0 2024-02-10T00:00:39.240 INFO:tasks.workunit.client.1.smithi183.stdout:4/977: truncate de/d19/d20/f26 2958263 0 2024-02-10T00:00:39.241 INFO:tasks.workunit.client.1.smithi183.stdout:4/978: fdatasync de/d14/d1d/d2f/da2/d109/d12a/f11f 0 2024-02-10T00:00:39.241 INFO:tasks.workunit.client.1.smithi183.stdout:1/859: write d0/d3/f85 [642278,68731] 0 2024-02-10T00:00:39.245 INFO:tasks.workunit.client.0.smithi164.stdout:8/584: sync 2024-02-10T00:00:39.246 INFO:tasks.workunit.client.0.smithi164.stdout:4/606: dwrite d2/d2f/f21 [0,4194304] 0 2024-02-10T00:00:39.246 INFO:tasks.workunit.client.0.smithi164.stdout:8/585: fdatasync d2/d12/f8d 0 2024-02-10T00:00:39.247 INFO:tasks.workunit.client.1.smithi183.stdout:6/852: dwrite d2/d1a/d25/d3c/d8d/fe9 [0,4194304] 0 2024-02-10T00:00:39.248 INFO:tasks.workunit.client.0.smithi164.stdout:9/591: rename d6/de/d2b/d5b to d6/de/d22/d58/dba 0 2024-02-10T00:00:39.248 INFO:tasks.workunit.client.0.smithi164.stdout:5/682: dread d7/d17/d21/d23/f2d [0,4194304] 0 2024-02-10T00:00:39.249 INFO:tasks.workunit.client.1.smithi183.stdout:5/988: rename d4/d23/d2a/c59 to d4/d10c/d131/d137/c145 0 2024-02-10T00:00:39.252 INFO:tasks.workunit.client.0.smithi164.stdout:5/683: write d7/d17/d21/d23/d37/f93 [741745,80065] 0 2024-02-10T00:00:39.252 INFO:tasks.workunit.client.0.smithi164.stdout:6/680: truncate d0/f17 2813565 0 2024-02-10T00:00:39.253 INFO:tasks.workunit.client.1.smithi183.stdout:0/948: dwrite d14/d1d/d2d/d31/d6c/de3/ffd [0,4194304] 0 2024-02-10T00:00:39.253 INFO:tasks.workunit.client.1.smithi183.stdout:4/979: creat de/d14/d1d/d2f/da2/d9c/df5/d117/f13a x:0 0 0 2024-02-10T00:00:39.253 INFO:tasks.workunit.client.0.smithi164.stdout:4/607: dwrite d2/fb [8388608,4194304] 0 2024-02-10T00:00:39.253 INFO:tasks.workunit.client.0.smithi164.stdout:1/535: truncate d1/d1a/f73 928727 0 2024-02-10T00:00:39.254 INFO:tasks.workunit.client.1.smithi183.stdout:5/989: dread - d4/d23/d3e/d80/d96/dd9/f13d zero size 2024-02-10T00:00:39.254 INFO:tasks.workunit.client.0.smithi164.stdout:3/539: dread d0/d1/d2/d19/f29 [4194304,4194304] 0 2024-02-10T00:00:39.255 INFO:tasks.workunit.client.1.smithi183.stdout:3/785: dwrite d7/db/d2a/d4d/d63/f9f [0,4194304] 0 2024-02-10T00:00:39.256 INFO:tasks.workunit.client.1.smithi183.stdout:7/872: dwrite d0/d2/f65 [0,4194304] 0 2024-02-10T00:00:39.257 INFO:tasks.workunit.client.1.smithi183.stdout:3/786: fsync d7/db/d2a/d2d/d51/dab/fd6 0 2024-02-10T00:00:39.258 INFO:tasks.workunit.client.0.smithi164.stdout:0/577: dwrite d6/d10/d66/f6a [0,4194304] 0 2024-02-10T00:00:39.258 INFO:tasks.workunit.client.1.smithi183.stdout:7/873: write d0/d2/d4/d8/d59/fda [804203,95944] 0 2024-02-10T00:00:39.262 INFO:tasks.workunit.client.0.smithi164.stdout:0/578: dwrite d6/d10/d66/f6a [0,4194304] 0 2024-02-10T00:00:39.263 INFO:tasks.workunit.client.1.smithi183.stdout:8/989: dwrite d0/d10/d9e/fbe [4194304,4194304] 0 2024-02-10T00:00:39.266 INFO:tasks.workunit.client.1.smithi183.stdout:9/936: dwrite d0/d3/d14/f38 [0,4194304] 0 2024-02-10T00:00:39.267 INFO:tasks.workunit.client.1.smithi183.stdout:7/874: dwrite d0/d2/d3/f33 [0,4194304] 0 2024-02-10T00:00:39.268 INFO:tasks.workunit.client.0.smithi164.stdout:8/586: fdatasync d2/f39 0 2024-02-10T00:00:39.269 INFO:tasks.workunit.client.0.smithi164.stdout:8/587: chown d2/d64/d65/d80/d32/d4d/c62 699 1 2024-02-10T00:00:39.269 INFO:tasks.workunit.client.0.smithi164.stdout:8/588: fdatasync d2/d64/d65/d80/d32/f3e 0 2024-02-10T00:00:39.271 INFO:tasks.workunit.client.1.smithi183.stdout:1/860: dwrite d0/d3/d67/f94 [0,4194304] 0 2024-02-10T00:00:39.272 INFO:tasks.workunit.client.0.smithi164.stdout:1/536: symlink d1/d23/d37/lb8 0 2024-02-10T00:00:39.274 INFO:tasks.workunit.client.1.smithi183.stdout:6/853: rename d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fe0 to d2/d1a/d25/d3c/d31/d38/d3f/f10b 0 2024-02-10T00:00:39.275 INFO:tasks.workunit.client.1.smithi183.stdout:3/787: creat d7/db/d2a/d2d/d51/dab/fe4 x:0 0 0 2024-02-10T00:00:39.276 INFO:tasks.workunit.client.0.smithi164.stdout:4/608: mknod d2/d19/d16/d31/d4b/cd6 0 2024-02-10T00:00:39.276 INFO:tasks.workunit.client.0.smithi164.stdout:1/537: dwrite d1/d23/f55 [0,4194304] 0 2024-02-10T00:00:39.277 INFO:tasks.workunit.client.1.smithi183.stdout:1/861: dwrite d0/d3a/f83 [0,4194304] 0 2024-02-10T00:00:39.278 INFO:tasks.workunit.client.1.smithi183.stdout:1/862: fdatasync d0/d3/f85 0 2024-02-10T00:00:39.279 INFO:tasks.workunit.client.1.smithi183.stdout:1/863: write d0/d3/d67/f2f [646870,13395] 0 2024-02-10T00:00:39.279 INFO:tasks.workunit.client.0.smithi164.stdout:0/579: creat d6/d10/d18/d2d/d35/d44/d90/fb0 x:0 0 0 2024-02-10T00:00:39.282 INFO:tasks.workunit.client.1.smithi183.stdout:9/937: chown d0/d3/d14/d1c/d4b 1 1 2024-02-10T00:00:39.287 INFO:tasks.workunit.client.0.smithi164.stdout:9/592: link d6/de/d40/d74/lb4 d6/de/lbb 0 2024-02-10T00:00:39.288 INFO:tasks.workunit.client.0.smithi164.stdout:8/589: mknod d2/d64/d65/d80/d32/d68/dac/cb5 0 2024-02-10T00:00:39.288 INFO:tasks.workunit.client.1.smithi183.stdout:1/864: rename d0/d3/d67/d7b/dfe/d7c/db1 to d0/d3/d7/d3d/d60/d89/d126 0 2024-02-10T00:00:39.289 INFO:tasks.workunit.client.1.smithi183.stdout:1/865: write d0/d3a/dd8/d108/f117 [299987,86551] 0 2024-02-10T00:00:39.291 INFO:tasks.workunit.client.0.smithi164.stdout:3/540: dread d0/d1/d2/d17/d37/d3f/d4e/d6d/f92 [0,4194304] 0 2024-02-10T00:00:39.296 INFO:tasks.workunit.client.1.smithi183.stdout:9/938: mknod d0/d92/c129 0 2024-02-10T00:00:39.297 INFO:tasks.workunit.client.1.smithi183.stdout:1/866: creat d0/d3a/dd8/d108/f127 x:0 0 0 2024-02-10T00:00:39.299 INFO:tasks.workunit.client.0.smithi164.stdout:2/664: write d3/d32/d4e/fc6 [986982,5466] 0 2024-02-10T00:00:39.300 INFO:tasks.workunit.client.0.smithi164.stdout:4/609: symlink d2/d5a/d94/ld7 0 2024-02-10T00:00:39.301 INFO:tasks.workunit.client.0.smithi164.stdout:7/634: truncate d3/d4d/d5d/fcc 317948 0 2024-02-10T00:00:39.301 INFO:tasks.workunit.client.1.smithi183.stdout:9/939: dwrite d0/d3/d14/d1c/f45 [0,4194304] 0 2024-02-10T00:00:39.302 INFO:tasks.workunit.client.0.smithi164.stdout:4/610: write d2/d2f/d37/d41/f35 [4435305,72975] 0 2024-02-10T00:00:39.303 INFO:tasks.workunit.client.1.smithi183.stdout:6/854: dread d2/d1a/d25/d3c/f42 [0,4194304] 0 2024-02-10T00:00:39.303 INFO:tasks.workunit.client.0.smithi164.stdout:9/593: creat d6/de/d22/d58/fbc x:0 0 0 2024-02-10T00:00:39.304 INFO:tasks.workunit.client.1.smithi183.stdout:1/867: dwrite d0/d3/d67/f2f [0,4194304] 0 2024-02-10T00:00:39.306 INFO:tasks.workunit.client.0.smithi164.stdout:1/538: dread d1/f9 [0,4194304] 0 2024-02-10T00:00:39.307 INFO:tasks.workunit.client.0.smithi164.stdout:1/539: fsync d1/d13/d2b/d52/f6b 0 2024-02-10T00:00:39.308 INFO:tasks.workunit.client.0.smithi164.stdout:8/590: write d2/f29 [4472441,66558] 0 2024-02-10T00:00:39.309 INFO:tasks.workunit.client.1.smithi183.stdout:1/868: unlink d0/d3/da9/lb2 0 2024-02-10T00:00:39.310 INFO:tasks.workunit.client.1.smithi183.stdout:9/940: write d0/d3/d14/d1c/d4b/f65 [5192560,3879] 0 2024-02-10T00:00:39.311 INFO:tasks.workunit.client.0.smithi164.stdout:2/665: creat d3/da6/d7a/d8e/fee x:0 0 0 2024-02-10T00:00:39.311 INFO:tasks.workunit.client.0.smithi164.stdout:2/666: readlink d3/da6/d7a/lb4 0 2024-02-10T00:00:39.313 INFO:tasks.workunit.client.1.smithi183.stdout:6/855: truncate d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/fcf 702915 0 2024-02-10T00:00:39.314 INFO:tasks.workunit.client.0.smithi164.stdout:4/611: creat d2/d2f/d37/d41/d69/fd8 x:0 0 0 2024-02-10T00:00:39.314 INFO:tasks.workunit.client.0.smithi164.stdout:4/612: chown d2/d5a/d94/f96 49 1 2024-02-10T00:00:39.314 INFO:tasks.workunit.client.0.smithi164.stdout:4/613: chown d2 7818 1 2024-02-10T00:00:39.315 INFO:tasks.workunit.client.1.smithi183.stdout:1/869: dwrite d0/d3/d67/d7b/faf [0,4194304] 0 2024-02-10T00:00:39.316 INFO:tasks.workunit.client.0.smithi164.stdout:8/591: readlink d2/lf 0 2024-02-10T00:00:39.316 INFO:tasks.workunit.client.1.smithi183.stdout:1/870: chown d0/d3/da9/c11c 81839 1 2024-02-10T00:00:39.317 INFO:tasks.workunit.client.0.smithi164.stdout:4/614: dwrite d2/d19/d16/f53 [0,4194304] 0 2024-02-10T00:00:39.318 INFO:tasks.workunit.client.1.smithi183.stdout:7/875: sync 2024-02-10T00:00:39.319 INFO:tasks.workunit.client.0.smithi164.stdout:9/594: creat d6/d41/d8b/dad/fbd x:0 0 0 2024-02-10T00:00:39.320 INFO:tasks.workunit.client.0.smithi164.stdout:9/595: stat d6/de/d22/f26 0 2024-02-10T00:00:39.321 INFO:tasks.workunit.client.0.smithi164.stdout:8/592: mknod d2/d64/cb6 0 2024-02-10T00:00:39.323 INFO:tasks.workunit.client.0.smithi164.stdout:4/615: mkdir d2/d2f/d37/d45/dd9 0 2024-02-10T00:00:39.324 INFO:tasks.workunit.client.0.smithi164.stdout:1/540: truncate d1/d13/d1f/fad 982433 0 2024-02-10T00:00:39.324 INFO:tasks.workunit.client.0.smithi164.stdout:4/616: stat d2/d19/d16/d31/d4b/f50 0 2024-02-10T00:00:39.326 INFO:tasks.workunit.client.1.smithi183.stdout:6/856: getdents d2/d1a/d25/d3c 0 2024-02-10T00:00:39.326 INFO:tasks.workunit.client.0.smithi164.stdout:9/596: mknod d6/de/d2b/cbe 0 2024-02-10T00:00:39.326 INFO:tasks.workunit.client.0.smithi164.stdout:4/617: stat d2/d2f/d37/d41/d3d/d42/d47/fd0 0 2024-02-10T00:00:39.327 INFO:tasks.workunit.client.0.smithi164.stdout:2/667: getdents d3/da6 0 2024-02-10T00:00:39.327 INFO:tasks.workunit.client.0.smithi164.stdout:7/635: chown d3/d4d/d5d/fcc 20 1 2024-02-10T00:00:39.327 INFO:tasks.workunit.client.0.smithi164.stdout:4/618: write d2/d19/d16/d31/f4d [3739255,10734] 0 2024-02-10T00:00:39.330 INFO:tasks.workunit.client.1.smithi183.stdout:7/876: dread d0/d11/d2f/da3/ff4 [0,4194304] 0 2024-02-10T00:00:39.330 INFO:tasks.workunit.client.1.smithi183.stdout:6/857: dread d2/d1a/d25/d3c/d31/f79 [0,4194304] 0 2024-02-10T00:00:39.331 INFO:tasks.workunit.client.0.smithi164.stdout:1/541: creat d1/d1a/d41/d18/d3a/fb9 x:0 0 0 2024-02-10T00:00:39.331 INFO:tasks.workunit.client.0.smithi164.stdout:1/542: chown d1/fa1 19101282 1 2024-02-10T00:00:39.331 INFO:tasks.workunit.client.0.smithi164.stdout:9/597: mknod d6/de/d40/d74/cbf 0 2024-02-10T00:00:39.332 INFO:tasks.workunit.client.0.smithi164.stdout:7/636: dwrite d3/d11/d39/d44/d6f/fd3 [0,4194304] 0 2024-02-10T00:00:39.332 INFO:tasks.workunit.client.1.smithi183.stdout:6/858: mknod d2/d1a/d25/d3c/d31/d38/c10c 0 2024-02-10T00:00:39.333 INFO:tasks.workunit.client.1.smithi183.stdout:6/859: chown d2/d1a/d25/d3c/d8d/dfe/la6 499 1 2024-02-10T00:00:39.336 INFO:tasks.workunit.client.1.smithi183.stdout:4/980: dread de/d19/d20/f5d [0,4194304] 0 2024-02-10T00:00:39.336 INFO:tasks.workunit.client.0.smithi164.stdout:2/668: symlink d3/da6/d7a/d8e/d36/dbd/lef 0 2024-02-10T00:00:39.336 INFO:tasks.workunit.client.0.smithi164.stdout:2/669: dread - d3/d32/d4e/d27/fe0 zero size 2024-02-10T00:00:39.337 INFO:tasks.workunit.client.1.smithi183.stdout:6/860: unlink d2/d1a/d25/d3c/d31/d38/cf5 0 2024-02-10T00:00:39.340 INFO:tasks.workunit.client.0.smithi164.stdout:2/670: dwrite d3/d26/fb0 [0,4194304] 0 2024-02-10T00:00:39.341 INFO:tasks.workunit.client.1.smithi183.stdout:4/981: rename de/d14/d27/ff4 to de/d19/d20/de6/df7/f13b 0 2024-02-10T00:00:39.344 INFO:tasks.workunit.client.0.smithi164.stdout:9/598: rename d6/de/d22/d58/dac to d6/de/d22/d58/dba/d75/dc0 0 2024-02-10T00:00:39.345 INFO:tasks.workunit.client.0.smithi164.stdout:1/543: mknod d1/d1a/d9a/cba 0 2024-02-10T00:00:39.349 INFO:tasks.workunit.client.0.smithi164.stdout:1/544: symlink d1/d23/d37/lbb 0 2024-02-10T00:00:39.350 INFO:tasks.workunit.client.1.smithi183.stdout:1/871: sync 2024-02-10T00:00:39.350 INFO:tasks.workunit.client.1.smithi183.stdout:1/872: stat d0/d3a/dd8/d108 0 2024-02-10T00:00:39.350 INFO:tasks.workunit.client.0.smithi164.stdout:7/637: creat d3/fd4 x:0 0 0 2024-02-10T00:00:39.352 INFO:tasks.workunit.client.0.smithi164.stdout:2/671: mkdir d3/d24/df0 0 2024-02-10T00:00:39.353 INFO:tasks.workunit.client.0.smithi164.stdout:2/672: rmdir d3/d24/d5b 39 2024-02-10T00:00:39.354 INFO:tasks.workunit.client.1.smithi183.stdout:3/788: dread d7/db/d2a/d2d/f84 [0,4194304] 0 2024-02-10T00:00:39.356 INFO:tasks.workunit.client.0.smithi164.stdout:2/673: creat d3/d32/d4e/d27/ff1 x:0 0 0 2024-02-10T00:00:39.357 INFO:tasks.workunit.client.1.smithi183.stdout:1/873: unlink d0/d3a/l76 0 2024-02-10T00:00:39.358 INFO:tasks.workunit.client.1.smithi183.stdout:3/789: rmdir d7/db/d2a 39 2024-02-10T00:00:39.361 INFO:tasks.workunit.client.1.smithi183.stdout:3/790: dread d7/db/d2a/d8e/fdc [0,4194304] 0 2024-02-10T00:00:39.362 INFO:tasks.workunit.client.1.smithi183.stdout:1/874: rmdir d0/d3/d7/d3d/d60/d89/de4/dea 0 2024-02-10T00:00:39.363 INFO:tasks.workunit.client.1.smithi183.stdout:1/875: chown d0/d3/d67/l53 315175 1 2024-02-10T00:00:39.364 INFO:tasks.workunit.client.1.smithi183.stdout:3/791: creat d7/db/d2a/d4d/fe5 x:0 0 0 2024-02-10T00:00:39.365 INFO:tasks.workunit.client.1.smithi183.stdout:1/876: symlink d0/d3/d7/d3d/l128 0 2024-02-10T00:00:39.367 INFO:tasks.workunit.client.1.smithi183.stdout:1/877: creat d0/f129 x:0 0 0 2024-02-10T00:00:39.370 INFO:tasks.workunit.client.1.smithi183.stdout:3/792: creat d7/db/d2a/fe6 x:0 0 0 2024-02-10T00:00:39.371 INFO:tasks.workunit.client.1.smithi183.stdout:5/990: dwrite d4/dd/fea [0,4194304] 0 2024-02-10T00:00:39.373 INFO:tasks.workunit.client.1.smithi183.stdout:5/991: creat d4/d23/d3e/d80/d96/dd9/f146 x:0 0 0 2024-02-10T00:00:39.377 INFO:tasks.workunit.client.1.smithi183.stdout:7/877: sync 2024-02-10T00:00:39.386 INFO:tasks.workunit.client.0.smithi164.stdout:5/684: truncate d7/d17/f1c 2077540 0 2024-02-10T00:00:39.387 INFO:tasks.workunit.client.0.smithi164.stdout:0/580: getdents d6/d10/d18/d2d/d35/d44/d90 0 2024-02-10T00:00:39.388 INFO:tasks.workunit.client.0.smithi164.stdout:0/581: dread - d6/d3a/d52/fa7 zero size 2024-02-10T00:00:39.389 INFO:tasks.workunit.client.0.smithi164.stdout:0/582: fsync d6/d7/d14/f54 0 2024-02-10T00:00:39.391 INFO:tasks.workunit.client.0.smithi164.stdout:5/685: dwrite d7/d17/d21/d23/d5a/d68/d1f/fa5 [0,4194304] 0 2024-02-10T00:00:39.392 INFO:tasks.workunit.client.0.smithi164.stdout:0/583: creat d6/d10/d4a/d60/d6c/fb1 x:0 0 0 2024-02-10T00:00:39.395 INFO:tasks.workunit.client.0.smithi164.stdout:5/686: rename d7/d17/d21/d23/d5a/cb4 to d7/d17/d69/ce1 0 2024-02-10T00:00:39.396 INFO:tasks.workunit.client.0.smithi164.stdout:0/584: dwrite d6/d7/f58 [0,4194304] 0 2024-02-10T00:00:39.399 INFO:tasks.workunit.client.0.smithi164.stdout:5/687: creat d7/d17/d21/d23/d37/d36/fe2 x:0 0 0 2024-02-10T00:00:39.401 INFO:tasks.workunit.client.0.smithi164.stdout:0/585: fdatasync d6/d3a/d52/d7a/f94 0 2024-02-10T00:00:39.402 INFO:tasks.workunit.client.0.smithi164.stdout:0/586: write d6/d10/d4a/f74 [5061582,44994] 0 2024-02-10T00:00:39.402 INFO:tasks.workunit.client.0.smithi164.stdout:5/688: creat d7/d17/d79/d7b/dc5/dd7/fe3 x:0 0 0 2024-02-10T00:00:39.404 INFO:tasks.workunit.client.1.smithi183.stdout:4/982: sync 2024-02-10T00:00:39.404 INFO:tasks.workunit.client.0.smithi164.stdout:1/545: sync 2024-02-10T00:00:39.405 INFO:tasks.workunit.client.0.smithi164.stdout:5/689: symlink d7/d17/d21/d23/d5a/le4 0 2024-02-10T00:00:39.406 INFO:tasks.workunit.client.0.smithi164.stdout:0/587: mkdir d6/d3a/db2 0 2024-02-10T00:00:39.408 INFO:tasks.workunit.client.0.smithi164.stdout:1/546: truncate d1/d1a/d41/d18/fb6 522065 0 2024-02-10T00:00:39.411 INFO:tasks.workunit.client.0.smithi164.stdout:5/690: rename d7/d17/d21/d24/dbc/f6b to d7/d17/d21/d23/d37/fe5 0 2024-02-10T00:00:39.413 INFO:tasks.workunit.client.0.smithi164.stdout:1/547: creat d1/d13/d2b/d52/d56/fbc x:0 0 0 2024-02-10T00:00:39.413 INFO:tasks.workunit.client.0.smithi164.stdout:0/588: link d6/d10/d4a/f74 d6/d10/d18/d2d/fb3 0 2024-02-10T00:00:39.416 INFO:tasks.workunit.client.0.smithi164.stdout:5/691: dwrite d7/d17/d21/d24/dbc/d43/f4e [4194304,4194304] 0 2024-02-10T00:00:39.422 INFO:tasks.workunit.client.0.smithi164.stdout:8/593: dread d2/f2c [0,4194304] 0 2024-02-10T00:00:39.430 INFO:tasks.workunit.client.0.smithi164.stdout:8/594: mkdir d2/d64/d65/d80/d32/d93/db7 0 2024-02-10T00:00:39.431 INFO:tasks.workunit.client.0.smithi164.stdout:8/595: write d2/d64/f97 [1871427,122753] 0 2024-02-10T00:00:39.436 INFO:tasks.workunit.client.1.smithi183.stdout:5/992: sync 2024-02-10T00:00:39.436 INFO:tasks.workunit.client.0.smithi164.stdout:8/596: dread d2/d64/d65/d80/d32/d4d/f5a [0,4194304] 0 2024-02-10T00:00:39.436 INFO:tasks.workunit.client.0.smithi164.stdout:8/597: fdatasync d2/d64/d65/d80/d82/fad 0 2024-02-10T00:00:39.437 INFO:tasks.workunit.client.0.smithi164.stdout:8/598: fsync d2/d64/f3b 0 2024-02-10T00:00:39.437 INFO:tasks.workunit.client.1.smithi183.stdout:8/990: dread d0/d4e/d53/f64 [4194304,4194304] 0 2024-02-10T00:00:39.438 INFO:tasks.workunit.client.0.smithi164.stdout:8/599: dread - d2/d64/f42 zero size 2024-02-10T00:00:39.439 INFO:tasks.workunit.client.1.smithi183.stdout:5/993: symlink d4/d23/d3e/d80/da1/d9e/d27/d37/d104/l147 0 2024-02-10T00:00:39.439 INFO:tasks.workunit.client.0.smithi164.stdout:8/600: read d2/d64/d65/d80/d32/d93/f9a [457818,130049] 0 2024-02-10T00:00:39.440 INFO:tasks.workunit.client.1.smithi183.stdout:8/991: symlink d0/d3f/d94/d122/l137 0 2024-02-10T00:00:39.441 INFO:tasks.workunit.client.1.smithi183.stdout:5/994: creat d4/d74/f148 x:0 0 0 2024-02-10T00:00:39.441 INFO:tasks.workunit.client.0.smithi164.stdout:8/601: creat d2/d64/d65/d98/fb8 x:0 0 0 2024-02-10T00:00:39.442 INFO:tasks.workunit.client.0.smithi164.stdout:8/602: chown d2/d64/l2e 21849178 1 2024-02-10T00:00:39.445 INFO:tasks.workunit.client.0.smithi164.stdout:8/603: mkdir d2/d64/d54/db9 0 2024-02-10T00:00:39.447 INFO:tasks.workunit.client.0.smithi164.stdout:3/541: dread d0/d1/d2/d19/d27/d5f/f85 [0,4194304] 0 2024-02-10T00:00:39.450 INFO:tasks.workunit.client.0.smithi164.stdout:8/604: dwrite d2/d64/d65/d80/d32/f56 [0,4194304] 0 2024-02-10T00:00:39.450 INFO:tasks.workunit.client.1.smithi183.stdout:1/878: read d0/d3a/dd8/d108/f117 [87774,61885] 0 2024-02-10T00:00:39.451 INFO:tasks.workunit.client.0.smithi164.stdout:3/542: dread d0/d1/d3c/f63 [0,4194304] 0 2024-02-10T00:00:39.455 INFO:tasks.workunit.client.0.smithi164.stdout:3/543: creat d0/d1/d2/d17/d37/d3f/d4e/d6d/fa3 x:0 0 0 2024-02-10T00:00:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:3/544: readlink d0/d1/d3c/d3d/l79 0 2024-02-10T00:00:39.456 INFO:tasks.workunit.client.0.smithi164.stdout:3/545: chown d0/d1/d3c 1563901670 1 2024-02-10T00:00:39.463 INFO:tasks.workunit.client.1.smithi183.stdout:0/949: dwrite d14/d1d/d59/fd1 [0,4194304] 0 2024-02-10T00:00:39.468 INFO:tasks.workunit.client.0.smithi164.stdout:4/619: dwrite d2/d19/d16/d31/d4b/f50 [0,4194304] 0 2024-02-10T00:00:39.469 INFO:tasks.workunit.client.1.smithi183.stdout:0/950: dread d14/d3e/d5f/daa/de6/f151 [0,4194304] 0 2024-02-10T00:00:39.470 INFO:tasks.workunit.client.1.smithi183.stdout:8/992: dread d0/d3f/db2/de9/fae [0,4194304] 0 2024-02-10T00:00:39.471 INFO:tasks.workunit.client.1.smithi183.stdout:6/861: truncate d2/fb0 3224678 0 2024-02-10T00:00:39.471 INFO:tasks.workunit.client.1.smithi183.stdout:9/941: dread d0/d3/d14/d1c/f10c [0,4194304] 0 2024-02-10T00:00:39.472 INFO:tasks.workunit.client.1.smithi183.stdout:6/862: write d2/d32/f41 [1370696,105522] 0 2024-02-10T00:00:39.472 INFO:tasks.workunit.client.0.smithi164.stdout:7/638: dwrite d3/d5/d9b/db7/d4b/f6a [0,4194304] 0 2024-02-10T00:00:39.474 INFO:tasks.workunit.client.1.smithi183.stdout:3/793: rmdir d7/db/d2a/d4d 39 2024-02-10T00:00:39.475 INFO:tasks.workunit.client.0.smithi164.stdout:2/674: dwrite d3/fe [0,4194304] 0 2024-02-10T00:00:39.475 INFO:tasks.workunit.client.0.smithi164.stdout:6/681: dread d0/d6/d12/d14/f1e [0,4194304] 0 2024-02-10T00:00:39.476 INFO:tasks.workunit.client.0.smithi164.stdout:4/620: dwrite d2/d19/d16/d31/fb8 [0,4194304] 0 2024-02-10T00:00:39.481 INFO:tasks.workunit.client.1.smithi183.stdout:7/878: truncate d0/d11/d2f/f34 309149 0 2024-02-10T00:00:39.486 INFO:tasks.workunit.client.0.smithi164.stdout:5/692: write d7/d17/d21/d85/fa4 [3161467,5150] 0 2024-02-10T00:00:39.486 INFO:tasks.workunit.client.1.smithi183.stdout:4/983: dwrite de/f12 [4194304,4194304] 0 2024-02-10T00:00:39.487 INFO:tasks.workunit.client.0.smithi164.stdout:1/548: truncate d1/d1a/d41/fe 2075895 0 2024-02-10T00:00:39.487 INFO:tasks.workunit.client.0.smithi164.stdout:0/589: write d6/d7/d14/f1b [904726,34960] 0 2024-02-10T00:00:39.488 INFO:tasks.workunit.client.1.smithi183.stdout:5/995: dwrite d4/dd/d31/f4d [0,4194304] 0 2024-02-10T00:00:39.488 INFO:tasks.workunit.client.1.smithi183.stdout:1/879: dwrite d0/d3c/fd7 [0,4194304] 0 2024-02-10T00:00:39.489 INFO:tasks.workunit.client.0.smithi164.stdout:9/599: getdents d6/d41/d8b/dad 0 2024-02-10T00:00:39.489 INFO:tasks.workunit.client.1.smithi183.stdout:1/880: write d0/d3/d7/f4a [375834,6389] 0 2024-02-10T00:00:39.494 INFO:tasks.workunit.client.0.smithi164.stdout:3/546: truncate d0/d1/d2/d17/d37/f69 513198 0 2024-02-10T00:00:39.494 INFO:tasks.workunit.client.0.smithi164.stdout:8/605: getdents d2/d64/d65/d80/d32/d99/da0 0 2024-02-10T00:00:39.494 INFO:tasks.workunit.client.1.smithi183.stdout:1/881: read d0/f4b [2811274,22148] 0 2024-02-10T00:00:39.495 INFO:tasks.workunit.client.1.smithi183.stdout:1/882: fdatasync d0/d3/d7/d3d/dcb/fe1 0 2024-02-10T00:00:39.495 INFO:tasks.workunit.client.1.smithi183.stdout:1/883: dread - d0/d3/da9/f102 zero size 2024-02-10T00:00:39.500 INFO:tasks.workunit.client.0.smithi164.stdout:7/639: rmdir d3/d5/d2b/dab 39 2024-02-10T00:00:39.502 INFO:tasks.workunit.client.0.smithi164.stdout:6/682: readlink d0/la 0 2024-02-10T00:00:39.503 INFO:tasks.workunit.client.0.smithi164.stdout:4/621: mknod d2/d2f/d37/d45/cda 0 2024-02-10T00:00:39.505 INFO:tasks.workunit.client.0.smithi164.stdout:0/590: unlink d6/d10/d18/d1c/l81 0 2024-02-10T00:00:39.507 INFO:tasks.workunit.client.0.smithi164.stdout:9/600: creat d6/de/d22/d58/dba/d61/fc1 x:0 0 0 2024-02-10T00:00:39.510 INFO:tasks.workunit.client.0.smithi164.stdout:8/606: rename d2/d64/d63/l6c to d2/d64/d54/db9/lba 0 2024-02-10T00:00:39.511 INFO:tasks.workunit.client.0.smithi164.stdout:8/607: write d2/d81/f8c [748287,64445] 0 2024-02-10T00:00:39.512 INFO:tasks.workunit.client.0.smithi164.stdout:7/640: unlink d3/d26/c3e 0 2024-02-10T00:00:39.512 INFO:tasks.workunit.client.1.smithi183.stdout:8/993: fdatasync d0/d4e/d53/f64 0 2024-02-10T00:00:39.513 INFO:tasks.workunit.client.0.smithi164.stdout:6/683: creat d0/d2b/d3a/dd0/fea x:0 0 0 2024-02-10T00:00:39.515 INFO:tasks.workunit.client.1.smithi183.stdout:3/794: mknod d7/db/d2a/d33/d59/db6/ce7 0 2024-02-10T00:00:39.516 INFO:tasks.workunit.client.1.smithi183.stdout:6/863: read d2/d1a/d25/f36 [544188,120907] 0 2024-02-10T00:00:39.516 INFO:tasks.workunit.client.0.smithi164.stdout:1/549: link d1/d13/f66 d1/d13/d2b/d52/da4/fbd 0 2024-02-10T00:00:39.517 INFO:tasks.workunit.client.0.smithi164.stdout:1/550: chown d1/d13/d2b/d52/f5d 67071040 1 2024-02-10T00:00:39.517 INFO:tasks.workunit.client.1.smithi183.stdout:6/864: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/c101 4298 1 2024-02-10T00:00:39.518 INFO:tasks.workunit.client.1.smithi183.stdout:4/984: symlink de/l13c 0 2024-02-10T00:00:39.518 INFO:tasks.workunit.client.0.smithi164.stdout:1/551: write d1/d13/d2b/d52/db7/fa7 [8819632,74932] 0 2024-02-10T00:00:39.518 INFO:tasks.workunit.client.1.smithi183.stdout:4/985: chown de/d14/d1d/fbd 3650240 1 2024-02-10T00:00:39.519 INFO:tasks.workunit.client.0.smithi164.stdout:1/552: write d1/d13/d1f/f7a [416998,90870] 0 2024-02-10T00:00:39.519 INFO:tasks.workunit.client.1.smithi183.stdout:1/884: symlink d0/d3a/l12a 0 2024-02-10T00:00:39.520 INFO:tasks.workunit.client.0.smithi164.stdout:4/622: rename d2/d2f/d37/d41/d3d/d42/f5b to d2/d2f/d37/d41/fdb 0 2024-02-10T00:00:39.521 INFO:tasks.workunit.client.0.smithi164.stdout:4/623: chown d2/d2f/d37/d41/d3d/d42/da2/db5 23212 1 2024-02-10T00:00:39.521 INFO:tasks.workunit.client.0.smithi164.stdout:8/608: symlink d2/d81/lbb 0 2024-02-10T00:00:39.521 INFO:tasks.workunit.client.1.smithi183.stdout:8/994: write d0/d23/db1/d130/f134 [230441,119734] 0 2024-02-10T00:00:39.522 INFO:tasks.workunit.client.0.smithi164.stdout:4/624: stat d2/d2f/d37/d41/f3e 0 2024-02-10T00:00:39.522 INFO:tasks.workunit.client.0.smithi164.stdout:2/675: creat d3/d24/ff2 x:0 0 0 2024-02-10T00:00:39.523 INFO:tasks.workunit.client.1.smithi183.stdout:6/865: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fae [0,4194304] 0 2024-02-10T00:00:39.524 INFO:tasks.workunit.client.0.smithi164.stdout:6/684: symlink d0/d2b/d3a/dd0/d93/db4/leb 0 2024-02-10T00:00:39.524 INFO:tasks.workunit.client.0.smithi164.stdout:5/693: link d7/d17/d21/lad d7/d17/d21/d23/d5a/d68/d1f/d59/le6 0 2024-02-10T00:00:39.524 INFO:tasks.workunit.client.1.smithi183.stdout:4/986: unlink de/d14/cc4 0 2024-02-10T00:00:39.525 INFO:tasks.workunit.client.0.smithi164.stdout:6/685: readlink d0/d2b/d3a/d3d/d42/d5d/d79/l94 0 2024-02-10T00:00:39.526 INFO:tasks.workunit.client.1.smithi183.stdout:0/951: creat d14/d1d/d59/d3c/f153 x:0 0 0 2024-02-10T00:00:39.526 INFO:tasks.workunit.client.0.smithi164.stdout:0/591: creat d6/d7/d14/d79/da2/fb4 x:0 0 0 2024-02-10T00:00:39.526 INFO:tasks.workunit.client.1.smithi183.stdout:0/952: chown d14/d3e/d5f/daa/ddd/lde 8172 1 2024-02-10T00:00:39.527 INFO:tasks.workunit.client.1.smithi183.stdout:1/885: creat d0/d3/d7/d3d/d60/d89/f12b x:0 0 0 2024-02-10T00:00:39.528 INFO:tasks.workunit.client.1.smithi183.stdout:1/886: write d0/d3/d7/d3d/d99/fe0 [3241752,96245] 0 2024-02-10T00:00:39.528 INFO:tasks.workunit.client.1.smithi183.stdout:6/866: write d2/d1a/d25/d3c/d31/d38/d6e/d34/f106 [810750,48944] 0 2024-02-10T00:00:39.529 INFO:tasks.workunit.client.0.smithi164.stdout:8/609: creat d2/d64/d65/fbc x:0 0 0 2024-02-10T00:00:39.529 INFO:tasks.workunit.client.1.smithi183.stdout:4/987: fdatasync de/d14/d1d/f59 0 2024-02-10T00:00:39.531 INFO:tasks.workunit.client.1.smithi183.stdout:3/795: creat d7/db/d2a/d2d/fe8 x:0 0 0 2024-02-10T00:00:39.531 INFO:tasks.workunit.client.0.smithi164.stdout:5/694: symlink d7/d17/d69/d92/da8/le7 0 2024-02-10T00:00:39.533 INFO:tasks.workunit.client.0.smithi164.stdout:4/625: fdatasync d2/d19/d16/f38 0 2024-02-10T00:00:39.536 INFO:tasks.workunit.client.0.smithi164.stdout:5/695: dwrite d7/d17/d21/d23/d37/d36/d8b/fc6 [0,4194304] 0 2024-02-10T00:00:39.536 INFO:tasks.workunit.client.0.smithi164.stdout:8/610: creat d2/d64/d63/fbd x:0 0 0 2024-02-10T00:00:39.537 INFO:tasks.workunit.client.1.smithi183.stdout:6/867: rmdir d2/da0 39 2024-02-10T00:00:39.537 INFO:tasks.workunit.client.1.smithi183.stdout:9/942: link d0/d3/d14/d74/l8a d0/d3/d14/d1c/d4b/d51/l12a 0 2024-02-10T00:00:39.537 INFO:tasks.workunit.client.0.smithi164.stdout:2/676: mknod d3/cf3 0 2024-02-10T00:00:39.537 INFO:tasks.workunit.client.0.smithi164.stdout:1/553: link d1/d1a/d41/d18/d33/c96 d1/d23/d61/d9d/cbe 0 2024-02-10T00:00:39.538 INFO:tasks.workunit.client.1.smithi183.stdout:6/868: write d2/d1a/d25/d3c/f42 [388622,60952] 0 2024-02-10T00:00:39.538 INFO:tasks.workunit.client.0.smithi164.stdout:2/677: chown d3/l66 2 1 2024-02-10T00:00:39.538 INFO:tasks.workunit.client.0.smithi164.stdout:8/611: fsync d2/d64/d65/d80/d32/f3e 0 2024-02-10T00:00:39.539 INFO:tasks.workunit.client.0.smithi164.stdout:1/554: write d1/d23/f55 [95013,21635] 0 2024-02-10T00:00:39.539 INFO:tasks.workunit.client.0.smithi164.stdout:5/696: write d7/d17/d21/d85/fa4 [3068416,50659] 0 2024-02-10T00:00:39.539 INFO:tasks.workunit.client.1.smithi183.stdout:6/869: stat d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/lad 0 2024-02-10T00:00:39.539 INFO:tasks.workunit.client.1.smithi183.stdout:3/796: unlink d7/db/l54 0 2024-02-10T00:00:39.540 INFO:tasks.workunit.client.1.smithi183.stdout:3/797: stat d7/db/d2a/d33/d59 0 2024-02-10T00:00:39.541 INFO:tasks.workunit.client.0.smithi164.stdout:1/555: stat d1/d13/d1f/f7a 0 2024-02-10T00:00:39.541 INFO:tasks.workunit.client.0.smithi164.stdout:7/641: dread d3/f9 [0,4194304] 0 2024-02-10T00:00:39.541 INFO:tasks.workunit.client.1.smithi183.stdout:3/798: read - d7/db/d2a/d2d/d51/dab/fd6 zero size 2024-02-10T00:00:39.541 INFO:tasks.workunit.client.1.smithi183.stdout:0/953: creat d14/d1d/d2d/d31/d68/d129/d12e/f154 x:0 0 0 2024-02-10T00:00:39.542 INFO:tasks.workunit.client.0.smithi164.stdout:8/612: chown d2/d64/d65/d80/d32/d99/d9e 8739073 1 2024-02-10T00:00:39.542 INFO:tasks.workunit.client.0.smithi164.stdout:4/626: symlink d2/d2f/d37/d45/dd9/ldc 0 2024-02-10T00:00:39.543 INFO:tasks.workunit.client.0.smithi164.stdout:7/642: stat d3/d5/d59/f72 0 2024-02-10T00:00:39.544 INFO:tasks.workunit.client.0.smithi164.stdout:8/613: write d2/d64/d63/f70 [909981,77370] 0 2024-02-10T00:00:39.544 INFO:tasks.workunit.client.0.smithi164.stdout:2/678: mkdir d3/da6/d7a/d8e/d88/df4 0 2024-02-10T00:00:39.544 INFO:tasks.workunit.client.1.smithi183.stdout:8/995: getdents d0/d11f/d81 0 2024-02-10T00:00:39.545 INFO:tasks.workunit.client.0.smithi164.stdout:4/627: fdatasync d2/d2f/d37/d45/fa9 0 2024-02-10T00:00:39.545 INFO:tasks.workunit.client.1.smithi183.stdout:8/996: readlink d0/d23/dff/l12a 0 2024-02-10T00:00:39.546 INFO:tasks.workunit.client.1.smithi183.stdout:5/996: dread d4/d23/f21 [0,4194304] 0 2024-02-10T00:00:39.547 INFO:tasks.workunit.client.0.smithi164.stdout:8/614: readlink d2/d64/d65/d80/d32/d99/d9e/la1 0 2024-02-10T00:00:39.547 INFO:tasks.workunit.client.0.smithi164.stdout:5/697: dwrite d7/d17/d79/d7b/dc5/dd7/fd1 [0,4194304] 0 2024-02-10T00:00:39.548 INFO:tasks.workunit.client.0.smithi164.stdout:1/556: rename d1/d1a/d41/d18/l27 to d1/d13/d2b/lbf 0 2024-02-10T00:00:39.549 INFO:tasks.workunit.client.0.smithi164.stdout:7/643: mkdir d3/d4d/d5d/dd5 0 2024-02-10T00:00:39.549 INFO:tasks.workunit.client.1.smithi183.stdout:1/887: link d0/d3/lb d0/d3/d7/def/l12c 0 2024-02-10T00:00:39.549 INFO:tasks.workunit.client.0.smithi164.stdout:7/644: chown d3/d28/d51/f64 1768191026 1 2024-02-10T00:00:39.551 INFO:tasks.workunit.client.0.smithi164.stdout:8/615: creat d2/d64/d65/d80/d32/d93/fbe x:0 0 0 2024-02-10T00:00:39.552 INFO:tasks.workunit.client.0.smithi164.stdout:1/557: creat d1/d13/d1f/fc0 x:0 0 0 2024-02-10T00:00:39.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/870: unlink d2/da0/cec 0 2024-02-10T00:00:39.555 INFO:tasks.workunit.client.0.smithi164.stdout:5/698: unlink d7/d17/d21/d23/d37/fda 0 2024-02-10T00:00:39.557 INFO:tasks.workunit.client.1.smithi183.stdout:9/943: rename d0/d3/d14/d1c/d4b/d51/c6b to d0/d3/d14/c12b 0 2024-02-10T00:00:39.557 INFO:tasks.workunit.client.1.smithi183.stdout:3/799: creat d7/db/d2a/d2d/fe9 x:0 0 0 2024-02-10T00:00:39.558 INFO:tasks.workunit.client.0.smithi164.stdout:2/679: dread d3/fd [0,4194304] 0 2024-02-10T00:00:39.558 INFO:tasks.workunit.client.1.smithi183.stdout:6/871: rmdir d2/d1a/d25/d3c 39 2024-02-10T00:00:39.558 INFO:tasks.workunit.client.0.smithi164.stdout:2/680: fsync d3/f44 0 2024-02-10T00:00:39.566 INFO:tasks.workunit.client.0.smithi164.stdout:8/616: mknod d2/d64/d65/d80/d32/d93/cbf 0 2024-02-10T00:00:39.574 INFO:tasks.workunit.client.1.smithi183.stdout:7/879: dwrite d0/f7d [0,4194304] 0 2024-02-10T00:00:39.574 INFO:tasks.workunit.client.0.smithi164.stdout:9/601: dwrite d6/f79 [0,4194304] 0 2024-02-10T00:00:39.574 INFO:tasks.workunit.client.1.smithi183.stdout:7/880: write d0/d2/d50/d5d/f78 [1778947,74132] 0 2024-02-10T00:00:39.577 INFO:tasks.workunit.client.0.smithi164.stdout:5/699: symlink d7/d17/d79/d7b/dc5/dd7/le8 0 2024-02-10T00:00:39.577 INFO:tasks.workunit.client.0.smithi164.stdout:5/700: fsync d7/d17/d79/f97 0 2024-02-10T00:00:39.580 INFO:tasks.workunit.client.0.smithi164.stdout:2/681: rename f2 to d3/da6/d7a/d8e/d36/d54/ff5 0 2024-02-10T00:00:39.582 INFO:tasks.workunit.client.1.smithi183.stdout:4/988: truncate de/d19/d1c/fe2 2755740 0 2024-02-10T00:00:39.583 INFO:tasks.workunit.client.1.smithi183.stdout:4/989: chown de/ccd 19366 1 2024-02-10T00:00:39.584 INFO:tasks.workunit.client.0.smithi164.stdout:2/682: dread d3/f23 [0,4194304] 0 2024-02-10T00:00:39.587 INFO:tasks.workunit.client.1.smithi183.stdout:8/997: truncate d0/d4e/d53/fe1 400380 0 2024-02-10T00:00:39.588 INFO:tasks.workunit.client.1.smithi183.stdout:8/998: stat d0/d31/db8 0 2024-02-10T00:00:39.589 INFO:tasks.workunit.client.0.smithi164.stdout:7/645: mkdir d3/d4d/d5d/dd5/dd6 0 2024-02-10T00:00:39.589 INFO:tasks.workunit.client.0.smithi164.stdout:6/686: write d0/d6/d12/d45/f65 [1843078,76122] 0 2024-02-10T00:00:39.590 INFO:tasks.workunit.client.1.smithi183.stdout:1/888: rename d0/d3/d7/d3d/d60/d89/d126 to d0/d12d 0 2024-02-10T00:00:39.592 INFO:tasks.workunit.client.1.smithi183.stdout:5/997: creat d4/d23/d3e/d80/da1/f149 x:0 0 0 2024-02-10T00:00:39.593 INFO:tasks.workunit.client.0.smithi164.stdout:8/617: rmdir d2/d64/d65/d80/d82 39 2024-02-10T00:00:39.594 INFO:tasks.workunit.client.1.smithi183.stdout:3/800: creat d7/db/d2a/d2d/d51/fea x:0 0 0 2024-02-10T00:00:39.597 INFO:tasks.workunit.client.1.smithi183.stdout:7/881: creat d0/d2/d4/d8/d59/d8a/f116 x:0 0 0 2024-02-10T00:00:39.598 INFO:tasks.workunit.client.1.smithi183.stdout:0/954: getdents d14/d3e/d5f/daa/de6 0 2024-02-10T00:00:39.599 INFO:tasks.workunit.client.1.smithi183.stdout:0/955: dread - d14/d1d/d2d/d31/d68/d129/d12e/f154 zero size 2024-02-10T00:00:39.599 INFO:tasks.workunit.client.0.smithi164.stdout:4/628: truncate d2/f5e 96947 0 2024-02-10T00:00:39.599 INFO:tasks.workunit.client.0.smithi164.stdout:3/547: write d0/d1/d2/d17/d37/f69 [1136123,82190] 0 2024-02-10T00:00:39.600 INFO:tasks.workunit.client.0.smithi164.stdout:1/558: write d1/d13/f66 [771960,15085] 0 2024-02-10T00:00:39.601 INFO:tasks.workunit.client.1.smithi183.stdout:8/999: mkdir d0/d4e/d6b/d138 0 2024-02-10T00:00:39.602 INFO:tasks.workunit.client.0.smithi164.stdout:1/559: write d1/d1a/d41/d18/d3a/fb9 [225312,4734] 0 2024-02-10T00:00:39.602 INFO:tasks.workunit.client.0.smithi164.stdout:9/602: mkdir d6/d41/d8b/dc2 0 2024-02-10T00:00:39.603 INFO:tasks.workunit.client.1.smithi183.stdout:9/944: rename d0/d10/f7c to d0/d30/f12c 0 2024-02-10T00:00:39.604 INFO:tasks.workunit.client.1.smithi183.stdout:1/889: mkdir d0/d3/d7/d3d/d60/d89/de4/d12e 0 2024-02-10T00:00:39.608 INFO:tasks.workunit.client.1.smithi183.stdout:7/882: mknod d0/d11/d9d/d103/c117 0 2024-02-10T00:00:39.608 INFO:tasks.workunit.client.0.smithi164.stdout:5/701: mkdir d7/d17/d69/d92/de9 0 2024-02-10T00:00:39.608 INFO:tasks.workunit.client.0.smithi164.stdout:2/683: fdatasync d3/d24/fdb 0 2024-02-10T00:00:39.609 INFO:tasks.workunit.client.0.smithi164.stdout:5/702: fsync d7/d17/d21/d23/d5a/d68/fd8 0 2024-02-10T00:00:39.610 INFO:tasks.workunit.client.0.smithi164.stdout:7/646: unlink d3/d26/c49 0 2024-02-10T00:00:39.610 INFO:tasks.workunit.client.1.smithi183.stdout:4/990: creat de/d14/d1d/d126/d128/f13d x:0 0 0 2024-02-10T00:00:39.611 INFO:tasks.workunit.client.1.smithi183.stdout:4/991: read - de/d14/d27/f8b zero size 2024-02-10T00:00:39.613 INFO:tasks.workunit.client.0.smithi164.stdout:8/618: rename d2/d64/l52 to d2/d81/lc0 0 2024-02-10T00:00:39.613 INFO:tasks.workunit.client.1.smithi183.stdout:7/883: dwrite d0/d11/d3e/f49 [4194304,4194304] 0 2024-02-10T00:00:39.614 INFO:tasks.workunit.client.0.smithi164.stdout:5/703: dwrite d7/d17/d21/d23/d5a/d68/d1f/f4a [0,4194304] 0 2024-02-10T00:00:39.616 INFO:tasks.workunit.client.0.smithi164.stdout:3/548: mknod d0/d1/d2/d19/d27/d5f/ca4 0 2024-02-10T00:00:39.618 INFO:tasks.workunit.client.0.smithi164.stdout:9/603: symlink d6/de/d22/d58/dba/d61/d76/da5/lc3 0 2024-02-10T00:00:39.620 INFO:tasks.workunit.client.0.smithi164.stdout:0/592: sync 2024-02-10T00:00:39.622 INFO:tasks.workunit.client.0.smithi164.stdout:2/684: chown d3/d32/d4e/d27/f94 135 1 2024-02-10T00:00:39.624 INFO:tasks.workunit.client.0.smithi164.stdout:4/629: symlink d2/d2f/d37/d41/dcc/ldd 0 2024-02-10T00:00:39.625 INFO:tasks.workunit.client.0.smithi164.stdout:4/630: chown d2/d2f/d37/d41/d3d/d42/d5f/fad 7480131 1 2024-02-10T00:00:39.626 INFO:tasks.workunit.client.0.smithi164.stdout:3/549: write d0/d1/d2/d19/d66/d84/f55 [1761209,99386] 0 2024-02-10T00:00:39.628 INFO:tasks.workunit.client.0.smithi164.stdout:0/593: readlink d6/d3a/l72 0 2024-02-10T00:00:39.628 INFO:tasks.workunit.client.0.smithi164.stdout:6/687: truncate d0/d3b/f90 3870059 0 2024-02-10T00:00:39.629 INFO:tasks.workunit.client.0.smithi164.stdout:2/685: write d3/d32/d4e/d27/f74 [4813892,54966] 0 2024-02-10T00:00:39.630 INFO:tasks.workunit.client.0.smithi164.stdout:7/647: symlink d3/d11/d39/d44/dbd/ld7 0 2024-02-10T00:00:39.631 INFO:tasks.workunit.client.0.smithi164.stdout:5/704: symlink d7/d17/d79/dde/lea 0 2024-02-10T00:00:39.632 INFO:tasks.workunit.client.0.smithi164.stdout:3/550: rmdir d0/d1/d2/d17 39 2024-02-10T00:00:39.633 INFO:tasks.workunit.client.0.smithi164.stdout:9/604: truncate d6/d41/d8b/d24/f5c 777177 0 2024-02-10T00:00:39.634 INFO:tasks.workunit.client.0.smithi164.stdout:0/594: rmdir d6/d7/d14/da6 39 2024-02-10T00:00:39.634 INFO:tasks.workunit.client.1.smithi183.stdout:6/872: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c [4194304,4194304] 0 2024-02-10T00:00:39.634 INFO:tasks.workunit.client.1.smithi183.stdout:9/945: mknod d0/d3/d14/c12d 0 2024-02-10T00:00:39.635 INFO:tasks.workunit.client.1.smithi183.stdout:7/884: mkdir d0/d11/d88/d94/dff/d118 0 2024-02-10T00:00:39.635 INFO:tasks.workunit.client.0.smithi164.stdout:6/688: chown d0/f5 264 1 2024-02-10T00:00:39.635 INFO:tasks.workunit.client.0.smithi164.stdout:0/595: chown d6/d10/d18/d2d/l83 1852 1 2024-02-10T00:00:39.636 INFO:tasks.workunit.client.1.smithi183.stdout:3/801: symlink d7/d98/dc9/dd0/leb 0 2024-02-10T00:00:39.636 INFO:tasks.workunit.client.0.smithi164.stdout:2/686: symlink d3/da6/d7a/d8e/db6/dce/dad/lf6 0 2024-02-10T00:00:39.637 INFO:tasks.workunit.client.1.smithi183.stdout:5/998: getdents d4/d23/d3e/d80/da1/d9e/d89/dd4/deb 0 2024-02-10T00:00:39.637 INFO:tasks.workunit.client.1.smithi183.stdout:0/956: dwrite d14/d1d/d2d/d31/f3a [0,4194304] 0 2024-02-10T00:00:39.638 INFO:tasks.workunit.client.0.smithi164.stdout:5/705: creat d7/d17/d21/d24/feb x:0 0 0 2024-02-10T00:00:39.639 INFO:tasks.workunit.client.0.smithi164.stdout:4/631: creat d2/d19/d16/d31/dcf/fde x:0 0 0 2024-02-10T00:00:39.640 INFO:tasks.workunit.client.0.smithi164.stdout:4/632: write d2/d19/d16/d31/d7e/d81/f87 [4235036,55052] 0 2024-02-10T00:00:39.640 INFO:tasks.workunit.client.1.smithi183.stdout:7/885: creat d0/d2/d50/dad/df8/f119 x:0 0 0 2024-02-10T00:00:39.641 INFO:tasks.workunit.client.1.smithi183.stdout:7/886: dread - d0/d11/d2f/da3/fd5 zero size 2024-02-10T00:00:39.641 INFO:tasks.workunit.client.1.smithi183.stdout:9/946: creat d0/d3/d14/d1c/d2d/d4f/d89/f12e x:0 0 0 2024-02-10T00:00:39.643 INFO:tasks.workunit.client.1.smithi183.stdout:7/887: read d0/d2/d3/f90 [2809839,106736] 0 2024-02-10T00:00:39.645 INFO:tasks.workunit.client.1.smithi183.stdout:5/999: unlink d4/d23/d2a/lfa 0 2024-02-10T00:00:39.645 INFO:tasks.workunit.client.0.smithi164.stdout:8/619: write d2/f41 [90347,119044] 0 2024-02-10T00:00:39.646 INFO:tasks.workunit.client.1.smithi183.stdout:0/957: creat d14/d3e/dd4/f155 x:0 0 0 2024-02-10T00:00:39.648 INFO:tasks.workunit.client.0.smithi164.stdout:1/560: dwrite d1/d1a/d41/d18/f3e [0,4194304] 0 2024-02-10T00:00:39.649 INFO:tasks.workunit.client.0.smithi164.stdout:1/561: chown d1/d23/d37/lb8 34 1 2024-02-10T00:00:39.649 INFO:tasks.workunit.client.0.smithi164.stdout:1/562: readlink d1/d1a/d35/l5c 0 2024-02-10T00:00:39.649 INFO:tasks.workunit.client.1.smithi183.stdout:1/890: dwrite d0/d3/d67/d70/fa1 [0,4194304] 0 2024-02-10T00:00:39.650 INFO:tasks.workunit.client.1.smithi183.stdout:0/958: fdatasync d14/d1d/d2d/d31/f91 0 2024-02-10T00:00:39.650 INFO:tasks.workunit.client.1.smithi183.stdout:3/802: dwrite d7/db/d2a/d2d/fdf [0,4194304] 0 2024-02-10T00:00:39.653 INFO:tasks.workunit.client.1.smithi183.stdout:7/888: dwrite d0/d11/dc3/ff6 [0,4194304] 0 2024-02-10T00:00:39.654 INFO:tasks.workunit.client.1.smithi183.stdout:7/889: readlink d0/d11/d2f/dbf/lcd 0 2024-02-10T00:00:39.654 INFO:tasks.workunit.client.0.smithi164.stdout:3/551: rename d0/d1/d3c/d3d to d0/d1/d2/d19/d27/d5f/da5 0 2024-02-10T00:00:39.654 INFO:tasks.workunit.client.1.smithi183.stdout:6/873: link d2/d1a/d25/d3c/d31/d38/d3f/f4d d2/d1a/d25/d3c/d31/d38/d6e/f10d 0 2024-02-10T00:00:39.655 INFO:tasks.workunit.client.1.smithi183.stdout:7/890: write d0/d11/d3e/f49 [1447571,15724] 0 2024-02-10T00:00:39.655 INFO:tasks.workunit.client.0.smithi164.stdout:9/605: symlink d6/d41/lc4 0 2024-02-10T00:00:39.656 INFO:tasks.workunit.client.1.smithi183.stdout:7/891: rename d0/d11 to d0/d11/d2f/d64/d6b/d11a 22 2024-02-10T00:00:39.657 INFO:tasks.workunit.client.0.smithi164.stdout:7/648: mknod d3/d28/cd8 0 2024-02-10T00:00:39.657 INFO:tasks.workunit.client.1.smithi183.stdout:9/947: getdents d0/d3/d14/d1c/d2d/d4f 0 2024-02-10T00:00:39.658 INFO:tasks.workunit.client.0.smithi164.stdout:6/689: creat d0/d2b/d3a/dd0/fec x:0 0 0 2024-02-10T00:00:39.659 INFO:tasks.workunit.client.0.smithi164.stdout:6/690: fdatasync d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 0 2024-02-10T00:00:39.660 INFO:tasks.workunit.client.0.smithi164.stdout:6/691: write d0/d6/d12/f18 [6414898,78729] 0 2024-02-10T00:00:39.664 INFO:tasks.workunit.client.1.smithi183.stdout:9/948: dread d0/d3/d14/d1c/d2d/d4f/d79/fb3 [0,4194304] 0 2024-02-10T00:00:39.664 INFO:tasks.workunit.client.0.smithi164.stdout:4/633: chown d2/d2f/d37/d41/f6e 78263 1 2024-02-10T00:00:39.664 INFO:tasks.workunit.client.0.smithi164.stdout:8/620: creat d2/d64/d7d/fc1 x:0 0 0 2024-02-10T00:00:39.664 INFO:tasks.workunit.client.0.smithi164.stdout:8/621: fsync d2/d64/d65/d80/d32/d4d/f9f 0 2024-02-10T00:00:39.665 INFO:tasks.workunit.client.1.smithi183.stdout:6/874: truncate d2/d1a/d25/d3c/d31/d66/fdf 685782 0 2024-02-10T00:00:39.665 INFO:tasks.workunit.client.0.smithi164.stdout:8/622: dread - d2/d64/d65/d80/f86 zero size 2024-02-10T00:00:39.665 INFO:tasks.workunit.client.0.smithi164.stdout:6/692: dwrite d0/d6/d12/d14/d4b/dbf/fe8 [0,4194304] 0 2024-02-10T00:00:39.666 INFO:tasks.workunit.client.0.smithi164.stdout:5/706: rename d7/d17/d21/d23/d37/d36/l50 to d7/d17/d69/d92/de9/lec 0 2024-02-10T00:00:39.667 INFO:tasks.workunit.client.0.smithi164.stdout:8/623: write d2/d64/d65/d80/d32/d58/f5c [2984985,61475] 0 2024-02-10T00:00:39.668 INFO:tasks.workunit.client.0.smithi164.stdout:8/624: dread - d2/d64/d65/d80/d32/d4d/f9f zero size 2024-02-10T00:00:39.668 INFO:tasks.workunit.client.1.smithi183.stdout:9/949: getdents d0/d3/d14/d1c/d4b 0 2024-02-10T00:00:39.669 INFO:tasks.workunit.client.0.smithi164.stdout:3/552: unlink d0/d1/d2/d19/d27/d5f/da5/d6b/f74 0 2024-02-10T00:00:39.669 INFO:tasks.workunit.client.1.smithi183.stdout:9/950: chown d0/d10/f53 9 1 2024-02-10T00:00:39.669 INFO:tasks.workunit.client.0.smithi164.stdout:9/606: unlink d6/d41/d8b/d24/d4f/f98 0 2024-02-10T00:00:39.672 INFO:tasks.workunit.client.0.smithi164.stdout:5/707: dwrite d7/d17/d79/d7b/dc5/dd7/fe3 [0,4194304] 0 2024-02-10T00:00:39.673 INFO:tasks.workunit.client.1.smithi183.stdout:9/951: mkdir d0/d3/d14/d1c/d2d/d4f/da4/dda/ddf/d12f 0 2024-02-10T00:00:39.673 INFO:tasks.workunit.client.0.smithi164.stdout:7/649: creat d3/d5/d9b/fd9 x:0 0 0 2024-02-10T00:00:39.677 INFO:tasks.workunit.client.0.smithi164.stdout:2/687: dread d3/f6 [0,4194304] 0 2024-02-10T00:00:39.679 INFO:tasks.workunit.client.1.smithi183.stdout:6/875: rename d2/d1a/d25/d3c/f42 to d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f10e 0 2024-02-10T00:00:39.679 INFO:tasks.workunit.client.1.smithi183.stdout:9/952: chown d0/d3/cc8 43882 1 2024-02-10T00:00:39.680 INFO:tasks.workunit.client.0.smithi164.stdout:2/688: dwrite d3/f44 [0,4194304] 0 2024-02-10T00:00:39.681 INFO:tasks.workunit.client.0.smithi164.stdout:4/634: creat d2/d2f/d37/d45/dab/dbd/fdf x:0 0 0 2024-02-10T00:00:39.681 INFO:tasks.workunit.client.0.smithi164.stdout:1/563: mknod d1/d95/cc1 0 2024-02-10T00:00:39.684 INFO:tasks.workunit.client.1.smithi183.stdout:9/953: unlink d0/d3/d14/d74/cfa 0 2024-02-10T00:00:39.685 INFO:tasks.workunit.client.0.smithi164.stdout:6/693: creat d0/d6/d12/d14/d4b/fed x:0 0 0 2024-02-10T00:00:39.686 INFO:tasks.workunit.client.1.smithi183.stdout:9/954: creat d0/d3/f130 x:0 0 0 2024-02-10T00:00:39.687 INFO:tasks.workunit.client.1.smithi183.stdout:4/992: sync 2024-02-10T00:00:39.687 INFO:tasks.workunit.client.1.smithi183.stdout:9/955: rmdir d0/d3/d14/d1c/d4b 39 2024-02-10T00:00:39.690 INFO:tasks.workunit.client.1.smithi183.stdout:4/993: dread de/d14/d1d/d2f/d139/dcb/fe1 [0,4194304] 0 2024-02-10T00:00:39.692 INFO:tasks.workunit.client.1.smithi183.stdout:9/956: dwrite d0/d3/d14/d1c/d2d/d4f/d89/dc5/f128 [0,4194304] 0 2024-02-10T00:00:39.693 INFO:tasks.workunit.client.0.smithi164.stdout:1/564: mkdir d1/d13/d2b/d52/da4/dc2 0 2024-02-10T00:00:39.694 INFO:tasks.workunit.client.1.smithi183.stdout:4/994: rename de/d19/l77 to de/d14/d1d/d2f/da2/d9c/df5/l13e 0 2024-02-10T00:00:39.695 INFO:tasks.workunit.client.1.smithi183.stdout:9/957: write d0/d3/d14/f20 [170644,101669] 0 2024-02-10T00:00:39.696 INFO:tasks.workunit.client.0.smithi164.stdout:9/607: truncate d6/d41/f99 994510 0 2024-02-10T00:00:39.697 INFO:tasks.workunit.client.1.smithi183.stdout:4/995: symlink de/d14/d27/d40/d108/l13f 0 2024-02-10T00:00:39.697 INFO:tasks.workunit.client.0.smithi164.stdout:0/596: link d6/d10/d18/d2d/d35/d44/d90/fa9 d6/d10/fb5 0 2024-02-10T00:00:39.697 INFO:tasks.workunit.client.1.smithi183.stdout:4/996: stat de/d14/d27/d2e/d10d/l125 0 2024-02-10T00:00:39.698 INFO:tasks.workunit.client.0.smithi164.stdout:2/689: fsync d3/d26/d56/fa4 0 2024-02-10T00:00:39.699 INFO:tasks.workunit.client.1.smithi183.stdout:4/997: chown de/d19/d20/de6/df7/f13b 2619161 1 2024-02-10T00:00:39.699 INFO:tasks.workunit.client.1.smithi183.stdout:9/958: rename d0/d3/d14/d1c/d2d/d4f/fb1 to d0/d3/d14/d3c/d7b/f131 0 2024-02-10T00:00:39.700 INFO:tasks.workunit.client.1.smithi183.stdout:0/959: dread d14/d1d/d2d/d31/d6c/d70/f125 [0,4194304] 0 2024-02-10T00:00:39.700 INFO:tasks.workunit.client.1.smithi183.stdout:4/998: chown de/d19/d20/fba 85 1 2024-02-10T00:00:39.700 INFO:tasks.workunit.client.0.smithi164.stdout:8/625: link d2/d64/l6d d2/d64/lc2 0 2024-02-10T00:00:39.701 INFO:tasks.workunit.client.1.smithi183.stdout:4/999: chown de/d14/d27/d40/l123 13 1 2024-02-10T00:00:39.703 INFO:tasks.workunit.client.0.smithi164.stdout:5/708: link d7/d17/d21/f58 d7/d17/d21/d23/d5a/d68/d1f/fed 0 2024-02-10T00:00:39.703 INFO:tasks.workunit.client.1.smithi183.stdout:9/959: creat d0/d30/d52/ddc/de1/f132 x:0 0 0 2024-02-10T00:00:39.703 INFO:tasks.workunit.client.1.smithi183.stdout:9/960: stat d0/d3/d14 0 2024-02-10T00:00:39.704 INFO:tasks.workunit.client.1.smithi183.stdout:0/960: mknod d14/d3e/d5f/daa/ddd/d130/c156 0 2024-02-10T00:00:39.704 INFO:tasks.workunit.client.1.smithi183.stdout:0/961: write d14/d1d/d2d/d31/f91 [5239835,97525] 0 2024-02-10T00:00:39.705 INFO:tasks.workunit.client.0.smithi164.stdout:2/690: creat d3/da6/d7a/d8e/ff7 x:0 0 0 2024-02-10T00:00:39.706 INFO:tasks.workunit.client.0.smithi164.stdout:6/694: creat d0/d2b/fee x:0 0 0 2024-02-10T00:00:39.707 INFO:tasks.workunit.client.1.smithi183.stdout:0/962: mknod d14/d1d/d55/dfa/c157 0 2024-02-10T00:00:39.709 INFO:tasks.workunit.client.0.smithi164.stdout:0/597: getdents d6/d10/d4a/d88 0 2024-02-10T00:00:39.709 INFO:tasks.workunit.client.1.smithi183.stdout:0/963: mkdir d14/d1d/d96/da0/d158 0 2024-02-10T00:00:39.709 INFO:tasks.workunit.client.0.smithi164.stdout:0/598: read d6/d3a/d52/f75 [448161,129767] 0 2024-02-10T00:00:39.711 INFO:tasks.workunit.client.1.smithi183.stdout:6/876: dread d2/fc0 [0,4194304] 0 2024-02-10T00:00:39.711 INFO:tasks.workunit.client.0.smithi164.stdout:5/709: symlink d7/lee 0 2024-02-10T00:00:39.711 INFO:tasks.workunit.client.0.smithi164.stdout:9/608: link d6/de/f11 d6/de/d22/d58/dba/d61/d76/da5/fc5 0 2024-02-10T00:00:39.712 INFO:tasks.workunit.client.0.smithi164.stdout:2/691: dread d3/da6/d7a/d8e/d36/f96 [0,4194304] 0 2024-02-10T00:00:39.712 INFO:tasks.workunit.client.1.smithi183.stdout:0/964: link d14/d1d/d2d/d31/d68/da3/lef d14/d1d/d59/d71/db4/l159 0 2024-02-10T00:00:39.713 INFO:tasks.workunit.client.1.smithi183.stdout:6/877: fsync d2/d1a/d25/d3c/d31/d38/d6e/d34/fe4 0 2024-02-10T00:00:39.713 INFO:tasks.workunit.client.0.smithi164.stdout:5/710: dread - d7/d17/d21/d23/d37/d36/fca zero size 2024-02-10T00:00:39.714 INFO:tasks.workunit.client.1.smithi183.stdout:0/965: symlink d14/d1d/d96/da0/l15a 0 2024-02-10T00:00:39.714 INFO:tasks.workunit.client.1.smithi183.stdout:6/878: chown d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/fb1 1530067 1 2024-02-10T00:00:39.715 INFO:tasks.workunit.client.0.smithi164.stdout:9/609: unlink d6/de/d40/f46 0 2024-02-10T00:00:39.715 INFO:tasks.workunit.client.1.smithi183.stdout:0/966: chown d14/d1d/d59/d71/d22/c5b 166 1 2024-02-10T00:00:39.715 INFO:tasks.workunit.client.0.smithi164.stdout:0/599: getdents d6/d10/d18/d1c 0 2024-02-10T00:00:39.718 INFO:tasks.workunit.client.0.smithi164.stdout:5/711: fsync d7/d17/d21/d24/dbc/d43/f6e 0 2024-02-10T00:00:39.718 INFO:tasks.workunit.client.0.smithi164.stdout:2/692: creat d3/d24/df0/ff8 x:0 0 0 2024-02-10T00:00:39.718 INFO:tasks.workunit.client.1.smithi183.stdout:0/967: dread d14/d3e/d5f/daa/de6/f151 [0,4194304] 0 2024-02-10T00:00:39.719 INFO:tasks.workunit.client.0.smithi164.stdout:9/610: fdatasync d6/d41/d8b/f1f 0 2024-02-10T00:00:39.720 INFO:tasks.workunit.client.0.smithi164.stdout:0/600: creat d6/d3a/d52/fb6 x:0 0 0 2024-02-10T00:00:39.722 INFO:tasks.workunit.client.0.smithi164.stdout:5/712: mkdir d7/d17/d79/dde/def 0 2024-02-10T00:00:39.727 INFO:tasks.workunit.client.1.smithi183.stdout:7/892: write d0/d11/d88/f91 [850788,32438] 0 2024-02-10T00:00:39.730 INFO:tasks.workunit.client.1.smithi183.stdout:7/893: read d0/d2/d50/d5d/f55 [742524,45290] 0 2024-02-10T00:00:39.731 INFO:tasks.workunit.client.1.smithi183.stdout:1/891: dwrite d0/d3/f2d [0,4194304] 0 2024-02-10T00:00:39.732 INFO:tasks.workunit.client.1.smithi183.stdout:3/803: dwrite d7/db/d2a/d2d/f9b [0,4194304] 0 2024-02-10T00:00:39.734 INFO:tasks.workunit.client.0.smithi164.stdout:9/611: mknod d6/de/d40/cc6 0 2024-02-10T00:00:39.737 INFO:tasks.workunit.client.0.smithi164.stdout:3/553: write d0/f10 [1653377,22354] 0 2024-02-10T00:00:39.737 INFO:tasks.workunit.client.0.smithi164.stdout:7/650: write d3/d11/d39/d44/fad [1170830,893] 0 2024-02-10T00:00:39.740 INFO:tasks.workunit.client.1.smithi183.stdout:6/879: truncate d2/d1a/d25/d3c/d31/d38/d6e/d34/fe4 844621 0 2024-02-10T00:00:39.741 INFO:tasks.workunit.client.1.smithi183.stdout:0/968: truncate d14/d1d/d55/f110 298723 0 2024-02-10T00:00:39.741 INFO:tasks.workunit.client.1.smithi183.stdout:6/880: read - d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/fdd zero size 2024-02-10T00:00:39.742 INFO:tasks.workunit.client.0.smithi164.stdout:4/635: truncate d2/f1a 1484003 0 2024-02-10T00:00:39.742 INFO:tasks.workunit.client.0.smithi164.stdout:1/565: write d1/d13/d1f/fac [1066508,26942] 0 2024-02-10T00:00:39.744 INFO:tasks.workunit.client.1.smithi183.stdout:7/894: creat d0/d11/d88/d94/dff/f11b x:0 0 0 2024-02-10T00:00:39.744 INFO:tasks.workunit.client.1.smithi183.stdout:7/895: chown d0/d2/d4/d8/c48 211759 1 2024-02-10T00:00:39.746 INFO:tasks.workunit.client.1.smithi183.stdout:1/892: creat d0/d3/d67/d70/dae/dc6/f12f x:0 0 0 2024-02-10T00:00:39.748 INFO:tasks.workunit.client.0.smithi164.stdout:8/626: dread d2/f11 [4194304,4194304] 0 2024-02-10T00:00:39.748 INFO:tasks.workunit.client.1.smithi183.stdout:0/969: mkdir d14/d1d/d96/da0/d15b 0 2024-02-10T00:00:39.750 INFO:tasks.workunit.client.0.smithi164.stdout:2/693: symlink d3/d32/d4e/lf9 0 2024-02-10T00:00:39.750 INFO:tasks.workunit.client.0.smithi164.stdout:8/627: chown d2/d64/d65/d80/d32/d4d/l8b 0 1 2024-02-10T00:00:39.751 INFO:tasks.workunit.client.1.smithi183.stdout:7/896: mkdir d0/d2/d50/dd1/d11c 0 2024-02-10T00:00:39.753 INFO:tasks.workunit.client.0.smithi164.stdout:6/695: dwrite d0/d6/d12/d45/f77 [4194304,4194304] 0 2024-02-10T00:00:39.753 INFO:tasks.workunit.client.0.smithi164.stdout:9/612: creat d6/de/d22/d58/dba/d61/d76/fc7 x:0 0 0 2024-02-10T00:00:39.753 INFO:tasks.workunit.client.0.smithi164.stdout:8/628: chown d2/d64/d65/d80/d32/d58/f5c 1909346 1 2024-02-10T00:00:39.754 INFO:tasks.workunit.client.1.smithi183.stdout:3/804: creat d7/fec x:0 0 0 2024-02-10T00:00:39.754 INFO:tasks.workunit.client.0.smithi164.stdout:1/566: mkdir d1/d13/d2b/d52/da4/dc3 0 2024-02-10T00:00:39.756 INFO:tasks.workunit.client.1.smithi183.stdout:0/970: creat d14/d1d/d2d/d31/d68/d129/f15c x:0 0 0 2024-02-10T00:00:39.756 INFO:tasks.workunit.client.0.smithi164.stdout:6/696: dread d0/f17 [0,4194304] 0 2024-02-10T00:00:39.757 INFO:tasks.workunit.client.1.smithi183.stdout:0/971: fsync d14/d1d/f11e 0 2024-02-10T00:00:39.758 INFO:tasks.workunit.client.0.smithi164.stdout:8/629: read d2/f49 [2435751,109609] 0 2024-02-10T00:00:39.759 INFO:tasks.workunit.client.0.smithi164.stdout:9/613: chown d6/d41/f99 347367050 1 2024-02-10T00:00:39.760 INFO:tasks.workunit.client.1.smithi183.stdout:6/881: rename d2/d1a/d25/f109 to d2/d1a/d25/d3c/d31/d38/d6e/ded/f10f 0 2024-02-10T00:00:39.761 INFO:tasks.workunit.client.1.smithi183.stdout:3/805: truncate d7/db/d2a/d1c/f1e 853564 0 2024-02-10T00:00:39.762 INFO:tasks.workunit.client.0.smithi164.stdout:7/651: rename d3/d4d to d3/d5/d2b/dab/dda 0 2024-02-10T00:00:39.766 INFO:tasks.workunit.client.1.smithi183.stdout:6/882: mkdir d2/d1a/d25/d3c/d31/d38/d110 0 2024-02-10T00:00:39.767 INFO:tasks.workunit.client.1.smithi183.stdout:6/883: fsync d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fbf 0 2024-02-10T00:00:39.767 INFO:tasks.workunit.client.1.smithi183.stdout:1/893: getdents d0/d3/d67/d70/dae 0 2024-02-10T00:00:39.768 INFO:tasks.workunit.client.1.smithi183.stdout:0/972: creat d14/d3e/d5f/daa/ddd/d103/f15d x:0 0 0 2024-02-10T00:00:39.768 INFO:tasks.workunit.client.1.smithi183.stdout:9/961: link d0/d3/d14/d1c/d2d/d4f/db8/l117 d0/d3/d14/d1c/d2d/d4f/db8/de7/d100/l133 0 2024-02-10T00:00:39.769 INFO:tasks.workunit.client.1.smithi183.stdout:7/897: getdents d0/d11/d9d 0 2024-02-10T00:00:39.770 INFO:tasks.workunit.client.1.smithi183.stdout:0/973: write d14/d1d/d2d/f10e [830953,23902] 0 2024-02-10T00:00:39.771 INFO:tasks.workunit.client.1.smithi183.stdout:1/894: mknod d0/d3c/dc9/c130 0 2024-02-10T00:00:39.773 INFO:tasks.workunit.client.1.smithi183.stdout:6/884: rename d2/d1a/d25/d3c/d8d/fe9 to d2/d1a/d25/d3c/f111 0 2024-02-10T00:00:39.774 INFO:tasks.workunit.client.1.smithi183.stdout:3/806: creat d7/db/d2a/fed x:0 0 0 2024-02-10T00:00:39.775 INFO:tasks.workunit.client.1.smithi183.stdout:7/898: fsync d0/d2/d50/ff1 0 2024-02-10T00:00:39.777 INFO:tasks.workunit.client.1.smithi183.stdout:0/974: symlink d14/d3e/d5f/daa/ddd/d103/l15e 0 2024-02-10T00:00:39.781 INFO:tasks.workunit.client.1.smithi183.stdout:1/895: symlink d0/d3/d67/d70/dae/l131 0 2024-02-10T00:00:39.786 INFO:tasks.workunit.client.1.smithi183.stdout:9/962: mkdir d0/d3/d14/d1c/d109/d134 0 2024-02-10T00:00:39.786 INFO:tasks.workunit.client.1.smithi183.stdout:3/807: rmdir d7/d98/dc9/dd0 39 2024-02-10T00:00:39.788 INFO:tasks.workunit.client.0.smithi164.stdout:3/554: truncate d0/d1/d2/d19/d27/f2c 5189588 0 2024-02-10T00:00:39.789 INFO:tasks.workunit.client.0.smithi164.stdout:8/630: symlink d2/d64/d65/d80/d32/d99/d9e/lc3 0 2024-02-10T00:00:39.789 INFO:tasks.workunit.client.0.smithi164.stdout:2/694: rename d3/da6/d7a/d8e/d36/d90/l9a to d3/d24/d5b/lfa 0 2024-02-10T00:00:39.789 INFO:tasks.workunit.client.0.smithi164.stdout:7/652: creat d3/d5/d9b/daa/fdb x:0 0 0 2024-02-10T00:00:39.790 INFO:tasks.workunit.client.0.smithi164.stdout:2/695: chown d3/d32 17862898 1 2024-02-10T00:00:39.792 INFO:tasks.workunit.client.1.smithi183.stdout:1/896: read d0/d3/d7/f23 [2540039,402] 0 2024-02-10T00:00:39.793 INFO:tasks.workunit.client.1.smithi183.stdout:3/808: readlink d7/l15 0 2024-02-10T00:00:39.793 INFO:tasks.workunit.client.1.smithi183.stdout:1/897: dread - d0/d3/d29/dc4/fd6 zero size 2024-02-10T00:00:39.794 INFO:tasks.workunit.client.0.smithi164.stdout:4/636: getdents d2/d19/d16/d31/dcf 0 2024-02-10T00:00:39.794 INFO:tasks.workunit.client.0.smithi164.stdout:3/555: symlink d0/d1/d2/d19/la6 0 2024-02-10T00:00:39.795 INFO:tasks.workunit.client.0.smithi164.stdout:0/601: getdents d6/d3a/d97 0 2024-02-10T00:00:39.795 INFO:tasks.workunit.client.1.smithi183.stdout:0/975: symlink d14/d1d/d59/d71/d134/l15f 0 2024-02-10T00:00:39.797 INFO:tasks.workunit.client.0.smithi164.stdout:2/696: creat d3/da6/d7a/ffb x:0 0 0 2024-02-10T00:00:39.797 INFO:tasks.workunit.client.0.smithi164.stdout:4/637: stat d2/d19/d16/d31/fb8 0 2024-02-10T00:00:39.797 INFO:tasks.workunit.client.0.smithi164.stdout:7/653: truncate d3/d26/f95 625673 0 2024-02-10T00:00:39.797 INFO:tasks.workunit.client.1.smithi183.stdout:9/963: mkdir d0/d3/d14/d1c/d4b/d97/daa/d135 0 2024-02-10T00:00:39.798 INFO:tasks.workunit.client.1.smithi183.stdout:6/885: truncate d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/f6c 4973360 0 2024-02-10T00:00:39.799 INFO:tasks.workunit.client.0.smithi164.stdout:5/713: dwrite d7/d17/d21/d24/f3d [0,4194304] 0 2024-02-10T00:00:39.800 INFO:tasks.workunit.client.1.smithi183.stdout:1/898: creat d0/d3/d67/d70/f132 x:0 0 0 2024-02-10T00:00:39.800 INFO:tasks.workunit.client.0.smithi164.stdout:8/631: dwrite d2/d64/d54/f7c [0,4194304] 0 2024-02-10T00:00:39.800 INFO:tasks.workunit.client.0.smithi164.stdout:3/556: fdatasync d0/d1/d2/d17/d37/f69 0 2024-02-10T00:00:39.803 INFO:tasks.workunit.client.0.smithi164.stdout:0/602: mkdir d6/d10/d18/d2d/d39/db7 0 2024-02-10T00:00:39.804 INFO:tasks.workunit.client.1.smithi183.stdout:3/809: creat d7/db/d2a/d4d/fee x:0 0 0 2024-02-10T00:00:39.805 INFO:tasks.workunit.client.1.smithi183.stdout:3/810: fsync d7/db/fba 0 2024-02-10T00:00:39.805 INFO:tasks.workunit.client.1.smithi183.stdout:1/899: creat d0/d3/d67/d70/f133 x:0 0 0 2024-02-10T00:00:39.806 INFO:tasks.workunit.client.1.smithi183.stdout:7/899: link d0/d11/le7 d0/d2/d4/l11d 0 2024-02-10T00:00:39.806 INFO:tasks.workunit.client.0.smithi164.stdout:9/614: dread d6/d41/d8b/d24/d4f/f8a [0,4194304] 0 2024-02-10T00:00:39.806 INFO:tasks.workunit.client.0.smithi164.stdout:3/557: readlink d0/d1/d2/d19/d66/d81/l8a 0 2024-02-10T00:00:39.806 INFO:tasks.workunit.client.1.smithi183.stdout:7/900: write d0/d2/d4/f10f [77249,15572] 0 2024-02-10T00:00:39.807 INFO:tasks.workunit.client.1.smithi183.stdout:7/901: fdatasync d0/d2/d50/ff1 0 2024-02-10T00:00:39.807 INFO:tasks.workunit.client.0.smithi164.stdout:5/714: write d7/d17/d79/fdc [1421892,122192] 0 2024-02-10T00:00:39.808 INFO:tasks.workunit.client.1.smithi183.stdout:0/976: link d14/d1d/d2d/d31/d6c/d70/fd6 d14/d3e/d5f/daa/de6/f160 0 2024-02-10T00:00:39.808 INFO:tasks.workunit.client.0.smithi164.stdout:2/697: creat d3/d24/ffc x:0 0 0 2024-02-10T00:00:39.810 INFO:tasks.workunit.client.1.smithi183.stdout:6/886: mknod d2/d1a/d25/d3c/d31/d38/d6e/ded/c112 0 2024-02-10T00:00:39.811 INFO:tasks.workunit.client.1.smithi183.stdout:6/887: dread - d2/f108 zero size 2024-02-10T00:00:39.811 INFO:tasks.workunit.client.0.smithi164.stdout:6/697: dread d0/d2b/d3a/dd0/f44 [0,4194304] 0 2024-02-10T00:00:39.811 INFO:tasks.workunit.client.0.smithi164.stdout:7/654: dwrite d3/d11/d39/f8d [0,4194304] 0 2024-02-10T00:00:39.812 INFO:tasks.workunit.client.0.smithi164.stdout:5/715: write d7/d17/d21/d23/d37/f93 [1298796,32141] 0 2024-02-10T00:00:39.813 INFO:tasks.workunit.client.0.smithi164.stdout:0/603: dwrite d6/d7/f58 [0,4194304] 0 2024-02-10T00:00:39.815 INFO:tasks.workunit.client.0.smithi164.stdout:8/632: rename d2/c6 to d2/d64/d54/db9/cc4 0 2024-02-10T00:00:39.816 INFO:tasks.workunit.client.0.smithi164.stdout:8/633: write d2/d64/f97 [9059,36350] 0 2024-02-10T00:00:39.818 INFO:tasks.workunit.client.0.smithi164.stdout:7/655: creat d3/d26/d67/d98/daf/fdc x:0 0 0 2024-02-10T00:00:39.819 INFO:tasks.workunit.client.1.smithi183.stdout:6/888: unlink d2/f65 0 2024-02-10T00:00:39.819 INFO:tasks.workunit.client.1.smithi183.stdout:3/811: readlink d7/db/d2a/d2d/d51/lcf 0 2024-02-10T00:00:39.819 INFO:tasks.workunit.client.0.smithi164.stdout:2/698: mkdir d3/d26/dfd 0 2024-02-10T00:00:39.820 INFO:tasks.workunit.client.1.smithi183.stdout:7/902: mknod d0/d11/c11e 0 2024-02-10T00:00:39.820 INFO:tasks.workunit.client.1.smithi183.stdout:6/889: write d2/d1a/d25/d3c/d8d/fb7 [3620073,1675] 0 2024-02-10T00:00:39.821 INFO:tasks.workunit.client.0.smithi164.stdout:1/567: sync 2024-02-10T00:00:39.822 INFO:tasks.workunit.client.0.smithi164.stdout:6/698: read d0/f5 [3024990,7960] 0 2024-02-10T00:00:39.822 INFO:tasks.workunit.client.0.smithi164.stdout:3/558: link d0/d1/d2/d19/f39 d0/d1/d2/d17/d37/d3f/d4e/d6d/fa7 0 2024-02-10T00:00:39.824 INFO:tasks.workunit.client.1.smithi183.stdout:3/812: dwrite d7/db/d2a/d4d/d63/fd1 [0,4194304] 0 2024-02-10T00:00:39.825 INFO:tasks.workunit.client.1.smithi183.stdout:7/903: unlink d0/d2/d50/dad/f61 0 2024-02-10T00:00:39.826 INFO:tasks.workunit.client.0.smithi164.stdout:2/699: symlink d3/d24/d5b/dd9/lfe 0 2024-02-10T00:00:39.826 INFO:tasks.workunit.client.0.smithi164.stdout:1/568: dread - d1/fa1 zero size 2024-02-10T00:00:39.827 INFO:tasks.workunit.client.0.smithi164.stdout:8/634: creat d2/d64/d65/d80/d32/db2/fc5 x:0 0 0 2024-02-10T00:00:39.828 INFO:tasks.workunit.client.1.smithi183.stdout:0/977: link d14/d1d/d96/f135 d14/d3e/d5f/daa/ddd/d121/f161 0 2024-02-10T00:00:39.828 INFO:tasks.workunit.client.0.smithi164.stdout:8/635: chown d2/d64/d65/d80/d32/d99/da0/cae 11942880 1 2024-02-10T00:00:39.829 INFO:tasks.workunit.client.0.smithi164.stdout:6/699: mkdir d0/d2b/d3a/dd0/d93/db4/def 0 2024-02-10T00:00:39.829 INFO:tasks.workunit.client.0.smithi164.stdout:0/604: dread d6/d3a/d52/d7a/f94 [0,4194304] 0 2024-02-10T00:00:39.829 INFO:tasks.workunit.client.1.smithi183.stdout:6/890: fdatasync d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/f99 0 2024-02-10T00:00:39.829 INFO:tasks.workunit.client.0.smithi164.stdout:8/636: chown d2/d64/d65/d80/d32/d68 15201626 1 2024-02-10T00:00:39.830 INFO:tasks.workunit.client.0.smithi164.stdout:3/559: creat d0/d1/d2/d17/d37/fa8 x:0 0 0 2024-02-10T00:00:39.831 INFO:tasks.workunit.client.0.smithi164.stdout:5/716: rmdir d7/d17/d79/dd2 0 2024-02-10T00:00:39.833 INFO:tasks.workunit.client.0.smithi164.stdout:5/717: fdatasync d7/d17/d21/d23/d5a/d68/d1f/fa5 0 2024-02-10T00:00:39.834 INFO:tasks.workunit.client.0.smithi164.stdout:2/700: rmdir d3/da6/d7a/d8e/db6 39 2024-02-10T00:00:39.834 INFO:tasks.workunit.client.0.smithi164.stdout:1/569: creat d1/d64/fc4 x:0 0 0 2024-02-10T00:00:39.834 INFO:tasks.workunit.client.0.smithi164.stdout:8/637: dwrite d2/d64/d54/f7c [0,4194304] 0 2024-02-10T00:00:39.836 INFO:tasks.workunit.client.1.smithi183.stdout:0/978: truncate d14/d3e/d5f/daa/ddd/f141 422426 0 2024-02-10T00:00:39.836 INFO:tasks.workunit.client.0.smithi164.stdout:1/570: write d1/f1b [4352297,34630] 0 2024-02-10T00:00:39.837 INFO:tasks.workunit.client.0.smithi164.stdout:2/701: chown d3/da6/d7a/d8e/d88/ca9 117 1 2024-02-10T00:00:39.838 INFO:tasks.workunit.client.1.smithi183.stdout:6/891: creat d2/d1a/d25/d3c/d31/d38/d6e/f113 x:0 0 0 2024-02-10T00:00:39.841 INFO:tasks.workunit.client.0.smithi164.stdout:7/656: rmdir d3/d5/d9b/db7/db6 0 2024-02-10T00:00:39.842 INFO:tasks.workunit.client.0.smithi164.stdout:4/638: dwrite d2/d19/d16/d31/d6d/fd5 [0,4194304] 0 2024-02-10T00:00:39.842 INFO:tasks.workunit.client.1.smithi183.stdout:0/979: creat d14/d1d/d59/d71/f162 x:0 0 0 2024-02-10T00:00:39.843 INFO:tasks.workunit.client.0.smithi164.stdout:4/639: stat d2/d2f/f21 0 2024-02-10T00:00:39.843 INFO:tasks.workunit.client.0.smithi164.stdout:9/615: dwrite d6/d41/d8b/d24/f45 [0,4194304] 0 2024-02-10T00:00:39.845 INFO:tasks.workunit.client.1.smithi183.stdout:6/892: rename d2/d1a/f49 to d2/d1a/d25/f114 0 2024-02-10T00:00:39.845 INFO:tasks.workunit.client.1.smithi183.stdout:6/893: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe 55703683 1 2024-02-10T00:00:39.848 INFO:tasks.workunit.client.0.smithi164.stdout:7/657: dwrite d3/d11/d39/d44/d48/d50/d92/f99 [0,4194304] 0 2024-02-10T00:00:39.848 INFO:tasks.workunit.client.0.smithi164.stdout:8/638: creat d2/d64/d65/d80/d32/d68/dac/fc6 x:0 0 0 2024-02-10T00:00:39.852 INFO:tasks.workunit.client.0.smithi164.stdout:0/605: creat d6/d10/d18/d2d/fb8 x:0 0 0 2024-02-10T00:00:39.856 INFO:tasks.workunit.client.0.smithi164.stdout:9/616: chown d6/ca 22601537 1 2024-02-10T00:00:39.860 INFO:tasks.workunit.client.0.smithi164.stdout:2/702: unlink d3/l1d 0 2024-02-10T00:00:39.860 INFO:tasks.workunit.client.0.smithi164.stdout:7/658: unlink d3/d26/d67/cc6 0 2024-02-10T00:00:39.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/639: dread d2/d64/d63/f70 [0,4194304] 0 2024-02-10T00:00:39.861 INFO:tasks.workunit.client.0.smithi164.stdout:8/640: chown d2/d64/l23 540027 1 2024-02-10T00:00:39.861 INFO:tasks.workunit.client.0.smithi164.stdout:4/640: symlink d2/d5a/le0 0 2024-02-10T00:00:39.863 INFO:tasks.workunit.client.0.smithi164.stdout:9/617: rename d6/de/d40/d74/f93 to d6/de/d22/d58/dba/d75/dc0/fc8 0 2024-02-10T00:00:39.866 INFO:tasks.workunit.client.0.smithi164.stdout:9/618: dread d6/d41/d8b/d24/f4d [4194304,4194304] 0 2024-02-10T00:00:39.867 INFO:tasks.workunit.client.0.smithi164.stdout:2/703: unlink d3/d32/d4e/d27/ff1 0 2024-02-10T00:00:39.869 INFO:tasks.workunit.client.0.smithi164.stdout:8/641: write d2/d64/d65/d80/d82/f84 [555901,34710] 0 2024-02-10T00:00:39.869 INFO:tasks.workunit.client.0.smithi164.stdout:8/642: stat d2/d64/d54/d71/cb3 0 2024-02-10T00:00:39.870 INFO:tasks.workunit.client.0.smithi164.stdout:4/641: unlink d2/d2f/d37/d41/f3e 0 2024-02-10T00:00:39.870 INFO:tasks.workunit.client.0.smithi164.stdout:8/643: chown d2/d64/d65/d80/d32/d68/dac 27 1 2024-02-10T00:00:39.871 INFO:tasks.workunit.client.0.smithi164.stdout:0/606: link d6/d10/d18/d2d/c8c d6/d10/d18/d2d/d39/db7/cb9 0 2024-02-10T00:00:39.873 INFO:tasks.workunit.client.0.smithi164.stdout:2/704: readlink d3/d24/lcb 0 2024-02-10T00:00:39.874 INFO:tasks.workunit.client.0.smithi164.stdout:4/642: write d2/d2f/d37/d71/fba [407908,27030] 0 2024-02-10T00:00:39.876 INFO:tasks.workunit.client.0.smithi164.stdout:0/607: creat d6/d10/d4a/d88/fba x:0 0 0 2024-02-10T00:00:39.886 INFO:tasks.workunit.client.1.smithi183.stdout:0/980: dread d14/d1d/d59/d71/fc3 [0,4194304] 0 2024-02-10T00:00:39.886 INFO:tasks.workunit.client.0.smithi164.stdout:7/659: rename d3/d26/f95 to d3/d28/fdd 0 2024-02-10T00:00:39.886 INFO:tasks.workunit.client.0.smithi164.stdout:4/643: symlink d2/d19/d16/le1 0 2024-02-10T00:00:39.887 INFO:tasks.workunit.client.0.smithi164.stdout:0/608: stat d6/d10/d18/fa8 0 2024-02-10T00:00:39.887 INFO:tasks.workunit.client.0.smithi164.stdout:9/619: dread d6/de/d2b/f67 [0,4194304] 0 2024-02-10T00:00:39.888 INFO:tasks.workunit.client.1.smithi183.stdout:0/981: mknod d14/d1d/d2d/d31/d68/d129/c163 0 2024-02-10T00:00:39.888 INFO:tasks.workunit.client.1.smithi183.stdout:3/813: dread d7/db/d2a/f88 [0,4194304] 0 2024-02-10T00:00:39.888 INFO:tasks.workunit.client.1.smithi183.stdout:0/982: chown d14/d3e/d92/f58 23852 1 2024-02-10T00:00:39.890 INFO:tasks.workunit.client.0.smithi164.stdout:2/705: dwrite d3/d32/fa0 [0,4194304] 0 2024-02-10T00:00:39.892 INFO:tasks.workunit.client.0.smithi164.stdout:0/609: mknod d6/d7/d14/d79/da2/cbb 0 2024-02-10T00:00:39.892 INFO:tasks.workunit.client.1.smithi183.stdout:0/983: mknod d14/d3e/d5f/daa/c164 0 2024-02-10T00:00:39.893 INFO:tasks.workunit.client.0.smithi164.stdout:0/610: write d6/d10/d66/f6a [1410220,55241] 0 2024-02-10T00:00:39.893 INFO:tasks.workunit.client.0.smithi164.stdout:0/611: chown d6/d3a/d52 118512820 1 2024-02-10T00:00:39.896 INFO:tasks.workunit.client.1.smithi183.stdout:0/984: dwrite d14/d43/f122 [0,4194304] 0 2024-02-10T00:00:39.896 INFO:tasks.workunit.client.1.smithi183.stdout:3/814: link d7/db/d2a/d33/f37 d7/db/d2a/d2d/d51/db3/fef 0 2024-02-10T00:00:39.897 INFO:tasks.workunit.client.0.smithi164.stdout:7/660: getdents d3/d5/d2b/d4a 0 2024-02-10T00:00:39.898 INFO:tasks.workunit.client.0.smithi164.stdout:9/620: truncate d6/de/d22/d58/dba/f8d 12660 0 2024-02-10T00:00:39.898 INFO:tasks.workunit.client.0.smithi164.stdout:7/661: write d3/d28/f61 [1303532,31369] 0 2024-02-10T00:00:39.899 INFO:tasks.workunit.client.0.smithi164.stdout:0/612: creat d6/d3a/d52/fbc x:0 0 0 2024-02-10T00:00:39.899 INFO:tasks.workunit.client.0.smithi164.stdout:2/706: link d3/l4 d3/d26/d64/lff 0 2024-02-10T00:00:39.903 INFO:tasks.workunit.client.0.smithi164.stdout:7/662: unlink d3/d26/d67/d98/daf/fdc 0 2024-02-10T00:00:39.903 INFO:tasks.workunit.client.1.smithi183.stdout:0/985: rmdir d14/d1d/d59/d3c/d93 39 2024-02-10T00:00:39.903 INFO:tasks.workunit.client.1.smithi183.stdout:3/815: mknod d7/db/d2a/d4d/cf0 0 2024-02-10T00:00:39.903 INFO:tasks.workunit.client.1.smithi183.stdout:6/894: sync 2024-02-10T00:00:39.903 INFO:tasks.workunit.client.1.smithi183.stdout:0/986: chown d14/d3e/d5f/daa/ddd/lec 693 1 2024-02-10T00:00:39.911 INFO:tasks.workunit.client.1.smithi183.stdout:1/900: write d0/d3c/fed [919977,50160] 0 2024-02-10T00:00:39.911 INFO:tasks.workunit.client.0.smithi164.stdout:6/700: truncate d0/d6/f59 839550 0 2024-02-10T00:00:39.913 INFO:tasks.workunit.client.0.smithi164.stdout:6/701: write d0/d3b/d56/fd6 [3158603,8489] 0 2024-02-10T00:00:39.914 INFO:tasks.workunit.client.1.smithi183.stdout:9/964: dwrite d0/d3/d14/d1c/d2d/d4f/d79/f80 [0,4194304] 0 2024-02-10T00:00:39.915 INFO:tasks.workunit.client.0.smithi164.stdout:3/560: truncate d0/d1/d2/d17/d37/d3f/d4e/d6d/f65 13403 0 2024-02-10T00:00:39.915 INFO:tasks.workunit.client.0.smithi164.stdout:0/613: write d6/d10/d18/d2d/f8f [421309,75059] 0 2024-02-10T00:00:39.917 INFO:tasks.workunit.client.0.smithi164.stdout:5/718: dwrite d7/d17/d21/d23/d37/d36/f81 [0,4194304] 0 2024-02-10T00:00:39.918 INFO:tasks.workunit.client.0.smithi164.stdout:0/614: chown d6/d10/d18/d2d 6664 1 2024-02-10T00:00:39.918 INFO:tasks.workunit.client.1.smithi183.stdout:1/901: symlink d0/d3/d67/d7b/dfe/d7c/l134 0 2024-02-10T00:00:39.919 INFO:tasks.workunit.client.0.smithi164.stdout:4/644: dread d2/d19/d16/d31/f36 [0,4194304] 0 2024-02-10T00:00:39.919 INFO:tasks.workunit.client.1.smithi183.stdout:7/904: dwrite d0/d2/d4/d8/f4d [0,4194304] 0 2024-02-10T00:00:39.920 INFO:tasks.workunit.client.1.smithi183.stdout:7/905: dread - d0/d2/d4/d8/d59/d8a/f116 zero size 2024-02-10T00:00:39.921 INFO:tasks.workunit.client.1.smithi183.stdout:0/987: dwrite d14/f20 [0,4194304] 0 2024-02-10T00:00:39.921 INFO:tasks.workunit.client.0.smithi164.stdout:1/571: dwrite d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:39.922 INFO:tasks.workunit.client.0.smithi164.stdout:0/615: dread - d6/d10/d18/d2d/fb8 zero size 2024-02-10T00:00:39.923 INFO:tasks.workunit.client.0.smithi164.stdout:7/663: mkdir d3/d26/d67/d98/daf/dde 0 2024-02-10T00:00:39.924 INFO:tasks.workunit.client.0.smithi164.stdout:6/702: dwrite d0/d6/d12/d14/d4b/f9e [0,4194304] 0 2024-02-10T00:00:39.925 INFO:tasks.workunit.client.0.smithi164.stdout:7/664: stat d3/d11/d39/d44/d48/d71 0 2024-02-10T00:00:39.927 INFO:tasks.workunit.client.1.smithi183.stdout:3/816: dwrite d7/db/d2a/d33/d59/db6/fc2 [0,4194304] 0 2024-02-10T00:00:39.928 INFO:tasks.workunit.client.1.smithi183.stdout:9/965: rename d0/d30/d52 to d0/d3/d14/d1c/d2d/d4f/db8/de7/d136 0 2024-02-10T00:00:39.930 INFO:tasks.workunit.client.0.smithi164.stdout:7/665: dwrite d3/d26/d67/fb5 [0,4194304] 0 2024-02-10T00:00:39.930 INFO:tasks.workunit.client.0.smithi164.stdout:6/703: dwrite d0/d6/d12/d14/d4b/dbf/fe8 [0,4194304] 0 2024-02-10T00:00:39.933 INFO:tasks.workunit.client.0.smithi164.stdout:2/707: mknod d3/da6/d7a/d8e/c100 0 2024-02-10T00:00:39.936 INFO:tasks.workunit.client.0.smithi164.stdout:4/645: creat d2/d19/d16/d31/dcf/fe2 x:0 0 0 2024-02-10T00:00:39.937 INFO:tasks.workunit.client.0.smithi164.stdout:9/621: truncate d6/de/d40/f88 486850 0 2024-02-10T00:00:39.938 INFO:tasks.workunit.client.0.smithi164.stdout:0/616: symlink d6/d10/d18/lbd 0 2024-02-10T00:00:39.940 INFO:tasks.workunit.client.1.smithi183.stdout:1/902: rename d0/d3c to d0/d3/d67/d70/dae/d135 0 2024-02-10T00:00:39.943 INFO:tasks.workunit.client.1.smithi183.stdout:9/966: symlink d0/d3/d14/d1c/d2d/d4f/db8/de7/d136/ddc/l137 0 2024-02-10T00:00:39.947 INFO:tasks.workunit.client.0.smithi164.stdout:1/572: symlink d1/d1a/d41/d18/d3a/lc5 0 2024-02-10T00:00:39.947 INFO:tasks.workunit.client.0.smithi164.stdout:7/666: symlink d3/d11/d39/d44/d48/d71/ldf 0 2024-02-10T00:00:39.947 INFO:tasks.workunit.client.0.smithi164.stdout:9/622: symlink d6/d41/d8b/d24/d4f/lc9 0 2024-02-10T00:00:39.948 INFO:tasks.workunit.client.1.smithi183.stdout:0/988: creat d14/d1d/d59/d3c/d93/f165 x:0 0 0 2024-02-10T00:00:39.949 INFO:tasks.workunit.client.1.smithi183.stdout:3/817: rename d7/db/d2a/d8e to d7/db/d2a/d33/d59/db6/df1 0 2024-02-10T00:00:39.949 INFO:tasks.workunit.client.0.smithi164.stdout:3/561: creat d0/d1/d2/d17/fa9 x:0 0 0 2024-02-10T00:00:39.950 INFO:tasks.workunit.client.0.smithi164.stdout:3/562: readlink d0/d1/d2/d19/d27/d5f/l6e 0 2024-02-10T00:00:39.951 INFO:tasks.workunit.client.0.smithi164.stdout:3/563: write d0/d1/d2/fe [3154481,59223] 0 2024-02-10T00:00:39.951 INFO:tasks.workunit.client.0.smithi164.stdout:4/646: mknod d2/ce3 0 2024-02-10T00:00:39.952 INFO:tasks.workunit.client.0.smithi164.stdout:3/564: chown d0/d1/dd/f8d 858802 1 2024-02-10T00:00:39.952 INFO:tasks.workunit.client.1.smithi183.stdout:9/967: write d0/d3/d14/d1c/d2d/d4f/de6/d11d/f102 [471105,115277] 0 2024-02-10T00:00:39.954 INFO:tasks.workunit.client.1.smithi183.stdout:0/989: truncate d14/f37 5052221 0 2024-02-10T00:00:39.955 INFO:tasks.workunit.client.0.smithi164.stdout:6/704: truncate d0/d6/d12/d14/f8d 868615 0 2024-02-10T00:00:39.955 INFO:tasks.workunit.client.0.smithi164.stdout:7/667: creat d3/d5/d2b/dab/fe0 x:0 0 0 2024-02-10T00:00:39.956 INFO:tasks.workunit.client.0.smithi164.stdout:3/565: dwrite d0/d1/d3c/f7c [4194304,4194304] 0 2024-02-10T00:00:39.957 INFO:tasks.workunit.client.1.smithi183.stdout:9/968: dwrite d0/d3/d14/d1c/d2d/d4f/d79/f85 [0,4194304] 0 2024-02-10T00:00:39.958 INFO:tasks.workunit.client.1.smithi183.stdout:0/990: fsync d14/d1d/d2d/d31/d6c/d70/f125 0 2024-02-10T00:00:39.959 INFO:tasks.workunit.client.0.smithi164.stdout:4/647: mknod d2/d2f/d37/d41/d3d/d42/da2/ce4 0 2024-02-10T00:00:39.961 INFO:tasks.workunit.client.0.smithi164.stdout:3/566: dread d0/d1/d2/d19/d27/d5f/f85 [0,4194304] 0 2024-02-10T00:00:39.963 INFO:tasks.workunit.client.1.smithi183.stdout:9/969: dwrite d0/d3/d14/d1c/d2d/d4f/d79/fb3 [0,4194304] 0 2024-02-10T00:00:39.963 INFO:tasks.workunit.client.1.smithi183.stdout:0/991: dwrite d14/d1d/d59/f14a [0,4194304] 0 2024-02-10T00:00:39.964 INFO:tasks.workunit.client.0.smithi164.stdout:6/705: rename d0/d2b/d3a/d3d/d6d to d0/d2b/d3a/d3d/d42/d5d/df0 0 2024-02-10T00:00:39.965 INFO:tasks.workunit.client.1.smithi183.stdout:9/970: fsync d0/d3/d14/d1c/d2d/fed 0 2024-02-10T00:00:39.965 INFO:tasks.workunit.client.0.smithi164.stdout:7/668: mknod d3/d11/d39/d44/ce1 0 2024-02-10T00:00:39.966 INFO:tasks.workunit.client.0.smithi164.stdout:4/648: symlink d2/d2f/d37/d41/le5 0 2024-02-10T00:00:39.967 INFO:tasks.workunit.client.1.smithi183.stdout:0/992: mkdir d14/d3e/d92/d166 0 2024-02-10T00:00:39.968 INFO:tasks.workunit.client.0.smithi164.stdout:3/567: unlink d0/d1/d2/d19/d27/fa2 0 2024-02-10T00:00:39.969 INFO:tasks.workunit.client.0.smithi164.stdout:1/573: getdents d1/d13/d2b 0 2024-02-10T00:00:39.971 INFO:tasks.workunit.client.1.smithi183.stdout:9/971: dwrite d0/f2f [0,4194304] 0 2024-02-10T00:00:39.972 INFO:tasks.workunit.client.0.smithi164.stdout:4/649: mknod d2/d2f/d37/ce6 0 2024-02-10T00:00:39.974 INFO:tasks.workunit.client.1.smithi183.stdout:9/972: creat d0/d3/d14/d1c/d2d/d4f/db8/f138 x:0 0 0 2024-02-10T00:00:39.976 INFO:tasks.workunit.client.1.smithi183.stdout:9/973: write d0/d3/d14/f20 [3531338,104243] 0 2024-02-10T00:00:39.980 INFO:tasks.workunit.client.0.smithi164.stdout:8/644: sync 2024-02-10T00:00:39.980 INFO:tasks.workunit.client.0.smithi164.stdout:9/623: dread d6/d41/fb1 [0,4194304] 0 2024-02-10T00:00:39.981 INFO:tasks.workunit.client.0.smithi164.stdout:6/706: dread d0/d6/d12/f91 [0,4194304] 0 2024-02-10T00:00:39.981 INFO:tasks.workunit.client.0.smithi164.stdout:9/624: write d6/de/d22/d69/f91 [4279930,35695] 0 2024-02-10T00:00:39.983 INFO:tasks.workunit.client.0.smithi164.stdout:3/568: truncate d0/d1/d2/d19/d27/f2c 3526282 0 2024-02-10T00:00:39.983 INFO:tasks.workunit.client.0.smithi164.stdout:4/650: creat d2/d19/d16/d31/d72/dc7/fe7 x:0 0 0 2024-02-10T00:00:39.987 INFO:tasks.workunit.client.0.smithi164.stdout:4/651: rename d2/d19/l18 to d2/d19/d16/daa/le8 0 2024-02-10T00:00:39.991 INFO:tasks.workunit.client.0.smithi164.stdout:9/625: dwrite d6/d41/fb1 [4194304,4194304] 0 2024-02-10T00:00:40.004 INFO:tasks.workunit.client.0.smithi164.stdout:2/708: sync 2024-02-10T00:00:40.008 INFO:tasks.workunit.client.0.smithi164.stdout:2/709: dwrite d3/da6/d7a/d8e/d36/d54/f55 [0,4194304] 0 2024-02-10T00:00:40.012 INFO:tasks.workunit.client.0.smithi164.stdout:2/710: unlink d3/l76 0 2024-02-10T00:00:40.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/711: mkdir d3/da6/d7a/d8e/db6/dce/d101 0 2024-02-10T00:00:40.015 INFO:tasks.workunit.client.0.smithi164.stdout:2/712: stat d3/fe 0 2024-02-10T00:00:40.016 INFO:tasks.workunit.client.0.smithi164.stdout:2/713: readlink d3/da6/d7a/d8e/db6/ld1 0 2024-02-10T00:00:40.016 INFO:tasks.workunit.client.0.smithi164.stdout:2/714: write d3/da6/d7a/d8e/f98 [750729,29622] 0 2024-02-10T00:00:40.020 INFO:tasks.workunit.client.0.smithi164.stdout:2/715: dwrite d3/d26/fae [0,4194304] 0 2024-02-10T00:00:40.033 INFO:tasks.workunit.client.0.smithi164.stdout:1/574: dread d1/d13/d1f/fac [0,4194304] 0 2024-02-10T00:00:40.035 INFO:tasks.workunit.client.0.smithi164.stdout:3/569: dread d0/d1/d2/d17/d37/d3f/d4e/f96 [0,4194304] 0 2024-02-10T00:00:40.035 INFO:tasks.workunit.client.0.smithi164.stdout:1/575: mknod d1/d1a/d41/d18/d33/cc6 0 2024-02-10T00:00:40.038 INFO:tasks.workunit.client.0.smithi164.stdout:1/576: mkdir d1/d64/dc7 0 2024-02-10T00:00:40.039 INFO:tasks.workunit.client.0.smithi164.stdout:1/577: write d1/d13/f47 [1675321,47717] 0 2024-02-10T00:00:40.039 INFO:tasks.workunit.client.0.smithi164.stdout:3/570: creat d0/d1/d2/faa x:0 0 0 2024-02-10T00:00:40.040 INFO:tasks.workunit.client.0.smithi164.stdout:3/571: chown d0/d1/f89 53223 1 2024-02-10T00:00:40.042 INFO:tasks.workunit.client.0.smithi164.stdout:1/578: getdents d1/d1a 0 2024-02-10T00:00:40.043 INFO:tasks.workunit.client.0.smithi164.stdout:3/572: symlink d0/d1/d2/d19/d66/d84/d82/lab 0 2024-02-10T00:00:40.046 INFO:tasks.workunit.client.0.smithi164.stdout:1/579: getdents d1/d13/d2b/d52/db7 0 2024-02-10T00:00:40.047 INFO:tasks.workunit.client.0.smithi164.stdout:1/580: chown d1/d13/d2b/l86 290 1 2024-02-10T00:00:40.047 INFO:tasks.workunit.client.0.smithi164.stdout:1/581: write d1/f7 [4234595,25061] 0 2024-02-10T00:00:40.049 INFO:tasks.workunit.client.0.smithi164.stdout:1/582: creat d1/d23/fc8 x:0 0 0 2024-02-10T00:00:40.050 INFO:tasks.workunit.client.0.smithi164.stdout:1/583: fdatasync d1/d13/d1f/fac 0 2024-02-10T00:00:40.052 INFO:tasks.workunit.client.0.smithi164.stdout:1/584: creat d1/d64/dc7/fc9 x:0 0 0 2024-02-10T00:00:40.053 INFO:tasks.workunit.client.0.smithi164.stdout:1/585: write d1/d13/d1f/f28 [4337562,2834] 0 2024-02-10T00:00:40.055 INFO:tasks.workunit.client.0.smithi164.stdout:1/586: symlink d1/d1a/lca 0 2024-02-10T00:00:40.057 INFO:tasks.workunit.client.0.smithi164.stdout:1/587: symlink d1/d64/lcb 0 2024-02-10T00:00:40.058 INFO:tasks.workunit.client.1.smithi183.stdout:6/895: truncate d2/d1a/d25/d3c/d8d/ff0 1591439 0 2024-02-10T00:00:40.061 INFO:tasks.workunit.client.1.smithi183.stdout:6/896: creat d2/d1a/d25/d3c/d31/d38/d3f/d94/f115 x:0 0 0 2024-02-10T00:00:40.062 INFO:tasks.workunit.client.0.smithi164.stdout:5/719: write d7/d17/f48 [348640,94828] 0 2024-02-10T00:00:40.071 INFO:tasks.workunit.client.0.smithi164.stdout:0/617: truncate d6/d3a/d52/d7a/f4e 2607758 0 2024-02-10T00:00:40.071 INFO:tasks.workunit.client.0.smithi164.stdout:0/618: fsync d6/d10/d18/d2d/d35/d44/d90/fb0 0 2024-02-10T00:00:40.072 INFO:tasks.workunit.client.1.smithi183.stdout:9/974: dread d0/d3/d14/d1c/d2d/d4f/db8/de7/d136/f66 [0,4194304] 0 2024-02-10T00:00:40.072 INFO:tasks.workunit.client.1.smithi183.stdout:1/903: truncate d0/d3/d67/d7b/dfe/d7c/fee 16527 0 2024-02-10T00:00:40.073 INFO:tasks.workunit.client.1.smithi183.stdout:7/906: dwrite d0/d11/d2f/d64/f93 [0,4194304] 0 2024-02-10T00:00:40.075 INFO:tasks.workunit.client.1.smithi183.stdout:9/975: chown d0/d3/d14/d1c/d2d/fd5 227 1 2024-02-10T00:00:40.075 INFO:tasks.workunit.client.0.smithi164.stdout:2/716: dread d3/da6/d7a/d8e/db6/db8/fd0 [0,4194304] 0 2024-02-10T00:00:40.076 INFO:tasks.workunit.client.0.smithi164.stdout:4/652: dread d2/d19/d16/d31/d7e/d81/f87 [0,4194304] 0 2024-02-10T00:00:40.079 INFO:tasks.workunit.client.1.smithi183.stdout:3/818: dwrite d7/db/d2a/d33/f87 [0,4194304] 0 2024-02-10T00:00:40.080 INFO:tasks.workunit.client.0.smithi164.stdout:8/645: dread d2/f39 [0,4194304] 0 2024-02-10T00:00:40.080 INFO:tasks.workunit.client.0.smithi164.stdout:8/646: fdatasync d2/d81/f8c 0 2024-02-10T00:00:40.081 INFO:tasks.workunit.client.1.smithi183.stdout:7/907: truncate d0/d11/f82 480124 0 2024-02-10T00:00:40.081 INFO:tasks.workunit.client.0.smithi164.stdout:5/720: rename d7/d17/d21/d23/d37/d36/fca to d7/d17/d21/d23/d5a/d68/d1f/d70/ff0 0 2024-02-10T00:00:40.082 INFO:tasks.workunit.client.0.smithi164.stdout:5/721: dread - d7/d17/d79/f86 zero size 2024-02-10T00:00:40.083 INFO:tasks.workunit.client.1.smithi183.stdout:7/908: stat d0/d11/d2f/db8/ded 0 2024-02-10T00:00:40.083 INFO:tasks.workunit.client.0.smithi164.stdout:5/722: chown d7/d17/d21/d23/d5a/d68 7 1 2024-02-10T00:00:40.084 INFO:tasks.workunit.client.0.smithi164.stdout:7/669: truncate d3/d26/d67/d98/fc1 1009167 0 2024-02-10T00:00:40.085 INFO:tasks.workunit.client.1.smithi183.stdout:6/897: dread d2/d1a/f1f [0,4194304] 0 2024-02-10T00:00:40.085 INFO:tasks.workunit.client.1.smithi183.stdout:9/976: dwrite d0/d3/d14/d1c/d2d/d4f/db8/de7/d136/ddc/de1/f115 [0,4194304] 0 2024-02-10T00:00:40.086 INFO:tasks.workunit.client.1.smithi183.stdout:6/898: dread - d2/ffb zero size 2024-02-10T00:00:40.088 INFO:tasks.workunit.client.1.smithi183.stdout:1/904: write d0/d3a/fa5 [187879,129239] 0 2024-02-10T00:00:40.088 INFO:tasks.workunit.client.1.smithi183.stdout:0/993: dread d14/d1d/d96/da0/fad [0,4194304] 0 2024-02-10T00:00:40.090 INFO:tasks.workunit.client.0.smithi164.stdout:9/626: dwrite d6/f70 [0,4194304] 0 2024-02-10T00:00:40.091 INFO:tasks.workunit.client.1.smithi183.stdout:7/909: dwrite d0/d2/d50/dad/f97 [0,4194304] 0 2024-02-10T00:00:40.092 INFO:tasks.workunit.client.1.smithi183.stdout:3/819: link d7/db/d2a/d4d/d63/f9f d7/db/d2a/d2d/d51/dab/ff2 0 2024-02-10T00:00:40.092 INFO:tasks.workunit.client.0.smithi164.stdout:6/707: dread d0/fb [0,4194304] 0 2024-02-10T00:00:40.093 INFO:tasks.workunit.client.1.smithi183.stdout:9/977: chown d0/d3/d14/d1c/d2d/d4f/da4/dda/f11f 1809 1 2024-02-10T00:00:40.094 INFO:tasks.workunit.client.0.smithi164.stdout:3/573: truncate d0/d1/d3c/f63 5615379 0 2024-02-10T00:00:40.095 INFO:tasks.workunit.client.0.smithi164.stdout:3/574: write d0/d1/d3c/fa1 [472863,130509] 0 2024-02-10T00:00:40.096 INFO:tasks.workunit.client.0.smithi164.stdout:3/575: chown d0/d1/d2/d19/d27/d5f/da5/f91 13 1 2024-02-10T00:00:40.096 INFO:tasks.workunit.client.0.smithi164.stdout:4/653: rmdir d2/d2f/d37/d41/dcc 39 2024-02-10T00:00:40.097 INFO:tasks.workunit.client.1.smithi183.stdout:1/905: dread d0/d3/d7/f6c [0,4194304] 0 2024-02-10T00:00:40.098 INFO:tasks.workunit.client.1.smithi183.stdout:7/910: rename d0/d2/d4/d8/d59/d8a/lea to d0/d11/d9d/dfc/l11f 0 2024-02-10T00:00:40.103 INFO:tasks.workunit.client.0.smithi164.stdout:0/619: creat d6/d10/d18/d2d/d35/d44/d90/d9d/fbe x:0 0 0 2024-02-10T00:00:40.105 INFO:tasks.workunit.client.1.smithi183.stdout:9/978: read d0/d3/d14/d1c/f5c [4578047,59814] 0 2024-02-10T00:00:40.108 INFO:tasks.workunit.client.1.smithi183.stdout:3/820: symlink d7/db/d2a/d2d/d51/d8f/lf3 0 2024-02-10T00:00:40.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/670: rename d3/d11/d39/f8d to d3/d5/d9b/db7/fe2 0 2024-02-10T00:00:40.109 INFO:tasks.workunit.client.1.smithi183.stdout:6/899: link d2/fb3 d2/d1a/d25/d3c/d31/d38/d3f/f116 0 2024-02-10T00:00:40.110 INFO:tasks.workunit.client.1.smithi183.stdout:6/900: fdatasync d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 0 2024-02-10T00:00:40.110 INFO:tasks.workunit.client.1.smithi183.stdout:9/979: truncate d0/d10/f42 4182449 0 2024-02-10T00:00:40.111 INFO:tasks.workunit.client.1.smithi183.stdout:1/906: mknod d0/d3/d7/d3d/d125/c136 0 2024-02-10T00:00:40.112 INFO:tasks.workunit.client.1.smithi183.stdout:1/907: chown d0/d12d/d100/f10e 1 1 2024-02-10T00:00:40.113 INFO:tasks.workunit.client.1.smithi183.stdout:7/911: rename d0/d11/d88/db1/lba to d0/d11/d9d/d103/d105/l120 0 2024-02-10T00:00:40.113 INFO:tasks.workunit.client.0.smithi164.stdout:2/717: symlink d3/da6/d7a/de1/l102 0 2024-02-10T00:00:40.114 INFO:tasks.workunit.client.1.smithi183.stdout:3/821: creat d7/db/d2a/d33/d59/d52/ff4 x:0 0 0 2024-02-10T00:00:40.115 INFO:tasks.workunit.client.1.smithi183.stdout:3/822: write d7/db/d2a/d33/f56 [2499215,77780] 0 2024-02-10T00:00:40.118 INFO:tasks.workunit.client.0.smithi164.stdout:5/723: fdatasync d7/d17/d79/fb1 0 2024-02-10T00:00:40.119 INFO:tasks.workunit.client.0.smithi164.stdout:5/724: chown d7/d17/d21/d23/f2d 3212 1 2024-02-10T00:00:40.120 INFO:tasks.workunit.client.1.smithi183.stdout:9/980: truncate d0/d3/d14/d3c/d7b/f87 2053215 0 2024-02-10T00:00:40.121 INFO:tasks.workunit.client.0.smithi164.stdout:6/708: rename d0/d2b/d3a/d3d/d42/lcb to d0/d2b/d3a/d3d/d42/d5d/d79/dbc/lf1 0 2024-02-10T00:00:40.123 INFO:tasks.workunit.client.0.smithi164.stdout:9/627: creat d6/d41/d8b/dc2/fca x:0 0 0 2024-02-10T00:00:40.125 INFO:tasks.workunit.client.0.smithi164.stdout:8/647: link d2/f25 d2/d64/d54/d5f/fc7 0 2024-02-10T00:00:40.126 INFO:tasks.workunit.client.1.smithi183.stdout:9/981: rename d0/d3/d14/d1c/d2d/d4f/d79 to d0/d3/d14/d1c/d2d/d4f/d89/d139 0 2024-02-10T00:00:40.127 INFO:tasks.workunit.client.0.smithi164.stdout:9/628: dwrite d6/f3e [4194304,4194304] 0 2024-02-10T00:00:40.128 INFO:tasks.workunit.client.0.smithi164.stdout:2/718: symlink d3/d26/l103 0 2024-02-10T00:00:40.128 INFO:tasks.workunit.client.0.smithi164.stdout:1/588: dread d1/d1a/fa3 [0,4194304] 0 2024-02-10T00:00:40.129 INFO:tasks.workunit.client.0.smithi164.stdout:9/629: write d6/de/d22/f26 [5451868,45344] 0 2024-02-10T00:00:40.129 INFO:tasks.workunit.client.0.smithi164.stdout:4/654: truncate d2/d19/d16/d31/dcf/fde 555300 0 2024-02-10T00:00:40.130 INFO:tasks.workunit.client.0.smithi164.stdout:5/725: symlink d7/d17/d21/d23/lf1 0 2024-02-10T00:00:40.131 INFO:tasks.workunit.client.0.smithi164.stdout:6/709: read d0/d2b/d3a/d3d/f74 [3429177,101903] 0 2024-02-10T00:00:40.131 INFO:tasks.workunit.client.0.smithi164.stdout:4/655: fdatasync d2/d19/d16/d31/d4b/f8c 0 2024-02-10T00:00:40.131 INFO:tasks.workunit.client.0.smithi164.stdout:8/648: rmdir d2/d64/d54/d5f 39 2024-02-10T00:00:40.132 INFO:tasks.workunit.client.0.smithi164.stdout:5/726: readlink d7/d17/d21/d24/dbc/d45/d5c/le0 0 2024-02-10T00:00:40.138 INFO:tasks.workunit.client.0.smithi164.stdout:0/620: dwrite d6/d7/d14/f20 [0,4194304] 0 2024-02-10T00:00:40.140 INFO:tasks.workunit.client.0.smithi164.stdout:2/719: write d3/da6/d7a/d8e/d36/fde [391477,42606] 0 2024-02-10T00:00:40.140 INFO:tasks.workunit.client.0.smithi164.stdout:0/621: chown d6/d10/d18/d2d/fb8 822 1 2024-02-10T00:00:40.141 INFO:tasks.workunit.client.0.smithi164.stdout:9/630: mknod d6/de/d22/d58/dba/d75/ccb 0 2024-02-10T00:00:40.141 INFO:tasks.workunit.client.0.smithi164.stdout:0/622: dread - d6/d3a/d52/fa7 zero size 2024-02-10T00:00:40.141 INFO:tasks.workunit.client.1.smithi183.stdout:0/994: dwrite d14/d3e/d5f/daa/de6/f151 [4194304,4194304] 0 2024-02-10T00:00:40.142 INFO:tasks.workunit.client.0.smithi164.stdout:8/649: creat d2/d64/d7d/fc8 x:0 0 0 2024-02-10T00:00:40.142 INFO:tasks.workunit.client.1.smithi183.stdout:0/995: write d14/d1d/d2d/f8a [997602,70335] 0 2024-02-10T00:00:40.143 INFO:tasks.workunit.client.0.smithi164.stdout:5/727: fdatasync d7/d17/d21/d23/d5a/d68/d1f/dbe/fc8 0 2024-02-10T00:00:40.144 INFO:tasks.workunit.client.0.smithi164.stdout:3/576: link d0/d1/d2/d17/c4f d0/d1/d2/d17/d37/d3f/d4e/cac 0 2024-02-10T00:00:40.144 INFO:tasks.workunit.client.0.smithi164.stdout:8/650: write d2/d64/d65/d80/d32/d93/fbe [211210,74902] 0 2024-02-10T00:00:40.146 INFO:tasks.workunit.client.1.smithi183.stdout:6/901: dwrite d2/d1a/d25/d3c/d31/d38/d6e/f10d [0,4194304] 0 2024-02-10T00:00:40.146 INFO:tasks.workunit.client.1.smithi183.stdout:0/996: unlink d14/d3e/l13d 0 2024-02-10T00:00:40.146 INFO:tasks.workunit.client.0.smithi164.stdout:3/577: stat d0/d1/d2/d17/d37/f69 0 2024-02-10T00:00:40.147 INFO:tasks.workunit.client.0.smithi164.stdout:8/651: readlink d2/d64/d54/d71/l96 0 2024-02-10T00:00:40.147 INFO:tasks.workunit.client.0.smithi164.stdout:6/710: dwrite d0/f17 [0,4194304] 0 2024-02-10T00:00:40.148 INFO:tasks.workunit.client.1.smithi183.stdout:7/912: dread d0/d11/d2f/da3/fb2 [0,4194304] 0 2024-02-10T00:00:40.148 INFO:tasks.workunit.client.0.smithi164.stdout:9/631: creat d6/de/d40/d74/fcc x:0 0 0 2024-02-10T00:00:40.149 INFO:tasks.workunit.client.1.smithi183.stdout:7/913: readlink d0/d2/d4/d8/d59/d8a/lbc 0 2024-02-10T00:00:40.149 INFO:tasks.workunit.client.1.smithi183.stdout:7/914: fdatasync d0/d11/d88/d94/dff/f11b 0 2024-02-10T00:00:40.150 INFO:tasks.workunit.client.0.smithi164.stdout:0/623: unlink d6/d10/d18/d1c/f71 0 2024-02-10T00:00:40.151 INFO:tasks.workunit.client.1.smithi183.stdout:6/902: mkdir d2/d1a/d117 0 2024-02-10T00:00:40.152 INFO:tasks.workunit.client.0.smithi164.stdout:0/624: read - d6/d3a/d52/fb6 zero size 2024-02-10T00:00:40.152 INFO:tasks.workunit.client.0.smithi164.stdout:8/652: dwrite d2/d81/f95 [0,4194304] 0 2024-02-10T00:00:40.153 INFO:tasks.workunit.client.0.smithi164.stdout:8/653: dread - d2/d64/d65/d80/f86 zero size 2024-02-10T00:00:40.154 INFO:tasks.workunit.client.0.smithi164.stdout:8/654: dread - d2/d64/d65/fa6 zero size 2024-02-10T00:00:40.154 INFO:tasks.workunit.client.1.smithi183.stdout:7/915: rename d0/d2/d4/d8/d59/d8a/f116 to d0/d2/d4/d8/d59/de6/f121 0 2024-02-10T00:00:40.155 INFO:tasks.workunit.client.0.smithi164.stdout:5/728: mkdir d7/d17/d21/d23/d5a/d68/d1f/dbe/df2 0 2024-02-10T00:00:40.157 INFO:tasks.workunit.client.0.smithi164.stdout:0/625: dwrite d6/d10/d4a/d60/d6c/fb1 [0,4194304] 0 2024-02-10T00:00:40.157 INFO:tasks.workunit.client.0.smithi164.stdout:6/711: unlink d0/d3b/fb8 0 2024-02-10T00:00:40.158 INFO:tasks.workunit.client.1.smithi183.stdout:9/982: write d0/fc0 [1024062,58012] 0 2024-02-10T00:00:40.159 INFO:tasks.workunit.client.0.smithi164.stdout:7/671: dwrite d3/d11/f82 [0,4194304] 0 2024-02-10T00:00:40.159 INFO:tasks.workunit.client.1.smithi183.stdout:0/997: truncate d14/d1d/d59/d3c/f153 761496 0 2024-02-10T00:00:40.160 INFO:tasks.workunit.client.0.smithi164.stdout:7/672: write d3/d26/f31 [2840457,15837] 0 2024-02-10T00:00:40.162 INFO:tasks.workunit.client.1.smithi183.stdout:3/823: dwrite d7/db/d2a/d1c/f7c [0,4194304] 0 2024-02-10T00:00:40.162 INFO:tasks.workunit.client.1.smithi183.stdout:7/916: creat d0/d2/d50/dd1/d11c/f122 x:0 0 0 2024-02-10T00:00:40.164 INFO:tasks.workunit.client.1.smithi183.stdout:7/917: chown d0/fa0 10955 1 2024-02-10T00:00:40.164 INFO:tasks.workunit.client.1.smithi183.stdout:1/908: dwrite d0/d3/d67/d7b/dfe/d7c/fee [0,4194304] 0 2024-02-10T00:00:40.164 INFO:tasks.workunit.client.1.smithi183.stdout:3/824: dread - d7/db/d2a/d4d/fee zero size 2024-02-10T00:00:40.165 INFO:tasks.workunit.client.1.smithi183.stdout:9/983: fsync d0/d10/f5f 0 2024-02-10T00:00:40.167 INFO:tasks.workunit.client.0.smithi164.stdout:6/712: dread d0/d6/d95/dcd/f7d [0,4194304] 0 2024-02-10T00:00:40.167 INFO:tasks.workunit.client.1.smithi183.stdout:1/909: readlink d0/d3/d67/d70/dae/d135/dc9/d86/lbc 0 2024-02-10T00:00:40.168 INFO:tasks.workunit.client.1.smithi183.stdout:0/998: dwrite d14/d1d/d59/d71/f56 [0,4194304] 0 2024-02-10T00:00:40.168 INFO:tasks.workunit.client.1.smithi183.stdout:1/910: chown d0/d3/d67 12 1 2024-02-10T00:00:40.171 INFO:tasks.workunit.client.1.smithi183.stdout:3/825: unlink d7/db/d2a/d2d/f9b 0 2024-02-10T00:00:40.174 INFO:tasks.workunit.client.1.smithi183.stdout:1/911: creat d0/d3a/f137 x:0 0 0 2024-02-10T00:00:40.174 INFO:tasks.workunit.client.1.smithi183.stdout:1/912: dread - d0/d3a/f105 zero size 2024-02-10T00:00:40.175 INFO:tasks.workunit.client.1.smithi183.stdout:0/999: rename d14/d1d/d96/da0/fad to d14/d3e/f167 0 2024-02-10T00:00:40.176 INFO:tasks.workunit.client.1.smithi183.stdout:7/918: mkdir d0/d11/d3e/d123 0 2024-02-10T00:00:40.177 INFO:tasks.workunit.client.1.smithi183.stdout:7/919: fdatasync d0/d11/d2f/dbf/fd8 0 2024-02-10T00:00:40.178 INFO:tasks.workunit.client.0.smithi164.stdout:3/578: read d0/d1/d2/d19/d66/d84/f55 [2558597,110652] 0 2024-02-10T00:00:40.178 INFO:tasks.workunit.client.1.smithi183.stdout:3/826: mkdir d7/db/d2a/d33/d59/db6/df1/df5 0 2024-02-10T00:00:40.179 INFO:tasks.workunit.client.0.smithi164.stdout:8/655: readlink d2/l15 0 2024-02-10T00:00:40.179 INFO:tasks.workunit.client.0.smithi164.stdout:6/713: chown d0/d2b/d3a/dd0/d93/db4/fda 373976 1 2024-02-10T00:00:40.179 INFO:tasks.workunit.client.0.smithi164.stdout:3/579: fsync d0/d1/d3c/f7c 0 2024-02-10T00:00:40.179 INFO:tasks.workunit.client.0.smithi164.stdout:1/589: truncate d1/f11 6686748 0 2024-02-10T00:00:40.179 INFO:tasks.workunit.client.0.smithi164.stdout:2/720: rmdir d3/da6/d7a/d8e/d88/df4 0 2024-02-10T00:00:40.180 INFO:tasks.workunit.client.1.smithi183.stdout:9/984: write d0/d3/d14/d1c/d2d/d4f/f11e [643278,71358] 0 2024-02-10T00:00:40.181 INFO:tasks.workunit.client.0.smithi164.stdout:0/626: write d6/d3a/f7d [4269799,104958] 0 2024-02-10T00:00:40.182 INFO:tasks.workunit.client.1.smithi183.stdout:7/920: dwrite d0/d2/d50/d5d/f8e [0,4194304] 0 2024-02-10T00:00:40.183 INFO:tasks.workunit.client.1.smithi183.stdout:1/913: symlink d0/d3/d7/d3d/d60/d89/l138 0 2024-02-10T00:00:40.183 INFO:tasks.workunit.client.1.smithi183.stdout:3/827: write d7/db/d2a/d2d/d51/f97 [174171,100439] 0 2024-02-10T00:00:40.186 INFO:tasks.workunit.client.1.smithi183.stdout:7/921: symlink d0/d2/d50/dad/l124 0 2024-02-10T00:00:40.187 INFO:tasks.workunit.client.1.smithi183.stdout:1/914: rmdir d0/d3/d7/d3d/dcb 39 2024-02-10T00:00:40.188 INFO:tasks.workunit.client.0.smithi164.stdout:8/656: rmdir d2/d64/d65/d80/d32/d4d 39 2024-02-10T00:00:40.189 INFO:tasks.workunit.client.1.smithi183.stdout:3/828: creat d7/db/d2a/d2d/d51/db3/ff6 x:0 0 0 2024-02-10T00:00:40.190 INFO:tasks.workunit.client.1.smithi183.stdout:7/922: dwrite d0/d2/d50/dd1/d11c/f122 [0,4194304] 0 2024-02-10T00:00:40.191 INFO:tasks.workunit.client.0.smithi164.stdout:7/673: truncate d3/d28/fa9 665996 0 2024-02-10T00:00:40.192 INFO:tasks.workunit.client.1.smithi183.stdout:7/923: readlink d0/d2/d50/d5d/l96 0 2024-02-10T00:00:40.192 INFO:tasks.workunit.client.1.smithi183.stdout:9/985: creat d0/d3/d14/d1c/f13a x:0 0 0 2024-02-10T00:00:40.193 INFO:tasks.workunit.client.0.smithi164.stdout:1/590: mkdir d1/d13/d2b/d52/da4/dc2/dcc 0 2024-02-10T00:00:40.195 INFO:tasks.workunit.client.0.smithi164.stdout:2/721: truncate d3/d26/d64/fa5 869448 0 2024-02-10T00:00:40.195 INFO:tasks.workunit.client.0.smithi164.stdout:8/657: dwrite d2/d64/d65/d98/fb8 [0,4194304] 0 2024-02-10T00:00:40.195 INFO:tasks.workunit.client.1.smithi183.stdout:9/986: fdatasync d0/d3/d14/f69 0 2024-02-10T00:00:40.196 INFO:tasks.workunit.client.0.smithi164.stdout:2/722: write d3/d24/ffc [190489,46393] 0 2024-02-10T00:00:40.198 INFO:tasks.workunit.client.0.smithi164.stdout:1/591: dwrite d1/f1b [0,4194304] 0 2024-02-10T00:00:40.199 INFO:tasks.workunit.client.0.smithi164.stdout:3/580: rename d0/d1/d2/d19/d27/d5f/f85 to d0/d1/d2/fad 0 2024-02-10T00:00:40.199 INFO:tasks.workunit.client.0.smithi164.stdout:8/658: mknod d2/d64/d63/cc9 0 2024-02-10T00:00:40.200 INFO:tasks.workunit.client.1.smithi183.stdout:9/987: chown d0/d3/d14/d1c/d2d/d4f/da4/dda 1693723703 1 2024-02-10T00:00:40.202 INFO:tasks.workunit.client.0.smithi164.stdout:0/627: rename d6/d3a/f7d to d6/d10/d18/d1c/d92/fbf 0 2024-02-10T00:00:40.203 INFO:tasks.workunit.client.1.smithi183.stdout:7/924: getdents d0/d11/d2f/ddb 0 2024-02-10T00:00:40.204 INFO:tasks.workunit.client.1.smithi183.stdout:7/925: write d0/d11/d2f/fae [680559,121798] 0 2024-02-10T00:00:40.206 INFO:tasks.workunit.client.1.smithi183.stdout:6/903: sync 2024-02-10T00:00:40.206 INFO:tasks.workunit.client.1.smithi183.stdout:6/904: chown d2/d1a/d25/d3c/faf 2 1 2024-02-10T00:00:40.207 INFO:tasks.workunit.client.0.smithi164.stdout:7/674: rename d3/d5/c8e to d3/dbf/ce3 0 2024-02-10T00:00:40.208 INFO:tasks.workunit.client.0.smithi164.stdout:0/628: stat d6/d10/d4a/l4f 0 2024-02-10T00:00:40.209 INFO:tasks.workunit.client.1.smithi183.stdout:7/926: unlink d0/d2/c29 0 2024-02-10T00:00:40.210 INFO:tasks.workunit.client.0.smithi164.stdout:9/632: dread d6/de/f6a [0,4194304] 0 2024-02-10T00:00:40.210 INFO:tasks.workunit.client.0.smithi164.stdout:9/633: stat d6/de/fa0 0 2024-02-10T00:00:40.211 INFO:tasks.workunit.client.1.smithi183.stdout:6/905: mknod d2/d1a/d25/d3c/d8d/dfe/c118 0 2024-02-10T00:00:40.211 INFO:tasks.workunit.client.0.smithi164.stdout:9/634: chown d6/de/d40/c7f 50702 1 2024-02-10T00:00:40.213 INFO:tasks.workunit.client.1.smithi183.stdout:7/927: symlink d0/d2/d50/dd1/d11c/l125 0 2024-02-10T00:00:40.214 INFO:tasks.workunit.client.0.smithi164.stdout:1/592: rename d1/d13/d2b/d54 to d1/d13/d2b/d52/da4/dc3/dcd 0 2024-02-10T00:00:40.215 INFO:tasks.workunit.client.0.smithi164.stdout:3/581: getdents d0/d1 0 2024-02-10T00:00:40.216 INFO:tasks.workunit.client.0.smithi164.stdout:1/593: fdatasync d1/d64/dc7/fc9 0 2024-02-10T00:00:40.216 INFO:tasks.workunit.client.0.smithi164.stdout:9/635: dwrite d6/de/f14 [0,4194304] 0 2024-02-10T00:00:40.220 INFO:tasks.workunit.client.1.smithi183.stdout:6/906: link d2/d1a/d25/d3c/d8d/ff0 d2/d1a/d25/f119 0 2024-02-10T00:00:40.223 INFO:tasks.workunit.client.0.smithi164.stdout:5/729: sync 2024-02-10T00:00:40.223 INFO:tasks.workunit.client.0.smithi164.stdout:8/659: rename d2/d64/d54/d5f/l75 to d2/d64/d65/d80/d32/d99/lca 0 2024-02-10T00:00:40.223 INFO:tasks.workunit.client.0.smithi164.stdout:9/636: dread d6/de/d22/d58/dba/d61/f6d [0,4194304] 0 2024-02-10T00:00:40.223 INFO:tasks.workunit.client.0.smithi164.stdout:1/594: dwrite d1/d13/d2b/d52/da4/dc3/dcd/f77 [4194304,4194304] 0 2024-02-10T00:00:40.224 INFO:tasks.workunit.client.0.smithi164.stdout:1/595: write d1/d13/d2b/d52/da4/fbd [1032178,79323] 0 2024-02-10T00:00:40.225 INFO:tasks.workunit.client.0.smithi164.stdout:0/629: mkdir d6/d10/d18/d2d/d35/d44/d49/d95/dc0 0 2024-02-10T00:00:40.225 INFO:tasks.workunit.client.0.smithi164.stdout:7/675: creat d3/d28/fe4 x:0 0 0 2024-02-10T00:00:40.226 INFO:tasks.workunit.client.0.smithi164.stdout:0/630: write d6/d10/d4a/d88/fba [747369,107242] 0 2024-02-10T00:00:40.226 INFO:tasks.workunit.client.0.smithi164.stdout:7/676: dread - d3/d11/d39/d44/d48/d71/fbe zero size 2024-02-10T00:00:40.227 INFO:tasks.workunit.client.0.smithi164.stdout:7/677: read - d3/d26/d67/d98/fb8 zero size 2024-02-10T00:00:40.229 INFO:tasks.workunit.client.0.smithi164.stdout:9/637: rmdir d6/de/d22/d58/dba/d61/d76 39 2024-02-10T00:00:40.231 INFO:tasks.workunit.client.0.smithi164.stdout:3/582: link d0/d1/d2/d19/d27/d5f/da5/d6b/f77 d0/d1/d2/d19/d66/fae 0 2024-02-10T00:00:40.231 INFO:tasks.workunit.client.0.smithi164.stdout:0/631: dwrite d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:40.232 INFO:tasks.workunit.client.0.smithi164.stdout:7/678: dread d3/d11/f23 [0,4194304] 0 2024-02-10T00:00:40.234 INFO:tasks.workunit.client.0.smithi164.stdout:9/638: symlink d6/de/d22/d58/dba/lcd 0 2024-02-10T00:00:40.236 INFO:tasks.workunit.client.0.smithi164.stdout:3/583: fsync d0/f43 0 2024-02-10T00:00:40.238 INFO:tasks.workunit.client.0.smithi164.stdout:1/596: creat d1/d1a/d41/fce x:0 0 0 2024-02-10T00:00:40.239 INFO:tasks.workunit.client.0.smithi164.stdout:3/584: creat d0/d1/faf x:0 0 0 2024-02-10T00:00:40.240 INFO:tasks.workunit.client.0.smithi164.stdout:7/679: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:40.241 INFO:tasks.workunit.client.0.smithi164.stdout:7/680: chown d3/f1d 7 1 2024-02-10T00:00:40.241 INFO:tasks.workunit.client.0.smithi164.stdout:9/639: rename d6/de/d22/d58/dba/d61/f6d to d6/d41/d8b/d24/fce 0 2024-02-10T00:00:40.243 INFO:tasks.workunit.client.0.smithi164.stdout:7/681: creat d3/d5/d2b/dab/dda/fe5 x:0 0 0 2024-02-10T00:00:40.243 INFO:tasks.workunit.client.0.smithi164.stdout:1/597: getdents d1/d23/d37/da9 0 2024-02-10T00:00:40.244 INFO:tasks.workunit.client.0.smithi164.stdout:3/585: mkdir d0/d8f/d9a/db0 0 2024-02-10T00:00:40.247 INFO:tasks.workunit.client.0.smithi164.stdout:9/640: symlink d6/de/d22/d58/dba/d61/d76/da5/lcf 0 2024-02-10T00:00:40.248 INFO:tasks.workunit.client.0.smithi164.stdout:9/641: write d6/f1e [1843202,127223] 0 2024-02-10T00:00:40.252 INFO:tasks.workunit.client.0.smithi164.stdout:9/642: dwrite d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:40.264 INFO:tasks.workunit.client.0.smithi164.stdout:5/730: read d7/d17/f48 [2951249,15720] 0 2024-02-10T00:00:40.265 INFO:tasks.workunit.client.0.smithi164.stdout:9/643: mkdir d6/de/d22/d58/dba/d61/d76/d82/db7/dd0 0 2024-02-10T00:00:40.266 INFO:tasks.workunit.client.0.smithi164.stdout:9/644: chown d6/de/f11 12222801 1 2024-02-10T00:00:40.266 INFO:tasks.workunit.client.0.smithi164.stdout:8/660: read d2/d64/d65/d80/d32/f56 [1669374,34830] 0 2024-02-10T00:00:40.267 INFO:tasks.workunit.client.0.smithi164.stdout:0/632: dread d6/d10/fb5 [0,4194304] 0 2024-02-10T00:00:40.267 INFO:tasks.workunit.client.0.smithi164.stdout:9/645: chown d6/d41/d8b/d24 118026 1 2024-02-10T00:00:40.268 INFO:tasks.workunit.client.0.smithi164.stdout:9/646: write d6/f86 [5200102,30164] 0 2024-02-10T00:00:40.269 INFO:tasks.workunit.client.1.smithi183.stdout:9/988: sync 2024-02-10T00:00:40.270 INFO:tasks.workunit.client.0.smithi164.stdout:9/647: write d6/de/d22/d69/f91 [4538346,60756] 0 2024-02-10T00:00:40.272 INFO:tasks.workunit.client.1.smithi183.stdout:1/915: dread d0/d3/d67/d70/fc7 [0,4194304] 0 2024-02-10T00:00:40.273 INFO:tasks.workunit.client.0.smithi164.stdout:4/656: dread d2/d19/d16/d31/d7e/fa3 [0,4194304] 0 2024-02-10T00:00:40.273 INFO:tasks.workunit.client.0.smithi164.stdout:5/731: fsync d7/d17/d21/d23/d37/fe5 0 2024-02-10T00:00:40.275 INFO:tasks.workunit.client.0.smithi164.stdout:1/598: read d1/d13/d1f/f28 [2545353,25591] 0 2024-02-10T00:00:40.275 INFO:tasks.workunit.client.0.smithi164.stdout:9/648: symlink d6/de/d22/d58/dba/d61/d76/ld1 0 2024-02-10T00:00:40.276 INFO:tasks.workunit.client.1.smithi183.stdout:9/989: dread d0/d10/f5f [0,4194304] 0 2024-02-10T00:00:40.276 INFO:tasks.workunit.client.0.smithi164.stdout:0/633: rename d6/d10/d18/d2d/d35/d44/d49/d95/c96 to d6/d10/d18/d2d/d39/cc1 0 2024-02-10T00:00:40.278 INFO:tasks.workunit.client.1.smithi183.stdout:9/990: read d0/d3/d14/d1c/d2d/d4f/d89/d139/fb3 [810801,51290] 0 2024-02-10T00:00:40.279 INFO:tasks.workunit.client.0.smithi164.stdout:1/599: creat d1/d13/d2b/d52/da4/dc2/fcf x:0 0 0 2024-02-10T00:00:40.280 INFO:tasks.workunit.client.0.smithi164.stdout:9/649: creat d6/de/d22/d58/dba/d61/d76/fd2 x:0 0 0 2024-02-10T00:00:40.281 INFO:tasks.workunit.client.0.smithi164.stdout:0/634: rmdir d6/d7 39 2024-02-10T00:00:40.282 INFO:tasks.workunit.client.0.smithi164.stdout:4/657: mknod d2/d5a/ce9 0 2024-02-10T00:00:40.282 INFO:tasks.workunit.client.0.smithi164.stdout:0/635: readlink d6/d10/d4a/d60/d6c/l8a 0 2024-02-10T00:00:40.282 INFO:tasks.workunit.client.0.smithi164.stdout:2/723: dread d3/d32/d4e/f3f [0,4194304] 0 2024-02-10T00:00:40.282 INFO:tasks.workunit.client.0.smithi164.stdout:9/650: chown d6/de/d22/d58/dba/d61/d76/d82/db7/c53 101 1 2024-02-10T00:00:40.283 INFO:tasks.workunit.client.0.smithi164.stdout:2/724: chown d3/d24/df0 291 1 2024-02-10T00:00:40.284 INFO:tasks.workunit.client.0.smithi164.stdout:2/725: write d3/da6/f31 [646456,78991] 0 2024-02-10T00:00:40.286 INFO:tasks.workunit.client.0.smithi164.stdout:8/661: link d2/c1b d2/d64/d54/ccb 0 2024-02-10T00:00:40.287 INFO:tasks.workunit.client.0.smithi164.stdout:5/732: creat d7/d17/d21/ff3 x:0 0 0 2024-02-10T00:00:40.288 INFO:tasks.workunit.client.0.smithi164.stdout:9/651: mkdir d6/de/d22/dd3 0 2024-02-10T00:00:40.288 INFO:tasks.workunit.client.0.smithi164.stdout:1/600: dread d1/d1a/d41/d18/f30 [0,4194304] 0 2024-02-10T00:00:40.289 INFO:tasks.workunit.client.0.smithi164.stdout:0/636: symlink d6/d10/d4a/lc2 0 2024-02-10T00:00:40.291 INFO:tasks.workunit.client.0.smithi164.stdout:8/662: mknod d2/d64/d65/d80/d32/d58/ccc 0 2024-02-10T00:00:40.292 INFO:tasks.workunit.client.0.smithi164.stdout:5/733: creat d7/d17/d21/d23/d5a/d68/d1f/d59/ff4 x:0 0 0 2024-02-10T00:00:40.292 INFO:tasks.workunit.client.0.smithi164.stdout:1/601: mknod d1/d23/d70/cd0 0 2024-02-10T00:00:40.294 INFO:tasks.workunit.client.0.smithi164.stdout:2/726: link d3/f1f d3/da6/f104 0 2024-02-10T00:00:40.295 INFO:tasks.workunit.client.0.smithi164.stdout:2/727: stat d3/c77 0 2024-02-10T00:00:40.296 INFO:tasks.workunit.client.0.smithi164.stdout:8/663: write d2/f11 [4301459,68974] 0 2024-02-10T00:00:40.298 INFO:tasks.workunit.client.0.smithi164.stdout:2/728: symlink d3/da6/d7a/d8e/db6/db8/l105 0 2024-02-10T00:00:40.299 INFO:tasks.workunit.client.0.smithi164.stdout:0/637: link d6/d3a/d52/fa7 d6/d3a/d52/fc3 0 2024-02-10T00:00:40.301 INFO:tasks.workunit.client.0.smithi164.stdout:0/638: readlink d6/d10/d66/la0 0 2024-02-10T00:00:40.301 INFO:tasks.workunit.client.0.smithi164.stdout:1/602: dwrite d1/d1a/f85 [0,4194304] 0 2024-02-10T00:00:40.303 INFO:tasks.workunit.client.0.smithi164.stdout:0/639: fsync d6/d10/d18/d1c/f2c 0 2024-02-10T00:00:40.303 INFO:tasks.workunit.client.0.smithi164.stdout:5/734: rename d7/d17/d21/d23/fa6 to d7/d17/d21/d23/d5a/d68/d1f/d59/ff5 0 2024-02-10T00:00:40.304 INFO:tasks.workunit.client.0.smithi164.stdout:9/652: rmdir d6/de/d22/d58/dba/d61/d76/d82/db7/dd0 0 2024-02-10T00:00:40.305 INFO:tasks.workunit.client.0.smithi164.stdout:2/729: dwrite d3/d24/ff2 [0,4194304] 0 2024-02-10T00:00:40.305 INFO:tasks.workunit.client.0.smithi164.stdout:9/653: read d6/d41/fb1 [4460856,111382] 0 2024-02-10T00:00:40.307 INFO:tasks.workunit.client.0.smithi164.stdout:2/730: write d3/da6/d7a/ffb [1020730,123064] 0 2024-02-10T00:00:40.309 INFO:tasks.workunit.client.0.smithi164.stdout:8/664: rename d2/d64/d65/d80/c59 to d2/d64/d63/ccd 0 2024-02-10T00:00:40.313 INFO:tasks.workunit.client.0.smithi164.stdout:1/603: mkdir d1/d23/d37/da9/dd1 0 2024-02-10T00:00:40.313 INFO:tasks.workunit.client.0.smithi164.stdout:9/654: write d6/de/d22/d58/dba/f6c [1107291,105627] 0 2024-02-10T00:00:40.314 INFO:tasks.workunit.client.1.smithi183.stdout:3/829: rename d7/db/d2a/d33/d59/db6/df1 to d7/db/d2a/d33/d59/df7 0 2024-02-10T00:00:40.314 INFO:tasks.workunit.client.0.smithi164.stdout:1/604: chown d1/d23/lae 7 1 2024-02-10T00:00:40.317 INFO:tasks.workunit.client.0.smithi164.stdout:5/735: symlink d7/d17/dc3/lf6 0 2024-02-10T00:00:40.319 INFO:tasks.workunit.client.1.smithi183.stdout:7/928: write d0/d11/f57 [390177,130869] 0 2024-02-10T00:00:40.319 INFO:tasks.workunit.client.0.smithi164.stdout:0/640: rename d6/f15 to d6/d10/d4a/d88/fc4 0 2024-02-10T00:00:40.319 INFO:tasks.workunit.client.1.smithi183.stdout:7/929: readlink d0/d11/d3e/l63 0 2024-02-10T00:00:40.322 INFO:tasks.workunit.client.0.smithi164.stdout:1/605: symlink d1/d23/d37/ld2 0 2024-02-10T00:00:40.323 INFO:tasks.workunit.client.1.smithi183.stdout:1/916: rename d0/d3/d29/dc4/cd4 to d0/d3a/dd8/d108/d112/c139 0 2024-02-10T00:00:40.324 INFO:tasks.workunit.client.1.smithi183.stdout:1/917: chown d0/c22 1716719 1 2024-02-10T00:00:40.324 INFO:tasks.workunit.client.1.smithi183.stdout:7/930: dread - d0/d11/d2f/d64/d6b/fc4 zero size 2024-02-10T00:00:40.326 INFO:tasks.workunit.client.0.smithi164.stdout:6/714: write d0/d6/d12/d14/f61 [4184188,31043] 0 2024-02-10T00:00:40.327 INFO:tasks.workunit.client.1.smithi183.stdout:1/918: creat d0/f13a x:0 0 0 2024-02-10T00:00:40.329 INFO:tasks.workunit.client.1.smithi183.stdout:9/991: rename d0/d3/d14/d1c/d2d/d4f/cbf to d0/d3/d14/d1c/d2d/d4f/d89/c13b 0 2024-02-10T00:00:40.329 INFO:tasks.workunit.client.1.smithi183.stdout:7/931: getdents d0/d2/d4/d8/d59/d8a/d109 0 2024-02-10T00:00:40.330 INFO:tasks.workunit.client.1.smithi183.stdout:3/830: getdents d7/db/d2a/d4d/d63/dc4 0 2024-02-10T00:00:40.331 INFO:tasks.workunit.client.1.smithi183.stdout:7/932: write d0/d2/d4/d8/d59/fda [1854867,83443] 0 2024-02-10T00:00:40.332 INFO:tasks.workunit.client.1.smithi183.stdout:7/933: read - d0/d2/d4/d8/fd9 zero size 2024-02-10T00:00:40.332 INFO:tasks.workunit.client.1.smithi183.stdout:1/919: rename d0/fc5 to d0/d12d/d100/f13b 0 2024-02-10T00:00:40.335 INFO:tasks.workunit.client.1.smithi183.stdout:9/992: unlink d0/d3/d14/d74/da8/fba 0 2024-02-10T00:00:40.336 INFO:tasks.workunit.client.1.smithi183.stdout:3/831: creat d7/db/d2a/d33/d59/d52/ff8 x:0 0 0 2024-02-10T00:00:40.336 INFO:tasks.workunit.client.1.smithi183.stdout:7/934: dwrite d0/d11/d3e/f70 [0,4194304] 0 2024-02-10T00:00:40.338 INFO:tasks.workunit.client.1.smithi183.stdout:1/920: fsync d0/d12d/d100/f10e 0 2024-02-10T00:00:40.341 INFO:tasks.workunit.client.1.smithi183.stdout:7/935: mkdir d0/d11/d2f/db8/ded/d126 0 2024-02-10T00:00:40.344 INFO:tasks.workunit.client.1.smithi183.stdout:3/832: symlink d7/db/d2a/d33/d59/lf9 0 2024-02-10T00:00:40.346 INFO:tasks.workunit.client.0.smithi164.stdout:9/655: dread d6/f3e [0,4194304] 0 2024-02-10T00:00:40.347 INFO:tasks.workunit.client.1.smithi183.stdout:9/993: rename d0/d92/db7/c108 to d0/d3/d14/d1c/d126/c13c 0 2024-02-10T00:00:40.347 INFO:tasks.workunit.client.1.smithi183.stdout:6/907: dread d2/d1a/f43 [0,4194304] 0 2024-02-10T00:00:40.349 INFO:tasks.workunit.client.1.smithi183.stdout:9/994: write d0/d3/fe8 [883970,114019] 0 2024-02-10T00:00:40.351 INFO:tasks.workunit.client.1.smithi183.stdout:3/833: rename d7/db/d2a/f69 to d7/db/d2a/d33/d59/db6/ffa 0 2024-02-10T00:00:40.352 INFO:tasks.workunit.client.1.smithi183.stdout:6/908: mkdir d2/d1a/d25/d3c/d31/d38/d87/d11a 0 2024-02-10T00:00:40.354 INFO:tasks.workunit.client.1.smithi183.stdout:3/834: symlink d7/db/d2a/d2d/d51/d8f/lfb 0 2024-02-10T00:00:40.354 INFO:tasks.workunit.client.0.smithi164.stdout:7/682: sync 2024-02-10T00:00:40.355 INFO:tasks.workunit.client.0.smithi164.stdout:4/658: dwrite d2/d2f/d37/d41/f4e [0,4194304] 0 2024-02-10T00:00:40.356 INFO:tasks.workunit.client.1.smithi183.stdout:6/909: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d11b 0 2024-02-10T00:00:40.357 INFO:tasks.workunit.client.0.smithi164.stdout:5/736: symlink d7/d17/d21/d23/d37/d36/d8b/lf7 0 2024-02-10T00:00:40.357 INFO:tasks.workunit.client.1.smithi183.stdout:3/835: creat d7/db/d2a/d4d/dde/ffc x:0 0 0 2024-02-10T00:00:40.358 INFO:tasks.workunit.client.0.smithi164.stdout:8/665: symlink d2/d64/d65/d80/d32/d93/db0/lce 0 2024-02-10T00:00:40.358 INFO:tasks.workunit.client.1.smithi183.stdout:9/995: dwrite d0/d3/d14/d1c/d2d/d4f/db8/de7/d136/ddc/de1/f115 [0,4194304] 0 2024-02-10T00:00:40.358 INFO:tasks.workunit.client.0.smithi164.stdout:8/666: chown d2/d64/d7d/fa7 117 1 2024-02-10T00:00:40.358 INFO:tasks.workunit.client.1.smithi183.stdout:6/910: readlink d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7b 0 2024-02-10T00:00:40.360 INFO:tasks.workunit.client.1.smithi183.stdout:9/996: chown d0/d3/d14/d1c/d2d/d4f/db8/de7/d136/fc4 4 1 2024-02-10T00:00:40.369 INFO:tasks.workunit.client.1.smithi183.stdout:1/921: truncate d0/d3/f2d 2853089 0 2024-02-10T00:00:40.370 INFO:tasks.workunit.client.0.smithi164.stdout:2/731: truncate d3/da6/d7a/d8e/db6/fbe 111921 0 2024-02-10T00:00:40.370 INFO:tasks.workunit.client.0.smithi164.stdout:1/606: mkdir d1/d23/dd3 0 2024-02-10T00:00:40.370 INFO:tasks.workunit.client.1.smithi183.stdout:7/936: sync 2024-02-10T00:00:40.371 INFO:tasks.workunit.client.0.smithi164.stdout:3/586: readlink d0/d1/d2/lb 0 2024-02-10T00:00:40.371 INFO:tasks.workunit.client.1.smithi183.stdout:7/937: write d0/d11/d3e/f49 [8113225,130442] 0 2024-02-10T00:00:40.371 INFO:tasks.workunit.client.0.smithi164.stdout:9/656: mkdir d6/de/d40/dd4 0 2024-02-10T00:00:40.374 INFO:tasks.workunit.client.0.smithi164.stdout:5/737: mkdir d7/d17/d21/d23/d37/d36/df8 0 2024-02-10T00:00:40.375 INFO:tasks.workunit.client.1.smithi183.stdout:1/922: creat d0/d3/d67/d70/dae/f13c x:0 0 0 2024-02-10T00:00:40.377 INFO:tasks.workunit.client.1.smithi183.stdout:6/911: truncate d2/d1a/d25/f119 2509141 0 2024-02-10T00:00:40.378 INFO:tasks.workunit.client.0.smithi164.stdout:2/732: creat d3/da6/d7a/de1/f106 x:0 0 0 2024-02-10T00:00:40.378 INFO:tasks.workunit.client.1.smithi183.stdout:9/997: mknod d0/d3/d14/d1c/d4b/d97/c13d 0 2024-02-10T00:00:40.379 INFO:tasks.workunit.client.0.smithi164.stdout:6/715: truncate d0/d2b/d3a/d3d/d42/fa8 965005 0 2024-02-10T00:00:40.382 INFO:tasks.workunit.client.0.smithi164.stdout:4/659: rename d2/d2f/d37/l58 to d2/d19/d16/d31/d72/dc7/lea 0 2024-02-10T00:00:40.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/667: creat d2/d64/d65/d80/d32/d93/db7/fcf x:0 0 0 2024-02-10T00:00:40.383 INFO:tasks.workunit.client.1.smithi183.stdout:9/998: dwrite d0/d3/d14/d74/f7f [0,4194304] 0 2024-02-10T00:00:40.383 INFO:tasks.workunit.client.1.smithi183.stdout:3/836: rename d7/db/d2a/d2d/d51/db8 to d7/db/d2a/d33/dfd 0 2024-02-10T00:00:40.384 INFO:tasks.workunit.client.0.smithi164.stdout:8/668: stat d2/d64/d54/d5f/fc7 0 2024-02-10T00:00:40.385 INFO:tasks.workunit.client.1.smithi183.stdout:1/923: write d0/d3/d67/d7b/dfe/d7c/fee [3562055,29681] 0 2024-02-10T00:00:40.389 INFO:tasks.workunit.client.0.smithi164.stdout:3/587: write d0/d1/d2/d17/d37/d3f/d4e/d6d/fa7 [2469649,38194] 0 2024-02-10T00:00:40.389 INFO:tasks.workunit.client.1.smithi183.stdout:3/837: symlink d7/db/d2a/d33/d59/daa/lfe 0 2024-02-10T00:00:40.390 INFO:tasks.workunit.client.0.smithi164.stdout:3/588: chown d0/d1/d2/la 52 1 2024-02-10T00:00:40.392 INFO:tasks.workunit.client.1.smithi183.stdout:9/999: creat d0/d3/d14/d1c/d4b/d97/daa/f13e x:0 0 0 2024-02-10T00:00:40.393 INFO:tasks.workunit.client.1.smithi183.stdout:6/912: truncate d2/d1a/d25/d3c/d31/d38/d6e/d34/fa9 943548 0 2024-02-10T00:00:40.396 INFO:tasks.workunit.client.0.smithi164.stdout:0/641: rename d6/d10/d18/d2d/l83 to d6/d7/d14/da6/daa/lc5 0 2024-02-10T00:00:40.397 INFO:tasks.workunit.client.1.smithi183.stdout:1/924: creat d0/d3/d7/d3d/dcb/f13d x:0 0 0 2024-02-10T00:00:40.397 INFO:tasks.workunit.client.0.smithi164.stdout:5/738: mkdir d7/df9 0 2024-02-10T00:00:40.398 INFO:tasks.workunit.client.1.smithi183.stdout:6/913: creat d2/dab/f11c x:0 0 0 2024-02-10T00:00:40.398 INFO:tasks.workunit.client.0.smithi164.stdout:4/660: creat d2/d19/d16/d31/d72/feb x:0 0 0 2024-02-10T00:00:40.398 INFO:tasks.workunit.client.0.smithi164.stdout:8/669: chown d2/f27 22892 1 2024-02-10T00:00:40.399 INFO:tasks.workunit.client.1.smithi183.stdout:1/925: creat d0/d3/d7/def/f13e x:0 0 0 2024-02-10T00:00:40.399 INFO:tasks.workunit.client.1.smithi183.stdout:6/914: write d2/d1a/d25/d3c/d31/d38/d6e/d34/dee/f10a [56385,37038] 0 2024-02-10T00:00:40.399 INFO:tasks.workunit.client.0.smithi164.stdout:1/607: truncate d1/d23/f84 674583 0 2024-02-10T00:00:40.400 INFO:tasks.workunit.client.0.smithi164.stdout:3/589: fdatasync d0/d1/d2/d19/d66/d84/f55 0 2024-02-10T00:00:40.401 INFO:tasks.workunit.client.1.smithi183.stdout:6/915: write d2/d1a/d25/d3c/d31/d38/d6e/d34/dee/ff2 [107715,96414] 0 2024-02-10T00:00:40.401 INFO:tasks.workunit.client.0.smithi164.stdout:7/683: getdents d3/d26/d67 0 2024-02-10T00:00:40.401 INFO:tasks.workunit.client.1.smithi183.stdout:1/926: write d0/d3a/dd8/d108/f117 [1016584,63855] 0 2024-02-10T00:00:40.402 INFO:tasks.workunit.client.1.smithi183.stdout:6/916: dread - d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/ff4 zero size 2024-02-10T00:00:40.403 INFO:tasks.workunit.client.0.smithi164.stdout:0/642: chown d6/d7/d14/c28 87582008 1 2024-02-10T00:00:40.405 INFO:tasks.workunit.client.1.smithi183.stdout:6/917: mknod d2/da0/c11d 0 2024-02-10T00:00:40.405 INFO:tasks.workunit.client.1.smithi183.stdout:7/938: dread d0/d11/d3e/f89 [0,4194304] 0 2024-02-10T00:00:40.406 INFO:tasks.workunit.client.1.smithi183.stdout:1/927: creat d0/d3/d7/d3d/d60/d89/de4/d12e/f13f x:0 0 0 2024-02-10T00:00:40.407 INFO:tasks.workunit.client.0.smithi164.stdout:5/739: mknod d7/d17/d21/d23/d5a/d68/d1f/dbe/df2/cfa 0 2024-02-10T00:00:40.407 INFO:tasks.workunit.client.0.smithi164.stdout:9/657: dread d6/d41/d8b/f1f [0,4194304] 0 2024-02-10T00:00:40.409 INFO:tasks.workunit.client.1.smithi183.stdout:3/838: rmdir d7/db/d2a/d33 39 2024-02-10T00:00:40.410 INFO:tasks.workunit.client.0.smithi164.stdout:3/590: creat d0/fb1 x:0 0 0 2024-02-10T00:00:40.410 INFO:tasks.workunit.client.0.smithi164.stdout:9/658: rmdir d6/de/d22 39 2024-02-10T00:00:40.412 INFO:tasks.workunit.client.0.smithi164.stdout:1/608: dread d1/f11 [4194304,4194304] 0 2024-02-10T00:00:40.413 INFO:tasks.workunit.client.1.smithi183.stdout:6/918: rename d2/dab/f11c to d2/d1a/d25/d3c/d31/d38/d6e/d35/f11e 0 2024-02-10T00:00:40.415 INFO:tasks.workunit.client.0.smithi164.stdout:4/661: write d2/d19/fc9 [997358,45813] 0 2024-02-10T00:00:40.418 INFO:tasks.workunit.client.0.smithi164.stdout:9/659: readlink d6/de/d22/d58/dba/l89 0 2024-02-10T00:00:40.419 INFO:tasks.workunit.client.1.smithi183.stdout:1/928: link d0/d12d/fbe d0/d3/d7/d3d/d60/dc2/f140 0 2024-02-10T00:00:40.420 INFO:tasks.workunit.client.0.smithi164.stdout:2/733: dwrite d3/d32/d4e/d27/f28 [0,4194304] 0 2024-02-10T00:00:40.420 INFO:tasks.workunit.client.0.smithi164.stdout:6/716: dwrite d0/d2b/d3a/d3d/d42/fa8 [0,4194304] 0 2024-02-10T00:00:40.421 INFO:tasks.workunit.client.1.smithi183.stdout:3/839: creat d7/db/d2a/d33/d59/daa/fff x:0 0 0 2024-02-10T00:00:40.422 INFO:tasks.workunit.client.0.smithi164.stdout:0/643: truncate d6/f3d 3757177 0 2024-02-10T00:00:40.424 INFO:tasks.workunit.client.1.smithi183.stdout:7/939: truncate d0/d2/d50/dd1/d11c/f122 1675941 0 2024-02-10T00:00:40.424 INFO:tasks.workunit.client.0.smithi164.stdout:0/644: read d6/d10/f1d [780396,59810] 0 2024-02-10T00:00:40.424 INFO:tasks.workunit.client.1.smithi183.stdout:1/929: fsync d0/d3/d67/d70/f10c 0 2024-02-10T00:00:40.426 INFO:tasks.workunit.client.1.smithi183.stdout:6/919: creat d2/d1a/d25/d3c/d31/d38/d6e/f11f x:0 0 0 2024-02-10T00:00:40.426 INFO:tasks.workunit.client.0.smithi164.stdout:0/645: read d6/d10/f1d [73497,103003] 0 2024-02-10T00:00:40.426 INFO:tasks.workunit.client.0.smithi164.stdout:0/646: readlink d6/l63 0 2024-02-10T00:00:40.427 INFO:tasks.workunit.client.1.smithi183.stdout:6/920: readlink d2/d1a/d25/d3c/d31/d38/lb5 0 2024-02-10T00:00:40.428 INFO:tasks.workunit.client.1.smithi183.stdout:7/940: dwrite d0/d11/d3e/f7c [0,4194304] 0 2024-02-10T00:00:40.429 INFO:tasks.workunit.client.1.smithi183.stdout:6/921: chown d2/d1a/d25/d3c/d31/l105 3 1 2024-02-10T00:00:40.435 INFO:tasks.workunit.client.1.smithi183.stdout:3/840: fdatasync d7/db/d2a/d2d/f31 0 2024-02-10T00:00:40.435 INFO:tasks.workunit.client.1.smithi183.stdout:7/941: dread - d0/d2/d4/d8/d59/fc9 zero size 2024-02-10T00:00:40.435 INFO:tasks.workunit.client.1.smithi183.stdout:6/922: rmdir d2/d1a/d25/d3c/d31/d38/d6e/d34 39 2024-02-10T00:00:40.435 INFO:tasks.workunit.client.0.smithi164.stdout:1/609: creat d1/d23/fd4 x:0 0 0 2024-02-10T00:00:40.436 INFO:tasks.workunit.client.0.smithi164.stdout:1/610: readlink d1/d1a/d41/l12 0 2024-02-10T00:00:40.437 INFO:tasks.workunit.client.0.smithi164.stdout:4/662: chown d2/d2f/d37/d41/d3d/d42/da2/fc2 1 1 2024-02-10T00:00:40.438 INFO:tasks.workunit.client.1.smithi183.stdout:1/930: creat d0/d3/d7/def/d115/f141 x:0 0 0 2024-02-10T00:00:40.439 INFO:tasks.workunit.client.0.smithi164.stdout:5/740: truncate d7/d17/d21/d23/d5a/d68/d1f/d59/ff5 1849224 0 2024-02-10T00:00:40.440 INFO:tasks.workunit.client.0.smithi164.stdout:5/741: fdatasync d7/d17/d21/d23/d5a/d68/d1f/dbe/fc4 0 2024-02-10T00:00:40.441 INFO:tasks.workunit.client.1.smithi183.stdout:7/942: fsync d0/d11/d2f/d64/d6b/f75 0 2024-02-10T00:00:40.441 INFO:tasks.workunit.client.0.smithi164.stdout:9/660: mknod d6/de/d40/cd5 0 2024-02-10T00:00:40.442 INFO:tasks.workunit.client.0.smithi164.stdout:6/717: mkdir d0/d2b/d3a/dd0/df2 0 2024-02-10T00:00:40.444 INFO:tasks.workunit.client.0.smithi164.stdout:1/611: rename d1/d1a/d41/d18/d3a/c4f to d1/d1a/d41/d18/d3a/cd5 0 2024-02-10T00:00:40.444 INFO:tasks.workunit.client.1.smithi183.stdout:1/931: dwrite d0/d3/d7/def/f13e [0,4194304] 0 2024-02-10T00:00:40.445 INFO:tasks.workunit.client.0.smithi164.stdout:1/612: readlink d1/d13/d2b/l86 0 2024-02-10T00:00:40.446 INFO:tasks.workunit.client.0.smithi164.stdout:2/734: mknod d3/c107 0 2024-02-10T00:00:40.449 INFO:tasks.workunit.client.0.smithi164.stdout:5/742: unlink d7/d17/d21/d23/d5a/d68/d1f/f9a 0 2024-02-10T00:00:40.449 INFO:tasks.workunit.client.0.smithi164.stdout:1/613: dwrite d1/f7 [4194304,4194304] 0 2024-02-10T00:00:40.449 INFO:tasks.workunit.client.0.smithi164.stdout:9/661: creat d6/de/d22/d58/fd6 x:0 0 0 2024-02-10T00:00:40.450 INFO:tasks.workunit.client.1.smithi183.stdout:1/932: getdents d0/d3/d67 0 2024-02-10T00:00:40.450 INFO:tasks.workunit.client.1.smithi183.stdout:1/933: stat d0/d3/d67/d7b/dfe/d7c/fee 0 2024-02-10T00:00:40.450 INFO:tasks.workunit.client.0.smithi164.stdout:1/614: write d1/d13/d2b/d52/da4/fbd [694184,19038] 0 2024-02-10T00:00:40.451 INFO:tasks.workunit.client.1.smithi183.stdout:3/841: dread d7/db/d2a/d1c/f27 [0,4194304] 0 2024-02-10T00:00:40.452 INFO:tasks.workunit.client.0.smithi164.stdout:3/591: truncate d0/d1/dd/f8d 86963 0 2024-02-10T00:00:40.453 INFO:tasks.workunit.client.1.smithi183.stdout:1/934: getdents d0/d3/d7 0 2024-02-10T00:00:40.454 INFO:tasks.workunit.client.0.smithi164.stdout:2/735: stat d3/l4 0 2024-02-10T00:00:40.454 INFO:tasks.workunit.client.0.smithi164.stdout:8/670: sync 2024-02-10T00:00:40.454 INFO:tasks.workunit.client.0.smithi164.stdout:7/684: sync 2024-02-10T00:00:40.455 INFO:tasks.workunit.client.1.smithi183.stdout:6/923: dread d2/d1a/d25/f114 [0,4194304] 0 2024-02-10T00:00:40.456 INFO:tasks.workunit.client.0.smithi164.stdout:1/615: dwrite d1/d1a/d41/d18/d3a/fb9 [0,4194304] 0 2024-02-10T00:00:40.456 INFO:tasks.workunit.client.0.smithi164.stdout:0/647: link d6/d10/d4a/d60/d6c/f5e d6/d10/d18/d1c/d92/fc6 0 2024-02-10T00:00:40.459 INFO:tasks.workunit.client.0.smithi164.stdout:3/592: dwrite d0/d1/d2/d19/d27/d5f/da5/f57 [0,4194304] 0 2024-02-10T00:00:40.459 INFO:tasks.workunit.client.1.smithi183.stdout:6/924: dread d2/d1a/d25/d3c/d31/d38/d6e/f10d [0,4194304] 0 2024-02-10T00:00:40.460 INFO:tasks.workunit.client.1.smithi183.stdout:1/935: rmdir d0/d3/d67/d70 39 2024-02-10T00:00:40.461 INFO:tasks.workunit.client.1.smithi183.stdout:6/925: write d2/d1a/d25/d3c/d31/d38/fb2 [529159,107377] 0 2024-02-10T00:00:40.461 INFO:tasks.workunit.client.0.smithi164.stdout:3/593: write d0/d1/d2/d19/d66/d81/f9f [366399,64577] 0 2024-02-10T00:00:40.461 INFO:tasks.workunit.client.0.smithi164.stdout:5/743: mkdir d7/d17/d21/dfb 0 2024-02-10T00:00:40.461 INFO:tasks.workunit.client.0.smithi164.stdout:3/594: chown d0/d1/dd/l61 3 1 2024-02-10T00:00:40.463 INFO:tasks.workunit.client.0.smithi164.stdout:9/662: dread d6/de/d40/f88 [0,4194304] 0 2024-02-10T00:00:40.464 INFO:tasks.workunit.client.1.smithi183.stdout:6/926: dread d2/d1a/d25/d3c/d31/d38/d3f/f4d [0,4194304] 0 2024-02-10T00:00:40.464 INFO:tasks.workunit.client.1.smithi183.stdout:1/936: mkdir d0/d3/d7/d3d/d142 0 2024-02-10T00:00:40.466 INFO:tasks.workunit.client.0.smithi164.stdout:1/616: dwrite d1/d1a/fa3 [0,4194304] 0 2024-02-10T00:00:40.467 INFO:tasks.workunit.client.0.smithi164.stdout:3/595: rmdir d0/d1/d2/d19/d27/d30 39 2024-02-10T00:00:40.469 INFO:tasks.workunit.client.0.smithi164.stdout:0/648: unlink d6/d7/d14/da6/daa/lc5 0 2024-02-10T00:00:40.469 INFO:tasks.workunit.client.0.smithi164.stdout:9/663: chown d6/f7 21 1 2024-02-10T00:00:40.472 INFO:tasks.workunit.client.0.smithi164.stdout:7/685: creat d3/d5/d2b/fe6 x:0 0 0 2024-02-10T00:00:40.474 INFO:tasks.workunit.client.0.smithi164.stdout:1/617: write d1/d1a/d41/d18/f9f [1295223,130846] 0 2024-02-10T00:00:40.480 INFO:tasks.workunit.client.0.smithi164.stdout:7/686: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:40.480 INFO:tasks.workunit.client.0.smithi164.stdout:3/596: mknod d0/d1/d2/d17/d37/d3f/d4e/cb2 0 2024-02-10T00:00:40.489 INFO:tasks.workunit.client.0.smithi164.stdout:7/687: dread d3/d26/f27 [0,4194304] 0 2024-02-10T00:00:40.489 INFO:tasks.workunit.client.0.smithi164.stdout:0/649: rename d6/d7/d14/d79/da2 to d6/d10/d4a/dc7 0 2024-02-10T00:00:40.489 INFO:tasks.workunit.client.0.smithi164.stdout:9/664: link d6/de/d40/c7f d6/de/d22/dd3/cd7 0 2024-02-10T00:00:40.490 INFO:tasks.workunit.client.0.smithi164.stdout:0/650: chown d6/d7/d14/l8b 20 1 2024-02-10T00:00:40.491 INFO:tasks.workunit.client.0.smithi164.stdout:0/651: chown d6/d10/d4a/l4f 185377 1 2024-02-10T00:00:40.493 INFO:tasks.workunit.client.0.smithi164.stdout:7/688: creat d3/d11/d39/d44/d6f/d75/fe7 x:0 0 0 2024-02-10T00:00:40.493 INFO:tasks.workunit.client.1.smithi183.stdout:7/943: write d0/d2/d50/dad/fc2 [757908,52110] 0 2024-02-10T00:00:40.494 INFO:tasks.workunit.client.0.smithi164.stdout:3/597: truncate d0/d1/d3c/f7c 5661144 0 2024-02-10T00:00:40.494 INFO:tasks.workunit.client.1.smithi183.stdout:7/944: dread - d0/d11/d3e/fdd zero size 2024-02-10T00:00:40.495 INFO:tasks.workunit.client.0.smithi164.stdout:3/598: rename d0/d1/d2/d19/d66 to d0/d1/d2/d19/d66/d84/d82/db3 22 2024-02-10T00:00:40.500 INFO:tasks.workunit.client.0.smithi164.stdout:3/599: link d0/d1/d2/d17/d37/d3f/d4e/cb2 d0/d1/d2/cb4 0 2024-02-10T00:00:40.501 INFO:tasks.workunit.client.0.smithi164.stdout:3/600: chown d0/d1/d2/d19/d27/d30 3924 1 2024-02-10T00:00:40.505 INFO:tasks.workunit.client.0.smithi164.stdout:3/601: truncate d0/d1/d2/d19/d27/f2c 2215652 0 2024-02-10T00:00:40.506 INFO:tasks.workunit.client.1.smithi183.stdout:3/842: write d7/db/d2a/d33/d59/fac [906669,8101] 0 2024-02-10T00:00:40.508 INFO:tasks.workunit.client.0.smithi164.stdout:3/602: read d0/d1/d3c/f63 [1716783,90211] 0 2024-02-10T00:00:40.511 INFO:tasks.workunit.client.0.smithi164.stdout:5/744: dread d7/d17/d21/d23/d5a/d68/d1f/fbb [0,4194304] 0 2024-02-10T00:00:40.514 INFO:tasks.workunit.client.0.smithi164.stdout:3/603: truncate d0/d1/f11 4052537 0 2024-02-10T00:00:40.514 INFO:tasks.workunit.client.1.smithi183.stdout:6/927: creat d2/d1a/d25/d3c/d31/d66/f120 x:0 0 0 2024-02-10T00:00:40.514 INFO:tasks.workunit.client.0.smithi164.stdout:4/663: write d2/d2f/d37/d41/d3d/f64 [1967054,45236] 0 2024-02-10T00:00:40.515 INFO:tasks.workunit.client.1.smithi183.stdout:3/843: mknod d7/db/d2a/d33/dfd/c100 0 2024-02-10T00:00:40.519 INFO:tasks.workunit.client.0.smithi164.stdout:6/718: truncate d0/d2b/d3a/d3d/d42/d5d/df0/fd2 597587 0 2024-02-10T00:00:40.519 INFO:tasks.workunit.client.1.smithi183.stdout:1/937: mknod d0/d3/d67/d70/dae/d135/c143 0 2024-02-10T00:00:40.520 INFO:tasks.workunit.client.1.smithi183.stdout:1/938: write d0/d3/d67/d70/dae/d135/dc9/f28 [4436577,26012] 0 2024-02-10T00:00:40.520 INFO:tasks.workunit.client.0.smithi164.stdout:3/604: unlink d0/d3b/c67 0 2024-02-10T00:00:40.521 INFO:tasks.workunit.client.1.smithi183.stdout:7/945: link d0/d2/d50/dad/df8/f119 d0/f127 0 2024-02-10T00:00:40.521 INFO:tasks.workunit.client.0.smithi164.stdout:8/671: write d2/f27 [1918967,12516] 0 2024-02-10T00:00:40.521 INFO:tasks.workunit.client.0.smithi164.stdout:5/745: dread d7/f19 [0,4194304] 0 2024-02-10T00:00:40.522 INFO:tasks.workunit.client.0.smithi164.stdout:4/664: readlink d2/d19/d16/d31/d7e/l9e 0 2024-02-10T00:00:40.523 INFO:tasks.workunit.client.1.smithi183.stdout:3/844: creat d7/f101 x:0 0 0 2024-02-10T00:00:40.524 INFO:tasks.workunit.client.0.smithi164.stdout:2/736: truncate d3/da6/d7a/d8e/d88/f95 525369 0 2024-02-10T00:00:40.524 INFO:tasks.workunit.client.1.smithi183.stdout:7/946: mkdir d0/d11/d2f/d64/d6b/d128 0 2024-02-10T00:00:40.525 INFO:tasks.workunit.client.1.smithi183.stdout:3/845: read d7/db/f13 [2014592,43429] 0 2024-02-10T00:00:40.526 INFO:tasks.workunit.client.1.smithi183.stdout:1/939: rename d0/d3/d7/d3d/dcb/f13d to d0/d12d/f144 0 2024-02-10T00:00:40.526 INFO:tasks.workunit.client.0.smithi164.stdout:4/665: dwrite d2/d19/d16/d31/d4b/f8d [0,4194304] 0 2024-02-10T00:00:40.527 INFO:tasks.workunit.client.1.smithi183.stdout:1/940: write d0/d3/d7/d3d/d60/d89/f12b [566575,72889] 0 2024-02-10T00:00:40.527 INFO:tasks.workunit.client.1.smithi183.stdout:6/928: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/f121 x:0 0 0 2024-02-10T00:00:40.527 INFO:tasks.workunit.client.1.smithi183.stdout:1/941: chown d0/d12d/d100 7 1 2024-02-10T00:00:40.528 INFO:tasks.workunit.client.0.smithi164.stdout:4/666: chown d2/d2f/d37/d41/d3d/d56/d85/c99 1751 1 2024-02-10T00:00:40.530 INFO:tasks.workunit.client.0.smithi164.stdout:9/665: dwrite d6/d41/fb1 [0,4194304] 0 2024-02-10T00:00:40.531 INFO:tasks.workunit.client.0.smithi164.stdout:7/689: truncate d3/d26/f31 621665 0 2024-02-10T00:00:40.531 INFO:tasks.workunit.client.0.smithi164.stdout:0/652: write d6/d3a/d52/d7a/f94 [763217,101249] 0 2024-02-10T00:00:40.532 INFO:tasks.workunit.client.1.smithi183.stdout:7/947: mknod d0/d2/d50/dad/c129 0 2024-02-10T00:00:40.532 INFO:tasks.workunit.client.0.smithi164.stdout:7/690: stat d3/d5/d2b/dab/dda/d5d/la1 0 2024-02-10T00:00:40.536 INFO:tasks.workunit.client.1.smithi183.stdout:1/942: symlink d0/d3/d7/def/l145 0 2024-02-10T00:00:40.537 INFO:tasks.workunit.client.0.smithi164.stdout:1/618: sync 2024-02-10T00:00:40.538 INFO:tasks.workunit.client.0.smithi164.stdout:2/737: read - d3/da6/d7a/fa3 zero size 2024-02-10T00:00:40.538 INFO:tasks.workunit.client.0.smithi164.stdout:2/738: readlink d3/d24/d5b/dd9/lfe 0 2024-02-10T00:00:40.539 INFO:tasks.workunit.client.1.smithi183.stdout:7/948: unlink d0/d11/d2f/f34 0 2024-02-10T00:00:40.540 INFO:tasks.workunit.client.0.smithi164.stdout:4/667: fsync d2/d2f/d37/d45/dab/dbd/fc4 0 2024-02-10T00:00:40.540 INFO:tasks.workunit.client.1.smithi183.stdout:6/929: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/f11e [0,4194304] 0 2024-02-10T00:00:40.540 INFO:tasks.workunit.client.1.smithi183.stdout:6/930: chown d2/d32 4125 1 2024-02-10T00:00:40.541 INFO:tasks.workunit.client.0.smithi164.stdout:0/653: creat d6/d3a/d52/fc8 x:0 0 0 2024-02-10T00:00:40.542 INFO:tasks.workunit.client.1.smithi183.stdout:1/943: rename d0/d3a/dd8/d108/f117 to d0/d3a/f146 0 2024-02-10T00:00:40.544 INFO:tasks.workunit.client.1.smithi183.stdout:6/931: dread d2/d1a/d25/d3c/d31/d38/d6e/d34/dee/ff2 [0,4194304] 0 2024-02-10T00:00:40.544 INFO:tasks.workunit.client.1.smithi183.stdout:3/846: creat d7/db/d2a/d2d/d51/f102 x:0 0 0 2024-02-10T00:00:40.545 INFO:tasks.workunit.client.0.smithi164.stdout:8/672: creat d2/d64/d65/d80/d32/d4d/fd0 x:0 0 0 2024-02-10T00:00:40.547 INFO:tasks.workunit.client.0.smithi164.stdout:0/654: dwrite d6/d10/d18/f67 [0,4194304] 0 2024-02-10T00:00:40.549 INFO:tasks.workunit.client.0.smithi164.stdout:5/746: symlink d7/d17/d21/d23/lfc 0 2024-02-10T00:00:40.550 INFO:tasks.workunit.client.1.smithi183.stdout:1/944: creat d0/d3/d7/def/d115/f147 x:0 0 0 2024-02-10T00:00:40.551 INFO:tasks.workunit.client.0.smithi164.stdout:6/719: truncate d0/d2b/d3a/d3d/d42/d5d/d79/fb1 533972 0 2024-02-10T00:00:40.552 INFO:tasks.workunit.client.1.smithi183.stdout:6/932: rename d2/f19 to d2/d1a/d117/f122 0 2024-02-10T00:00:40.553 INFO:tasks.workunit.client.1.smithi183.stdout:3/847: fsync d7/d98/fa3 0 2024-02-10T00:00:40.555 INFO:tasks.workunit.client.1.smithi183.stdout:7/949: dread d0/f21 [0,4194304] 0 2024-02-10T00:00:40.556 INFO:tasks.workunit.client.0.smithi164.stdout:3/605: link d0/d1/faf d0/d1/d2/d19/d27/fb5 0 2024-02-10T00:00:40.558 INFO:tasks.workunit.client.0.smithi164.stdout:5/747: symlink d7/d17/d69/d92/da8/dcd/lfd 0 2024-02-10T00:00:40.559 INFO:tasks.workunit.client.1.smithi183.stdout:7/950: dwrite d0/d11/dc3/ff6 [0,4194304] 0 2024-02-10T00:00:40.561 INFO:tasks.workunit.client.0.smithi164.stdout:6/720: truncate d0/d6/f4f 4614638 0 2024-02-10T00:00:40.563 INFO:tasks.workunit.client.0.smithi164.stdout:5/748: fdatasync d7/d17/d21/d85/fa4 0 2024-02-10T00:00:40.566 INFO:tasks.workunit.client.0.smithi164.stdout:2/739: unlink d3/da6/d7a/d8e/d8a/ca1 0 2024-02-10T00:00:40.567 INFO:tasks.workunit.client.0.smithi164.stdout:8/673: truncate d2/d81/f8c 651024 0 2024-02-10T00:00:40.567 INFO:tasks.workunit.client.0.smithi164.stdout:2/740: write d3/d32/fea [635682,44751] 0 2024-02-10T00:00:40.568 INFO:tasks.workunit.client.0.smithi164.stdout:0/655: truncate d6/d10/d18/d2d/fb8 407335 0 2024-02-10T00:00:40.569 INFO:tasks.workunit.client.0.smithi164.stdout:3/606: symlink d0/d1/d2/d19/d27/lb6 0 2024-02-10T00:00:40.572 INFO:tasks.workunit.client.0.smithi164.stdout:5/749: rename d7/d17/d21/fbd to d7/d17/d69/d92/ffe 0 2024-02-10T00:00:40.572 INFO:tasks.workunit.client.0.smithi164.stdout:1/619: dread d1/d13/d2b/d52/db7/fa7 [4194304,4194304] 0 2024-02-10T00:00:40.573 INFO:tasks.workunit.client.0.smithi164.stdout:1/620: write d1/d13/f66 [1372761,92812] 0 2024-02-10T00:00:40.574 INFO:tasks.workunit.client.0.smithi164.stdout:1/621: write d1/d1a/d41/d18/f9f [198234,100416] 0 2024-02-10T00:00:40.575 INFO:tasks.workunit.client.0.smithi164.stdout:2/741: creat d3/d24/d5b/f108 x:0 0 0 2024-02-10T00:00:40.576 INFO:tasks.workunit.client.1.smithi183.stdout:1/945: mkdir d0/d3/d67/d70/d148 0 2024-02-10T00:00:40.577 INFO:tasks.workunit.client.1.smithi183.stdout:3/848: write d7/db/d2a/d2d/fcc [97097,25785] 0 2024-02-10T00:00:40.577 INFO:tasks.workunit.client.0.smithi164.stdout:3/607: creat d0/d8f/d9a/fb7 x:0 0 0 2024-02-10T00:00:40.580 INFO:tasks.workunit.client.0.smithi164.stdout:2/742: dwrite d3/d32/d4e/fc6 [0,4194304] 0 2024-02-10T00:00:40.582 INFO:tasks.workunit.client.1.smithi183.stdout:6/933: rename d2/d1a/d25/d3c/c62 to d2/d1a/d25/d3c/c123 0 2024-02-10T00:00:40.582 INFO:tasks.workunit.client.0.smithi164.stdout:9/666: truncate d6/f3e 8053433 0 2024-02-10T00:00:40.582 INFO:tasks.workunit.client.0.smithi164.stdout:8/674: dread d2/f7 [0,4194304] 0 2024-02-10T00:00:40.584 INFO:tasks.workunit.client.0.smithi164.stdout:3/608: dwrite d0/d1/d2/d17/d37/f69 [0,4194304] 0 2024-02-10T00:00:40.584 INFO:tasks.workunit.client.1.smithi183.stdout:3/849: dread - d7/db/f96 zero size 2024-02-10T00:00:40.585 INFO:tasks.workunit.client.1.smithi183.stdout:6/934: dread - d2/d1a/d25/d3c/d31/d38/d3f/f116 zero size 2024-02-10T00:00:40.585 INFO:tasks.workunit.client.0.smithi164.stdout:3/609: write d0/f10 [2681019,40687] 0 2024-02-10T00:00:40.585 INFO:tasks.workunit.client.1.smithi183.stdout:3/850: dread - d7/db/d2a/d33/d59/df7/fe0 zero size 2024-02-10T00:00:40.595 INFO:tasks.workunit.client.0.smithi164.stdout:7/691: sync 2024-02-10T00:00:40.596 INFO:tasks.workunit.client.0.smithi164.stdout:3/610: creat d0/d1/d2/d17/d37/d3f/d4e/d6d/fb8 x:0 0 0 2024-02-10T00:00:40.599 INFO:tasks.workunit.client.0.smithi164.stdout:3/611: dwrite d0/d1/d2/fe [0,4194304] 0 2024-02-10T00:00:40.600 INFO:tasks.workunit.client.0.smithi164.stdout:5/750: mkdir d7/d17/d21/d24/dff 0 2024-02-10T00:00:40.605 INFO:tasks.workunit.client.0.smithi164.stdout:2/743: rmdir d3/da6/d7a/d8e/d8a/dc8 39 2024-02-10T00:00:40.607 INFO:tasks.workunit.client.1.smithi183.stdout:6/935: rename d2/d1a/d117/f122 to d2/d1a/d25/d3c/d31/d38/d3f/d5e/f124 0 2024-02-10T00:00:40.608 INFO:tasks.workunit.client.0.smithi164.stdout:9/667: mknod d6/de/cd8 0 2024-02-10T00:00:40.610 INFO:tasks.workunit.client.0.smithi164.stdout:1/622: truncate d1/d23/fc8 969745 0 2024-02-10T00:00:40.611 INFO:tasks.workunit.client.0.smithi164.stdout:5/751: symlink d7/daf/l100 0 2024-02-10T00:00:40.612 INFO:tasks.workunit.client.0.smithi164.stdout:1/623: write d1/d1a/d41/d18/f3e [1824362,121412] 0 2024-02-10T00:00:40.612 INFO:tasks.workunit.client.1.smithi183.stdout:7/951: write d0/d11/d2f/fb6 [1667726,33152] 0 2024-02-10T00:00:40.613 INFO:tasks.workunit.client.0.smithi164.stdout:1/624: dread - d1/d64/dc7/fc9 zero size 2024-02-10T00:00:40.613 INFO:tasks.workunit.client.1.smithi183.stdout:7/952: chown d0/d2/d4/d8/d59/cb7 724620471 1 2024-02-10T00:00:40.614 INFO:tasks.workunit.client.0.smithi164.stdout:2/744: mkdir d3/d24/d5b/d109 0 2024-02-10T00:00:40.614 INFO:tasks.workunit.client.1.smithi183.stdout:3/851: rename d7/l22 to d7/db/d2a/d4d/l103 0 2024-02-10T00:00:40.614 INFO:tasks.workunit.client.1.smithi183.stdout:1/946: dwrite d0/d3/fa [4194304,4194304] 0 2024-02-10T00:00:40.617 INFO:tasks.workunit.client.1.smithi183.stdout:1/947: fdatasync d0/d3/d67/d7b/dfe/f110 0 2024-02-10T00:00:40.617 INFO:tasks.workunit.client.0.smithi164.stdout:2/745: dwrite d3/d24/d5b/f108 [0,4194304] 0 2024-02-10T00:00:40.618 INFO:tasks.workunit.client.0.smithi164.stdout:2/746: fdatasync d3/f62 0 2024-02-10T00:00:40.618 INFO:tasks.workunit.client.1.smithi183.stdout:3/852: write d7/db/d2a/d33/d59/fe3 [343319,128976] 0 2024-02-10T00:00:40.619 INFO:tasks.workunit.client.0.smithi164.stdout:8/675: rename d2/d64/d65/d80/d82/fa2 to d2/fd1 0 2024-02-10T00:00:40.622 INFO:tasks.workunit.client.1.smithi183.stdout:1/948: creat d0/d3/d67/d7b/d113/f149 x:0 0 0 2024-02-10T00:00:40.623 INFO:tasks.workunit.client.0.smithi164.stdout:6/721: dread d0/f1a [0,4194304] 0 2024-02-10T00:00:40.624 INFO:tasks.workunit.client.1.smithi183.stdout:3/853: dwrite d7/db/d2a/d4d/dde/ffc [0,4194304] 0 2024-02-10T00:00:40.625 INFO:tasks.workunit.client.0.smithi164.stdout:7/692: dwrite d3/d5/d2b/f4e [0,4194304] 0 2024-02-10T00:00:40.626 INFO:tasks.workunit.client.0.smithi164.stdout:7/693: stat d3/d11/d39/d44/d48/d50 0 2024-02-10T00:00:40.629 INFO:tasks.workunit.client.1.smithi183.stdout:1/949: unlink d0/d3/d7/d3d/dcb/ff8 0 2024-02-10T00:00:40.630 INFO:tasks.workunit.client.1.smithi183.stdout:3/854: mknod d7/db/d2a/d33/d59/df7/c104 0 2024-02-10T00:00:40.632 INFO:tasks.workunit.client.1.smithi183.stdout:1/950: symlink d0/d3/d7/d3d/dcb/l14a 0 2024-02-10T00:00:40.636 INFO:tasks.workunit.client.1.smithi183.stdout:6/936: dread d2/d1a/d25/d3c/d31/d66/f71 [0,4194304] 0 2024-02-10T00:00:40.637 INFO:tasks.workunit.client.1.smithi183.stdout:1/951: truncate d0/d3a/dd8/f119 1283055 0 2024-02-10T00:00:40.641 INFO:tasks.workunit.client.0.smithi164.stdout:8/676: rename d2/d64/d54/d71/d78/ca8 to d2/d64/d65/da9/cd2 0 2024-02-10T00:00:40.641 INFO:tasks.workunit.client.0.smithi164.stdout:8/677: dread - d2/d64/d7d/fc8 zero size 2024-02-10T00:00:40.641 INFO:tasks.workunit.client.1.smithi183.stdout:6/937: creat d2/d1a/d25/d3c/d31/f125 x:0 0 0 2024-02-10T00:00:40.642 INFO:tasks.workunit.client.0.smithi164.stdout:8/678: write d2/d64/d65/d80/d32/f55 [662505,45381] 0 2024-02-10T00:00:40.643 INFO:tasks.workunit.client.1.smithi183.stdout:3/855: dread d7/db/d2a/d33/f37 [0,4194304] 0 2024-02-10T00:00:40.643 INFO:tasks.workunit.client.0.smithi164.stdout:7/694: creat d3/d28/d51/fe8 x:0 0 0 2024-02-10T00:00:40.644 INFO:tasks.workunit.client.0.smithi164.stdout:5/752: mknod d7/d17/d21/d23/d5a/d68/d1f/c101 0 2024-02-10T00:00:40.645 INFO:tasks.workunit.client.0.smithi164.stdout:1/625: unlink d1/d1a/d41/d18/d33/c96 0 2024-02-10T00:00:40.647 INFO:tasks.workunit.client.0.smithi164.stdout:3/612: getdents d0/d8f 0 2024-02-10T00:00:40.647 INFO:tasks.workunit.client.1.smithi183.stdout:3/856: link d7/db/d2a/d2d/f92 d7/d98/f105 0 2024-02-10T00:00:40.648 INFO:tasks.workunit.client.1.smithi183.stdout:3/857: fsync d7/db/d2a/d33/d59/fac 0 2024-02-10T00:00:40.648 INFO:tasks.workunit.client.0.smithi164.stdout:8/679: symlink d2/d64/d65/d80/d32/d68/dac/ld3 0 2024-02-10T00:00:40.649 INFO:tasks.workunit.client.0.smithi164.stdout:7/695: creat d3/d28/d51/fe9 x:0 0 0 2024-02-10T00:00:40.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/696: chown d3/d5/d2b/d4a/l5c 16 1 2024-02-10T00:00:40.650 INFO:tasks.workunit.client.0.smithi164.stdout:7/697: dread - d3/d5/d2b/dab/fe0 zero size 2024-02-10T00:00:40.651 INFO:tasks.workunit.client.0.smithi164.stdout:3/613: symlink d0/d1/d2/d19/d27/d30/lb9 0 2024-02-10T00:00:40.652 INFO:tasks.workunit.client.0.smithi164.stdout:8/680: symlink d2/d64/d65/d80/d82/ld4 0 2024-02-10T00:00:40.653 INFO:tasks.workunit.client.0.smithi164.stdout:8/681: chown d2/d12/f48 3549899 1 2024-02-10T00:00:40.654 INFO:tasks.workunit.client.0.smithi164.stdout:3/614: mknod d0/d8f/cba 0 2024-02-10T00:00:40.655 INFO:tasks.workunit.client.0.smithi164.stdout:0/656: sync 2024-02-10T00:00:40.655 INFO:tasks.workunit.client.0.smithi164.stdout:4/668: sync 2024-02-10T00:00:40.655 INFO:tasks.workunit.client.0.smithi164.stdout:5/753: creat d7/d17/d21/d23/d37/f102 x:0 0 0 2024-02-10T00:00:40.656 INFO:tasks.workunit.client.0.smithi164.stdout:8/682: mknod d2/d64/d65/d80/d32/db2/cd5 0 2024-02-10T00:00:40.657 INFO:tasks.workunit.client.0.smithi164.stdout:3/615: creat d0/d1/d2/d19/d66/d81/fbb x:0 0 0 2024-02-10T00:00:40.658 INFO:tasks.workunit.client.0.smithi164.stdout:1/626: getdents d1/d1a/d35 0 2024-02-10T00:00:40.659 INFO:tasks.workunit.client.0.smithi164.stdout:0/657: write d6/d10/d18/d2d/f84 [5036883,86174] 0 2024-02-10T00:00:40.661 INFO:tasks.workunit.client.0.smithi164.stdout:8/683: rmdir d2/d64/d65/d80/d32/d93/db7 39 2024-02-10T00:00:40.661 INFO:tasks.workunit.client.0.smithi164.stdout:4/669: dwrite d2/d19/d16/d31/fb8 [0,4194304] 0 2024-02-10T00:00:40.662 INFO:tasks.workunit.client.0.smithi164.stdout:3/616: mknod d0/d1/d2/d19/d27/d5f/cbc 0 2024-02-10T00:00:40.662 INFO:tasks.workunit.client.0.smithi164.stdout:4/670: chown d2/d19/d16/f6b 2144372 1 2024-02-10T00:00:40.664 INFO:tasks.workunit.client.0.smithi164.stdout:4/671: write d2/d2f/d37/d71/fba [1090210,29726] 0 2024-02-10T00:00:40.666 INFO:tasks.workunit.client.0.smithi164.stdout:1/627: rename d1/d13/d2b/d52/d56/f68 to d1/d95/fd6 0 2024-02-10T00:00:40.666 INFO:tasks.workunit.client.0.smithi164.stdout:1/628: fsync d1/d64/fc4 0 2024-02-10T00:00:40.667 INFO:tasks.workunit.client.0.smithi164.stdout:8/684: mknod d2/d81/cd6 0 2024-02-10T00:00:40.667 INFO:tasks.workunit.client.0.smithi164.stdout:1/629: chown d1/d23/f55 236933170 1 2024-02-10T00:00:40.667 INFO:tasks.workunit.client.0.smithi164.stdout:8/685: dread - d2/d64/d65/fbc zero size 2024-02-10T00:00:40.669 INFO:tasks.workunit.client.0.smithi164.stdout:0/658: fsync f1 0 2024-02-10T00:00:40.669 INFO:tasks.workunit.client.1.smithi183.stdout:1/952: truncate d0/d3/d67/d7b/f98 4698015 0 2024-02-10T00:00:40.669 INFO:tasks.workunit.client.1.smithi183.stdout:6/938: truncate d2/d1a/d25/f8e 3680064 0 2024-02-10T00:00:40.670 INFO:tasks.workunit.client.0.smithi164.stdout:9/668: write d6/de/d22/d58/dba/d61/d76/da5/fc5 [1943774,61569] 0 2024-02-10T00:00:40.671 INFO:tasks.workunit.client.1.smithi183.stdout:1/953: rmdir d0/d3/d7 39 2024-02-10T00:00:40.671 INFO:tasks.workunit.client.0.smithi164.stdout:2/747: write d3/f61 [368437,36547] 0 2024-02-10T00:00:40.674 INFO:tasks.workunit.client.1.smithi183.stdout:6/939: mknod d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/c126 0 2024-02-10T00:00:40.675 INFO:tasks.workunit.client.1.smithi183.stdout:1/954: chown d0/d3/d7/d3d/d60/d89/de4/d12e/f13f 446 1 2024-02-10T00:00:40.675 INFO:tasks.workunit.client.1.smithi183.stdout:3/858: write d7/db/d2a/d2d/d51/f8a [304407,61020] 0 2024-02-10T00:00:40.676 INFO:tasks.workunit.client.1.smithi183.stdout:3/859: dread - d7/f101 zero size 2024-02-10T00:00:40.676 INFO:tasks.workunit.client.0.smithi164.stdout:6/722: write d0/f2f [8158510,32953] 0 2024-02-10T00:00:40.677 INFO:tasks.workunit.client.1.smithi183.stdout:1/955: rmdir d0/d3/d67/d7b 39 2024-02-10T00:00:40.678 INFO:tasks.workunit.client.1.smithi183.stdout:7/953: sync 2024-02-10T00:00:40.679 INFO:tasks.workunit.client.1.smithi183.stdout:6/940: rename d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/c91 to d2/d1a/d25/d3c/d31/d38/d3f/c127 0 2024-02-10T00:00:40.684 INFO:tasks.workunit.client.1.smithi183.stdout:3/860: fsync d7/db/f45 0 2024-02-10T00:00:40.684 INFO:tasks.workunit.client.1.smithi183.stdout:1/956: dwrite d0/d3/da9/f102 [0,4194304] 0 2024-02-10T00:00:40.684 INFO:tasks.workunit.client.1.smithi183.stdout:1/957: write d0/d3/d7/def/d115/f147 [397037,130292] 0 2024-02-10T00:00:40.684 INFO:tasks.workunit.client.1.smithi183.stdout:7/954: mknod d0/c12a 0 2024-02-10T00:00:40.685 INFO:tasks.workunit.client.0.smithi164.stdout:4/672: creat d2/d2f/d37/d41/d3d/d56/fec x:0 0 0 2024-02-10T00:00:40.685 INFO:tasks.workunit.client.0.smithi164.stdout:5/754: write d7/d17/d21/d23/d37/d36/d8b/fcf [358199,85553] 0 2024-02-10T00:00:40.685 INFO:tasks.workunit.client.0.smithi164.stdout:4/673: write d2/d19/d16/d31/d6d/fb1 [10126064,55299] 0 2024-02-10T00:00:40.685 INFO:tasks.workunit.client.0.smithi164.stdout:4/674: readlink d2/l7 0 2024-02-10T00:00:40.687 INFO:tasks.workunit.client.0.smithi164.stdout:1/630: chown d1/d1a/d41/d18/fb6 922 1 2024-02-10T00:00:40.687 INFO:tasks.workunit.client.0.smithi164.stdout:7/698: dread d3/d11/d39/d44/d48/d71/f91 [4194304,4194304] 0 2024-02-10T00:00:40.688 INFO:tasks.workunit.client.1.smithi183.stdout:6/941: dwrite d2/d1a/d25/d3c/d31/d38/d87/f6a [0,4194304] 0 2024-02-10T00:00:40.688 INFO:tasks.workunit.client.0.smithi164.stdout:8/686: mkdir d2/d64/d54/d71/dd7 0 2024-02-10T00:00:40.688 INFO:tasks.workunit.client.1.smithi183.stdout:1/958: symlink d0/d3/d7/l14b 0 2024-02-10T00:00:40.690 INFO:tasks.workunit.client.0.smithi164.stdout:3/617: mkdir d0/d1/d2/d19/d27/d5f/da5/d94/dbd 0 2024-02-10T00:00:40.691 INFO:tasks.workunit.client.1.smithi183.stdout:7/955: dwrite d0/d11/d3e/f70 [0,4194304] 0 2024-02-10T00:00:40.692 INFO:tasks.workunit.client.0.smithi164.stdout:6/723: symlink d0/d6/d12/d14/d4b/lf3 0 2024-02-10T00:00:40.692 INFO:tasks.workunit.client.0.smithi164.stdout:8/687: dwrite d2/d64/d63/fbd [0,4194304] 0 2024-02-10T00:00:40.693 INFO:tasks.workunit.client.0.smithi164.stdout:6/724: write d0/d6/d12/d14/d4b/fed [842484,104134] 0 2024-02-10T00:00:40.693 INFO:tasks.workunit.client.0.smithi164.stdout:5/755: chown d7/d17/d21/d23/d5a/d68/d1f/d59/ff5 15946 1 2024-02-10T00:00:40.694 INFO:tasks.workunit.client.0.smithi164.stdout:4/675: mknod d2/d19/d16/d31/d7e/ced 0 2024-02-10T00:00:40.695 INFO:tasks.workunit.client.0.smithi164.stdout:4/676: readlink d2/d19/d16/d31/d83/l89 0 2024-02-10T00:00:40.695 INFO:tasks.workunit.client.0.smithi164.stdout:4/677: write d2/fb [12893835,5579] 0 2024-02-10T00:00:40.698 INFO:tasks.workunit.client.1.smithi183.stdout:6/942: chown d2/d1a/d25/d3c/d31/d38/d6e/d34/fe4 8581 1 2024-02-10T00:00:40.700 INFO:tasks.workunit.client.1.smithi183.stdout:3/861: link d7/d98/dc9/le2 d7/db/d2a/d33/l106 0 2024-02-10T00:00:40.704 INFO:tasks.workunit.client.0.smithi164.stdout:0/659: rename d6/d10/d66/f6a to d6/d7/d14/d79/fc9 0 2024-02-10T00:00:40.704 INFO:tasks.workunit.client.0.smithi164.stdout:9/669: mkdir d6/de/d40/dd4/dd9 0 2024-02-10T00:00:40.705 INFO:tasks.workunit.client.0.smithi164.stdout:9/670: write d6/de/fa0 [565434,112987] 0 2024-02-10T00:00:40.706 INFO:tasks.workunit.client.0.smithi164.stdout:8/688: creat d2/d64/d65/d80/d32/d99/da0/fd8 x:0 0 0 2024-02-10T00:00:40.708 INFO:tasks.workunit.client.1.smithi183.stdout:6/943: fsync d2/d1a/d25/d3c/d31/d38/d6e/f68 0 2024-02-10T00:00:40.708 INFO:tasks.workunit.client.0.smithi164.stdout:4/678: symlink d2/d2f/d37/d41/d3d/d42/d5f/lee 0 2024-02-10T00:00:40.709 INFO:tasks.workunit.client.1.smithi183.stdout:6/944: chown d2/d1a/d25/d3c/d31/d38/c10c 752931367 1 2024-02-10T00:00:40.709 INFO:tasks.workunit.client.0.smithi164.stdout:4/679: readlink d2/d19/d16/d31/l9d 0 2024-02-10T00:00:40.710 INFO:tasks.workunit.client.1.smithi183.stdout:6/945: chown d2/d1a/d25/d3c/d31/d38/d3f/l80 486190 1 2024-02-10T00:00:40.710 INFO:tasks.workunit.client.0.smithi164.stdout:0/660: dwrite d6/d7/d14/f1b [0,4194304] 0 2024-02-10T00:00:40.712 INFO:tasks.workunit.client.0.smithi164.stdout:5/756: truncate d7/fd 4599196 0 2024-02-10T00:00:40.714 INFO:tasks.workunit.client.1.smithi183.stdout:6/946: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/fbf [0,4194304] 0 2024-02-10T00:00:40.718 INFO:tasks.workunit.client.0.smithi164.stdout:5/757: creat d7/d17/dc3/f103 x:0 0 0 2024-02-10T00:00:40.718 INFO:tasks.workunit.client.0.smithi164.stdout:9/671: getdents d6/de/d22/d58/dba/da7 0 2024-02-10T00:00:40.719 INFO:tasks.workunit.client.0.smithi164.stdout:1/631: getdents d1/d13/d80 0 2024-02-10T00:00:40.720 INFO:tasks.workunit.client.0.smithi164.stdout:3/618: truncate d0/d1/d2/d19/d66/d84/f62 3068180 0 2024-02-10T00:00:40.722 INFO:tasks.workunit.client.0.smithi164.stdout:4/680: creat d2/d2f/d37/d41/fef x:0 0 0 2024-02-10T00:00:40.724 INFO:tasks.workunit.client.0.smithi164.stdout:1/632: dwrite d1/d23/f98 [4194304,4194304] 0 2024-02-10T00:00:40.726 INFO:tasks.workunit.client.0.smithi164.stdout:2/748: rename d3/d32/d4e/d27/c8b to d3/da6/d7a/d8e/d8a/c10a 0 2024-02-10T00:00:40.726 INFO:tasks.workunit.client.0.smithi164.stdout:9/672: creat d6/de/d40/dd4/dd9/fda x:0 0 0 2024-02-10T00:00:40.727 INFO:tasks.workunit.client.0.smithi164.stdout:1/633: mkdir d1/d23/d37/da9/dd7 0 2024-02-10T00:00:40.730 INFO:tasks.workunit.client.0.smithi164.stdout:5/758: link d7/d17/d79/d7b/dc5/dd7/fd1 d7/d17/f104 0 2024-02-10T00:00:40.731 INFO:tasks.workunit.client.0.smithi164.stdout:9/673: mkdir d6/de/d22/d58/dba/d75/ddb 0 2024-02-10T00:00:40.733 INFO:tasks.workunit.client.0.smithi164.stdout:3/619: truncate d0/d1/d2/d17/d37/fa8 384876 0 2024-02-10T00:00:40.734 INFO:tasks.workunit.client.0.smithi164.stdout:4/681: truncate d2/d2f/d37/d45/dab/dbd/fdf 108856 0 2024-02-10T00:00:40.734 INFO:tasks.workunit.client.0.smithi164.stdout:9/674: readlink d6/de/d2b/lb8 0 2024-02-10T00:00:40.735 INFO:tasks.workunit.client.0.smithi164.stdout:1/634: truncate d1/d1a/d41/fe 2609909 0 2024-02-10T00:00:40.735 INFO:tasks.workunit.client.0.smithi164.stdout:4/682: write d2/d2f/d37/d71/fba [1657817,101708] 0 2024-02-10T00:00:40.736 INFO:tasks.workunit.client.0.smithi164.stdout:5/759: creat d7/d17/d69/d92/da8/dcd/dd3/f105 x:0 0 0 2024-02-10T00:00:40.739 INFO:tasks.workunit.client.0.smithi164.stdout:4/683: mkdir d2/d2f/d37/d41/d3d/df0 0 2024-02-10T00:00:40.739 INFO:tasks.workunit.client.0.smithi164.stdout:6/725: sync 2024-02-10T00:00:40.740 INFO:tasks.workunit.client.0.smithi164.stdout:9/675: dwrite d6/de/d22/d58/dba/d61/d76/f78 [0,4194304] 0 2024-02-10T00:00:40.740 INFO:tasks.workunit.client.0.smithi164.stdout:5/760: creat d7/d17/d69/d92/de9/f106 x:0 0 0 2024-02-10T00:00:40.741 INFO:tasks.workunit.client.0.smithi164.stdout:9/676: readlink d6/de/d22/d58/dba/d61/la1 0 2024-02-10T00:00:40.741 INFO:tasks.workunit.client.0.smithi164.stdout:3/620: creat d0/d1/fbe x:0 0 0 2024-02-10T00:00:40.742 INFO:tasks.workunit.client.0.smithi164.stdout:4/684: rmdir d2 39 2024-02-10T00:00:40.744 INFO:tasks.workunit.client.0.smithi164.stdout:3/621: fdatasync d0/d1/d2/f8e 0 2024-02-10T00:00:40.749 INFO:tasks.workunit.client.0.smithi164.stdout:3/622: dwrite d0/d1/d2/d19/d27/d5f/da5/f57 [0,4194304] 0 2024-02-10T00:00:40.750 INFO:tasks.workunit.client.1.smithi183.stdout:7/956: write d0/d2/d50/dad/df8/f119 [144491,9051] 0 2024-02-10T00:00:40.750 INFO:tasks.workunit.client.0.smithi164.stdout:3/623: stat d0/d1/d2/d19/d27/fb5 0 2024-02-10T00:00:40.752 INFO:tasks.workunit.client.0.smithi164.stdout:5/761: link d7/d17/d79/d7b/f95 d7/d17/d79/d7b/dc5/dd7/f107 0 2024-02-10T00:00:40.753 INFO:tasks.workunit.client.1.smithi183.stdout:3/862: dwrite d7/db/d2a/f65 [0,4194304] 0 2024-02-10T00:00:40.754 INFO:tasks.workunit.client.1.smithi183.stdout:6/947: sync 2024-02-10T00:00:40.755 INFO:tasks.workunit.client.1.smithi183.stdout:1/959: dwrite d0/d3/d7/d3d/fac [4194304,4194304] 0 2024-02-10T00:00:40.756 INFO:tasks.workunit.client.1.smithi183.stdout:6/948: read - d2/d1a/d25/d3c/d31/d38/d3f/d94/f115 zero size 2024-02-10T00:00:40.757 INFO:tasks.workunit.client.1.smithi183.stdout:6/949: readlink d2/l21 0 2024-02-10T00:00:40.757 INFO:tasks.workunit.client.1.smithi183.stdout:1/960: write d0/d3a/dd8/d108/f127 [401530,123354] 0 2024-02-10T00:00:40.759 INFO:tasks.workunit.client.0.smithi164.stdout:6/726: dread d0/d6/f4f [0,4194304] 0 2024-02-10T00:00:40.760 INFO:tasks.workunit.client.1.smithi183.stdout:6/950: creat d2/d1a/d25/d3c/d31/d38/d87/f128 x:0 0 0 2024-02-10T00:00:40.761 INFO:tasks.workunit.client.1.smithi183.stdout:6/951: fsync d2/d1a/d25/d3c/fe8 0 2024-02-10T00:00:40.761 INFO:tasks.workunit.client.1.smithi183.stdout:3/863: mkdir d7/db/d2a/d2d/d51/d8f/dd3/d107 0 2024-02-10T00:00:40.762 INFO:tasks.workunit.client.1.smithi183.stdout:7/957: write d0/fbd [208655,78464] 0 2024-02-10T00:00:40.762 INFO:tasks.workunit.client.0.smithi164.stdout:6/727: read d0/d2b/d3a/f5e [531691,93222] 0 2024-02-10T00:00:40.763 INFO:tasks.workunit.client.0.smithi164.stdout:7/699: write d3/d28/f3f [823427,32112] 0 2024-02-10T00:00:40.771 INFO:tasks.workunit.client.0.smithi164.stdout:9/677: getdents d6/de/d22/d58/dba/d61/d76 0 2024-02-10T00:00:40.771 INFO:tasks.workunit.client.1.smithi183.stdout:7/958: rename d0/d11/l106 to d0/l12b 0 2024-02-10T00:00:40.773 INFO:tasks.workunit.client.0.smithi164.stdout:8/689: dwrite d2/d64/d54/d5f/fc7 [0,4194304] 0 2024-02-10T00:00:40.774 INFO:tasks.workunit.client.0.smithi164.stdout:0/661: dwrite d6/d3a/d52/fa7 [0,4194304] 0 2024-02-10T00:00:40.774 INFO:tasks.workunit.client.1.smithi183.stdout:7/959: mknod d0/d11/d9d/d103/c12c 0 2024-02-10T00:00:40.775 INFO:tasks.workunit.client.0.smithi164.stdout:9/678: write d6/d41/d8b/d24/f84 [519036,40260] 0 2024-02-10T00:00:40.775 INFO:tasks.workunit.client.0.smithi164.stdout:2/749: dwrite d3/d24/fdb [0,4194304] 0 2024-02-10T00:00:40.777 INFO:tasks.workunit.client.1.smithi183.stdout:7/960: creat d0/d11/d9d/d103/f12d x:0 0 0 2024-02-10T00:00:40.777 INFO:tasks.workunit.client.0.smithi164.stdout:5/762: chown d7/d17/d21/d24/fa3 70897767 1 2024-02-10T00:00:40.781 INFO:tasks.workunit.client.0.smithi164.stdout:4/685: dread d2/d19/d16/f3f [0,4194304] 0 2024-02-10T00:00:40.781 INFO:tasks.workunit.client.1.smithi183.stdout:7/961: rmdir d0/d11/d2f/db8 39 2024-02-10T00:00:40.782 INFO:tasks.workunit.client.1.smithi183.stdout:7/962: chown d0/d2/d50/c6f 5 1 2024-02-10T00:00:40.783 INFO:tasks.workunit.client.0.smithi164.stdout:8/690: chown d2/l1f 1 1 2024-02-10T00:00:40.785 INFO:tasks.workunit.client.0.smithi164.stdout:2/750: unlink d3/d32/fa0 0 2024-02-10T00:00:40.786 INFO:tasks.workunit.client.1.smithi183.stdout:7/963: symlink d0/l12e 0 2024-02-10T00:00:40.788 INFO:tasks.workunit.client.0.smithi164.stdout:5/763: rmdir d7/d17/d21/d24/dbc/d45/d5c 39 2024-02-10T00:00:40.792 INFO:tasks.workunit.client.0.smithi164.stdout:9/679: rename d6/de/d22/d58/dba/d61/d76/d82/db7/cb2 to d6/de/d22/d58/dba/d61/d76/cdc 0 2024-02-10T00:00:40.792 INFO:tasks.workunit.client.0.smithi164.stdout:9/680: readlink d6/l27 0 2024-02-10T00:00:40.794 INFO:tasks.workunit.client.0.smithi164.stdout:5/764: fdatasync d7/d17/d21/d23/f72 0 2024-02-10T00:00:40.795 INFO:tasks.workunit.client.0.smithi164.stdout:7/700: creat d3/d11/d39/d44/d48/fea x:0 0 0 2024-02-10T00:00:40.797 INFO:tasks.workunit.client.0.smithi164.stdout:9/681: mkdir d6/de/d22/ddd 0 2024-02-10T00:00:40.798 INFO:tasks.workunit.client.0.smithi164.stdout:2/751: dread d3/f6 [0,4194304] 0 2024-02-10T00:00:40.798 INFO:tasks.workunit.client.0.smithi164.stdout:5/765: mkdir d7/d17/d21/d23/d37/d36/d108 0 2024-02-10T00:00:40.799 INFO:tasks.workunit.client.0.smithi164.stdout:9/682: write d6/de/d40/f6f [1584099,123292] 0 2024-02-10T00:00:40.799 INFO:tasks.workunit.client.0.smithi164.stdout:9/683: readlink d6/de/d22/l7d 0 2024-02-10T00:00:40.799 INFO:tasks.workunit.client.0.smithi164.stdout:7/701: symlink d3/d5/d2b/dab/dda/leb 0 2024-02-10T00:00:40.802 INFO:tasks.workunit.client.0.smithi164.stdout:2/752: creat d3/d24/d5b/d109/f10b x:0 0 0 2024-02-10T00:00:40.804 INFO:tasks.workunit.client.0.smithi164.stdout:5/766: mkdir d7/d17/d21/d23/d5a/d68/d1f/d109 0 2024-02-10T00:00:40.805 INFO:tasks.workunit.client.0.smithi164.stdout:7/702: creat d3/d5/fec x:0 0 0 2024-02-10T00:00:40.806 INFO:tasks.workunit.client.0.smithi164.stdout:7/703: write d3/fd4 [999155,121444] 0 2024-02-10T00:00:40.806 INFO:tasks.workunit.client.0.smithi164.stdout:2/753: unlink d3/da6/d7a/d8e/d88/lc2 0 2024-02-10T00:00:40.807 INFO:tasks.workunit.client.0.smithi164.stdout:9/684: truncate d6/d41/d8b/dad/fbd 667374 0 2024-02-10T00:00:40.808 INFO:tasks.workunit.client.0.smithi164.stdout:9/685: write d6/de/d2b/f3c [3393312,57079] 0 2024-02-10T00:00:40.809 INFO:tasks.workunit.client.1.smithi183.stdout:3/864: dread f6 [4194304,4194304] 0 2024-02-10T00:00:40.809 INFO:tasks.workunit.client.0.smithi164.stdout:5/767: unlink d7/d17/d69/ce1 0 2024-02-10T00:00:40.810 INFO:tasks.workunit.client.0.smithi164.stdout:2/754: dwrite d3/f7 [0,4194304] 0 2024-02-10T00:00:40.810 INFO:tasks.workunit.client.0.smithi164.stdout:5/768: fdatasync d7/d17/fc0 0 2024-02-10T00:00:40.812 INFO:tasks.workunit.client.1.smithi183.stdout:7/964: sync 2024-02-10T00:00:40.812 INFO:tasks.workunit.client.1.smithi183.stdout:3/865: dwrite d7/db/d2a/d33/d59/fe3 [8388608,4194304] 0 2024-02-10T00:00:40.816 INFO:tasks.workunit.client.1.smithi183.stdout:7/965: mkdir d0/d2/d50/dad/df8/d12f 0 2024-02-10T00:00:40.816 INFO:tasks.workunit.client.1.smithi183.stdout:7/966: chown d0/d11/d2f/dbf/fcf 98054 1 2024-02-10T00:00:40.817 INFO:tasks.workunit.client.1.smithi183.stdout:7/967: chown d0/d2/d50/lf0 167129417 1 2024-02-10T00:00:40.817 INFO:tasks.workunit.client.1.smithi183.stdout:3/866: rename d7/db/d2a/d2d/d51/d8f/lb5 to d7/db/d2a/d2d/d51/d8f/dd3/l108 0 2024-02-10T00:00:40.818 INFO:tasks.workunit.client.1.smithi183.stdout:1/961: write d0/d3/fa6 [1454800,130241] 0 2024-02-10T00:00:40.821 INFO:tasks.workunit.client.1.smithi183.stdout:6/952: dwrite d2/d1a/d25/d3c/d31/d38/d6e/f2e [8388608,4194304] 0 2024-02-10T00:00:40.824 INFO:tasks.workunit.client.1.smithi183.stdout:7/968: creat d0/d11/d88/db1/f130 x:0 0 0 2024-02-10T00:00:40.824 INFO:tasks.workunit.client.1.smithi183.stdout:1/962: stat d0/d3/d67/f94 0 2024-02-10T00:00:40.825 INFO:tasks.workunit.client.1.smithi183.stdout:3/867: creat d7/db/d2a/da5/f109 x:0 0 0 2024-02-10T00:00:40.825 INFO:tasks.workunit.client.1.smithi183.stdout:1/963: chown d0/d3/d67/d70/dae/l131 13 1 2024-02-10T00:00:40.826 INFO:tasks.workunit.client.1.smithi183.stdout:6/953: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/f129 x:0 0 0 2024-02-10T00:00:40.827 INFO:tasks.workunit.client.0.smithi164.stdout:2/755: dwrite d3/d24/d5b/fac [0,4194304] 0 2024-02-10T00:00:40.828 INFO:tasks.workunit.client.1.smithi183.stdout:1/964: write d0/d3/d67/d7b/faf [4723392,20654] 0 2024-02-10T00:00:40.828 INFO:tasks.workunit.client.0.smithi164.stdout:3/624: dwrite d0/d1/d2/d19/d66/d84/f62 [0,4194304] 0 2024-02-10T00:00:40.829 INFO:tasks.workunit.client.1.smithi183.stdout:7/969: rename d0/d11/d2f/fb6 to d0/d11/d88/db1/f131 0 2024-02-10T00:00:40.830 INFO:tasks.workunit.client.1.smithi183.stdout:7/970: fsync d0/d11/d88/d94/dff/f11b 0 2024-02-10T00:00:40.832 INFO:tasks.workunit.client.0.smithi164.stdout:2/756: mknod d3/d24/d5b/d109/c10c 0 2024-02-10T00:00:40.834 INFO:tasks.workunit.client.0.smithi164.stdout:1/635: dwrite d1/d23/fc8 [0,4194304] 0 2024-02-10T00:00:40.835 INFO:tasks.workunit.client.1.smithi183.stdout:7/971: rmdir d0/d11/d2f/dbf 39 2024-02-10T00:00:40.835 INFO:tasks.workunit.client.0.smithi164.stdout:5/769: truncate d7/d17/d79/fb1 826416 0 2024-02-10T00:00:40.836 INFO:tasks.workunit.client.0.smithi164.stdout:2/757: read - d3/da6/d7a/d8e/d36/d54/f9f zero size 2024-02-10T00:00:40.836 INFO:tasks.workunit.client.0.smithi164.stdout:6/728: dwrite d0/d6/f59 [0,4194304] 0 2024-02-10T00:00:40.836 INFO:tasks.workunit.client.1.smithi183.stdout:3/868: truncate d7/db/d2a/d33/d59/f86 3916744 0 2024-02-10T00:00:40.837 INFO:tasks.workunit.client.1.smithi183.stdout:3/869: read - d7/db/d2a/d33/d59/df7/fe0 zero size 2024-02-10T00:00:40.838 INFO:tasks.workunit.client.1.smithi183.stdout:7/972: write d0/d11/d2f/db8/f102 [3153688,109273] 0 2024-02-10T00:00:40.839 INFO:tasks.workunit.client.1.smithi183.stdout:6/954: creat d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f12a x:0 0 0 2024-02-10T00:00:40.841 INFO:tasks.workunit.client.0.smithi164.stdout:4/686: dwrite d2/d2f/d37/d41/d3d/d42/d47/f80 [0,4194304] 0 2024-02-10T00:00:40.842 INFO:tasks.workunit.client.1.smithi183.stdout:7/973: dread d0/d11/d3e/f7c [0,4194304] 0 2024-02-10T00:00:40.844 INFO:tasks.workunit.client.1.smithi183.stdout:3/870: dwrite d7/db/d2a/f88 [0,4194304] 0 2024-02-10T00:00:40.846 INFO:tasks.workunit.client.1.smithi183.stdout:7/974: mknod d0/d2/d4/d8/d59/c132 0 2024-02-10T00:00:40.850 INFO:tasks.workunit.client.0.smithi164.stdout:2/758: write d3/d32/d4e/d27/f2c [3374509,50836] 0 2024-02-10T00:00:40.850 INFO:tasks.workunit.client.1.smithi183.stdout:3/871: rename d7/db/d2a/d4d/l6e to d7/db/d2a/d4d/d63/dc4/l10a 0 2024-02-10T00:00:40.851 INFO:tasks.workunit.client.1.smithi183.stdout:3/872: dread - d7/db/d2a/d33/d59/daa/fff zero size 2024-02-10T00:00:40.851 INFO:tasks.workunit.client.1.smithi183.stdout:7/975: symlink d0/d2/d4/d8/dc1/l133 0 2024-02-10T00:00:40.852 INFO:tasks.workunit.client.0.smithi164.stdout:1/636: rename d1/d13/d2b/d52/d56/l6e to d1/d13/d2b/ld8 0 2024-02-10T00:00:40.855 INFO:tasks.workunit.client.0.smithi164.stdout:9/686: sync 2024-02-10T00:00:40.855 INFO:tasks.workunit.client.0.smithi164.stdout:7/704: sync 2024-02-10T00:00:40.856 INFO:tasks.workunit.client.0.smithi164.stdout:6/729: mknod d0/d2b/cf4 0 2024-02-10T00:00:40.856 INFO:tasks.workunit.client.1.smithi183.stdout:3/873: creat d7/db/d2a/d4d/d63/f10b x:0 0 0 2024-02-10T00:00:40.859 INFO:tasks.workunit.client.0.smithi164.stdout:5/770: rmdir d7/d17/d21/d23/d37/d36/d108 0 2024-02-10T00:00:40.863 INFO:tasks.workunit.client.0.smithi164.stdout:2/759: read d3/d24/ffc [186482,57469] 0 2024-02-10T00:00:40.864 INFO:tasks.workunit.client.0.smithi164.stdout:7/705: symlink d3/d5/d2b/dab/dda/d5d/led 0 2024-02-10T00:00:40.865 INFO:tasks.workunit.client.0.smithi164.stdout:7/706: chown d3/d26/l29 12455 1 2024-02-10T00:00:40.865 INFO:tasks.workunit.client.0.smithi164.stdout:4/687: creat d2/d19/d16/ff1 x:0 0 0 2024-02-10T00:00:40.866 INFO:tasks.workunit.client.0.smithi164.stdout:1/637: creat d1/d13/d2b/d52/da4/dc2/dcc/fd9 x:0 0 0 2024-02-10T00:00:40.866 INFO:tasks.workunit.client.0.smithi164.stdout:6/730: symlink d0/d2b/d3a/lf5 0 2024-02-10T00:00:40.868 INFO:tasks.workunit.client.0.smithi164.stdout:0/662: dread d6/d10/d18/d2d/f5a [0,4194304] 0 2024-02-10T00:00:40.870 INFO:tasks.workunit.client.1.smithi183.stdout:6/955: dread d2/d1a/f6f [0,4194304] 0 2024-02-10T00:00:40.870 INFO:tasks.workunit.client.0.smithi164.stdout:2/760: rename d3/d26/d56/l87 to d3/da6/d7a/d8e/d36/d90/l10d 0 2024-02-10T00:00:40.871 INFO:tasks.workunit.client.0.smithi164.stdout:7/707: rmdir d3/d11/d39/d44/dbd 39 2024-02-10T00:00:40.872 INFO:tasks.workunit.client.0.smithi164.stdout:4/688: mkdir d2/d2f/d37/d41/d3d/d42/d47/df2 0 2024-02-10T00:00:40.873 INFO:tasks.workunit.client.0.smithi164.stdout:1/638: dwrite d1/f1b [4194304,4194304] 0 2024-02-10T00:00:40.873 INFO:tasks.workunit.client.1.smithi183.stdout:6/956: truncate d2/d1a/d25/d3c/d31/d38/d87/fcc 588676 0 2024-02-10T00:00:40.874 INFO:tasks.workunit.client.0.smithi164.stdout:4/689: fdatasync d2/d19/fc9 0 2024-02-10T00:00:40.874 INFO:tasks.workunit.client.0.smithi164.stdout:8/691: dread d2/d64/d65/f85 [0,4194304] 0 2024-02-10T00:00:40.875 INFO:tasks.workunit.client.0.smithi164.stdout:8/692: write d2/f41 [24196,17748] 0 2024-02-10T00:00:40.875 INFO:tasks.workunit.client.0.smithi164.stdout:5/771: mknod d7/d17/d21/d24/dbc/d45/d5c/c10a 0 2024-02-10T00:00:40.875 INFO:tasks.workunit.client.0.smithi164.stdout:0/663: creat d6/d10/d18/fca x:0 0 0 2024-02-10T00:00:40.876 INFO:tasks.workunit.client.0.smithi164.stdout:2/761: mkdir d3/d24/d5b/dd9/d10e 0 2024-02-10T00:00:40.876 INFO:tasks.workunit.client.1.smithi183.stdout:6/957: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d34/d12b 0 2024-02-10T00:00:40.877 INFO:tasks.workunit.client.1.smithi183.stdout:6/958: chown d2/d1a/d25/d3c/d31/d38/d3f/d5e/l7f 224401 1 2024-02-10T00:00:40.878 INFO:tasks.workunit.client.0.smithi164.stdout:2/762: write d3/da6/f31 [2615091,67813] 0 2024-02-10T00:00:40.879 INFO:tasks.workunit.client.0.smithi164.stdout:8/693: mkdir d2/d64/d65/d80/d82/dd9 0 2024-02-10T00:00:40.879 INFO:tasks.workunit.client.1.smithi183.stdout:6/959: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/d12c 0 2024-02-10T00:00:40.880 INFO:tasks.workunit.client.0.smithi164.stdout:0/664: mknod d6/d10/d4a/d60/ccb 0 2024-02-10T00:00:40.880 INFO:tasks.workunit.client.1.smithi183.stdout:6/960: chown d2/d1a/d25/d3c/d31/f79 37 1 2024-02-10T00:00:40.881 INFO:tasks.workunit.client.0.smithi164.stdout:6/731: truncate d0/d3b/faf 748491 0 2024-02-10T00:00:40.882 INFO:tasks.workunit.client.0.smithi164.stdout:7/708: creat d3/d26/d67/d98/daf/dde/fee x:0 0 0 2024-02-10T00:00:40.882 INFO:tasks.workunit.client.1.smithi183.stdout:6/961: unlink d2/d1a/d25/d3c/d31/d66/f120 0 2024-02-10T00:00:40.884 INFO:tasks.workunit.client.1.smithi183.stdout:6/962: write d2/d1a/d25/d3c/d31/d38/d6e/d35/f4f [3311307,51621] 0 2024-02-10T00:00:40.884 INFO:tasks.workunit.client.0.smithi164.stdout:2/763: unlink d3/da6/d7a/d8e/db6/dce/dad/cc7 0 2024-02-10T00:00:40.885 INFO:tasks.workunit.client.0.smithi164.stdout:0/665: creat d6/d10/d4a/d88/fcc x:0 0 0 2024-02-10T00:00:40.887 INFO:tasks.workunit.client.0.smithi164.stdout:6/732: unlink d0/d2b/d3a/d3d/d42/d5d/d66/l88 0 2024-02-10T00:00:40.887 INFO:tasks.workunit.client.0.smithi164.stdout:7/709: mkdir d3/d11/d39/d3a/def 0 2024-02-10T00:00:40.890 INFO:tasks.workunit.client.0.smithi164.stdout:6/733: fsync d0/d6/d12/d57/f7b 0 2024-02-10T00:00:40.891 INFO:tasks.workunit.client.0.smithi164.stdout:5/772: link d7/d17/d21/d23/c66 d7/d17/d21/d23/d37/d36/c10b 0 2024-02-10T00:00:40.891 INFO:tasks.workunit.client.0.smithi164.stdout:8/694: truncate d2/d64/d65/d80/d32/d99/da0/fd8 466065 0 2024-02-10T00:00:40.892 INFO:tasks.workunit.client.0.smithi164.stdout:7/710: dwrite d3/d5/fec [0,4194304] 0 2024-02-10T00:00:40.893 INFO:tasks.workunit.client.0.smithi164.stdout:8/695: dread - d2/d64/d63/fa5 zero size 2024-02-10T00:00:40.895 INFO:tasks.workunit.client.0.smithi164.stdout:5/773: creat d7/d17/d79/dde/f10c x:0 0 0 2024-02-10T00:00:40.896 INFO:tasks.workunit.client.1.smithi183.stdout:3/874: sync 2024-02-10T00:00:40.897 INFO:tasks.workunit.client.1.smithi183.stdout:3/875: write d7/db/d2a/d2d/d51/f8a [54116,71695] 0 2024-02-10T00:00:40.897 INFO:tasks.workunit.client.0.smithi164.stdout:6/734: unlink d0/d6/f9b 0 2024-02-10T00:00:40.898 INFO:tasks.workunit.client.1.smithi183.stdout:3/876: chown d7/db/d2a/l85 8 1 2024-02-10T00:00:40.899 INFO:tasks.workunit.client.0.smithi164.stdout:7/711: truncate d3/d11/d39/d44/d6f/d75/fe7 68906 0 2024-02-10T00:00:40.899 INFO:tasks.workunit.client.0.smithi164.stdout:8/696: dwrite d2/d12/f17 [4194304,4194304] 0 2024-02-10T00:00:40.900 INFO:tasks.workunit.client.1.smithi183.stdout:3/877: read d7/db/d2a/d2d/d51/d8f/faf [8947565,117245] 0 2024-02-10T00:00:40.903 INFO:tasks.workunit.client.0.smithi164.stdout:6/735: symlink d0/d6/d81/lf6 0 2024-02-10T00:00:40.904 INFO:tasks.workunit.client.1.smithi183.stdout:3/878: fsync d7/db/d2a/d33/f72 0 2024-02-10T00:00:40.906 INFO:tasks.workunit.client.0.smithi164.stdout:5/774: rename d7/d17/d21/d23/d5a/d68/d1f/d59/c8f to d7/d17/d79/d7b/dc5/c10d 0 2024-02-10T00:00:40.906 INFO:tasks.workunit.client.0.smithi164.stdout:8/697: fsync d2/f20 0 2024-02-10T00:00:40.906 INFO:tasks.workunit.client.0.smithi164.stdout:7/712: rename d3/d26 to d3/d26/df0 22 2024-02-10T00:00:40.907 INFO:tasks.workunit.client.0.smithi164.stdout:7/713: write d3/f13 [1220020,95529] 0 2024-02-10T00:00:40.908 INFO:tasks.workunit.client.0.smithi164.stdout:5/775: write d7/d17/d21/d23/d5a/d68/fd9 [773811,99373] 0 2024-02-10T00:00:40.915 INFO:tasks.workunit.client.1.smithi183.stdout:1/965: write d0/d3/d29/f51 [2657922,66758] 0 2024-02-10T00:00:40.918 INFO:tasks.workunit.client.1.smithi183.stdout:3/879: creat d7/db/f10c x:0 0 0 2024-02-10T00:00:40.919 INFO:tasks.workunit.client.1.smithi183.stdout:1/966: mknod d0/d3a/dd8/c14c 0 2024-02-10T00:00:40.919 INFO:tasks.workunit.client.0.smithi164.stdout:5/776: read d7/d17/d21/d23/d5a/d68/d1f/fa5 [2044017,115074] 0 2024-02-10T00:00:40.919 INFO:tasks.workunit.client.0.smithi164.stdout:3/625: dread d0/d1/d2/d17/d37/f3a [0,4194304] 0 2024-02-10T00:00:40.920 INFO:tasks.workunit.client.1.smithi183.stdout:1/967: stat d0/d3/d67/d70/dae/d135/ff9 0 2024-02-10T00:00:40.922 INFO:tasks.workunit.client.0.smithi164.stdout:9/687: dread d6/de/d22/d58/dba/d61/d76/d82/fa4 [0,4194304] 0 2024-02-10T00:00:40.924 INFO:tasks.workunit.client.1.smithi183.stdout:7/976: write d0/d2/d4/d8/f60 [1061984,44725] 0 2024-02-10T00:00:40.924 INFO:tasks.workunit.client.1.smithi183.stdout:1/968: fsync d0/d3/d67/d7b/dfe/fa2 0 2024-02-10T00:00:40.924 INFO:tasks.workunit.client.0.smithi164.stdout:4/690: dwrite d2/d2f/d37/d41/d3d/f62 [0,4194304] 0 2024-02-10T00:00:40.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/691: stat d2/d2f/d37/d41/d3d/fa5 0 2024-02-10T00:00:40.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/692: read d2/d19/d16/d31/fb8 [716244,52590] 0 2024-02-10T00:00:40.926 INFO:tasks.workunit.client.0.smithi164.stdout:4/693: write d2/d19/d16/d31/d4b/f8c [1504039,5870] 0 2024-02-10T00:00:40.927 INFO:tasks.workunit.client.1.smithi183.stdout:1/969: dwrite d0/d3/d67/d70/dae/dc6/f12f [0,4194304] 0 2024-02-10T00:00:40.928 INFO:tasks.workunit.client.1.smithi183.stdout:1/970: chown d0/d3/d7/d3d/cc3 721335 1 2024-02-10T00:00:40.929 INFO:tasks.workunit.client.1.smithi183.stdout:1/971: chown d0/d3a/f105 295268 1 2024-02-10T00:00:40.931 INFO:tasks.workunit.client.1.smithi183.stdout:6/963: dread d2/d1a/d25/f2c [0,4194304] 0 2024-02-10T00:00:40.931 INFO:tasks.workunit.client.0.smithi164.stdout:2/764: dwrite d3/d32/d4e/f67 [0,4194304] 0 2024-02-10T00:00:40.932 INFO:tasks.workunit.client.0.smithi164.stdout:0/666: truncate d6/d7/d14/f20 3984054 0 2024-02-10T00:00:40.933 INFO:tasks.workunit.client.0.smithi164.stdout:0/667: write d6/d10/d18/d2d/f5d [1100817,69919] 0 2024-02-10T00:00:40.937 INFO:tasks.workunit.client.0.smithi164.stdout:1/639: sync 2024-02-10T00:00:40.938 INFO:tasks.workunit.client.0.smithi164.stdout:1/640: write d1/d64/dc7/fc9 [523263,4005] 0 2024-02-10T00:00:40.940 INFO:tasks.workunit.client.0.smithi164.stdout:5/777: fsync d7/d17/d21/f89 0 2024-02-10T00:00:40.941 INFO:tasks.workunit.client.0.smithi164.stdout:4/694: dread d2/d2f/f54 [0,4194304] 0 2024-02-10T00:00:40.941 INFO:tasks.workunit.client.0.smithi164.stdout:5/778: chown d7/d17/d21/d23/d5a/d68/d1f/f44 1575 1 2024-02-10T00:00:40.945 INFO:tasks.workunit.client.1.smithi183.stdout:1/972: getdents d0/d3 0 2024-02-10T00:00:40.945 INFO:tasks.workunit.client.1.smithi183.stdout:6/964: truncate d2/d1a/d25/d3c/d8d/ff0 1197684 0 2024-02-10T00:00:40.945 INFO:tasks.workunit.client.0.smithi164.stdout:2/765: mknod d3/da6/d7a/de1/c10f 0 2024-02-10T00:00:40.946 INFO:tasks.workunit.client.0.smithi164.stdout:2/766: chown d3/da6/d7a/d8e/d36/dbd/lef 74371220 1 2024-02-10T00:00:40.947 INFO:tasks.workunit.client.1.smithi183.stdout:6/965: chown d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/le7 133604 1 2024-02-10T00:00:40.947 INFO:tasks.workunit.client.1.smithi183.stdout:1/973: mknod d0/d3/d7/d3d/dcb/c14d 0 2024-02-10T00:00:40.949 INFO:tasks.workunit.client.0.smithi164.stdout:3/626: creat d0/d8f/d9a/db0/fbf x:0 0 0 2024-02-10T00:00:40.950 INFO:tasks.workunit.client.1.smithi183.stdout:6/966: mknod d2/d1a/d25/d3c/d31/d38/d87/c12d 0 2024-02-10T00:00:40.951 INFO:tasks.workunit.client.0.smithi164.stdout:5/779: creat d7/d17/d21/d23/d37/d36/d8b/f10e x:0 0 0 2024-02-10T00:00:40.952 INFO:tasks.workunit.client.1.smithi183.stdout:6/967: mkdir d2/d1a/d25/d3c/d12e 0 2024-02-10T00:00:40.954 INFO:tasks.workunit.client.0.smithi164.stdout:2/767: unlink d3/da6/d7a/d8e/db6/db8/l105 0 2024-02-10T00:00:40.955 INFO:tasks.workunit.client.1.smithi183.stdout:6/968: mkdir d2/d1a/d25/d3c/d31/d38/d6e/d35/d12f 0 2024-02-10T00:00:40.956 INFO:tasks.workunit.client.1.smithi183.stdout:1/974: dread d0/d3/da9/fda [0,4194304] 0 2024-02-10T00:00:40.956 INFO:tasks.workunit.client.0.smithi164.stdout:9/688: rmdir d6/de/d22/ddd 0 2024-02-10T00:00:40.958 INFO:tasks.workunit.client.1.smithi183.stdout:6/969: mkdir d2/d1a/d25/d3c/d8d/d130 0 2024-02-10T00:00:40.958 INFO:tasks.workunit.client.0.smithi164.stdout:8/698: rename d2/d64/l6d to d2/lda 0 2024-02-10T00:00:40.959 INFO:tasks.workunit.client.0.smithi164.stdout:0/668: creat d6/fcd x:0 0 0 2024-02-10T00:00:40.959 INFO:tasks.workunit.client.1.smithi183.stdout:6/970: chown d2/d1a/d25/d3c/d31/d38/d3f/l54 1071 1 2024-02-10T00:00:40.961 INFO:tasks.workunit.client.0.smithi164.stdout:3/627: link d0/d1/d2/d19/f39 d0/d8f/d9a/db0/fc0 0 2024-02-10T00:00:40.961 INFO:tasks.workunit.client.0.smithi164.stdout:5/780: mknod d7/d17/d79/dde/def/c10f 0 2024-02-10T00:00:40.964 INFO:tasks.workunit.client.0.smithi164.stdout:8/699: mknod d2/d64/d63/cdb 0 2024-02-10T00:00:40.966 INFO:tasks.workunit.client.0.smithi164.stdout:0/669: mkdir d6/d7/d14/d79/dce 0 2024-02-10T00:00:40.967 INFO:tasks.workunit.client.0.smithi164.stdout:7/714: write d3/d11/f18 [1282556,75259] 0 2024-02-10T00:00:40.967 INFO:tasks.workunit.client.0.smithi164.stdout:0/670: stat d6/l13 0 2024-02-10T00:00:40.977 INFO:tasks.workunit.client.1.smithi183.stdout:3/880: sync 2024-02-10T00:00:40.979 INFO:tasks.workunit.client.1.smithi183.stdout:3/881: chown d7/d98/dc9/le2 0 1 2024-02-10T00:00:40.980 INFO:tasks.workunit.client.1.smithi183.stdout:1/975: dread d0/d3/d67/d7b/dfe/f25 [0,4194304] 0 2024-02-10T00:00:40.981 INFO:tasks.workunit.client.1.smithi183.stdout:3/882: creat d7/db/d2a/d2d/d51/d8f/f10d x:0 0 0 2024-02-10T00:00:40.982 INFO:tasks.workunit.client.1.smithi183.stdout:6/971: dread d2/d1a/d25/d3c/d31/d38/d87/f88 [0,4194304] 0 2024-02-10T00:00:40.983 INFO:tasks.workunit.client.1.smithi183.stdout:3/883: mknod d7/db/d2a/d4d/c10e 0 2024-02-10T00:00:40.985 INFO:tasks.workunit.client.1.smithi183.stdout:3/884: write d7/db/d2a/f9a [1675885,119596] 0 2024-02-10T00:00:40.985 INFO:tasks.workunit.client.1.smithi183.stdout:1/976: dread d0/d3/d7/f8d [0,4194304] 0 2024-02-10T00:00:40.986 INFO:tasks.workunit.client.1.smithi183.stdout:6/972: creat d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/f131 x:0 0 0 2024-02-10T00:00:40.986 INFO:tasks.workunit.client.1.smithi183.stdout:3/885: dread - d7/db/d2a/d33/fb9 zero size 2024-02-10T00:00:40.988 INFO:tasks.workunit.client.1.smithi183.stdout:1/977: symlink d0/d3/d67/d70/dae/d135/dc9/l14e 0 2024-02-10T00:00:40.990 INFO:tasks.workunit.client.1.smithi183.stdout:1/978: creat d0/d12d/d100/f14f x:0 0 0 2024-02-10T00:00:40.992 INFO:tasks.workunit.client.1.smithi183.stdout:1/979: mkdir d0/d3/d7/d3d/d60/d89/d150 0 2024-02-10T00:00:40.992 INFO:tasks.workunit.client.1.smithi183.stdout:1/980: fdatasync d0/d3/f2d 0 2024-02-10T00:00:40.995 INFO:tasks.workunit.client.1.smithi183.stdout:3/886: link d7/db/c7e d7/db/d2a/d33/d59/d52/c10f 0 2024-02-10T00:00:40.996 INFO:tasks.workunit.client.1.smithi183.stdout:3/887: fsync d7/db/d2a/f99 0 2024-02-10T00:00:40.998 INFO:tasks.workunit.client.1.smithi183.stdout:6/973: dwrite d2/d1a/d25/d3c/d31/d38/d87/fcc [0,4194304] 0 2024-02-10T00:00:40.998 INFO:tasks.workunit.client.1.smithi183.stdout:1/981: getdents d0/d12d/d100 0 2024-02-10T00:00:40.999 INFO:tasks.workunit.client.0.smithi164.stdout:6/736: sync 2024-02-10T00:00:41.001 INFO:tasks.workunit.client.1.smithi183.stdout:6/974: mknod d2/d1a/d25/d3c/d31/d38/c132 0 2024-02-10T00:00:41.002 INFO:tasks.workunit.client.1.smithi183.stdout:1/982: creat d0/d3/d7/d3d/d60/dc2/f151 x:0 0 0 2024-02-10T00:00:41.003 INFO:tasks.workunit.client.0.smithi164.stdout:4/695: write d2/d19/d16/f6b [131066,38468] 0 2024-02-10T00:00:41.003 INFO:tasks.workunit.client.1.smithi183.stdout:1/983: write d0/d3/d67/d70/dae/d135/ff9 [716381,86857] 0 2024-02-10T00:00:41.004 INFO:tasks.workunit.client.0.smithi164.stdout:8/700: rmdir d2/d64/d54/d71/d78 39 2024-02-10T00:00:41.005 INFO:tasks.workunit.client.0.smithi164.stdout:2/768: write d3/d26/d64/f75 [1600832,50428] 0 2024-02-10T00:00:41.005 INFO:tasks.workunit.client.0.smithi164.stdout:1/641: write d1/d23/f84 [620908,123786] 0 2024-02-10T00:00:41.005 INFO:tasks.workunit.client.0.smithi164.stdout:0/671: mkdir d6/d10/d18/d2d/d39/dcf 0 2024-02-10T00:00:41.005 INFO:tasks.workunit.client.0.smithi164.stdout:7/715: rename d3/d5/l43 to d3/d26/d67/d98/daf/dde/lf1 0 2024-02-10T00:00:41.006 INFO:tasks.workunit.client.0.smithi164.stdout:5/781: mkdir d7/d17/d21/d23/d5a/d68/d1f/d110 0 2024-02-10T00:00:41.007 INFO:tasks.workunit.client.0.smithi164.stdout:2/769: write d3/d32/fe2 [209086,7327] 0 2024-02-10T00:00:41.008 INFO:tasks.workunit.client.0.smithi164.stdout:4/696: mkdir d2/d2f/d37/d45/df3 0 2024-02-10T00:00:41.008 INFO:tasks.workunit.client.0.smithi164.stdout:5/782: chown d7/d17/d21/l3c 25 1 2024-02-10T00:00:41.008 INFO:tasks.workunit.client.1.smithi183.stdout:6/975: creat d2/d1a/d25/d3c/d31/d38/d6e/ded/f133 x:0 0 0 2024-02-10T00:00:41.008 INFO:tasks.workunit.client.1.smithi183.stdout:6/976: chown d2/d1a/d117 15166 1 2024-02-10T00:00:41.009 INFO:tasks.workunit.client.1.smithi183.stdout:1/984: creat d0/d3/d67/d70/f152 x:0 0 0 2024-02-10T00:00:41.010 INFO:tasks.workunit.client.0.smithi164.stdout:4/697: chown d2/d2f/d37/ce6 2032735 1 2024-02-10T00:00:41.011 INFO:tasks.workunit.client.1.smithi183.stdout:1/985: rmdir d0/d3/d67/d70/dae/d135 39 2024-02-10T00:00:41.011 INFO:tasks.workunit.client.0.smithi164.stdout:1/642: dwrite d1/d23/fc8 [0,4194304] 0 2024-02-10T00:00:41.012 INFO:tasks.workunit.client.0.smithi164.stdout:7/716: creat d3/d26/da7/ff2 x:0 0 0 2024-02-10T00:00:41.012 INFO:tasks.workunit.client.1.smithi183.stdout:1/986: dread - d0/d3a/feb zero size 2024-02-10T00:00:41.013 INFO:tasks.workunit.client.0.smithi164.stdout:2/770: fdatasync d3/da6/d7a/fa3 0 2024-02-10T00:00:41.013 INFO:tasks.workunit.client.1.smithi183.stdout:1/987: write d0/d12d/d100/f14f [652921,55374] 0 2024-02-10T00:00:41.014 INFO:tasks.workunit.client.1.smithi183.stdout:7/977: sync 2024-02-10T00:00:41.014 INFO:tasks.workunit.client.1.smithi183.stdout:7/978: chown d0/d2/d4/f10f 52 1 2024-02-10T00:00:41.015 INFO:tasks.workunit.client.0.smithi164.stdout:5/783: unlink d7/d17/d79/dde/def/c10f 0 2024-02-10T00:00:41.015 INFO:tasks.workunit.client.1.smithi183.stdout:7/979: read d0/d11/dc3/ff6 [3460729,4360] 0 2024-02-10T00:00:41.015 INFO:tasks.workunit.client.1.smithi183.stdout:1/988: mknod d0/d3/da9/c153 0 2024-02-10T00:00:41.015 INFO:tasks.workunit.client.1.smithi183.stdout:1/989: chown d0/d3a/feb 3 1 2024-02-10T00:00:41.016 INFO:tasks.workunit.client.0.smithi164.stdout:4/698: chown d2/d2f/d37/c3c 129708 1 2024-02-10T00:00:41.017 INFO:tasks.workunit.client.0.smithi164.stdout:9/689: dread d6/de/d2b/f38 [0,4194304] 0 2024-02-10T00:00:41.018 INFO:tasks.workunit.client.0.smithi164.stdout:0/672: creat d6/d10/fd0 x:0 0 0 2024-02-10T00:00:41.018 INFO:tasks.workunit.client.0.smithi164.stdout:8/701: dread d2/d64/f83 [0,4194304] 0 2024-02-10T00:00:41.019 INFO:tasks.workunit.client.0.smithi164.stdout:7/717: dwrite d3/d5/d59/f8c [0,4194304] 0 2024-02-10T00:00:41.019 INFO:tasks.workunit.client.0.smithi164.stdout:9/690: fsync d6/de/d2b/f80 0 2024-02-10T00:00:41.020 INFO:tasks.workunit.client.0.smithi164.stdout:5/784: symlink d7/d17/d79/l111 0 2024-02-10T00:00:41.024 INFO:tasks.workunit.client.1.smithi183.stdout:1/990: dwrite d0/d3a/dd8/f11f [4194304,4194304] 0 2024-02-10T00:00:41.025 INFO:tasks.workunit.client.0.smithi164.stdout:8/702: chown d2/d12/f24 40046011 1 2024-02-10T00:00:41.025 INFO:tasks.workunit.client.0.smithi164.stdout:7/718: dread - d3/d5/d59/fce zero size 2024-02-10T00:00:41.025 INFO:tasks.workunit.client.0.smithi164.stdout:1/643: mknod d1/d23/d37/da9/dd1/cda 0 2024-02-10T00:00:41.025 INFO:tasks.workunit.client.0.smithi164.stdout:9/691: symlink d6/de/d22/d58/dba/lde 0 2024-02-10T00:00:41.025 INFO:tasks.workunit.client.0.smithi164.stdout:8/703: symlink d2/d12/ldc 0 2024-02-10T00:00:41.026 INFO:tasks.workunit.client.0.smithi164.stdout:7/719: dwrite d3/d28/d51/f64 [0,4194304] 0 2024-02-10T00:00:41.027 INFO:tasks.workunit.client.0.smithi164.stdout:1/644: mkdir d1/d23/d37/da9/dd1/ddb 0 2024-02-10T00:00:41.029 INFO:tasks.workunit.client.1.smithi183.stdout:3/888: dread d7/db/d2a/d2d/d51/d8f/faf [4194304,4194304] 0 2024-02-10T00:00:41.030 INFO:tasks.workunit.client.0.smithi164.stdout:9/692: creat d6/de/d40/fdf x:0 0 0 2024-02-10T00:00:41.030 INFO:tasks.workunit.client.1.smithi183.stdout:1/991: fdatasync d0/d3/d67/d70/fc7 0 2024-02-10T00:00:41.031 INFO:tasks.workunit.client.1.smithi183.stdout:3/889: chown d7/db/d2a/f44 872909 1 2024-02-10T00:00:41.031 INFO:tasks.workunit.client.1.smithi183.stdout:6/977: dwrite d2/d1a/d25/f36 [0,4194304] 0 2024-02-10T00:00:41.032 INFO:tasks.workunit.client.1.smithi183.stdout:1/992: write d0/f13a [572750,115404] 0 2024-02-10T00:00:41.033 INFO:tasks.workunit.client.0.smithi164.stdout:8/704: mkdir d2/d64/d65/d80/d32/d4d/ddd 0 2024-02-10T00:00:41.036 INFO:tasks.workunit.client.1.smithi183.stdout:3/890: readlink d7/db/d2a/d4d/d63/dc4/l10a 0 2024-02-10T00:00:41.037 INFO:tasks.workunit.client.1.smithi183.stdout:1/993: rmdir d0/d3/d67/d7b/dfe/d7c 39 2024-02-10T00:00:41.037 INFO:tasks.workunit.client.0.smithi164.stdout:8/705: dread d2/d64/f51 [0,4194304] 0 2024-02-10T00:00:41.038 INFO:tasks.workunit.client.1.smithi183.stdout:1/994: dread - d0/d3/d67/d70/dae/f13c zero size 2024-02-10T00:00:41.038 INFO:tasks.workunit.client.0.smithi164.stdout:8/706: write d2/d64/f97 [544994,42830] 0 2024-02-10T00:00:41.039 INFO:tasks.workunit.client.0.smithi164.stdout:7/720: mkdir d3/d11/df3 0 2024-02-10T00:00:41.043 INFO:tasks.workunit.client.0.smithi164.stdout:6/737: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/faa [0,4194304] 0 2024-02-10T00:00:41.044 INFO:tasks.workunit.client.0.smithi164.stdout:6/738: read - d0/d6/d95/fc5 zero size 2024-02-10T00:00:41.044 INFO:tasks.workunit.client.0.smithi164.stdout:9/693: rename d6/d41/lc4 to d6/de/d22/d58/dba/d75/le0 0 2024-02-10T00:00:41.045 INFO:tasks.workunit.client.1.smithi183.stdout:6/978: unlink d2/d1a/d25/d3c/d31/d38/d3f/d5e/f124 0 2024-02-10T00:00:41.046 INFO:tasks.workunit.client.1.smithi183.stdout:3/891: mkdir d7/db/d2a/d2d/d51/d8f/dd3/d107/d110 0 2024-02-10T00:00:41.046 INFO:tasks.workunit.client.1.smithi183.stdout:1/995: creat d0/d3/d29/f154 x:0 0 0 2024-02-10T00:00:41.046 INFO:tasks.workunit.client.0.smithi164.stdout:8/707: creat d2/d64/d54/db9/fde x:0 0 0 2024-02-10T00:00:41.047 INFO:tasks.workunit.client.0.smithi164.stdout:0/673: link d6/c5f d6/d10/d18/d2d/d35/d44/d49/cd1 0 2024-02-10T00:00:41.048 INFO:tasks.workunit.client.0.smithi164.stdout:8/708: fdatasync d2/d64/d54/f7c 0 2024-02-10T00:00:41.048 INFO:tasks.workunit.client.0.smithi164.stdout:3/628: sync 2024-02-10T00:00:41.048 INFO:tasks.workunit.client.1.smithi183.stdout:7/980: dread d0/d11/f1c [0,4194304] 0 2024-02-10T00:00:41.049 INFO:tasks.workunit.client.1.smithi183.stdout:3/892: write d7/db/d2a/f44 [430600,75179] 0 2024-02-10T00:00:41.049 INFO:tasks.workunit.client.1.smithi183.stdout:1/996: readlink d0/d3/d67/d7b/dfe/ldd 0 2024-02-10T00:00:41.050 INFO:tasks.workunit.client.0.smithi164.stdout:8/709: write d2/d64/d7d/fc1 [1024990,40246] 0 2024-02-10T00:00:41.050 INFO:tasks.workunit.client.0.smithi164.stdout:1/645: link d1/d13/d1f/fc0 d1/d13/d2b/d52/d56/fdc 0 2024-02-10T00:00:41.051 INFO:tasks.workunit.client.0.smithi164.stdout:5/785: getdents d7/d17/d21/d24/dbc/d45 0 2024-02-10T00:00:41.051 INFO:tasks.workunit.client.1.smithi183.stdout:6/979: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/d61/d73/f134 x:0 0 0 2024-02-10T00:00:41.051 INFO:tasks.workunit.client.0.smithi164.stdout:6/739: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 [0,4194304] 0 2024-02-10T00:00:41.055 INFO:tasks.workunit.client.0.smithi164.stdout:9/694: unlink d6/de/d22/d58/dba/d61/d76/da5/lc3 0 2024-02-10T00:00:41.056 INFO:tasks.workunit.client.1.smithi183.stdout:6/980: mkdir d2/d1a/d25/d3c/d31/d38/d87/d11a/d135 0 2024-02-10T00:00:41.056 INFO:tasks.workunit.client.1.smithi183.stdout:1/997: dwrite d0/d3/d67/f96 [4194304,4194304] 0 2024-02-10T00:00:41.057 INFO:tasks.workunit.client.0.smithi164.stdout:1/646: dwrite d1/d13/d1f/f7a [0,4194304] 0 2024-02-10T00:00:41.057 INFO:tasks.workunit.client.1.smithi183.stdout:7/981: dwrite d0/d2/f2b [0,4194304] 0 2024-02-10T00:00:41.058 INFO:tasks.workunit.client.0.smithi164.stdout:8/710: creat d2/d64/d65/da9/fdf x:0 0 0 2024-02-10T00:00:41.058 INFO:tasks.workunit.client.0.smithi164.stdout:4/699: dread d2/d19/d16/f38 [0,4194304] 0 2024-02-10T00:00:41.059 INFO:tasks.workunit.client.0.smithi164.stdout:4/700: read - d2/d19/d16/d31/d72/fa8 zero size 2024-02-10T00:00:41.062 INFO:tasks.workunit.client.0.smithi164.stdout:6/740: creat d0/d6/d95/ff7 x:0 0 0 2024-02-10T00:00:41.063 INFO:tasks.workunit.client.1.smithi183.stdout:6/981: creat d2/da0/df1/f136 x:0 0 0 2024-02-10T00:00:41.064 INFO:tasks.workunit.client.0.smithi164.stdout:0/674: symlink d6/d10/d18/d2d/ld2 0 2024-02-10T00:00:41.065 INFO:tasks.workunit.client.0.smithi164.stdout:0/675: write d6/d10/d18/d2d/f7f [1626447,47617] 0 2024-02-10T00:00:41.066 INFO:tasks.workunit.client.0.smithi164.stdout:0/676: write d6/d10/d18/d2d/f5d [1197529,65558] 0 2024-02-10T00:00:41.066 INFO:tasks.workunit.client.0.smithi164.stdout:5/786: symlink d7/d17/d21/d24/l112 0 2024-02-10T00:00:41.067 INFO:tasks.workunit.client.0.smithi164.stdout:9/695: read d6/f3e [5083838,66985] 0 2024-02-10T00:00:41.074 INFO:tasks.workunit.client.0.smithi164.stdout:1/647: dread d1/d23/d61/d9d/fa0 [0,4194304] 0 2024-02-10T00:00:41.074 INFO:tasks.workunit.client.0.smithi164.stdout:0/677: fsync d6/d10/d4a/d88/fc4 0 2024-02-10T00:00:41.074 INFO:tasks.workunit.client.0.smithi164.stdout:7/721: dread d3/d5/d2b/dab/dda/f55 [0,4194304] 0 2024-02-10T00:00:41.075 INFO:tasks.workunit.client.1.smithi183.stdout:7/982: rename d0/d2/d50/d5d to d0/d11/d88/d94/dff/d118/d134 0 2024-02-10T00:00:41.076 INFO:tasks.workunit.client.1.smithi183.stdout:1/998: mknod d0/d3/d67/d70/dae/d135/dc9/c155 0 2024-02-10T00:00:41.076 INFO:tasks.workunit.client.0.smithi164.stdout:0/678: write d6/d10/d18/f67 [2057838,110149] 0 2024-02-10T00:00:41.076 INFO:tasks.workunit.client.0.smithi164.stdout:5/787: creat d7/d17/d21/d24/dbc/d45/d5c/f113 x:0 0 0 2024-02-10T00:00:41.079 INFO:tasks.workunit.client.1.smithi183.stdout:6/982: mkdir d2/d1a/d25/d3c/d31/d38/d3f/d5e/d137 0 2024-02-10T00:00:41.082 INFO:tasks.workunit.client.0.smithi164.stdout:3/629: rename d0/d1/d3c/f63 to d0/fc1 0 2024-02-10T00:00:41.082 INFO:tasks.workunit.client.0.smithi164.stdout:8/711: creat d2/d64/d65/d80/fe0 x:0 0 0 2024-02-10T00:00:41.083 INFO:tasks.workunit.client.0.smithi164.stdout:2/771: write d3/d24/f39 [2547323,123313] 0 2024-02-10T00:00:41.083 INFO:tasks.workunit.client.1.smithi183.stdout:1/999: truncate d0/d3/d7/d3d/d60/dc2/f140 711813 0 2024-02-10T00:00:41.083 INFO:tasks.workunit.client.1.smithi183.stdout:6/983: dread d2/d1a/d25/d3c/d31/d38/d3f/f4d [0,4194304] 0 2024-02-10T00:00:41.083 INFO:tasks.workunit.client.0.smithi164.stdout:3/630: stat d0/d1/d2/d19/d66/fae 0 2024-02-10T00:00:41.084 INFO:tasks.workunit.client.1.smithi183.stdout:6/984: mknod d2/d1a/d25/d3c/d31/d38/d87/d11a/d135/c138 0 2024-02-10T00:00:41.085 INFO:tasks.workunit.client.0.smithi164.stdout:1/648: unlink d1/d13/d80/fb5 0 2024-02-10T00:00:41.086 INFO:tasks.workunit.client.0.smithi164.stdout:1/649: chown d1/d13/d2b/d52/f6b 390 1 2024-02-10T00:00:41.087 INFO:tasks.workunit.client.1.smithi183.stdout:6/985: symlink d2/d1a/d25/d3c/d31/d38/d110/l139 0 2024-02-10T00:00:41.087 INFO:tasks.workunit.client.1.smithi183.stdout:6/986: read d2/d1a/d25/f2c [187446,5109] 0 2024-02-10T00:00:41.088 INFO:tasks.workunit.client.1.smithi183.stdout:3/893: sync 2024-02-10T00:00:41.088 INFO:tasks.workunit.client.1.smithi183.stdout:6/987: dread - d2/d1a/d25/d3c/d31/fe1 zero size 2024-02-10T00:00:41.089 INFO:tasks.workunit.client.1.smithi183.stdout:3/894: readlink d7/db/d2a/d33/l82 0 2024-02-10T00:00:41.089 INFO:tasks.workunit.client.0.smithi164.stdout:9/696: mknod d6/de/d40/db6/ce1 0 2024-02-10T00:00:41.089 INFO:tasks.workunit.client.1.smithi183.stdout:3/895: write d7/db/d2a/d2d/fcc [403444,3304] 0 2024-02-10T00:00:41.090 INFO:tasks.workunit.client.0.smithi164.stdout:1/650: dwrite d1/d13/d2b/d52/d56/fbc [0,4194304] 0 2024-02-10T00:00:41.091 INFO:tasks.workunit.client.1.smithi183.stdout:6/988: creat d2/d1a/d25/d3c/d31/d38/d87/d11a/d135/f13a x:0 0 0 2024-02-10T00:00:41.092 INFO:tasks.workunit.client.0.smithi164.stdout:8/712: chown d2/d64/d54/d71/d78/c89 62 1 2024-02-10T00:00:41.093 INFO:tasks.workunit.client.1.smithi183.stdout:3/896: chown d7/db/c7e 63529 1 2024-02-10T00:00:41.093 INFO:tasks.workunit.client.0.smithi164.stdout:2/772: write d3/da6/d7a/d8e/d36/d54/ff5 [2670106,10505] 0 2024-02-10T00:00:41.094 INFO:tasks.workunit.client.1.smithi183.stdout:3/897: write d7/db/d2a/d33/d59/df7/fe0 [1031094,101556] 0 2024-02-10T00:00:41.094 INFO:tasks.workunit.client.0.smithi164.stdout:2/773: fdatasync d3/d26/fae 0 2024-02-10T00:00:41.095 INFO:tasks.workunit.client.1.smithi183.stdout:3/898: stat d7/db/d2a/d33/f72 0 2024-02-10T00:00:41.095 INFO:tasks.workunit.client.0.smithi164.stdout:2/774: readlink d3/da6/d7a/de1/l102 0 2024-02-10T00:00:41.096 INFO:tasks.workunit.client.0.smithi164.stdout:2/775: fdatasync d3/d24/df0/ff8 0 2024-02-10T00:00:41.096 INFO:tasks.workunit.client.0.smithi164.stdout:2/776: chown d3/f6 4 1 2024-02-10T00:00:41.097 INFO:tasks.workunit.client.1.smithi183.stdout:6/989: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/dbe/fea [0,4194304] 0 2024-02-10T00:00:41.099 INFO:tasks.workunit.client.1.smithi183.stdout:3/899: creat d7/db/d2a/d2d/d51/dab/f111 x:0 0 0 2024-02-10T00:00:41.101 INFO:tasks.workunit.client.1.smithi183.stdout:7/983: read d0/d2/d3/f90 [3761789,56469] 0 2024-02-10T00:00:41.101 INFO:tasks.workunit.client.0.smithi164.stdout:6/741: getdents d0/d3b/d56 0 2024-02-10T00:00:41.102 INFO:tasks.workunit.client.1.smithi183.stdout:7/984: chown d0/d2/d50/dd1/d11c 59 1 2024-02-10T00:00:41.102 INFO:tasks.workunit.client.1.smithi183.stdout:6/990: dwrite d2/d1a/d25/d3c/d31/d38/d6e/d35/d81/d8b/fff [0,4194304] 0 2024-02-10T00:00:41.103 INFO:tasks.workunit.client.1.smithi183.stdout:3/900: truncate d7/db/f45 3547432 0 2024-02-10T00:00:41.103 INFO:tasks.workunit.client.0.smithi164.stdout:7/722: getdents d3/dbf 0 2024-02-10T00:00:41.104 INFO:tasks.workunit.client.1.smithi183.stdout:6/991: chown d2/d1a/d25/d3c/d31/d38/d3f 160140 1 2024-02-10T00:00:41.104 INFO:tasks.workunit.client.0.smithi164.stdout:2/777: symlink d3/d24/l110 0 2024-02-10T00:00:41.105 INFO:tasks.workunit.client.1.smithi183.stdout:7/985: mkdir d0/d11/d9d/d135 0 2024-02-10T00:00:41.106 INFO:tasks.workunit.client.0.smithi164.stdout:9/697: rename d6/d41/d8b/dad to d6/de/de2 0 2024-02-10T00:00:41.108 INFO:tasks.workunit.client.1.smithi183.stdout:6/992: rename d2/d1a/d25/d3c/d31/d38/d6e/ded/d45/f12a to d2/d1a/d25/d3c/d8d/d130/f13b 0 2024-02-10T00:00:41.109 INFO:tasks.workunit.client.1.smithi183.stdout:6/993: write d2/d1a/d25/d3c/fe8 [831017,33552] 0 2024-02-10T00:00:41.110 INFO:tasks.workunit.client.0.smithi164.stdout:9/698: dwrite d6/de/d2b/f3c [4194304,4194304] 0 2024-02-10T00:00:41.112 INFO:tasks.workunit.client.0.smithi164.stdout:2/778: symlink d3/l111 0 2024-02-10T00:00:41.113 INFO:tasks.workunit.client.1.smithi183.stdout:6/994: dwrite d2/d1a/d25/d3c/d31/d38/d87/fcc [0,4194304] 0 2024-02-10T00:00:41.116 INFO:tasks.workunit.client.0.smithi164.stdout:2/779: dwrite d3/d32/d4e/d27/f28 [0,4194304] 0 2024-02-10T00:00:41.116 INFO:tasks.workunit.client.1.smithi183.stdout:6/995: creat d2/d1a/d25/d3c/d31/d38/d6e/d34/d98/f13c x:0 0 0 2024-02-10T00:00:41.120 INFO:tasks.workunit.client.0.smithi164.stdout:4/701: truncate d2/d2f/d37/d41/d3d/d42/d47/f80 2973191 0 2024-02-10T00:00:41.121 INFO:tasks.workunit.client.0.smithi164.stdout:7/723: read d3/d11/d39/d44/d6f/f9e [6878674,60695] 0 2024-02-10T00:00:41.122 INFO:tasks.workunit.client.0.smithi164.stdout:7/724: dread d3/d26/f27 [0,4194304] 0 2024-02-10T00:00:41.124 INFO:tasks.workunit.client.0.smithi164.stdout:9/699: mkdir d6/de/d40/db6/de3 0 2024-02-10T00:00:41.125 INFO:tasks.workunit.client.0.smithi164.stdout:9/700: chown d6/de/d22/d58/dba/f6c 2052195 1 2024-02-10T00:00:41.126 INFO:tasks.workunit.client.0.smithi164.stdout:3/631: dwrite d0/d1/d2/d17/d37/d3f/d4e/d6d/fa7 [0,4194304] 0 2024-02-10T00:00:41.126 INFO:tasks.workunit.client.0.smithi164.stdout:1/651: rename d1/d1a/d41/d18/f9f to d1/fdd 0 2024-02-10T00:00:41.127 INFO:tasks.workunit.client.0.smithi164.stdout:8/713: rename d2/d64/d65/d80/d32/d99 to d2/d64/d65/d80/d32/d99/de1 22 2024-02-10T00:00:41.136 INFO:tasks.workunit.client.0.smithi164.stdout:1/652: write d1/f94 [384972,100611] 0 2024-02-10T00:00:41.136 INFO:tasks.workunit.client.0.smithi164.stdout:0/679: write d6/d10/d18/d2d/fb8 [862910,68414] 0 2024-02-10T00:00:41.137 INFO:tasks.workunit.client.0.smithi164.stdout:5/788: truncate d7/f1d 1286289 0 2024-02-10T00:00:41.137 INFO:tasks.workunit.client.0.smithi164.stdout:9/701: symlink d6/d41/d8b/le4 0 2024-02-10T00:00:41.137 INFO:tasks.workunit.client.0.smithi164.stdout:7/725: mkdir d3/d5/df4 0 2024-02-10T00:00:41.138 INFO:tasks.workunit.client.1.smithi183.stdout:7/986: sync 2024-02-10T00:00:41.139 INFO:tasks.workunit.client.0.smithi164.stdout:2/780: creat d3/d32/d4e/d27/f112 x:0 0 0 2024-02-10T00:00:41.141 INFO:tasks.workunit.client.1.smithi183.stdout:7/987: creat d0/d2/d4/d101/f136 x:0 0 0 2024-02-10T00:00:41.141 INFO:tasks.workunit.client.0.smithi164.stdout:3/632: rename d0/d1/d2/d19/d66/d81/f99 to d0/d8f/d9a/fc2 0 2024-02-10T00:00:41.144 INFO:tasks.workunit.client.0.smithi164.stdout:2/781: creat d3/d24/d5b/dd9/f113 x:0 0 0 2024-02-10T00:00:41.145 INFO:tasks.workunit.client.0.smithi164.stdout:5/789: rename d7/d17/d21/f89 to d7/d17/d21/d23/d37/d36/f114 0 2024-02-10T00:00:41.146 INFO:tasks.workunit.client.0.smithi164.stdout:8/714: dwrite d2/d12/f3f [0,4194304] 0 2024-02-10T00:00:41.147 INFO:tasks.workunit.client.0.smithi164.stdout:0/680: dwrite d6/d7/f24 [4194304,4194304] 0 2024-02-10T00:00:41.148 INFO:tasks.workunit.client.0.smithi164.stdout:7/726: getdents d3/d26/da7 0 2024-02-10T00:00:41.148 INFO:tasks.workunit.client.0.smithi164.stdout:3/633: symlink d0/d1/d2/d19/d27/d5f/da5/d94/lc3 0 2024-02-10T00:00:41.149 INFO:tasks.workunit.client.0.smithi164.stdout:2/782: fdatasync d3/d32/d4e/f59 0 2024-02-10T00:00:41.149 INFO:tasks.workunit.client.0.smithi164.stdout:1/653: link d1/d23/d37/lb8 d1/d1a/lde 0 2024-02-10T00:00:41.151 INFO:tasks.workunit.client.0.smithi164.stdout:8/715: read d2/d81/f95 [713090,130294] 0 2024-02-10T00:00:41.152 INFO:tasks.workunit.client.0.smithi164.stdout:0/681: fsync d6/d10/d18/fa8 0 2024-02-10T00:00:41.153 INFO:tasks.workunit.client.0.smithi164.stdout:9/702: truncate d6/de/d40/dd4/dd9/fda 339022 0 2024-02-10T00:00:41.153 INFO:tasks.workunit.client.0.smithi164.stdout:7/727: readlink d3/d11/d39/d3a/lc2 0 2024-02-10T00:00:41.155 INFO:tasks.workunit.client.0.smithi164.stdout:0/682: chown d6/d3a/d52/fb6 1733 1 2024-02-10T00:00:41.157 INFO:tasks.workunit.client.0.smithi164.stdout:5/790: rename d7/d17/d21/d24/dbc/f9e to d7/d17/d21/d23/d37/d36/d8b/f115 0 2024-02-10T00:00:41.160 INFO:tasks.workunit.client.0.smithi164.stdout:9/703: dwrite d6/de/d22/d58/dba/f6c [0,4194304] 0 2024-02-10T00:00:41.161 INFO:tasks.workunit.client.0.smithi164.stdout:0/683: fsync d6/d10/d18/d2d/d35/f48 0 2024-02-10T00:00:41.161 INFO:tasks.workunit.client.0.smithi164.stdout:8/716: dread d2/d64/d7d/fc1 [0,4194304] 0 2024-02-10T00:00:41.162 INFO:tasks.workunit.client.0.smithi164.stdout:0/684: write d6/d10/d18/d2d/f37 [1283813,54920] 0 2024-02-10T00:00:41.164 INFO:tasks.workunit.client.0.smithi164.stdout:7/728: mknod d3/d11/df3/cf5 0 2024-02-10T00:00:41.165 INFO:tasks.workunit.client.1.smithi183.stdout:3/901: getdents d7/db/d2a/d2d/d51/d8f/dd3/d107 0 2024-02-10T00:00:41.166 INFO:tasks.workunit.client.0.smithi164.stdout:6/742: dread d0/d6/d12/d14/d4b/dbf/fe8 [0,4194304] 0 2024-02-10T00:00:41.166 INFO:tasks.workunit.client.0.smithi164.stdout:8/717: mkdir d2/d64/d65/de2 0 2024-02-10T00:00:41.166 INFO:tasks.workunit.client.0.smithi164.stdout:9/704: mknod d6/de/d22/d58/dba/d61/d76/d82/db7/ce5 0 2024-02-10T00:00:41.167 INFO:tasks.workunit.client.0.smithi164.stdout:8/718: dread - d2/d12/f8d zero size 2024-02-10T00:00:41.167 INFO:tasks.workunit.client.0.smithi164.stdout:3/634: truncate d0/d1/d2/d17/fa9 911903 0 2024-02-10T00:00:41.169 INFO:tasks.workunit.client.0.smithi164.stdout:7/729: dwrite d3/d5/fe [4194304,4194304] 0 2024-02-10T00:00:41.170 INFO:tasks.workunit.client.1.smithi183.stdout:3/902: write d7/db/d2a/d2d/f5b [2060983,72154] 0 2024-02-10T00:00:41.171 INFO:tasks.workunit.client.0.smithi164.stdout:8/719: mkdir d2/d12/de3 0 2024-02-10T00:00:41.173 INFO:tasks.workunit.client.0.smithi164.stdout:4/702: sync 2024-02-10T00:00:41.174 INFO:tasks.workunit.client.0.smithi164.stdout:3/635: creat d0/d1/d2/d19/d27/d5f/da5/d94/dbd/fc4 x:0 0 0 2024-02-10T00:00:41.178 INFO:tasks.workunit.client.0.smithi164.stdout:7/730: dwrite d3/d11/d39/d44/d48/d71/fbe [0,4194304] 0 2024-02-10T00:00:41.179 INFO:tasks.workunit.client.0.smithi164.stdout:7/731: stat d3/d28/c74 0 2024-02-10T00:00:41.180 INFO:tasks.workunit.client.0.smithi164.stdout:3/636: symlink d0/d1/d2/d19/d27/d5f/da5/d94/lc5 0 2024-02-10T00:00:41.181 INFO:tasks.workunit.client.0.smithi164.stdout:0/685: dread d6/d10/d18/d2d/f7f [0,4194304] 0 2024-02-10T00:00:41.182 INFO:tasks.workunit.client.0.smithi164.stdout:7/732: fsync d3/d11/d39/d44/d6f/d75/fd1 0 2024-02-10T00:00:41.182 INFO:tasks.workunit.client.0.smithi164.stdout:8/720: dwrite d2/d81/f95 [4194304,4194304] 0 2024-02-10T00:00:41.183 INFO:tasks.workunit.client.0.smithi164.stdout:8/721: stat d2/d12/c30 0 2024-02-10T00:00:41.184 INFO:tasks.workunit.client.0.smithi164.stdout:8/722: write d2/f41 [33693,73043] 0 2024-02-10T00:00:41.185 INFO:tasks.workunit.client.0.smithi164.stdout:8/723: dread - d2/d64/d65/fa6 zero size 2024-02-10T00:00:41.186 INFO:tasks.workunit.client.0.smithi164.stdout:7/733: mknod d3/d11/d39/d44/cf6 0 2024-02-10T00:00:41.189 INFO:tasks.workunit.client.0.smithi164.stdout:3/637: rename d0/d1/d2/d19/d27/d5f/da5/f57 to d0/d1/d2/d17/d37/d3f/fc6 0 2024-02-10T00:00:41.191 INFO:tasks.workunit.client.0.smithi164.stdout:8/724: unlink d2/d64/d65/d80/d82/ld4 0 2024-02-10T00:00:41.192 INFO:tasks.workunit.client.1.smithi183.stdout:6/996: rename d2/d1a/d25/d3c/d31/d38/d3f/d5e to d2/d1a/d25/d3c/d31/d38/d6e/d13d 0 2024-02-10T00:00:41.194 INFO:tasks.workunit.client.0.smithi164.stdout:3/638: readlink d0/d1/dd/l61 0 2024-02-10T00:00:41.196 INFO:tasks.workunit.client.0.smithi164.stdout:2/783: dread d3/d26/d64/f6a [0,4194304] 0 2024-02-10T00:00:41.196 INFO:tasks.workunit.client.0.smithi164.stdout:7/734: mknod d3/d11/d39/d44/cf7 0 2024-02-10T00:00:41.196 INFO:tasks.workunit.client.0.smithi164.stdout:3/639: dread - d0/d1/d2/f8e zero size 2024-02-10T00:00:41.196 INFO:tasks.workunit.client.0.smithi164.stdout:8/725: dwrite d2/d12/f17 [4194304,4194304] 0 2024-02-10T00:00:41.197 INFO:tasks.workunit.client.0.smithi164.stdout:7/735: fdatasync d3/d26/da7/fc5 0 2024-02-10T00:00:41.197 INFO:tasks.workunit.client.1.smithi183.stdout:7/988: rename d0/d11/d2f to d0/d2/d4/d101/d137 0 2024-02-10T00:00:41.199 INFO:tasks.workunit.client.0.smithi164.stdout:3/640: mknod d0/d1/d2/d19/cc7 0 2024-02-10T00:00:41.200 INFO:tasks.workunit.client.0.smithi164.stdout:3/641: fsync d0/d1/d2/d19/d27/f80 0 2024-02-10T00:00:41.202 INFO:tasks.workunit.client.0.smithi164.stdout:7/736: dwrite d3/d11/d39/d44/d6f/d75/fd1 [0,4194304] 0 2024-02-10T00:00:41.203 INFO:tasks.workunit.client.0.smithi164.stdout:7/737: chown d3/d5/d9b/db7/d4b/f6a 0 1 2024-02-10T00:00:41.209 INFO:tasks.workunit.client.0.smithi164.stdout:7/738: unlink d3/d5/d59/c84 0 2024-02-10T00:00:41.209 INFO:tasks.workunit.client.1.smithi183.stdout:3/903: dread d7/db/d2a/d33/f72 [0,4194304] 0 2024-02-10T00:00:41.212 INFO:tasks.workunit.client.1.smithi183.stdout:3/904: truncate d7/db/d2a/d2d/d51/d8f/faf 4732258 0 2024-02-10T00:00:41.214 INFO:tasks.workunit.client.0.smithi164.stdout:3/642: mkdir d0/d1/dd/dc8 0 2024-02-10T00:00:41.216 INFO:tasks.workunit.client.1.smithi183.stdout:3/905: truncate d7/db/d2a/d4d/dde/fce 646748 0 2024-02-10T00:00:41.220 INFO:tasks.workunit.client.0.smithi164.stdout:4/703: dread d2/d2f/d37/f55 [0,4194304] 0 2024-02-10T00:00:41.221 INFO:tasks.workunit.client.1.smithi183.stdout:3/906: getdents d7/db/d2a/d4d/dde 0 2024-02-10T00:00:41.221 INFO:tasks.workunit.client.0.smithi164.stdout:1/654: truncate d1/d13/f66 2000492 0 2024-02-10T00:00:41.222 INFO:tasks.workunit.client.1.smithi183.stdout:3/907: write d7/db/d2a/d4d/dde/ffc [4778071,130419] 0 2024-02-10T00:00:41.226 INFO:tasks.workunit.client.0.smithi164.stdout:5/791: truncate d7/d17/d21/d23/d5a/d68/fd9 535181 0 2024-02-10T00:00:41.228 INFO:tasks.workunit.client.0.smithi164.stdout:1/655: mkdir d1/d13/d2b/d52/db7/ddf 0 2024-02-10T00:00:41.228 INFO:tasks.workunit.client.0.smithi164.stdout:5/792: chown d7/d17/d21/d23/d5a/d68/d1f/d59 3280436 1 2024-02-10T00:00:41.230 INFO:tasks.workunit.client.0.smithi164.stdout:0/686: sync 2024-02-10T00:00:41.231 INFO:tasks.workunit.client.0.smithi164.stdout:6/743: dwrite d0/d6/d12/d57/f7b [0,4194304] 0 2024-02-10T00:00:41.231 INFO:tasks.workunit.client.1.smithi183.stdout:6/997: write d2/d1a/d25/d3c/d31/d38/d6e/f2e [9385395,104503] 0 2024-02-10T00:00:41.233 INFO:tasks.workunit.client.0.smithi164.stdout:7/739: rename d3/dbf/ccd to d3/d11/d39/d44/cf8 0 2024-02-10T00:00:41.234 INFO:tasks.workunit.client.1.smithi183.stdout:6/998: dread d2/d1a/d25/d3c/d31/f79 [0,4194304] 0 2024-02-10T00:00:41.234 INFO:tasks.workunit.client.1.smithi183.stdout:6/999: stat d2/d1a/d25/d3c/d8d/d130 0 2024-02-10T00:00:41.235 INFO:tasks.workunit.client.0.smithi164.stdout:7/740: stat d3/d5/d2b/dab/dda/leb 0 2024-02-10T00:00:41.236 INFO:tasks.workunit.client.0.smithi164.stdout:2/784: write d3/d26/d56/f7c [261276,77082] 0 2024-02-10T00:00:41.237 INFO:tasks.workunit.client.1.smithi183.stdout:7/989: write d0/d2/d4/d101/d137/d64/d6b/f86 [1208325,94135] 0 2024-02-10T00:00:41.237 INFO:tasks.workunit.client.1.smithi183.stdout:7/990: dread - d0/d2/f10b zero size 2024-02-10T00:00:41.238 INFO:tasks.workunit.client.0.smithi164.stdout:9/705: dread d6/de/d22/f51 [0,4194304] 0 2024-02-10T00:00:41.238 INFO:tasks.workunit.client.0.smithi164.stdout:2/785: write d3/da6/d7a/d8e/d36/d54/f9f [529445,117423] 0 2024-02-10T00:00:41.239 INFO:tasks.workunit.client.0.smithi164.stdout:9/706: write d6/de/f14 [2951066,103750] 0 2024-02-10T00:00:41.244 INFO:tasks.workunit.client.0.smithi164.stdout:5/793: write d7/f19 [2621084,74584] 0 2024-02-10T00:00:41.244 INFO:tasks.workunit.client.1.smithi183.stdout:7/991: mkdir d0/d11/d9d/d103/d105/d10e/d138 0 2024-02-10T00:00:41.245 INFO:tasks.workunit.client.0.smithi164.stdout:1/656: unlink d1/d13/d2b/d52/da4/dc3/dcd/f78 0 2024-02-10T00:00:41.246 INFO:tasks.workunit.client.0.smithi164.stdout:0/687: mkdir d6/d10/d4a/d88/dd3 0 2024-02-10T00:00:41.247 INFO:tasks.workunit.client.0.smithi164.stdout:7/741: mkdir d3/d5/d2b/dab/dda/d5d/df9 0 2024-02-10T00:00:41.249 INFO:tasks.workunit.client.0.smithi164.stdout:2/786: unlink d3/d32/d4e/ld2 0 2024-02-10T00:00:41.250 INFO:tasks.workunit.client.0.smithi164.stdout:3/643: getdents d0/d1/d3c 0 2024-02-10T00:00:41.253 INFO:tasks.workunit.client.1.smithi183.stdout:7/992: dread d0/d2/d4/d8/d59/d8a/fa9 [0,4194304] 0 2024-02-10T00:00:41.254 INFO:tasks.workunit.client.0.smithi164.stdout:4/704: dread d2/d2f/d37/d41/d3d/d42/f63 [0,4194304] 0 2024-02-10T00:00:41.255 INFO:tasks.workunit.client.0.smithi164.stdout:8/726: sync 2024-02-10T00:00:41.255 INFO:tasks.workunit.client.0.smithi164.stdout:2/787: dwrite d3/d32/fe2 [0,4194304] 0 2024-02-10T00:00:41.257 INFO:tasks.workunit.client.0.smithi164.stdout:6/744: creat d0/d6/d12/ff8 x:0 0 0 2024-02-10T00:00:41.257 INFO:tasks.workunit.client.0.smithi164.stdout:4/705: fsync d2/d2f/d37/d41/d3d/f52 0 2024-02-10T00:00:41.257 INFO:tasks.workunit.client.0.smithi164.stdout:8/727: read d2/f4 [2844052,66522] 0 2024-02-10T00:00:41.259 INFO:tasks.workunit.client.0.smithi164.stdout:1/657: mkdir d1/d1a/d75/de0 0 2024-02-10T00:00:41.260 INFO:tasks.workunit.client.0.smithi164.stdout:4/706: stat d2/d2f/d37/f8f 0 2024-02-10T00:00:41.263 INFO:tasks.workunit.client.1.smithi183.stdout:3/908: sync 2024-02-10T00:00:41.263 INFO:tasks.workunit.client.1.smithi183.stdout:7/993: truncate d0/d2/d4/d101/d137/d64/f93 3703207 0 2024-02-10T00:00:41.264 INFO:tasks.workunit.client.1.smithi183.stdout:7/994: chown d0/d11/f98 232775138 1 2024-02-10T00:00:41.264 INFO:tasks.workunit.client.0.smithi164.stdout:8/728: dwrite d2/d64/d63/fbd [0,4194304] 0 2024-02-10T00:00:41.264 INFO:tasks.workunit.client.1.smithi183.stdout:7/995: readlink d0/d2/d4/d101/d137/d64/lef 0 2024-02-10T00:00:41.266 INFO:tasks.workunit.client.0.smithi164.stdout:0/688: truncate d6/d3a/d52/f75 2290492 0 2024-02-10T00:00:41.266 INFO:tasks.workunit.client.1.smithi183.stdout:7/996: creat d0/d11/d9d/d103/d105/f139 x:0 0 0 2024-02-10T00:00:41.267 INFO:tasks.workunit.client.0.smithi164.stdout:7/742: creat d3/d11/d39/d44/d6f/ffa x:0 0 0 2024-02-10T00:00:41.268 INFO:tasks.workunit.client.1.smithi183.stdout:3/909: creat d7/db/d2a/d1c/f112 x:0 0 0 2024-02-10T00:00:41.268 INFO:tasks.workunit.client.1.smithi183.stdout:7/997: fdatasync d0/d2/d4/d101/d137/d64/d6b/fde 0 2024-02-10T00:00:41.268 INFO:tasks.workunit.client.0.smithi164.stdout:2/788: rename d3/d24/f39 to d3/da6/d7a/d8e/d36/dbd/f114 0 2024-02-10T00:00:41.268 INFO:tasks.workunit.client.1.smithi183.stdout:7/998: chown d0/d11/d88/d94/dff 9502270 1 2024-02-10T00:00:41.269 INFO:tasks.workunit.client.0.smithi164.stdout:6/745: mknod d0/d3b/d56/db3/cf9 0 2024-02-10T00:00:41.270 INFO:tasks.workunit.client.0.smithi164.stdout:7/743: write d3/d26/d67/fb5 [1227923,108534] 0 2024-02-10T00:00:41.270 INFO:tasks.workunit.client.1.smithi183.stdout:7/999: mknod d0/d2/d4/d8/d59/c13a 0 2024-02-10T00:00:41.271 INFO:tasks.workunit.client.0.smithi164.stdout:6/746: chown d0/la 82782 1 2024-02-10T00:00:41.272 INFO:tasks.workunit.client.0.smithi164.stdout:8/729: dwrite d2/d64/d7d/fc8 [0,4194304] 0 2024-02-10T00:00:41.273 INFO:tasks.workunit.client.0.smithi164.stdout:9/707: getdents d6/de/d22/d58/dba/d61/d76 0 2024-02-10T00:00:41.273 INFO:tasks.workunit.client.1.smithi183.stdout:3/910: link d7/db/d2a/d33/d59/daa/cb4 d7/db/d2a/d1c/c113 0 2024-02-10T00:00:41.274 INFO:tasks.workunit.client.1.smithi183.stdout:3/911: chown d7/db/d2a/d33 14 1 2024-02-10T00:00:41.274 INFO:tasks.workunit.client.0.smithi164.stdout:1/658: dread d1/d13/d2b/d52/f82 [0,4194304] 0 2024-02-10T00:00:41.276 INFO:tasks.workunit.client.0.smithi164.stdout:5/794: dread d7/d17/fc0 [0,4194304] 0 2024-02-10T00:00:41.277 INFO:tasks.workunit.client.1.smithi183.stdout:3/912: symlink d7/db/d2a/d2d/d51/d8f/l114 0 2024-02-10T00:00:41.277 INFO:tasks.workunit.client.0.smithi164.stdout:1/659: read - d1/d13/d2b/f50 zero size 2024-02-10T00:00:41.279 INFO:tasks.workunit.client.0.smithi164.stdout:3/644: link d0/d1/l9d d0/d8f/d9a/lc9 0 2024-02-10T00:00:41.280 INFO:tasks.workunit.client.1.smithi183.stdout:3/913: dwrite d7/db/d2a/d33/d59/db6/fc2 [0,4194304] 0 2024-02-10T00:00:41.281 INFO:tasks.workunit.client.0.smithi164.stdout:8/730: creat d2/d64/d65/d98/fe4 x:0 0 0 2024-02-10T00:00:41.283 INFO:tasks.workunit.client.0.smithi164.stdout:7/744: dwrite d3/d5/f30 [4194304,4194304] 0 2024-02-10T00:00:41.284 INFO:tasks.workunit.client.1.smithi183.stdout:3/914: symlink d7/db/d2a/d33/d59/df7/da0/l115 0 2024-02-10T00:00:41.284 INFO:tasks.workunit.client.0.smithi164.stdout:2/789: mkdir d3/da6/d7a/d8e/d8a/d115 0 2024-02-10T00:00:41.288 INFO:tasks.workunit.client.0.smithi164.stdout:0/689: link d6/d10/d18/d2d/f5d d6/d10/d18/d2d/d35/fd4 0 2024-02-10T00:00:41.289 INFO:tasks.workunit.client.0.smithi164.stdout:0/690: write d6/d10/d4a/dc7/fb4 [1042605,106211] 0 2024-02-10T00:00:41.290 INFO:tasks.workunit.client.0.smithi164.stdout:0/691: chown d6/d3a/d52/c9f 45 1 2024-02-10T00:00:41.290 INFO:tasks.workunit.client.0.smithi164.stdout:8/731: mknod d2/d64/d65/da9/ce5 0 2024-02-10T00:00:41.292 INFO:tasks.workunit.client.0.smithi164.stdout:2/790: rmdir d3/d26/d64 39 2024-02-10T00:00:41.293 INFO:tasks.workunit.client.0.smithi164.stdout:2/791: write d3/f7 [4377125,98724] 0 2024-02-10T00:00:41.294 INFO:tasks.workunit.client.0.smithi164.stdout:5/795: mkdir d7/d17/d21/d24/dff/d116 0 2024-02-10T00:00:41.295 INFO:tasks.workunit.client.0.smithi164.stdout:3/645: mknod d0/d1/d2/d19/d27/cca 0 2024-02-10T00:00:41.299 INFO:tasks.workunit.client.0.smithi164.stdout:9/708: rmdir d6/de/d40/db6/de3 0 2024-02-10T00:00:41.299 INFO:tasks.workunit.client.0.smithi164.stdout:2/792: dread d3/da6/d7a/d8e/d36/d54/f9f [0,4194304] 0 2024-02-10T00:00:41.300 INFO:tasks.workunit.client.0.smithi164.stdout:5/796: dwrite d7/d17/d69/d92/de9/f106 [0,4194304] 0 2024-02-10T00:00:41.301 INFO:tasks.workunit.client.0.smithi164.stdout:6/747: rename d0/d6/d95/dcd/l9d to d0/d6/d12/d45/lfa 0 2024-02-10T00:00:41.304 INFO:tasks.workunit.client.0.smithi164.stdout:8/732: unlink d2/d64/d63/cdb 0 2024-02-10T00:00:41.305 INFO:tasks.workunit.client.0.smithi164.stdout:2/793: dwrite d3/d24/d5b/fe3 [0,4194304] 0 2024-02-10T00:00:41.307 INFO:tasks.workunit.client.0.smithi164.stdout:0/692: creat d6/d7/d14/da6/daa/fd5 x:0 0 0 2024-02-10T00:00:41.307 INFO:tasks.workunit.client.0.smithi164.stdout:7/745: mknod d3/d5/cfb 0 2024-02-10T00:00:41.310 INFO:tasks.workunit.client.0.smithi164.stdout:9/709: creat d6/de/d22/d58/dba/d75/fe6 x:0 0 0 2024-02-10T00:00:41.310 INFO:tasks.workunit.client.0.smithi164.stdout:4/707: write d2/d2f/d37/d41/d3d/d42/d47/f80 [1599915,104192] 0 2024-02-10T00:00:41.311 INFO:tasks.workunit.client.0.smithi164.stdout:9/710: fsync d6/de/d22/d58/fd6 0 2024-02-10T00:00:41.312 INFO:tasks.workunit.client.1.smithi183.stdout:3/915: write d7/db/d2a/d33/d59/f8b [766830,8586] 0 2024-02-10T00:00:41.312 INFO:tasks.workunit.client.0.smithi164.stdout:1/660: rename d1/l76 to d1/d13/d1f/le1 0 2024-02-10T00:00:41.313 INFO:tasks.workunit.client.0.smithi164.stdout:1/661: chown d1/d13/d1f/c6c 12858 1 2024-02-10T00:00:41.313 INFO:tasks.workunit.client.0.smithi164.stdout:6/748: stat d0/d2b/d3a/d3d/d42/d5d/d66/cac 0 2024-02-10T00:00:41.319 INFO:tasks.workunit.client.0.smithi164.stdout:5/797: dread d7/d17/d21/d23/d5a/d68/d1f/fbb [0,4194304] 0 2024-02-10T00:00:41.322 INFO:tasks.workunit.client.0.smithi164.stdout:4/708: creat d2/d2f/d37/d71/ff4 x:0 0 0 2024-02-10T00:00:41.322 INFO:tasks.workunit.client.0.smithi164.stdout:9/711: mkdir d6/de/d22/de7 0 2024-02-10T00:00:41.322 INFO:tasks.workunit.client.0.smithi164.stdout:4/709: chown d2/d19/d16/d31/d7e 9376863 1 2024-02-10T00:00:41.323 INFO:tasks.workunit.client.0.smithi164.stdout:1/662: fsync d1/d23/f92 0 2024-02-10T00:00:41.325 INFO:tasks.workunit.client.0.smithi164.stdout:0/693: mkdir d6/d10/d18/d2d/dd6 0 2024-02-10T00:00:41.326 INFO:tasks.workunit.client.0.smithi164.stdout:2/794: dread d3/da6/f104 [0,4194304] 0 2024-02-10T00:00:41.327 INFO:tasks.workunit.client.1.smithi183.stdout:3/916: write d7/db/d2a/d2d/d51/d8f/faf [270675,104576] 0 2024-02-10T00:00:41.328 INFO:tasks.workunit.client.0.smithi164.stdout:2/795: read d3/d24/ffc [194466,16520] 0 2024-02-10T00:00:41.329 INFO:tasks.workunit.client.0.smithi164.stdout:5/798: read d7/d17/d21/d23/d37/d36/f114 [219741,103158] 0 2024-02-10T00:00:41.329 INFO:tasks.workunit.client.0.smithi164.stdout:1/663: dwrite d1/d13/d2b/d52/da4/dc2/dcc/fd9 [0,4194304] 0 2024-02-10T00:00:41.331 INFO:tasks.workunit.client.1.smithi183.stdout:3/917: rename d7/db/d2a/d2d/d51/d8f/lf3 to d7/db/d2a/d2d/d51/dab/l116 0 2024-02-10T00:00:41.331 INFO:tasks.workunit.client.0.smithi164.stdout:4/710: fsync d2/d19/d16/d31/f36 0 2024-02-10T00:00:41.333 INFO:tasks.workunit.client.1.smithi183.stdout:3/918: creat d7/d98/dc9/f117 x:0 0 0 2024-02-10T00:00:41.334 INFO:tasks.workunit.client.0.smithi164.stdout:5/799: dwrite d7/d17/d21/d23/d37/d36/d8b/fcf [4194304,4194304] 0 2024-02-10T00:00:41.335 INFO:tasks.workunit.client.0.smithi164.stdout:0/694: write d6/d10/d18/d2d/fb3 [6087082,22042] 0 2024-02-10T00:00:41.336 INFO:tasks.workunit.client.0.smithi164.stdout:8/733: truncate d2/fd1 4380742 0 2024-02-10T00:00:41.336 INFO:tasks.workunit.client.0.smithi164.stdout:7/746: truncate d3/d5/fec 892320 0 2024-02-10T00:00:41.338 INFO:tasks.workunit.client.1.smithi183.stdout:3/919: rename d7/db/d2a/d33/f72 to d7/db/d2a/d2d/d51/d8f/dd3/f118 0 2024-02-10T00:00:41.339 INFO:tasks.workunit.client.0.smithi164.stdout:3/646: rename d0/d1/d2/d19/d27/d5f/ca4 to d0/d1/d2/d17/ccb 0 2024-02-10T00:00:41.340 INFO:tasks.workunit.client.0.smithi164.stdout:3/647: write d0/f5e [410177,128582] 0 2024-02-10T00:00:41.341 INFO:tasks.workunit.client.0.smithi164.stdout:1/664: rmdir d1/d23/d61/d9d 39 2024-02-10T00:00:41.342 INFO:tasks.workunit.client.1.smithi183.stdout:3/920: rename d7/db/d2a/d2d/d51/dab/fd6 to d7/db/f119 0 2024-02-10T00:00:41.343 INFO:tasks.workunit.client.0.smithi164.stdout:5/800: creat d7/d17/d21/d23/d5a/d68/d1f/dbe/f117 x:0 0 0 2024-02-10T00:00:41.343 INFO:tasks.workunit.client.1.smithi183.stdout:3/921: stat d7/db/d2a/d4d/l103 0 2024-02-10T00:00:41.382 INFO:tasks.workunit.client.0.smithi164.stdout:6/749: sync 2024-02-10T00:00:41.384 INFO:tasks.workunit.client.0.smithi164.stdout:0/695: mkdir d6/d10/d4a/dc7/dd7 0 2024-02-10T00:00:41.388 INFO:tasks.workunit.client.1.smithi183.stdout:3/922: dwrite d7/db/d2a/d4d/dde/fce [0,4194304] 0 2024-02-10T00:00:41.392 INFO:tasks.workunit.client.1.smithi183.stdout:3/923: truncate d7/db/d2a/d4d/d63/fd5 778149 0 2024-02-10T00:00:41.393 INFO:tasks.workunit.client.1.smithi183.stdout:3/924: fsync d7/db/d2a/d2d/d51/fea 0 2024-02-10T00:00:41.394 INFO:tasks.workunit.client.1.smithi183.stdout:3/925: write d7/db/d2a/d2d/d51/fbd [380888,28797] 0 2024-02-10T00:00:41.398 INFO:tasks.workunit.client.1.smithi183.stdout:3/926: truncate d7/db/d2a/d1c/f27 2448940 0 2024-02-10T00:00:41.409 INFO:tasks.workunit.client.1.smithi183.stdout:3/927: dwrite d7/db/f94 [0,4194304] 0 2024-02-10T00:00:41.411 INFO:tasks.workunit.client.1.smithi183.stdout:3/928: mkdir d7/d98/d11a 0 2024-02-10T00:00:41.415 INFO:tasks.workunit.client.1.smithi183.stdout:3/929: dwrite d7/db/d2a/f44 [0,4194304] 0 2024-02-10T00:00:41.419 INFO:tasks.workunit.client.1.smithi183.stdout:3/930: unlink d7/db/d2a/fe6 0 2024-02-10T00:00:41.420 INFO:tasks.workunit.client.1.smithi183.stdout:3/931: symlink d7/db/d2a/d4d/l11b 0 2024-02-10T00:00:41.422 INFO:tasks.workunit.client.1.smithi183.stdout:3/932: readlink d7/l32 0 2024-02-10T00:00:41.433 INFO:tasks.workunit.client.0.smithi164.stdout:1/665: creat d1/d1a/d75/fe2 x:0 0 0 2024-02-10T00:00:41.433 INFO:tasks.workunit.client.0.smithi164.stdout:1/666: chown d1/d23/d37/da9/dd7 0 1 2024-02-10T00:00:41.434 INFO:tasks.workunit.client.0.smithi164.stdout:3/648: rename d0/d1/d2/d19/d27/d5f/da5/d94/lc3 to d0/d3b/lcc 0 2024-02-10T00:00:41.436 INFO:tasks.workunit.client.1.smithi183.stdout:3/933: write d7/db/d2a/d33/d59/df7/fb0 [414561,32504] 0 2024-02-10T00:00:41.437 INFO:tasks.workunit.client.1.smithi183.stdout:3/934: chown d7/db/d2a/d33/f87 1290989427 1 2024-02-10T00:00:41.437 INFO:tasks.workunit.client.0.smithi164.stdout:4/711: mknod d2/d5a/cf5 0 2024-02-10T00:00:41.438 INFO:tasks.workunit.client.1.smithi183.stdout:3/935: chown d7/db/d2a/d2d/c42 12 1 2024-02-10T00:00:41.439 INFO:tasks.workunit.client.0.smithi164.stdout:5/801: creat d7/d17/d21/d85/f118 x:0 0 0 2024-02-10T00:00:41.440 INFO:tasks.workunit.client.1.smithi183.stdout:3/936: symlink d7/l11c 0 2024-02-10T00:00:41.441 INFO:tasks.workunit.client.0.smithi164.stdout:9/712: getdents d6/de/d40/d74 0 2024-02-10T00:00:41.441 INFO:tasks.workunit.client.1.smithi183.stdout:3/937: chown d7/d98/fa3 19291406 1 2024-02-10T00:00:41.441 INFO:tasks.workunit.client.1.smithi183.stdout:3/938: read d7/db/d2a/d33/d59/db6/ffa [3479202,47617] 0 2024-02-10T00:00:41.442 INFO:tasks.workunit.client.0.smithi164.stdout:9/713: write d6/de/d22/d69/f91 [2671285,84426] 0 2024-02-10T00:00:41.442 INFO:tasks.workunit.client.0.smithi164.stdout:4/712: dwrite d2/d19/d16/d31/f74 [0,4194304] 0 2024-02-10T00:00:41.442 INFO:tasks.workunit.client.1.smithi183.stdout:3/939: write d7/db/d2a/d4d/fe5 [860959,102355] 0 2024-02-10T00:00:41.445 INFO:tasks.workunit.client.1.smithi183.stdout:3/940: symlink d7/db/d2a/d4d/dde/l11d 0 2024-02-10T00:00:41.450 INFO:tasks.workunit.client.1.smithi183.stdout:3/941: rename d7/db/d2a/d4d/d63/fbe to d7/db/d2a/d33/f11e 0 2024-02-10T00:00:41.454 INFO:tasks.workunit.client.0.smithi164.stdout:9/714: dread d6/fc [0,4194304] 0 2024-02-10T00:00:41.454 INFO:tasks.workunit.client.0.smithi164.stdout:1/667: symlink d1/d23/d37/da9/dd1/le3 0 2024-02-10T00:00:41.455 INFO:tasks.workunit.client.1.smithi183.stdout:3/942: link d7/db/d2a/d4d/d63/f9f d7/d98/dc9/dd0/f11f 0 2024-02-10T00:00:41.456 INFO:tasks.workunit.client.0.smithi164.stdout:2/796: link d3/da6/d7a/d8e/d36/lb5 d3/da6/d7a/d8e/d8a/dc8/l116 0 2024-02-10T00:00:41.456 INFO:tasks.workunit.client.0.smithi164.stdout:1/668: chown d1/d13/d2b/d52/f82 189351 1 2024-02-10T00:00:41.456 INFO:tasks.workunit.client.1.smithi183.stdout:3/943: chown d7/db/d2a/d4d/dde/ffc 41 1 2024-02-10T00:00:41.456 INFO:tasks.workunit.client.0.smithi164.stdout:1/669: chown d1/d13/d2b/lbf 21377 1 2024-02-10T00:00:41.457 INFO:tasks.workunit.client.0.smithi164.stdout:1/670: write d1/d13/f19 [3385720,64572] 0 2024-02-10T00:00:41.457 INFO:tasks.workunit.client.1.smithi183.stdout:3/944: mknod d7/db/d2a/d2d/d51/dab/da9/c120 0 2024-02-10T00:00:41.458 INFO:tasks.workunit.client.0.smithi164.stdout:8/734: link d2/d64/d65/c7f d2/d64/d54/d71/d78/ce6 0 2024-02-10T00:00:41.458 INFO:tasks.workunit.client.1.smithi183.stdout:3/945: dread - d7/db/d2a/d1c/f112 zero size 2024-02-10T00:00:41.458 INFO:tasks.workunit.client.0.smithi164.stdout:7/747: truncate d3/d11/d39/d44/d48/f78 370869 0 2024-02-10T00:00:41.463 INFO:tasks.workunit.client.0.smithi164.stdout:1/671: dwrite d1/d13/d1f/fac [0,4194304] 0 2024-02-10T00:00:41.463 INFO:tasks.workunit.client.0.smithi164.stdout:5/802: creat d7/daf/dce/f119 x:0 0 0 2024-02-10T00:00:41.464 INFO:tasks.workunit.client.1.smithi183.stdout:3/946: rename d7/db/d2a/d4d/d63/dc4/l10a to d7/db/d2a/d2d/l121 0 2024-02-10T00:00:41.464 INFO:tasks.workunit.client.0.smithi164.stdout:8/735: fsync d2/f4 0 2024-02-10T00:00:41.467 INFO:tasks.workunit.client.0.smithi164.stdout:4/713: dwrite d2/d2f/d37/d41/d3d/fa0 [0,4194304] 0 2024-02-10T00:00:41.467 INFO:tasks.workunit.client.0.smithi164.stdout:5/803: chown d7/d17/d21/d23/cb9 183 1 2024-02-10T00:00:41.467 INFO:tasks.workunit.client.0.smithi164.stdout:3/649: creat d0/d1/d2/fcd x:0 0 0 2024-02-10T00:00:41.467 INFO:tasks.workunit.client.0.smithi164.stdout:7/748: truncate d3/d11/d39/d44/fb3 1488706 0 2024-02-10T00:00:41.468 INFO:tasks.workunit.client.0.smithi164.stdout:3/650: chown d0/d8f/d9a/fb7 8 1 2024-02-10T00:00:41.470 INFO:tasks.workunit.client.0.smithi164.stdout:4/714: dread - d2/d19/d16/d31/d72/feb zero size 2024-02-10T00:00:41.473 INFO:tasks.workunit.client.0.smithi164.stdout:5/804: dwrite d7/d17/d21/d24/dbc/d43/f53 [0,4194304] 0 2024-02-10T00:00:41.479 INFO:tasks.workunit.client.0.smithi164.stdout:6/750: truncate d0/d2b/d3a/f8f 311401 0 2024-02-10T00:00:41.482 INFO:tasks.workunit.client.0.smithi164.stdout:2/797: write d3/da6/d7a/fa3 [707274,90175] 0 2024-02-10T00:00:41.486 INFO:tasks.workunit.client.0.smithi164.stdout:0/696: rename d6/d7/d14/f20 to d6/d10/d4a/fd8 0 2024-02-10T00:00:41.487 INFO:tasks.workunit.client.0.smithi164.stdout:3/651: fsync d0/d1/d2/d17/d37/d3f/d4e/f96 0 2024-02-10T00:00:41.487 INFO:tasks.workunit.client.0.smithi164.stdout:3/652: chown d0 147425797 1 2024-02-10T00:00:41.490 INFO:tasks.workunit.client.0.smithi164.stdout:7/749: read d3/d28/f3b [2669738,94037] 0 2024-02-10T00:00:41.491 INFO:tasks.workunit.client.0.smithi164.stdout:0/697: creat d6/d10/d4a/d88/fd9 x:0 0 0 2024-02-10T00:00:41.492 INFO:tasks.workunit.client.0.smithi164.stdout:4/715: creat d2/d19/dc1/ff6 x:0 0 0 2024-02-10T00:00:41.495 INFO:tasks.workunit.client.0.smithi164.stdout:3/653: rename d0/d1/d2/d19/d27/d5f/da5/d6b to d0/d3b/dce 0 2024-02-10T00:00:41.496 INFO:tasks.workunit.client.0.smithi164.stdout:1/672: mkdir d1/d1a/d41/de4 0 2024-02-10T00:00:41.496 INFO:tasks.workunit.client.0.smithi164.stdout:7/750: stat d3/d26/d67/d98/daf/lbc 0 2024-02-10T00:00:41.497 INFO:tasks.workunit.client.0.smithi164.stdout:1/673: chown d1/d13/d2b/lbf 14024 1 2024-02-10T00:00:41.497 INFO:tasks.workunit.client.0.smithi164.stdout:0/698: fsync d6/d10/d18/d1c/f3b 0 2024-02-10T00:00:41.498 INFO:tasks.workunit.client.0.smithi164.stdout:0/699: stat d6/d3a/d52/d7a/c4c 0 2024-02-10T00:00:41.498 INFO:tasks.workunit.client.0.smithi164.stdout:4/716: chown d2/d19/d16/f1b 175 1 2024-02-10T00:00:41.504 INFO:tasks.workunit.client.0.smithi164.stdout:3/654: creat d0/d8f/fcf x:0 0 0 2024-02-10T00:00:41.504 INFO:tasks.workunit.client.0.smithi164.stdout:9/715: truncate d6/de/d2b/f3c 3782444 0 2024-02-10T00:00:41.504 INFO:tasks.workunit.client.0.smithi164.stdout:4/717: dwrite d2/d19/d16/d31/d72/feb [0,4194304] 0 2024-02-10T00:00:41.506 INFO:tasks.workunit.client.1.smithi183.stdout:3/947: sync 2024-02-10T00:00:41.506 INFO:tasks.workunit.client.0.smithi164.stdout:1/674: symlink d1/d13/d2b/d52/da4/dc2/dcc/le5 0 2024-02-10T00:00:41.507 INFO:tasks.workunit.client.1.smithi183.stdout:3/948: chown d7/db/d2a/d2d/d51/d8f/fa2 7594 1 2024-02-10T00:00:41.507 INFO:tasks.workunit.client.0.smithi164.stdout:6/751: write d0/d2b/d3a/d3d/d42/d5d/d79/f8b [824683,125] 0 2024-02-10T00:00:41.507 INFO:tasks.workunit.client.1.smithi183.stdout:3/949: fsync d7/db/d2a/d1c/fcd 0 2024-02-10T00:00:41.508 INFO:tasks.workunit.client.0.smithi164.stdout:2/798: link d3/d32/d4e/d27/cbf d3/d24/c117 0 2024-02-10T00:00:41.511 INFO:tasks.workunit.client.0.smithi164.stdout:6/752: dread - d0/d6/d12/d45/fc4 zero size 2024-02-10T00:00:41.513 INFO:tasks.workunit.client.0.smithi164.stdout:4/718: dwrite d2/d2f/d37/d45/dab/dbd/fc4 [0,4194304] 0 2024-02-10T00:00:41.514 INFO:tasks.workunit.client.0.smithi164.stdout:9/716: mknod d6/de/d40/d74/ce8 0 2024-02-10T00:00:41.514 INFO:tasks.workunit.client.0.smithi164.stdout:2/799: rename d3/da6/d7a/d8e/d36/dbd to d3/da6/d7a/d8e/d36/dbd/d118 22 2024-02-10T00:00:41.515 INFO:tasks.workunit.client.0.smithi164.stdout:0/700: creat d6/d7/d14/d79/dce/fda x:0 0 0 2024-02-10T00:00:41.515 INFO:tasks.workunit.client.0.smithi164.stdout:8/736: dwrite d2/d64/d65/d80/d32/d4d/f57 [0,4194304] 0 2024-02-10T00:00:41.516 INFO:tasks.workunit.client.0.smithi164.stdout:7/751: getdents d3/d26/d67 0 2024-02-10T00:00:41.517 INFO:tasks.workunit.client.0.smithi164.stdout:5/805: dwrite d7/fd [0,4194304] 0 2024-02-10T00:00:41.518 INFO:tasks.workunit.client.1.smithi183.stdout:3/950: creat d7/db/d2a/d4d/d63/dc4/f122 x:0 0 0 2024-02-10T00:00:41.518 INFO:tasks.workunit.client.0.smithi164.stdout:4/719: fsync d2/d2f/d37/d45/fa7 0 2024-02-10T00:00:41.520 INFO:tasks.workunit.client.0.smithi164.stdout:8/737: write d2/d64/d65/d80/d32/f3e [3127225,110376] 0 2024-02-10T00:00:41.521 INFO:tasks.workunit.client.0.smithi164.stdout:5/806: write d7/d17/d21/d24/dbc/d43/f6e [956483,6482] 0 2024-02-10T00:00:41.521 INFO:tasks.workunit.client.0.smithi164.stdout:2/800: read d3/da6/d7a/ffb [206928,75959] 0 2024-02-10T00:00:41.522 INFO:tasks.workunit.client.1.smithi183.stdout:3/951: dwrite d7/db/d2a/d2d/d51/d8f/faf [0,4194304] 0 2024-02-10T00:00:41.522 INFO:tasks.workunit.client.0.smithi164.stdout:0/701: mknod d6/d10/cdb 0 2024-02-10T00:00:41.524 INFO:tasks.workunit.client.0.smithi164.stdout:9/717: creat d6/de/d22/d58/dba/d61/d76/d82/fe9 x:0 0 0 2024-02-10T00:00:41.525 INFO:tasks.workunit.client.0.smithi164.stdout:6/753: dread d0/d6/d12/f91 [0,4194304] 0 2024-02-10T00:00:41.525 INFO:tasks.workunit.client.0.smithi164.stdout:9/718: dread - d6/de/d22/d58/dba/d61/d76/fc7 zero size 2024-02-10T00:00:41.527 INFO:tasks.workunit.client.1.smithi183.stdout:3/952: truncate d7/db/d2a/d1c/fcd 934088 0 2024-02-10T00:00:41.528 INFO:tasks.workunit.client.0.smithi164.stdout:5/807: rename d7/d17/d21/d23/d37/fa1 to d7/d17/d21/d24/dff/d116/f11a 0 2024-02-10T00:00:41.528 INFO:tasks.workunit.client.1.smithi183.stdout:3/953: fsync d7/db/d2a/d2d/f5b 0 2024-02-10T00:00:41.530 INFO:tasks.workunit.client.0.smithi164.stdout:4/720: symlink d2/d2f/lf7 0 2024-02-10T00:00:41.531 INFO:tasks.workunit.client.0.smithi164.stdout:4/721: dread - d2/d19/d16/d31/d7e/fc0 zero size 2024-02-10T00:00:41.532 INFO:tasks.workunit.client.0.smithi164.stdout:0/702: dwrite d6/d10/d18/d1c/f3b [0,4194304] 0 2024-02-10T00:00:41.536 INFO:tasks.workunit.client.0.smithi164.stdout:9/719: symlink d6/de/d40/dd4/lea 0 2024-02-10T00:00:41.536 INFO:tasks.workunit.client.1.smithi183.stdout:3/954: getdents d7/db/d2a/d33/dfd 0 2024-02-10T00:00:41.537 INFO:tasks.workunit.client.0.smithi164.stdout:7/752: truncate d3/d5/d2b/fe6 1004018 0 2024-02-10T00:00:41.539 INFO:tasks.workunit.client.0.smithi164.stdout:8/738: truncate d2/d12/f72 2513402 0 2024-02-10T00:00:41.539 INFO:tasks.workunit.client.0.smithi164.stdout:4/722: creat d2/d2f/d37/d41/d3d/d42/d5f/ff8 x:0 0 0 2024-02-10T00:00:41.539 INFO:tasks.workunit.client.1.smithi183.stdout:3/955: truncate d7/db/d2a/d4d/d63/fd5 758921 0 2024-02-10T00:00:41.540 INFO:tasks.workunit.client.0.smithi164.stdout:8/739: write d2/d64/f2d [3251303,103135] 0 2024-02-10T00:00:41.541 INFO:tasks.workunit.client.0.smithi164.stdout:0/703: rename d6/d10/d18/d2d/d35/d44/d49/f6d to d6/d10/d18/d2d/d35/fdc 0 2024-02-10T00:00:41.541 INFO:tasks.workunit.client.1.smithi183.stdout:3/956: creat d7/db/d2a/d4d/d63/f123 x:0 0 0 2024-02-10T00:00:41.551 INFO:tasks.workunit.client.0.smithi164.stdout:8/740: rename d2/d64/d65/d80/d32/d99/d9e/lc3 to d2/d64/d65/d80/d32/d4d/le7 0 2024-02-10T00:00:41.552 INFO:tasks.workunit.client.0.smithi164.stdout:2/801: getdents d3/da6/d7a/d8e/d36/d54 0 2024-02-10T00:00:41.553 INFO:tasks.workunit.client.0.smithi164.stdout:8/741: mkdir d2/d64/d7d/de8 0 2024-02-10T00:00:41.554 INFO:tasks.workunit.client.0.smithi164.stdout:0/704: creat d6/d10/fdd x:0 0 0 2024-02-10T00:00:41.554 INFO:tasks.workunit.client.0.smithi164.stdout:2/802: dread - d3/f17 zero size 2024-02-10T00:00:41.554 INFO:tasks.workunit.client.0.smithi164.stdout:8/742: stat d2/d64/d65/c9b 0 2024-02-10T00:00:41.556 INFO:tasks.workunit.client.0.smithi164.stdout:8/743: readlink d2/d64/lc2 0 2024-02-10T00:00:41.557 INFO:tasks.workunit.client.0.smithi164.stdout:7/753: read d3/d5/fec [511389,105187] 0 2024-02-10T00:00:41.557 INFO:tasks.workunit.client.0.smithi164.stdout:8/744: fdatasync d2/f27 0 2024-02-10T00:00:41.558 INFO:tasks.workunit.client.0.smithi164.stdout:0/705: rename d6/d10/f69 to d6/d10/d4a/d88/fde 0 2024-02-10T00:00:41.559 INFO:tasks.workunit.client.0.smithi164.stdout:1/675: truncate d1/d23/f98 1636270 0 2024-02-10T00:00:41.561 INFO:tasks.workunit.client.0.smithi164.stdout:7/754: mknod d3/d11/df3/cfc 0 2024-02-10T00:00:41.561 INFO:tasks.workunit.client.0.smithi164.stdout:2/803: dwrite d3/da6/d7a/d8e/f41 [0,4194304] 0 2024-02-10T00:00:41.562 INFO:tasks.workunit.client.0.smithi164.stdout:1/676: write d1/d13/d2b/d52/da4/dc2/dcc/fd9 [5239138,99507] 0 2024-02-10T00:00:41.564 INFO:tasks.workunit.client.0.smithi164.stdout:8/745: mkdir d2/d64/d65/d80/d32/d4d/de9 0 2024-02-10T00:00:41.565 INFO:tasks.workunit.client.0.smithi164.stdout:0/706: dread d6/d7/f24 [4194304,4194304] 0 2024-02-10T00:00:41.569 INFO:tasks.workunit.client.0.smithi164.stdout:8/746: symlink d2/d64/d65/d80/d82/lea 0 2024-02-10T00:00:41.569 INFO:tasks.workunit.client.0.smithi164.stdout:3/655: sync 2024-02-10T00:00:41.570 INFO:tasks.workunit.client.0.smithi164.stdout:6/754: dread d0/d6/d12/f4e [0,4194304] 0 2024-02-10T00:00:41.571 INFO:tasks.workunit.client.0.smithi164.stdout:0/707: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:41.575 INFO:tasks.workunit.client.0.smithi164.stdout:2/804: dread d3/d32/d4e/d27/f74 [0,4194304] 0 2024-02-10T00:00:41.576 INFO:tasks.workunit.client.0.smithi164.stdout:9/720: write d6/de/f3d [1022196,110110] 0 2024-02-10T00:00:41.579 INFO:tasks.workunit.client.0.smithi164.stdout:9/721: write d6/de/d22/d58/dba/d61/d76/f78 [1707630,43125] 0 2024-02-10T00:00:41.580 INFO:tasks.workunit.client.0.smithi164.stdout:4/723: dwrite d2/d2f/d37/d41/d3d/d42/d5f/fad [0,4194304] 0 2024-02-10T00:00:41.581 INFO:tasks.workunit.client.0.smithi164.stdout:4/724: chown d2/d2f/d37/c3c 64949882 1 2024-02-10T00:00:41.582 INFO:tasks.workunit.client.0.smithi164.stdout:8/747: chown d2/d64/d54/db9/lba 29 1 2024-02-10T00:00:41.586 INFO:tasks.workunit.client.0.smithi164.stdout:7/755: write d3/d11/f23 [4322124,113870] 0 2024-02-10T00:00:41.588 INFO:tasks.workunit.client.0.smithi164.stdout:1/677: creat d1/d1a/d41/d18/fe6 x:0 0 0 2024-02-10T00:00:41.588 INFO:tasks.workunit.client.0.smithi164.stdout:2/805: mkdir d3/da6/d7a/d119 0 2024-02-10T00:00:41.590 INFO:tasks.workunit.client.0.smithi164.stdout:5/808: sync 2024-02-10T00:00:41.591 INFO:tasks.workunit.client.0.smithi164.stdout:9/722: write d6/de/d2b/f38 [2794603,55396] 0 2024-02-10T00:00:41.592 INFO:tasks.workunit.client.0.smithi164.stdout:8/748: mknod d2/d12/ceb 0 2024-02-10T00:00:41.595 INFO:tasks.workunit.client.0.smithi164.stdout:5/809: dwrite d7/fd4 [0,4194304] 0 2024-02-10T00:00:41.596 INFO:tasks.workunit.client.0.smithi164.stdout:5/810: write d7/d17/d21/d85/fc7 [6136574,105120] 0 2024-02-10T00:00:41.598 INFO:tasks.workunit.client.0.smithi164.stdout:5/811: fsync d7/d17/d21/d23/d37/d36/d8b/fcf 0 2024-02-10T00:00:41.598 INFO:tasks.workunit.client.0.smithi164.stdout:4/725: creat d2/d2f/d37/d41/d3d/df0/ff9 x:0 0 0 2024-02-10T00:00:41.599 INFO:tasks.workunit.client.0.smithi164.stdout:8/749: chown d2/c1c 13261 1 2024-02-10T00:00:41.599 INFO:tasks.workunit.client.1.smithi183.stdout:3/957: dwrite d7/db/d2a/d33/d59/f86 [4194304,4194304] 0 2024-02-10T00:00:41.600 INFO:tasks.workunit.client.0.smithi164.stdout:3/656: rename d0/d1/d2/fad to d0/d1/d2/fd0 0 2024-02-10T00:00:41.601 INFO:tasks.workunit.client.0.smithi164.stdout:9/723: creat d6/de/d22/d58/dba/d61/d76/d82/feb x:0 0 0 2024-02-10T00:00:41.602 INFO:tasks.workunit.client.0.smithi164.stdout:9/724: dread - d6/de/d40/f95 zero size 2024-02-10T00:00:41.607 INFO:tasks.workunit.client.0.smithi164.stdout:0/708: creat d6/d7/fdf x:0 0 0 2024-02-10T00:00:41.608 INFO:tasks.workunit.client.0.smithi164.stdout:1/678: mkdir d1/d1a/d41/d18/de7 0 2024-02-10T00:00:41.612 INFO:tasks.workunit.client.0.smithi164.stdout:5/812: unlink d7/ce 0 2024-02-10T00:00:41.626 INFO:tasks.workunit.client.1.smithi183.stdout:3/958: dwrite d7/db/d2a/d33/f37 [0,4194304] 0 2024-02-10T00:00:41.629 INFO:tasks.workunit.client.1.smithi183.stdout:3/959: mkdir d7/d98/d124 0 2024-02-10T00:00:41.629 INFO:tasks.workunit.client.0.smithi164.stdout:8/750: creat d2/d64/d65/d80/d32/d68/dac/fec x:0 0 0 2024-02-10T00:00:41.630 INFO:tasks.workunit.client.0.smithi164.stdout:6/755: getdents d0/d6/d12/d14/d4b/dbf 0 2024-02-10T00:00:41.630 INFO:tasks.workunit.client.0.smithi164.stdout:2/806: rmdir d3/da6/d7a/d8e/db6/dce/d101 0 2024-02-10T00:00:41.633 INFO:tasks.workunit.client.0.smithi164.stdout:7/756: link d3/d5/d2b/dab/dda/d5d/fcc d3/d28/d51/ffd 0 2024-02-10T00:00:41.633 INFO:tasks.workunit.client.0.smithi164.stdout:9/725: creat d6/de/d22/de7/fec x:0 0 0 2024-02-10T00:00:41.635 INFO:tasks.workunit.client.0.smithi164.stdout:2/807: symlink d3/da6/d7a/d8e/d88/l11a 0 2024-02-10T00:00:41.636 INFO:tasks.workunit.client.0.smithi164.stdout:6/756: creat d0/d2b/d3a/d3d/d42/d5d/d79/dbd/ffb x:0 0 0 2024-02-10T00:00:41.637 INFO:tasks.workunit.client.0.smithi164.stdout:8/751: dwrite d2/f11 [0,4194304] 0 2024-02-10T00:00:41.637 INFO:tasks.workunit.client.0.smithi164.stdout:0/709: truncate d6/d10/d18/fca 533754 0 2024-02-10T00:00:41.637 INFO:tasks.workunit.client.1.smithi183.stdout:3/960: dwrite d7/db/d2a/f79 [0,4194304] 0 2024-02-10T00:00:41.637 INFO:tasks.workunit.client.0.smithi164.stdout:5/813: mknod d7/d17/d21/d24/dbc/c11b 0 2024-02-10T00:00:41.641 INFO:tasks.workunit.client.1.smithi183.stdout:3/961: creat d7/db/d2a/d2d/d51/db3/f125 x:0 0 0 2024-02-10T00:00:41.641 INFO:tasks.workunit.client.0.smithi164.stdout:5/814: chown d7/d17/d79/dde/f10c 153991 1 2024-02-10T00:00:41.641 INFO:tasks.workunit.client.0.smithi164.stdout:1/679: dwrite d1/d1a/d41/d18/fb6 [0,4194304] 0 2024-02-10T00:00:41.642 INFO:tasks.workunit.client.1.smithi183.stdout:3/962: read - d7/db/f96 zero size 2024-02-10T00:00:41.642 INFO:tasks.workunit.client.0.smithi164.stdout:8/752: fsync d2/d64/d65/d80/d32/d4d/f57 0 2024-02-10T00:00:41.643 INFO:tasks.workunit.client.0.smithi164.stdout:6/757: creat d0/d6/d95/dcd/ffc x:0 0 0 2024-02-10T00:00:41.644 INFO:tasks.workunit.client.1.smithi183.stdout:3/963: fdatasync d7/db/d2a/d2d/f2f 0 2024-02-10T00:00:41.644 INFO:tasks.workunit.client.0.smithi164.stdout:7/757: truncate d3/d28/fdd 1082851 0 2024-02-10T00:00:41.648 INFO:tasks.workunit.client.1.smithi183.stdout:3/964: mkdir d7/db/d2a/d4d/d63/dc4/d126 0 2024-02-10T00:00:41.648 INFO:tasks.workunit.client.1.smithi183.stdout:3/965: write d7/db/d2a/d2d/d51/f8a [1401244,33170] 0 2024-02-10T00:00:41.649 INFO:tasks.workunit.client.1.smithi183.stdout:3/966: readlink d7/d98/dc9/le2 0 2024-02-10T00:00:41.650 INFO:tasks.workunit.client.0.smithi164.stdout:8/753: chown d2/d12/c2a 3672564 1 2024-02-10T00:00:41.650 INFO:tasks.workunit.client.0.smithi164.stdout:2/808: dwrite d3/d24/fdb [0,4194304] 0 2024-02-10T00:00:41.650 INFO:tasks.workunit.client.0.smithi164.stdout:9/726: dwrite d6/de/d22/d58/dba/d61/d76/da5/fae [8388608,4194304] 0 2024-02-10T00:00:41.650 INFO:tasks.workunit.client.0.smithi164.stdout:1/680: mkdir d1/d13/d2b/d52/da4/dc2/dcc/de8 0 2024-02-10T00:00:41.653 INFO:tasks.workunit.client.0.smithi164.stdout:0/710: dwrite d6/d3a/d52/fbc [0,4194304] 0 2024-02-10T00:00:41.653 INFO:tasks.workunit.client.0.smithi164.stdout:7/758: creat d3/d11/d39/d3a/ffe x:0 0 0 2024-02-10T00:00:41.654 INFO:tasks.workunit.client.0.smithi164.stdout:0/711: chown d6/d10/d18/d2d/d35/d44/d90/d9d 361006600 1 2024-02-10T00:00:41.655 INFO:tasks.workunit.client.0.smithi164.stdout:0/712: stat d6/l13 0 2024-02-10T00:00:41.655 INFO:tasks.workunit.client.0.smithi164.stdout:6/758: mkdir d0/d2b/d3a/d3d/da7/da9/dfd 0 2024-02-10T00:00:41.656 INFO:tasks.workunit.client.0.smithi164.stdout:5/815: mknod d7/d17/d21/d24/c11c 0 2024-02-10T00:00:41.658 INFO:tasks.workunit.client.0.smithi164.stdout:2/809: dwrite d3/d32/d4e/d27/f2c [0,4194304] 0 2024-02-10T00:00:41.660 INFO:tasks.workunit.client.0.smithi164.stdout:9/727: symlink d6/de/d22/de7/led 0 2024-02-10T00:00:41.663 INFO:tasks.workunit.client.0.smithi164.stdout:6/759: rmdir d0/d6/d12/d57 39 2024-02-10T00:00:41.663 INFO:tasks.workunit.client.0.smithi164.stdout:0/713: mkdir d6/d10/d18/d2d/d39/de0 0 2024-02-10T00:00:41.663 INFO:tasks.workunit.client.0.smithi164.stdout:2/810: mkdir d3/da6/d7a/d8e/d36/d54/d11b 0 2024-02-10T00:00:41.665 INFO:tasks.workunit.client.0.smithi164.stdout:8/754: mknod d2/d64/d65/d80/d32/d4d/de9/ced 0 2024-02-10T00:00:41.667 INFO:tasks.workunit.client.0.smithi164.stdout:5/816: write d7/d17/d21/d24/fae [857814,20213] 0 2024-02-10T00:00:41.669 INFO:tasks.workunit.client.0.smithi164.stdout:9/728: dwrite d6/de/d22/d58/dba/f94 [0,4194304] 0 2024-02-10T00:00:41.669 INFO:tasks.workunit.client.0.smithi164.stdout:7/759: dwrite d3/d5/d2b/d4a/f6b [0,4194304] 0 2024-02-10T00:00:41.670 INFO:tasks.workunit.client.0.smithi164.stdout:0/714: mkdir d6/d10/d18/d2d/d35/d44/d49/d95/de1 0 2024-02-10T00:00:41.672 INFO:tasks.workunit.client.0.smithi164.stdout:8/755: creat d2/d64/d65/d80/d32/d4d/de9/fee x:0 0 0 2024-02-10T00:00:41.673 INFO:tasks.workunit.client.0.smithi164.stdout:9/729: symlink d6/de/d2b/lee 0 2024-02-10T00:00:41.674 INFO:tasks.workunit.client.0.smithi164.stdout:8/756: fdatasync d2/d81/f95 0 2024-02-10T00:00:41.674 INFO:tasks.workunit.client.0.smithi164.stdout:9/730: fsync d6/fa3 0 2024-02-10T00:00:41.675 INFO:tasks.workunit.client.0.smithi164.stdout:2/811: creat d3/d26/f11c x:0 0 0 2024-02-10T00:00:41.678 INFO:tasks.workunit.client.0.smithi164.stdout:8/757: readlink d2/d64/d65/d80/d82/lea 0 2024-02-10T00:00:41.678 INFO:tasks.workunit.client.0.smithi164.stdout:7/760: rename d3/d5/fe to d3/d11/d39/d44/d48/d50/fff 0 2024-02-10T00:00:41.679 INFO:tasks.workunit.client.0.smithi164.stdout:5/817: dwrite d7/d17/dc3/f103 [0,4194304] 0 2024-02-10T00:00:41.681 INFO:tasks.workunit.client.0.smithi164.stdout:5/818: dread - d7/daf/dce/f119 zero size 2024-02-10T00:00:41.681 INFO:tasks.workunit.client.0.smithi164.stdout:0/715: dwrite d6/d10/d18/d2d/f84 [0,4194304] 0 2024-02-10T00:00:41.681 INFO:tasks.workunit.client.0.smithi164.stdout:2/812: creat d3/da6/f11d x:0 0 0 2024-02-10T00:00:41.685 INFO:tasks.workunit.client.0.smithi164.stdout:0/716: creat d6/d10/d18/d2d/d35/fe2 x:0 0 0 2024-02-10T00:00:41.685 INFO:tasks.workunit.client.0.smithi164.stdout:0/717: write d6/d7/fdf [988162,39869] 0 2024-02-10T00:00:41.685 INFO:tasks.workunit.client.0.smithi164.stdout:2/813: dread - d3/da6/d7a/d8e/db6/dce/f86 zero size 2024-02-10T00:00:41.686 INFO:tasks.workunit.client.0.smithi164.stdout:5/819: mknod d7/df9/c11d 0 2024-02-10T00:00:41.687 INFO:tasks.workunit.client.0.smithi164.stdout:2/814: readlink d3/da6/d7a/d8e/d36/d90/lc3 0 2024-02-10T00:00:41.688 INFO:tasks.workunit.client.0.smithi164.stdout:2/815: write d3/d24/d5b/f6e [543052,68340] 0 2024-02-10T00:00:41.692 INFO:tasks.workunit.client.0.smithi164.stdout:2/816: mkdir d3/da6/d7a/d8e/d36/d54/d11e 0 2024-02-10T00:00:41.693 INFO:tasks.workunit.client.0.smithi164.stdout:2/817: chown d3/da6/d7a/d8e/f98 100 1 2024-02-10T00:00:41.693 INFO:tasks.workunit.client.0.smithi164.stdout:2/818: chown d3/d24/d5b/d109/c10c 46414043 1 2024-02-10T00:00:41.694 INFO:tasks.workunit.client.0.smithi164.stdout:5/820: link d7/d17/d21/l3c d7/d17/d21/dfb/l11e 0 2024-02-10T00:00:41.695 INFO:tasks.workunit.client.0.smithi164.stdout:2/819: symlink d3/d24/d5b/d109/l11f 0 2024-02-10T00:00:41.697 INFO:tasks.workunit.client.0.smithi164.stdout:5/821: symlink d7/d17/d21/d23/l11f 0 2024-02-10T00:00:41.699 INFO:tasks.workunit.client.0.smithi164.stdout:2/820: truncate d3/da6/d7a/d8e/ff7 852775 0 2024-02-10T00:00:41.700 INFO:tasks.workunit.client.0.smithi164.stdout:2/821: fdatasync d3/da6/d7a/d8e/d36/f83 0 2024-02-10T00:00:41.702 INFO:tasks.workunit.client.0.smithi164.stdout:5/822: dwrite d7/d17/d21/d24/dbc/d43/f53 [0,4194304] 0 2024-02-10T00:00:41.704 INFO:tasks.workunit.client.0.smithi164.stdout:2/822: mknod d3/da6/d7a/d8e/d36/d54/d11b/c120 0 2024-02-10T00:00:41.706 INFO:tasks.workunit.client.0.smithi164.stdout:5/823: symlink d7/d17/d21/dfb/l120 0 2024-02-10T00:00:41.709 INFO:tasks.workunit.client.0.smithi164.stdout:5/824: dwrite d7/d17/d21/d23/d5a/d68/d1f/dbe/f117 [0,4194304] 0 2024-02-10T00:00:41.710 INFO:tasks.workunit.client.0.smithi164.stdout:4/726: sync 2024-02-10T00:00:41.710 INFO:tasks.workunit.client.0.smithi164.stdout:5/825: readlink d7/d17/d21/l2f 0 2024-02-10T00:00:41.711 INFO:tasks.workunit.client.0.smithi164.stdout:4/727: write d2/d2f/d37/d45/fa9 [770494,67879] 0 2024-02-10T00:00:41.712 INFO:tasks.workunit.client.0.smithi164.stdout:4/728: write d2/d19/d16/fc5 [922705,123444] 0 2024-02-10T00:00:41.712 INFO:tasks.workunit.client.0.smithi164.stdout:5/826: mknod d7/d17/d21/d24/dbc/d43/c121 0 2024-02-10T00:00:41.713 INFO:tasks.workunit.client.0.smithi164.stdout:4/729: stat d2/d19/d16/d31/la1 0 2024-02-10T00:00:41.714 INFO:tasks.workunit.client.0.smithi164.stdout:5/827: chown d7/d17/d21/d23/d37/d36/df8 5544769 1 2024-02-10T00:00:41.714 INFO:tasks.workunit.client.0.smithi164.stdout:4/730: chown d2/d19/d16/d31/fb8 0 1 2024-02-10T00:00:41.728 INFO:tasks.workunit.client.0.smithi164.stdout:1/681: dread d1/fd [0,4194304] 0 2024-02-10T00:00:41.759 INFO:tasks.workunit.client.0.smithi164.stdout:9/731: dread d6/d41/d8b/d24/f45 [0,4194304] 0 2024-02-10T00:00:41.768 INFO:tasks.workunit.client.0.smithi164.stdout:9/732: dread d6/de/d22/d58/dba/d61/d76/d82/db7/f57 [0,4194304] 0 2024-02-10T00:00:41.769 INFO:tasks.workunit.client.0.smithi164.stdout:9/733: stat d6/de/d40/cc6 0 2024-02-10T00:00:41.772 INFO:tasks.workunit.client.0.smithi164.stdout:9/734: getdents d6/de/d22/d58/dba 0 2024-02-10T00:00:41.775 INFO:tasks.workunit.client.0.smithi164.stdout:9/735: dread d6/de/d40/dd4/dd9/fda [0,4194304] 0 2024-02-10T00:00:41.777 INFO:tasks.workunit.client.0.smithi164.stdout:9/736: symlink d6/de/d22/d58/dba/d61/d76/lef 0 2024-02-10T00:00:41.781 INFO:tasks.workunit.client.0.smithi164.stdout:3/657: sync 2024-02-10T00:00:41.781 INFO:tasks.workunit.client.0.smithi164.stdout:3/658: chown d0/d1/d2/d19/d27/d30/l86 14959884 1 2024-02-10T00:00:41.782 INFO:tasks.workunit.client.0.smithi164.stdout:3/659: fdatasync d0/d1/d2/d17/d37/d3f/fc6 0 2024-02-10T00:00:41.784 INFO:tasks.workunit.client.0.smithi164.stdout:3/660: symlink d0/d1/dd/dc8/ld1 0 2024-02-10T00:00:41.786 INFO:tasks.workunit.client.0.smithi164.stdout:3/661: symlink d0/d1/d2/d19/d66/ld2 0 2024-02-10T00:00:41.789 INFO:tasks.workunit.client.0.smithi164.stdout:3/662: rename d0/d1/d2/d17/d37/d3f/d4e/d6d/f7d to d0/d1/d2/d19/d66/d84/d82/fd3 0 2024-02-10T00:00:41.792 INFO:tasks.workunit.client.0.smithi164.stdout:3/663: link d0/d1/d2/d19/d66/d84/f62 d0/d1/d2/d19/d66/fd4 0 2024-02-10T00:00:41.796 INFO:tasks.workunit.client.0.smithi164.stdout:3/664: symlink d0/d1/d2/d17/d37/d9b/ld5 0 2024-02-10T00:00:41.796 INFO:tasks.workunit.client.0.smithi164.stdout:3/665: chown d0/f43 65 1 2024-02-10T00:00:41.799 INFO:tasks.workunit.client.0.smithi164.stdout:3/666: rmdir d0/d1/d2/d19/d66/d84/d82 39 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:3/667: symlink d0/d1/d2/d19/d66/ld6 0 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:5/828: sync 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:2/823: sync 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:2/824: symlink d3/da6/d7a/d119/l121 0 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:5/829: write d7/d17/d21/d24/f3d [2481068,103435] 0 2024-02-10T00:00:41.801 INFO:tasks.workunit.client.0.smithi164.stdout:2/825: stat d3/f73 0 2024-02-10T00:00:41.803 INFO:tasks.workunit.client.0.smithi164.stdout:2/826: creat d3/da6/d7a/d8e/db6/db8/f122 x:0 0 0 2024-02-10T00:00:41.805 INFO:tasks.workunit.client.0.smithi164.stdout:5/830: dwrite d7/d17/d21/d24/dbc/d43/f4e [0,4194304] 0 2024-02-10T00:00:41.808 INFO:tasks.workunit.client.0.smithi164.stdout:5/831: rmdir d7/d17/d21/d23/d5a/d68/d1f/d70 39 2024-02-10T00:00:41.809 INFO:tasks.workunit.client.0.smithi164.stdout:2/827: dwrite d3/d32/d4e/d27/fe0 [0,4194304] 0 2024-02-10T00:00:41.810 INFO:tasks.workunit.client.0.smithi164.stdout:5/832: chown d7/d17/d21/d23/d37/f102 4 1 2024-02-10T00:00:41.812 INFO:tasks.workunit.client.0.smithi164.stdout:2/828: read d3/d24/ff2 [2771479,127197] 0 2024-02-10T00:00:41.835 INFO:tasks.workunit.client.0.smithi164.stdout:5/833: dread d7/f7f [0,4194304] 0 2024-02-10T00:00:41.853 INFO:tasks.workunit.client.0.smithi164.stdout:8/758: read d2/d64/d65/d80/d32/f3e [355411,48224] 0 2024-02-10T00:00:41.856 INFO:tasks.workunit.client.0.smithi164.stdout:2/829: sync 2024-02-10T00:00:41.860 INFO:tasks.workunit.client.0.smithi164.stdout:2/830: dwrite d3/d24/d5b/dd9/f113 [0,4194304] 0 2024-02-10T00:00:41.862 INFO:tasks.workunit.client.0.smithi164.stdout:2/831: mkdir d3/d24/d5b/d123 0 2024-02-10T00:00:41.887 INFO:tasks.workunit.client.0.smithi164.stdout:4/731: dread d2/d2f/d37/d41/fdb [0,4194304] 0 2024-02-10T00:00:41.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/732: symlink d2/d5a/d94/lfa 0 2024-02-10T00:00:41.891 INFO:tasks.workunit.client.1.smithi183.stdout:3/967: dwrite d7/db/d2a/d33/d59/df7/fdc [0,4194304] 0 2024-02-10T00:00:41.891 INFO:tasks.workunit.client.0.smithi164.stdout:2/832: dread d3/da6/d7a/ffb [0,4194304] 0 2024-02-10T00:00:41.892 INFO:tasks.workunit.client.0.smithi164.stdout:4/733: mknod d2/d5a/cfb 0 2024-02-10T00:00:41.892 INFO:tasks.workunit.client.0.smithi164.stdout:2/833: write d3/fe [1292926,53817] 0 2024-02-10T00:00:41.892 INFO:tasks.workunit.client.1.smithi183.stdout:3/968: write d7/db/d2a/d33/d59/d52/f60 [2442924,117338] 0 2024-02-10T00:00:41.893 INFO:tasks.workunit.client.1.smithi183.stdout:3/969: chown d7/db/d2a/d4d/dde/c9e 66 1 2024-02-10T00:00:41.894 INFO:tasks.workunit.client.1.smithi183.stdout:3/970: chown d7/db/d2a/d4d/d63 834573 1 2024-02-10T00:00:41.895 INFO:tasks.workunit.client.1.smithi183.stdout:3/971: write d7/db/d2a/d33/d59/f8b [2110881,103667] 0 2024-02-10T00:00:41.895 INFO:tasks.workunit.client.0.smithi164.stdout:2/834: symlink d3/d24/d5b/d123/l124 0 2024-02-10T00:00:41.897 INFO:tasks.workunit.client.0.smithi164.stdout:4/734: getdents d2/d19/dc1 0 2024-02-10T00:00:41.897 INFO:tasks.workunit.client.1.smithi183.stdout:3/972: symlink d7/db/d2a/d2d/d51/dab/l127 0 2024-02-10T00:00:41.898 INFO:tasks.workunit.client.0.smithi164.stdout:2/835: creat d3/d24/df0/f125 x:0 0 0 2024-02-10T00:00:41.898 INFO:tasks.workunit.client.0.smithi164.stdout:2/836: chown d3/da6/d7a/d8e/db6/dce/dad/lf6 2 1 2024-02-10T00:00:41.899 INFO:tasks.workunit.client.1.smithi183.stdout:3/973: chown d7/db/f45 32204 1 2024-02-10T00:00:41.900 INFO:tasks.workunit.client.0.smithi164.stdout:2/837: truncate d3/f17 93122 0 2024-02-10T00:00:41.902 INFO:tasks.workunit.client.1.smithi183.stdout:3/974: getdents d7/db/d2a/d4d/dde 0 2024-02-10T00:00:41.902 INFO:tasks.workunit.client.0.smithi164.stdout:2/838: mkdir d3/da6/d7a/d8e/db6/d126 0 2024-02-10T00:00:41.903 INFO:tasks.workunit.client.0.smithi164.stdout:2/839: write d3/da6/d7a/d8e/d36/d54/f55 [4689933,9615] 0 2024-02-10T00:00:41.904 INFO:tasks.workunit.client.1.smithi183.stdout:3/975: mknod d7/db/d2a/d2d/d51/dab/da9/c128 0 2024-02-10T00:00:41.906 INFO:tasks.workunit.client.1.smithi183.stdout:3/976: creat d7/db/d2a/d33/d59/d52/f129 x:0 0 0 2024-02-10T00:00:41.906 INFO:tasks.workunit.client.0.smithi164.stdout:2/840: dread d3/d32/d4e/d27/fe0 [0,4194304] 0 2024-02-10T00:00:41.918 INFO:tasks.workunit.client.0.smithi164.stdout:2/841: dread d3/d26/d64/f75 [0,4194304] 0 2024-02-10T00:00:41.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/977: write d7/db/d2a/d33/f36 [567256,8983] 0 2024-02-10T00:00:41.923 INFO:tasks.workunit.client.1.smithi183.stdout:3/978: chown d7/db/d2a/d33/d59/fd8 18008 1 2024-02-10T00:00:41.924 INFO:tasks.workunit.client.0.smithi164.stdout:4/735: sync 2024-02-10T00:00:41.924 INFO:tasks.workunit.client.0.smithi164.stdout:6/760: dwrite d0/f1a [0,4194304] 0 2024-02-10T00:00:41.925 INFO:tasks.workunit.client.1.smithi183.stdout:3/979: chown d7/db/d2a/d2d/d51/dab 988 1 2024-02-10T00:00:41.925 INFO:tasks.workunit.client.1.smithi183.stdout:3/980: readlink d7/db/d2a/da5/lcb 0 2024-02-10T00:00:41.927 INFO:tasks.workunit.client.0.smithi164.stdout:0/718: truncate d6/d3a/d52/f53 5226615 0 2024-02-10T00:00:41.929 INFO:tasks.workunit.client.1.smithi183.stdout:3/981: dwrite d7/db/d2a/d2d/d51/fea [0,4194304] 0 2024-02-10T00:00:41.929 INFO:tasks.workunit.client.0.smithi164.stdout:2/842: dread d3/d32/d4e/f3f [0,4194304] 0 2024-02-10T00:00:41.929 INFO:tasks.workunit.client.1.smithi183.stdout:3/982: chown d7/f101 5397 1 2024-02-10T00:00:41.931 INFO:tasks.workunit.client.0.smithi164.stdout:7/761: dwrite d3/d26/d67/d98/fc1 [0,4194304] 0 2024-02-10T00:00:41.932 INFO:tasks.workunit.client.0.smithi164.stdout:7/762: fdatasync d3/d5/d9b/daa/fdb 0 2024-02-10T00:00:41.932 INFO:tasks.workunit.client.1.smithi183.stdout:3/983: unlink d7/db/d2a/d4d/l11b 0 2024-02-10T00:00:41.933 INFO:tasks.workunit.client.1.smithi183.stdout:3/984: fsync d7/db/d2a/d4d/fee 0 2024-02-10T00:00:41.934 INFO:tasks.workunit.client.0.smithi164.stdout:1/682: truncate d1/d95/fd6 4856796 0 2024-02-10T00:00:41.936 INFO:tasks.workunit.client.0.smithi164.stdout:2/843: read d3/d26/d56/fa4 [785510,125288] 0 2024-02-10T00:00:41.936 INFO:tasks.workunit.client.0.smithi164.stdout:7/763: dwrite d3/d11/d39/d44/d6f/fd3 [0,4194304] 0 2024-02-10T00:00:41.940 INFO:tasks.workunit.client.0.smithi164.stdout:9/737: dwrite d6/de/de2/fbd [0,4194304] 0 2024-02-10T00:00:41.941 INFO:tasks.workunit.client.0.smithi164.stdout:9/738: chown d6/d41/d8b/d24/d4f/lc9 54338457 1 2024-02-10T00:00:41.941 INFO:tasks.workunit.client.0.smithi164.stdout:3/668: truncate d0/d1/d2/d19/d66/fd4 5118494 0 2024-02-10T00:00:41.942 INFO:tasks.workunit.client.0.smithi164.stdout:3/669: chown d0/d1/d2/faa 5891 1 2024-02-10T00:00:41.942 INFO:tasks.workunit.client.0.smithi164.stdout:2/844: dread d3/d32/d4e/d27/fe0 [0,4194304] 0 2024-02-10T00:00:41.944 INFO:tasks.workunit.client.0.smithi164.stdout:5/834: write d7/d17/d79/fb1 [226204,118175] 0 2024-02-10T00:00:41.945 INFO:tasks.workunit.client.0.smithi164.stdout:8/759: truncate d2/d12/f24 525770 0 2024-02-10T00:00:41.945 INFO:tasks.workunit.client.0.smithi164.stdout:8/760: dread - d2/d64/f42 zero size 2024-02-10T00:00:41.953 INFO:tasks.workunit.client.0.smithi164.stdout:6/761: rename d0/f6e to d0/d2b/d3a/d3d/d42/d5d/df0/ffe 0 2024-02-10T00:00:41.954 INFO:tasks.workunit.client.0.smithi164.stdout:4/736: mknod d2/d5a/cfc 0 2024-02-10T00:00:41.958 INFO:tasks.workunit.client.0.smithi164.stdout:9/739: mknod d6/d41/cf0 0 2024-02-10T00:00:41.963 INFO:tasks.workunit.client.0.smithi164.stdout:2/845: mkdir d3/da6/d7a/d8e/db6/d126/d127 0 2024-02-10T00:00:41.964 INFO:tasks.workunit.client.0.smithi164.stdout:3/670: link d0/d1/d2/d19/f73 d0/d1/d2/d17/d37/d3f/fd7 0 2024-02-10T00:00:41.964 INFO:tasks.workunit.client.0.smithi164.stdout:5/835: symlink d7/d17/d21/d23/d37/d36/df8/l122 0 2024-02-10T00:00:41.967 INFO:tasks.workunit.client.0.smithi164.stdout:4/737: creat d2/d2f/d37/d41/dcc/ffd x:0 0 0 2024-02-10T00:00:41.967 INFO:tasks.workunit.client.0.smithi164.stdout:0/719: truncate d6/d10/d4a/d88/fc4 314264 0 2024-02-10T00:00:41.967 INFO:tasks.workunit.client.0.smithi164.stdout:4/738: stat d2/d19/d16/d31/d72/dc7 0 2024-02-10T00:00:41.969 INFO:tasks.workunit.client.0.smithi164.stdout:5/836: mknod d7/d17/d69/d92/c123 0 2024-02-10T00:00:41.970 INFO:tasks.workunit.client.0.smithi164.stdout:6/762: link d0/d2b/cf4 d0/d6/d12/d14/d4b/dbf/cff 0 2024-02-10T00:00:41.970 INFO:tasks.workunit.client.0.smithi164.stdout:5/837: write d7/d17/d21/d23/f72 [674082,80007] 0 2024-02-10T00:00:41.971 INFO:tasks.workunit.client.0.smithi164.stdout:7/764: getdents d3/d26 0 2024-02-10T00:00:41.972 INFO:tasks.workunit.client.0.smithi164.stdout:6/763: fdatasync d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 0 2024-02-10T00:00:41.973 INFO:tasks.workunit.client.0.smithi164.stdout:6/764: chown d0/d2b/d3a/d3d/d42/d5d/d79 32334649 1 2024-02-10T00:00:41.974 INFO:tasks.workunit.client.0.smithi164.stdout:3/671: creat d0/d1/dd/fd8 x:0 0 0 2024-02-10T00:00:41.974 INFO:tasks.workunit.client.0.smithi164.stdout:6/765: write d0/d6/d95/ff7 [780234,50984] 0 2024-02-10T00:00:41.976 INFO:tasks.workunit.client.0.smithi164.stdout:4/739: symlink d2/d2f/d37/d41/d3d/d56/db2/lfe 0 2024-02-10T00:00:41.976 INFO:tasks.workunit.client.0.smithi164.stdout:6/766: dread - d0/d2b/d3a/d3d/fa3 zero size 2024-02-10T00:00:41.978 INFO:tasks.workunit.client.0.smithi164.stdout:5/838: unlink d7/d17/d21/d23/d37/l49 0 2024-02-10T00:00:41.981 INFO:tasks.workunit.client.0.smithi164.stdout:7/765: rename d3/d11/df3 to d3/d5/d2b/d4a/d100 0 2024-02-10T00:00:41.982 INFO:tasks.workunit.client.1.smithi183.stdout:3/985: dread d7/db/d2a/d2d/fdf [0,4194304] 0 2024-02-10T00:00:41.983 INFO:tasks.workunit.client.1.smithi183.stdout:3/986: write d7/db/d2a/d2d/d51/dab/fe4 [535472,96445] 0 2024-02-10T00:00:41.983 INFO:tasks.workunit.client.0.smithi164.stdout:4/740: dwrite d2/d19/d16/d31/dcf/fe2 [0,4194304] 0 2024-02-10T00:00:41.984 INFO:tasks.workunit.client.0.smithi164.stdout:4/741: readlink d2/d2f/d37/d41/d3d/l7f 0 2024-02-10T00:00:41.985 INFO:tasks.workunit.client.1.smithi183.stdout:3/987: chown d7/db/f24 8341715 1 2024-02-10T00:00:41.986 INFO:tasks.workunit.client.0.smithi164.stdout:5/839: dread d7/d17/d21/d24/fae [0,4194304] 0 2024-02-10T00:00:41.987 INFO:tasks.workunit.client.0.smithi164.stdout:7/766: dread d3/d5/d9b/db7/d4b/f6d [0,4194304] 0 2024-02-10T00:00:41.989 INFO:tasks.workunit.client.1.smithi183.stdout:3/988: truncate d7/db/d2a/d33/d59/d52/ff8 262291 0 2024-02-10T00:00:41.990 INFO:tasks.workunit.client.1.smithi183.stdout:3/989: chown d7/db/f24 3772 1 2024-02-10T00:00:41.990 INFO:tasks.workunit.client.0.smithi164.stdout:3/672: rename d0/d1/d2/d19/d66/fd4 to d0/d1/d2/d17/d37/d3f/d4e/d6d/fd9 0 2024-02-10T00:00:41.990 INFO:tasks.workunit.client.0.smithi164.stdout:1/683: sync 2024-02-10T00:00:41.991 INFO:tasks.workunit.client.0.smithi164.stdout:5/840: read d7/d17/d21/d23/d37/fe5 [479134,40207] 0 2024-02-10T00:00:41.992 INFO:tasks.workunit.client.1.smithi183.stdout:3/990: creat d7/db/d2a/d2d/d51/d8f/dd3/d107/f12a x:0 0 0 2024-02-10T00:00:41.993 INFO:tasks.workunit.client.0.smithi164.stdout:4/742: mkdir d2/d2f/d37/dff 0 2024-02-10T00:00:41.996 INFO:tasks.workunit.client.0.smithi164.stdout:2/846: dread d3/d26/fae [0,4194304] 0 2024-02-10T00:00:41.997 INFO:tasks.workunit.client.0.smithi164.stdout:8/761: dread d2/f49 [0,4194304] 0 2024-02-10T00:00:41.997 INFO:tasks.workunit.client.0.smithi164.stdout:2/847: write d3/f61 [162578,24092] 0 2024-02-10T00:00:41.998 INFO:tasks.workunit.client.0.smithi164.stdout:8/762: read - d2/d64/d65/d80/d32/d4d/de9/fee zero size 2024-02-10T00:00:41.998 INFO:tasks.workunit.client.1.smithi183.stdout:3/991: dread d7/db/d2a/d2d/d51/f8a [0,4194304] 0 2024-02-10T00:00:42.000 INFO:tasks.workunit.client.1.smithi183.stdout:3/992: creat d7/db/d2a/d33/d59/d52/f12b x:0 0 0 2024-02-10T00:00:42.001 INFO:tasks.workunit.client.0.smithi164.stdout:0/720: dwrite d6/d10/d4a/d60/d6c/f5e [0,4194304] 0 2024-02-10T00:00:42.003 INFO:tasks.workunit.client.1.smithi183.stdout:3/993: mknod d7/db/d2a/d33/d59/d52/c12c 0 2024-02-10T00:00:42.003 INFO:tasks.workunit.client.0.smithi164.stdout:0/721: chown d6/d10/d4a/f74 57 1 2024-02-10T00:00:42.005 INFO:tasks.workunit.client.0.smithi164.stdout:1/684: creat d1/d13/d2b/d52/da4/dc3/dcd/fe9 x:0 0 0 2024-02-10T00:00:42.009 INFO:tasks.workunit.client.0.smithi164.stdout:2/848: mknod d3/da6/d7a/d8e/d36/c128 0 2024-02-10T00:00:42.010 INFO:tasks.workunit.client.0.smithi164.stdout:2/849: chown d3 292 1 2024-02-10T00:00:42.010 INFO:tasks.workunit.client.0.smithi164.stdout:8/763: truncate d2/d12/f48 788048 0 2024-02-10T00:00:42.010 INFO:tasks.workunit.client.0.smithi164.stdout:6/767: dread d0/d2b/d3a/d3d/f74 [0,4194304] 0 2024-02-10T00:00:42.014 INFO:tasks.workunit.client.0.smithi164.stdout:5/841: symlink d7/d17/l124 0 2024-02-10T00:00:42.014 INFO:tasks.workunit.client.0.smithi164.stdout:2/850: dwrite d3/d24/d5b/f6e [0,4194304] 0 2024-02-10T00:00:42.016 INFO:tasks.workunit.client.0.smithi164.stdout:9/740: sync 2024-02-10T00:00:42.017 INFO:tasks.workunit.client.0.smithi164.stdout:3/673: creat d0/d1/d2/d17/d37/d3f/d4e/fda x:0 0 0 2024-02-10T00:00:42.020 INFO:tasks.workunit.client.0.smithi164.stdout:5/842: dwrite d7/f19 [0,4194304] 0 2024-02-10T00:00:42.020 INFO:tasks.workunit.client.1.smithi183.stdout:3/994: truncate d7/db/d2a/d33/d59/d52/f9d 2249892 0 2024-02-10T00:00:42.022 INFO:tasks.workunit.client.0.smithi164.stdout:5/843: chown d7/d17/d21/d24/dbc/d43/f4e 671489664 1 2024-02-10T00:00:42.024 INFO:tasks.workunit.client.0.smithi164.stdout:0/722: rename d6/d10/d18/f31 to d6/d7/fe3 0 2024-02-10T00:00:42.025 INFO:tasks.workunit.client.1.smithi183.stdout:3/995: symlink d7/db/d2a/d2d/d51/d8f/dd3/d107/d110/l12d 0 2024-02-10T00:00:42.025 INFO:tasks.workunit.client.0.smithi164.stdout:5/844: write d7/d17/d21/f29 [75296,121704] 0 2024-02-10T00:00:42.026 INFO:tasks.workunit.client.0.smithi164.stdout:4/743: dwrite d2/d2f/d37/d41/d3d/d42/da2/fc2 [0,4194304] 0 2024-02-10T00:00:42.026 INFO:tasks.workunit.client.1.smithi183.stdout:3/996: stat d7/db/d2a/d2d/d51/d8f/dd3/f118 0 2024-02-10T00:00:42.027 INFO:tasks.workunit.client.1.smithi183.stdout:3/997: fsync d7/db/d2a/f44 0 2024-02-10T00:00:42.029 INFO:tasks.workunit.client.0.smithi164.stdout:9/741: dwrite d6/de/f6a [4194304,4194304] 0 2024-02-10T00:00:42.031 INFO:tasks.workunit.client.1.smithi183.stdout:3/998: unlink d7/db/d2a/f3a 0 2024-02-10T00:00:42.031 INFO:tasks.workunit.client.0.smithi164.stdout:6/768: write d0/fb [4742446,13497] 0 2024-02-10T00:00:42.034 INFO:tasks.workunit.client.0.smithi164.stdout:7/767: dwrite d3/d11/d39/d44/d6f/d75/fe7 [0,4194304] 0 2024-02-10T00:00:42.036 INFO:tasks.workunit.client.1.smithi183.stdout:3/999: getdents d7/db/d2a/d2d/d51/d8f 0 2024-02-10T00:00:42.037 INFO:tasks.workunit.client.0.smithi164.stdout:8/764: rename d2/d64/l2e to d2/d64/d54/db9/lef 0 2024-02-10T00:00:42.037 INFO:tasks.workunit.client.0.smithi164.stdout:0/723: truncate d6/d10/d18/fa8 1393145 0 2024-02-10T00:00:42.037 INFO:tasks.workunit.client.0.smithi164.stdout:3/674: truncate d0/d1/d2/d17/fa9 1731598 0 2024-02-10T00:00:42.038 INFO:tasks.workunit.client.0.smithi164.stdout:6/769: chown d0/d6/d12/d14/f8d 15145830 1 2024-02-10T00:00:42.039 INFO:tasks.workunit.client.1.smithi183.stderr:+ rm -rf -- ./tmp.9LyH0pqMLK 2024-02-10T00:00:42.040 INFO:tasks.workunit.client.0.smithi164.stdout:1/685: truncate d1/d1a/d41/f5f 836537 0 2024-02-10T00:00:42.045 INFO:tasks.workunit.client.0.smithi164.stdout:8/765: mkdir d2/d64/d65/d80/d32/d99/d9e/df0 0 2024-02-10T00:00:42.045 INFO:tasks.workunit.client.0.smithi164.stdout:9/742: symlink d6/de/d22/d58/dba/d61/lf1 0 2024-02-10T00:00:42.053 INFO:tasks.workunit.client.0.smithi164.stdout:4/744: rename d2/d2f/d37/d45/dab/dbd/fca to d2/d19/d16/d31/f100 0 2024-02-10T00:00:42.054 INFO:tasks.workunit.client.0.smithi164.stdout:4/745: chown d2/d2f/d37/d41/d3d/df0 113015 1 2024-02-10T00:00:42.054 INFO:tasks.workunit.client.0.smithi164.stdout:8/766: rmdir d2/d81 39 2024-02-10T00:00:42.055 INFO:tasks.workunit.client.0.smithi164.stdout:7/768: getdents d3/d11/d39/d3a 0 2024-02-10T00:00:42.056 INFO:tasks.workunit.client.0.smithi164.stdout:1/686: dread d1/d13/d2b/f5a [0,4194304] 0 2024-02-10T00:00:42.056 INFO:tasks.workunit.client.0.smithi164.stdout:9/743: write d6/d41/d8b/d24/f45 [4688461,1077] 0 2024-02-10T00:00:42.056 INFO:tasks.workunit.client.0.smithi164.stdout:7/769: readlink d3/d26/l85 0 2024-02-10T00:00:42.057 INFO:tasks.workunit.client.0.smithi164.stdout:4/746: creat d2/d19/dc1/f101 x:0 0 0 2024-02-10T00:00:42.059 INFO:tasks.workunit.client.0.smithi164.stdout:1/687: creat d1/d1a/d75/fea x:0 0 0 2024-02-10T00:00:42.059 INFO:tasks.workunit.client.0.smithi164.stdout:9/744: mknod d6/de/d2b/cf2 0 2024-02-10T00:00:42.060 INFO:tasks.workunit.client.0.smithi164.stdout:9/745: readlink d6/de/d2b/lb8 0 2024-02-10T00:00:42.061 INFO:tasks.workunit.client.0.smithi164.stdout:1/688: rmdir d1/d1a/d41/d18/d3a 39 2024-02-10T00:00:42.064 INFO:tasks.workunit.client.0.smithi164.stdout:7/770: link d3/d11/d39/d44/d48/fbb d3/d11/d39/d44/d48/d71/f101 0 2024-02-10T00:00:42.064 INFO:tasks.workunit.client.0.smithi164.stdout:4/747: dwrite d2/d2f/d37/d41/d3d/d56/d85/fbb [0,4194304] 0 2024-02-10T00:00:42.069 INFO:tasks.workunit.client.0.smithi164.stdout:5/845: dread d7/d17/f104 [0,4194304] 0 2024-02-10T00:00:42.070 INFO:tasks.workunit.client.0.smithi164.stdout:1/689: truncate d1/d13/d2b/d52/da4/dc3/dcd/fe9 4314 0 2024-02-10T00:00:42.071 INFO:tasks.workunit.client.0.smithi164.stdout:7/771: dwrite d3/d26/da7/ff2 [0,4194304] 0 2024-02-10T00:00:42.072 INFO:tasks.workunit.client.0.smithi164.stdout:1/690: dread - d1/d13/d2b/d52/fa5 zero size 2024-02-10T00:00:42.075 INFO:tasks.workunit.client.0.smithi164.stdout:2/851: write d3/d26/d64/fa5 [1048807,78845] 0 2024-02-10T00:00:42.084 INFO:tasks.workunit.client.0.smithi164.stdout:3/675: dwrite d0/d1/d2/d17/d37/d3f/d4e/d6d/f65 [0,4194304] 0 2024-02-10T00:00:42.084 INFO:tasks.workunit.client.0.smithi164.stdout:6/770: dwrite d0/d2b/d3a/d3d/d42/d5d/d79/fb1 [0,4194304] 0 2024-02-10T00:00:42.085 INFO:tasks.workunit.client.0.smithi164.stdout:6/771: chown d0/d6/d12/d14/f50 673 1 2024-02-10T00:00:42.086 INFO:tasks.workunit.client.0.smithi164.stdout:6/772: fdatasync d0/d3b/d56/db3/fe5 0 2024-02-10T00:00:42.086 INFO:tasks.workunit.client.0.smithi164.stdout:5/846: mknod d7/d17/d21/d24/dff/c125 0 2024-02-10T00:00:42.087 INFO:tasks.workunit.client.0.smithi164.stdout:8/767: write d2/d81/f8c [323746,114315] 0 2024-02-10T00:00:42.087 INFO:tasks.workunit.client.0.smithi164.stdout:4/748: truncate d2/d5a/d94/f96 4190591 0 2024-02-10T00:00:42.088 INFO:tasks.workunit.client.0.smithi164.stdout:7/772: creat d3/d11/f102 x:0 0 0 2024-02-10T00:00:42.090 INFO:tasks.workunit.client.0.smithi164.stdout:1/691: unlink d1/d13/f47 0 2024-02-10T00:00:42.094 INFO:tasks.workunit.client.0.smithi164.stdout:4/749: dwrite d2/d19/d16/d31/f36 [0,4194304] 0 2024-02-10T00:00:42.095 INFO:tasks.workunit.client.0.smithi164.stdout:9/746: dread d6/d41/d8b/d24/f2a [0,4194304] 0 2024-02-10T00:00:42.103 INFO:tasks.workunit.client.0.smithi164.stdout:3/676: rmdir d0 39 2024-02-10T00:00:42.107 INFO:tasks.workunit.client.0.smithi164.stdout:4/750: mknod d2/d2f/d37/d41/d3d/d56/d85/c102 0 2024-02-10T00:00:42.109 INFO:tasks.workunit.client.0.smithi164.stdout:6/773: rename d0/d6/d12/d45/c80 to d0/d2b/d3a/dd0/c100 0 2024-02-10T00:00:42.110 INFO:tasks.workunit.client.0.smithi164.stdout:8/768: mkdir d2/d64/d65/d80/d32/d93/df1 0 2024-02-10T00:00:42.111 INFO:tasks.workunit.client.0.smithi164.stdout:6/774: chown d0/d6/d12/d14/d4b/lf3 84 1 2024-02-10T00:00:42.112 INFO:tasks.workunit.client.0.smithi164.stdout:3/677: write d0/d1/d2/fd0 [59587,86797] 0 2024-02-10T00:00:42.113 INFO:tasks.workunit.client.0.smithi164.stdout:9/747: dwrite d6/de/d22/d58/dba/d61/d76/d82/fa4 [4194304,4194304] 0 2024-02-10T00:00:42.113 INFO:tasks.workunit.client.0.smithi164.stdout:6/775: fdatasync d0/f2f 0 2024-02-10T00:00:42.115 INFO:tasks.workunit.client.0.smithi164.stdout:6/776: readlink d0/d3b/d56/l5f 0 2024-02-10T00:00:42.115 INFO:tasks.workunit.client.0.smithi164.stdout:7/773: rename d3/d28/fe4 to d3/d26/d67/d98/daf/f103 0 2024-02-10T00:00:42.116 INFO:tasks.workunit.client.0.smithi164.stdout:8/769: symlink d2/d64/d65/lf2 0 2024-02-10T00:00:42.116 INFO:tasks.workunit.client.0.smithi164.stdout:2/852: dread d3/f7 [0,4194304] 0 2024-02-10T00:00:42.116 INFO:tasks.workunit.client.0.smithi164.stdout:5/847: link d7/d17/d21/dfb/l11e d7/d17/d21/d23/d37/d36/l126 0 2024-02-10T00:00:42.120 INFO:tasks.workunit.client.0.smithi164.stdout:3/678: write d0/d1/d2/d17/d37/d3f/d4e/d6d/fa3 [329952,79851] 0 2024-02-10T00:00:42.120 INFO:tasks.workunit.client.0.smithi164.stdout:9/748: mknod d6/d41/d8b/dc2/cf3 0 2024-02-10T00:00:42.120 INFO:tasks.workunit.client.0.smithi164.stdout:7/774: chown d3/d11/d39/d44/d48/d50/c69 226 1 2024-02-10T00:00:42.120 INFO:tasks.workunit.client.0.smithi164.stdout:3/679: read - d0/d1/d2/d19/d27/d5f/da5/f91 zero size 2024-02-10T00:00:42.121 INFO:tasks.workunit.client.0.smithi164.stdout:2/853: unlink d3/da6/d7a/d8e/fee 0 2024-02-10T00:00:42.122 INFO:tasks.workunit.client.0.smithi164.stdout:3/680: chown d0/d1/d2/d19/l50 1 1 2024-02-10T00:00:42.122 INFO:tasks.workunit.client.0.smithi164.stdout:4/751: getdents d2/d2f/d37/d41/d3d/df0 0 2024-02-10T00:00:42.123 INFO:tasks.workunit.client.0.smithi164.stdout:8/770: creat d2/d64/d65/d80/d32/d99/da0/ff3 x:0 0 0 2024-02-10T00:00:42.124 INFO:tasks.workunit.client.0.smithi164.stdout:0/724: sync 2024-02-10T00:00:42.125 INFO:tasks.workunit.client.0.smithi164.stdout:1/692: rename d1/d1a/c43 to d1/d1a/d75/de0/ceb 0 2024-02-10T00:00:42.126 INFO:tasks.workunit.client.0.smithi164.stdout:5/848: dwrite d7/d17/f48 [4194304,4194304] 0 2024-02-10T00:00:42.127 INFO:tasks.workunit.client.0.smithi164.stdout:8/771: write d2/d64/d65/d80/d82/fad [1165146,6881] 0 2024-02-10T00:00:42.128 INFO:tasks.workunit.client.0.smithi164.stdout:5/849: chown d7/d17/d21/l42 500403994 1 2024-02-10T00:00:42.129 INFO:tasks.workunit.client.0.smithi164.stdout:1/693: write d1/d13/d2b/d52/da4/faa [68726,36204] 0 2024-02-10T00:00:42.136 INFO:tasks.workunit.client.0.smithi164.stdout:6/777: dread d0/d6/d95/dcd/f7d [0,4194304] 0 2024-02-10T00:00:42.136 INFO:tasks.workunit.client.0.smithi164.stdout:1/694: dwrite d1/d1a/d75/fe2 [0,4194304] 0 2024-02-10T00:00:42.137 INFO:tasks.workunit.client.0.smithi164.stdout:3/681: dread d0/d1/d2/fe [4194304,4194304] 0 2024-02-10T00:00:42.140 INFO:tasks.workunit.client.0.smithi164.stdout:4/752: unlink d2/d2f/d37/f8f 0 2024-02-10T00:00:42.140 INFO:tasks.workunit.client.0.smithi164.stdout:0/725: write d6/d7/fe3 [7476266,108268] 0 2024-02-10T00:00:42.145 INFO:tasks.workunit.client.0.smithi164.stdout:0/726: dwrite d6/d10/d18/d2d/f37 [0,4194304] 0 2024-02-10T00:00:42.146 INFO:tasks.workunit.client.0.smithi164.stdout:0/727: write d6/d10/d18/d2d/f2e [2479311,85795] 0 2024-02-10T00:00:42.147 INFO:tasks.workunit.client.0.smithi164.stdout:0/728: dread - d6/d3a/d52/fc8 zero size 2024-02-10T00:00:42.148 INFO:tasks.workunit.client.0.smithi164.stdout:1/695: mknod d1/d13/d2b/cec 0 2024-02-10T00:00:42.148 INFO:tasks.workunit.client.0.smithi164.stdout:0/729: chown d6/d7/d14 1 1 2024-02-10T00:00:42.149 INFO:tasks.workunit.client.0.smithi164.stdout:3/682: creat d0/d1/d2/d17/d37/d9b/fdb x:0 0 0 2024-02-10T00:00:42.150 INFO:tasks.workunit.client.0.smithi164.stdout:4/753: mknod d2/d5a/d94/c103 0 2024-02-10T00:00:42.152 INFO:tasks.workunit.client.0.smithi164.stdout:8/772: link d2/d64/d65/d80/d32/f38 d2/d81/ff4 0 2024-02-10T00:00:42.152 INFO:tasks.workunit.client.0.smithi164.stdout:8/773: chown d2/d64/d63/f70 4 1 2024-02-10T00:00:42.153 INFO:tasks.workunit.client.0.smithi164.stdout:5/850: symlink d7/d17/d21/l127 0 2024-02-10T00:00:42.154 INFO:tasks.workunit.client.0.smithi164.stdout:7/775: truncate d3/d5/d9b/fd9 48470 0 2024-02-10T00:00:42.157 INFO:tasks.workunit.client.0.smithi164.stdout:1/696: dread d1/d13/d2b/f2e [0,4194304] 0 2024-02-10T00:00:42.159 INFO:tasks.workunit.client.0.smithi164.stdout:8/774: dwrite d2/d64/d63/fa5 [0,4194304] 0 2024-02-10T00:00:42.159 INFO:tasks.workunit.client.0.smithi164.stdout:4/754: creat d2/d2f/d37/d41/d3d/d56/db2/f104 x:0 0 0 2024-02-10T00:00:42.159 INFO:tasks.workunit.client.0.smithi164.stdout:9/749: link d6/de/d22/d58/dba/d61/d76/da5/lcf d6/lf4 0 2024-02-10T00:00:42.164 INFO:tasks.workunit.client.0.smithi164.stdout:9/750: dread d6/de/d22/d58/dba/d61/d76/d82/db7/f57 [0,4194304] 0 2024-02-10T00:00:42.166 INFO:tasks.workunit.client.0.smithi164.stdout:2/854: truncate d3/f44 3794562 0 2024-02-10T00:00:42.169 INFO:tasks.workunit.client.0.smithi164.stdout:4/755: mkdir d2/d2f/d37/d41/d3d/df0/d105 0 2024-02-10T00:00:42.169 INFO:tasks.workunit.client.0.smithi164.stdout:6/778: link d0/d6/d12/c20 d0/d2b/d3a/d3d/da7/da9/dfd/c101 0 2024-02-10T00:00:42.169 INFO:tasks.workunit.client.0.smithi164.stdout:9/751: dwrite d6/de/d40/f9f [0,4194304] 0 2024-02-10T00:00:42.171 INFO:tasks.workunit.client.0.smithi164.stdout:8/775: rename d2/d64/d65/d80/c92 to d2/d12/cf5 0 2024-02-10T00:00:42.172 INFO:tasks.workunit.client.0.smithi164.stdout:5/851: link d7/d17/d21/d23/d5a/d68/d1f/d59/ff4 d7/daf/f128 0 2024-02-10T00:00:42.174 INFO:tasks.workunit.client.0.smithi164.stdout:0/730: creat d6/d3a/fe4 x:0 0 0 2024-02-10T00:00:42.175 INFO:tasks.workunit.client.0.smithi164.stdout:0/731: chown d6/d3a 472093 1 2024-02-10T00:00:42.176 INFO:tasks.workunit.client.0.smithi164.stdout:4/756: dwrite d2/d2f/d37/d41/d3d/d42/f63 [4194304,4194304] 0 2024-02-10T00:00:42.176 INFO:tasks.workunit.client.0.smithi164.stdout:0/732: readlink d6/d7/d14/l16 0 2024-02-10T00:00:42.177 INFO:tasks.workunit.client.0.smithi164.stdout:6/779: creat d0/d2b/d3a/d3d/d42/d5d/f102 x:0 0 0 2024-02-10T00:00:42.178 INFO:tasks.workunit.client.0.smithi164.stdout:6/780: stat d0/l15 0 2024-02-10T00:00:42.178 INFO:tasks.workunit.client.0.smithi164.stdout:8/776: chown d2/d64/d54/d71/d78/ce6 36922 1 2024-02-10T00:00:42.181 INFO:tasks.workunit.client.0.smithi164.stdout:2/855: unlink d3/da6/d7a/d8e/d8a/dc8/leb 0 2024-02-10T00:00:42.182 INFO:tasks.workunit.client.0.smithi164.stdout:2/856: write d3/da6/d7a/d8e/d36/f83 [1311123,32245] 0 2024-02-10T00:00:42.182 INFO:tasks.workunit.client.0.smithi164.stdout:0/733: mknod d6/d10/d18/d1c/ce5 0 2024-02-10T00:00:42.184 INFO:tasks.workunit.client.0.smithi164.stdout:3/683: dread d0/d1/d2/d17/d37/d3f/d4e/d6d/fa7 [0,4194304] 0 2024-02-10T00:00:42.193 INFO:tasks.workunit.client.0.smithi164.stdout:8/777: unlink d2/d64/l43 0 2024-02-10T00:00:42.195 INFO:tasks.workunit.client.0.smithi164.stdout:6/781: dread d0/d2b/f36 [0,4194304] 0 2024-02-10T00:00:42.197 INFO:tasks.workunit.client.0.smithi164.stdout:4/757: symlink d2/l106 0 2024-02-10T00:00:42.199 INFO:tasks.workunit.client.0.smithi164.stdout:0/734: mkdir d6/d7/d14/da6/de6 0 2024-02-10T00:00:42.199 INFO:tasks.workunit.client.0.smithi164.stdout:7/776: sync 2024-02-10T00:00:42.199 INFO:tasks.workunit.client.0.smithi164.stdout:2/857: mknod d3/da6/d7a/d8e/db6/db8/c129 0 2024-02-10T00:00:42.200 INFO:tasks.workunit.client.0.smithi164.stdout:7/777: read d3/d5/d2b/dab/dda/d5d/fcc [6663,44744] 0 2024-02-10T00:00:42.203 INFO:tasks.workunit.client.0.smithi164.stdout:9/752: link d6/d41/d8b/c92 d6/de/d22/d58/dba/d61/d76/da5/cf5 0 2024-02-10T00:00:42.204 INFO:tasks.workunit.client.0.smithi164.stdout:5/852: truncate d7/d17/d21/ff3 797631 0 2024-02-10T00:00:42.205 INFO:tasks.workunit.client.0.smithi164.stdout:8/778: fdatasync d2/d64/d65/d80/d32/d4d/f6b 0 2024-02-10T00:00:42.205 INFO:tasks.workunit.client.0.smithi164.stdout:0/735: dwrite d6/d10/d18/d2d/d35/d44/f98 [0,4194304] 0 2024-02-10T00:00:42.206 INFO:tasks.workunit.client.0.smithi164.stdout:6/782: write d0/d2b/d3a/d3d/d42/d5d/df0/ffe [4549308,68245] 0 2024-02-10T00:00:42.208 INFO:tasks.workunit.client.0.smithi164.stdout:8/779: write d2/d64/f97 [605924,65278] 0 2024-02-10T00:00:42.208 INFO:tasks.workunit.client.0.smithi164.stdout:6/783: dread - d0/d3b/d56/db3/fe5 zero size 2024-02-10T00:00:42.209 INFO:tasks.workunit.client.0.smithi164.stdout:7/778: mknod d3/d5/d2b/dab/c104 0 2024-02-10T00:00:42.210 INFO:tasks.workunit.client.0.smithi164.stdout:3/684: truncate d0/d1/d2/d19/d27/f2c 3084935 0 2024-02-10T00:00:42.210 INFO:tasks.workunit.client.0.smithi164.stdout:8/780: stat d2/d64/d54/d71/d78/ce6 0 2024-02-10T00:00:42.211 INFO:tasks.workunit.client.0.smithi164.stdout:1/697: dread d1/d1a/fa3 [0,4194304] 0 2024-02-10T00:00:42.212 INFO:tasks.workunit.client.0.smithi164.stdout:8/781: fdatasync d2/d64/d65/fbc 0 2024-02-10T00:00:42.213 INFO:tasks.workunit.client.0.smithi164.stdout:1/698: write d1/d23/f7d [924163,34985] 0 2024-02-10T00:00:42.216 INFO:tasks.workunit.client.0.smithi164.stdout:4/758: mknod d2/d19/d16/d31/c107 0 2024-02-10T00:00:42.219 INFO:tasks.workunit.client.0.smithi164.stdout:6/784: unlink d0/d6/d12/f1f 0 2024-02-10T00:00:42.219 INFO:tasks.workunit.client.0.smithi164.stdout:9/753: dwrite d6/d41/d8b/d24/f2a [8388608,4194304] 0 2024-02-10T00:00:42.220 INFO:tasks.workunit.client.0.smithi164.stdout:9/754: fdatasync d6/de/d22/f30 0 2024-02-10T00:00:42.221 INFO:tasks.workunit.client.0.smithi164.stdout:1/699: fsync d1/d13/d2b/d52/db7/fa7 0 2024-02-10T00:00:42.224 INFO:tasks.workunit.client.0.smithi164.stdout:2/858: dread d3/d32/d4e/d27/f28 [0,4194304] 0 2024-02-10T00:00:42.225 INFO:tasks.workunit.client.0.smithi164.stdout:6/785: write d0/d2b/d3a/d3d/f74 [2736155,65208] 0 2024-02-10T00:00:42.231 INFO:tasks.workunit.client.0.smithi164.stdout:4/759: unlink d2/d2f/d37/d41/d3d/d42/d5f/fad 0 2024-02-10T00:00:42.231 INFO:tasks.workunit.client.0.smithi164.stdout:1/700: creat d1/d13/d2b/d52/da4/dc2/dcc/fed x:0 0 0 2024-02-10T00:00:42.233 INFO:tasks.workunit.client.0.smithi164.stdout:2/859: unlink d3/d26/d56/f7c 0 2024-02-10T00:00:42.233 INFO:tasks.workunit.client.0.smithi164.stdout:5/853: write d7/d17/d21/f58 [2567214,111731] 0 2024-02-10T00:00:42.234 INFO:tasks.workunit.client.0.smithi164.stdout:3/685: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:42.237 INFO:tasks.workunit.client.0.smithi164.stdout:2/860: dread d3/d26/d64/f75 [0,4194304] 0 2024-02-10T00:00:42.237 INFO:tasks.workunit.client.0.smithi164.stdout:3/686: write d0/d1/d2/d19/f56 [4568364,104889] 0 2024-02-10T00:00:42.238 INFO:tasks.workunit.client.0.smithi164.stdout:9/755: rename d6/d41/d8b/d24/f4d to d6/de/d22/d58/dba/d61/ff6 0 2024-02-10T00:00:42.239 INFO:tasks.workunit.client.0.smithi164.stdout:0/736: dread d6/d10/d18/d2d/f5d [0,4194304] 0 2024-02-10T00:00:42.240 INFO:tasks.workunit.client.0.smithi164.stdout:2/861: write d3/da6/d7a/d8e/d36/d54/ff5 [1169128,103833] 0 2024-02-10T00:00:42.241 INFO:tasks.workunit.client.0.smithi164.stdout:8/782: dread d2/d64/f2f [0,4194304] 0 2024-02-10T00:00:42.242 INFO:tasks.workunit.client.0.smithi164.stdout:1/701: truncate d1/d1a/d41/fe 3153444 0 2024-02-10T00:00:42.244 INFO:tasks.workunit.client.0.smithi164.stdout:7/779: truncate d3/d11/d39/d44/fad 1668225 0 2024-02-10T00:00:42.246 INFO:tasks.workunit.client.0.smithi164.stdout:9/756: dwrite d6/d41/fb1 [0,4194304] 0 2024-02-10T00:00:42.248 INFO:tasks.workunit.client.0.smithi164.stdout:7/780: chown d3/d5/d2b/d4a/d100/cf5 3573673 1 2024-02-10T00:00:42.249 INFO:tasks.workunit.client.0.smithi164.stdout:8/783: dwrite d2/f39 [4194304,4194304] 0 2024-02-10T00:00:42.253 INFO:tasks.workunit.client.0.smithi164.stdout:0/737: rmdir d6/d3a/d52 39 2024-02-10T00:00:42.255 INFO:tasks.workunit.client.0.smithi164.stdout:4/760: dwrite d2/d2f/d37/d41/f46 [0,4194304] 0 2024-02-10T00:00:42.256 INFO:tasks.workunit.client.0.smithi164.stdout:8/784: dwrite d2/d12/f3f [4194304,4194304] 0 2024-02-10T00:00:42.258 INFO:tasks.workunit.client.0.smithi164.stdout:5/854: truncate d7/d17/d21/d24/feb 100286 0 2024-02-10T00:00:42.259 INFO:tasks.workunit.client.0.smithi164.stdout:7/781: mknod d3/d5/d2b/dab/dda/d5d/dd5/c105 0 2024-02-10T00:00:42.262 INFO:tasks.workunit.client.0.smithi164.stdout:0/738: dwrite d6/d10/d4a/d60/f6e [0,4194304] 0 2024-02-10T00:00:42.263 INFO:tasks.workunit.client.0.smithi164.stdout:1/702: truncate d1/d13/d2b/d52/da4/dc2/fcf 283539 0 2024-02-10T00:00:42.265 INFO:tasks.workunit.client.0.smithi164.stdout:4/761: symlink d2/d2f/d37/d41/l108 0 2024-02-10T00:00:42.266 INFO:tasks.workunit.client.0.smithi164.stdout:0/739: creat d6/d10/d4a/dc7/fe7 x:0 0 0 2024-02-10T00:00:42.268 INFO:tasks.workunit.client.0.smithi164.stdout:6/786: dread d0/d2b/d3a/d3d/d42/d5d/df0/ffe [4194304,4194304] 0 2024-02-10T00:00:42.268 INFO:tasks.workunit.client.0.smithi164.stdout:5/855: symlink d7/d17/d21/d23/d5a/d68/d1f/d110/l129 0 2024-02-10T00:00:42.268 INFO:tasks.workunit.client.0.smithi164.stdout:9/757: getdents d6/de/d22/d58/dba 0 2024-02-10T00:00:42.269 INFO:tasks.workunit.client.0.smithi164.stdout:5/856: chown d7/f7f 60 1 2024-02-10T00:00:42.271 INFO:tasks.workunit.client.0.smithi164.stdout:8/785: read d2/d64/f83 [757870,23264] 0 2024-02-10T00:00:42.273 INFO:tasks.workunit.client.0.smithi164.stdout:4/762: symlink d2/d19/d16/d31/d83/l109 0 2024-02-10T00:00:42.275 INFO:tasks.workunit.client.0.smithi164.stdout:9/758: mknod d6/de/d22/d69/cf7 0 2024-02-10T00:00:42.276 INFO:tasks.workunit.client.0.smithi164.stdout:6/787: symlink d0/d2b/d3a/d3d/d42/d5d/d79/l103 0 2024-02-10T00:00:42.277 INFO:tasks.workunit.client.0.smithi164.stdout:5/857: stat d7/d17/d79/d7b/f95 0 2024-02-10T00:00:42.279 INFO:tasks.workunit.client.0.smithi164.stdout:9/759: unlink d6/de/d40/f56 0 2024-02-10T00:00:42.282 INFO:tasks.workunit.client.0.smithi164.stdout:5/858: dwrite d7/d17/d69/f6a [0,4194304] 0 2024-02-10T00:00:42.282 INFO:tasks.workunit.client.0.smithi164.stdout:9/760: write d6/de/d40/d74/fcc [1014309,66036] 0 2024-02-10T00:00:42.282 INFO:tasks.workunit.client.0.smithi164.stdout:9/761: readlink d6/d41/d8b/le4 0 2024-02-10T00:00:42.283 INFO:tasks.workunit.client.0.smithi164.stdout:6/788: unlink d0/d3b/faf 0 2024-02-10T00:00:42.284 INFO:tasks.workunit.client.0.smithi164.stdout:1/703: getdents d1/d1a/d41/d18/d3a 0 2024-02-10T00:00:42.286 INFO:tasks.workunit.client.0.smithi164.stdout:4/763: rename d2/d2f/d37/d41/cd3 to d2/d2f/d37/d41/c10a 0 2024-02-10T00:00:42.286 INFO:tasks.workunit.client.0.smithi164.stdout:5/859: fsync d7/d17/d21/d24/fae 0 2024-02-10T00:00:42.287 INFO:tasks.workunit.client.0.smithi164.stdout:9/762: dwrite d6/fc [0,4194304] 0 2024-02-10T00:00:42.288 INFO:tasks.workunit.client.0.smithi164.stdout:8/786: getdents d2/d64/d65/d80/d32/d4d 0 2024-02-10T00:00:42.289 INFO:tasks.workunit.client.0.smithi164.stdout:6/789: creat d0/d6/d95/f104 x:0 0 0 2024-02-10T00:00:42.292 INFO:tasks.workunit.client.0.smithi164.stdout:1/704: creat d1/d23/d70/fee x:0 0 0 2024-02-10T00:00:42.292 INFO:tasks.workunit.client.0.smithi164.stdout:4/764: mknod d2/d19/d16/d31/d83/c10b 0 2024-02-10T00:00:42.307 INFO:tasks.workunit.client.0.smithi164.stdout:9/763: mknod d6/de/de2/cf8 0 2024-02-10T00:00:42.307 INFO:tasks.workunit.client.0.smithi164.stdout:6/790: unlink d0/d2b/d3a/d3d/d42/d5d/d79/dbd/fe6 0 2024-02-10T00:00:42.307 INFO:tasks.workunit.client.0.smithi164.stdout:3/687: write d0/d1/d2/d17/d37/f90 [2946668,71769] 0 2024-02-10T00:00:42.308 INFO:tasks.workunit.client.0.smithi164.stdout:6/791: fdatasync d0/d6/d12/ff8 0 2024-02-10T00:00:42.310 INFO:tasks.workunit.client.0.smithi164.stdout:9/764: mknod d6/de/d22/d58/dba/cf9 0 2024-02-10T00:00:42.311 INFO:tasks.workunit.client.0.smithi164.stdout:8/787: truncate d2/f8a 721724 0 2024-02-10T00:00:42.312 INFO:tasks.workunit.client.0.smithi164.stdout:8/788: chown d2/d64/d54/db9 6 1 2024-02-10T00:00:42.312 INFO:tasks.workunit.client.0.smithi164.stdout:6/792: mkdir d0/d2b/d3a/dd0/d93/d105 0 2024-02-10T00:00:42.313 INFO:tasks.workunit.client.0.smithi164.stdout:6/793: readlink d0/d3b/d56/l5f 0 2024-02-10T00:00:42.314 INFO:tasks.workunit.client.0.smithi164.stdout:6/794: stat d0/d2b/d3a/d3d/d42/ca0 0 2024-02-10T00:00:42.315 INFO:tasks.workunit.client.0.smithi164.stdout:4/765: creat d2/d19/d16/d31/f10c x:0 0 0 2024-02-10T00:00:42.316 INFO:tasks.workunit.client.0.smithi164.stdout:4/766: fdatasync d2/d2f/d37/d41/f35 0 2024-02-10T00:00:42.317 INFO:tasks.workunit.client.0.smithi164.stdout:8/789: dwrite d2/f25 [0,4194304] 0 2024-02-10T00:00:42.317 INFO:tasks.workunit.client.0.smithi164.stdout:3/688: rename d0/d1/d2/d17/d37/d3f/d4e/d6d/fd9 to d0/d1/d2/d17/d37/fdc 0 2024-02-10T00:00:42.319 INFO:tasks.workunit.client.0.smithi164.stdout:9/765: mkdir d6/de/dfa 0 2024-02-10T00:00:42.322 INFO:tasks.workunit.client.0.smithi164.stdout:0/740: write f1 [153412,69643] 0 2024-02-10T00:00:42.333 INFO:tasks.workunit.client.0.smithi164.stdout:7/782: dread d3/d28/f3b [0,4194304] 0 2024-02-10T00:00:42.337 INFO:tasks.workunit.client.0.smithi164.stdout:4/767: dread d2/d19/d16/d31/d4b/f8c [0,4194304] 0 2024-02-10T00:00:42.337 INFO:tasks.workunit.client.0.smithi164.stdout:2/862: dread d3/f44 [0,4194304] 0 2024-02-10T00:00:42.338 INFO:tasks.workunit.client.0.smithi164.stdout:7/783: creat d3/d5/d2b/dab/dda/d5d/f106 x:0 0 0 2024-02-10T00:00:42.340 INFO:tasks.workunit.client.0.smithi164.stdout:7/784: chown d3/d5/d2b/dab/dda/d5d/l87 62182 1 2024-02-10T00:00:42.340 INFO:tasks.workunit.client.0.smithi164.stdout:3/689: write d0/d1/d3c/f7c [2830811,57889] 0 2024-02-10T00:00:42.340 INFO:tasks.workunit.client.0.smithi164.stdout:0/741: mknod d6/d10/d18/d2d/d39/dcf/ce8 0 2024-02-10T00:00:42.341 INFO:tasks.workunit.client.0.smithi164.stdout:7/785: readlink d3/d5/d2b/dab/dda/leb 0 2024-02-10T00:00:42.342 INFO:tasks.workunit.client.0.smithi164.stdout:4/768: unlink d2/l7 0 2024-02-10T00:00:42.343 INFO:tasks.workunit.client.0.smithi164.stdout:9/766: creat d6/de/d22/d58/dba/d61/ffb x:0 0 0 2024-02-10T00:00:42.343 INFO:tasks.workunit.client.0.smithi164.stdout:6/795: dread d0/d6/d12/d14/f61 [0,4194304] 0 2024-02-10T00:00:42.343 INFO:tasks.workunit.client.0.smithi164.stdout:3/690: chown d0/d1/d2/d17/d37/d3f/d4e/c5b 120554699 1 2024-02-10T00:00:42.343 INFO:tasks.workunit.client.0.smithi164.stdout:7/786: readlink d3/d5/d2b/d4a/l5c 0 2024-02-10T00:00:42.344 INFO:tasks.workunit.client.0.smithi164.stdout:2/863: symlink d3/da6/d7a/d8e/d36/d90/l12a 0 2024-02-10T00:00:42.345 INFO:tasks.workunit.client.0.smithi164.stdout:8/790: rename d2/f67 to d2/d64/d54/ff6 0 2024-02-10T00:00:42.346 INFO:tasks.workunit.client.0.smithi164.stdout:6/796: chown d0/d3b/d56/db3/fde 94855207 1 2024-02-10T00:00:42.347 INFO:tasks.workunit.client.0.smithi164.stdout:4/769: readlink d2/l3 0 2024-02-10T00:00:42.349 INFO:tasks.workunit.client.0.smithi164.stdout:8/791: chown d2/c1b 6 1 2024-02-10T00:00:42.349 INFO:tasks.workunit.client.0.smithi164.stdout:5/860: sync 2024-02-10T00:00:42.350 INFO:tasks.workunit.client.0.smithi164.stdout:3/691: creat d0/d1/d2/d19/d27/d5f/da5/d94/fdd x:0 0 0 2024-02-10T00:00:42.353 INFO:tasks.workunit.client.0.smithi164.stdout:9/767: dwrite d6/de/d22/f26 [4194304,4194304] 0 2024-02-10T00:00:42.354 INFO:tasks.workunit.client.0.smithi164.stdout:1/705: dread d1/d13/d2b/d52/da4/dc3/dcd/f77 [4194304,4194304] 0 2024-02-10T00:00:42.354 INFO:tasks.workunit.client.0.smithi164.stdout:3/692: stat d0/d1/d2/d19/d27/d5f/da5/d94/fdd 0 2024-02-10T00:00:42.358 INFO:tasks.workunit.client.0.smithi164.stdout:0/742: getdents d6/d7/d14 0 2024-02-10T00:00:42.358 INFO:tasks.workunit.client.0.smithi164.stdout:4/770: dwrite d2/d2f/d37/d41/d3d/fa5 [0,4194304] 0 2024-02-10T00:00:42.359 INFO:tasks.workunit.client.0.smithi164.stdout:7/787: rename d3/d5/d2b/dab to d3/d11/d39/d44/dbd/d107 0 2024-02-10T00:00:42.359 INFO:tasks.workunit.client.0.smithi164.stdout:6/797: rmdir d0/d2b/d3a/d3d/d42/d5d/d79 39 2024-02-10T00:00:42.363 INFO:tasks.workunit.client.0.smithi164.stdout:4/771: write d2/d19/d16/d31/d57/f59 [3846797,60712] 0 2024-02-10T00:00:42.363 INFO:tasks.workunit.client.0.smithi164.stdout:8/792: dwrite d2/d64/d65/d80/fe0 [0,4194304] 0 2024-02-10T00:00:42.363 INFO:tasks.workunit.client.0.smithi164.stdout:5/861: symlink d7/d17/d69/d92/da8/dcd/dd3/l12a 0 2024-02-10T00:00:42.363 INFO:tasks.workunit.client.0.smithi164.stdout:6/798: dread - d0/d6/d12/d45/fc4 zero size 2024-02-10T00:00:42.367 INFO:tasks.workunit.client.0.smithi164.stdout:3/693: rename d0/d1/d2/d17/d37/f69 to d0/d1/d2/d19/d66/fde 0 2024-02-10T00:00:42.369 INFO:tasks.workunit.client.0.smithi164.stdout:7/788: mknod d3/d5/d9b/c108 0 2024-02-10T00:00:42.370 INFO:tasks.workunit.client.0.smithi164.stdout:3/694: chown d0/d1/d2/d17/d37/d3f 2799951 1 2024-02-10T00:00:42.371 INFO:tasks.workunit.client.0.smithi164.stdout:2/864: getdents d3/da6/d7a/d8e/d36 0 2024-02-10T00:00:42.371 INFO:tasks.workunit.client.0.smithi164.stdout:7/789: readlink d3/d5/d9b/lac 0 2024-02-10T00:00:42.372 INFO:tasks.workunit.client.0.smithi164.stdout:5/862: dwrite d7/d17/d21/d24/dbc/d43/f6e [0,4194304] 0 2024-02-10T00:00:42.374 INFO:tasks.workunit.client.0.smithi164.stdout:7/790: chown d3/d11/d39/d44/d6f/ffa 519955 1 2024-02-10T00:00:42.375 INFO:tasks.workunit.client.0.smithi164.stdout:4/772: creat d2/d19/d16/d31/d7e/d81/f10d x:0 0 0 2024-02-10T00:00:42.375 INFO:tasks.workunit.client.0.smithi164.stdout:1/706: dread d1/d13/d2b/d52/da4/dc2/dcc/fd9 [4194304,4194304] 0 2024-02-10T00:00:42.376 INFO:tasks.workunit.client.0.smithi164.stdout:0/743: fdatasync d6/d10/d18/fca 0 2024-02-10T00:00:42.387 INFO:tasks.workunit.client.0.smithi164.stdout:6/799: symlink d0/d6/d12/d57/l106 0 2024-02-10T00:00:42.390 INFO:tasks.workunit.client.0.smithi164.stdout:2/865: dwrite d3/fd [0,4194304] 0 2024-02-10T00:00:42.390 INFO:tasks.workunit.client.0.smithi164.stdout:4/773: write d2/d2f/d37/d41/d3d/d56/d85/fbb [2054208,32663] 0 2024-02-10T00:00:42.391 INFO:tasks.workunit.client.0.smithi164.stdout:0/744: unlink d6/d7/d14/c28 0 2024-02-10T00:00:42.392 INFO:tasks.workunit.client.0.smithi164.stdout:8/793: dwrite d2/d64/d65/d80/d32/d93/db7/fcf [0,4194304] 0 2024-02-10T00:00:42.394 INFO:tasks.workunit.client.0.smithi164.stdout:2/866: write d3/d26/fae [4595471,85919] 0 2024-02-10T00:00:42.394 INFO:tasks.workunit.client.0.smithi164.stdout:1/707: symlink d1/d23/d37/da9/dd1/ddb/lef 0 2024-02-10T00:00:42.394 INFO:tasks.workunit.client.0.smithi164.stdout:9/768: dread d6/de/de2/fbd [0,4194304] 0 2024-02-10T00:00:42.396 INFO:tasks.workunit.client.0.smithi164.stdout:1/708: chown d1/d1a/d41/d18/c69 48316 1 2024-02-10T00:00:42.396 INFO:tasks.workunit.client.0.smithi164.stdout:4/774: write d2/d19/d16/d31/d4b/f8c [136295,65460] 0 2024-02-10T00:00:42.398 INFO:tasks.workunit.client.0.smithi164.stdout:8/794: unlink d2/d64/d54/c74 0 2024-02-10T00:00:42.398 INFO:tasks.workunit.client.0.smithi164.stdout:4/775: dread - d2/d2f/d37/d41/fef zero size 2024-02-10T00:00:42.399 INFO:tasks.workunit.client.0.smithi164.stdout:9/769: mkdir d6/de/d22/d58/dba/d61/d76/d82/dfc 0 2024-02-10T00:00:42.401 INFO:tasks.workunit.client.0.smithi164.stdout:4/776: write d2/d19/d16/d31/d7e/d81/f10d [105001,51012] 0 2024-02-10T00:00:42.401 INFO:tasks.workunit.client.0.smithi164.stdout:9/770: chown d6/de/d40/f88 1001 1 2024-02-10T00:00:42.401 INFO:tasks.workunit.client.0.smithi164.stdout:4/777: read - d2/d19/dc1/ff6 zero size 2024-02-10T00:00:42.401 INFO:tasks.workunit.client.0.smithi164.stdout:1/709: rmdir d1/d64/dc7 39 2024-02-10T00:00:42.405 INFO:tasks.workunit.client.0.smithi164.stdout:4/778: rmdir d2/d19/d16/d31/d83 39 2024-02-10T00:00:42.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/867: creat d3/d32/d4e/d27/f12b x:0 0 0 2024-02-10T00:00:42.406 INFO:tasks.workunit.client.0.smithi164.stdout:9/771: read d6/de/d2b/f37 [412632,105170] 0 2024-02-10T00:00:42.407 INFO:tasks.workunit.client.0.smithi164.stdout:0/745: read d6/d7/fc [2110676,55808] 0 2024-02-10T00:00:42.407 INFO:tasks.workunit.client.0.smithi164.stdout:9/772: stat d6/d41/d8b/f2c 0 2024-02-10T00:00:42.411 INFO:tasks.workunit.client.0.smithi164.stdout:8/795: rename d2/d64/d54/db9/lef to d2/d64/d65/d80/d32/d93/lf7 0 2024-02-10T00:00:42.413 INFO:tasks.workunit.client.0.smithi164.stdout:4/779: getdents d2/d2f/d37/d41/d69 0 2024-02-10T00:00:42.414 INFO:tasks.workunit.client.0.smithi164.stdout:9/773: dwrite d6/de/f3d [0,4194304] 0 2024-02-10T00:00:42.415 INFO:tasks.workunit.client.0.smithi164.stdout:9/774: stat d6/d41/d8b/f2e 0 2024-02-10T00:00:42.419 INFO:tasks.workunit.client.0.smithi164.stdout:4/780: dwrite d2/d19/d16/d31/d6d/fd5 [0,4194304] 0 2024-02-10T00:00:42.420 INFO:tasks.workunit.client.0.smithi164.stdout:4/781: chown d2/d19/d16/d31/d4b/f8c 0 1 2024-02-10T00:00:42.432 INFO:tasks.workunit.client.0.smithi164.stdout:3/695: dread d0/d1/d2/d19/d66/d84/f88 [0,4194304] 0 2024-02-10T00:00:42.434 INFO:tasks.workunit.client.0.smithi164.stdout:3/696: write d0/d1/d2/d17/d37/d3f/d4e/d6d/f65 [4452272,53551] 0 2024-02-10T00:00:42.434 INFO:tasks.workunit.client.0.smithi164.stdout:8/796: link d2/d64/d54/db9/fde d2/d64/d54/db9/ff8 0 2024-02-10T00:00:42.435 INFO:tasks.workunit.client.0.smithi164.stdout:3/697: chown d0/d1/d2/d19/d27/lb6 29062 1 2024-02-10T00:00:42.437 INFO:tasks.workunit.client.0.smithi164.stdout:3/698: chown d0/d3b/c7b 0 1 2024-02-10T00:00:42.439 INFO:tasks.workunit.client.0.smithi164.stdout:7/791: dwrite d3/d28/d51/ffd [0,4194304] 0 2024-02-10T00:00:42.439 INFO:tasks.workunit.client.0.smithi164.stdout:4/782: creat d2/f10e x:0 0 0 2024-02-10T00:00:42.442 INFO:tasks.workunit.client.0.smithi164.stdout:8/797: rename d2/d64/d65/d80/fb1 to d2/d64/d65/d80/d32/d93/db7/ff9 0 2024-02-10T00:00:42.443 INFO:tasks.workunit.client.0.smithi164.stdout:6/800: dread d0/d6/d12/d57/f58 [0,4194304] 0 2024-02-10T00:00:42.444 INFO:tasks.workunit.client.0.smithi164.stdout:4/783: mkdir d2/d19/d10f 0 2024-02-10T00:00:42.444 INFO:tasks.workunit.client.0.smithi164.stdout:3/699: symlink d0/d1/d2/d19/d66/d84/ldf 0 2024-02-10T00:00:42.445 INFO:tasks.workunit.client.0.smithi164.stdout:4/784: fsync d2/d2f/d37/d41/f46 0 2024-02-10T00:00:42.451 INFO:tasks.workunit.client.0.smithi164.stdout:6/801: mknod d0/d6/d12/c107 0 2024-02-10T00:00:42.453 INFO:tasks.workunit.client.0.smithi164.stdout:3/700: creat d0/d1/d2/d17/fe0 x:0 0 0 2024-02-10T00:00:42.456 INFO:tasks.workunit.client.0.smithi164.stdout:2/868: dread d3/d24/f52 [0,4194304] 0 2024-02-10T00:00:42.456 INFO:tasks.workunit.client.0.smithi164.stdout:3/701: write d0/d1/d2/d19/f56 [3121539,62637] 0 2024-02-10T00:00:42.457 INFO:tasks.workunit.client.0.smithi164.stdout:3/702: dread - d0/d1/fbe zero size 2024-02-10T00:00:42.458 INFO:tasks.workunit.client.0.smithi164.stdout:9/775: dread d6/de/d22/d58/dba/d61/d76/f78 [0,4194304] 0 2024-02-10T00:00:42.458 INFO:tasks.workunit.client.0.smithi164.stdout:3/703: write d0/d1/d2/f8e [355921,43501] 0 2024-02-10T00:00:42.461 INFO:tasks.workunit.client.0.smithi164.stdout:9/776: rename d6/d41/d8b/f1f to d6/de/ffd 0 2024-02-10T00:00:42.483 INFO:tasks.workunit.client.0.smithi164.stdout:5/863: sync 2024-02-10T00:00:42.496 INFO:tasks.workunit.client.0.smithi164.stdout:9/777: fsync d6/d41/d8b/d24/f84 0 2024-02-10T00:00:42.497 INFO:tasks.workunit.client.0.smithi164.stdout:4/785: dread d2/d19/d16/fc5 [0,4194304] 0 2024-02-10T00:00:42.498 INFO:tasks.workunit.client.0.smithi164.stdout:7/792: truncate d3/f9 5452198 0 2024-02-10T00:00:42.499 INFO:tasks.workunit.client.0.smithi164.stdout:6/802: truncate d0/d2b/d3a/d3d/d42/d5d/d79/faa 4785444 0 2024-02-10T00:00:42.499 INFO:tasks.workunit.client.0.smithi164.stdout:2/869: truncate d3/d26/d64/f75 2151005 0 2024-02-10T00:00:42.500 INFO:tasks.workunit.client.0.smithi164.stdout:3/704: truncate d0/d1/d2/d17/d37/d3f/d4e/fda 716808 0 2024-02-10T00:00:42.501 INFO:tasks.workunit.client.0.smithi164.stdout:5/864: rename d7/d17/d79/f97 to d7/d17/d21/d23/d5a/d68/d1f/d110/f12b 0 2024-02-10T00:00:42.501 INFO:tasks.workunit.client.0.smithi164.stdout:7/793: creat d3/d11/d39/d44/dbd/f109 x:0 0 0 2024-02-10T00:00:42.502 INFO:tasks.workunit.client.0.smithi164.stdout:6/803: creat d0/d3b/d56/f108 x:0 0 0 2024-02-10T00:00:42.503 INFO:tasks.workunit.client.0.smithi164.stdout:3/705: chown d0/d8f/d9a/db0/fc0 628398 1 2024-02-10T00:00:42.503 INFO:tasks.workunit.client.0.smithi164.stdout:4/786: symlink d2/d19/d16/d31/l110 0 2024-02-10T00:00:42.504 INFO:tasks.workunit.client.0.smithi164.stdout:9/778: creat d6/de/ffe x:0 0 0 2024-02-10T00:00:42.505 INFO:tasks.workunit.client.0.smithi164.stdout:8/798: dwrite d2/d64/d65/d80/d32/d4d/f6b [0,4194304] 0 2024-02-10T00:00:42.505 INFO:tasks.workunit.client.0.smithi164.stdout:2/870: creat d3/da6/d7a/d8e/d36/dbd/f12c x:0 0 0 2024-02-10T00:00:42.507 INFO:tasks.workunit.client.0.smithi164.stdout:9/779: read - d6/d41/d8b/dc2/fca zero size 2024-02-10T00:00:42.508 INFO:tasks.workunit.client.0.smithi164.stdout:5/865: fsync d7/d17/d21/d23/d5a/d68/d1f/d59/ff5 0 2024-02-10T00:00:42.509 INFO:tasks.workunit.client.0.smithi164.stdout:7/794: creat d3/d11/d39/d44/dbd/d107/dda/f10a x:0 0 0 2024-02-10T00:00:42.513 INFO:tasks.workunit.client.0.smithi164.stdout:6/804: dwrite d0/f17 [4194304,4194304] 0 2024-02-10T00:00:42.514 INFO:tasks.workunit.client.0.smithi164.stdout:4/787: dwrite d2/d19/d16/d31/f36 [4194304,4194304] 0 2024-02-10T00:00:42.519 INFO:tasks.workunit.client.0.smithi164.stdout:5/866: dwrite d7/d17/d21/d23/d5a/d68/d1f/dbe/fc4 [0,4194304] 0 2024-02-10T00:00:42.519 INFO:tasks.workunit.client.0.smithi164.stdout:3/706: rename d0/d1/d2/d19/d66 to d0/d3b/dce/de1 0 2024-02-10T00:00:42.521 INFO:tasks.workunit.client.0.smithi164.stdout:8/799: fdatasync d2/d64/d65/d80/d32/d93/f9a 0 2024-02-10T00:00:42.521 INFO:tasks.workunit.client.0.smithi164.stdout:7/795: mknod d3/d11/d39/c10b 0 2024-02-10T00:00:42.529 INFO:tasks.workunit.client.0.smithi164.stdout:9/780: rename d6/de/d40/dd4 to d6/d41/d8b/d24/d4f/dff 0 2024-02-10T00:00:42.530 INFO:tasks.workunit.client.0.smithi164.stdout:2/871: creat d3/d32/f12d x:0 0 0 2024-02-10T00:00:42.531 INFO:tasks.workunit.client.0.smithi164.stdout:2/872: write d3/d24/d5b/fac [1052244,71618] 0 2024-02-10T00:00:42.532 INFO:tasks.workunit.client.0.smithi164.stdout:2/873: write d3/d32/d4e/d27/f2c [2286544,124391] 0 2024-02-10T00:00:42.533 INFO:tasks.workunit.client.0.smithi164.stdout:2/874: write d3/d32/d4e/f67 [2462503,41960] 0 2024-02-10T00:00:42.538 INFO:tasks.workunit.client.0.smithi164.stdout:8/800: mkdir d2/d64/d65/d80/d32/d93/df1/dfa 0 2024-02-10T00:00:42.540 INFO:tasks.workunit.client.0.smithi164.stdout:4/788: rename d2/d19/d16/l2a to d2/d19/d16/d31/d57/l111 0 2024-02-10T00:00:42.540 INFO:tasks.workunit.client.0.smithi164.stdout:5/867: truncate d7/d17/d79/f86 312873 0 2024-02-10T00:00:42.541 INFO:tasks.workunit.client.0.smithi164.stdout:4/789: chown d2/d2f/d37/d41 3468974 1 2024-02-10T00:00:42.542 INFO:tasks.workunit.client.0.smithi164.stdout:2/875: rmdir d3/d26 39 2024-02-10T00:00:42.542 INFO:tasks.workunit.client.0.smithi164.stdout:5/868: write d7/d17/d21/d24/fae [1531701,91404] 0 2024-02-10T00:00:42.542 INFO:tasks.workunit.client.0.smithi164.stdout:2/876: chown d3/d32/d4e/d27/f12b 81238 1 2024-02-10T00:00:42.546 INFO:tasks.workunit.client.0.smithi164.stdout:2/877: unlink d3/d26/d64/f6a 0 2024-02-10T00:00:42.546 INFO:tasks.workunit.client.0.smithi164.stdout:2/878: write d3/fd [1675868,76083] 0 2024-02-10T00:00:42.550 INFO:tasks.workunit.client.0.smithi164.stdout:1/710: sync 2024-02-10T00:00:42.551 INFO:tasks.workunit.client.0.smithi164.stdout:1/711: write d1/d13/f19 [10951970,41333] 0 2024-02-10T00:00:42.552 INFO:tasks.workunit.client.0.smithi164.stdout:2/879: dwrite d3/d24/ff2 [0,4194304] 0 2024-02-10T00:00:42.553 INFO:tasks.workunit.client.0.smithi164.stdout:2/880: read - d3/d32/d4e/d27/f112 zero size 2024-02-10T00:00:42.553 INFO:tasks.workunit.client.0.smithi164.stdout:2/881: stat d3/da6/d7a/d8e/d36/f96 0 2024-02-10T00:00:42.558 INFO:tasks.workunit.client.0.smithi164.stdout:6/805: write d0/d6/d12/f67 [872715,88861] 0 2024-02-10T00:00:42.560 INFO:tasks.workunit.client.0.smithi164.stdout:9/781: write d6/de/d22/d69/f6b [331484,82007] 0 2024-02-10T00:00:42.560 INFO:tasks.workunit.client.0.smithi164.stdout:7/796: truncate d3/d11/f23 3571261 0 2024-02-10T00:00:42.561 INFO:tasks.workunit.client.0.smithi164.stdout:9/782: stat d6/d41/d8b/dc2/fca 0 2024-02-10T00:00:42.561 INFO:tasks.workunit.client.0.smithi164.stdout:9/783: chown d6/de/d22/d58/dba/d61/f77 443134 1 2024-02-10T00:00:42.562 INFO:tasks.workunit.client.0.smithi164.stdout:3/707: truncate d0/d1/d2/d19/f56 487097 0 2024-02-10T00:00:42.563 INFO:tasks.workunit.client.0.smithi164.stdout:2/882: dread d3/da6/d7a/d8e/d36/d54/f9f [0,4194304] 0 2024-02-10T00:00:42.565 INFO:tasks.workunit.client.0.smithi164.stdout:4/790: write d2/d2f/d37/d41/f6e [2161904,84656] 0 2024-02-10T00:00:42.568 INFO:tasks.workunit.client.0.smithi164.stdout:7/797: creat d3/d26/da7/f10c x:0 0 0 2024-02-10T00:00:42.569 INFO:tasks.workunit.client.0.smithi164.stdout:9/784: dwrite d6/f1e [0,4194304] 0 2024-02-10T00:00:42.569 INFO:tasks.workunit.client.0.smithi164.stdout:3/708: dwrite d0/d1/d2/fcd [0,4194304] 0 2024-02-10T00:00:42.571 INFO:tasks.workunit.client.0.smithi164.stdout:7/798: write d3/d11/d39/d44/dbd/d107/dda/d5d/f106 [938965,1259] 0 2024-02-10T00:00:42.572 INFO:tasks.workunit.client.0.smithi164.stdout:3/709: write d0/d1/d2/d19/d27/d5f/da5/f91 [82027,89215] 0 2024-02-10T00:00:42.572 INFO:tasks.workunit.client.0.smithi164.stdout:2/883: mkdir d3/d24/d12e 0 2024-02-10T00:00:42.574 INFO:tasks.workunit.client.0.smithi164.stdout:9/785: creat d6/d41/d8b/d24/d4f/f100 x:0 0 0 2024-02-10T00:00:42.583 INFO:tasks.workunit.client.0.smithi164.stdout:5/869: dread d7/d17/d21/d23/d37/d36/f81 [0,4194304] 0 2024-02-10T00:00:42.586 INFO:tasks.workunit.client.0.smithi164.stdout:6/806: write d0/d6/d12/d14/f50 [3477208,27417] 0 2024-02-10T00:00:42.586 INFO:tasks.workunit.client.0.smithi164.stdout:3/710: creat d0/d1/d2/d19/fe2 x:0 0 0 2024-02-10T00:00:42.589 INFO:tasks.workunit.client.0.smithi164.stdout:9/786: mkdir d6/de/d22/d58/dba/d61/d76/d82/d101 0 2024-02-10T00:00:42.589 INFO:tasks.workunit.client.0.smithi164.stdout:9/787: chown d6/ca 542910 1 2024-02-10T00:00:42.591 INFO:tasks.workunit.client.0.smithi164.stdout:3/711: rmdir d0/d1/dd/dc8 39 2024-02-10T00:00:42.592 INFO:tasks.workunit.client.0.smithi164.stdout:5/870: symlink d7/d17/d21/d23/d5a/d68/d1f/d70/l12c 0 2024-02-10T00:00:42.594 INFO:tasks.workunit.client.0.smithi164.stdout:5/871: write d7/d17/d21/d23/d5a/d68/d1f/f4a [1540456,54044] 0 2024-02-10T00:00:42.596 INFO:tasks.workunit.client.0.smithi164.stdout:6/807: truncate d0/d2b/d3a/d3d/fa3 549481 0 2024-02-10T00:00:42.597 INFO:tasks.workunit.client.0.smithi164.stdout:1/712: dread d1/d1a/d35/f34 [0,4194304] 0 2024-02-10T00:00:42.599 INFO:tasks.workunit.client.0.smithi164.stdout:5/872: fsync d7/f7f 0 2024-02-10T00:00:42.601 INFO:tasks.workunit.client.0.smithi164.stdout:5/873: chown d7/d17/d21/d23/d5a/d68/d1f/dbe/df2/cfa 3048594 1 2024-02-10T00:00:42.602 INFO:tasks.workunit.client.0.smithi164.stdout:3/712: getdents d0/d1/d2/d17/d37/d3f/d4e/d6d 0 2024-02-10T00:00:42.604 INFO:tasks.workunit.client.0.smithi164.stdout:1/713: dread d1/d13/d1f/fad [0,4194304] 0 2024-02-10T00:00:42.605 INFO:tasks.workunit.client.0.smithi164.stdout:0/746: sync 2024-02-10T00:00:42.606 INFO:tasks.workunit.client.0.smithi164.stdout:2/884: truncate d3/d24/d5b/f108 2294212 0 2024-02-10T00:00:42.609 INFO:tasks.workunit.client.0.smithi164.stdout:4/791: dread d2/d19/d16/d31/f4d [0,4194304] 0 2024-02-10T00:00:42.609 INFO:tasks.workunit.client.0.smithi164.stdout:1/714: creat d1/d1a/d35/ff0 x:0 0 0 2024-02-10T00:00:42.610 INFO:tasks.workunit.client.0.smithi164.stdout:0/747: truncate d6/d10/d18/d2d/d35/f48 2817050 0 2024-02-10T00:00:42.613 INFO:tasks.workunit.client.0.smithi164.stdout:6/808: dread d0/d2b/d3a/d3d/d42/d5d/d79/f8b [0,4194304] 0 2024-02-10T00:00:42.613 INFO:tasks.workunit.client.0.smithi164.stdout:4/792: mkdir d2/d2f/d37/d45/dd9/d112 0 2024-02-10T00:00:42.618 INFO:tasks.workunit.client.0.smithi164.stdout:5/874: rename d7/d17/d79/d7b/dc5/dd7/fd1 to d7/d17/d21/d24/dbc/f12d 0 2024-02-10T00:00:42.622 INFO:tasks.workunit.client.0.smithi164.stdout:9/788: dread d6/f3e [4194304,4194304] 0 2024-02-10T00:00:42.624 INFO:tasks.workunit.client.0.smithi164.stdout:9/789: chown d6/de/d22/d58/dba/d75 154 1 2024-02-10T00:00:42.625 INFO:tasks.workunit.client.0.smithi164.stdout:0/748: unlink d6/d10/d18/d1c/d92/fc6 0 2024-02-10T00:00:42.627 INFO:tasks.workunit.client.0.smithi164.stdout:3/713: dwrite d0/d1/d2/d17/d37/fa8 [0,4194304] 0 2024-02-10T00:00:42.628 INFO:tasks.workunit.client.0.smithi164.stdout:2/885: creat d3/d26/f12f x:0 0 0 2024-02-10T00:00:42.631 INFO:tasks.workunit.client.0.smithi164.stdout:4/793: rename d2/d2f/d37/d71/ff4 to d2/d2f/d37/d41/d3d/d42/d5f/f113 0 2024-02-10T00:00:42.631 INFO:tasks.workunit.client.0.smithi164.stdout:5/875: mkdir d7/df9/d12e 0 2024-02-10T00:00:42.632 INFO:tasks.workunit.client.0.smithi164.stdout:5/876: readlink d7/d17/d69/ld0 0 2024-02-10T00:00:42.632 INFO:tasks.workunit.client.0.smithi164.stdout:8/801: sync 2024-02-10T00:00:42.633 INFO:tasks.workunit.client.0.smithi164.stdout:8/802: write d2/d64/d65/d80/d32/d68/dac/fc6 [454436,91800] 0 2024-02-10T00:00:42.634 INFO:tasks.workunit.client.0.smithi164.stdout:6/809: dread d0/d6/d12/f18 [0,4194304] 0 2024-02-10T00:00:42.637 INFO:tasks.workunit.client.0.smithi164.stdout:6/810: fdatasync d0/d6/d12/f22 0 2024-02-10T00:00:42.639 INFO:tasks.workunit.client.0.smithi164.stdout:5/877: dwrite d7/d17/d21/d23/d37/d36/d8b/f10e [0,4194304] 0 2024-02-10T00:00:42.639 INFO:tasks.workunit.client.0.smithi164.stdout:0/749: getdents d6/d10/d18/d2d/d35/d44/d49/d95/dc0 0 2024-02-10T00:00:42.641 INFO:tasks.workunit.client.0.smithi164.stdout:0/750: fsync d6/d7/fe3 0 2024-02-10T00:00:42.641 INFO:tasks.workunit.client.0.smithi164.stdout:1/715: getdents d1/d23/d37/da9/dd1/ddb 0 2024-02-10T00:00:42.642 INFO:tasks.workunit.client.0.smithi164.stdout:2/886: symlink d3/d26/dfd/l130 0 2024-02-10T00:00:42.644 INFO:tasks.workunit.client.0.smithi164.stdout:3/714: creat d0/d1/dd/fe3 x:0 0 0 2024-02-10T00:00:42.647 INFO:tasks.workunit.client.0.smithi164.stdout:5/878: mkdir d7/d17/d79/d7b/dc5/dd7/d12f 0 2024-02-10T00:00:42.648 INFO:tasks.workunit.client.0.smithi164.stdout:5/879: fsync d7/d17/d21/d23/d37/d36/fe2 0 2024-02-10T00:00:42.649 INFO:tasks.workunit.client.0.smithi164.stdout:2/887: creat d3/da6/f131 x:0 0 0 2024-02-10T00:00:42.650 INFO:tasks.workunit.client.0.smithi164.stdout:6/811: creat d0/d2b/d3a/d3d/da7/da9/dfd/f109 x:0 0 0 2024-02-10T00:00:42.650 INFO:tasks.workunit.client.0.smithi164.stdout:3/715: fdatasync d0/d8f/d9a/fc2 0 2024-02-10T00:00:42.651 INFO:tasks.workunit.client.0.smithi164.stdout:6/812: dread - d0/d6/d12/d45/fc4 zero size 2024-02-10T00:00:42.652 INFO:tasks.workunit.client.0.smithi164.stdout:1/716: creat d1/d1a/d41/de4/ff1 x:0 0 0 2024-02-10T00:00:42.657 INFO:tasks.workunit.client.0.smithi164.stdout:2/888: mkdir d3/d26/dfd/d132 0 2024-02-10T00:00:42.658 INFO:tasks.workunit.client.0.smithi164.stdout:3/716: fdatasync d0/d1/d2/d17/d37/d3f/d4e/d6d/f92 0 2024-02-10T00:00:42.659 INFO:tasks.workunit.client.0.smithi164.stdout:9/790: dread d6/f70 [0,4194304] 0 2024-02-10T00:00:42.662 INFO:tasks.workunit.client.0.smithi164.stdout:8/803: truncate d2/d64/d7d/fc8 273699 0 2024-02-10T00:00:42.666 INFO:tasks.workunit.client.0.smithi164.stdout:8/804: dread d2/d64/d65/d80/d32/d93/f9a [0,4194304] 0 2024-02-10T00:00:42.667 INFO:tasks.workunit.client.0.smithi164.stdout:1/717: fsync d1/d1a/d41/f58 0 2024-02-10T00:00:42.669 INFO:tasks.workunit.client.0.smithi164.stdout:0/751: getdents d6/d10/d18/d2d/d35/d44/d49 0 2024-02-10T00:00:42.671 INFO:tasks.workunit.client.0.smithi164.stdout:1/718: write d1/d13/d2b/d52/d56/fbc [2862415,106335] 0 2024-02-10T00:00:42.672 INFO:tasks.workunit.client.0.smithi164.stdout:9/791: unlink d6/d41/d8b/f1d 0 2024-02-10T00:00:42.672 INFO:tasks.workunit.client.0.smithi164.stdout:5/880: link d7/d17/d21/l127 d7/d17/d69/d92/de9/l130 0 2024-02-10T00:00:42.673 INFO:tasks.workunit.client.0.smithi164.stdout:2/889: dwrite d3/da6/f104 [0,4194304] 0 2024-02-10T00:00:42.677 INFO:tasks.workunit.client.0.smithi164.stdout:8/805: dwrite d2/f41 [0,4194304] 0 2024-02-10T00:00:42.677 INFO:tasks.workunit.client.0.smithi164.stdout:3/717: dwrite d0/d1/d2/d19/f33 [0,4194304] 0 2024-02-10T00:00:42.681 INFO:tasks.workunit.client.0.smithi164.stdout:6/813: getdents d0/d3b 0 2024-02-10T00:00:42.685 INFO:tasks.workunit.client.0.smithi164.stdout:9/792: mknod d6/d41/d8b/d24/d4f/dff/c102 0 2024-02-10T00:00:42.687 INFO:tasks.workunit.client.0.smithi164.stdout:0/752: dwrite d6/d10/d18/d2d/f7f [0,4194304] 0 2024-02-10T00:00:42.687 INFO:tasks.workunit.client.0.smithi164.stdout:2/890: write d3/f23 [612522,99656] 0 2024-02-10T00:00:42.687 INFO:tasks.workunit.client.0.smithi164.stdout:5/881: dwrite d7/d17/d21/d24/dbc/d43/f6e [0,4194304] 0 2024-02-10T00:00:42.689 INFO:tasks.workunit.client.0.smithi164.stdout:8/806: dwrite d2/f27 [0,4194304] 0 2024-02-10T00:00:42.690 INFO:tasks.workunit.client.0.smithi164.stdout:2/891: write d3/d26/f11c [1040437,93998] 0 2024-02-10T00:00:42.691 INFO:tasks.workunit.client.0.smithi164.stdout:3/718: dwrite d0/d3b/dce/de1/d81/fbb [0,4194304] 0 2024-02-10T00:00:42.691 INFO:tasks.workunit.client.0.smithi164.stdout:7/799: sync 2024-02-10T00:00:42.692 INFO:tasks.workunit.client.0.smithi164.stdout:8/807: fsync d2/d12/f3f 0 2024-02-10T00:00:42.695 INFO:tasks.workunit.client.0.smithi164.stdout:1/719: dread d1/d1a/d41/f58 [0,4194304] 0 2024-02-10T00:00:42.699 INFO:tasks.workunit.client.0.smithi164.stdout:5/882: mkdir d7/d17/d69/d92/da8/dcd/dd3/d131 0 2024-02-10T00:00:42.700 INFO:tasks.workunit.client.0.smithi164.stdout:0/753: creat d6/fe9 x:0 0 0 2024-02-10T00:00:42.703 INFO:tasks.workunit.client.0.smithi164.stdout:2/892: dwrite d3/fd [0,4194304] 0 2024-02-10T00:00:42.704 INFO:tasks.workunit.client.0.smithi164.stdout:7/800: dwrite d3/d26/d67/d98/fc1 [0,4194304] 0 2024-02-10T00:00:42.705 INFO:tasks.workunit.client.0.smithi164.stdout:5/883: mkdir d7/d17/d69/d92/da8/dcd/dd3/d132 0 2024-02-10T00:00:42.706 INFO:tasks.workunit.client.0.smithi164.stdout:5/884: fsync d7/d17/d21/d23/fc1 0 2024-02-10T00:00:42.707 INFO:tasks.workunit.client.0.smithi164.stdout:7/801: write d3/d5/d9b/db7/d4b/f6a [1172083,85273] 0 2024-02-10T00:00:42.711 INFO:tasks.workunit.client.0.smithi164.stdout:2/893: dwrite d3/d32/d4e/f59 [0,4194304] 0 2024-02-10T00:00:42.711 INFO:tasks.workunit.client.0.smithi164.stdout:1/720: rename d1/fdd to d1/d1a/d41/d18/ff2 0 2024-02-10T00:00:42.711 INFO:tasks.workunit.client.0.smithi164.stdout:0/754: dwrite d6/d3a/d52/fb6 [0,4194304] 0 2024-02-10T00:00:42.713 INFO:tasks.workunit.client.0.smithi164.stdout:2/894: write d3/d24/df0/ff8 [391771,115156] 0 2024-02-10T00:00:42.713 INFO:tasks.workunit.client.0.smithi164.stdout:0/755: write d6/d10/d4a/dc7/fe7 [525236,62833] 0 2024-02-10T00:00:42.715 INFO:tasks.workunit.client.0.smithi164.stdout:2/895: chown d3/da6/d7a/d8e/db6/db8 853 1 2024-02-10T00:00:42.715 INFO:tasks.workunit.client.0.smithi164.stdout:2/896: chown d3/d26/l103 63658922 1 2024-02-10T00:00:42.720 INFO:tasks.workunit.client.0.smithi164.stdout:1/721: rename d1/d1a/fa3 to d1/d23/d37/da9/dd1/ddb/ff3 0 2024-02-10T00:00:42.721 INFO:tasks.workunit.client.0.smithi164.stdout:0/756: fdatasync d6/d10/d18/fca 0 2024-02-10T00:00:42.722 INFO:tasks.workunit.client.0.smithi164.stdout:0/757: fdatasync d6/d7/fe3 0 2024-02-10T00:00:42.724 INFO:tasks.workunit.client.0.smithi164.stdout:1/722: symlink d1/d23/d37/lf4 0 2024-02-10T00:00:42.724 INFO:tasks.workunit.client.0.smithi164.stdout:1/723: write d1/d23/f55 [616094,21747] 0 2024-02-10T00:00:42.725 INFO:tasks.workunit.client.0.smithi164.stdout:1/724: chown d1/l38 162 1 2024-02-10T00:00:42.726 INFO:tasks.workunit.client.0.smithi164.stdout:2/897: truncate d3/da6/d7a/d8e/d36/f3b 5723697 0 2024-02-10T00:00:42.727 INFO:tasks.workunit.client.0.smithi164.stdout:2/898: fdatasync d3/da6/d7a/d8e/d36/fde 0 2024-02-10T00:00:42.731 INFO:tasks.workunit.client.0.smithi164.stdout:1/725: write d1/d1a/d41/d18/f3e [1033937,126072] 0 2024-02-10T00:00:42.736 INFO:tasks.workunit.client.0.smithi164.stdout:2/899: getdents d3/da6/d7a/d8e/d36/d90 0 2024-02-10T00:00:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:2/900: link d3/f15 d3/d32/d4e/d27/f133 0 2024-02-10T00:00:42.740 INFO:tasks.workunit.client.0.smithi164.stdout:2/901: fdatasync d3/d24/d5b/fac 0 2024-02-10T00:00:42.742 INFO:tasks.workunit.client.0.smithi164.stdout:2/902: creat d3/d26/d56/f134 x:0 0 0 2024-02-10T00:00:42.745 INFO:tasks.workunit.client.0.smithi164.stdout:2/903: unlink d3/da6/d7a/d8e/db6/dce/dad/cd4 0 2024-02-10T00:00:42.748 INFO:tasks.workunit.client.0.smithi164.stdout:2/904: rename d3/d32/fe2 to d3/d24/d5b/d109/f135 0 2024-02-10T00:00:42.768 INFO:tasks.workunit.client.0.smithi164.stdout:4/794: sync 2024-02-10T00:00:42.769 INFO:tasks.workunit.client.0.smithi164.stdout:4/795: fdatasync d2/d19/d16/d31/d4b/f50 0 2024-02-10T00:00:42.780 INFO:tasks.workunit.client.0.smithi164.stdout:3/719: truncate d0/d1/d2/d17/d37/fa8 1422195 0 2024-02-10T00:00:42.783 INFO:tasks.workunit.client.0.smithi164.stdout:8/808: dwrite d2/f7 [0,4194304] 0 2024-02-10T00:00:42.784 INFO:tasks.workunit.client.0.smithi164.stdout:8/809: dread - d2/d64/d7d/fa7 zero size 2024-02-10T00:00:42.784 INFO:tasks.workunit.client.0.smithi164.stdout:7/802: write d3/d11/d39/d44/d48/fbb [706321,95483] 0 2024-02-10T00:00:42.787 INFO:tasks.workunit.client.0.smithi164.stdout:5/885: dread d7/d17/d21/d23/d37/d36/f46 [0,4194304] 0 2024-02-10T00:00:42.789 INFO:tasks.workunit.client.0.smithi164.stdout:6/814: dread d0/d3b/f90 [0,4194304] 0 2024-02-10T00:00:42.790 INFO:tasks.workunit.client.0.smithi164.stdout:1/726: dread d1/f1b [4194304,4194304] 0 2024-02-10T00:00:42.792 INFO:tasks.workunit.client.0.smithi164.stdout:2/905: truncate d3/d32/d4e/f67 4573277 0 2024-02-10T00:00:42.792 INFO:tasks.workunit.client.0.smithi164.stdout:0/758: dwrite d6/d10/d18/d2d/d35/d44/d90/fa9 [0,4194304] 0 2024-02-10T00:00:42.793 INFO:tasks.workunit.client.0.smithi164.stdout:4/796: truncate d2/d19/d16/d31/d6d/fb1 8647648 0 2024-02-10T00:00:42.794 INFO:tasks.workunit.client.0.smithi164.stdout:0/759: dread - d6/d10/d18/d2d/d35/d44/d90/fb0 zero size 2024-02-10T00:00:42.796 INFO:tasks.workunit.client.0.smithi164.stdout:9/793: mknod d6/de/d22/d58/dba/d61/c103 0 2024-02-10T00:00:42.799 INFO:tasks.workunit.client.0.smithi164.stdout:5/886: symlink d7/df9/l133 0 2024-02-10T00:00:42.801 INFO:tasks.workunit.client.0.smithi164.stdout:6/815: symlink d0/d2b/d3a/l10a 0 2024-02-10T00:00:42.802 INFO:tasks.workunit.client.0.smithi164.stdout:2/906: mknod d3/d24/d5b/c136 0 2024-02-10T00:00:42.806 INFO:tasks.workunit.client.0.smithi164.stdout:5/887: creat d7/d17/d79/dde/def/f134 x:0 0 0 2024-02-10T00:00:42.807 INFO:tasks.workunit.client.0.smithi164.stdout:6/816: creat d0/d6/f10b x:0 0 0 2024-02-10T00:00:42.808 INFO:tasks.workunit.client.0.smithi164.stdout:2/907: mkdir d3/d24/d5b/d137 0 2024-02-10T00:00:42.809 INFO:tasks.workunit.client.0.smithi164.stdout:0/760: chown d6/d7/d14/da6/daa/fd5 5 1 2024-02-10T00:00:42.811 INFO:tasks.workunit.client.0.smithi164.stdout:7/803: rename d3/d26 to d3/d11/d39/d44/d10d 0 2024-02-10T00:00:42.813 INFO:tasks.workunit.client.0.smithi164.stdout:1/727: creat d1/d1a/ff5 x:0 0 0 2024-02-10T00:00:42.815 INFO:tasks.workunit.client.0.smithi164.stdout:8/810: dread d2/d64/d65/d98/fb8 [0,4194304] 0 2024-02-10T00:00:42.816 INFO:tasks.workunit.client.0.smithi164.stdout:8/811: chown d2/d64/d7d/fa7 11160806 1 2024-02-10T00:00:42.816 INFO:tasks.workunit.client.0.smithi164.stdout:3/720: dread d0/d1/dd/f52 [0,4194304] 0 2024-02-10T00:00:42.818 INFO:tasks.workunit.client.0.smithi164.stdout:6/817: dread - d0/d2b/d3a/d3d/d42/f47 zero size 2024-02-10T00:00:42.819 INFO:tasks.workunit.client.0.smithi164.stdout:8/812: dread d2/f41 [0,4194304] 0 2024-02-10T00:00:42.823 INFO:tasks.workunit.client.0.smithi164.stdout:5/888: truncate d7/d17/d21/ff3 1218609 0 2024-02-10T00:00:42.825 INFO:tasks.workunit.client.0.smithi164.stdout:3/721: chown d0/d3b/dce/de1/d84/c2d 18614313 1 2024-02-10T00:00:42.825 INFO:tasks.workunit.client.0.smithi164.stdout:5/889: chown d7/d17/d21/d23/f5f 0 1 2024-02-10T00:00:42.825 INFO:tasks.workunit.client.0.smithi164.stdout:6/818: mknod d0/d6/d12/d57/c10c 0 2024-02-10T00:00:42.826 INFO:tasks.workunit.client.0.smithi164.stdout:0/761: dwrite d6/d10/d18/fca [0,4194304] 0 2024-02-10T00:00:42.827 INFO:tasks.workunit.client.0.smithi164.stdout:6/819: chown d0/d6/d95/ff7 30241 1 2024-02-10T00:00:42.829 INFO:tasks.workunit.client.0.smithi164.stdout:6/820: readlink d0/d2b/d3a/d3d/d42/d5d/d79/lba 0 2024-02-10T00:00:42.830 INFO:tasks.workunit.client.0.smithi164.stdout:6/821: fsync d0/d3b/d56/db3/fde 0 2024-02-10T00:00:42.831 INFO:tasks.workunit.client.0.smithi164.stdout:9/794: rename d6/d41 to d6/de/d22/dd3/d104 0 2024-02-10T00:00:42.831 INFO:tasks.workunit.client.0.smithi164.stdout:0/762: dwrite d6/d3a/d52/fb6 [4194304,4194304] 0 2024-02-10T00:00:42.834 INFO:tasks.workunit.client.0.smithi164.stdout:7/804: mkdir d3/d10e 0 2024-02-10T00:00:42.840 INFO:tasks.workunit.client.0.smithi164.stdout:6/822: symlink d0/d6/d81/l10d 0 2024-02-10T00:00:42.841 INFO:tasks.workunit.client.0.smithi164.stdout:6/823: readlink d0/d2b/d3a/d3d/d42/d5d/d79/l103 0 2024-02-10T00:00:42.842 INFO:tasks.workunit.client.0.smithi164.stdout:8/813: mknod d2/d64/d65/d80/d82/dd9/cfb 0 2024-02-10T00:00:42.843 INFO:tasks.workunit.client.0.smithi164.stdout:0/763: rmdir d6/d10/d4a/d60 39 2024-02-10T00:00:42.843 INFO:tasks.workunit.client.0.smithi164.stdout:1/728: link d1/d1a/d35/l5c d1/d95/lf6 0 2024-02-10T00:00:42.844 INFO:tasks.workunit.client.0.smithi164.stdout:2/908: getdents d3/da6/d7a/d8e/db6/dce/dad 0 2024-02-10T00:00:42.844 INFO:tasks.workunit.client.0.smithi164.stdout:1/729: read d1/fd [2677459,31064] 0 2024-02-10T00:00:42.845 INFO:tasks.workunit.client.0.smithi164.stdout:1/730: stat d1/d1a/d41/d18/l1e 0 2024-02-10T00:00:42.846 INFO:tasks.workunit.client.0.smithi164.stdout:8/814: symlink d2/d64/d65/d80/d32/d99/lfc 0 2024-02-10T00:00:42.848 INFO:tasks.workunit.client.0.smithi164.stdout:0/764: chown d6/d10/d4a/d60/d6c/f7e 3643 1 2024-02-10T00:00:42.849 INFO:tasks.workunit.client.0.smithi164.stdout:5/890: creat d7/d17/d21/d23/d37/f135 x:0 0 0 2024-02-10T00:00:42.851 INFO:tasks.workunit.client.0.smithi164.stdout:6/824: dwrite d0/d6/f10 [4194304,4194304] 0 2024-02-10T00:00:42.853 INFO:tasks.workunit.client.0.smithi164.stdout:8/815: rename d2/d64/d65/d80/d32/f56 to d2/ffd 0 2024-02-10T00:00:42.858 INFO:tasks.workunit.client.0.smithi164.stdout:5/891: mknod d7/d17/d21/d24/dbc/d45/c136 0 2024-02-10T00:00:42.859 INFO:tasks.workunit.client.0.smithi164.stdout:4/797: sync 2024-02-10T00:00:42.861 INFO:tasks.workunit.client.0.smithi164.stdout:0/765: rename d6/d10/d18/d2d/d35 to d6/d7/d14/da6/dea 0 2024-02-10T00:00:42.864 INFO:tasks.workunit.client.0.smithi164.stdout:7/805: truncate d3/d11/d39/d44/d48/d71/fbe 2688512 0 2024-02-10T00:00:42.866 INFO:tasks.workunit.client.0.smithi164.stdout:1/731: truncate d1/d23/f97 4429831 0 2024-02-10T00:00:42.867 INFO:tasks.workunit.client.0.smithi164.stdout:3/722: dwrite d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:42.868 INFO:tasks.workunit.client.0.smithi164.stdout:0/766: dwrite d6/d7/d14/da6/dea/d44/f98 [0,4194304] 0 2024-02-10T00:00:42.868 INFO:tasks.workunit.client.0.smithi164.stdout:1/732: stat d1/d23/d37/da9/dd1/ddb/ff3 0 2024-02-10T00:00:42.868 INFO:tasks.workunit.client.0.smithi164.stdout:3/723: fsync d0/d3b/dce/f9e 0 2024-02-10T00:00:42.870 INFO:tasks.workunit.client.0.smithi164.stdout:2/909: link d3/da6/d7a/d8e/ff7 d3/da6/d7a/d8e/d8a/dc8/f138 0 2024-02-10T00:00:42.871 INFO:tasks.workunit.client.0.smithi164.stdout:6/825: mknod d0/d2b/c10e 0 2024-02-10T00:00:42.875 INFO:tasks.workunit.client.0.smithi164.stdout:7/806: creat d3/d11/d39/d3a/f10f x:0 0 0 2024-02-10T00:00:42.879 INFO:tasks.workunit.client.0.smithi164.stdout:7/807: dwrite d3/d11/d39/d3a/ffe [0,4194304] 0 2024-02-10T00:00:42.881 INFO:tasks.workunit.client.0.smithi164.stdout:3/724: creat d0/d3b/fe4 x:0 0 0 2024-02-10T00:00:42.881 INFO:tasks.workunit.client.0.smithi164.stdout:1/733: creat d1/d13/d2b/d52/da4/dc2/dcc/ff7 x:0 0 0 2024-02-10T00:00:42.883 INFO:tasks.workunit.client.0.smithi164.stdout:5/892: creat d7/d17/d69/d92/da8/dcd/dd3/d131/f137 x:0 0 0 2024-02-10T00:00:42.885 INFO:tasks.workunit.client.0.smithi164.stdout:8/816: creat d2/d64/d65/d80/d32/d93/ffe x:0 0 0 2024-02-10T00:00:42.886 INFO:tasks.workunit.client.0.smithi164.stdout:9/795: getdents d6 0 2024-02-10T00:00:42.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/798: rmdir d2/d2f/d37/d41/d3d/d42/d47/df2 0 2024-02-10T00:00:42.891 INFO:tasks.workunit.client.0.smithi164.stdout:4/799: write d2/d19/d16/d31/d57/f7a [2229796,41965] 0 2024-02-10T00:00:42.895 INFO:tasks.workunit.client.0.smithi164.stdout:1/734: symlink d1/d23/d37/da9/dd7/lf8 0 2024-02-10T00:00:42.898 INFO:tasks.workunit.client.0.smithi164.stdout:8/817: creat d2/d64/d65/d80/d32/d93/df1/dfa/fff x:0 0 0 2024-02-10T00:00:42.899 INFO:tasks.workunit.client.0.smithi164.stdout:4/800: mknod d2/d19/d16/daa/c114 0 2024-02-10T00:00:42.900 INFO:tasks.workunit.client.0.smithi164.stdout:2/910: getdents d3/da6/d7a/d8e/db6/db8 0 2024-02-10T00:00:42.902 INFO:tasks.workunit.client.0.smithi164.stdout:1/735: mknod d1/d23/d70/cf9 0 2024-02-10T00:00:42.903 INFO:tasks.workunit.client.0.smithi164.stdout:6/826: link d0/d6/d81/l98 d0/d3b/l10f 0 2024-02-10T00:00:42.905 INFO:tasks.workunit.client.0.smithi164.stdout:4/801: dwrite d2/d19/d16/d31/d4b/f8d [0,4194304] 0 2024-02-10T00:00:42.907 INFO:tasks.workunit.client.0.smithi164.stdout:7/808: write d3/d28/f3b [4521718,54363] 0 2024-02-10T00:00:42.910 INFO:tasks.workunit.client.0.smithi164.stdout:8/818: creat d2/d64/d65/de2/f100 x:0 0 0 2024-02-10T00:00:42.912 INFO:tasks.workunit.client.0.smithi164.stdout:6/827: stat d0/d6/le 0 2024-02-10T00:00:42.913 INFO:tasks.workunit.client.0.smithi164.stdout:9/796: write d6/f1e [2503170,118236] 0 2024-02-10T00:00:42.914 INFO:tasks.workunit.client.0.smithi164.stdout:3/725: dwrite d0/d1/d2/d17/fa9 [0,4194304] 0 2024-02-10T00:00:42.914 INFO:tasks.workunit.client.0.smithi164.stdout:0/767: dread d6/d10/d4a/d60/d6c/f5e [0,4194304] 0 2024-02-10T00:00:42.916 INFO:tasks.workunit.client.0.smithi164.stdout:4/802: mknod d2/d19/d16/d31/d6d/c115 0 2024-02-10T00:00:42.916 INFO:tasks.workunit.client.0.smithi164.stdout:7/809: mkdir d3/d11/d39/d44/d10d/d67/d98/d110 0 2024-02-10T00:00:42.919 INFO:tasks.workunit.client.0.smithi164.stdout:1/736: truncate d1/d13/d1f/fc0 541057 0 2024-02-10T00:00:42.919 INFO:tasks.workunit.client.0.smithi164.stdout:5/893: dread d7/fd4 [0,4194304] 0 2024-02-10T00:00:42.920 INFO:tasks.workunit.client.0.smithi164.stdout:8/819: rename d2/d12/f17 to d2/d64/d54/d5f/f101 0 2024-02-10T00:00:42.921 INFO:tasks.workunit.client.0.smithi164.stdout:3/726: dwrite d0/d1/d3c/fa1 [0,4194304] 0 2024-02-10T00:00:42.922 INFO:tasks.workunit.client.0.smithi164.stdout:6/828: mkdir d0/d6/d12/d14/d4b/dbf/d110 0 2024-02-10T00:00:42.924 INFO:tasks.workunit.client.0.smithi164.stdout:2/911: creat d3/d32/f139 x:0 0 0 2024-02-10T00:00:42.925 INFO:tasks.workunit.client.0.smithi164.stdout:2/912: write d3/d26/fae [2622456,22144] 0 2024-02-10T00:00:42.928 INFO:tasks.workunit.client.0.smithi164.stdout:8/820: write d2/ffd [4890265,113991] 0 2024-02-10T00:00:42.928 INFO:tasks.workunit.client.0.smithi164.stdout:8/821: readlink d2/d64/d65/d80/d32/d4d/l76 0 2024-02-10T00:00:42.929 INFO:tasks.workunit.client.0.smithi164.stdout:5/894: mkdir d7/d17/d21/d23/d5a/d68/d1f/dbe/df2/d138 0 2024-02-10T00:00:42.930 INFO:tasks.workunit.client.0.smithi164.stdout:6/829: rmdir d0/d2b/d3a/d3d/d42/d5d/d79 39 2024-02-10T00:00:42.931 INFO:tasks.workunit.client.0.smithi164.stdout:0/768: symlink d6/d7/d14/da6/dea/d44/d49/d95/dc0/leb 0 2024-02-10T00:00:42.933 INFO:tasks.workunit.client.0.smithi164.stdout:2/913: fdatasync d3/da6/d7a/d8e/d36/f5d 0 2024-02-10T00:00:42.935 INFO:tasks.workunit.client.0.smithi164.stdout:1/737: stat d1/d23/d61/d9d/lb4 0 2024-02-10T00:00:42.940 INFO:tasks.workunit.client.0.smithi164.stdout:6/830: creat d0/d2b/d3a/d3d/d42/d5d/df0/f111 x:0 0 0 2024-02-10T00:00:42.940 INFO:tasks.workunit.client.0.smithi164.stdout:7/810: rmdir d3/d10e 0 2024-02-10T00:00:42.944 INFO:tasks.workunit.client.0.smithi164.stdout:4/803: link d2/d19/d16/f53 d2/d5a/f116 0 2024-02-10T00:00:42.945 INFO:tasks.workunit.client.0.smithi164.stdout:9/797: write d6/f7 [8698246,37550] 0 2024-02-10T00:00:42.946 INFO:tasks.workunit.client.0.smithi164.stdout:1/738: symlink d1/d23/d37/da9/dd1/ddb/lfa 0 2024-02-10T00:00:42.947 INFO:tasks.workunit.client.0.smithi164.stdout:8/822: dread d2/ffd [4194304,4194304] 0 2024-02-10T00:00:42.948 INFO:tasks.workunit.client.0.smithi164.stdout:2/914: dread d3/d32/d4e/d27/f74 [0,4194304] 0 2024-02-10T00:00:42.950 INFO:tasks.workunit.client.0.smithi164.stdout:8/823: chown d2/d64/d65/d80/d32/d68/dac/ld3 23 1 2024-02-10T00:00:42.952 INFO:tasks.workunit.client.0.smithi164.stdout:4/804: mkdir d2/d19/d16/d31/d72/d117 0 2024-02-10T00:00:42.954 INFO:tasks.workunit.client.0.smithi164.stdout:3/727: dread d0/d1/d2/d17/d37/f90 [0,4194304] 0 2024-02-10T00:00:42.955 INFO:tasks.workunit.client.0.smithi164.stdout:6/831: mkdir d0/d6/d12/d45/d112 0 2024-02-10T00:00:42.955 INFO:tasks.workunit.client.0.smithi164.stdout:3/728: read - d0/d1/faf zero size 2024-02-10T00:00:42.956 INFO:tasks.workunit.client.0.smithi164.stdout:2/915: truncate d3/d32/d4e/f5e 2439764 0 2024-02-10T00:00:42.957 INFO:tasks.workunit.client.0.smithi164.stdout:8/824: mkdir d2/d64/d65/d98/d102 0 2024-02-10T00:00:42.958 INFO:tasks.workunit.client.0.smithi164.stdout:8/825: write d2/d64/d54/f7c [2138974,8861] 0 2024-02-10T00:00:42.962 INFO:tasks.workunit.client.0.smithi164.stdout:4/805: readlink d2/d19/d16/d31/d57/l111 0 2024-02-10T00:00:42.963 INFO:tasks.workunit.client.0.smithi164.stdout:0/769: getdents d6/d3a 0 2024-02-10T00:00:42.964 INFO:tasks.workunit.client.0.smithi164.stdout:7/811: dread d3/d5/f30 [4194304,4194304] 0 2024-02-10T00:00:42.964 INFO:tasks.workunit.client.0.smithi164.stdout:8/826: dwrite d2/d64/d65/d80/d32/d58/f5c [0,4194304] 0 2024-02-10T00:00:42.966 INFO:tasks.workunit.client.0.smithi164.stdout:3/729: rmdir d0/d8f/d9a/db0 39 2024-02-10T00:00:42.966 INFO:tasks.workunit.client.0.smithi164.stdout:8/827: chown d2/f2c 2497894 1 2024-02-10T00:00:42.967 INFO:tasks.workunit.client.0.smithi164.stdout:7/812: chown d3/dbf/ce3 107 1 2024-02-10T00:00:42.967 INFO:tasks.workunit.client.0.smithi164.stdout:0/770: write d6/d7/d14/da6/dea/d44/d90/d9d/fbe [21538,87201] 0 2024-02-10T00:00:42.968 INFO:tasks.workunit.client.0.smithi164.stdout:6/832: rename d0/d6/le to d0/d2b/d3a/d3d/da7/da9/dfd/l113 0 2024-02-10T00:00:42.970 INFO:tasks.workunit.client.0.smithi164.stdout:2/916: creat d3/d26/d64/f13a x:0 0 0 2024-02-10T00:00:42.972 INFO:tasks.workunit.client.0.smithi164.stdout:1/739: dread d1/d13/f19 [8388608,4194304] 0 2024-02-10T00:00:42.973 INFO:tasks.workunit.client.0.smithi164.stdout:4/806: dwrite d2/d19/d16/d31/d4b/f8c [0,4194304] 0 2024-02-10T00:00:42.973 INFO:tasks.workunit.client.0.smithi164.stdout:1/740: dread - d1/d1a/d41/de4/ff1 zero size 2024-02-10T00:00:42.975 INFO:tasks.workunit.client.0.smithi164.stdout:3/730: rmdir d0/d1/d2/d17/d37/d9b 39 2024-02-10T00:00:42.976 INFO:tasks.workunit.client.0.smithi164.stdout:3/731: fsync d0/d1/d2/fd0 0 2024-02-10T00:00:42.977 INFO:tasks.workunit.client.0.smithi164.stdout:0/771: chown d6/d10/f61 1 1 2024-02-10T00:00:42.978 INFO:tasks.workunit.client.0.smithi164.stdout:7/813: mknod d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/c111 0 2024-02-10T00:00:42.978 INFO:tasks.workunit.client.0.smithi164.stdout:3/732: write d0/d3b/dce/de1/fde [277525,53426] 0 2024-02-10T00:00:42.979 INFO:tasks.workunit.client.0.smithi164.stdout:2/917: mkdir d3/da6/d7a/d8e/d36/dbd/d13b 0 2024-02-10T00:00:42.979 INFO:tasks.workunit.client.0.smithi164.stdout:4/807: dwrite d2/d2f/d37/d41/d3d/f64 [0,4194304] 0 2024-02-10T00:00:42.980 INFO:tasks.workunit.client.0.smithi164.stdout:1/741: truncate d1/f11 1278517 0 2024-02-10T00:00:42.982 INFO:tasks.workunit.client.0.smithi164.stdout:7/814: write d3/d11/d39/d44/d10d/da7/f10c [339360,30653] 0 2024-02-10T00:00:42.982 INFO:tasks.workunit.client.0.smithi164.stdout:1/742: dread - d1/d1a/ff5 zero size 2024-02-10T00:00:42.983 INFO:tasks.workunit.client.0.smithi164.stdout:6/833: readlink d0/d2b/d3a/d3d/d42/d5d/d79/dbd/le2 0 2024-02-10T00:00:42.985 INFO:tasks.workunit.client.0.smithi164.stdout:6/834: chown d0/d6/d12/f91 21450 1 2024-02-10T00:00:42.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/743: write d1/d1a/d35/ff0 [146032,99059] 0 2024-02-10T00:00:42.987 INFO:tasks.workunit.client.0.smithi164.stdout:0/772: dwrite d6/d10/d18/d1c/f2c [0,4194304] 0 2024-02-10T00:00:42.987 INFO:tasks.workunit.client.0.smithi164.stdout:6/835: stat d0/d2b/d3a/f53 0 2024-02-10T00:00:42.988 INFO:tasks.workunit.client.0.smithi164.stdout:5/895: sync 2024-02-10T00:00:42.992 INFO:tasks.workunit.client.0.smithi164.stdout:6/836: dread - d0/d6/f71 zero size 2024-02-10T00:00:42.993 INFO:tasks.workunit.client.0.smithi164.stdout:5/896: chown d7/f1d 59045777 1 2024-02-10T00:00:42.993 INFO:tasks.workunit.client.0.smithi164.stdout:6/837: write d0/d6/d12/f67 [1778935,112412] 0 2024-02-10T00:00:42.994 INFO:tasks.workunit.client.0.smithi164.stdout:7/815: mknod d3/d11/d39/d44/dbd/d107/dcf/c112 0 2024-02-10T00:00:42.997 INFO:tasks.workunit.client.0.smithi164.stdout:4/808: rename d2/d19/d16/d31/d6d/c115 to d2/d19/d16/c118 0 2024-02-10T00:00:42.999 INFO:tasks.workunit.client.0.smithi164.stdout:2/918: link d3/da6/d7a/d8e/d36/d54/d11b/c120 d3/d32/d4e/c13c 0 2024-02-10T00:00:43.003 INFO:tasks.workunit.client.0.smithi164.stdout:4/809: rmdir d2/d2f/d37/d41/d3d/d56 39 2024-02-10T00:00:43.003 INFO:tasks.workunit.client.0.smithi164.stdout:2/919: dwrite d3/d24/d5b/d109/f10b [0,4194304] 0 2024-02-10T00:00:43.004 INFO:tasks.workunit.client.0.smithi164.stdout:8/828: dread d2/d64/d65/d80/d32/d93/db7/fcf [0,4194304] 0 2024-02-10T00:00:43.013 INFO:tasks.workunit.client.0.smithi164.stdout:0/773: rename d6/d7/d14 to d6/dec 0 2024-02-10T00:00:43.014 INFO:tasks.workunit.client.0.smithi164.stdout:0/774: write d6/d10/d4a/d60/d6c/fb1 [1379570,117967] 0 2024-02-10T00:00:43.015 INFO:tasks.workunit.client.0.smithi164.stdout:0/775: chown d6/d10/d18/d2d 12 1 2024-02-10T00:00:43.016 INFO:tasks.workunit.client.0.smithi164.stdout:3/733: write d0/d3b/dce/de1/d84/f55 [128455,32104] 0 2024-02-10T00:00:43.017 INFO:tasks.workunit.client.0.smithi164.stdout:9/798: sync 2024-02-10T00:00:43.019 INFO:tasks.workunit.client.0.smithi164.stdout:6/838: write d0/d2b/d3a/d3d/d42/d5d/df0/fd2 [1100940,18055] 0 2024-02-10T00:00:43.019 INFO:tasks.workunit.client.0.smithi164.stdout:7/816: write d3/d11/d39/d44/d48/d71/fbe [3697837,26241] 0 2024-02-10T00:00:43.020 INFO:tasks.workunit.client.0.smithi164.stdout:5/897: truncate d7/d17/d21/f58 1105565 0 2024-02-10T00:00:43.020 INFO:tasks.workunit.client.0.smithi164.stdout:9/799: chown d6/de/d22/dd3/d104/d8b/d24/d4f/lc9 7425944 1 2024-02-10T00:00:43.020 INFO:tasks.workunit.client.0.smithi164.stdout:1/744: dwrite d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:43.023 INFO:tasks.workunit.client.0.smithi164.stdout:5/898: chown d7/d17/d21/d23/d37/d36/df8 115 1 2024-02-10T00:00:43.023 INFO:tasks.workunit.client.0.smithi164.stdout:2/920: creat d3/d26/d56/db9/f13d x:0 0 0 2024-02-10T00:00:43.025 INFO:tasks.workunit.client.0.smithi164.stdout:4/810: creat d2/f119 x:0 0 0 2024-02-10T00:00:43.026 INFO:tasks.workunit.client.0.smithi164.stdout:0/776: chown d6/dec/d79/dce 6219 1 2024-02-10T00:00:43.031 INFO:tasks.workunit.client.0.smithi164.stdout:1/745: dwrite d1/d13/d1f/f28 [0,4194304] 0 2024-02-10T00:00:43.032 INFO:tasks.workunit.client.0.smithi164.stdout:1/746: chown d1/d13/d1f/fac 7333 1 2024-02-10T00:00:43.033 INFO:tasks.workunit.client.0.smithi164.stdout:8/829: truncate d2/d64/d54/d71/f90 231839 0 2024-02-10T00:00:43.033 INFO:tasks.workunit.client.0.smithi164.stdout:8/830: fdatasync d2/d64/d65/fa6 0 2024-02-10T00:00:43.035 INFO:tasks.workunit.client.0.smithi164.stdout:3/734: getdents d0/d1/d2/d17/d37/d3f/d4e/d6d 0 2024-02-10T00:00:43.036 INFO:tasks.workunit.client.0.smithi164.stdout:6/839: symlink d0/d6/d12/d14/d4b/dbf/d110/l114 0 2024-02-10T00:00:43.039 INFO:tasks.workunit.client.0.smithi164.stdout:1/747: mknod d1/d1a/d41/d18/d33/cfb 0 2024-02-10T00:00:43.040 INFO:tasks.workunit.client.0.smithi164.stdout:2/921: symlink d3/d26/dfd/d132/l13e 0 2024-02-10T00:00:43.045 INFO:tasks.workunit.client.0.smithi164.stdout:1/748: dwrite d1/d13/d1f/f7a [0,4194304] 0 2024-02-10T00:00:43.046 INFO:tasks.workunit.client.0.smithi164.stdout:5/899: rename d7/d17/d21/d24/dbc/d45/d5c/f113 to d7/d17/d21/d23/d5a/f139 0 2024-02-10T00:00:43.046 INFO:tasks.workunit.client.0.smithi164.stdout:2/922: symlink d3/da6/d7a/d8e/d8a/dc8/l13f 0 2024-02-10T00:00:43.048 INFO:tasks.workunit.client.0.smithi164.stdout:3/735: symlink d0/d1/d2/d17/d37/d9b/le5 0 2024-02-10T00:00:43.048 INFO:tasks.workunit.client.0.smithi164.stdout:8/831: dwrite d2/f2c [0,4194304] 0 2024-02-10T00:00:43.050 INFO:tasks.workunit.client.0.smithi164.stdout:7/817: dwrite d3/d11/d39/d44/d10d/d67/d98/fa8 [0,4194304] 0 2024-02-10T00:00:43.051 INFO:tasks.workunit.client.0.smithi164.stdout:1/749: mknod d1/d23/d37/da9/dd1/ddb/cfc 0 2024-02-10T00:00:43.052 INFO:tasks.workunit.client.0.smithi164.stdout:5/900: write d7/d17/d21/d23/d5a/d68/d1f/dbe/f117 [3254218,100943] 0 2024-02-10T00:00:43.055 INFO:tasks.workunit.client.0.smithi164.stdout:6/840: dread d0/d6/d12/f22 [0,4194304] 0 2024-02-10T00:00:43.056 INFO:tasks.workunit.client.0.smithi164.stdout:7/818: creat d3/d5/d2b/d4a/f113 x:0 0 0 2024-02-10T00:00:43.057 INFO:tasks.workunit.client.0.smithi164.stdout:6/841: fsync d0/f17 0 2024-02-10T00:00:43.058 INFO:tasks.workunit.client.0.smithi164.stdout:9/800: dread d6/de/d22/dd3/d104/f99 [0,4194304] 0 2024-02-10T00:00:43.058 INFO:tasks.workunit.client.0.smithi164.stdout:3/736: rename d0/d1/d3c/f7c to d0/d1/dd/dc8/fe6 0 2024-02-10T00:00:43.059 INFO:tasks.workunit.client.0.smithi164.stdout:8/832: mknod d2/d64/d65/d80/d32/d4d/ddd/c103 0 2024-02-10T00:00:43.060 INFO:tasks.workunit.client.0.smithi164.stdout:4/811: dread d2/d2f/d37/d41/d3d/f52 [0,4194304] 0 2024-02-10T00:00:43.060 INFO:tasks.workunit.client.0.smithi164.stdout:3/737: write d0/fb1 [180876,71257] 0 2024-02-10T00:00:43.061 INFO:tasks.workunit.client.0.smithi164.stdout:5/901: write d7/d17/d21/d23/d5a/d68/d1f/f44 [5202617,124961] 0 2024-02-10T00:00:43.062 INFO:tasks.workunit.client.0.smithi164.stdout:9/801: dread - d6/de/d22/dd3/d104/d8b/dc2/fca zero size 2024-02-10T00:00:43.062 INFO:tasks.workunit.client.0.smithi164.stdout:7/819: read d3/d11/d39/d44/d48/d71/fbe [2422798,71297] 0 2024-02-10T00:00:43.063 INFO:tasks.workunit.client.0.smithi164.stdout:0/777: truncate d6/d10/d18/d1c/d92/fbf 3976556 0 2024-02-10T00:00:43.065 INFO:tasks.workunit.client.0.smithi164.stdout:7/820: write d3/d5/d9b/daa/fdb [115896,71434] 0 2024-02-10T00:00:43.069 INFO:tasks.workunit.client.0.smithi164.stdout:1/750: rename d1/d23/d37/ld2 to d1/d1a/d75/lfd 0 2024-02-10T00:00:43.070 INFO:tasks.workunit.client.0.smithi164.stdout:1/751: read - d1/d1a/d41/de4/ff1 zero size 2024-02-10T00:00:43.070 INFO:tasks.workunit.client.0.smithi164.stdout:5/902: creat d7/df9/f13a x:0 0 0 2024-02-10T00:00:43.071 INFO:tasks.workunit.client.0.smithi164.stdout:4/812: mknod d2/d2f/d37/d45/dab/dbd/c11a 0 2024-02-10T00:00:43.072 INFO:tasks.workunit.client.0.smithi164.stdout:0/778: symlink d6/d3a/led 0 2024-02-10T00:00:43.074 INFO:tasks.workunit.client.0.smithi164.stdout:9/802: creat d6/de/d22/dd3/d104/d8b/f105 x:0 0 0 2024-02-10T00:00:43.077 INFO:tasks.workunit.client.0.smithi164.stdout:5/903: rmdir d7/d17/d79/d7b 39 2024-02-10T00:00:43.081 INFO:tasks.workunit.client.0.smithi164.stdout:5/904: dwrite d7/d17/d21/d23/d5a/d68/d1f/dbe/f117 [0,4194304] 0 2024-02-10T00:00:43.081 INFO:tasks.workunit.client.0.smithi164.stdout:2/923: truncate d3/d32/d4e/fc6 1713751 0 2024-02-10T00:00:43.093 INFO:tasks.workunit.client.0.smithi164.stdout:1/752: write d1/d13/d2b/f2e [2363059,86742] 0 2024-02-10T00:00:43.095 INFO:tasks.workunit.client.0.smithi164.stdout:1/753: chown d1/d1a/d41/f58 3108 1 2024-02-10T00:00:43.095 INFO:tasks.workunit.client.0.smithi164.stdout:6/842: dwrite d0/d6/fa1 [0,4194304] 0 2024-02-10T00:00:43.096 INFO:tasks.workunit.client.0.smithi164.stdout:8/833: link d2/d64/d54/db9/fde d2/d64/d65/d80/d32/d58/f104 0 2024-02-10T00:00:43.097 INFO:tasks.workunit.client.0.smithi164.stdout:8/834: fsync d2/d64/d65/d80/d82/fad 0 2024-02-10T00:00:43.098 INFO:tasks.workunit.client.0.smithi164.stdout:1/754: fdatasync d1/d13/d2b/f2e 0 2024-02-10T00:00:43.101 INFO:tasks.workunit.client.0.smithi164.stdout:5/905: dread d7/d17/d21/d23/d5a/d68/fd9 [0,4194304] 0 2024-02-10T00:00:43.102 INFO:tasks.workunit.client.0.smithi164.stdout:7/821: rename d3/d11/d39/c7a to d3/d11/d39/d44/d6f/c114 0 2024-02-10T00:00:43.105 INFO:tasks.workunit.client.0.smithi164.stdout:4/813: truncate d2/d19/d16/d31/f100 307909 0 2024-02-10T00:00:43.105 INFO:tasks.workunit.client.0.smithi164.stdout:0/779: dwrite d6/d3a/d52/fc8 [0,4194304] 0 2024-02-10T00:00:43.108 INFO:tasks.workunit.client.0.smithi164.stdout:7/822: dwrite d3/d28/f61 [0,4194304] 0 2024-02-10T00:00:43.109 INFO:tasks.workunit.client.0.smithi164.stdout:7/823: chown d3/d5/l8 245834311 1 2024-02-10T00:00:43.109 INFO:tasks.workunit.client.0.smithi164.stdout:8/835: rmdir d2/d64/d65/de2 39 2024-02-10T00:00:43.110 INFO:tasks.workunit.client.0.smithi164.stdout:7/824: readlink d3/d11/d39/d44/dbd/d107/dda/leb 0 2024-02-10T00:00:43.110 INFO:tasks.workunit.client.0.smithi164.stdout:1/755: creat d1/d1a/d75/de0/ffe x:0 0 0 2024-02-10T00:00:43.111 INFO:tasks.workunit.client.0.smithi164.stdout:3/738: getdents d0/d1/d2/d19/d27/d5f/da5/d94/dbd 0 2024-02-10T00:00:43.112 INFO:tasks.workunit.client.0.smithi164.stdout:1/756: read - d1/d1a/d41/d18/fe6 zero size 2024-02-10T00:00:43.115 INFO:tasks.workunit.client.0.smithi164.stdout:7/825: dread d3/d11/d39/d44/d10d/f27 [0,4194304] 0 2024-02-10T00:00:43.116 INFO:tasks.workunit.client.0.smithi164.stdout:4/814: creat d2/d2f/d37/d45/f11b x:0 0 0 2024-02-10T00:00:43.116 INFO:tasks.workunit.client.0.smithi164.stdout:6/843: stat d0/d3b/d56 0 2024-02-10T00:00:43.118 INFO:tasks.workunit.client.0.smithi164.stdout:9/803: getdents d6/de/d22/d58/dba/d61 0 2024-02-10T00:00:43.122 INFO:tasks.workunit.client.0.smithi164.stdout:0/780: fdatasync d6/d3a/d52/f75 0 2024-02-10T00:00:43.123 INFO:tasks.workunit.client.0.smithi164.stdout:7/826: symlink d3/d11/d39/d44/d6f/d75/l115 0 2024-02-10T00:00:43.127 INFO:tasks.workunit.client.0.smithi164.stdout:9/804: read d6/de/ffd [86144,111086] 0 2024-02-10T00:00:43.127 INFO:tasks.workunit.client.0.smithi164.stdout:8/836: creat d2/d64/d65/d80/d32/d99/d9e/df0/f105 x:0 0 0 2024-02-10T00:00:43.129 INFO:tasks.workunit.client.0.smithi164.stdout:2/924: truncate d3/fd 4122483 0 2024-02-10T00:00:43.129 INFO:tasks.workunit.client.0.smithi164.stdout:2/925: chown d3/da6/d7a/d8e/db6/ld1 270791 1 2024-02-10T00:00:43.132 INFO:tasks.workunit.client.0.smithi164.stdout:7/827: unlink d3/d11/d39/d44/dbd/d107/dda/leb 0 2024-02-10T00:00:43.135 INFO:tasks.workunit.client.0.smithi164.stdout:8/837: mknod d2/d64/d65/d80/d32/d99/d9e/c106 0 2024-02-10T00:00:43.136 INFO:tasks.workunit.client.0.smithi164.stdout:5/906: dread d7/d17/d21/d23/d5a/d68/d1f/d59/ff5 [0,4194304] 0 2024-02-10T00:00:43.136 INFO:tasks.workunit.client.0.smithi164.stdout:8/838: stat d2/l15 0 2024-02-10T00:00:43.137 INFO:tasks.workunit.client.0.smithi164.stdout:0/781: symlink d6/d10/d18/d2d/d39/db7/lee 0 2024-02-10T00:00:43.138 INFO:tasks.workunit.client.0.smithi164.stdout:7/828: symlink d3/dbf/l116 0 2024-02-10T00:00:43.139 INFO:tasks.workunit.client.0.smithi164.stdout:1/757: truncate d1/d13/d2b/d52/da4/faa 626022 0 2024-02-10T00:00:43.142 INFO:tasks.workunit.client.0.smithi164.stdout:4/815: truncate d2/d19/d16/d31/f36 2058247 0 2024-02-10T00:00:43.142 INFO:tasks.workunit.client.0.smithi164.stdout:3/739: getdents d0/d8f/d9a 0 2024-02-10T00:00:43.143 INFO:tasks.workunit.client.0.smithi164.stdout:1/758: readlink d1/d13/d2b/d52/da4/dc2/dcc/le5 0 2024-02-10T00:00:43.143 INFO:tasks.workunit.client.0.smithi164.stdout:6/844: dwrite d0/d6/d12/d14/f24 [0,4194304] 0 2024-02-10T00:00:43.144 INFO:tasks.workunit.client.0.smithi164.stdout:2/926: dwrite d3/d32/d4e/d27/f28 [4194304,4194304] 0 2024-02-10T00:00:43.145 INFO:tasks.workunit.client.0.smithi164.stdout:2/927: stat d3/d26/dfd 0 2024-02-10T00:00:43.148 INFO:tasks.workunit.client.0.smithi164.stdout:0/782: symlink d6/d10/d4a/d60/d6c/lef 0 2024-02-10T00:00:43.148 INFO:tasks.workunit.client.0.smithi164.stdout:0/783: chown d6/fcd 126659746 1 2024-02-10T00:00:43.149 INFO:tasks.workunit.client.0.smithi164.stdout:9/805: truncate d6/f1e 459783 0 2024-02-10T00:00:43.150 INFO:tasks.workunit.client.0.smithi164.stdout:9/806: chown d6/de/d22/dd3/d104/d8b/l71 224 1 2024-02-10T00:00:43.154 INFO:tasks.workunit.client.0.smithi164.stdout:3/740: mkdir d0/d8f/d9a/db0/de7 0 2024-02-10T00:00:43.155 INFO:tasks.workunit.client.0.smithi164.stdout:5/907: symlink d7/d17/d21/d24/dbc/d45/db3/l13b 0 2024-02-10T00:00:43.155 INFO:tasks.workunit.client.0.smithi164.stdout:9/807: dwrite d6/de/d22/d58/dba/d61/d76/da5/fc5 [0,4194304] 0 2024-02-10T00:00:43.156 INFO:tasks.workunit.client.0.smithi164.stdout:1/759: dread d1/d1a/d41/d18/ff2 [0,4194304] 0 2024-02-10T00:00:43.160 INFO:tasks.workunit.client.0.smithi164.stdout:4/816: creat d2/d19/d10f/f11c x:0 0 0 2024-02-10T00:00:43.162 INFO:tasks.workunit.client.0.smithi164.stdout:5/908: mknod d7/d17/d21/dfb/c13c 0 2024-02-10T00:00:43.163 INFO:tasks.workunit.client.0.smithi164.stdout:2/928: symlink d3/l140 0 2024-02-10T00:00:43.164 INFO:tasks.workunit.client.0.smithi164.stdout:9/808: mknod d6/de/d22/dd3/d104/d8b/d24/d4f/dff/c106 0 2024-02-10T00:00:43.165 INFO:tasks.workunit.client.0.smithi164.stdout:1/760: creat d1/d1a/d75/fff x:0 0 0 2024-02-10T00:00:43.167 INFO:tasks.workunit.client.0.smithi164.stdout:6/845: rename d0/d2b/d3a/d3d/d42/d5d/d79/faa to d0/d6/d95/dcd/f115 0 2024-02-10T00:00:43.169 INFO:tasks.workunit.client.0.smithi164.stdout:7/829: write d3/f16 [1090592,4925] 0 2024-02-10T00:00:43.170 INFO:tasks.workunit.client.0.smithi164.stdout:4/817: rmdir d2/d19/d16/d31/d7e/d81 39 2024-02-10T00:00:43.171 INFO:tasks.workunit.client.0.smithi164.stdout:8/839: link d2/d64/d54/d71/d78/c94 d2/d64/d54/d71/c107 0 2024-02-10T00:00:43.172 INFO:tasks.workunit.client.0.smithi164.stdout:5/909: write d7/fd4 [2137044,39477] 0 2024-02-10T00:00:43.174 INFO:tasks.workunit.client.0.smithi164.stdout:5/910: write d7/d17/d21/d23/d37/f93 [1159303,7120] 0 2024-02-10T00:00:43.174 INFO:tasks.workunit.client.0.smithi164.stdout:0/784: rename d6/d3a/d52/fa7 to d6/d3a/d97/ff0 0 2024-02-10T00:00:43.178 INFO:tasks.workunit.client.0.smithi164.stdout:8/840: mknod d2/d64/d65/d80/d32/d99/d9e/df0/c108 0 2024-02-10T00:00:43.184 INFO:tasks.workunit.client.0.smithi164.stdout:5/911: rename d7/d17/d69/d92/da8/dcd/dd3/l12a to d7/d17/d69/d92/da8/dcd/dd3/d132/l13d 0 2024-02-10T00:00:43.186 INFO:tasks.workunit.client.0.smithi164.stdout:8/841: dread d2/d64/d65/d80/d32/f55 [0,4194304] 0 2024-02-10T00:00:43.188 INFO:tasks.workunit.client.0.smithi164.stdout:3/741: write d0/d1/d2/d17/d37/d3f/fd7 [982791,82386] 0 2024-02-10T00:00:43.190 INFO:tasks.workunit.client.0.smithi164.stdout:5/912: dwrite d7/d17/d21/d23/d5a/d68/d1f/dbe/f117 [0,4194304] 0 2024-02-10T00:00:43.190 INFO:tasks.workunit.client.0.smithi164.stdout:7/830: dread d3/f13 [0,4194304] 0 2024-02-10T00:00:43.191 INFO:tasks.workunit.client.0.smithi164.stdout:2/929: write d3/da6/d7a/d8e/d8a/dc8/f138 [562196,96807] 0 2024-02-10T00:00:43.192 INFO:tasks.workunit.client.0.smithi164.stdout:9/809: truncate d6/fc 2830168 0 2024-02-10T00:00:43.192 INFO:tasks.workunit.client.0.smithi164.stdout:6/846: link d0/d2b/f7e d0/d2b/d3a/d3d/da7/da9/de1/f116 0 2024-02-10T00:00:43.193 INFO:tasks.workunit.client.0.smithi164.stdout:4/818: link d2/d2f/d37/d41/fdb d2/d2f/d37/d41/d3d/df0/d105/f11d 0 2024-02-10T00:00:43.195 INFO:tasks.workunit.client.0.smithi164.stdout:1/761: getdents d1/d95 0 2024-02-10T00:00:43.197 INFO:tasks.workunit.client.0.smithi164.stdout:8/842: symlink d2/d64/d65/d80/d32/d4d/ddd/l109 0 2024-02-10T00:00:43.197 INFO:tasks.workunit.client.0.smithi164.stdout:8/843: readlink d2/d64/d54/d71/l96 0 2024-02-10T00:00:43.199 INFO:tasks.workunit.client.0.smithi164.stdout:7/831: creat d3/d11/d39/d44/d9a/f117 x:0 0 0 2024-02-10T00:00:43.200 INFO:tasks.workunit.client.0.smithi164.stdout:7/832: chown d3/d11/d39/d44 264007640 1 2024-02-10T00:00:43.200 INFO:tasks.workunit.client.0.smithi164.stdout:2/930: chown d3/d24/f46 1143 1 2024-02-10T00:00:43.202 INFO:tasks.workunit.client.0.smithi164.stdout:9/810: read d6/de/d22/dd3/d104/d8b/d24/f5c [17921,7375] 0 2024-02-10T00:00:43.202 INFO:tasks.workunit.client.0.smithi164.stdout:4/819: creat d2/d19/dc1/f11e x:0 0 0 2024-02-10T00:00:43.203 INFO:tasks.workunit.client.0.smithi164.stdout:4/820: chown d2/d2f/d37/d45/f11b 1067623289 1 2024-02-10T00:00:43.204 INFO:tasks.workunit.client.0.smithi164.stdout:5/913: creat d7/df9/d12e/f13e x:0 0 0 2024-02-10T00:00:43.205 INFO:tasks.workunit.client.0.smithi164.stdout:7/833: dread d3/d11/d39/d3a/f7d [0,4194304] 0 2024-02-10T00:00:43.205 INFO:tasks.workunit.client.0.smithi164.stdout:7/834: chown d3/f16 3572578 1 2024-02-10T00:00:43.206 INFO:tasks.workunit.client.0.smithi164.stdout:0/785: getdents d6/d10/d18/d2d/d39 0 2024-02-10T00:00:43.209 INFO:tasks.workunit.client.0.smithi164.stdout:3/742: rename d0/d1/d2/d19/la6 to d0/d1/d2/d17/d37/le8 0 2024-02-10T00:00:43.211 INFO:tasks.workunit.client.0.smithi164.stdout:5/914: symlink d7/d17/d21/d23/d5a/d68/l13f 0 2024-02-10T00:00:43.211 INFO:tasks.workunit.client.0.smithi164.stdout:8/844: rmdir d2/d64/d65/d80/d32/d99/d9e/df0 39 2024-02-10T00:00:43.216 INFO:tasks.workunit.client.0.smithi164.stdout:2/931: symlink d3/d24/l141 0 2024-02-10T00:00:43.217 INFO:tasks.workunit.client.0.smithi164.stdout:7/835: write d3/d11/d39/d44/d6f/f9e [3054903,88911] 0 2024-02-10T00:00:43.219 INFO:tasks.workunit.client.0.smithi164.stdout:0/786: creat d6/dec/da6/dea/d44/d49/d95/dc0/ff1 x:0 0 0 2024-02-10T00:00:43.220 INFO:tasks.workunit.client.0.smithi164.stdout:1/762: write d1/fd [1514396,82975] 0 2024-02-10T00:00:43.223 INFO:tasks.workunit.client.0.smithi164.stdout:4/821: fdatasync d2/d5a/d94/f96 0 2024-02-10T00:00:43.223 INFO:tasks.workunit.client.0.smithi164.stdout:7/836: dwrite d3/d28/f61 [0,4194304] 0 2024-02-10T00:00:43.226 INFO:tasks.workunit.client.0.smithi164.stdout:2/932: symlink d3/d24/d5b/d109/l142 0 2024-02-10T00:00:43.227 INFO:tasks.workunit.client.0.smithi164.stdout:4/822: read d2/d19/f48 [3348623,111304] 0 2024-02-10T00:00:43.228 INFO:tasks.workunit.client.0.smithi164.stdout:9/811: dwrite d6/de/d22/dd3/d104/d8b/f87 [0,4194304] 0 2024-02-10T00:00:43.229 INFO:tasks.workunit.client.0.smithi164.stdout:4/823: stat d2/d19/d16/d31/d7e/l9e 0 2024-02-10T00:00:43.229 INFO:tasks.workunit.client.0.smithi164.stdout:0/787: symlink d6/d10/d4a/d60/d6c/lf2 0 2024-02-10T00:00:43.230 INFO:tasks.workunit.client.0.smithi164.stdout:0/788: readlink d6/l13 0 2024-02-10T00:00:43.232 INFO:tasks.workunit.client.0.smithi164.stdout:6/847: rename d0/d2b/cb5 to d0/d6/d12/d57/c117 0 2024-02-10T00:00:43.233 INFO:tasks.workunit.client.0.smithi164.stdout:1/763: symlink d1/d13/d2b/d52/da4/dc3/dcd/l100 0 2024-02-10T00:00:43.235 INFO:tasks.workunit.client.0.smithi164.stdout:8/845: dwrite d2/f49 [0,4194304] 0 2024-02-10T00:00:43.235 INFO:tasks.workunit.client.0.smithi164.stdout:6/848: fsync d0/d2b/d3a/d3d/d42/d5d/df0/f111 0 2024-02-10T00:00:43.235 INFO:tasks.workunit.client.0.smithi164.stdout:3/743: dread d0/fc1 [0,4194304] 0 2024-02-10T00:00:43.237 INFO:tasks.workunit.client.0.smithi164.stdout:2/933: mkdir d3/da6/d7a/d8e/d36/d143 0 2024-02-10T00:00:43.239 INFO:tasks.workunit.client.0.smithi164.stdout:9/812: mkdir d6/de/d22/d58/dba/d61/d107 0 2024-02-10T00:00:43.242 INFO:tasks.workunit.client.0.smithi164.stdout:8/846: write d2/d64/f83 [457333,101738] 0 2024-02-10T00:00:43.243 INFO:tasks.workunit.client.0.smithi164.stdout:8/847: fsync d2/f29 0 2024-02-10T00:00:43.245 INFO:tasks.workunit.client.0.smithi164.stdout:3/744: unlink d0/f43 0 2024-02-10T00:00:43.245 INFO:tasks.workunit.client.0.smithi164.stdout:2/934: readlink d3/da6/d7a/d8e/d8a/dc8/l116 0 2024-02-10T00:00:43.246 INFO:tasks.workunit.client.0.smithi164.stdout:0/789: symlink d6/dec/da6/de6/lf3 0 2024-02-10T00:00:43.247 INFO:tasks.workunit.client.0.smithi164.stdout:1/764: symlink d1/d23/dd3/l101 0 2024-02-10T00:00:43.251 INFO:tasks.workunit.client.0.smithi164.stdout:1/765: dwrite d1/d23/fd4 [0,4194304] 0 2024-02-10T00:00:43.253 INFO:tasks.workunit.client.0.smithi164.stdout:8/848: chown d2/d64/d54/d71/d78/c94 3 1 2024-02-10T00:00:43.253 INFO:tasks.workunit.client.0.smithi164.stdout:3/745: creat d0/d3b/dce/fe9 x:0 0 0 2024-02-10T00:00:43.256 INFO:tasks.workunit.client.0.smithi164.stdout:4/824: rename d2/l106 to d2/d5a/l11f 0 2024-02-10T00:00:43.256 INFO:tasks.workunit.client.0.smithi164.stdout:5/915: dwrite d7/d17/d21/d23/d5a/d68/d1f/fed [0,4194304] 0 2024-02-10T00:00:43.257 INFO:tasks.workunit.client.0.smithi164.stdout:7/837: getdents d3/d11/d39/d44/d10d/d67/d98/daf 0 2024-02-10T00:00:43.259 INFO:tasks.workunit.client.0.smithi164.stdout:6/849: truncate d0/d6/d95/f104 194906 0 2024-02-10T00:00:43.261 INFO:tasks.workunit.client.0.smithi164.stdout:8/849: rmdir d2/d64/d65/d80/d32/d4d 39 2024-02-10T00:00:43.261 INFO:tasks.workunit.client.0.smithi164.stdout:0/790: symlink d6/d10/d18/d2d/dd6/lf4 0 2024-02-10T00:00:43.263 INFO:tasks.workunit.client.0.smithi164.stdout:5/916: creat d7/d17/d21/dfb/f140 x:0 0 0 2024-02-10T00:00:43.264 INFO:tasks.workunit.client.0.smithi164.stdout:3/746: rename d0/d1/d2/d19/l50 to d0/d1/d2/d17/d37/d9b/lea 0 2024-02-10T00:00:43.266 INFO:tasks.workunit.client.0.smithi164.stdout:4/825: mkdir d2/d19/d16/d31/d4b/d120 0 2024-02-10T00:00:43.267 INFO:tasks.workunit.client.0.smithi164.stdout:2/935: dread d3/da6/d7a/d8e/d88/f95 [0,4194304] 0 2024-02-10T00:00:43.267 INFO:tasks.workunit.client.0.smithi164.stdout:4/826: dread - d2/d19/d10f/f11c zero size 2024-02-10T00:00:43.268 INFO:tasks.workunit.client.0.smithi164.stdout:6/850: mkdir d0/d2b/d3a/dd0/d93/d118 0 2024-02-10T00:00:43.268 INFO:tasks.workunit.client.0.smithi164.stdout:7/838: dread d3/d5/d2b/fe6 [0,4194304] 0 2024-02-10T00:00:43.268 INFO:tasks.workunit.client.0.smithi164.stdout:1/766: truncate d1/d13/d2b/d52/da4/dc3/dcd/f6a 990911 0 2024-02-10T00:00:43.269 INFO:tasks.workunit.client.0.smithi164.stdout:4/827: chown d2/la 12071527 1 2024-02-10T00:00:43.270 INFO:tasks.workunit.client.0.smithi164.stdout:4/828: chown d2/d2f/d37/l39 2946660 1 2024-02-10T00:00:43.271 INFO:tasks.workunit.client.0.smithi164.stdout:5/917: mkdir d7/d17/d69/d92/da8/d141 0 2024-02-10T00:00:43.271 INFO:tasks.workunit.client.0.smithi164.stdout:1/767: dread d1/d1a/d41/d18/f3e [4194304,4194304] 0 2024-02-10T00:00:43.276 INFO:tasks.workunit.client.0.smithi164.stdout:5/918: dwrite d7/d17/d21/d24/fae [0,4194304] 0 2024-02-10T00:00:43.283 INFO:tasks.workunit.client.0.smithi164.stdout:8/850: symlink d2/d64/d65/d80/d32/d4d/de9/l10a 0 2024-02-10T00:00:43.284 INFO:tasks.workunit.client.0.smithi164.stdout:6/851: rmdir d0/d6 39 2024-02-10T00:00:43.284 INFO:tasks.workunit.client.0.smithi164.stdout:8/851: stat d2/d64/d65/d80/d32/d93/db0/lce 0 2024-02-10T00:00:43.292 INFO:tasks.workunit.client.0.smithi164.stdout:5/919: read - d7/d17/d21/d23/d37/d36/d8b/f115 zero size 2024-02-10T00:00:43.293 INFO:tasks.workunit.client.0.smithi164.stdout:6/852: creat d0/d2b/d3a/dd0/d93/f119 x:0 0 0 2024-02-10T00:00:43.294 INFO:tasks.workunit.client.0.smithi164.stdout:6/853: chown d0/f2f 178506 1 2024-02-10T00:00:43.295 INFO:tasks.workunit.client.0.smithi164.stdout:0/791: truncate d6/dec/da6/dea/d44/f98 3026716 0 2024-02-10T00:00:43.298 INFO:tasks.workunit.client.0.smithi164.stdout:8/852: write d2/d64/d54/db9/fde [584040,49587] 0 2024-02-10T00:00:43.298 INFO:tasks.workunit.client.0.smithi164.stdout:2/936: dwrite d3/d26/d56/fa8 [0,4194304] 0 2024-02-10T00:00:43.301 INFO:tasks.workunit.client.0.smithi164.stdout:4/829: creat d2/d19/d16/d31/d4b/d120/f121 x:0 0 0 2024-02-10T00:00:43.302 INFO:tasks.workunit.client.0.smithi164.stdout:6/854: fdatasync d0/d2b/f36 0 2024-02-10T00:00:43.302 INFO:tasks.workunit.client.0.smithi164.stdout:3/747: dwrite d0/d1/d2/d17/f7e [0,4194304] 0 2024-02-10T00:00:43.304 INFO:tasks.workunit.client.0.smithi164.stdout:1/768: dread d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:43.304 INFO:tasks.workunit.client.0.smithi164.stdout:4/830: chown d2/d19/d16/d31/d7e/ld1 8220 1 2024-02-10T00:00:43.305 INFO:tasks.workunit.client.0.smithi164.stdout:4/831: stat d2/d2f/d37/d41/d3d/d42/lc3 0 2024-02-10T00:00:43.309 INFO:tasks.workunit.client.0.smithi164.stdout:8/853: symlink d2/d64/d65/da9/l10b 0 2024-02-10T00:00:43.309 INFO:tasks.workunit.client.0.smithi164.stdout:7/839: link d3/d11/d39/d44/d6f/d75/c7b d3/d11/d39/d44/dbd/d107/dcf/c118 0 2024-02-10T00:00:43.309 INFO:tasks.workunit.client.0.smithi164.stdout:0/792: symlink d6/d7/lf5 0 2024-02-10T00:00:43.310 INFO:tasks.workunit.client.0.smithi164.stdout:6/855: creat d0/d2b/d3a/dd0/d93/f11a x:0 0 0 2024-02-10T00:00:43.310 INFO:tasks.workunit.client.0.smithi164.stdout:3/748: symlink d0/d8f/d9a/db0/leb 0 2024-02-10T00:00:43.311 INFO:tasks.workunit.client.0.smithi164.stdout:1/769: creat d1/d13/d1f/f102 x:0 0 0 2024-02-10T00:00:43.313 INFO:tasks.workunit.client.0.smithi164.stdout:4/832: dread d2/d19/d16/d31/d57/f9b [0,4194304] 0 2024-02-10T00:00:43.315 INFO:tasks.workunit.client.0.smithi164.stdout:7/840: creat d3/d5/d2b/d4a/d100/f119 x:0 0 0 2024-02-10T00:00:43.316 INFO:tasks.workunit.client.0.smithi164.stdout:7/841: fdatasync d3/d11/d39/d44/d10d/d67/d98/fb8 0 2024-02-10T00:00:43.317 INFO:tasks.workunit.client.0.smithi164.stdout:0/793: write d6/d10/d4a/d60/d6c/f46 [3580327,36734] 0 2024-02-10T00:00:43.318 INFO:tasks.workunit.client.0.smithi164.stdout:9/813: sync 2024-02-10T00:00:43.318 INFO:tasks.workunit.client.0.smithi164.stdout:5/920: getdents d7/d17/d79 0 2024-02-10T00:00:43.319 INFO:tasks.workunit.client.0.smithi164.stdout:4/833: creat d2/d2f/d37/d41/d3d/df0/f122 x:0 0 0 2024-02-10T00:00:43.320 INFO:tasks.workunit.client.0.smithi164.stdout:6/856: symlink d0/d6/d95/dcd/l11b 0 2024-02-10T00:00:43.320 INFO:tasks.workunit.client.0.smithi164.stdout:5/921: chown d7/d17/d21/d24/dbc/d45/d5c/le0 48300 1 2024-02-10T00:00:43.322 INFO:tasks.workunit.client.0.smithi164.stdout:5/922: write d7/d17/d21/d23/f72 [487943,8358] 0 2024-02-10T00:00:43.324 INFO:tasks.workunit.client.0.smithi164.stdout:7/842: mknod d3/d5/d9b/db7/d4b/c11a 0 2024-02-10T00:00:43.324 INFO:tasks.workunit.client.0.smithi164.stdout:5/923: stat d7/d17/d69/c9c 0 2024-02-10T00:00:43.326 INFO:tasks.workunit.client.0.smithi164.stdout:4/834: dwrite d2/d19/dc1/f11e [0,4194304] 0 2024-02-10T00:00:43.328 INFO:tasks.workunit.client.0.smithi164.stdout:6/857: dwrite d0/d6/d95/dcd/ffc [0,4194304] 0 2024-02-10T00:00:43.330 INFO:tasks.workunit.client.0.smithi164.stdout:2/937: truncate d3/d24/d5b/f6e 2140621 0 2024-02-10T00:00:43.332 INFO:tasks.workunit.client.0.smithi164.stdout:1/770: link d1/d1a/ff5 d1/d1a/f103 0 2024-02-10T00:00:43.333 INFO:tasks.workunit.client.0.smithi164.stdout:1/771: readlink d1/d13/l9b 0 2024-02-10T00:00:43.334 INFO:tasks.workunit.client.0.smithi164.stdout:5/924: readlink l2 0 2024-02-10T00:00:43.335 INFO:tasks.workunit.client.0.smithi164.stdout:8/854: truncate d2/d64/d65/de2/f100 803857 0 2024-02-10T00:00:43.336 INFO:tasks.workunit.client.0.smithi164.stdout:3/749: dwrite d0/fc1 [4194304,4194304] 0 2024-02-10T00:00:43.336 INFO:tasks.workunit.client.0.smithi164.stdout:6/858: dwrite d0/d2b/d3a/dd0/fec [0,4194304] 0 2024-02-10T00:00:43.347 INFO:tasks.workunit.client.0.smithi164.stdout:6/859: creat d0/d6/d95/dcd/f11c x:0 0 0 2024-02-10T00:00:43.348 INFO:tasks.workunit.client.0.smithi164.stdout:2/938: symlink d3/da6/d7a/d8e/db6/d126/d127/l144 0 2024-02-10T00:00:43.350 INFO:tasks.workunit.client.0.smithi164.stdout:1/772: unlink d1/d13/f66 0 2024-02-10T00:00:43.351 INFO:tasks.workunit.client.0.smithi164.stdout:1/773: chown d1/d1a/d75/fff 176117 1 2024-02-10T00:00:43.352 INFO:tasks.workunit.client.0.smithi164.stdout:6/860: creat d0/d2b/d3a/dd0/f11d x:0 0 0 2024-02-10T00:00:43.353 INFO:tasks.workunit.client.0.smithi164.stdout:9/814: mknod d6/de/d22/d58/dba/d61/d76/d82/dfc/c108 0 2024-02-10T00:00:43.353 INFO:tasks.workunit.client.0.smithi164.stdout:4/835: link d2/d2f/d37/l39 d2/d19/d16/d31/d72/l123 0 2024-02-10T00:00:43.357 INFO:tasks.workunit.client.0.smithi164.stdout:6/861: creat d0/d2b/d3a/d3d/da7/da9/f11e x:0 0 0 2024-02-10T00:00:43.358 INFO:tasks.workunit.client.0.smithi164.stdout:4/836: mkdir d2/d19/dc1/d124 0 2024-02-10T00:00:43.359 INFO:tasks.workunit.client.0.smithi164.stdout:2/939: mknod d3/d32/d4e/d27/c145 0 2024-02-10T00:00:43.361 INFO:tasks.workunit.client.0.smithi164.stdout:5/925: rename d7/d17/d21/d23/d37/d36/c10b to d7/c142 0 2024-02-10T00:00:43.362 INFO:tasks.workunit.client.0.smithi164.stdout:3/750: getdents d0/d1/d2/d19 0 2024-02-10T00:00:43.365 INFO:tasks.workunit.client.0.smithi164.stdout:0/794: dread d6/d10/d4a/d60/d6c/fb1 [0,4194304] 0 2024-02-10T00:00:43.367 INFO:tasks.workunit.client.0.smithi164.stdout:8/855: rename d2/d64/d65/d80/d32/d4d/l76 to d2/d64/d65/d98/l10c 0 2024-02-10T00:00:43.369 INFO:tasks.workunit.client.0.smithi164.stdout:6/862: creat d0/d2b/d3a/d3d/da7/da9/de1/f11f x:0 0 0 2024-02-10T00:00:43.370 INFO:tasks.workunit.client.0.smithi164.stdout:6/863: stat d0/d6/d95/dcd/dc3 0 2024-02-10T00:00:43.371 INFO:tasks.workunit.client.0.smithi164.stdout:6/864: write d0/f5 [1671418,80157] 0 2024-02-10T00:00:43.372 INFO:tasks.workunit.client.0.smithi164.stdout:6/865: chown d0/d6/d12/d14/d4b/cb2 438897626 1 2024-02-10T00:00:43.379 INFO:tasks.workunit.client.0.smithi164.stdout:7/843: write d3/d5/d59/f72 [1066793,26617] 0 2024-02-10T00:00:43.380 INFO:tasks.workunit.client.0.smithi164.stdout:7/844: read - d3/d11/d39/d44/d6f/ffa zero size 2024-02-10T00:00:43.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/856: mkdir d2/d64/d65/d80/d32/d93/d10d 0 2024-02-10T00:00:43.385 INFO:tasks.workunit.client.0.smithi164.stdout:7/845: dwrite d3/d11/d39/d44/d48/fbb [0,4194304] 0 2024-02-10T00:00:43.386 INFO:tasks.workunit.client.0.smithi164.stdout:4/837: dread d2/d19/d16/d31/f36 [0,4194304] 0 2024-02-10T00:00:43.387 INFO:tasks.workunit.client.0.smithi164.stdout:4/838: write d2/d19/d16/d31/d57/faf [1120822,105910] 0 2024-02-10T00:00:43.388 INFO:tasks.workunit.client.0.smithi164.stdout:4/839: fdatasync d2/d2f/d37/d71/fba 0 2024-02-10T00:00:43.389 INFO:tasks.workunit.client.0.smithi164.stdout:9/815: truncate d6/de/d2b/f67 2055283 0 2024-02-10T00:00:43.404 INFO:tasks.workunit.client.0.smithi164.stdout:3/751: truncate d0/d3b/dce/fe9 1005128 0 2024-02-10T00:00:43.405 INFO:tasks.workunit.client.0.smithi164.stdout:1/774: dwrite d1/d13/d2b/d52/da4/dc2/fcf [0,4194304] 0 2024-02-10T00:00:43.406 INFO:tasks.workunit.client.0.smithi164.stdout:2/940: getdents d3/d26/d56/db9 0 2024-02-10T00:00:43.408 INFO:tasks.workunit.client.0.smithi164.stdout:5/926: dread d7/d17/d21/d85/fc7 [0,4194304] 0 2024-02-10T00:00:43.409 INFO:tasks.workunit.client.0.smithi164.stdout:9/816: chown d6/de/d22/d58/dba/d61/lf1 710729 1 2024-02-10T00:00:43.410 INFO:tasks.workunit.client.0.smithi164.stdout:3/752: chown d0/d8f/d9a/lc9 5 1 2024-02-10T00:00:43.410 INFO:tasks.workunit.client.0.smithi164.stdout:0/795: dwrite d6/d3a/d52/f53 [0,4194304] 0 2024-02-10T00:00:43.412 INFO:tasks.workunit.client.0.smithi164.stdout:0/796: chown d6/d10/d18/d2d/d39/de0 1 1 2024-02-10T00:00:43.415 INFO:tasks.workunit.client.0.smithi164.stdout:6/866: link d0/d3b/fce d0/d2b/d3a/d3d/d42/d5d/d66/f120 0 2024-02-10T00:00:43.416 INFO:tasks.workunit.client.0.smithi164.stdout:4/840: mknod d2/d19/d16/d31/d7e/c125 0 2024-02-10T00:00:43.417 INFO:tasks.workunit.client.0.smithi164.stdout:4/841: chown d2/d2f/d37/d41 1574 1 2024-02-10T00:00:43.417 INFO:tasks.workunit.client.0.smithi164.stdout:5/927: rmdir d7/d17/d69/d92/da8 39 2024-02-10T00:00:43.417 INFO:tasks.workunit.client.0.smithi164.stdout:6/867: read d0/d2b/d3a/d3d/d42/d5d/d79/f8b [86246,115996] 0 2024-02-10T00:00:43.418 INFO:tasks.workunit.client.0.smithi164.stdout:9/817: symlink d6/de/de2/l109 0 2024-02-10T00:00:43.438 INFO:tasks.workunit.client.0.smithi164.stdout:0/797: mknod d6/d10/d18/d1c/d92/cf6 0 2024-02-10T00:00:43.439 INFO:tasks.workunit.client.0.smithi164.stdout:8/857: creat d2/d64/d65/d80/f10e x:0 0 0 2024-02-10T00:00:43.440 INFO:tasks.workunit.client.0.smithi164.stdout:2/941: mkdir d3/da6/d7a/d8e/d36/d143/d146 0 2024-02-10T00:00:43.452 INFO:tasks.workunit.client.0.smithi164.stdout:9/818: readlink d6/de/d22/d58/dba/d61/la1 0 2024-02-10T00:00:43.453 INFO:tasks.workunit.client.0.smithi164.stdout:1/775: dwrite d1/d1a/f73 [0,4194304] 0 2024-02-10T00:00:43.454 INFO:tasks.workunit.client.0.smithi164.stdout:1/776: chown d1/d23/d37/caf 0 1 2024-02-10T00:00:43.455 INFO:tasks.workunit.client.0.smithi164.stdout:0/798: mkdir d6/d10/d4a/d60/d6c/df7 0 2024-02-10T00:00:43.456 INFO:tasks.workunit.client.0.smithi164.stdout:8/858: mkdir d2/d64/d65/d80/d32/d99/d10f 0 2024-02-10T00:00:43.457 INFO:tasks.workunit.client.0.smithi164.stdout:6/868: dwrite d0/d2b/d3a/d3d/d42/f84 [0,4194304] 0 2024-02-10T00:00:43.457 INFO:tasks.workunit.client.0.smithi164.stdout:2/942: mknod d3/d24/d5b/dd9/c147 0 2024-02-10T00:00:43.458 INFO:tasks.workunit.client.0.smithi164.stdout:8/859: chown d2/d64/d54/d71/d78/ce6 282 1 2024-02-10T00:00:43.459 INFO:tasks.workunit.client.0.smithi164.stdout:3/753: creat d0/d1/d2/d17/fec x:0 0 0 2024-02-10T00:00:43.466 INFO:tasks.workunit.client.0.smithi164.stdout:9/819: creat d6/de/dfa/f10a x:0 0 0 2024-02-10T00:00:43.466 INFO:tasks.workunit.client.0.smithi164.stdout:1/777: truncate d1/f11 419147 0 2024-02-10T00:00:43.467 INFO:tasks.workunit.client.0.smithi164.stdout:9/820: write d6/de/d22/dd3/d104/fb1 [2181860,96271] 0 2024-02-10T00:00:43.468 INFO:tasks.workunit.client.0.smithi164.stdout:5/928: link d7/d17/d21/d23/d5a/d68/d1f/d70/c77 d7/d17/d21/d23/d5a/d68/d1f/dbe/df2/d138/c143 0 2024-02-10T00:00:43.470 INFO:tasks.workunit.client.0.smithi164.stdout:9/821: fdatasync d6/de/d22/dd3/d104/d8b/d24/f5c 0 2024-02-10T00:00:43.471 INFO:tasks.workunit.client.0.smithi164.stdout:6/869: truncate d0/d6/f10b 544634 0 2024-02-10T00:00:43.471 INFO:tasks.workunit.client.0.smithi164.stdout:8/860: truncate d2/d64/d65/da9/fdf 959439 0 2024-02-10T00:00:43.472 INFO:tasks.workunit.client.0.smithi164.stdout:5/929: fsync d7/d17/d21/d23/f2d 0 2024-02-10T00:00:43.473 INFO:tasks.workunit.client.0.smithi164.stdout:3/754: dread d0/d1/d2/d19/f29 [4194304,4194304] 0 2024-02-10T00:00:43.477 INFO:tasks.workunit.client.0.smithi164.stdout:6/870: dwrite d0/d2b/d3a/d3d/d42/f84 [0,4194304] 0 2024-02-10T00:00:43.479 INFO:tasks.workunit.client.0.smithi164.stdout:4/842: dwrite d2/d2f/d37/d41/fdb [0,4194304] 0 2024-02-10T00:00:43.479 INFO:tasks.workunit.client.0.smithi164.stdout:7/846: sync 2024-02-10T00:00:43.479 INFO:tasks.workunit.client.0.smithi164.stdout:8/861: rename d2/f27 to d2/d12/de3/f110 0 2024-02-10T00:00:43.480 INFO:tasks.workunit.client.0.smithi164.stdout:9/822: mkdir d6/de/d22/dd3/d104/d8b/d24/d10b 0 2024-02-10T00:00:43.484 INFO:tasks.workunit.client.0.smithi164.stdout:7/847: dwrite d3/fd4 [0,4194304] 0 2024-02-10T00:00:43.486 INFO:tasks.workunit.client.0.smithi164.stdout:6/871: mkdir d0/d2b/d3a/d3d/d42/d5d/d79/dbc/d121 0 2024-02-10T00:00:43.487 INFO:tasks.workunit.client.0.smithi164.stdout:6/872: dread - d0/d3b/d56/f108 zero size 2024-02-10T00:00:43.488 INFO:tasks.workunit.client.0.smithi164.stdout:0/799: write d6/f3d [3247621,11936] 0 2024-02-10T00:00:43.489 INFO:tasks.workunit.client.0.smithi164.stdout:6/873: chown d0/d2b/d3a/dd0/d93/db4/fda 70 1 2024-02-10T00:00:43.490 INFO:tasks.workunit.client.0.smithi164.stdout:6/874: fsync d0/f2f 0 2024-02-10T00:00:43.496 INFO:tasks.workunit.client.0.smithi164.stdout:5/930: creat d7/d17/d21/d23/d5a/d68/d1f/f144 x:0 0 0 2024-02-10T00:00:43.499 INFO:tasks.workunit.client.0.smithi164.stdout:6/875: mknod d0/d2b/d3a/d3d/da7/da9/de1/c122 0 2024-02-10T00:00:43.499 INFO:tasks.workunit.client.0.smithi164.stdout:6/876: chown d0/d2b 753810 1 2024-02-10T00:00:43.501 INFO:tasks.workunit.client.0.smithi164.stdout:4/843: link d2/d19/d16/d31/d4b/f50 d2/d2f/d37/f126 0 2024-02-10T00:00:43.501 INFO:tasks.workunit.client.0.smithi164.stdout:7/848: mkdir d3/d28/d11b 0 2024-02-10T00:00:43.503 INFO:tasks.workunit.client.0.smithi164.stdout:0/800: rename d6/d10/d18/d1c/d92/fbf to d6/dec/da6/dea/d44/d90/d9d/ff8 0 2024-02-10T00:00:43.505 INFO:tasks.workunit.client.0.smithi164.stdout:6/877: dread d0/d6/d95/fc8 [0,4194304] 0 2024-02-10T00:00:43.505 INFO:tasks.workunit.client.0.smithi164.stdout:1/778: dread d1/d23/d70/f7e [0,4194304] 0 2024-02-10T00:00:43.506 INFO:tasks.workunit.client.0.smithi164.stdout:4/844: rename d2/d2f/d37/d45/df3 to d2/d2f/d37/d45/d127 0 2024-02-10T00:00:43.508 INFO:tasks.workunit.client.0.smithi164.stdout:5/931: rename d7/d17/d21/d23/d5a/d68/l99 to d7/d17/d79/d7b/dc5/l145 0 2024-02-10T00:00:43.509 INFO:tasks.workunit.client.0.smithi164.stdout:0/801: mknod d6/dec/da6/dea/d44/d49/cf9 0 2024-02-10T00:00:43.510 INFO:tasks.workunit.client.0.smithi164.stdout:0/802: write d6/d10/d4a/dc7/fe7 [398055,97513] 0 2024-02-10T00:00:43.511 INFO:tasks.workunit.client.0.smithi164.stdout:4/845: creat d2/d2f/d37/d71/f128 x:0 0 0 2024-02-10T00:00:43.511 INFO:tasks.workunit.client.0.smithi164.stdout:0/803: stat d6/d3a/d52/d7a/fa1 0 2024-02-10T00:00:43.512 INFO:tasks.workunit.client.0.smithi164.stdout:4/846: write d2/d2f/d37/d41/dcc/ffd [976168,118152] 0 2024-02-10T00:00:43.513 INFO:tasks.workunit.client.0.smithi164.stdout:7/849: rename d3/d28/cd8 to d3/d11/d39/d44/dbd/d107/dda/c11c 0 2024-02-10T00:00:43.514 INFO:tasks.workunit.client.0.smithi164.stdout:5/932: creat d7/d17/d69/d92/de9/f146 x:0 0 0 2024-02-10T00:00:43.517 INFO:tasks.workunit.client.0.smithi164.stdout:0/804: creat d6/dec/d79/dce/ffa x:0 0 0 2024-02-10T00:00:43.517 INFO:tasks.workunit.client.0.smithi164.stdout:4/847: symlink d2/d5a/d94/l129 0 2024-02-10T00:00:43.519 INFO:tasks.workunit.client.0.smithi164.stdout:7/850: mkdir d3/d11/d39/d44/d10d/d67/d11d 0 2024-02-10T00:00:43.521 INFO:tasks.workunit.client.0.smithi164.stdout:5/933: symlink d7/d17/d21/d85/l147 0 2024-02-10T00:00:43.522 INFO:tasks.workunit.client.0.smithi164.stdout:9/823: write d6/de/d22/dd3/d104/d8b/f2c [28626,34194] 0 2024-02-10T00:00:43.523 INFO:tasks.workunit.client.0.smithi164.stdout:8/862: truncate d2/d64/f83 1359428 0 2024-02-10T00:00:43.526 INFO:tasks.workunit.client.0.smithi164.stdout:2/943: sync 2024-02-10T00:00:43.529 INFO:tasks.workunit.client.0.smithi164.stdout:6/878: write d0/d6/d95/dcd/f115 [310141,98178] 0 2024-02-10T00:00:43.532 INFO:tasks.workunit.client.0.smithi164.stdout:5/934: read - d7/d17/d21/d24/dbc/d43/f9f zero size 2024-02-10T00:00:43.532 INFO:tasks.workunit.client.0.smithi164.stdout:5/935: readlink l2 0 2024-02-10T00:00:43.534 INFO:tasks.workunit.client.0.smithi164.stdout:8/863: dread d2/d64/d65/d80/d32/d99/da0/fd8 [0,4194304] 0 2024-02-10T00:00:43.536 INFO:tasks.workunit.client.0.smithi164.stdout:7/851: dread d3/d5/d9b/db7/d4b/f6a [0,4194304] 0 2024-02-10T00:00:43.540 INFO:tasks.workunit.client.0.smithi164.stdout:8/864: dwrite d2/f39 [0,4194304] 0 2024-02-10T00:00:43.540 INFO:tasks.workunit.client.0.smithi164.stdout:0/805: dwrite d6/d3a/d52/f8e [0,4194304] 0 2024-02-10T00:00:43.542 INFO:tasks.workunit.client.0.smithi164.stdout:9/824: link d6/de/d22/dd3/d104/d8b/f2e d6/de/d22/d58/dba/d75/f10c 0 2024-02-10T00:00:43.549 INFO:tasks.workunit.client.0.smithi164.stdout:1/779: rename d1/f7 to d1/d1a/d41/f104 0 2024-02-10T00:00:43.549 INFO:tasks.workunit.client.0.smithi164.stdout:1/780: chown d1/d23/d70/fee 38046 1 2024-02-10T00:00:43.549 INFO:tasks.workunit.client.0.smithi164.stdout:1/781: stat d1/d1a/d41/l12 0 2024-02-10T00:00:43.554 INFO:tasks.workunit.client.0.smithi164.stdout:6/879: dread d0/d6/d95/dcd/f115 [0,4194304] 0 2024-02-10T00:00:43.555 INFO:tasks.workunit.client.0.smithi164.stdout:2/944: link d3/d26/l2b d3/da6/d7a/l148 0 2024-02-10T00:00:43.556 INFO:tasks.workunit.client.0.smithi164.stdout:4/848: getdents d2/d19/d16/d31/d57 0 2024-02-10T00:00:43.557 INFO:tasks.workunit.client.0.smithi164.stdout:7/852: symlink d3/d28/l11e 0 2024-02-10T00:00:43.560 INFO:tasks.workunit.client.0.smithi164.stdout:0/806: unlink d6/dec/da6/dea/d44/c4b 0 2024-02-10T00:00:43.560 INFO:tasks.workunit.client.0.smithi164.stdout:6/880: dread - d0/d6/d81/f96 zero size 2024-02-10T00:00:43.561 INFO:tasks.workunit.client.0.smithi164.stdout:2/945: mknod d3/da6/d7a/d8e/d88/c149 0 2024-02-10T00:00:43.562 INFO:tasks.workunit.client.0.smithi164.stdout:4/849: chown d2/d2f/d37/l39 786470 1 2024-02-10T00:00:43.563 INFO:tasks.workunit.client.0.smithi164.stdout:4/850: chown d2/d5a/cfb 636 1 2024-02-10T00:00:43.564 INFO:tasks.workunit.client.0.smithi164.stdout:4/851: dread - d2/d19/d16/d31/d7e/fc0 zero size 2024-02-10T00:00:43.566 INFO:tasks.workunit.client.0.smithi164.stdout:0/807: fsync d6/d10/d4a/d88/fde 0 2024-02-10T00:00:43.567 INFO:tasks.workunit.client.0.smithi164.stdout:8/865: truncate d2/d64/d65/d80/d32/d93/df1/dfa/fff 104083 0 2024-02-10T00:00:43.568 INFO:tasks.workunit.client.0.smithi164.stdout:1/782: creat d1/d1a/d41/d18/f105 x:0 0 0 2024-02-10T00:00:43.569 INFO:tasks.workunit.client.0.smithi164.stdout:9/825: link d6/de/lbb d6/de/d40/d74/l10d 0 2024-02-10T00:00:43.570 INFO:tasks.workunit.client.0.smithi164.stdout:9/826: dread - d6/de/d22/dd3/d104/d8b/d24/d4f/f100 zero size 2024-02-10T00:00:43.570 INFO:tasks.workunit.client.0.smithi164.stdout:6/881: mknod d0/d2b/d3a/dd0/df2/c123 0 2024-02-10T00:00:43.572 INFO:tasks.workunit.client.0.smithi164.stdout:9/827: chown d6/de/d22/d58/dba/d61/d76/d82/db7/c4c 1849 1 2024-02-10T00:00:43.573 INFO:tasks.workunit.client.0.smithi164.stdout:7/853: write d3/d11/d39/d3a/fba [305883,19856] 0 2024-02-10T00:00:43.575 INFO:tasks.workunit.client.0.smithi164.stdout:8/866: fsync d2/d64/d65/d80/d32/f38 0 2024-02-10T00:00:43.577 INFO:tasks.workunit.client.0.smithi164.stdout:4/852: mkdir d2/d2f/d37/d41/d3d/d42/da2/db5/d12a 0 2024-02-10T00:00:43.577 INFO:tasks.workunit.client.0.smithi164.stdout:0/808: dwrite d6/d10/d4a/d60/d6c/fb1 [0,4194304] 0 2024-02-10T00:00:43.577 INFO:tasks.workunit.client.0.smithi164.stdout:1/783: fdatasync d1/d1a/d41/d18/f30 0 2024-02-10T00:00:43.580 INFO:tasks.workunit.client.0.smithi164.stdout:8/867: write d2/d64/d65/d80/d32/d58/f104 [1458809,66171] 0 2024-02-10T00:00:43.581 INFO:tasks.workunit.client.0.smithi164.stdout:7/854: dwrite d3/d5/d59/f8c [4194304,4194304] 0 2024-02-10T00:00:43.583 INFO:tasks.workunit.client.0.smithi164.stdout:9/828: rename d6/de/d22/d58/dba/d61/d76/d82/db7/c53 to d6/de/d22/d58/dba/d75/c10e 0 2024-02-10T00:00:43.585 INFO:tasks.workunit.client.0.smithi164.stdout:8/868: dwrite d2/d64/d65/d80/d32/d4d/f57 [0,4194304] 0 2024-02-10T00:00:43.586 INFO:tasks.workunit.client.0.smithi164.stdout:8/869: read d2/f11 [5415016,69431] 0 2024-02-10T00:00:43.588 INFO:tasks.workunit.client.0.smithi164.stdout:8/870: chown d2/d64/d65/d80/d32/d4d/de9/l10a 188943647 1 2024-02-10T00:00:43.591 INFO:tasks.workunit.client.0.smithi164.stdout:3/755: sync 2024-02-10T00:00:43.593 INFO:tasks.workunit.client.0.smithi164.stdout:2/946: getdents d3/d32/d4e/d27 0 2024-02-10T00:00:43.593 INFO:tasks.workunit.client.0.smithi164.stdout:1/784: creat d1/d1a/d35/f106 x:0 0 0 2024-02-10T00:00:43.594 INFO:tasks.workunit.client.0.smithi164.stdout:1/785: readlink d1/d23/lae 0 2024-02-10T00:00:43.594 INFO:tasks.workunit.client.0.smithi164.stdout:0/809: mkdir d6/d10/d66/dfb 0 2024-02-10T00:00:43.595 INFO:tasks.workunit.client.0.smithi164.stdout:7/855: mkdir d3/d11/d39/d44/d10d/d11f 0 2024-02-10T00:00:43.596 INFO:tasks.workunit.client.0.smithi164.stdout:9/829: symlink d6/de/d22/dd3/d104/d8b/d24/d4f/dff/l10f 0 2024-02-10T00:00:43.597 INFO:tasks.workunit.client.0.smithi164.stdout:4/853: mkdir d2/d12b 0 2024-02-10T00:00:43.599 INFO:tasks.workunit.client.0.smithi164.stdout:8/871: rmdir d2/d64/d65/d80/d32/d93/db7 39 2024-02-10T00:00:43.600 INFO:tasks.workunit.client.0.smithi164.stdout:3/756: creat d0/d1/d2/d19/fed x:0 0 0 2024-02-10T00:00:43.601 INFO:tasks.workunit.client.0.smithi164.stdout:3/757: write d0/d1/fbe [229767,56522] 0 2024-02-10T00:00:43.602 INFO:tasks.workunit.client.0.smithi164.stdout:3/758: write d0/d3b/dce/f9e [137705,5756] 0 2024-02-10T00:00:43.603 INFO:tasks.workunit.client.0.smithi164.stdout:3/759: stat d0/d1/d2/d19/d27/d30 0 2024-02-10T00:00:43.605 INFO:tasks.workunit.client.0.smithi164.stdout:7/856: creat d3/d11/d39/d44/d6f/d75/f120 x:0 0 0 2024-02-10T00:00:43.607 INFO:tasks.workunit.client.0.smithi164.stdout:0/810: creat d6/d10/d4a/d60/d6c/df7/ffc x:0 0 0 2024-02-10T00:00:43.608 INFO:tasks.workunit.client.0.smithi164.stdout:5/936: sync 2024-02-10T00:00:43.609 INFO:tasks.workunit.client.0.smithi164.stdout:0/811: chown d6/d10/d4a/d88/dd3 247895 1 2024-02-10T00:00:43.610 INFO:tasks.workunit.client.0.smithi164.stdout:4/854: dwrite d2/d19/d16/d31/f4d [0,4194304] 0 2024-02-10T00:00:43.614 INFO:tasks.workunit.client.0.smithi164.stdout:8/872: link d2/d64/d54/d5f/fc7 d2/d64/d54/d5f/f111 0 2024-02-10T00:00:43.615 INFO:tasks.workunit.client.0.smithi164.stdout:1/786: dwrite d1/d13/d2b/d52/da4/dc2/dcc/ff7 [0,4194304] 0 2024-02-10T00:00:43.619 INFO:tasks.workunit.client.0.smithi164.stdout:6/882: truncate d0/d2b/d3a/dd0/d93/db4/fda 4036984 0 2024-02-10T00:00:43.619 INFO:tasks.workunit.client.0.smithi164.stdout:5/937: dread - d7/d17/d21/d24/dbc/d45/d5c/fb6 zero size 2024-02-10T00:00:43.619 INFO:tasks.workunit.client.0.smithi164.stdout:4/855: mkdir d2/d2f/d37/d45/d12c 0 2024-02-10T00:00:43.621 INFO:tasks.workunit.client.0.smithi164.stdout:5/938: write d7/d17/d21/d23/d5a/d68/d1f/fa5 [1347854,40532] 0 2024-02-10T00:00:43.621 INFO:tasks.workunit.client.0.smithi164.stdout:6/883: readlink d0/d3b/d56/db3/le3 0 2024-02-10T00:00:43.621 INFO:tasks.workunit.client.0.smithi164.stdout:5/939: fdatasync d7/d17/d79/fdc 0 2024-02-10T00:00:43.625 INFO:tasks.workunit.client.0.smithi164.stdout:0/812: symlink d6/d10/d4a/d88/dd3/lfd 0 2024-02-10T00:00:43.625 INFO:tasks.workunit.client.0.smithi164.stdout:1/787: creat d1/d23/d70/f107 x:0 0 0 2024-02-10T00:00:43.630 INFO:tasks.workunit.client.0.smithi164.stdout:6/884: mkdir d0/d6/d95/dcd/dc3/d124 0 2024-02-10T00:00:43.632 INFO:tasks.workunit.client.0.smithi164.stdout:8/873: read d2/d64/d65/d80/d32/d4d/f6b [1908149,101541] 0 2024-02-10T00:00:43.633 INFO:tasks.workunit.client.0.smithi164.stdout:8/874: write d2/d64/d65/d80/d32/d4d/f57 [1583783,2095] 0 2024-02-10T00:00:43.640 INFO:tasks.workunit.client.0.smithi164.stdout:3/760: rename d0/d1/c32 to d0/d1/dd/cee 0 2024-02-10T00:00:43.642 INFO:tasks.workunit.client.0.smithi164.stdout:9/830: truncate d6/de/d22/dd3/d104/d8b/f2c 238620 0 2024-02-10T00:00:43.643 INFO:tasks.workunit.client.0.smithi164.stdout:8/875: rmdir d2/d64/d54/d71 39 2024-02-10T00:00:43.645 INFO:tasks.workunit.client.0.smithi164.stdout:0/813: unlink d6/d7/l7c 0 2024-02-10T00:00:43.645 INFO:tasks.workunit.client.0.smithi164.stdout:2/947: dwrite d3/da6/d7a/d8e/db6/dce/f86 [0,4194304] 0 2024-02-10T00:00:43.646 INFO:tasks.workunit.client.0.smithi164.stdout:2/948: chown d3/da6/f31 409 1 2024-02-10T00:00:43.646 INFO:tasks.workunit.client.0.smithi164.stdout:0/814: chown d6/dec/da6/dea/d44/d90/d9d 0 1 2024-02-10T00:00:43.647 INFO:tasks.workunit.client.0.smithi164.stdout:0/815: readlink d6/dec/da6/dea/l9c 0 2024-02-10T00:00:43.648 INFO:tasks.workunit.client.0.smithi164.stdout:2/949: fsync d3/da6/d7a/d8e/d36/d54/f55 0 2024-02-10T00:00:43.648 INFO:tasks.workunit.client.0.smithi164.stdout:6/885: rename d0/d2b/d3a/d3d/d42/d5d/df0 to d0/d6/d95/dcd/d125 0 2024-02-10T00:00:43.651 INFO:tasks.workunit.client.0.smithi164.stdout:9/831: readlink d6/lf4 0 2024-02-10T00:00:43.653 INFO:tasks.workunit.client.0.smithi164.stdout:5/940: creat d7/d17/f148 x:0 0 0 2024-02-10T00:00:43.654 INFO:tasks.workunit.client.0.smithi164.stdout:5/941: chown d7/d17/d21/d24/l112 45830187 1 2024-02-10T00:00:43.655 INFO:tasks.workunit.client.0.smithi164.stdout:5/942: write d7/d17/d21/d23/d37/f93 [1602,51544] 0 2024-02-10T00:00:43.656 INFO:tasks.workunit.client.0.smithi164.stdout:7/857: dread d3/d11/d39/d44/d10d/d67/f86 [0,4194304] 0 2024-02-10T00:00:43.657 INFO:tasks.workunit.client.0.smithi164.stdout:5/943: readlink d7/d17/d79/d7b/dc5/dd7/le8 0 2024-02-10T00:00:43.658 INFO:tasks.workunit.client.0.smithi164.stdout:5/944: dread - d7/d17/d21/d23/d37/f102 zero size 2024-02-10T00:00:43.658 INFO:tasks.workunit.client.0.smithi164.stdout:7/858: fdatasync d3/d11/d39/d44/d6f/d75/fd1 0 2024-02-10T00:00:43.659 INFO:tasks.workunit.client.0.smithi164.stdout:7/859: readlink d3/d11/d39/d44/dbd/d107/dda/d5d/l87 0 2024-02-10T00:00:43.661 INFO:tasks.workunit.client.0.smithi164.stdout:6/886: fsync d0/d3b/d56/fd7 0 2024-02-10T00:00:43.662 INFO:tasks.workunit.client.0.smithi164.stdout:6/887: dread - d0/d6/d12/ff8 zero size 2024-02-10T00:00:43.663 INFO:tasks.workunit.client.0.smithi164.stdout:2/950: creat d3/da6/d7a/d8e/d36/d143/f14a x:0 0 0 2024-02-10T00:00:43.665 INFO:tasks.workunit.client.0.smithi164.stdout:1/788: rename d1/d64/dc7/fc9 to d1/d13/d2b/d52/da4/dc3/f108 0 2024-02-10T00:00:43.666 INFO:tasks.workunit.client.0.smithi164.stdout:9/832: mknod d6/de/d22/dd3/d104/d8b/d24/d4f/dff/c110 0 2024-02-10T00:00:43.666 INFO:tasks.workunit.client.0.smithi164.stdout:4/856: link d2/d19/d16/d31/c3b d2/d2f/c12d 0 2024-02-10T00:00:43.674 INFO:tasks.workunit.client.0.smithi164.stdout:4/857: chown d2/d2f/d37/d41/d3d/d56/c86 2154662 1 2024-02-10T00:00:43.675 INFO:tasks.workunit.client.0.smithi164.stdout:4/858: write d2/d19/d16/d31/f74 [3783296,32119] 0 2024-02-10T00:00:43.702 INFO:tasks.workunit.client.0.smithi164.stdout:9/833: mkdir d6/de/d22/d58/dba/d61/d76/da5/d111 0 2024-02-10T00:00:43.703 INFO:tasks.workunit.client.0.smithi164.stdout:7/860: unlink d3/d28/fa9 0 2024-02-10T00:00:43.703 INFO:tasks.workunit.client.0.smithi164.stdout:1/789: symlink d1/d13/l109 0 2024-02-10T00:00:43.703 INFO:tasks.workunit.client.0.smithi164.stdout:0/816: dread d6/d10/d18/d2d/fb3 [4194304,4194304] 0 2024-02-10T00:00:43.705 INFO:tasks.workunit.client.0.smithi164.stdout:7/861: chown d3/d11/d39/d44/cf7 2 1 2024-02-10T00:00:43.705 INFO:tasks.workunit.client.0.smithi164.stdout:6/888: truncate d0/d2b/d3a/f5e 5065047 0 2024-02-10T00:00:43.706 INFO:tasks.workunit.client.0.smithi164.stdout:4/859: creat d2/d19/d16/d31/d72/f12e x:0 0 0 2024-02-10T00:00:43.709 INFO:tasks.workunit.client.0.smithi164.stdout:5/945: getdents d7/d17/d21/d85 0 2024-02-10T00:00:43.710 INFO:tasks.workunit.client.0.smithi164.stdout:9/834: read d6/de/d22/d58/dba/d61/d76/d82/db7/f9e [94648,49106] 0 2024-02-10T00:00:43.710 INFO:tasks.workunit.client.0.smithi164.stdout:6/889: unlink d0/d3b/d56/fd7 0 2024-02-10T00:00:43.711 INFO:tasks.workunit.client.0.smithi164.stdout:1/790: dread d1/d23/f7d [0,4194304] 0 2024-02-10T00:00:43.711 INFO:tasks.workunit.client.0.smithi164.stdout:3/761: dwrite d0/d3b/dce/de1/d84/f62 [0,4194304] 0 2024-02-10T00:00:43.712 INFO:tasks.workunit.client.0.smithi164.stdout:0/817: link d6/d10/d18/d1c/f3b d6/dec/da6/dea/d44/ffe 0 2024-02-10T00:00:43.713 INFO:tasks.workunit.client.0.smithi164.stdout:6/890: stat d0/d6/d95/dcd/dc3 0 2024-02-10T00:00:43.713 INFO:tasks.workunit.client.0.smithi164.stdout:4/860: creat d2/d19/d10f/f12f x:0 0 0 2024-02-10T00:00:43.715 INFO:tasks.workunit.client.0.smithi164.stdout:5/946: creat d7/d17/d21/d23/d5a/d68/d1f/d110/f149 x:0 0 0 2024-02-10T00:00:43.716 INFO:tasks.workunit.client.0.smithi164.stdout:8/876: sync 2024-02-10T00:00:43.716 INFO:tasks.workunit.client.0.smithi164.stdout:7/862: link d3/d11/d39/d44/dbd/d107/dda/f10a d3/d5/d59/f121 0 2024-02-10T00:00:43.717 INFO:tasks.workunit.client.0.smithi164.stdout:6/891: write d0/d2b/d3a/dd0/f7a [1500454,72898] 0 2024-02-10T00:00:43.718 INFO:tasks.workunit.client.0.smithi164.stdout:8/877: chown d2/d64/d65/d80/d32/d58/f79 33683 1 2024-02-10T00:00:43.718 INFO:tasks.workunit.client.0.smithi164.stdout:4/861: mknod d2/d19/c130 0 2024-02-10T00:00:43.719 INFO:tasks.workunit.client.0.smithi164.stdout:1/791: mknod d1/d1a/d9a/c10a 0 2024-02-10T00:00:43.719 INFO:tasks.workunit.client.0.smithi164.stdout:4/862: write d2/d2f/d37/d41/f46 [1848553,81052] 0 2024-02-10T00:00:43.721 INFO:tasks.workunit.client.0.smithi164.stdout:5/947: creat d7/d17/d79/dde/def/f14a x:0 0 0 2024-02-10T00:00:43.724 INFO:tasks.workunit.client.0.smithi164.stdout:4/863: dwrite d2/d19/dc1/f101 [0,4194304] 0 2024-02-10T00:00:43.725 INFO:tasks.workunit.client.0.smithi164.stdout:4/864: readlink d2/d19/l24 0 2024-02-10T00:00:43.726 INFO:tasks.workunit.client.0.smithi164.stdout:5/948: unlink d7/l11 0 2024-02-10T00:00:43.729 INFO:tasks.workunit.client.0.smithi164.stdout:8/878: creat d2/d64/d65/d80/d32/f112 x:0 0 0 2024-02-10T00:00:43.731 INFO:tasks.workunit.client.0.smithi164.stdout:8/879: chown d2/d64/d65/da9/l10b 8 1 2024-02-10T00:00:43.733 INFO:tasks.workunit.client.0.smithi164.stdout:6/892: rename d0/d2b/d3a/dd0/f44 to d0/d2b/d3a/d3d/d42/f126 0 2024-02-10T00:00:43.734 INFO:tasks.workunit.client.0.smithi164.stdout:1/792: creat d1/f10b x:0 0 0 2024-02-10T00:00:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:9/835: dread d6/de/d2b/f3c [0,4194304] 0 2024-02-10T00:00:43.735 INFO:tasks.workunit.client.0.smithi164.stdout:4/865: fdatasync d2/d2f/d37/d45/dab/dbd/fdf 0 2024-02-10T00:00:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:8/880: rename d2/d64/d54/f7c to d2/d64/d65/d80/d32/d93/df1/dfa/f113 0 2024-02-10T00:00:43.740 INFO:tasks.workunit.client.0.smithi164.stdout:3/762: dread d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:2/951: sync 2024-02-10T00:00:43.742 INFO:tasks.workunit.client.0.smithi164.stdout:0/818: truncate d6/d10/d18/d2d/f2e 267575 0 2024-02-10T00:00:43.743 INFO:tasks.workunit.client.0.smithi164.stdout:3/763: dread d0/d3b/dce/de1/d84/f62 [4194304,4194304] 0 2024-02-10T00:00:43.746 INFO:tasks.workunit.client.0.smithi164.stdout:7/863: dwrite d3/d5/d9b/fd9 [0,4194304] 0 2024-02-10T00:00:43.748 INFO:tasks.workunit.client.0.smithi164.stdout:9/836: unlink d6/de/d22/dd3/d104/d8b/d24/f45 0 2024-02-10T00:00:43.748 INFO:tasks.workunit.client.0.smithi164.stdout:9/837: stat d6/lf4 0 2024-02-10T00:00:43.750 INFO:tasks.workunit.client.0.smithi164.stdout:5/949: creat d7/d17/d21/d23/d37/f14b x:0 0 0 2024-02-10T00:00:43.751 INFO:tasks.workunit.client.0.smithi164.stdout:5/950: write d7/d17/d21/d23/d5a/d68/fd8 [566110,85848] 0 2024-02-10T00:00:43.751 INFO:tasks.workunit.client.0.smithi164.stdout:4/866: rename d2/d19/dc1/ff6 to d2/d2f/d37/dff/f131 0 2024-02-10T00:00:43.751 INFO:tasks.workunit.client.0.smithi164.stdout:5/951: chown d7/f19 939 1 2024-02-10T00:00:43.751 INFO:tasks.workunit.client.0.smithi164.stdout:4/867: write d2/d19/d10f/f12f [934876,117941] 0 2024-02-10T00:00:43.752 INFO:tasks.workunit.client.0.smithi164.stdout:2/952: fsync d3/d24/ffc 0 2024-02-10T00:00:43.756 INFO:tasks.workunit.client.0.smithi164.stdout:6/893: mkdir d0/d2b/d3a/d3d/d42/d127 0 2024-02-10T00:00:43.756 INFO:tasks.workunit.client.0.smithi164.stdout:0/819: symlink d6/dec/da6/de6/lff 0 2024-02-10T00:00:43.758 INFO:tasks.workunit.client.0.smithi164.stdout:7/864: mknod d3/d11/d39/d44/d10d/d67/c122 0 2024-02-10T00:00:43.759 INFO:tasks.workunit.client.0.smithi164.stdout:8/881: mknod d2/d64/d65/d80/d32/d93/c114 0 2024-02-10T00:00:43.762 INFO:tasks.workunit.client.0.smithi164.stdout:7/865: dwrite d3/d5/d9b/fd9 [0,4194304] 0 2024-02-10T00:00:43.764 INFO:tasks.workunit.client.0.smithi164.stdout:6/894: unlink d0/d2b/d3a/f53 0 2024-02-10T00:00:43.768 INFO:tasks.workunit.client.0.smithi164.stdout:8/882: mkdir d2/d115 0 2024-02-10T00:00:43.773 INFO:tasks.workunit.client.0.smithi164.stdout:6/895: rename d0/d6/d12/d14/f24 to d0/d2b/d3a/d3d/d42/d5d/d66/ddc/f128 0 2024-02-10T00:00:43.779 INFO:tasks.workunit.client.0.smithi164.stdout:3/764: write d0/d1/d2/d19/d27/fb5 [232431,8499] 0 2024-02-10T00:00:43.781 INFO:tasks.workunit.client.0.smithi164.stdout:1/793: dwrite d1/d13/d2b/d52/d56/fdc [0,4194304] 0 2024-02-10T00:00:43.783 INFO:tasks.workunit.client.0.smithi164.stdout:1/794: write d1/d23/d70/f107 [982853,24701] 0 2024-02-10T00:00:43.783 INFO:tasks.workunit.client.0.smithi164.stdout:2/953: write d3/da6/d7a/d8e/d36/d54/f9f [563850,33961] 0 2024-02-10T00:00:43.783 INFO:tasks.workunit.client.0.smithi164.stdout:0/820: write d6/fa5 [686648,23615] 0 2024-02-10T00:00:43.785 INFO:tasks.workunit.client.0.smithi164.stdout:6/896: chown d0/d2b/d3a/dd0/d93/db4/fda 446274358 1 2024-02-10T00:00:43.786 INFO:tasks.workunit.client.0.smithi164.stdout:0/821: chown d6/d10/d18/lbd 47553452 1 2024-02-10T00:00:43.786 INFO:tasks.workunit.client.0.smithi164.stdout:5/952: dread d7/d17/d21/d23/d37/d36/d8b/f10e [0,4194304] 0 2024-02-10T00:00:43.788 INFO:tasks.workunit.client.0.smithi164.stdout:2/954: write d3/da6/d7a/d8e/d36/d143/f14a [305114,59486] 0 2024-02-10T00:00:43.788 INFO:tasks.workunit.client.0.smithi164.stdout:6/897: chown d0/d6/d12/d14/f50 576 1 2024-02-10T00:00:43.788 INFO:tasks.workunit.client.0.smithi164.stdout:7/866: link d3/d11/d39/d44/dbd/ld7 d3/d11/d39/d44/d6f/d75/l123 0 2024-02-10T00:00:43.790 INFO:tasks.workunit.client.0.smithi164.stdout:6/898: chown d0/d6/d12/d14/d4b/c69 211 1 2024-02-10T00:00:43.793 INFO:tasks.workunit.client.0.smithi164.stdout:2/955: dwrite d3/d24/d5b/fe3 [4194304,4194304] 0 2024-02-10T00:00:43.797 INFO:tasks.workunit.client.0.smithi164.stdout:0/822: dread d6/dec/da6/dea/d44/d90/d9d/fbe [0,4194304] 0 2024-02-10T00:00:43.799 INFO:tasks.workunit.client.0.smithi164.stdout:8/883: dread d2/d64/d54/d5f/f101 [0,4194304] 0 2024-02-10T00:00:43.800 INFO:tasks.workunit.client.0.smithi164.stdout:8/884: write d2/d64/d54/db9/fde [68168,118986] 0 2024-02-10T00:00:43.801 INFO:tasks.workunit.client.0.smithi164.stdout:8/885: write d2/f7 [3583876,95297] 0 2024-02-10T00:00:43.802 INFO:tasks.workunit.client.0.smithi164.stdout:8/886: write d2/d81/f95 [8520818,63475] 0 2024-02-10T00:00:43.830 INFO:tasks.workunit.client.0.smithi164.stdout:7/867: dread d3/d11/d39/d44/d6f/d75/fd1 [0,4194304] 0 2024-02-10T00:00:43.830 INFO:tasks.workunit.client.0.smithi164.stdout:7/868: fsync d3/d11/d39/d44/d48/fea 0 2024-02-10T00:00:43.843 INFO:tasks.workunit.client.0.smithi164.stdout:4/868: sync 2024-02-10T00:00:43.847 INFO:tasks.workunit.client.0.smithi164.stdout:3/765: rmdir d0/d1/d2/d17/d37/d9b 39 2024-02-10T00:00:43.849 INFO:tasks.workunit.client.0.smithi164.stdout:1/795: chown d1/d1a/d75/de0/ceb 3906 1 2024-02-10T00:00:43.856 INFO:tasks.workunit.client.0.smithi164.stdout:5/953: dwrite d7/d17/d21/d23/d37/d36/f46 [4194304,4194304] 0 2024-02-10T00:00:43.856 INFO:tasks.workunit.client.0.smithi164.stdout:8/887: stat d2/d64/d54/ff6 0 2024-02-10T00:00:43.866 INFO:tasks.workunit.client.0.smithi164.stdout:6/899: mknod d0/d3b/dd4/c129 0 2024-02-10T00:00:43.869 INFO:tasks.workunit.client.0.smithi164.stdout:0/823: link d6/dec/f54 d6/dec/d79/dce/f100 0 2024-02-10T00:00:43.872 INFO:tasks.workunit.client.0.smithi164.stdout:3/766: link d0/d3b/dce/de1/d84/l23 d0/d1/d2/d19/d27/d5f/da5/d94/dbd/lef 0 2024-02-10T00:00:43.873 INFO:tasks.workunit.client.0.smithi164.stdout:0/824: dwrite d6/d10/d18/d2d/d39/f9b [0,4194304] 0 2024-02-10T00:00:43.878 INFO:tasks.workunit.client.0.smithi164.stdout:8/888: dread d2/d64/d54/db9/ff8 [0,4194304] 0 2024-02-10T00:00:43.886 INFO:tasks.workunit.client.0.smithi164.stdout:5/954: dread d7/d17/d21/d24/dbc/d43/f53 [0,4194304] 0 2024-02-10T00:00:43.887 INFO:tasks.workunit.client.0.smithi164.stdout:5/955: write d7/d17/d21/d23/f72 [1143949,46087] 0 2024-02-10T00:00:43.914 INFO:tasks.workunit.client.0.smithi164.stdout:1/796: mknod d1/d13/d2b/d52/c10c 0 2024-02-10T00:00:43.917 INFO:tasks.workunit.client.0.smithi164.stdout:4/869: sync 2024-02-10T00:00:43.918 INFO:tasks.workunit.client.0.smithi164.stdout:4/870: stat d2/d19/d16/d31/d4b/lb0 0 2024-02-10T00:00:43.925 INFO:tasks.workunit.client.0.smithi164.stdout:9/838: write d6/de/d22/d58/dba/d75/dc0/fc8 [1648134,78256] 0 2024-02-10T00:00:43.927 INFO:tasks.workunit.client.0.smithi164.stdout:2/956: write d3/f15 [8871613,79769] 0 2024-02-10T00:00:43.928 INFO:tasks.workunit.client.0.smithi164.stdout:7/869: truncate d3/d11/d39/d44/d6f/d75/fe7 2289147 0 2024-02-10T00:00:43.930 INFO:tasks.workunit.client.0.smithi164.stdout:0/825: mkdir d6/dec/d79/dce/d101 0 2024-02-10T00:00:43.935 INFO:tasks.workunit.client.0.smithi164.stdout:6/900: dwrite d0/d6/d95/f104 [0,4194304] 0 2024-02-10T00:00:43.952 INFO:tasks.workunit.client.0.smithi164.stdout:5/956: sync 2024-02-10T00:00:43.955 INFO:tasks.workunit.client.0.smithi164.stdout:5/957: fdatasync d7/d17/d21/d23/d5a/d68/d1f/dbe/fc4 0 2024-02-10T00:00:43.956 INFO:tasks.workunit.client.0.smithi164.stdout:4/871: mknod d2/d5a/d94/c132 0 2024-02-10T00:00:43.959 INFO:tasks.workunit.client.0.smithi164.stdout:9/839: creat d6/de/d22/dd3/d104/f112 x:0 0 0 2024-02-10T00:00:43.960 INFO:tasks.workunit.client.0.smithi164.stdout:2/957: creat d3/da6/d7a/d8e/d36/d54/d11b/f14b x:0 0 0 2024-02-10T00:00:43.961 INFO:tasks.workunit.client.0.smithi164.stdout:7/870: write d3/d5/d9b/db7/d4b/f6a [3613455,113667] 0 2024-02-10T00:00:43.962 INFO:tasks.workunit.client.0.smithi164.stdout:0/826: chown d6/d10/d4a/d88/fc4 12682795 1 2024-02-10T00:00:43.962 INFO:tasks.workunit.client.0.smithi164.stdout:0/827: dread - d6/d10/fd0 zero size 2024-02-10T00:00:43.966 INFO:tasks.workunit.client.0.smithi164.stdout:3/767: dwrite d0/d3b/dce/de1/d84/f88 [0,4194304] 0 2024-02-10T00:00:43.967 INFO:tasks.workunit.client.0.smithi164.stdout:3/768: readlink d0/d1/d2/d19/d27/d5f/da5/d94/lc5 0 2024-02-10T00:00:43.970 INFO:tasks.workunit.client.0.smithi164.stdout:9/840: creat d6/de/d22/d58/dba/f113 x:0 0 0 2024-02-10T00:00:43.971 INFO:tasks.workunit.client.0.smithi164.stdout:2/958: symlink d3/d26/d64/l14c 0 2024-02-10T00:00:43.973 INFO:tasks.workunit.client.0.smithi164.stdout:0/828: symlink d6/dec/d79/dce/l102 0 2024-02-10T00:00:43.973 INFO:tasks.workunit.client.0.smithi164.stdout:0/829: stat d6/d10/d4a/d60/d6c/lf2 0 2024-02-10T00:00:43.974 INFO:tasks.workunit.client.0.smithi164.stdout:0/830: dread - d6/dec/d79/dce/ffa zero size 2024-02-10T00:00:43.975 INFO:tasks.workunit.client.0.smithi164.stdout:6/901: mknod d0/d2b/d3a/d3d/d42/d5d/c12a 0 2024-02-10T00:00:43.976 INFO:tasks.workunit.client.0.smithi164.stdout:8/889: creat d2/d64/d65/d80/d32/d99/d9e/f116 x:0 0 0 2024-02-10T00:00:43.977 INFO:tasks.workunit.client.0.smithi164.stdout:1/797: truncate d1/d1a/d75/fff 937549 0 2024-02-10T00:00:43.978 INFO:tasks.workunit.client.0.smithi164.stdout:3/769: mknod d0/d1/d3c/cf0 0 2024-02-10T00:00:43.979 INFO:tasks.workunit.client.0.smithi164.stdout:3/770: stat d0/fa0 0 2024-02-10T00:00:43.980 INFO:tasks.workunit.client.0.smithi164.stdout:6/902: dwrite d0/d2b/d3a/d3d/d42/d5d/f102 [0,4194304] 0 2024-02-10T00:00:43.981 INFO:tasks.workunit.client.0.smithi164.stdout:9/841: mknod d6/de/d22/d69/c114 0 2024-02-10T00:00:43.983 INFO:tasks.workunit.client.0.smithi164.stdout:7/871: symlink d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/dd6/l124 0 2024-02-10T00:00:43.983 INFO:tasks.workunit.client.0.smithi164.stdout:0/831: creat d6/dec/d79/f103 x:0 0 0 2024-02-10T00:00:43.986 INFO:tasks.workunit.client.0.smithi164.stdout:1/798: dwrite d1/d1a/d35/ff0 [0,4194304] 0 2024-02-10T00:00:43.987 INFO:tasks.workunit.client.0.smithi164.stdout:7/872: write d3/d11/d39/d44/d10d/da7/fc5 [63864,97238] 0 2024-02-10T00:00:43.987 INFO:tasks.workunit.client.0.smithi164.stdout:4/872: truncate d2/d2f/f54 300838 0 2024-02-10T00:00:43.989 INFO:tasks.workunit.client.0.smithi164.stdout:4/873: fsync d2/d2f/d37/d45/fa7 0 2024-02-10T00:00:43.990 INFO:tasks.workunit.client.0.smithi164.stdout:3/771: read d0/d1/d2/d19/d27/d5f/da5/f91 [24442,113360] 0 2024-02-10T00:00:43.990 INFO:tasks.workunit.client.0.smithi164.stdout:8/890: mknod d2/d64/d65/d80/d32/d4d/de9/c117 0 2024-02-10T00:00:43.991 INFO:tasks.workunit.client.0.smithi164.stdout:0/832: dwrite d6/d7/f58 [0,4194304] 0 2024-02-10T00:00:43.993 INFO:tasks.workunit.client.0.smithi164.stdout:2/959: mknod d3/d26/c14d 0 2024-02-10T00:00:43.994 INFO:tasks.workunit.client.0.smithi164.stdout:9/842: rename d6/de/d22/dd3/d104/d8b/d24/d4f/dff/c110 to d6/de/de2/c115 0 2024-02-10T00:00:44.000 INFO:tasks.workunit.client.0.smithi164.stdout:4/874: unlink d2/d2f/d37/d71/f128 0 2024-02-10T00:00:44.002 INFO:tasks.workunit.client.0.smithi164.stdout:5/958: sync 2024-02-10T00:00:44.003 INFO:tasks.workunit.client.0.smithi164.stdout:9/843: creat d6/de/d22/d58/dba/d75/dc0/f116 x:0 0 0 2024-02-10T00:00:44.004 INFO:tasks.workunit.client.0.smithi164.stdout:6/903: rmdir d0/d2b/d3a/d3d/d42/d127 0 2024-02-10T00:00:44.005 INFO:tasks.workunit.client.0.smithi164.stdout:4/875: dwrite d2/d2f/d37/d41/f35 [4194304,4194304] 0 2024-02-10T00:00:44.009 INFO:tasks.workunit.client.0.smithi164.stdout:9/844: dwrite d6/f7 [4194304,4194304] 0 2024-02-10T00:00:44.012 INFO:tasks.workunit.client.0.smithi164.stdout:4/876: dread d2/d2f/d37/d41/fdb [0,4194304] 0 2024-02-10T00:00:44.012 INFO:tasks.workunit.client.0.smithi164.stdout:5/959: unlink d7/lee 0 2024-02-10T00:00:44.015 INFO:tasks.workunit.client.0.smithi164.stdout:7/873: rename d3/f5f to d3/d28/f125 0 2024-02-10T00:00:44.017 INFO:tasks.workunit.client.0.smithi164.stdout:8/891: getdents d2/d64/d65/d80/d32/d99/d9e 0 2024-02-10T00:00:44.018 INFO:tasks.workunit.client.0.smithi164.stdout:8/892: chown d2/d64 14 1 2024-02-10T00:00:44.021 INFO:tasks.workunit.client.0.smithi164.stdout:6/904: mknod d0/d2b/d3a/d3d/d42/d5d/c12b 0 2024-02-10T00:00:44.023 INFO:tasks.workunit.client.0.smithi164.stdout:2/960: getdents d3/da6/d7a/d8e/d88 0 2024-02-10T00:00:44.024 INFO:tasks.workunit.client.0.smithi164.stdout:2/961: chown d3/f4a 10 1 2024-02-10T00:00:44.024 INFO:tasks.workunit.client.0.smithi164.stdout:7/874: creat d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/dd6/f126 x:0 0 0 2024-02-10T00:00:44.026 INFO:tasks.workunit.client.0.smithi164.stdout:6/905: dwrite d0/d6/d12/d14/f50 [0,4194304] 0 2024-02-10T00:00:44.033 INFO:tasks.workunit.client.0.smithi164.stdout:0/833: truncate d6/d10/d18/d2d/f84 1963803 0 2024-02-10T00:00:44.033 INFO:tasks.workunit.client.0.smithi164.stdout:3/772: write d0/d1/dd/f8d [163295,101253] 0 2024-02-10T00:00:44.036 INFO:tasks.workunit.client.0.smithi164.stdout:4/877: mkdir d2/d19/d16/d31/d72/d117/d133 0 2024-02-10T00:00:44.037 INFO:tasks.workunit.client.0.smithi164.stdout:4/878: write d2/d2f/d37/d41/f6e [3212345,64375] 0 2024-02-10T00:00:44.038 INFO:tasks.workunit.client.0.smithi164.stdout:4/879: write d2/d2f/d37/d45/f11b [216140,117060] 0 2024-02-10T00:00:44.038 INFO:tasks.workunit.client.0.smithi164.stdout:5/960: write d7/d17/f83 [3963815,94506] 0 2024-02-10T00:00:44.039 INFO:tasks.workunit.client.0.smithi164.stdout:2/962: mknod d3/d26/d56/db9/c14e 0 2024-02-10T00:00:44.040 INFO:tasks.workunit.client.0.smithi164.stdout:0/834: rmdir d6/d3a/d52 39 2024-02-10T00:00:44.041 INFO:tasks.workunit.client.0.smithi164.stdout:3/773: mkdir d0/d3b/dce/de1/df1 0 2024-02-10T00:00:44.041 INFO:tasks.workunit.client.0.smithi164.stdout:2/963: write d3/d26/d56/db9/f13d [994067,31243] 0 2024-02-10T00:00:44.042 INFO:tasks.workunit.client.0.smithi164.stdout:9/845: dwrite d6/f3e [4194304,4194304] 0 2024-02-10T00:00:44.044 INFO:tasks.workunit.client.0.smithi164.stdout:9/846: dread - d6/de/d22/dd3/d104/d8b/d24/d4f/f5d zero size 2024-02-10T00:00:44.045 INFO:tasks.workunit.client.0.smithi164.stdout:7/875: mkdir d3/d11/d39/d3a/def/d127 0 2024-02-10T00:00:44.046 INFO:tasks.workunit.client.0.smithi164.stdout:2/964: fdatasync d3/da6/d7a/d8e/d36/f43 0 2024-02-10T00:00:44.047 INFO:tasks.workunit.client.0.smithi164.stdout:2/965: chown d3/da6/d7a/d8e/d36/lb5 41538 1 2024-02-10T00:00:44.048 INFO:tasks.workunit.client.0.smithi164.stdout:5/961: mkdir d7/d17/d21/d14c 0 2024-02-10T00:00:44.052 INFO:tasks.workunit.client.0.smithi164.stdout:9/847: creat d6/f117 x:0 0 0 2024-02-10T00:00:44.053 INFO:tasks.workunit.client.0.smithi164.stdout:0/835: mkdir d6/d10/d66/dfb/d104 0 2024-02-10T00:00:44.054 INFO:tasks.workunit.client.0.smithi164.stdout:1/799: dwrite d1/d1a/d75/fff [0,4194304] 0 2024-02-10T00:00:44.058 INFO:tasks.workunit.client.0.smithi164.stdout:7/876: creat d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/dd6/f128 x:0 0 0 2024-02-10T00:00:44.060 INFO:tasks.workunit.client.0.smithi164.stdout:5/962: chown d7/d17/d69/d92/da8/le7 27275 1 2024-02-10T00:00:44.060 INFO:tasks.workunit.client.0.smithi164.stdout:8/893: dwrite d2/d64/d65/d80/d32/d93/df1/dfa/fff [0,4194304] 0 2024-02-10T00:00:44.062 INFO:tasks.workunit.client.0.smithi164.stdout:7/877: readlink d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/dd6/l124 0 2024-02-10T00:00:44.062 INFO:tasks.workunit.client.0.smithi164.stdout:8/894: write d2/d81/f95 [7252417,116247] 0 2024-02-10T00:00:44.063 INFO:tasks.workunit.client.0.smithi164.stdout:1/800: dwrite d1/d1a/d75/fe2 [0,4194304] 0 2024-02-10T00:00:44.064 INFO:tasks.workunit.client.0.smithi164.stdout:3/774: getdents d0/d8f/d9a 0 2024-02-10T00:00:44.067 INFO:tasks.workunit.client.0.smithi164.stdout:2/966: symlink d3/da6/d7a/d8e/d36/d54/d11e/l14f 0 2024-02-10T00:00:44.068 INFO:tasks.workunit.client.0.smithi164.stdout:6/906: sync 2024-02-10T00:00:44.073 INFO:tasks.workunit.client.0.smithi164.stdout:4/880: chown d2/d2f/f54 6784 1 2024-02-10T00:00:44.074 INFO:tasks.workunit.client.0.smithi164.stdout:4/881: stat d2/d19 0 2024-02-10T00:00:44.077 INFO:tasks.workunit.client.0.smithi164.stdout:6/907: symlink d0/d2b/d3a/d3d/d42/d5d/d79/dbc/l12c 0 2024-02-10T00:00:44.078 INFO:tasks.workunit.client.0.smithi164.stdout:9/848: dread d6/f1e [0,4194304] 0 2024-02-10T00:00:44.079 INFO:tasks.workunit.client.0.smithi164.stdout:7/878: link d3/d11/d39/d44/d48/d71/f101 d3/d11/d39/d44/d48/d50/f129 0 2024-02-10T00:00:44.081 INFO:tasks.workunit.client.0.smithi164.stdout:4/882: symlink d2/d19/d16/d31/d72/d117/l134 0 2024-02-10T00:00:44.081 INFO:tasks.workunit.client.0.smithi164.stdout:2/967: symlink d3/d24/d5b/d137/l150 0 2024-02-10T00:00:44.083 INFO:tasks.workunit.client.0.smithi164.stdout:3/775: link d0/d1/d2/d19/c5d d0/d8f/d9a/db0/de7/cf2 0 2024-02-10T00:00:44.085 INFO:tasks.workunit.client.0.smithi164.stdout:4/883: creat d2/d2f/d37/d45/dd9/f135 x:0 0 0 2024-02-10T00:00:44.087 INFO:tasks.workunit.client.0.smithi164.stdout:7/879: dwrite d3/d11/d39/d44/dbd/d107/dda/d5d/f106 [0,4194304] 0 2024-02-10T00:00:44.091 INFO:tasks.workunit.client.0.smithi164.stdout:2/968: truncate d3/da6/d7a/d8e/d88/f95 1189596 0 2024-02-10T00:00:44.091 INFO:tasks.workunit.client.0.smithi164.stdout:9/849: dwrite d6/de/de2/fbd [0,4194304] 0 2024-02-10T00:00:44.095 INFO:tasks.workunit.client.0.smithi164.stdout:3/776: rename d0/d3b/dce/de1/ld2 to d0/d1/d2/d17/d37/d9b/lf3 0 2024-02-10T00:00:44.097 INFO:tasks.workunit.client.0.smithi164.stdout:1/801: dwrite d1/fd [0,4194304] 0 2024-02-10T00:00:44.097 INFO:tasks.workunit.client.0.smithi164.stdout:7/880: creat d3/d11/d39/d44/d10d/d67/d98/daf/f12a x:0 0 0 2024-02-10T00:00:44.098 INFO:tasks.workunit.client.0.smithi164.stdout:6/908: link d0/d6/d12/d45/f65 d0/d2b/d3a/dd0/d93/f12d 0 2024-02-10T00:00:44.099 INFO:tasks.workunit.client.0.smithi164.stdout:2/969: creat d3/d24/df0/f151 x:0 0 0 2024-02-10T00:00:44.101 INFO:tasks.workunit.client.0.smithi164.stdout:5/963: dwrite d7/d17/d21/d24/f28 [0,4194304] 0 2024-02-10T00:00:44.101 INFO:tasks.workunit.client.0.smithi164.stdout:8/895: dwrite d2/d64/d54/d5f/fc7 [0,4194304] 0 2024-02-10T00:00:44.101 INFO:tasks.workunit.client.0.smithi164.stdout:3/777: rmdir d0/d1/d2 39 2024-02-10T00:00:44.102 INFO:tasks.workunit.client.0.smithi164.stdout:0/836: dread d6/d3a/d52/fc8 [0,4194304] 0 2024-02-10T00:00:44.103 INFO:tasks.workunit.client.0.smithi164.stdout:6/909: chown d0/d2b/d3a/d3d/f74 42301 1 2024-02-10T00:00:44.104 INFO:tasks.workunit.client.0.smithi164.stdout:1/802: mkdir d1/d13/d2b/d52/da4/dc2/dcc/d10d 0 2024-02-10T00:00:44.104 INFO:tasks.workunit.client.0.smithi164.stdout:4/884: getdents d2/d19/d16/d31/d4b/d120 0 2024-02-10T00:00:44.105 INFO:tasks.workunit.client.0.smithi164.stdout:9/850: creat d6/de/d22/dd3/d104/d8b/d24/f118 x:0 0 0 2024-02-10T00:00:44.107 INFO:tasks.workunit.client.0.smithi164.stdout:6/910: mknod d0/d6/d81/c12e 0 2024-02-10T00:00:44.109 INFO:tasks.workunit.client.0.smithi164.stdout:1/803: mknod d1/d13/d2b/c10e 0 2024-02-10T00:00:44.110 INFO:tasks.workunit.client.0.smithi164.stdout:7/881: symlink d3/d11/d39/d44/dbd/d107/dda/d5d/df9/l12b 0 2024-02-10T00:00:44.111 INFO:tasks.workunit.client.0.smithi164.stdout:5/964: getdents d7/d17/d21/d85 0 2024-02-10T00:00:44.114 INFO:tasks.workunit.client.0.smithi164.stdout:4/885: dwrite d2/d2f/d37/d41/fef [0,4194304] 0 2024-02-10T00:00:44.114 INFO:tasks.workunit.client.0.smithi164.stdout:3/778: mknod d0/d8f/d9a/db0/de7/cf4 0 2024-02-10T00:00:44.116 INFO:tasks.workunit.client.0.smithi164.stdout:9/851: dwrite d6/de/d22/d58/dba/f6c [0,4194304] 0 2024-02-10T00:00:44.118 INFO:tasks.workunit.client.0.smithi164.stdout:6/911: truncate d0/d6/f32 474951 0 2024-02-10T00:00:44.118 INFO:tasks.workunit.client.0.smithi164.stdout:1/804: mknod d1/d13/d2b/d52/da4/dc3/dcd/c10f 0 2024-02-10T00:00:44.119 INFO:tasks.workunit.client.0.smithi164.stdout:6/912: write d0/d6/d12/f67 [1157949,121298] 0 2024-02-10T00:00:44.120 INFO:tasks.workunit.client.0.smithi164.stdout:7/882: stat d3/d11/d39/d44/d48/d50/d92/f99 0 2024-02-10T00:00:44.121 INFO:tasks.workunit.client.0.smithi164.stdout:4/886: dwrite d2/d19/d16/d31/d72/feb [0,4194304] 0 2024-02-10T00:00:44.121 INFO:tasks.workunit.client.0.smithi164.stdout:6/913: fsync d0/d2b/f36 0 2024-02-10T00:00:44.122 INFO:tasks.workunit.client.0.smithi164.stdout:3/779: chown d0/d1/d2/d17/f54 190084349 1 2024-02-10T00:00:44.122 INFO:tasks.workunit.client.0.smithi164.stdout:4/887: dread - d2/d19/d16/d31/f10c zero size 2024-02-10T00:00:44.123 INFO:tasks.workunit.client.0.smithi164.stdout:0/837: rename d6/dec/da6/dea/d44/d49/f91 to d6/d10/d4a/dc7/f105 0 2024-02-10T00:00:44.126 INFO:tasks.workunit.client.0.smithi164.stdout:9/852: mknod d6/de/dfa/c119 0 2024-02-10T00:00:44.130 INFO:tasks.workunit.client.0.smithi164.stdout:7/883: creat d3/d5/d2b/d4a/f12c x:0 0 0 2024-02-10T00:00:44.133 INFO:tasks.workunit.client.0.smithi164.stdout:0/838: fsync d6/d10/d4a/d88/fde 0 2024-02-10T00:00:44.134 INFO:tasks.workunit.client.0.smithi164.stdout:9/853: unlink d6/de/c17 0 2024-02-10T00:00:44.134 INFO:tasks.workunit.client.0.smithi164.stdout:0/839: fdatasync d6/d10/d18/d2d/d39/f9b 0 2024-02-10T00:00:44.135 INFO:tasks.workunit.client.0.smithi164.stdout:3/780: mknod d0/d1/cf5 0 2024-02-10T00:00:44.136 INFO:tasks.workunit.client.0.smithi164.stdout:7/884: dwrite d3/d11/d39/d44/d6f/ffa [0,4194304] 0 2024-02-10T00:00:44.137 INFO:tasks.workunit.client.0.smithi164.stdout:9/854: read - d6/de/d22/de7/fec zero size 2024-02-10T00:00:44.137 INFO:tasks.workunit.client.0.smithi164.stdout:6/914: rename d0/d6/d12/c20 to d0/d6/d12/d45/d112/c12f 0 2024-02-10T00:00:44.139 INFO:tasks.workunit.client.0.smithi164.stdout:7/885: write d3/d11/d39/d44/d10d/d67/d98/fa8 [1217951,117820] 0 2024-02-10T00:00:44.141 INFO:tasks.workunit.client.0.smithi164.stdout:7/886: dread - d3/d11/d39/d44/d48/fea zero size 2024-02-10T00:00:44.141 INFO:tasks.workunit.client.0.smithi164.stdout:6/915: fsync d0/d6/d12/f27 0 2024-02-10T00:00:44.143 INFO:tasks.workunit.client.0.smithi164.stdout:3/781: symlink d0/d3b/dce/de1/df1/lf6 0 2024-02-10T00:00:44.145 INFO:tasks.workunit.client.0.smithi164.stdout:6/916: dread - d0/d2b/d3a/dd0/f11d zero size 2024-02-10T00:00:44.147 INFO:tasks.workunit.client.0.smithi164.stdout:7/887: creat d3/d11/d39/d44/d48/f12d x:0 0 0 2024-02-10T00:00:44.149 INFO:tasks.workunit.client.0.smithi164.stdout:3/782: link d0/d8f/cba d0/d1/d2/d19/d27/d30/cf7 0 2024-02-10T00:00:44.151 INFO:tasks.workunit.client.0.smithi164.stdout:7/888: creat d3/f12e x:0 0 0 2024-02-10T00:00:44.151 INFO:tasks.workunit.client.0.smithi164.stdout:6/917: dread d0/d2b/d3a/f5e [0,4194304] 0 2024-02-10T00:00:44.152 INFO:tasks.workunit.client.0.smithi164.stdout:7/889: write d3/d11/f82 [5194913,100464] 0 2024-02-10T00:00:44.155 INFO:tasks.workunit.client.0.smithi164.stdout:3/783: dwrite d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:44.160 INFO:tasks.workunit.client.0.smithi164.stdout:3/784: mknod d0/d1/d2/d19/d27/d5f/da5/d94/dbd/cf8 0 2024-02-10T00:00:44.161 INFO:tasks.workunit.client.0.smithi164.stdout:8/896: dread d2/d64/d65/d80/d32/f38 [0,4194304] 0 2024-02-10T00:00:44.165 INFO:tasks.workunit.client.0.smithi164.stdout:5/965: sync 2024-02-10T00:00:44.166 INFO:tasks.workunit.client.0.smithi164.stdout:6/918: dread d0/d2b/d3a/dd0/d93/f12d [0,4194304] 0 2024-02-10T00:00:44.168 INFO:tasks.workunit.client.0.smithi164.stdout:2/970: write d3/d32/f97 [639818,66785] 0 2024-02-10T00:00:44.171 INFO:tasks.workunit.client.0.smithi164.stdout:4/888: dread d2/d2f/d37/d41/d3d/fa0 [0,4194304] 0 2024-02-10T00:00:44.171 INFO:tasks.workunit.client.0.smithi164.stdout:5/966: chown d7/d17/d21/d24/dbc/d45/db3/cdd 7017 1 2024-02-10T00:00:44.172 INFO:tasks.workunit.client.0.smithi164.stdout:5/967: chown d7/d17/d21/d23/l11f 13637886 1 2024-02-10T00:00:44.172 INFO:tasks.workunit.client.0.smithi164.stdout:4/889: write d2/d2f/d37/d41/d3d/f62 [2446879,30177] 0 2024-02-10T00:00:44.173 INFO:tasks.workunit.client.0.smithi164.stdout:2/971: creat d3/d26/d64/f152 x:0 0 0 2024-02-10T00:00:44.174 INFO:tasks.workunit.client.0.smithi164.stdout:2/972: write d3/da6/d7a/de1/f106 [374530,26515] 0 2024-02-10T00:00:44.174 INFO:tasks.workunit.client.0.smithi164.stdout:6/919: creat d0/f130 x:0 0 0 2024-02-10T00:00:44.176 INFO:tasks.workunit.client.0.smithi164.stdout:5/968: fsync d7/d17/f71 0 2024-02-10T00:00:44.176 INFO:tasks.workunit.client.0.smithi164.stdout:5/969: stat d7/df9/l133 0 2024-02-10T00:00:44.179 INFO:tasks.workunit.client.0.smithi164.stdout:2/973: mknod d3/d24/d5b/d137/c153 0 2024-02-10T00:00:44.180 INFO:tasks.workunit.client.0.smithi164.stdout:0/840: dread d6/d10/d18/fca [0,4194304] 0 2024-02-10T00:00:44.181 INFO:tasks.workunit.client.0.smithi164.stdout:0/841: stat d6/d10/f61 0 2024-02-10T00:00:44.187 INFO:tasks.workunit.client.0.smithi164.stdout:1/805: dwrite d1/d1a/d41/fb [0,4194304] 0 2024-02-10T00:00:44.188 INFO:tasks.workunit.client.0.smithi164.stdout:9/855: write d6/de/d2b/f37 [453656,60791] 0 2024-02-10T00:00:44.189 INFO:tasks.workunit.client.0.smithi164.stdout:2/974: dread d3/f6 [0,4194304] 0 2024-02-10T00:00:44.190 INFO:tasks.workunit.client.0.smithi164.stdout:7/890: fsync d3/f12e 0 2024-02-10T00:00:44.190 INFO:tasks.workunit.client.0.smithi164.stdout:2/975: chown d3/l92 6328987 1 2024-02-10T00:00:44.191 INFO:tasks.workunit.client.0.smithi164.stdout:8/897: write d2/f20 [2026548,61608] 0 2024-02-10T00:00:44.192 INFO:tasks.workunit.client.0.smithi164.stdout:3/785: truncate d0/d1/dd/dc8/fe6 946293 0 2024-02-10T00:00:44.192 INFO:tasks.workunit.client.0.smithi164.stdout:8/898: fsync d2/d64/d65/d80/d32/d99/d9e/df0/f105 0 2024-02-10T00:00:44.195 INFO:tasks.workunit.client.0.smithi164.stdout:6/920: symlink d0/d2b/d3a/d3d/l131 0 2024-02-10T00:00:44.196 INFO:tasks.workunit.client.0.smithi164.stdout:4/890: creat d2/d19/d16/d31/d7e/f136 x:0 0 0 2024-02-10T00:00:44.197 INFO:tasks.workunit.client.0.smithi164.stdout:4/891: write d2/d2f/d37/d41/d3d/df0/f122 [384710,56560] 0 2024-02-10T00:00:44.198 INFO:tasks.workunit.client.0.smithi164.stdout:9/856: mkdir d6/de/d22/d11a 0 2024-02-10T00:00:44.200 INFO:tasks.workunit.client.0.smithi164.stdout:7/891: creat d3/d11/d39/d44/d10d/d67/d98/f12f x:0 0 0 2024-02-10T00:00:44.200 INFO:tasks.workunit.client.0.smithi164.stdout:3/786: mknod d0/d1/d3c/cf9 0 2024-02-10T00:00:44.201 INFO:tasks.workunit.client.0.smithi164.stdout:8/899: creat d2/d64/d63/f118 x:0 0 0 2024-02-10T00:00:44.202 INFO:tasks.workunit.client.0.smithi164.stdout:8/900: readlink d2/d64/d54/l69 0 2024-02-10T00:00:44.203 INFO:tasks.workunit.client.0.smithi164.stdout:0/842: mkdir d6/d106 0 2024-02-10T00:00:44.204 INFO:tasks.workunit.client.0.smithi164.stdout:5/970: link d7/d17/d69/l96 d7/d17/d21/d23/d5a/d68/d1f/d59/l14d 0 2024-02-10T00:00:44.205 INFO:tasks.workunit.client.0.smithi164.stdout:7/892: dwrite d3/d5/d2b/d4a/f12c [0,4194304] 0 2024-02-10T00:00:44.205 INFO:tasks.workunit.client.0.smithi164.stdout:4/892: chown d2/d19/d16/daa/le8 64230659 1 2024-02-10T00:00:44.206 INFO:tasks.workunit.client.0.smithi164.stdout:2/976: mkdir d3/d154 0 2024-02-10T00:00:44.207 INFO:tasks.workunit.client.0.smithi164.stdout:4/893: read - d2/d2f/d37/d41/d3d/d56/db2/f104 zero size 2024-02-10T00:00:44.211 INFO:tasks.workunit.client.0.smithi164.stdout:6/921: write d0/fc [3721229,117792] 0 2024-02-10T00:00:44.211 INFO:tasks.workunit.client.0.smithi164.stdout:7/893: dread d3/d11/d39/d44/d10d/da7/fc5 [0,4194304] 0 2024-02-10T00:00:44.212 INFO:tasks.workunit.client.0.smithi164.stdout:2/977: dwrite d3/da6/d7a/d8e/d36/d54/f9f [0,4194304] 0 2024-02-10T00:00:44.213 INFO:tasks.workunit.client.0.smithi164.stdout:3/787: chown d0/c20 26231212 1 2024-02-10T00:00:44.216 INFO:tasks.workunit.client.0.smithi164.stdout:5/971: rmdir d7/d17/d69/d92/da8/dcd/dd3/d132 39 2024-02-10T00:00:44.218 INFO:tasks.workunit.client.0.smithi164.stdout:4/894: creat d2/d2f/d37/d45/f137 x:0 0 0 2024-02-10T00:00:44.219 INFO:tasks.workunit.client.0.smithi164.stdout:9/857: mknod d6/de/d22/d58/dba/d75/ddb/c11b 0 2024-02-10T00:00:44.220 INFO:tasks.workunit.client.0.smithi164.stdout:7/894: chown d3/d28/f125 216 1 2024-02-10T00:00:44.220 INFO:tasks.workunit.client.0.smithi164.stdout:6/922: mknod d0/d6/d95/c132 0 2024-02-10T00:00:44.221 INFO:tasks.workunit.client.0.smithi164.stdout:6/923: fsync d0/d2b/f36 0 2024-02-10T00:00:44.222 INFO:tasks.workunit.client.0.smithi164.stdout:1/806: getdents d1/d13/d2b/d52 0 2024-02-10T00:00:44.223 INFO:tasks.workunit.client.0.smithi164.stdout:1/807: stat d1/f6 0 2024-02-10T00:00:44.223 INFO:tasks.workunit.client.0.smithi164.stdout:1/808: stat d1/d13/d80/l83 0 2024-02-10T00:00:44.223 INFO:tasks.workunit.client.0.smithi164.stdout:5/972: creat d7/d17/d21/dfb/f14e x:0 0 0 2024-02-10T00:00:44.225 INFO:tasks.workunit.client.0.smithi164.stdout:5/973: write d7/d17/d79/fdc [1958404,45744] 0 2024-02-10T00:00:44.226 INFO:tasks.workunit.client.0.smithi164.stdout:9/858: creat d6/de/d40/db6/f11c x:0 0 0 2024-02-10T00:00:44.227 INFO:tasks.workunit.client.0.smithi164.stdout:4/895: rename d2/d2f/d37/d41/d3d/d42/d47/fd0 to d2/d19/d16/d31/dcf/f138 0 2024-02-10T00:00:44.227 INFO:tasks.workunit.client.0.smithi164.stdout:2/978: getdents d3/da6/d7a/d8e/db6/db8 0 2024-02-10T00:00:44.229 INFO:tasks.workunit.client.0.smithi164.stdout:0/843: truncate d6/d10/d4a/d60/fac 194615 0 2024-02-10T00:00:44.231 INFO:tasks.workunit.client.0.smithi164.stdout:0/844: write d6/d3a/d52/fb6 [5489682,52816] 0 2024-02-10T00:00:44.231 INFO:tasks.workunit.client.0.smithi164.stdout:1/809: creat d1/d23/d37/da9/dd1/ddb/f110 x:0 0 0 2024-02-10T00:00:44.233 INFO:tasks.workunit.client.0.smithi164.stdout:7/895: mkdir d3/d130 0 2024-02-10T00:00:44.234 INFO:tasks.workunit.client.0.smithi164.stdout:8/901: dwrite d2/d81/ff4 [0,4194304] 0 2024-02-10T00:00:44.235 INFO:tasks.workunit.client.0.smithi164.stdout:4/896: unlink d2/d19/f11 0 2024-02-10T00:00:44.236 INFO:tasks.workunit.client.0.smithi164.stdout:7/896: dread - d3/d11/d39/d44/d10d/d67/d98/daf/dde/fee zero size 2024-02-10T00:00:44.236 INFO:tasks.workunit.client.0.smithi164.stdout:6/924: fsync d0/d3b/f90 0 2024-02-10T00:00:44.238 INFO:tasks.workunit.client.0.smithi164.stdout:3/788: creat d0/d3b/dce/de1/d84/ffa x:0 0 0 2024-02-10T00:00:44.239 INFO:tasks.workunit.client.0.smithi164.stdout:5/974: unlink d7/d17/d21/l3c 0 2024-02-10T00:00:44.240 INFO:tasks.workunit.client.0.smithi164.stdout:2/979: dwrite d3/f6 [0,4194304] 0 2024-02-10T00:00:44.240 INFO:tasks.workunit.client.0.smithi164.stdout:5/975: chown d7/d17/d21/d23/d5a/d68 1338397 1 2024-02-10T00:00:44.241 INFO:tasks.workunit.client.0.smithi164.stdout:2/980: readlink d3/da6/d7a/d8e/d36/dbd/lef 0 2024-02-10T00:00:44.243 INFO:tasks.workunit.client.0.smithi164.stdout:9/859: mknod d6/de/d22/d58/dba/d61/d107/c11d 0 2024-02-10T00:00:44.244 INFO:tasks.workunit.client.0.smithi164.stdout:8/902: unlink d2/d64/d65/d80/d32/d4d/f6b 0 2024-02-10T00:00:44.244 INFO:tasks.workunit.client.0.smithi164.stdout:8/903: stat d2/d12/f3f 0 2024-02-10T00:00:44.255 INFO:tasks.workunit.client.0.smithi164.stdout:9/860: dwrite d6/de/d22/d58/dba/d75/dc0/fc8 [4194304,4194304] 0 2024-02-10T00:00:44.256 INFO:tasks.workunit.client.0.smithi164.stdout:6/925: symlink d0/d6/d12/d14/d4b/dbf/l133 0 2024-02-10T00:00:44.257 INFO:tasks.workunit.client.0.smithi164.stdout:0/845: rmdir d6/dec/da6/dea/d44/d49/d95 39 2024-02-10T00:00:44.257 INFO:tasks.workunit.client.0.smithi164.stdout:7/897: mkdir d3/d5/d131 0 2024-02-10T00:00:44.258 INFO:tasks.workunit.client.0.smithi164.stdout:6/926: chown d0/d6/d12/c107 101 1 2024-02-10T00:00:44.259 INFO:tasks.workunit.client.0.smithi164.stdout:9/861: write d6/de/d22/d58/dba/d75/dc0/fc8 [3043985,63006] 0 2024-02-10T00:00:44.259 INFO:tasks.workunit.client.0.smithi164.stdout:7/898: chown d3/d28/c46 299 1 2024-02-10T00:00:44.259 INFO:tasks.workunit.client.0.smithi164.stdout:4/897: creat d2/d19/d16/d31/f139 x:0 0 0 2024-02-10T00:00:44.260 INFO:tasks.workunit.client.0.smithi164.stdout:4/898: readlink d2/d19/d16/d31/d6d/l97 0 2024-02-10T00:00:44.263 INFO:tasks.workunit.client.0.smithi164.stdout:1/810: write d1/d1a/ff5 [218773,36450] 0 2024-02-10T00:00:44.264 INFO:tasks.workunit.client.0.smithi164.stdout:7/899: dwrite d3/d11/d39/d44/d10d/d67/d98/fc1 [0,4194304] 0 2024-02-10T00:00:44.269 INFO:tasks.workunit.client.0.smithi164.stdout:3/789: truncate d0/d8f/d9a/db0/fc0 947304 0 2024-02-10T00:00:44.272 INFO:tasks.workunit.client.0.smithi164.stdout:7/900: dwrite d3/d11/d39/d44/d6f/d75/f120 [0,4194304] 0 2024-02-10T00:00:44.272 INFO:tasks.workunit.client.0.smithi164.stdout:2/981: dread d3/d26/d56/fa4 [0,4194304] 0 2024-02-10T00:00:44.273 INFO:tasks.workunit.client.0.smithi164.stdout:1/811: dread - d1/d23/d37/f99 zero size 2024-02-10T00:00:44.276 INFO:tasks.workunit.client.0.smithi164.stdout:6/927: dwrite d0/d6/d12/f27 [0,4194304] 0 2024-02-10T00:00:44.276 INFO:tasks.workunit.client.0.smithi164.stdout:4/899: rmdir d2/d19/d16/d31/d7e/d81 39 2024-02-10T00:00:44.279 INFO:tasks.workunit.client.0.smithi164.stdout:1/812: read d1/f71 [414820,98158] 0 2024-02-10T00:00:44.279 INFO:tasks.workunit.client.0.smithi164.stdout:2/982: creat d3/d26/dfd/d132/f155 x:0 0 0 2024-02-10T00:00:44.281 INFO:tasks.workunit.client.0.smithi164.stdout:3/790: dwrite d0/d3b/dce/de1/d81/f9f [0,4194304] 0 2024-02-10T00:00:44.283 INFO:tasks.workunit.client.0.smithi164.stdout:2/983: chown d3/d32/d4e/d27/f12b 1474966 1 2024-02-10T00:00:44.286 INFO:tasks.workunit.client.0.smithi164.stdout:7/901: symlink d3/d11/d39/d44/d10d/d67/d98/d110/l132 0 2024-02-10T00:00:44.287 INFO:tasks.workunit.client.0.smithi164.stdout:1/813: unlink d1/d13/d1f/f28 0 2024-02-10T00:00:44.287 INFO:tasks.workunit.client.0.smithi164.stdout:9/862: link d6/de/lab d6/de/d22/dd3/d104/d8b/d24/l11e 0 2024-02-10T00:00:44.288 INFO:tasks.workunit.client.0.smithi164.stdout:2/984: creat d3/d24/df0/f156 x:0 0 0 2024-02-10T00:00:44.289 INFO:tasks.workunit.client.0.smithi164.stdout:3/791: dwrite d0/d1/faf [0,4194304] 0 2024-02-10T00:00:44.290 INFO:tasks.workunit.client.0.smithi164.stdout:9/863: read - d6/de/d22/dd3/d104/f112 zero size 2024-02-10T00:00:44.291 INFO:tasks.workunit.client.0.smithi164.stdout:3/792: write d0/d1/d2/fd0 [660749,115823] 0 2024-02-10T00:00:44.293 INFO:tasks.workunit.client.0.smithi164.stdout:2/985: fsync d3/d24/f46 0 2024-02-10T00:00:44.295 INFO:tasks.workunit.client.0.smithi164.stdout:6/928: truncate d0/d6/d95/dcd/d125/f111 10819 0 2024-02-10T00:00:44.298 INFO:tasks.workunit.client.0.smithi164.stdout:2/986: rename d3/d26/d64/l72 to d3/da6/d7a/d8e/d88/l157 0 2024-02-10T00:00:44.300 INFO:tasks.workunit.client.0.smithi164.stdout:3/793: mkdir d0/d3b/dce/de1/d81/d95/dfb 0 2024-02-10T00:00:44.301 INFO:tasks.workunit.client.0.smithi164.stdout:2/987: symlink d3/da6/d7a/d8e/d36/d54/d11b/l158 0 2024-02-10T00:00:44.302 INFO:tasks.workunit.client.0.smithi164.stdout:6/929: chown d0/d6/d95/dcd/d125/f111 19102 1 2024-02-10T00:00:44.302 INFO:tasks.workunit.client.0.smithi164.stdout:5/976: sync 2024-02-10T00:00:44.302 INFO:tasks.workunit.client.0.smithi164.stdout:8/904: sync 2024-02-10T00:00:44.303 INFO:tasks.workunit.client.0.smithi164.stdout:3/794: creat d0/d8f/d9a/db0/ffc x:0 0 0 2024-02-10T00:00:44.304 INFO:tasks.workunit.client.0.smithi164.stdout:9/864: dwrite d6/de/d22/d58/dba/d61/ff6 [8388608,4194304] 0 2024-02-10T00:00:44.304 INFO:tasks.workunit.client.0.smithi164.stdout:2/988: chown d3/da6/d7a/d8e/f41 2070 1 2024-02-10T00:00:44.306 INFO:tasks.workunit.client.0.smithi164.stdout:9/865: fsync d6/de/f14 0 2024-02-10T00:00:44.306 INFO:tasks.workunit.client.0.smithi164.stdout:2/989: fsync d3/da6/d7a/de1/f106 0 2024-02-10T00:00:44.308 INFO:tasks.workunit.client.0.smithi164.stdout:3/795: unlink d0/d1/d2/fe 0 2024-02-10T00:00:44.309 INFO:tasks.workunit.client.0.smithi164.stdout:6/930: dwrite d0/d6/d12/f27 [0,4194304] 0 2024-02-10T00:00:44.311 INFO:tasks.workunit.client.0.smithi164.stdout:3/796: write d0/d1/d2/d17/d37/d3f/d4e/d6d/fa3 [99315,35193] 0 2024-02-10T00:00:44.312 INFO:tasks.workunit.client.0.smithi164.stdout:3/797: dread - d0/d1/d2/d19/d27/f80 zero size 2024-02-10T00:00:44.312 INFO:tasks.workunit.client.0.smithi164.stdout:8/905: unlink d2/d64/d65/d80/d32/d99/lfc 0 2024-02-10T00:00:44.313 INFO:tasks.workunit.client.0.smithi164.stdout:8/906: dread - d2/d64/d7d/fa7 zero size 2024-02-10T00:00:44.314 INFO:tasks.workunit.client.0.smithi164.stdout:2/990: mkdir d3/da6/d7a/de1/d159 0 2024-02-10T00:00:44.315 INFO:tasks.workunit.client.0.smithi164.stdout:3/798: dread - d0/d1/d2/d17/d37/d3f/d4e/d6d/fb8 zero size 2024-02-10T00:00:44.315 INFO:tasks.workunit.client.0.smithi164.stdout:5/977: truncate d7/d17/d21/d24/feb 708336 0 2024-02-10T00:00:44.315 INFO:tasks.workunit.client.0.smithi164.stdout:8/907: chown d2/d81/cd6 0 1 2024-02-10T00:00:44.317 INFO:tasks.workunit.client.0.smithi164.stdout:0/846: dread d6/d3a/d52/f8e [0,4194304] 0 2024-02-10T00:00:44.318 INFO:tasks.workunit.client.0.smithi164.stdout:0/847: fsync d6/fcd 0 2024-02-10T00:00:44.318 INFO:tasks.workunit.client.0.smithi164.stdout:5/978: stat d7/l38 0 2024-02-10T00:00:44.319 INFO:tasks.workunit.client.0.smithi164.stdout:3/799: symlink d0/d8f/d9a/lfd 0 2024-02-10T00:00:44.320 INFO:tasks.workunit.client.0.smithi164.stdout:0/848: fdatasync d6/dec/da6/dea/fe2 0 2024-02-10T00:00:44.321 INFO:tasks.workunit.client.0.smithi164.stdout:2/991: dwrite d3/d26/d56/f134 [0,4194304] 0 2024-02-10T00:00:44.321 INFO:tasks.workunit.client.0.smithi164.stdout:8/908: rmdir d2/d64/d65/d80/d32/db2 39 2024-02-10T00:00:44.323 INFO:tasks.workunit.client.0.smithi164.stdout:9/866: truncate d6/de/d22/d58/dba/d61/d76/d82/fe9 293011 0 2024-02-10T00:00:44.324 INFO:tasks.workunit.client.0.smithi164.stdout:5/979: symlink d7/d17/d21/d23/d5a/d68/d1f/d59/l14f 0 2024-02-10T00:00:44.325 INFO:tasks.workunit.client.0.smithi164.stdout:9/867: read d6/de/d22/d58/dba/f6c [138583,57445] 0 2024-02-10T00:00:44.326 INFO:tasks.workunit.client.0.smithi164.stdout:3/800: rename d0/d1/d2/d19/fe2 to d0/d3b/dce/de1/d81/d95/dfb/ffe 0 2024-02-10T00:00:44.327 INFO:tasks.workunit.client.0.smithi164.stdout:8/909: mknod d2/d64/d65/d80/d32/d99/c119 0 2024-02-10T00:00:44.327 INFO:tasks.workunit.client.0.smithi164.stdout:3/801: chown d0/d1/d2/d17/fe0 29 1 2024-02-10T00:00:44.329 INFO:tasks.workunit.client.0.smithi164.stdout:5/980: dread d7/d17/d21/d24/dbc/d43/f53 [0,4194304] 0 2024-02-10T00:00:44.330 INFO:tasks.workunit.client.0.smithi164.stdout:9/868: mkdir d6/de/d22/d58/dba/d61/d76/d11f 0 2024-02-10T00:00:44.330 INFO:tasks.workunit.client.0.smithi164.stdout:5/981: read d7/d17/d79/fb1 [291979,9684] 0 2024-02-10T00:00:44.331 INFO:tasks.workunit.client.0.smithi164.stdout:0/849: truncate f3 8624918 0 2024-02-10T00:00:44.332 INFO:tasks.workunit.client.0.smithi164.stdout:9/869: read d6/de/d22/dd3/d104/d8b/d24/fce [5921548,116387] 0 2024-02-10T00:00:44.333 INFO:tasks.workunit.client.0.smithi164.stdout:9/870: chown d6/de/d40/d74/l7a 472038591 1 2024-02-10T00:00:44.334 INFO:tasks.workunit.client.0.smithi164.stdout:2/992: truncate d3/da6/d7a/d8e/d36/d54/f55 5485791 0 2024-02-10T00:00:44.336 INFO:tasks.workunit.client.0.smithi164.stdout:0/850: creat d6/d10/d66/dfb/f107 x:0 0 0 2024-02-10T00:00:44.338 INFO:tasks.workunit.client.0.smithi164.stdout:9/871: creat d6/de/d22/dd3/d104/f120 x:0 0 0 2024-02-10T00:00:44.339 INFO:tasks.workunit.client.0.smithi164.stdout:2/993: creat d3/d26/dfd/f15a x:0 0 0 2024-02-10T00:00:44.340 INFO:tasks.workunit.client.0.smithi164.stdout:5/982: mknod d7/d17/d21/d23/d5a/d68/d1f/c150 0 2024-02-10T00:00:44.341 INFO:tasks.workunit.client.0.smithi164.stdout:8/910: link d2/d64/d65/d80/d32/d58/f79 d2/d64/d65/d80/d32/d99/d9e/f11a 0 2024-02-10T00:00:44.343 INFO:tasks.workunit.client.0.smithi164.stdout:3/802: getdents d0/d1/d2/d17/d37 0 2024-02-10T00:00:44.345 INFO:tasks.workunit.client.0.smithi164.stdout:5/983: link d7/d17/dc3/f103 d7/d17/d21/d24/dff/f151 0 2024-02-10T00:00:44.346 INFO:tasks.workunit.client.0.smithi164.stdout:4/900: dread d2/d2f/d37/d41/f4e [0,4194304] 0 2024-02-10T00:00:44.347 INFO:tasks.workunit.client.0.smithi164.stdout:3/803: chown d0/d1/d2/d19/d27/d30/c83 8727843 1 2024-02-10T00:00:44.347 INFO:tasks.workunit.client.0.smithi164.stdout:0/851: dwrite d6/d7/fc [0,4194304] 0 2024-02-10T00:00:44.348 INFO:tasks.workunit.client.0.smithi164.stdout:4/901: fdatasync d2/d19/d10f/f11c 0 2024-02-10T00:00:44.349 INFO:tasks.workunit.client.0.smithi164.stdout:1/814: dread d1/d1a/d41/d18/d3a/fb9 [0,4194304] 0 2024-02-10T00:00:44.354 INFO:tasks.workunit.client.0.smithi164.stdout:5/984: rename d7/d17/d21/d24/dbc/d45 to d7/d17/d21/d23/d5a/d68/d1f/d59/d152 0 2024-02-10T00:00:44.355 INFO:tasks.workunit.client.0.smithi164.stdout:1/815: dwrite d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:44.359 INFO:tasks.workunit.client.0.smithi164.stdout:4/902: mknod d2/d2f/d37/d41/d3d/c13a 0 2024-02-10T00:00:44.364 INFO:tasks.workunit.client.0.smithi164.stdout:7/902: write d3/d5/d9b/db7/d4b/f6d [652696,72039] 0 2024-02-10T00:00:44.364 INFO:tasks.workunit.client.0.smithi164.stdout:7/903: chown d3/d11 103374 1 2024-02-10T00:00:44.370 INFO:tasks.workunit.client.0.smithi164.stdout:6/931: write d0/d6/d95/fc8 [1091077,41135] 0 2024-02-10T00:00:44.377 INFO:tasks.workunit.client.0.smithi164.stdout:0/852: symlink d6/dec/da6/dea/d44/d49/d95/de1/l108 0 2024-02-10T00:00:44.380 INFO:tasks.workunit.client.0.smithi164.stdout:2/994: write d3/da6/d7a/d8e/db6/dce/fbb [1067257,57180] 0 2024-02-10T00:00:44.381 INFO:tasks.workunit.client.0.smithi164.stdout:5/985: creat d7/d17/d21/d23/d5a/d68/d1f/d109/f153 x:0 0 0 2024-02-10T00:00:44.383 INFO:tasks.workunit.client.0.smithi164.stdout:8/911: truncate d2/d64/d65/d98/fb8 4863465 0 2024-02-10T00:00:44.384 INFO:tasks.workunit.client.0.smithi164.stdout:2/995: dread d3/da6/d7a/d8e/d36/d54/f9f [0,4194304] 0 2024-02-10T00:00:44.385 INFO:tasks.workunit.client.0.smithi164.stdout:9/872: sync 2024-02-10T00:00:44.386 INFO:tasks.workunit.client.0.smithi164.stdout:3/804: dwrite d0/d3b/dce/f77 [0,4194304] 0 2024-02-10T00:00:44.391 INFO:tasks.workunit.client.0.smithi164.stdout:1/816: truncate d1/d1a/d75/fe2 4630186 0 2024-02-10T00:00:44.392 INFO:tasks.workunit.client.0.smithi164.stdout:7/904: mkdir d3/d28/d133 0 2024-02-10T00:00:44.396 INFO:tasks.workunit.client.0.smithi164.stdout:2/996: symlink d3/da6/d7a/d8e/db6/db8/l15b 0 2024-02-10T00:00:44.396 INFO:tasks.workunit.client.0.smithi164.stdout:8/912: dread d2/f8a [0,4194304] 0 2024-02-10T00:00:44.397 INFO:tasks.workunit.client.0.smithi164.stdout:9/873: mkdir d6/de/d22/dd3/d121 0 2024-02-10T00:00:44.397 INFO:tasks.workunit.client.0.smithi164.stdout:4/903: link d2/d19/d16/f53 d2/d2f/d37/d45/dab/dbd/f13b 0 2024-02-10T00:00:44.398 INFO:tasks.workunit.client.0.smithi164.stdout:8/913: write d2/d81/f8c [954781,5571] 0 2024-02-10T00:00:44.400 INFO:tasks.workunit.client.0.smithi164.stdout:6/932: symlink d0/d6/d95/dcd/dc3/d124/l134 0 2024-02-10T00:00:44.402 INFO:tasks.workunit.client.0.smithi164.stdout:2/997: dread d3/da6/d7a/ffb [0,4194304] 0 2024-02-10T00:00:44.402 INFO:tasks.workunit.client.0.smithi164.stdout:7/905: fdatasync d3/d11/d39/d44/d48/fbb 0 2024-02-10T00:00:44.405 INFO:tasks.workunit.client.0.smithi164.stdout:1/817: dwrite d1/d13/d1f/fac [0,4194304] 0 2024-02-10T00:00:44.409 INFO:tasks.workunit.client.0.smithi164.stdout:5/986: dwrite d7/d17/d21/d24/dff/f151 [0,4194304] 0 2024-02-10T00:00:44.413 INFO:tasks.workunit.client.0.smithi164.stdout:0/853: rename d6/dec/da6/dea/d44/d49/l9e to d6/d3a/d97/l109 0 2024-02-10T00:00:44.416 INFO:tasks.workunit.client.0.smithi164.stdout:2/998: dread d3/d24/d5b/dd9/fe8 [0,4194304] 0 2024-02-10T00:00:44.416 INFO:tasks.workunit.client.0.smithi164.stdout:7/906: creat d3/d11/d39/d44/dbd/d107/dcf/f134 x:0 0 0 2024-02-10T00:00:44.420 INFO:tasks.workunit.client.0.smithi164.stdout:9/874: symlink d6/de/d22/d11a/l122 0 2024-02-10T00:00:44.420 INFO:tasks.workunit.client.0.smithi164.stdout:8/914: chown d2/d64/d65/d80/d32/d99/d9e/df0/f105 861 1 2024-02-10T00:00:44.421 INFO:tasks.workunit.client.0.smithi164.stdout:0/854: dread d6/d10/d18/d2d/f8f [0,4194304] 0 2024-02-10T00:00:44.433 INFO:tasks.workunit.client.0.smithi164.stdout:6/933: write d0/d3b/d56/fd6 [1012692,13354] 0 2024-02-10T00:00:44.443 INFO:tasks.workunit.client.0.smithi164.stdout:2/999: write d3/d24/d5b/d109/f135 [3369685,59667] 0 2024-02-10T00:00:44.443 INFO:tasks.workunit.client.0.smithi164.stdout:7/907: symlink d3/d11/d39/d44/dbd/d107/dda/d5d/df9/l135 0 2024-02-10T00:00:44.445 INFO:tasks.workunit.client.0.smithi164.stdout:3/805: getdents d0/d3b/dce/de1/d84 0 2024-02-10T00:00:44.445 INFO:tasks.workunit.client.0.smithi164.stdout:4/904: link d2/d2f/d37/d41/d3d/d56/d85/c102 d2/d2f/d37/d45/dab/dbd/c13c 0 2024-02-10T00:00:44.447 INFO:tasks.workunit.client.0.smithi164.stdout:9/875: creat d6/de/d22/d58/dba/d61/d76/d82/dfc/f123 x:0 0 0 2024-02-10T00:00:44.448 INFO:tasks.workunit.client.0.smithi164.stdout:0/855: creat d6/dec/da6/dea/d44/d49/d95/dc0/f10a x:0 0 0 2024-02-10T00:00:44.449 INFO:tasks.workunit.client.0.smithi164.stdout:1/818: creat d1/d13/d2b/d52/da4/f111 x:0 0 0 2024-02-10T00:00:44.450 INFO:tasks.workunit.client.0.smithi164.stdout:8/915: fsync d2/d12/f48 0 2024-02-10T00:00:44.453 INFO:tasks.workunit.client.0.smithi164.stdout:5/987: rename d7/fd to d7/d17/f154 0 2024-02-10T00:00:44.454 INFO:tasks.workunit.client.0.smithi164.stdout:0/856: mkdir d6/d10/d66/d10b 0 2024-02-10T00:00:44.464 INFO:tasks.workunit.client.0.smithi164.stdout:9/876: write d6/de/ffd [2658139,58423] 0 2024-02-10T00:00:44.465 INFO:tasks.workunit.client.0.smithi164.stdout:9/877: readlink d6/de/d22/d58/dba/d61/la1 0 2024-02-10T00:00:44.466 INFO:tasks.workunit.client.0.smithi164.stdout:9/878: write d6/de/d22/dd3/d104/d8b/dc2/fca [470851,69696] 0 2024-02-10T00:00:44.467 INFO:tasks.workunit.client.0.smithi164.stdout:8/916: mknod d2/d64/d65/d80/d32/d68/c11b 0 2024-02-10T00:00:44.468 INFO:tasks.workunit.client.0.smithi164.stdout:9/879: dread - d6/de/d22/d58/dba/d61/d76/fd2 zero size 2024-02-10T00:00:44.468 INFO:tasks.workunit.client.0.smithi164.stdout:0/857: dread d6/d7/f24 [0,4194304] 0 2024-02-10T00:00:44.471 INFO:tasks.workunit.client.0.smithi164.stdout:9/880: dread d6/de/d22/dd3/d104/d8b/d24/d4f/dff/dd9/fda [0,4194304] 0 2024-02-10T00:00:44.472 INFO:tasks.workunit.client.0.smithi164.stdout:1/819: creat d1/d1a/d41/f112 x:0 0 0 2024-02-10T00:00:44.473 INFO:tasks.workunit.client.0.smithi164.stdout:0/858: read d6/d10/d4a/d60/d6c/f7e [151801,22454] 0 2024-02-10T00:00:44.475 INFO:tasks.workunit.client.0.smithi164.stdout:6/934: rename d0/d2b/d3a/f87 to d0/d2b/d3a/d3d/f135 0 2024-02-10T00:00:44.478 INFO:tasks.workunit.client.0.smithi164.stdout:8/917: mknod d2/d64/d54/d71/d78/c11c 0 2024-02-10T00:00:44.478 INFO:tasks.workunit.client.0.smithi164.stdout:4/905: truncate d2/d2f/d37/d41/d3d/d42/d5f/f113 539697 0 2024-02-10T00:00:44.480 INFO:tasks.workunit.client.0.smithi164.stdout:5/988: creat d7/d17/d21/f155 x:0 0 0 2024-02-10T00:00:44.480 INFO:tasks.workunit.client.0.smithi164.stdout:6/935: dread d0/d6/d12/f27 [0,4194304] 0 2024-02-10T00:00:44.481 INFO:tasks.workunit.client.0.smithi164.stdout:6/936: readlink d0/d2b/d3a/d3d/d42/d5d/d79/l103 0 2024-02-10T00:00:44.483 INFO:tasks.workunit.client.0.smithi164.stdout:3/806: rename d0/c20 to d0/d3b/dce/de1/d84/cff 0 2024-02-10T00:00:44.483 INFO:tasks.workunit.client.0.smithi164.stdout:4/906: dread d2/d2f/d37/d41/d3d/df0/f122 [0,4194304] 0 2024-02-10T00:00:44.485 INFO:tasks.workunit.client.0.smithi164.stdout:9/881: symlink d6/de/d22/d58/dba/d61/d76/da5/d111/l124 0 2024-02-10T00:00:44.486 INFO:tasks.workunit.client.0.smithi164.stdout:7/908: sync 2024-02-10T00:00:44.487 INFO:tasks.workunit.client.0.smithi164.stdout:6/937: fdatasync d0/d2b/d3a/dd0/fec 0 2024-02-10T00:00:44.489 INFO:tasks.workunit.client.0.smithi164.stdout:6/938: write d0/d6/d12/d45/f65 [1872775,72288] 0 2024-02-10T00:00:44.489 INFO:tasks.workunit.client.0.smithi164.stdout:5/989: dread d7/f7f [0,4194304] 0 2024-02-10T00:00:44.490 INFO:tasks.workunit.client.0.smithi164.stdout:0/859: rename d6/d10/d18/d1c/d92 to d6/d10/d66/d10b/d10c 0 2024-02-10T00:00:44.490 INFO:tasks.workunit.client.0.smithi164.stdout:5/990: chown d7/d17/d21/d23/f2d 13495 1 2024-02-10T00:00:44.491 INFO:tasks.workunit.client.0.smithi164.stdout:8/918: symlink d2/d64/d65/d98/d102/l11d 0 2024-02-10T00:00:44.492 INFO:tasks.workunit.client.0.smithi164.stdout:4/907: write d2/d2f/d37/d41/f4e [657712,77772] 0 2024-02-10T00:00:44.493 INFO:tasks.workunit.client.0.smithi164.stdout:3/807: mknod d0/d1/d2/d17/d37/d9b/c100 0 2024-02-10T00:00:44.494 INFO:tasks.workunit.client.0.smithi164.stdout:3/808: fsync d0/d3b/dce/de1/d81/f9f 0 2024-02-10T00:00:44.496 INFO:tasks.workunit.client.0.smithi164.stdout:9/882: mknod d6/de/d22/dd3/d104/d8b/c125 0 2024-02-10T00:00:44.497 INFO:tasks.workunit.client.0.smithi164.stdout:7/909: mkdir d3/d11/d39/d44/d48/d50/d136 0 2024-02-10T00:00:44.507 INFO:tasks.workunit.client.0.smithi164.stdout:0/860: mknod d6/dec/d79/dce/c10d 0 2024-02-10T00:00:44.510 INFO:tasks.workunit.client.0.smithi164.stdout:1/820: getdents d1/d13/d80 0 2024-02-10T00:00:44.512 INFO:tasks.workunit.client.0.smithi164.stdout:0/861: dwrite d6/d3a/d52/fb6 [0,4194304] 0 2024-02-10T00:00:44.514 INFO:tasks.workunit.client.0.smithi164.stdout:8/919: getdents d2/d64/d7d/de8 0 2024-02-10T00:00:44.515 INFO:tasks.workunit.client.0.smithi164.stdout:8/920: chown d2/d64/d65/fa6 6 1 2024-02-10T00:00:44.517 INFO:tasks.workunit.client.0.smithi164.stdout:1/821: truncate d1/d13/d1f/fad 1513561 0 2024-02-10T00:00:44.518 INFO:tasks.workunit.client.0.smithi164.stdout:5/991: truncate d7/d17/f148 1048551 0 2024-02-10T00:00:44.520 INFO:tasks.workunit.client.0.smithi164.stdout:8/921: dwrite d2/d12/f8d [0,4194304] 0 2024-02-10T00:00:44.520 INFO:tasks.workunit.client.0.smithi164.stdout:7/910: truncate d3/d11/d39/d44/d48/f12d 1036263 0 2024-02-10T00:00:44.522 INFO:tasks.workunit.client.0.smithi164.stdout:3/809: getdents d0/d1/d2/d19/d27/d5f/da5/d94 0 2024-02-10T00:00:44.524 INFO:tasks.workunit.client.0.smithi164.stdout:1/822: rename d1/d13/d1f/fc0 to d1/d23/f113 0 2024-02-10T00:00:44.525 INFO:tasks.workunit.client.0.smithi164.stdout:5/992: dwrite d7/d17/d21/d24/f3d [0,4194304] 0 2024-02-10T00:00:44.526 INFO:tasks.workunit.client.0.smithi164.stdout:8/922: unlink d2/d64/d65/d80/d32/d4d/f5a 0 2024-02-10T00:00:44.528 INFO:tasks.workunit.client.0.smithi164.stdout:3/810: rmdir d0/d3b/dce/de1/df1 39 2024-02-10T00:00:44.532 INFO:tasks.workunit.client.0.smithi164.stdout:1/823: dwrite d1/d13/d2b/d52/da4/dc2/dcc/ff7 [0,4194304] 0 2024-02-10T00:00:44.535 INFO:tasks.workunit.client.0.smithi164.stdout:4/908: dwrite d2/fb [0,4194304] 0 2024-02-10T00:00:44.536 INFO:tasks.workunit.client.0.smithi164.stdout:3/811: dwrite d0/fb1 [0,4194304] 0 2024-02-10T00:00:44.540 INFO:tasks.workunit.client.0.smithi164.stdout:1/824: dwrite d1/d23/d70/fee [0,4194304] 0 2024-02-10T00:00:44.540 INFO:tasks.workunit.client.0.smithi164.stdout:9/883: truncate d6/de/d22/dd3/d104/d8b/f87 2429455 0 2024-02-10T00:00:44.541 INFO:tasks.workunit.client.0.smithi164.stdout:4/909: rmdir d2/d19/da4 0 2024-02-10T00:00:44.541 INFO:tasks.workunit.client.0.smithi164.stdout:8/923: read d2/d12/f72 [1013350,36675] 0 2024-02-10T00:00:44.543 INFO:tasks.workunit.client.0.smithi164.stdout:9/884: chown d6/de/d22/d58/dba/d61/c103 10 1 2024-02-10T00:00:44.547 INFO:tasks.workunit.client.0.smithi164.stdout:8/924: dwrite d2/d64/d65/d80/d32/f112 [0,4194304] 0 2024-02-10T00:00:44.549 INFO:tasks.workunit.client.0.smithi164.stdout:4/910: mkdir d2/d19/d16/d31/d72/d117/d13d 0 2024-02-10T00:00:44.550 INFO:tasks.workunit.client.0.smithi164.stdout:1/825: mknod d1/d1a/d41/d18/c114 0 2024-02-10T00:00:44.550 INFO:tasks.workunit.client.0.smithi164.stdout:1/826: chown d1/d1a/d41/fce 4 1 2024-02-10T00:00:44.553 INFO:tasks.workunit.client.0.smithi164.stdout:3/812: truncate d0/d1/d2/faa 854116 0 2024-02-10T00:00:44.558 INFO:tasks.workunit.client.0.smithi164.stdout:8/925: rename d2/d64/d65/d80/d32/d68/dac to d2/d64/d65/d80/d32/d93/db7/d11e 0 2024-02-10T00:00:44.559 INFO:tasks.workunit.client.0.smithi164.stdout:8/926: write d2/d64/d63/fa5 [2330272,126821] 0 2024-02-10T00:00:44.560 INFO:tasks.workunit.client.0.smithi164.stdout:3/813: mknod d0/d3b/dce/de1/d81/d95/dfb/c101 0 2024-02-10T00:00:44.560 INFO:tasks.workunit.client.0.smithi164.stdout:4/911: getdents d2/d19/d16/d31/d72/d117/d13d 0 2024-02-10T00:00:44.565 INFO:tasks.workunit.client.0.smithi164.stdout:3/814: dread d0/d1/d2/d17/d37/d3f/d4e/d6d/fa7 [0,4194304] 0 2024-02-10T00:00:44.566 INFO:tasks.workunit.client.0.smithi164.stdout:3/815: readlink d0/d3b/dce/de1/d81/l8a 0 2024-02-10T00:00:44.566 INFO:tasks.workunit.client.0.smithi164.stdout:0/862: dread d6/d10/d4a/d60/d6c/f7e [0,4194304] 0 2024-02-10T00:00:44.568 INFO:tasks.workunit.client.0.smithi164.stdout:3/816: mkdir d0/d1/d2/d19/d27/d5f/da5/d94/d102 0 2024-02-10T00:00:44.569 INFO:tasks.workunit.client.0.smithi164.stdout:0/863: mknod d6/d10/d4a/d60/c10e 0 2024-02-10T00:00:44.570 INFO:tasks.workunit.client.0.smithi164.stdout:6/939: sync 2024-02-10T00:00:44.577 INFO:tasks.workunit.client.0.smithi164.stdout:0/864: read - d6/d10/d66/dfb/f107 zero size 2024-02-10T00:00:44.578 INFO:tasks.workunit.client.0.smithi164.stdout:0/865: dread - d6/dec/da6/daa/fd5 zero size 2024-02-10T00:00:44.579 INFO:tasks.workunit.client.0.smithi164.stdout:6/940: chown d0/d2b/d3a/d3d/da7/da9/dfd/l113 46433 1 2024-02-10T00:00:44.579 INFO:tasks.workunit.client.0.smithi164.stdout:3/817: getdents d0/d3b/dce/de1/df1 0 2024-02-10T00:00:44.581 INFO:tasks.workunit.client.0.smithi164.stdout:6/941: creat d0/d3b/d56/f136 x:0 0 0 2024-02-10T00:00:44.587 INFO:tasks.workunit.client.0.smithi164.stdout:6/942: fsync d0/d6/d95/dcd/dc3/fd5 0 2024-02-10T00:00:44.589 INFO:tasks.workunit.client.0.smithi164.stdout:7/911: truncate d3/d11/d39/d44/d10d/d67/d98/fc1 5214035 0 2024-02-10T00:00:44.590 INFO:tasks.workunit.client.0.smithi164.stdout:5/993: dwrite d7/d17/d21/d23/d5a/d68/d1f/d59/d152/db3/fcb [0,4194304] 0 2024-02-10T00:00:44.591 INFO:tasks.workunit.client.0.smithi164.stdout:5/994: chown d7/d17/d21/d23/d5a/d68/d1f/d70 122799365 1 2024-02-10T00:00:44.592 INFO:tasks.workunit.client.0.smithi164.stdout:3/818: rename d0/d1/d2/d17 to d0/d103 0 2024-02-10T00:00:44.599 INFO:tasks.workunit.client.0.smithi164.stdout:9/885: write d6/de/d22/dd3/d104/d8b/d24/d4f/f5d [833722,38069] 0 2024-02-10T00:00:44.605 INFO:tasks.workunit.client.0.smithi164.stdout:1/827: truncate d1/d23/f84 1121435 0 2024-02-10T00:00:44.606 INFO:tasks.workunit.client.0.smithi164.stdout:8/927: write d2/d64/d54/d71/f90 [338172,93798] 0 2024-02-10T00:00:44.606 INFO:tasks.workunit.client.0.smithi164.stdout:8/928: stat d2/d64/d65/d80/fe0 0 2024-02-10T00:00:44.608 INFO:tasks.workunit.client.0.smithi164.stdout:0/866: truncate d6/d7/fdf 1364752 0 2024-02-10T00:00:44.613 INFO:tasks.workunit.client.0.smithi164.stdout:6/943: dwrite d0/d6/d12/d14/f8d [0,4194304] 0 2024-02-10T00:00:44.613 INFO:tasks.workunit.client.0.smithi164.stdout:7/912: truncate d3/d11/d39/d44/d6f/d75/fe7 2253096 0 2024-02-10T00:00:44.616 INFO:tasks.workunit.client.0.smithi164.stdout:8/929: mknod d2/d64/d65/d80/d32/d99/da0/c11f 0 2024-02-10T00:00:44.619 INFO:tasks.workunit.client.0.smithi164.stdout:1/828: fsync d1/d23/f98 0 2024-02-10T00:00:44.621 INFO:tasks.workunit.client.0.smithi164.stdout:0/867: creat d6/dec/d79/dce/d101/f10f x:0 0 0 2024-02-10T00:00:44.622 INFO:tasks.workunit.client.0.smithi164.stdout:0/868: write d6/d10/d4a/d88/fcc [152674,126079] 0 2024-02-10T00:00:44.622 INFO:tasks.workunit.client.0.smithi164.stdout:5/995: dread d7/d17/d21/d24/dbc/f8c [0,4194304] 0 2024-02-10T00:00:44.631 INFO:tasks.workunit.client.0.smithi164.stdout:5/996: fsync d7/d17/d21/d23/d5a/d68/d1f/d59/d152/d5c/fb6 0 2024-02-10T00:00:44.635 INFO:tasks.workunit.client.0.smithi164.stdout:4/912: sync 2024-02-10T00:00:44.639 INFO:tasks.workunit.client.0.smithi164.stdout:5/997: truncate d7/d17/f1c 1549838 0 2024-02-10T00:00:44.640 INFO:tasks.workunit.client.0.smithi164.stdout:5/998: fsync d7/fd4 0 2024-02-10T00:00:44.640 INFO:tasks.workunit.client.0.smithi164.stdout:9/886: dwrite d6/de/d22/dd3/d104/d8b/f2e [0,4194304] 0 2024-02-10T00:00:44.647 INFO:tasks.workunit.client.0.smithi164.stdout:6/944: truncate d0/d2b/d3a/d3d/d42/d5d/d79/f8b 1771751 0 2024-02-10T00:00:44.648 INFO:tasks.workunit.client.0.smithi164.stdout:8/930: write d2/d64/d65/da9/fdf [674391,78019] 0 2024-02-10T00:00:44.649 INFO:tasks.workunit.client.0.smithi164.stdout:1/829: truncate d1/d23/f113 4390302 0 2024-02-10T00:00:44.650 INFO:tasks.workunit.client.0.smithi164.stdout:0/869: write d6/d10/d18/d2d/f2f [7450847,107974] 0 2024-02-10T00:00:44.651 INFO:tasks.workunit.client.0.smithi164.stdout:6/945: creat d0/d3b/dd4/f137 x:0 0 0 2024-02-10T00:00:44.654 INFO:tasks.workunit.client.0.smithi164.stdout:8/931: write d2/d64/d65/d80/d32/db2/fc5 [545103,119818] 0 2024-02-10T00:00:44.656 INFO:tasks.workunit.client.0.smithi164.stdout:6/946: rename d0/d6/l34 to d0/d2b/d3a/d3d/d42/d5d/d79/dbc/l138 0 2024-02-10T00:00:44.657 INFO:tasks.workunit.client.0.smithi164.stdout:0/870: mkdir d6/d7/d110 0 2024-02-10T00:00:44.657 INFO:tasks.workunit.client.0.smithi164.stdout:6/947: chown d0/d2b/d3a/d3d/d42/fa8 793079 1 2024-02-10T00:00:44.657 INFO:tasks.workunit.client.0.smithi164.stdout:6/948: stat d0/d3b/d56/db3/fde 0 2024-02-10T00:00:44.658 INFO:tasks.workunit.client.0.smithi164.stdout:4/913: write d2/d2f/d37/f126 [1961736,111265] 0 2024-02-10T00:00:44.659 INFO:tasks.workunit.client.0.smithi164.stdout:4/914: fsync d2/d19/d16/ff1 0 2024-02-10T00:00:44.660 INFO:tasks.workunit.client.0.smithi164.stdout:6/949: creat d0/d6/d12/d14/f139 x:0 0 0 2024-02-10T00:00:44.662 INFO:tasks.workunit.client.0.smithi164.stdout:4/915: mkdir d2/d19/d13e 0 2024-02-10T00:00:44.664 INFO:tasks.workunit.client.0.smithi164.stdout:6/950: mknod d0/d6/d12/d57/c13a 0 2024-02-10T00:00:44.665 INFO:tasks.workunit.client.0.smithi164.stdout:4/916: stat d2/d19/d16/f53 0 2024-02-10T00:00:44.665 INFO:tasks.workunit.client.0.smithi164.stdout:4/917: dread - d2/f119 zero size 2024-02-10T00:00:44.668 INFO:tasks.workunit.client.0.smithi164.stdout:1/830: write d1/d1a/d41/d18/f30 [816957,25918] 0 2024-02-10T00:00:44.671 INFO:tasks.workunit.client.0.smithi164.stdout:8/932: write d2/d64/d65/d80/d32/f4b [2846882,60175] 0 2024-02-10T00:00:44.672 INFO:tasks.workunit.client.0.smithi164.stdout:9/887: dread d6/de/d22/dd3/d104/d8b/f29 [0,4194304] 0 2024-02-10T00:00:44.673 INFO:tasks.workunit.client.0.smithi164.stdout:6/951: rename d0/d2b/d3a/l10a to d0/d2b/d3a/d3d/d42/d5d/l13b 0 2024-02-10T00:00:44.674 INFO:tasks.workunit.client.0.smithi164.stdout:1/831: dwrite d1/d23/fd4 [4194304,4194304] 0 2024-02-10T00:00:44.674 INFO:tasks.workunit.client.0.smithi164.stdout:9/888: write d6/de/d22/f26 [9408354,73927] 0 2024-02-10T00:00:44.677 INFO:tasks.workunit.client.0.smithi164.stdout:8/933: write d2/d64/d65/d80/d32/d99/d9e/f116 [1026309,65757] 0 2024-02-10T00:00:44.677 INFO:tasks.workunit.client.0.smithi164.stdout:1/832: rmdir d1/d23/dd3 39 2024-02-10T00:00:44.679 INFO:tasks.workunit.client.0.smithi164.stdout:3/819: sync 2024-02-10T00:00:44.679 INFO:tasks.workunit.client.0.smithi164.stdout:4/918: rename d2/d19/d16/d31/d57/l111 to d2/d2f/d37/d41/l13f 0 2024-02-10T00:00:44.680 INFO:tasks.workunit.client.0.smithi164.stdout:4/919: write d2/d19/d16/d31/f4d [3161916,4177] 0 2024-02-10T00:00:44.681 INFO:tasks.workunit.client.0.smithi164.stdout:6/952: symlink d0/d2b/d3a/dd0/d93/d105/l13c 0 2024-02-10T00:00:44.682 INFO:tasks.workunit.client.0.smithi164.stdout:6/953: readlink d0/d2b/d3a/dd0/d93/lcf 0 2024-02-10T00:00:44.682 INFO:tasks.workunit.client.0.smithi164.stdout:8/934: write d2/d64/d54/d5f/f101 [3194047,52315] 0 2024-02-10T00:00:44.684 INFO:tasks.workunit.client.0.smithi164.stdout:4/920: mkdir d2/d2f/d37/d45/d127/d140 0 2024-02-10T00:00:44.685 INFO:tasks.workunit.client.0.smithi164.stdout:4/921: read - d2/d19/d16/d31/d4b/d120/f121 zero size 2024-02-10T00:00:44.686 INFO:tasks.workunit.client.0.smithi164.stdout:1/833: symlink d1/d1a/d41/l115 0 2024-02-10T00:00:44.689 INFO:tasks.workunit.client.0.smithi164.stdout:9/889: creat d6/de/d22/d58/dba/d61/f126 x:0 0 0 2024-02-10T00:00:44.691 INFO:tasks.workunit.client.0.smithi164.stdout:8/935: creat d2/d115/f120 x:0 0 0 2024-02-10T00:00:44.691 INFO:tasks.workunit.client.0.smithi164.stdout:8/936: chown d2 2 1 2024-02-10T00:00:44.691 INFO:tasks.workunit.client.0.smithi164.stdout:6/954: mknod d0/d2b/d3a/dd0/d93/d118/c13d 0 2024-02-10T00:00:44.693 INFO:tasks.workunit.client.0.smithi164.stdout:4/922: rename d2/d19/d16/f3a to d2/d19/d16/d31/d83/f141 0 2024-02-10T00:00:44.694 INFO:tasks.workunit.client.0.smithi164.stdout:9/890: mkdir d6/de/d22/d58/dba/da7/d127 0 2024-02-10T00:00:44.695 INFO:tasks.workunit.client.0.smithi164.stdout:9/891: write d6/de/d22/dd3/d104/d8b/d24/d4f/f100 [888968,1317] 0 2024-02-10T00:00:44.697 INFO:tasks.workunit.client.0.smithi164.stdout:4/923: symlink d2/d19/d16/l142 0 2024-02-10T00:00:44.698 INFO:tasks.workunit.client.0.smithi164.stdout:4/924: fsync d2/d19/d16/d31/d7e/fc0 0 2024-02-10T00:00:44.699 INFO:tasks.workunit.client.0.smithi164.stdout:8/937: dread d2/d64/d65/d80/d32/d93/db7/ff9 [0,4194304] 0 2024-02-10T00:00:44.700 INFO:tasks.workunit.client.0.smithi164.stdout:9/892: symlink d6/de/d22/d58/dba/d61/d107/l128 0 2024-02-10T00:00:44.702 INFO:tasks.workunit.client.0.smithi164.stdout:6/955: getdents d0/d3b 0 2024-02-10T00:00:44.702 INFO:tasks.workunit.client.0.smithi164.stdout:4/925: mknod d2/d2f/d37/d41/d3d/d42/da2/db5/c143 0 2024-02-10T00:00:44.704 INFO:tasks.workunit.client.0.smithi164.stdout:3/820: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:44.707 INFO:tasks.workunit.client.0.smithi164.stdout:1/834: dwrite d1/d23/d61/fb3 [0,4194304] 0 2024-02-10T00:00:44.707 INFO:tasks.workunit.client.0.smithi164.stdout:4/926: mknod d2/d2f/d37/d45/dd9/c144 0 2024-02-10T00:00:44.709 INFO:tasks.workunit.client.0.smithi164.stdout:6/956: rename d0/d6/f54 to d0/d6/d95/dcd/dc3/f13e 0 2024-02-10T00:00:44.711 INFO:tasks.workunit.client.0.smithi164.stdout:7/913: sync 2024-02-10T00:00:44.713 INFO:tasks.workunit.client.0.smithi164.stdout:1/835: fsync d1/d13/d2b/d52/f5d 0 2024-02-10T00:00:44.714 INFO:tasks.workunit.client.0.smithi164.stdout:6/957: dwrite d0/d2b/f36 [0,4194304] 0 2024-02-10T00:00:44.716 INFO:tasks.workunit.client.0.smithi164.stdout:3/821: symlink d0/d1/dd/l104 0 2024-02-10T00:00:44.718 INFO:tasks.workunit.client.0.smithi164.stdout:1/836: dread d1/d1a/d41/d18/d3a/fb9 [0,4194304] 0 2024-02-10T00:00:44.718 INFO:tasks.workunit.client.0.smithi164.stdout:4/927: creat d2/d2f/d37/f145 x:0 0 0 2024-02-10T00:00:44.721 INFO:tasks.workunit.client.0.smithi164.stdout:8/938: dwrite d2/d64/d65/d98/fb8 [0,4194304] 0 2024-02-10T00:00:44.721 INFO:tasks.workunit.client.0.smithi164.stdout:6/958: mkdir d0/d6/d13f 0 2024-02-10T00:00:44.721 INFO:tasks.workunit.client.0.smithi164.stdout:3/822: fsync d0/d1/dd/f52 0 2024-02-10T00:00:44.724 INFO:tasks.workunit.client.0.smithi164.stdout:4/928: creat d2/d2f/d37/d45/d127/d140/f146 x:0 0 0 2024-02-10T00:00:44.728 INFO:tasks.workunit.client.0.smithi164.stdout:1/837: link d1/d1a/d41/d18/f3e d1/d23/d37/da9/dd7/f116 0 2024-02-10T00:00:44.730 INFO:tasks.workunit.client.0.smithi164.stdout:9/893: dread d6/de/d22/dd3/d104/d8b/d24/f73 [0,4194304] 0 2024-02-10T00:00:44.730 INFO:tasks.workunit.client.0.smithi164.stdout:8/939: creat d2/d64/d65/d80/d32/d93/db7/f121 x:0 0 0 2024-02-10T00:00:44.731 INFO:tasks.workunit.client.0.smithi164.stdout:4/929: symlink d2/d19/d16/d31/d4b/d120/l147 0 2024-02-10T00:00:44.732 INFO:tasks.workunit.client.0.smithi164.stdout:3/823: mknod d0/d3b/dce/de1/c105 0 2024-02-10T00:00:44.736 INFO:tasks.workunit.client.0.smithi164.stdout:9/894: dwrite d6/de/d22/d58/dba/d61/d76/fc7 [0,4194304] 0 2024-02-10T00:00:44.736 INFO:tasks.workunit.client.0.smithi164.stdout:4/930: creat d2/d19/d16/d31/d72/dc7/f148 x:0 0 0 2024-02-10T00:00:44.737 INFO:tasks.workunit.client.0.smithi164.stdout:4/931: fdatasync d2/d19/d16/d31/f74 0 2024-02-10T00:00:44.741 INFO:tasks.workunit.client.0.smithi164.stdout:6/959: getdents d0/d2b/d3a/d3d/da7/da9 0 2024-02-10T00:00:44.742 INFO:tasks.workunit.client.0.smithi164.stdout:3/824: getdents d0/d3b/dce/de1/df1 0 2024-02-10T00:00:44.743 INFO:tasks.workunit.client.0.smithi164.stdout:6/960: write d0/d6/d95/dcd/d125/ffe [5629835,61417] 0 2024-02-10T00:00:44.743 INFO:tasks.workunit.client.0.smithi164.stdout:0/871: sync 2024-02-10T00:00:44.744 INFO:tasks.workunit.client.0.smithi164.stdout:5/999: sync 2024-02-10T00:00:44.745 INFO:tasks.workunit.client.0.smithi164.stdout:4/932: rename d2/d2f/d37/d41/f35 to d2/f149 0 2024-02-10T00:00:44.749 INFO:tasks.workunit.client.0.smithi164.stdout:9/895: rename d6/de/d22/f51 to d6/de/d22/d58/dba/d61/d76/d82/dfc/f129 0 2024-02-10T00:00:44.750 INFO:tasks.workunit.client.0.smithi164.stdout:4/933: mknod d2/d2f/d37/d71/c14a 0 2024-02-10T00:00:44.751 INFO:tasks.workunit.client.0.smithi164.stdout:7/914: dread d3/d11/f23 [0,4194304] 0 2024-02-10T00:00:44.751 INFO:tasks.workunit.client.0.smithi164.stdout:9/896: chown d6/de/c15 27536670 1 2024-02-10T00:00:44.752 INFO:tasks.workunit.client.0.smithi164.stdout:3/825: symlink d0/d3b/dce/de1/d84/l106 0 2024-02-10T00:00:44.752 INFO:tasks.workunit.client.0.smithi164.stdout:4/934: chown d2/d19/d16/d31/d72/feb 236369 1 2024-02-10T00:00:44.753 INFO:tasks.workunit.client.0.smithi164.stdout:7/915: write d3/d11/d39/d44/dbd/d107/dda/d5d/f106 [1118835,34323] 0 2024-02-10T00:00:44.754 INFO:tasks.workunit.client.0.smithi164.stdout:6/961: rename d0/d2b/d3a/d3d/d42/d5d/d79/l94 to d0/d6/d95/dcd/dc3/l140 0 2024-02-10T00:00:44.758 INFO:tasks.workunit.client.0.smithi164.stdout:0/872: link d6/d10/d18/d2d/ld2 d6/d10/d4a/l111 0 2024-02-10T00:00:44.769 INFO:tasks.workunit.client.0.smithi164.stdout:9/897: rename d6/de/d40/d74/l10d to d6/de/d22/dd3/d104/d8b/d24/d4f/dff/l12a 0 2024-02-10T00:00:44.770 INFO:tasks.workunit.client.0.smithi164.stdout:3/826: creat d0/d1/dd/f107 x:0 0 0 2024-02-10T00:00:44.771 INFO:tasks.workunit.client.0.smithi164.stdout:0/873: read d6/dec/da6/dea/d44/d90/fa9 [1938687,92224] 0 2024-02-10T00:00:44.771 INFO:tasks.workunit.client.0.smithi164.stdout:1/838: truncate d1/d1a/d35/ff0 2529049 0 2024-02-10T00:00:44.772 INFO:tasks.workunit.client.0.smithi164.stdout:8/940: truncate d2/d64/f97 2646846 0 2024-02-10T00:00:44.775 INFO:tasks.workunit.client.0.smithi164.stdout:3/827: dread d0/d1/d2/d19/f39 [0,4194304] 0 2024-02-10T00:00:44.776 INFO:tasks.workunit.client.0.smithi164.stdout:8/941: write d2/d64/d54/d5f/f101 [6956293,123323] 0 2024-02-10T00:00:44.782 INFO:tasks.workunit.client.0.smithi164.stdout:7/916: dwrite d3/d11/d39/d44/d6f/d75/fe7 [0,4194304] 0 2024-02-10T00:00:44.786 INFO:tasks.workunit.client.0.smithi164.stdout:6/962: rename d0/d2b/d3a/d3d/da7/da9 to d0/d2b/d3a/d3d/d42/d5d/d79/dbc/d141 0 2024-02-10T00:00:44.786 INFO:tasks.workunit.client.0.smithi164.stdout:6/963: stat d0/f5 0 2024-02-10T00:00:44.789 INFO:tasks.workunit.client.0.smithi164.stdout:3/828: mkdir d0/d3b/dce/de1/df1/d108 0 2024-02-10T00:00:44.792 INFO:tasks.workunit.client.0.smithi164.stdout:7/917: creat d3/d11/d39/d44/d10d/f137 x:0 0 0 2024-02-10T00:00:44.795 INFO:tasks.workunit.client.0.smithi164.stdout:7/918: dread d3/d11/d39/d44/d10d/f27 [0,4194304] 0 2024-02-10T00:00:44.796 INFO:tasks.workunit.client.0.smithi164.stdout:8/942: mkdir d2/d64/d65/d80/d32/d99/d9e/d122 0 2024-02-10T00:00:44.798 INFO:tasks.workunit.client.0.smithi164.stdout:0/874: getdents d6/d3a/d97 0 2024-02-10T00:00:44.799 INFO:tasks.workunit.client.0.smithi164.stdout:0/875: readlink d6/dec/da6/dea/d44/d49/d95/dc0/leb 0 2024-02-10T00:00:44.799 INFO:tasks.workunit.client.0.smithi164.stdout:9/898: write d6/de/d40/f81 [291520,64435] 0 2024-02-10T00:00:44.800 INFO:tasks.workunit.client.0.smithi164.stdout:8/943: truncate d2/d115/f120 969118 0 2024-02-10T00:00:44.801 INFO:tasks.workunit.client.0.smithi164.stdout:0/876: write d6/d10/d4a/d88/fd9 [980456,2362] 0 2024-02-10T00:00:44.803 INFO:tasks.workunit.client.0.smithi164.stdout:8/944: truncate d2/d64/f61 5626713 0 2024-02-10T00:00:44.804 INFO:tasks.workunit.client.0.smithi164.stdout:0/877: unlink d6/dec/f54 0 2024-02-10T00:00:44.805 INFO:tasks.workunit.client.0.smithi164.stdout:1/839: dwrite d1/d23/d37/da9/dd7/f116 [0,4194304] 0 2024-02-10T00:00:44.807 INFO:tasks.workunit.client.0.smithi164.stdout:3/829: write d0/d1/faf [5143209,44655] 0 2024-02-10T00:00:44.809 INFO:tasks.workunit.client.0.smithi164.stdout:0/878: creat d6/d10/d4a/dc7/f112 x:0 0 0 2024-02-10T00:00:44.810 INFO:tasks.workunit.client.0.smithi164.stdout:9/899: truncate d6/de/d22/d58/dba/d61/fc1 990552 0 2024-02-10T00:00:44.811 INFO:tasks.workunit.client.0.smithi164.stdout:4/935: sync 2024-02-10T00:00:44.812 INFO:tasks.workunit.client.0.smithi164.stdout:3/830: write d0/d103/d37/d3f/fd7 [988086,104496] 0 2024-02-10T00:00:44.815 INFO:tasks.workunit.client.0.smithi164.stdout:6/964: dwrite d0/d2b/d3a/dd0/d93/db4/fda [0,4194304] 0 2024-02-10T00:00:44.816 INFO:tasks.workunit.client.0.smithi164.stdout:7/919: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:44.818 INFO:tasks.workunit.client.0.smithi164.stdout:0/879: rename d6/d10/lab to d6/d10/d4a/d60/l113 0 2024-02-10T00:00:44.818 INFO:tasks.workunit.client.0.smithi164.stdout:8/945: dwrite d2/d64/d65/d80/d32/f3e [0,4194304] 0 2024-02-10T00:00:44.821 INFO:tasks.workunit.client.0.smithi164.stdout:4/936: write d2/d2f/d37/d41/d3d/d42/d5f/ff8 [407680,17564] 0 2024-02-10T00:00:44.821 INFO:tasks.workunit.client.0.smithi164.stdout:1/840: dwrite d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:44.824 INFO:tasks.workunit.client.0.smithi164.stdout:6/965: rename d0/fc to d0/d3b/dd4/f142 0 2024-02-10T00:00:44.826 INFO:tasks.workunit.client.0.smithi164.stdout:8/946: rmdir d2/d64/d54/d5f 39 2024-02-10T00:00:44.827 INFO:tasks.workunit.client.0.smithi164.stdout:9/900: dwrite d6/de/d22/d58/dba/f94 [0,4194304] 0 2024-02-10T00:00:44.827 INFO:tasks.workunit.client.0.smithi164.stdout:0/880: mknod d6/d10/d4a/d60/d6c/df7/c114 0 2024-02-10T00:00:44.828 INFO:tasks.workunit.client.0.smithi164.stdout:7/920: creat d3/d11/d39/d44/f138 x:0 0 0 2024-02-10T00:00:44.831 INFO:tasks.workunit.client.0.smithi164.stdout:1/841: mkdir d1/d13/d2b/d52/db7/d117 0 2024-02-10T00:00:44.833 INFO:tasks.workunit.client.0.smithi164.stdout:4/937: unlink d2/d2f/d37/d41/d3d/d42/da2/ce4 0 2024-02-10T00:00:44.838 INFO:tasks.workunit.client.0.smithi164.stdout:9/901: rename d6/de/d22/d58/dba/d61/d76/d82 to d6/de/d22/dd3/d104/d12b 0 2024-02-10T00:00:44.840 INFO:tasks.workunit.client.0.smithi164.stdout:8/947: link d2/d64/d65/d80/l36 d2/d64/l123 0 2024-02-10T00:00:44.842 INFO:tasks.workunit.client.0.smithi164.stdout:0/881: getdents d6 0 2024-02-10T00:00:44.842 INFO:tasks.workunit.client.0.smithi164.stdout:7/921: read d3/d11/d39/d44/d10d/f31 [414546,75468] 0 2024-02-10T00:00:44.845 INFO:tasks.workunit.client.0.smithi164.stdout:7/922: rmdir d3/d5/d2b/d4a/d100 39 2024-02-10T00:00:44.847 INFO:tasks.workunit.client.0.smithi164.stdout:8/948: dwrite d2/d64/d54/db9/ff8 [0,4194304] 0 2024-02-10T00:00:44.850 INFO:tasks.workunit.client.0.smithi164.stdout:7/923: truncate d3/d11/d39/d44/fad 1568304 0 2024-02-10T00:00:44.851 INFO:tasks.workunit.client.0.smithi164.stdout:7/924: write d3/d11/d39/d44/d9a/f117 [719446,79474] 0 2024-02-10T00:00:44.855 INFO:tasks.workunit.client.0.smithi164.stdout:7/925: dwrite d3/d11/d39/d44/dbd/d107/fe0 [0,4194304] 0 2024-02-10T00:00:44.858 INFO:tasks.workunit.client.0.smithi164.stdout:7/926: truncate d3/d11/f14 3526459 0 2024-02-10T00:00:44.863 INFO:tasks.workunit.client.0.smithi164.stdout:3/831: dread d0/d1/d2/fcd [0,4194304] 0 2024-02-10T00:00:44.863 INFO:tasks.workunit.client.0.smithi164.stdout:7/927: rename d3/d28/d51/f64 to d3/d11/d39/d44/d48/f139 0 2024-02-10T00:00:44.868 INFO:tasks.workunit.client.0.smithi164.stdout:7/928: link d3/d5/f8b d3/d11/d39/d44/d48/d50/d92/f13a 0 2024-02-10T00:00:44.868 INFO:tasks.workunit.client.0.smithi164.stdout:7/929: chown d3/d5/d9b 28235872 1 2024-02-10T00:00:44.869 INFO:tasks.workunit.client.0.smithi164.stdout:8/949: dread d2/d64/d7d/fc8 [0,4194304] 0 2024-02-10T00:00:44.870 INFO:tasks.workunit.client.0.smithi164.stdout:1/842: sync 2024-02-10T00:00:44.873 INFO:tasks.workunit.client.0.smithi164.stdout:1/843: mknod d1/d13/d2b/d52/db7/ddf/c118 0 2024-02-10T00:00:44.874 INFO:tasks.workunit.client.0.smithi164.stdout:4/938: dread d2/d2f/d37/d41/d69/fb6 [0,4194304] 0 2024-02-10T00:00:44.874 INFO:tasks.workunit.client.0.smithi164.stdout:4/939: readlink d2/d2f/lf7 0 2024-02-10T00:00:44.875 INFO:tasks.workunit.client.0.smithi164.stdout:1/844: mknod d1/d1a/d9a/c119 0 2024-02-10T00:00:44.875 INFO:tasks.workunit.client.0.smithi164.stdout:1/845: chown d1/d1a/d75/l90 49 1 2024-02-10T00:00:44.876 INFO:tasks.workunit.client.0.smithi164.stdout:1/846: dread - d1/d1a/d41/d18/fe6 zero size 2024-02-10T00:00:44.879 INFO:tasks.workunit.client.0.smithi164.stdout:4/940: link d2/d19/d16/d31/d6d/fd5 d2/d2f/d37/d41/d3d/d42/f14b 0 2024-02-10T00:00:44.880 INFO:tasks.workunit.client.0.smithi164.stdout:4/941: dread - d2/f10e zero size 2024-02-10T00:00:44.880 INFO:tasks.workunit.client.0.smithi164.stdout:4/942: stat d2/d2f/d37/d41/f46 0 2024-02-10T00:00:44.881 INFO:tasks.workunit.client.0.smithi164.stdout:4/943: dread - d2/d19/d16/d31/f139 zero size 2024-02-10T00:00:44.884 INFO:tasks.workunit.client.0.smithi164.stdout:4/944: truncate d2/d2f/d37/d41/d3d/d42/f7c 767952 0 2024-02-10T00:00:44.885 INFO:tasks.workunit.client.0.smithi164.stdout:4/945: chown d2/d2f/d37/d41/d3d/d42/da2/fc2 457666 1 2024-02-10T00:00:44.888 INFO:tasks.workunit.client.0.smithi164.stdout:4/946: chown d2/d19/d16/d31/f100 7910433 1 2024-02-10T00:00:44.889 INFO:tasks.workunit.client.0.smithi164.stdout:4/947: dread - d2/d19/d16/d31/d72/dc7/fe7 zero size 2024-02-10T00:00:44.890 INFO:tasks.workunit.client.0.smithi164.stdout:4/948: chown d2/d2f/d37/ce6 0 1 2024-02-10T00:00:44.891 INFO:tasks.workunit.client.0.smithi164.stdout:6/966: write d0/d3b/fce [799710,107812] 0 2024-02-10T00:00:44.892 INFO:tasks.workunit.client.0.smithi164.stdout:0/882: dread d6/dec/da6/dea/f48 [0,4194304] 0 2024-02-10T00:00:44.895 INFO:tasks.workunit.client.0.smithi164.stdout:4/949: mkdir d2/d2f/d37/d41/d3d/df0/d14c 0 2024-02-10T00:00:44.896 INFO:tasks.workunit.client.0.smithi164.stdout:4/950: fdatasync d2/d2f/d37/d41/d3d/f52 0 2024-02-10T00:00:44.901 INFO:tasks.workunit.client.0.smithi164.stdout:9/902: dwrite d6/f1e [0,4194304] 0 2024-02-10T00:00:44.902 INFO:tasks.workunit.client.0.smithi164.stdout:9/903: write d6/de/f11 [3031807,24600] 0 2024-02-10T00:00:44.903 INFO:tasks.workunit.client.0.smithi164.stdout:9/904: stat d6/de/d22/d58/dba/d75/fe6 0 2024-02-10T00:00:44.903 INFO:tasks.workunit.client.0.smithi164.stdout:9/905: stat d6/de/d22/dd3/d104/f120 0 2024-02-10T00:00:44.904 INFO:tasks.workunit.client.0.smithi164.stdout:3/832: truncate d0/d3b/dce/f9e 112964 0 2024-02-10T00:00:44.905 INFO:tasks.workunit.client.0.smithi164.stdout:7/930: write d3/d11/d39/d44/d48/d71/fbe [1524498,117117] 0 2024-02-10T00:00:44.905 INFO:tasks.workunit.client.0.smithi164.stdout:3/833: readlink d0/d1/d2/d19/d27/d5f/da5/d94/lc5 0 2024-02-10T00:00:44.908 INFO:tasks.workunit.client.0.smithi164.stdout:8/950: dwrite d2/f11 [4194304,4194304] 0 2024-02-10T00:00:44.909 INFO:tasks.workunit.client.0.smithi164.stdout:1/847: truncate d1/fd 2426278 0 2024-02-10T00:00:44.913 INFO:tasks.workunit.client.0.smithi164.stdout:4/951: rename d2/d19/c130 to d2/d2f/d37/d41/d3d/d42/da2/c14d 0 2024-02-10T00:00:44.920 INFO:tasks.workunit.client.0.smithi164.stdout:9/906: dwrite d6/de/d22/dd3/d104/f99 [0,4194304] 0 2024-02-10T00:00:44.920 INFO:tasks.workunit.client.0.smithi164.stdout:1/848: unlink d1/d1a/d41/fb 0 2024-02-10T00:00:44.924 INFO:tasks.workunit.client.0.smithi164.stdout:7/931: rename d3/d5/d9b/daa to d3/d11/d39/d44/dbd/d107/dda/d13b 0 2024-02-10T00:00:44.924 INFO:tasks.workunit.client.0.smithi164.stdout:4/952: mknod d2/d2f/d37/d71/c14e 0 2024-02-10T00:00:44.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/953: fsync d2/f10e 0 2024-02-10T00:00:44.925 INFO:tasks.workunit.client.0.smithi164.stdout:4/954: stat d2/d5a/d94 0 2024-02-10T00:00:44.926 INFO:tasks.workunit.client.0.smithi164.stdout:4/955: stat d2/d2f/d37/d41/f95 0 2024-02-10T00:00:44.927 INFO:tasks.workunit.client.0.smithi164.stdout:4/956: fdatasync d2/d2f/d37/d41/d3d/d56/db2/f104 0 2024-02-10T00:00:44.929 INFO:tasks.workunit.client.0.smithi164.stdout:9/907: mkdir d6/de/d40/d74/d12c 0 2024-02-10T00:00:44.932 INFO:tasks.workunit.client.0.smithi164.stdout:0/883: write d6/dec/da6/dea/d44/ffe [4083230,6511] 0 2024-02-10T00:00:44.935 INFO:tasks.workunit.client.0.smithi164.stdout:7/932: mkdir d3/dbf/d13c 0 2024-02-10T00:00:44.936 INFO:tasks.workunit.client.0.smithi164.stdout:6/967: link d0/d2b/d3a/d3d/l97 d0/d6/d12/l143 0 2024-02-10T00:00:44.937 INFO:tasks.workunit.client.0.smithi164.stdout:6/968: write d0/d3b/d56/db3/fe5 [244916,103365] 0 2024-02-10T00:00:44.937 INFO:tasks.workunit.client.0.smithi164.stdout:6/969: chown d0/d2b 318 1 2024-02-10T00:00:44.938 INFO:tasks.workunit.client.0.smithi164.stdout:6/970: write d0/d2b/d3a/d3d/d42/d5d/d79/fb1 [2548794,68641] 0 2024-02-10T00:00:44.940 INFO:tasks.workunit.client.0.smithi164.stdout:3/834: truncate d0/d3b/dce/de1/d84/f62 1145584 0 2024-02-10T00:00:44.941 INFO:tasks.workunit.client.0.smithi164.stdout:8/951: write d2/d64/d65/d80/d32/d58/f79 [869121,41504] 0 2024-02-10T00:00:44.943 INFO:tasks.workunit.client.0.smithi164.stdout:9/908: creat d6/de/d22/dd3/d104/d8b/d24/d4f/f12d x:0 0 0 2024-02-10T00:00:44.945 INFO:tasks.workunit.client.0.smithi164.stdout:7/933: truncate d3/d11/d39/d44/d10d/f27 39696 0 2024-02-10T00:00:44.947 INFO:tasks.workunit.client.0.smithi164.stdout:6/971: rmdir d0/d3b/dd4 39 2024-02-10T00:00:44.950 INFO:tasks.workunit.client.0.smithi164.stdout:7/934: dwrite d3/d11/d39/d44/d10d/d67/d98/f12f [0,4194304] 0 2024-02-10T00:00:44.954 INFO:tasks.workunit.client.0.smithi164.stdout:4/957: creat d2/d2f/d37/d45/d12c/f14f x:0 0 0 2024-02-10T00:00:44.954 INFO:tasks.workunit.client.0.smithi164.stdout:7/935: dwrite d3/d28/f3f [0,4194304] 0 2024-02-10T00:00:44.956 INFO:tasks.workunit.client.0.smithi164.stdout:1/849: write d1/d1a/d41/d18/f3e [111398,2039] 0 2024-02-10T00:00:44.956 INFO:tasks.workunit.client.0.smithi164.stdout:9/909: mkdir d6/de/d22/dd3/d104/d12b/dfc/d12e 0 2024-02-10T00:00:44.961 INFO:tasks.workunit.client.0.smithi164.stdout:4/958: fsync d2/d2f/d37/d41/d3d/fa5 0 2024-02-10T00:00:44.964 INFO:tasks.workunit.client.0.smithi164.stdout:3/835: fdatasync d0/d103/d37/fdc 0 2024-02-10T00:00:44.966 INFO:tasks.workunit.client.0.smithi164.stdout:0/884: truncate d6/d3a/fe4 665165 0 2024-02-10T00:00:44.968 INFO:tasks.workunit.client.0.smithi164.stdout:7/936: creat d3/d11/d39/d44/d48/d50/d136/f13d x:0 0 0 2024-02-10T00:00:44.969 INFO:tasks.workunit.client.0.smithi164.stdout:9/910: creat d6/de/d22/dd3/d104/d8b/d24/d10b/f12f x:0 0 0 2024-02-10T00:00:44.969 INFO:tasks.workunit.client.0.smithi164.stdout:6/972: dread d0/d6/d12/d14/f50 [0,4194304] 0 2024-02-10T00:00:44.971 INFO:tasks.workunit.client.0.smithi164.stdout:3/836: write d0/d3b/dce/de1/d84/ffa [918260,100110] 0 2024-02-10T00:00:44.971 INFO:tasks.workunit.client.0.smithi164.stdout:0/885: rmdir d6/dec/da6/de6 39 2024-02-10T00:00:44.972 INFO:tasks.workunit.client.0.smithi164.stdout:4/959: dread d2/d19/d16/d31/f4f [0,4194304] 0 2024-02-10T00:00:44.972 INFO:tasks.workunit.client.0.smithi164.stdout:4/960: fsync d2/d19/d16/ff1 0 2024-02-10T00:00:44.973 INFO:tasks.workunit.client.0.smithi164.stdout:3/837: creat d0/d3b/f109 x:0 0 0 2024-02-10T00:00:44.974 INFO:tasks.workunit.client.0.smithi164.stdout:7/937: mknod d3/c13e 0 2024-02-10T00:00:44.975 INFO:tasks.workunit.client.0.smithi164.stdout:7/938: chown d3/d11/d39/d44/dbd/d107/dda 1883 1 2024-02-10T00:00:44.975 INFO:tasks.workunit.client.0.smithi164.stdout:7/939: chown d3/d11/d39/d44/d10d/d67/d11d 74485520 1 2024-02-10T00:00:44.976 INFO:tasks.workunit.client.0.smithi164.stdout:6/973: link d0/d6/fa1 d0/d6/d13f/f144 0 2024-02-10T00:00:44.977 INFO:tasks.workunit.client.0.smithi164.stdout:7/940: readlink d3/d11/d39/d44/d6f/d75/l115 0 2024-02-10T00:00:44.979 INFO:tasks.workunit.client.0.smithi164.stdout:8/952: write d2/d64/d54/ff6 [2333744,75638] 0 2024-02-10T00:00:44.980 INFO:tasks.workunit.client.0.smithi164.stdout:6/974: chown d0/d6/d95/dcd/dc3/fd5 273122238 1 2024-02-10T00:00:44.980 INFO:tasks.workunit.client.0.smithi164.stdout:8/953: read - d2/d64/d65/d80/f86 zero size 2024-02-10T00:00:44.980 INFO:tasks.workunit.client.0.smithi164.stdout:4/961: rename d2/d5a/d94/ld7 to d2/d19/d16/d31/d72/d117/l150 0 2024-02-10T00:00:44.980 INFO:tasks.workunit.client.0.smithi164.stdout:4/962: write d2/d2f/d37/d41/d3d/f52 [2683164,121777] 0 2024-02-10T00:00:44.981 INFO:tasks.workunit.client.0.smithi164.stdout:0/886: creat d6/d10/f115 x:0 0 0 2024-02-10T00:00:44.982 INFO:tasks.workunit.client.0.smithi164.stdout:0/887: write d6/fe9 [590661,37619] 0 2024-02-10T00:00:44.986 INFO:tasks.workunit.client.0.smithi164.stdout:3/838: creat d0/d3b/dce/de1/d84/d82/f10a x:0 0 0 2024-02-10T00:00:44.988 INFO:tasks.workunit.client.0.smithi164.stdout:1/850: dwrite d1/d13/d2b/d52/da4/faa [0,4194304] 0 2024-02-10T00:00:44.989 INFO:tasks.workunit.client.0.smithi164.stdout:7/941: chown d3/d11/d39/d44/d48/f12d 244047314 1 2024-02-10T00:00:44.990 INFO:tasks.workunit.client.0.smithi164.stdout:7/942: fdatasync d3/d11/d39/d44/d6f/ffa 0 2024-02-10T00:00:44.992 INFO:tasks.workunit.client.0.smithi164.stdout:8/954: creat d2/d81/f124 x:0 0 0 2024-02-10T00:00:44.996 INFO:tasks.workunit.client.0.smithi164.stdout:4/963: rmdir d2/d19 39 2024-02-10T00:00:45.000 INFO:tasks.workunit.client.0.smithi164.stdout:4/964: dwrite d2/d2f/d37/f145 [0,4194304] 0 2024-02-10T00:00:45.002 INFO:tasks.workunit.client.0.smithi164.stdout:6/975: fdatasync d0/d2b/f7e 0 2024-02-10T00:00:45.003 INFO:tasks.workunit.client.0.smithi164.stdout:8/955: chown d2/d64/d54/d5f/ca3 2346501 1 2024-02-10T00:00:45.009 INFO:tasks.workunit.client.0.smithi164.stdout:1/851: truncate d1/d13/d2b/d52/d56/fdc 546386 0 2024-02-10T00:00:45.011 INFO:tasks.workunit.client.0.smithi164.stdout:0/888: dwrite d6/d10/d4a/d88/fde [0,4194304] 0 2024-02-10T00:00:45.013 INFO:tasks.workunit.client.0.smithi164.stdout:7/943: link d3/f16 d3/d11/d39/d44/d10d/d67/d11d/f13f 0 2024-02-10T00:00:45.014 INFO:tasks.workunit.client.0.smithi164.stdout:3/839: truncate d0/d103/d37/d3f/d4e/f96 701428 0 2024-02-10T00:00:45.014 INFO:tasks.workunit.client.0.smithi164.stdout:4/965: symlink d2/d19/d16/d31/dcf/l151 0 2024-02-10T00:00:45.019 INFO:tasks.workunit.client.0.smithi164.stdout:4/966: creat d2/d2f/d37/d41/d3d/d56/d85/f152 x:0 0 0 2024-02-10T00:00:45.028 INFO:tasks.workunit.client.0.smithi164.stdout:6/976: unlink d0/d3b/d56/l76 0 2024-02-10T00:00:45.028 INFO:tasks.workunit.client.0.smithi164.stdout:7/944: link d3/d11/d39/d44/d6f/d75/fd1 d3/d11/d39/d44/d10d/da7/f140 0 2024-02-10T00:00:45.030 INFO:tasks.workunit.client.0.smithi164.stdout:0/889: rmdir d6/d10/d66/dfb/d104 0 2024-02-10T00:00:45.030 INFO:tasks.workunit.client.0.smithi164.stdout:3/840: truncate d0/d1/dd/f107 435954 0 2024-02-10T00:00:45.032 INFO:tasks.workunit.client.0.smithi164.stdout:6/977: mknod d0/d2b/d3a/dd0/d93/d105/c145 0 2024-02-10T00:00:45.034 INFO:tasks.workunit.client.0.smithi164.stdout:0/890: rename d6/d10/d66/d10b/d10c/cf6 to d6/d10/d18/d2d/d39/de0/c116 0 2024-02-10T00:00:45.037 INFO:tasks.workunit.client.0.smithi164.stdout:9/911: sync 2024-02-10T00:00:45.037 INFO:tasks.workunit.client.0.smithi164.stdout:3/841: dwrite d0/d1/d2/d19/f56 [4194304,4194304] 0 2024-02-10T00:00:45.038 INFO:tasks.workunit.client.0.smithi164.stdout:3/842: stat d0/fc1 0 2024-02-10T00:00:45.039 INFO:tasks.workunit.client.0.smithi164.stdout:3/843: write d0/d1/dd/fd8 [272247,99193] 0 2024-02-10T00:00:45.040 INFO:tasks.workunit.client.0.smithi164.stdout:6/978: mknod d0/d2b/d3a/d3d/d42/d5d/d79/dbc/d141/c146 0 2024-02-10T00:00:45.042 INFO:tasks.workunit.client.0.smithi164.stdout:0/891: read d6/d10/d18/d2d/f37 [2148614,87272] 0 2024-02-10T00:00:45.043 INFO:tasks.workunit.client.0.smithi164.stdout:6/979: write d0/d6/d12/d14/f61 [7063539,87142] 0 2024-02-10T00:00:45.043 INFO:tasks.workunit.client.0.smithi164.stdout:1/852: dread d1/d1a/f73 [0,4194304] 0 2024-02-10T00:00:45.045 INFO:tasks.workunit.client.0.smithi164.stdout:8/956: dread d2/fd1 [0,4194304] 0 2024-02-10T00:00:45.047 INFO:tasks.workunit.client.0.smithi164.stdout:4/967: dread d2/d19/d16/d31/d57/f59 [0,4194304] 0 2024-02-10T00:00:45.048 INFO:tasks.workunit.client.0.smithi164.stdout:3/844: dread d0/d3b/dce/de1/d84/ffa [0,4194304] 0 2024-02-10T00:00:45.049 INFO:tasks.workunit.client.0.smithi164.stdout:7/945: truncate d3/d11/f82 2586571 0 2024-02-10T00:00:45.051 INFO:tasks.workunit.client.0.smithi164.stdout:1/853: mknod d1/d23/d37/da9/dd1/c11a 0 2024-02-10T00:00:45.052 INFO:tasks.workunit.client.0.smithi164.stdout:1/854: readlink d1/d1a/d41/l115 0 2024-02-10T00:00:45.054 INFO:tasks.workunit.client.0.smithi164.stdout:0/892: rename d6/d10/d18/d2d/f37 to d6/dec/d79/f117 0 2024-02-10T00:00:45.055 INFO:tasks.workunit.client.0.smithi164.stdout:6/980: truncate d0/d2b/d3a/d3d/d42/d5d/d66/f82 569191 0 2024-02-10T00:00:45.056 INFO:tasks.workunit.client.0.smithi164.stdout:1/855: dread d1/d23/f7d [0,4194304] 0 2024-02-10T00:00:45.058 INFO:tasks.workunit.client.0.smithi164.stdout:3/845: creat d0/d8f/d9a/f10b x:0 0 0 2024-02-10T00:00:45.064 INFO:tasks.workunit.client.0.smithi164.stdout:4/968: creat d2/d2f/d37/d41/d3d/df0/d105/f153 x:0 0 0 2024-02-10T00:00:45.065 INFO:tasks.workunit.client.0.smithi164.stdout:6/981: truncate d0/d2b/d3a/d3d/d42/d5d/d79/dbc/d141/de1/f116 68062 0 2024-02-10T00:00:45.069 INFO:tasks.workunit.client.0.smithi164.stdout:3/846: dread d0/f10 [0,4194304] 0 2024-02-10T00:00:45.069 INFO:tasks.workunit.client.0.smithi164.stdout:0/893: mkdir d6/d10/d4a/dc7/dd7/d118 0 2024-02-10T00:00:45.071 INFO:tasks.workunit.client.0.smithi164.stdout:9/912: dread d6/de/d22/dd3/d104/d8b/d24/d4f/f8a [8388608,4194304] 0 2024-02-10T00:00:45.072 INFO:tasks.workunit.client.0.smithi164.stdout:9/913: chown d6/de/d22/d58/dba/d75/dc0 964 1 2024-02-10T00:00:45.072 INFO:tasks.workunit.client.0.smithi164.stdout:4/969: truncate d2/d2f/d37/d45/dab/dbd/fdf 735037 0 2024-02-10T00:00:45.073 INFO:tasks.workunit.client.0.smithi164.stdout:7/946: link d3/d5/l68 d3/d11/d39/d44/dbd/d107/dcf/l141 0 2024-02-10T00:00:45.076 INFO:tasks.workunit.client.0.smithi164.stdout:8/957: getdents d2/d64/d65/d80/d32/d99/da0 0 2024-02-10T00:00:45.076 INFO:tasks.workunit.client.0.smithi164.stdout:8/958: write d2/f20 [5636105,113130] 0 2024-02-10T00:00:45.080 INFO:tasks.workunit.client.0.smithi164.stdout:0/894: truncate d6/d10/f61 1296691 0 2024-02-10T00:00:45.080 INFO:tasks.workunit.client.0.smithi164.stdout:1/856: truncate d1/d13/d1f/f102 117710 0 2024-02-10T00:00:45.082 INFO:tasks.workunit.client.0.smithi164.stdout:4/970: chown d2/d19/d16/d31/d7e/d81/f87 204281 1 2024-02-10T00:00:45.085 INFO:tasks.workunit.client.0.smithi164.stdout:6/982: write d0/d3b/f6f [204172,117146] 0 2024-02-10T00:00:45.085 INFO:tasks.workunit.client.0.smithi164.stdout:7/947: symlink d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/dd6/l142 0 2024-02-10T00:00:45.087 INFO:tasks.workunit.client.0.smithi164.stdout:8/959: symlink d2/d64/d7d/l125 0 2024-02-10T00:00:45.089 INFO:tasks.workunit.client.0.smithi164.stdout:0/895: mknod d6/d10/d18/d2d/d39/c119 0 2024-02-10T00:00:45.090 INFO:tasks.workunit.client.0.smithi164.stdout:1/857: chown d1/d1a/d41/f104 82613 1 2024-02-10T00:00:45.092 INFO:tasks.workunit.client.0.smithi164.stdout:7/948: dwrite d3/d11/d39/d44/dbd/d107/fe0 [0,4194304] 0 2024-02-10T00:00:45.093 INFO:tasks.workunit.client.0.smithi164.stdout:4/971: write d2/d19/d16/d31/d7e/d81/f87 [2819567,68971] 0 2024-02-10T00:00:45.094 INFO:tasks.workunit.client.0.smithi164.stdout:3/847: creat d0/f10c x:0 0 0 2024-02-10T00:00:45.096 INFO:tasks.workunit.client.0.smithi164.stdout:8/960: dwrite d2/d64/d65/d80/d32/d99/d9e/f11a [0,4194304] 0 2024-02-10T00:00:45.096 INFO:tasks.workunit.client.0.smithi164.stdout:9/914: truncate d6/f79 5157092 0 2024-02-10T00:00:45.099 INFO:tasks.workunit.client.0.smithi164.stdout:0/896: unlink d6/d7/f6f 0 2024-02-10T00:00:45.101 INFO:tasks.workunit.client.0.smithi164.stdout:8/961: chown d2/d64/d65/d80/d32/d4d/ddd 312289796 1 2024-02-10T00:00:45.101 INFO:tasks.workunit.client.0.smithi164.stdout:1/858: rename d1/d64/f89 to d1/d1a/d9a/f11b 0 2024-02-10T00:00:45.101 INFO:tasks.workunit.client.0.smithi164.stdout:9/915: read d6/de/d22/dd3/d104/d8b/dc2/fca [83551,78739] 0 2024-02-10T00:00:45.103 INFO:tasks.workunit.client.0.smithi164.stdout:4/972: creat d2/d19/d16/d31/d72/f154 x:0 0 0 2024-02-10T00:00:45.104 INFO:tasks.workunit.client.0.smithi164.stdout:7/949: dwrite d3/d5/d2b/d4a/f12c [0,4194304] 0 2024-02-10T00:00:45.104 INFO:tasks.workunit.client.0.smithi164.stdout:3/848: dwrite d0/d3b/fe4 [0,4194304] 0 2024-02-10T00:00:45.104 INFO:tasks.workunit.client.0.smithi164.stdout:9/916: stat d6/de/d22/dd3/d104/d8b 0 2024-02-10T00:00:45.106 INFO:tasks.workunit.client.0.smithi164.stdout:8/962: mkdir d2/d64/d65/d98/d126 0 2024-02-10T00:00:45.107 INFO:tasks.workunit.client.0.smithi164.stdout:3/849: dread - d0/d1/d2/d19/d27/d5f/da5/d94/fdd zero size 2024-02-10T00:00:45.108 INFO:tasks.workunit.client.0.smithi164.stdout:3/850: readlink d0/d1/dd/l61 0 2024-02-10T00:00:45.109 INFO:tasks.workunit.client.0.smithi164.stdout:9/917: symlink d6/de/d2b/l130 0 2024-02-10T00:00:45.111 INFO:tasks.workunit.client.0.smithi164.stdout:0/897: creat d6/d10/d4a/f11a x:0 0 0 2024-02-10T00:00:45.112 INFO:tasks.workunit.client.0.smithi164.stdout:6/983: dread d0/d6/f10 [4194304,4194304] 0 2024-02-10T00:00:45.113 INFO:tasks.workunit.client.0.smithi164.stdout:7/950: symlink d3/d5/d2b/d4a/l143 0 2024-02-10T00:00:45.113 INFO:tasks.workunit.client.0.smithi164.stdout:0/898: fdatasync d6/dec/da6/dea/d44/d90/fb0 0 2024-02-10T00:00:45.118 INFO:tasks.workunit.client.0.smithi164.stdout:3/851: write d0/f10 [1198713,109554] 0 2024-02-10T00:00:45.120 INFO:tasks.workunit.client.0.smithi164.stdout:8/963: creat d2/d64/d54/d71/dd7/f127 x:0 0 0 2024-02-10T00:00:45.121 INFO:tasks.workunit.client.0.smithi164.stdout:9/918: mknod d6/de/d22/d58/dba/d75/dc0/c131 0 2024-02-10T00:00:45.124 INFO:tasks.workunit.client.0.smithi164.stdout:6/984: creat d0/d2b/d3a/d3d/d42/d5d/d79/dbc/d141/dfd/f147 x:0 0 0 2024-02-10T00:00:45.125 INFO:tasks.workunit.client.0.smithi164.stdout:3/852: stat d0/d1/d2/d19/d27/d30/cf7 0 2024-02-10T00:00:45.127 INFO:tasks.workunit.client.0.smithi164.stdout:7/951: creat d3/d5/d131/f144 x:0 0 0 2024-02-10T00:00:45.128 INFO:tasks.workunit.client.0.smithi164.stdout:9/919: creat d6/de/d2b/f132 x:0 0 0 2024-02-10T00:00:45.128 INFO:tasks.workunit.client.0.smithi164.stdout:7/952: write d3/d11/d39/d44/dbd/d107/fe0 [3731280,10812] 0 2024-02-10T00:00:45.129 INFO:tasks.workunit.client.0.smithi164.stdout:0/899: write d6/dec/d79/dce/d101/f10f [85406,44952] 0 2024-02-10T00:00:45.129 INFO:tasks.workunit.client.0.smithi164.stdout:3/853: mknod d0/d3b/dce/de1/d84/d82/c10d 0 2024-02-10T00:00:45.134 INFO:tasks.workunit.client.0.smithi164.stdout:0/900: dread d6/d10/d4a/d88/fd9 [0,4194304] 0 2024-02-10T00:00:45.134 INFO:tasks.workunit.client.0.smithi164.stdout:9/920: rename d6/de/d22/de7/fec to d6/f133 0 2024-02-10T00:00:45.135 INFO:tasks.workunit.client.0.smithi164.stdout:3/854: rmdir d0/d3b/dce/de1/d81/d95 39 2024-02-10T00:00:45.138 INFO:tasks.workunit.client.0.smithi164.stdout:0/901: rmdir d6/dec/d79/dce/d101 39 2024-02-10T00:00:45.142 INFO:tasks.workunit.client.0.smithi164.stdout:9/921: creat d6/de/d40/d74/f134 x:0 0 0 2024-02-10T00:00:45.146 INFO:tasks.workunit.client.0.smithi164.stdout:4/973: write d2/d2f/d37/d41/d3d/d42/d5f/f113 [1180816,99955] 0 2024-02-10T00:00:45.146 INFO:tasks.workunit.client.0.smithi164.stdout:1/859: sync 2024-02-10T00:00:45.149 INFO:tasks.workunit.client.0.smithi164.stdout:0/902: truncate d6/dec/da6/dea/f48 565698 0 2024-02-10T00:00:45.151 INFO:tasks.workunit.client.0.smithi164.stdout:1/860: rmdir d1 39 2024-02-10T00:00:45.152 INFO:tasks.workunit.client.0.smithi164.stdout:6/985: dwrite d0/d2b/d3a/d3d/f135 [0,4194304] 0 2024-02-10T00:00:45.154 INFO:tasks.workunit.client.0.smithi164.stdout:6/986: fdatasync d0/d6/d95/ff7 0 2024-02-10T00:00:45.154 INFO:tasks.workunit.client.0.smithi164.stdout:7/953: dwrite d3/d5/fec [0,4194304] 0 2024-02-10T00:00:45.155 INFO:tasks.workunit.client.0.smithi164.stdout:6/987: fdatasync d0/d2b/d3a/dd0/d93/f11a 0 2024-02-10T00:00:45.155 INFO:tasks.workunit.client.0.smithi164.stdout:3/855: rename d0/d3b/dce/f9e to d0/d1/d2/d19/d27/d5f/da5/f10e 0 2024-02-10T00:00:45.157 INFO:tasks.workunit.client.0.smithi164.stdout:8/964: dread d2/d64/d65/d80/d32/f4b [0,4194304] 0 2024-02-10T00:00:45.162 INFO:tasks.workunit.client.0.smithi164.stdout:4/974: write d2/f1a [1633861,79020] 0 2024-02-10T00:00:45.163 INFO:tasks.workunit.client.0.smithi164.stdout:4/975: dread - d2/d19/d16/ff1 zero size 2024-02-10T00:00:45.164 INFO:tasks.workunit.client.0.smithi164.stdout:0/903: creat d6/d7/d110/f11b x:0 0 0 2024-02-10T00:00:45.164 INFO:tasks.workunit.client.0.smithi164.stdout:0/904: chown d6/d10/d18 98915 1 2024-02-10T00:00:45.165 INFO:tasks.workunit.client.0.smithi164.stdout:9/922: rename d6/de/d2b/lb8 to d6/de/d40/db6/l135 0 2024-02-10T00:00:45.166 INFO:tasks.workunit.client.0.smithi164.stdout:9/923: stat d6/de/de2/cf8 0 2024-02-10T00:00:45.166 INFO:tasks.workunit.client.0.smithi164.stdout:3/856: rmdir d0/d8f/d9a 39 2024-02-10T00:00:45.168 INFO:tasks.workunit.client.0.smithi164.stdout:6/988: rmdir d0/d6/d12/d14/d4b/dbf 39 2024-02-10T00:00:45.169 INFO:tasks.workunit.client.0.smithi164.stdout:6/989: chown d0/d2b/d3a/dd0/d93/lcf 0 1 2024-02-10T00:00:45.170 INFO:tasks.workunit.client.0.smithi164.stdout:7/954: rmdir d3/d11/d39/d44/d10d/d67/d98/daf/dde 39 2024-02-10T00:00:45.171 INFO:tasks.workunit.client.0.smithi164.stdout:9/924: creat d6/de/d22/d58/dba/d75/f136 x:0 0 0 2024-02-10T00:00:45.172 INFO:tasks.workunit.client.0.smithi164.stdout:3/857: mknod d0/d1/d2/d19/d27/d30/c10f 0 2024-02-10T00:00:45.174 INFO:tasks.workunit.client.0.smithi164.stdout:7/955: truncate d3/d11/d39/d3a/f7d 1168591 0 2024-02-10T00:00:45.175 INFO:tasks.workunit.client.0.smithi164.stdout:6/990: fsync d0/d6/d95/dcd/dc3/f13e 0 2024-02-10T00:00:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:4/976: creat d2/d2f/f155 x:0 0 0 2024-02-10T00:00:45.176 INFO:tasks.workunit.client.0.smithi164.stdout:9/925: dwrite d6/de/dfa/f10a [0,4194304] 0 2024-02-10T00:00:45.178 INFO:tasks.workunit.client.0.smithi164.stdout:3/858: mkdir d0/d103/d37/d3f/d4e/d110 0 2024-02-10T00:00:45.179 INFO:tasks.workunit.client.0.smithi164.stdout:9/926: read d6/de/d22/dd3/d104/d12b/db7/f57 [3321823,35584] 0 2024-02-10T00:00:45.179 INFO:tasks.workunit.client.0.smithi164.stdout:3/859: fsync d0/d1/d3c/fa1 0 2024-02-10T00:00:45.179 INFO:tasks.workunit.client.0.smithi164.stdout:6/991: mknod d0/d2b/d3a/c148 0 2024-02-10T00:00:45.180 INFO:tasks.workunit.client.0.smithi164.stdout:7/956: mknod d3/d5/c145 0 2024-02-10T00:00:45.183 INFO:tasks.workunit.client.0.smithi164.stdout:4/977: creat d2/d2f/d37/d41/d3d/d56/db2/f156 x:0 0 0 2024-02-10T00:00:45.184 INFO:tasks.workunit.client.0.smithi164.stdout:9/927: fdatasync d6/de/d22/dd3/d104/d8b/d24/d4f/f100 0 2024-02-10T00:00:45.186 INFO:tasks.workunit.client.0.smithi164.stdout:0/905: write d6/d10/d18/d2d/f51 [1825373,26998] 0 2024-02-10T00:00:45.189 INFO:tasks.workunit.client.0.smithi164.stdout:7/957: dwrite d3/f9 [0,4194304] 0 2024-02-10T00:00:45.189 INFO:tasks.workunit.client.0.smithi164.stdout:6/992: dwrite d0/d2b/f36 [0,4194304] 0 2024-02-10T00:00:45.189 INFO:tasks.workunit.client.0.smithi164.stdout:1/861: truncate d1/d23/f7d 453636 0 2024-02-10T00:00:45.190 INFO:tasks.workunit.client.0.smithi164.stdout:3/860: dread d0/d1/dd/f8d [0,4194304] 0 2024-02-10T00:00:45.192 INFO:tasks.workunit.client.0.smithi164.stdout:8/965: dread d2/d64/f3b [0,4194304] 0 2024-02-10T00:00:45.193 INFO:tasks.workunit.client.0.smithi164.stdout:9/928: dwrite d6/de/d40/f6f [0,4194304] 0 2024-02-10T00:00:45.193 INFO:tasks.workunit.client.0.smithi164.stdout:6/993: chown d0/d6/d81/lf6 156878249 1 2024-02-10T00:00:45.195 INFO:tasks.workunit.client.0.smithi164.stdout:1/862: write d1/d13/d2b/d52/d56/fbc [2780195,10533] 0 2024-02-10T00:00:45.202 INFO:tasks.workunit.client.0.smithi164.stdout:6/994: dwrite d0/d6/d12/d45/fc4 [0,4194304] 0 2024-02-10T00:00:45.202 INFO:tasks.workunit.client.0.smithi164.stdout:7/958: dwrite d3/d11/d39/d44/dbd/d107/dda/f55 [0,4194304] 0 2024-02-10T00:00:45.204 INFO:tasks.workunit.client.0.smithi164.stdout:0/906: mkdir d6/d10/d4a/dc7/dd7/d118/d11c 0 2024-02-10T00:00:45.204 INFO:tasks.workunit.client.0.smithi164.stdout:6/995: chown d0/d3b/d56/db3/fde 174763383 1 2024-02-10T00:00:45.205 INFO:tasks.workunit.client.0.smithi164.stdout:8/966: unlink d2/d64/d65/d80/d32/d99/c119 0 2024-02-10T00:00:45.206 INFO:tasks.workunit.client.0.smithi164.stdout:7/959: write d3/d11/d39/d44/dbd/d107/dda/f55 [1172180,38783] 0 2024-02-10T00:00:45.207 INFO:tasks.workunit.client.0.smithi164.stdout:0/907: read d6/d7/f24 [7122094,30576] 0 2024-02-10T00:00:45.207 INFO:tasks.workunit.client.0.smithi164.stdout:4/978: dwrite d2/d19/d16/f88 [0,4194304] 0 2024-02-10T00:00:45.213 INFO:tasks.workunit.client.0.smithi164.stdout:0/908: mkdir d6/d10/d18/d2d/d39/de0/d11d 0 2024-02-10T00:00:45.213 INFO:tasks.workunit.client.0.smithi164.stdout:4/979: fsync d2/d19/d16/d31/f4f 0 2024-02-10T00:00:45.213 INFO:tasks.workunit.client.0.smithi164.stdout:0/909: stat d6/d3a/d52/d7a 0 2024-02-10T00:00:45.219 INFO:tasks.workunit.client.0.smithi164.stdout:6/996: creat d0/d6/d12/f149 x:0 0 0 2024-02-10T00:00:45.219 INFO:tasks.workunit.client.0.smithi164.stdout:4/980: creat d2/d19/d16/d31/d57/f157 x:0 0 0 2024-02-10T00:00:45.220 INFO:tasks.workunit.client.0.smithi164.stdout:8/967: getdents d2/d64/d65 0 2024-02-10T00:00:45.223 INFO:tasks.workunit.client.0.smithi164.stdout:0/910: dwrite d6/d10/d18/d2d/f2f [0,4194304] 0 2024-02-10T00:00:45.226 INFO:tasks.workunit.client.0.smithi164.stdout:6/997: rename d0/d6/d12/d14/f8c to d0/d3b/f14a 0 2024-02-10T00:00:45.228 INFO:tasks.workunit.client.0.smithi164.stdout:8/968: dwrite d2/d64/d65/d80/d32/d93/db7/f121 [0,4194304] 0 2024-02-10T00:00:45.231 INFO:tasks.workunit.client.0.smithi164.stdout:0/911: link d6/dec/da6/dea/f41 d6/d106/f11e 0 2024-02-10T00:00:45.232 INFO:tasks.workunit.client.0.smithi164.stdout:8/969: dwrite d2/f2c [0,4194304] 0 2024-02-10T00:00:45.233 INFO:tasks.workunit.client.0.smithi164.stdout:8/970: write d2/d64/d7d/fa7 [645034,18783] 0 2024-02-10T00:00:45.234 INFO:tasks.workunit.client.0.smithi164.stdout:0/912: unlink d6/d7/f24 0 2024-02-10T00:00:45.235 INFO:tasks.workunit.client.0.smithi164.stdout:6/998: getdents d0/d2b/d3a/d3d/da7 0 2024-02-10T00:00:45.238 INFO:tasks.workunit.client.0.smithi164.stdout:0/913: dread d6/dec/d79/dce/d101/f10f [0,4194304] 0 2024-02-10T00:00:45.238 INFO:tasks.workunit.client.0.smithi164.stdout:8/971: dwrite d2/d81/f95 [0,4194304] 0 2024-02-10T00:00:45.242 INFO:tasks.workunit.client.0.smithi164.stdout:0/914: creat d6/d10/d4a/dc7/dd7/f11f x:0 0 0 2024-02-10T00:00:45.243 INFO:tasks.workunit.client.0.smithi164.stdout:8/972: fdatasync d2/d64/d65/de2/f100 0 2024-02-10T00:00:45.244 INFO:tasks.workunit.client.0.smithi164.stdout:3/861: dread d0/d3b/dce/de1/d84/d82/f87 [0,4194304] 0 2024-02-10T00:00:45.245 INFO:tasks.workunit.client.0.smithi164.stdout:3/862: read - d0/d3b/f109 zero size 2024-02-10T00:00:45.245 INFO:tasks.workunit.client.0.smithi164.stdout:3/863: fdatasync d0/d1/fbe 0 2024-02-10T00:00:45.247 INFO:tasks.workunit.client.0.smithi164.stdout:0/915: read d6/d7/f58 [1311957,48756] 0 2024-02-10T00:00:45.248 INFO:tasks.workunit.client.0.smithi164.stdout:8/973: dwrite d2/d64/d65/d80/d32/d93/fbe [0,4194304] 0 2024-02-10T00:00:45.252 INFO:tasks.workunit.client.0.smithi164.stdout:3/864: dwrite d0/d103/d37/d9b/fdb [0,4194304] 0 2024-02-10T00:00:45.252 INFO:tasks.workunit.client.0.smithi164.stdout:0/916: write d6/d3a/d97/ff0 [4364539,100849] 0 2024-02-10T00:00:45.253 INFO:tasks.workunit.client.0.smithi164.stdout:0/917: fsync d6/dec/da6/dea/d44/ffe 0 2024-02-10T00:00:45.254 INFO:tasks.workunit.client.0.smithi164.stdout:8/974: creat d2/d64/d65/d80/d32/db2/f128 x:0 0 0 2024-02-10T00:00:45.259 INFO:tasks.workunit.client.0.smithi164.stdout:0/918: dwrite d6/dec/da6/dea/d44/d90/fa9 [0,4194304] 0 2024-02-10T00:00:45.262 INFO:tasks.workunit.client.0.smithi164.stdout:3/865: rename d0/d8f/d9a/db0/leb to d0/d1/l111 0 2024-02-10T00:00:45.265 INFO:tasks.workunit.client.0.smithi164.stdout:0/919: creat d6/d7/f120 x:0 0 0 2024-02-10T00:00:45.270 INFO:tasks.workunit.client.0.smithi164.stdout:0/920: fdatasync d6/d7/fdf 0 2024-02-10T00:00:45.271 INFO:tasks.workunit.client.0.smithi164.stdout:3/866: link d0/d1/dd/f107 d0/f112 0 2024-02-10T00:00:45.272 INFO:tasks.workunit.client.0.smithi164.stdout:0/921: chown d6/d10/d18/d2d/d39/db7/lee 1023403 1 2024-02-10T00:00:45.272 INFO:tasks.workunit.client.0.smithi164.stdout:3/867: chown d0/d1/d2/d19/d27/fb5 2503 1 2024-02-10T00:00:45.272 INFO:tasks.workunit.client.0.smithi164.stdout:0/922: write d6/d7/d110/f11b [107117,94907] 0 2024-02-10T00:00:45.275 INFO:tasks.workunit.client.0.smithi164.stdout:0/923: mkdir d6/dec/da6/daa/d121 0 2024-02-10T00:00:45.275 INFO:tasks.workunit.client.0.smithi164.stdout:0/924: stat d6/d3a/d52/f53 0 2024-02-10T00:00:45.279 INFO:tasks.workunit.client.0.smithi164.stdout:0/925: rmdir d6/d10/d4a/dc7/dd7/d118/d11c 0 2024-02-10T00:00:45.282 INFO:tasks.workunit.client.0.smithi164.stdout:0/926: truncate d6/d10/f1d 3798038 0 2024-02-10T00:00:45.283 INFO:tasks.workunit.client.0.smithi164.stdout:0/927: symlink d6/d10/d66/d10b/l122 0 2024-02-10T00:00:45.285 INFO:tasks.workunit.client.0.smithi164.stdout:0/928: truncate d6/d10/d4a/d60/fac 254957 0 2024-02-10T00:00:45.298 INFO:tasks.workunit.client.0.smithi164.stdout:1/863: dwrite d1/d1a/d35/ff0 [0,4194304] 0 2024-02-10T00:00:45.300 INFO:tasks.workunit.client.0.smithi164.stdout:1/864: mkdir d1/d13/d2b/d52/da4/dc2/d11c 0 2024-02-10T00:00:45.306 INFO:tasks.workunit.client.0.smithi164.stdout:7/960: sync 2024-02-10T00:00:45.308 INFO:tasks.workunit.client.0.smithi164.stdout:9/929: truncate d6/de/d22/d58/dba/d61/d76/fc7 2900012 0 2024-02-10T00:00:45.316 INFO:tasks.workunit.client.0.smithi164.stdout:4/981: dwrite d2/d19/d16/d31/dcf/f138 [0,4194304] 0 2024-02-10T00:00:45.316 INFO:tasks.workunit.client.0.smithi164.stdout:6/999: write d0/d6/f28 [8424584,65658] 0 2024-02-10T00:00:45.321 INFO:tasks.workunit.client.0.smithi164.stdout:8/975: truncate d2/d64/d7d/fc1 1442827 0 2024-02-10T00:00:45.321 INFO:tasks.workunit.client.0.smithi164.stdout:0/929: dread d6/d10/d4a/d60/d6c/fb1 [0,4194304] 0 2024-02-10T00:00:45.323 INFO:tasks.workunit.client.0.smithi164.stdout:9/930: dread d6/de/d22/d58/dba/d75/dc0/fc8 [0,4194304] 0 2024-02-10T00:00:45.325 INFO:tasks.workunit.client.0.smithi164.stdout:3/868: truncate d0/fc1 208337 0 2024-02-10T00:00:45.329 INFO:tasks.workunit.client.0.smithi164.stdout:4/982: rename d2/d19/d16/d31/d72/l123 to d2/d2f/d37/d41/d3d/d42/d5f/l158 0 2024-02-10T00:00:45.329 INFO:tasks.workunit.client.0.smithi164.stdout:0/930: chown d6/dec/da6/de6 1052326 1 2024-02-10T00:00:45.331 INFO:tasks.workunit.client.0.smithi164.stdout:9/931: creat d6/de/d22/de7/f137 x:0 0 0 2024-02-10T00:00:45.331 INFO:tasks.workunit.client.0.smithi164.stdout:4/983: rmdir d2/d19/dc1 39 2024-02-10T00:00:45.332 INFO:tasks.workunit.client.0.smithi164.stdout:7/961: link d3/d11/lc8 d3/d11/d39/d44/d48/l146 0 2024-02-10T00:00:45.335 INFO:tasks.workunit.client.0.smithi164.stdout:8/976: dwrite d2/d12/de3/f110 [4194304,4194304] 0 2024-02-10T00:00:45.336 INFO:tasks.workunit.client.0.smithi164.stdout:0/931: dread d6/d10/f61 [0,4194304] 0 2024-02-10T00:00:45.337 INFO:tasks.workunit.client.0.smithi164.stdout:8/977: read d2/f8a [29002,5277] 0 2024-02-10T00:00:45.337 INFO:tasks.workunit.client.0.smithi164.stdout:4/984: dread d2/d19/d16/d31/f70 [0,4194304] 0 2024-02-10T00:00:45.338 INFO:tasks.workunit.client.0.smithi164.stdout:7/962: rmdir d3/d11/d39/d44/dbd/d107/dda/d5d/df9 39 2024-02-10T00:00:45.340 INFO:tasks.workunit.client.0.smithi164.stdout:7/963: fdatasync d3/d11/d39/d44/d10d/d67/d98/daf/f12a 0 2024-02-10T00:00:45.340 INFO:tasks.workunit.client.0.smithi164.stdout:0/932: mknod d6/d3a/d52/d7a/c123 0 2024-02-10T00:00:45.341 INFO:tasks.workunit.client.0.smithi164.stdout:9/932: getdents d6/de/d22/d58/dba/d61/d76/da5/d111 0 2024-02-10T00:00:45.343 INFO:tasks.workunit.client.0.smithi164.stdout:9/933: fdatasync d6/de/fa0 0 2024-02-10T00:00:45.344 INFO:tasks.workunit.client.0.smithi164.stdout:8/978: dwrite d2/d64/d54/d5f/f101 [0,4194304] 0 2024-02-10T00:00:45.347 INFO:tasks.workunit.client.0.smithi164.stdout:7/964: dread d3/d5/d2b/d4a/f12c [0,4194304] 0 2024-02-10T00:00:45.347 INFO:tasks.workunit.client.0.smithi164.stdout:9/934: read d6/de/d22/dd3/d104/d8b/d24/fce [1170304,7193] 0 2024-02-10T00:00:45.350 INFO:tasks.workunit.client.0.smithi164.stdout:9/935: chown d6/de/d22/d58/dba/d61/d76/da5/fc5 1 1 2024-02-10T00:00:45.350 INFO:tasks.workunit.client.0.smithi164.stdout:3/869: truncate d0/d1/d2/fcd 1433384 0 2024-02-10T00:00:45.351 INFO:tasks.workunit.client.0.smithi164.stdout:9/936: write d6/de/d22/dd3/d104/d8b/d24/d4f/f12d [709497,115745] 0 2024-02-10T00:00:45.354 INFO:tasks.workunit.client.0.smithi164.stdout:8/979: creat d2/d64/d65/d80/d32/d93/df1/dfa/f129 x:0 0 0 2024-02-10T00:00:45.354 INFO:tasks.workunit.client.0.smithi164.stdout:1/865: sync 2024-02-10T00:00:45.358 INFO:tasks.workunit.client.0.smithi164.stdout:4/985: getdents d2/d19/d16 0 2024-02-10T00:00:45.360 INFO:tasks.workunit.client.0.smithi164.stdout:1/866: unlink d1/d95/fd6 0 2024-02-10T00:00:45.361 INFO:tasks.workunit.client.0.smithi164.stdout:8/980: write d2/d64/d65/d80/d32/d93/df1/dfa/f113 [1327667,62143] 0 2024-02-10T00:00:45.362 INFO:tasks.workunit.client.0.smithi164.stdout:7/965: truncate d3/d11/d39/d44/fb3 1306022 0 2024-02-10T00:00:45.362 INFO:tasks.workunit.client.0.smithi164.stdout:0/933: dread d6/d10/d18/d2d/f5d [0,4194304] 0 2024-02-10T00:00:45.364 INFO:tasks.workunit.client.0.smithi164.stdout:4/986: creat d2/d2f/d37/d45/d127/f159 x:0 0 0 2024-02-10T00:00:45.365 INFO:tasks.workunit.client.0.smithi164.stdout:4/987: dread - d2/d2f/d37/d45/d127/d140/f146 zero size 2024-02-10T00:00:45.365 INFO:tasks.workunit.client.0.smithi164.stdout:3/870: truncate d0/d8f/d9a/fb7 11119 0 2024-02-10T00:00:45.366 INFO:tasks.workunit.client.0.smithi164.stdout:8/981: creat d2/d12/de3/f12a x:0 0 0 2024-02-10T00:00:45.368 INFO:tasks.workunit.client.0.smithi164.stdout:7/966: creat d3/d28/d133/f147 x:0 0 0 2024-02-10T00:00:45.371 INFO:tasks.workunit.client.0.smithi164.stdout:9/937: write d6/de/d22/dd3/d104/d8b/f90 [9963,106672] 0 2024-02-10T00:00:45.372 INFO:tasks.workunit.client.0.smithi164.stdout:9/938: write d6/de/d22/d58/fd6 [604612,62144] 0 2024-02-10T00:00:45.373 INFO:tasks.workunit.client.0.smithi164.stdout:8/982: unlink d2/fd1 0 2024-02-10T00:00:45.375 INFO:tasks.workunit.client.0.smithi164.stdout:8/983: read d2/d64/d65/d80/d32/f55 [532689,90073] 0 2024-02-10T00:00:45.375 INFO:tasks.workunit.client.0.smithi164.stdout:3/871: rename d0/f5e to d0/d3b/dce/de1/d84/d82/f113 0 2024-02-10T00:00:45.376 INFO:tasks.workunit.client.0.smithi164.stdout:3/872: chown d0/d1/d2/c53 7594932 1 2024-02-10T00:00:45.378 INFO:tasks.workunit.client.0.smithi164.stdout:3/873: dread d0/f10 [0,4194304] 0 2024-02-10T00:00:45.382 INFO:tasks.workunit.client.0.smithi164.stdout:7/967: creat d3/d11/d39/d44/dbd/d107/dda/d13b/f148 x:0 0 0 2024-02-10T00:00:45.384 INFO:tasks.workunit.client.0.smithi164.stdout:8/984: mknod d2/d64/d65/d80/d32/d4d/c12b 0 2024-02-10T00:00:45.385 INFO:tasks.workunit.client.0.smithi164.stdout:4/988: dwrite d2/d2f/d37/d71/dc6/fc8 [0,4194304] 0 2024-02-10T00:00:45.389 INFO:tasks.workunit.client.0.smithi164.stdout:8/985: mknod d2/d64/d63/c12c 0 2024-02-10T00:00:45.389 INFO:tasks.workunit.client.0.smithi164.stdout:1/867: dread d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:45.390 INFO:tasks.workunit.client.0.smithi164.stdout:0/934: dread d6/dec/d79/fc9 [0,4194304] 0 2024-02-10T00:00:45.390 INFO:tasks.workunit.client.0.smithi164.stdout:4/989: mkdir d2/d19/d16/d31/d4b/d15a 0 2024-02-10T00:00:45.391 INFO:tasks.workunit.client.0.smithi164.stdout:1/868: stat d1/d1a/d41/d18/d33 0 2024-02-10T00:00:45.392 INFO:tasks.workunit.client.0.smithi164.stdout:0/935: chown d6/d10/d4a/d60/d6c/lef 6341137 1 2024-02-10T00:00:45.392 INFO:tasks.workunit.client.0.smithi164.stdout:4/990: dread - d2/d2f/d37/d41/d3d/d56/db2/f104 zero size 2024-02-10T00:00:45.393 INFO:tasks.workunit.client.0.smithi164.stdout:7/968: mkdir d3/d11/d39/d44/d48/d149 0 2024-02-10T00:00:45.394 INFO:tasks.workunit.client.0.smithi164.stdout:8/986: mkdir d2/d64/d65/d80/d32/db2/d12d 0 2024-02-10T00:00:45.396 INFO:tasks.workunit.client.0.smithi164.stdout:0/936: mknod d6/d10/d66/d10b/c124 0 2024-02-10T00:00:45.396 INFO:tasks.workunit.client.0.smithi164.stdout:9/939: dread d6/f35 [0,4194304] 0 2024-02-10T00:00:45.397 INFO:tasks.workunit.client.0.smithi164.stdout:4/991: rmdir d2/d19/d16/d31/d72 39 2024-02-10T00:00:45.400 INFO:tasks.workunit.client.0.smithi164.stdout:4/992: stat d2/d19/d16/d31/d4b 0 2024-02-10T00:00:45.400 INFO:tasks.workunit.client.0.smithi164.stdout:7/969: dwrite d3/d11/d39/d44/d6f/fd3 [0,4194304] 0 2024-02-10T00:00:45.401 INFO:tasks.workunit.client.0.smithi164.stdout:3/874: truncate d0/d103/d37/d3f/d4e/d6d/fa3 802243 0 2024-02-10T00:00:45.401 INFO:tasks.workunit.client.0.smithi164.stdout:8/987: readlink d2/l9 0 2024-02-10T00:00:45.404 INFO:tasks.workunit.client.0.smithi164.stdout:1/869: link d1/d13/d2b/d52/da4/dc3/f108 d1/d23/d37/da9/dd1/ddb/f11d 0 2024-02-10T00:00:45.404 INFO:tasks.workunit.client.0.smithi164.stdout:0/937: write d6/f3d [3008352,71445] 0 2024-02-10T00:00:45.406 INFO:tasks.workunit.client.0.smithi164.stdout:9/940: unlink d6/de/d22/dd3/d104/f99 0 2024-02-10T00:00:45.409 INFO:tasks.workunit.client.0.smithi164.stdout:7/970: dread - d3/d11/d39/d44/fd0 zero size 2024-02-10T00:00:45.410 INFO:tasks.workunit.client.0.smithi164.stdout:1/870: unlink d1/d1a/d41/de4/ff1 0 2024-02-10T00:00:45.410 INFO:tasks.workunit.client.0.smithi164.stdout:1/871: chown d1/f10b 1949445 1 2024-02-10T00:00:45.411 INFO:tasks.workunit.client.0.smithi164.stdout:1/872: dread - d1/d64/fc4 zero size 2024-02-10T00:00:45.412 INFO:tasks.workunit.client.0.smithi164.stdout:0/938: creat d6/d10/d4a/d60/d6c/f125 x:0 0 0 2024-02-10T00:00:45.417 INFO:tasks.workunit.client.0.smithi164.stdout:3/875: dread d0/d103/d37/f90 [0,4194304] 0 2024-02-10T00:00:45.422 INFO:tasks.workunit.client.0.smithi164.stdout:3/876: dwrite d0/d3b/dce/de1/fde [4194304,4194304] 0 2024-02-10T00:00:45.428 INFO:tasks.workunit.client.0.smithi164.stdout:4/993: dread d2/d2f/d37/d41/fef [0,4194304] 0 2024-02-10T00:00:45.435 INFO:tasks.workunit.client.0.smithi164.stdout:8/988: creat d2/d64/d65/d80/d32/d99/d9e/f12e x:0 0 0 2024-02-10T00:00:45.435 INFO:tasks.workunit.client.0.smithi164.stdout:1/873: dread d1/d23/f97 [0,4194304] 0 2024-02-10T00:00:45.436 INFO:tasks.workunit.client.0.smithi164.stdout:7/971: creat d3/d11/d39/d44/d10d/d11f/f14a x:0 0 0 2024-02-10T00:00:45.436 INFO:tasks.workunit.client.0.smithi164.stdout:8/989: read - d2/d64/d65/fa6 zero size 2024-02-10T00:00:45.437 INFO:tasks.workunit.client.0.smithi164.stdout:4/994: fdatasync d2/d2f/f54 0 2024-02-10T00:00:45.438 INFO:tasks.workunit.client.0.smithi164.stdout:8/990: fdatasync d2/d64/d65/d80/d32/f38 0 2024-02-10T00:00:45.438 INFO:tasks.workunit.client.0.smithi164.stdout:8/991: chown d2/d115 31520299 1 2024-02-10T00:00:45.439 INFO:tasks.workunit.client.0.smithi164.stdout:7/972: symlink d3/d11/d39/d3a/def/l14b 0 2024-02-10T00:00:45.439 INFO:tasks.workunit.client.0.smithi164.stdout:4/995: fsync d2/d2f/d37/d41/d3d/d42/da2/fc2 0 2024-02-10T00:00:45.439 INFO:tasks.workunit.client.0.smithi164.stdout:1/874: symlink d1/d1a/d41/d18/d33/l11e 0 2024-02-10T00:00:45.440 INFO:tasks.workunit.client.0.smithi164.stdout:0/939: creat d6/d10/d4a/f126 x:0 0 0 2024-02-10T00:00:45.447 INFO:tasks.workunit.client.0.smithi164.stdout:0/940: unlink d6/c19 0 2024-02-10T00:00:45.452 INFO:tasks.workunit.client.0.smithi164.stdout:8/992: rename d2/d64/d63/c12c to d2/d64/d65/d80/d32/d99/c12f 0 2024-02-10T00:00:45.455 INFO:tasks.workunit.client.0.smithi164.stdout:4/996: unlink d2/d2f/d37/d41/d3d/fa5 0 2024-02-10T00:00:45.456 INFO:tasks.workunit.client.0.smithi164.stdout:3/877: getdents d0/d1/dd/dc8 0 2024-02-10T00:00:45.461 INFO:tasks.workunit.client.0.smithi164.stdout:9/941: sync 2024-02-10T00:00:45.463 INFO:tasks.workunit.client.0.smithi164.stdout:3/878: creat d0/d3b/dce/de1/d81/d95/f114 x:0 0 0 2024-02-10T00:00:45.464 INFO:tasks.workunit.client.0.smithi164.stdout:7/973: link d3/d11/d39/d44/dbd/d107/dda/d5d/dd5/c105 d3/d5/d9b/c14c 0 2024-02-10T00:00:45.464 INFO:tasks.workunit.client.0.smithi164.stdout:9/942: read d6/de/d22/d58/dba/d61/d76/fc7 [2081777,11255] 0 2024-02-10T00:00:45.466 INFO:tasks.workunit.client.0.smithi164.stdout:9/943: chown d6/de/d22/dd3 6 1 2024-02-10T00:00:45.468 INFO:tasks.workunit.client.0.smithi164.stdout:8/993: truncate d2/d64/d65/d80/f86 725998 0 2024-02-10T00:00:45.469 INFO:tasks.workunit.client.0.smithi164.stdout:7/974: mknod d3/d11/d39/d44/d10d/da7/c14d 0 2024-02-10T00:00:45.470 INFO:tasks.workunit.client.0.smithi164.stdout:3/879: dwrite d0/d103/d37/d3f/d4e/d6d/f92 [0,4194304] 0 2024-02-10T00:00:45.472 INFO:tasks.workunit.client.0.smithi164.stdout:4/997: dwrite d2/d19/f15 [0,4194304] 0 2024-02-10T00:00:45.472 INFO:tasks.workunit.client.0.smithi164.stdout:9/944: write d6/de/d22/d58/dba/d61/ffb [892283,42687] 0 2024-02-10T00:00:45.473 INFO:tasks.workunit.client.0.smithi164.stdout:3/880: write d0/d8f/d9a/db0/fbf [178106,43871] 0 2024-02-10T00:00:45.475 INFO:tasks.workunit.client.0.smithi164.stdout:7/975: creat d3/d11/d39/d44/d9a/f14e x:0 0 0 2024-02-10T00:00:45.475 INFO:tasks.workunit.client.0.smithi164.stdout:9/945: fdatasync d6/de/ffd 0 2024-02-10T00:00:45.476 INFO:tasks.workunit.client.0.smithi164.stdout:4/998: write d2/d2f/d37/d41/d3d/d56/d85/f152 [879150,54297] 0 2024-02-10T00:00:45.480 INFO:tasks.workunit.client.0.smithi164.stdout:7/976: mkdir d3/d11/d39/d44/d48/d50/d92/d14f 0 2024-02-10T00:00:45.481 INFO:tasks.workunit.client.0.smithi164.stdout:9/946: creat d6/de/d22/d58/dba/da7/f138 x:0 0 0 2024-02-10T00:00:45.483 INFO:tasks.workunit.client.0.smithi164.stdout:9/947: read d6/de/d2b/f80 [87024,102017] 0 2024-02-10T00:00:45.483 INFO:tasks.workunit.client.0.smithi164.stdout:9/948: dread - d6/de/d22/dd3/d104/d8b/f105 zero size 2024-02-10T00:00:45.484 INFO:tasks.workunit.client.0.smithi164.stdout:0/941: rename d6/d10/d18/d2d/ld2 to d6/d10/d4a/d60/l127 0 2024-02-10T00:00:45.487 INFO:tasks.workunit.client.0.smithi164.stdout:1/875: sync 2024-02-10T00:00:45.489 INFO:tasks.workunit.client.0.smithi164.stdout:3/881: rename d0/d3b/dce/de1/d84/f62 to d0/d3b/dce/de1/df1/f115 0 2024-02-10T00:00:45.489 INFO:tasks.workunit.client.0.smithi164.stdout:8/994: link d2/d64/d65/d80/d32/d99/da0/cae d2/d64/d54/db9/c130 0 2024-02-10T00:00:45.495 INFO:tasks.workunit.client.0.smithi164.stdout:1/876: dwrite d1/d13/d1f/fac [0,4194304] 0 2024-02-10T00:00:45.496 INFO:tasks.workunit.client.0.smithi164.stdout:8/995: stat d2/d64/d65/d80/d32/d93/db7/d11e/fec 0 2024-02-10T00:00:45.496 INFO:tasks.workunit.client.0.smithi164.stdout:8/996: chown d2/d64/f51 16 1 2024-02-10T00:00:45.496 INFO:tasks.workunit.client.0.smithi164.stdout:0/942: creat d6/d10/d18/d2d/d39/db7/f128 x:0 0 0 2024-02-10T00:00:45.496 INFO:tasks.workunit.client.0.smithi164.stdout:9/949: rename d6/de/d22/dd3/d104/d8b/c3a to d6/de/d22/d58/dba/d61/d76/d11f/c139 0 2024-02-10T00:00:45.501 INFO:tasks.workunit.client.0.smithi164.stdout:4/999: truncate d2/d19/d10f/f12f 1164991 0 2024-02-10T00:00:45.504 INFO:tasks.workunit.client.0.smithi164.stdout:1/877: rmdir d1/d13/d2b/d52/da4/dc3 39 2024-02-10T00:00:45.504 INFO:tasks.workunit.client.0.smithi164.stdout:1/878: chown d1/d23/d61 56911825 1 2024-02-10T00:00:45.505 INFO:tasks.workunit.client.0.smithi164.stdout:8/997: write d2/d64/d65/d80/d32/f4b [4031617,17606] 0 2024-02-10T00:00:45.505 INFO:tasks.workunit.client.0.smithi164.stdout:7/977: link d3/d11/d39/d44/d10d/d67/f86 d3/d5/d131/f150 0 2024-02-10T00:00:45.507 INFO:tasks.workunit.client.0.smithi164.stdout:7/978: fsync d3/d5/d2b/f4e 0 2024-02-10T00:00:45.507 INFO:tasks.workunit.client.0.smithi164.stdout:1/879: creat d1/d13/d2b/d52/da4/dc2/f11f x:0 0 0 2024-02-10T00:00:45.508 INFO:tasks.workunit.client.0.smithi164.stdout:9/950: mknod d6/de/d22/dd3/d104/d8b/d24/c13a 0 2024-02-10T00:00:45.508 INFO:tasks.workunit.client.0.smithi164.stdout:9/951: fsync d6/de/f11 0 2024-02-10T00:00:45.510 INFO:tasks.workunit.client.0.smithi164.stdout:0/943: creat d6/dec/da6/dea/d44/d49/d95/dc0/f129 x:0 0 0 2024-02-10T00:00:45.510 INFO:tasks.workunit.client.0.smithi164.stdout:9/952: dread - d6/de/d22/d58/dba/d61/f126 zero size 2024-02-10T00:00:45.511 INFO:tasks.workunit.client.0.smithi164.stdout:8/998: creat d2/d64/d65/d80/d32/d93/db0/f131 x:0 0 0 2024-02-10T00:00:45.513 INFO:tasks.workunit.client.0.smithi164.stdout:0/944: chown d6/d3a/d52/d7a/l4d 12 1 2024-02-10T00:00:45.514 INFO:tasks.workunit.client.0.smithi164.stdout:9/953: creat d6/de/d22/dd3/d104/d8b/f13b x:0 0 0 2024-02-10T00:00:45.515 INFO:tasks.workunit.client.0.smithi164.stdout:8/999: write d2/d64/d54/d5f/f111 [2411416,43403] 0 2024-02-10T00:00:45.516 INFO:tasks.workunit.client.0.smithi164.stdout:9/954: readlink d6/de/d22/d58/dba/l89 0 2024-02-10T00:00:45.516 INFO:tasks.workunit.client.0.smithi164.stdout:0/945: write d6/dec/da6/dea/d44/ffe [1107087,15967] 0 2024-02-10T00:00:45.516 INFO:tasks.workunit.client.0.smithi164.stdout:1/880: truncate d1/d1a/d75/de0/ffe 640920 0 2024-02-10T00:00:45.518 INFO:tasks.workunit.client.0.smithi164.stdout:0/946: chown d6/d10/d4a/d60/d6c/df7/c114 1920323629 1 2024-02-10T00:00:45.521 INFO:tasks.workunit.client.0.smithi164.stdout:3/882: dread d0/d3b/dce/de1/fae [0,4194304] 0 2024-02-10T00:00:45.522 INFO:tasks.workunit.client.0.smithi164.stdout:1/881: dread d1/d23/d37/da9/dd1/ddb/f11d [0,4194304] 0 2024-02-10T00:00:45.524 INFO:tasks.workunit.client.0.smithi164.stdout:7/979: dwrite d3/d28/f125 [0,4194304] 0 2024-02-10T00:00:45.524 INFO:tasks.workunit.client.0.smithi164.stdout:9/955: getdents d6/de/d22/d58/dba/d75 0 2024-02-10T00:00:45.525 INFO:tasks.workunit.client.0.smithi164.stdout:3/883: creat d0/d8f/d9a/db0/de7/f116 x:0 0 0 2024-02-10T00:00:45.528 INFO:tasks.workunit.client.0.smithi164.stdout:3/884: creat d0/d1/dd/dc8/f117 x:0 0 0 2024-02-10T00:00:45.531 INFO:tasks.workunit.client.0.smithi164.stdout:7/980: rename d3/d11/d39/d44/d10d/l29 to d3/d130/l151 0 2024-02-10T00:00:45.532 INFO:tasks.workunit.client.0.smithi164.stdout:1/882: mkdir d1/d13/d2b/d52/da4/dc2/dcc/d10d/d120 0 2024-02-10T00:00:45.534 INFO:tasks.workunit.client.0.smithi164.stdout:3/885: symlink d0/d3b/dce/l118 0 2024-02-10T00:00:45.537 INFO:tasks.workunit.client.0.smithi164.stdout:1/883: mknod d1/d23/d61/c121 0 2024-02-10T00:00:45.538 INFO:tasks.workunit.client.0.smithi164.stdout:1/884: write d1/d23/d61/fb3 [257793,61226] 0 2024-02-10T00:00:45.539 INFO:tasks.workunit.client.0.smithi164.stdout:7/981: rename d3/d5/d2b/d4a/d100/cf5 to d3/d11/c152 0 2024-02-10T00:00:45.539 INFO:tasks.workunit.client.0.smithi164.stdout:9/956: link d6/de/d22/d58/dba/d75/ccb d6/de/d22/dd3/d104/d8b/d24/d4f/c13c 0 2024-02-10T00:00:45.540 INFO:tasks.workunit.client.0.smithi164.stdout:7/982: write d3/d5/d59/f8c [2410987,36043] 0 2024-02-10T00:00:45.542 INFO:tasks.workunit.client.0.smithi164.stdout:3/886: creat d0/d8f/f119 x:0 0 0 2024-02-10T00:00:45.543 INFO:tasks.workunit.client.0.smithi164.stdout:1/885: dwrite d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:45.543 INFO:tasks.workunit.client.0.smithi164.stdout:1/886: chown d1/d64/fc4 40995 1 2024-02-10T00:00:45.545 INFO:tasks.workunit.client.0.smithi164.stdout:9/957: creat d6/de/d40/db6/f13d x:0 0 0 2024-02-10T00:00:45.547 INFO:tasks.workunit.client.0.smithi164.stdout:0/947: dread d6/dec/d79/dce/f100 [0,4194304] 0 2024-02-10T00:00:45.553 INFO:tasks.workunit.client.0.smithi164.stdout:3/887: symlink d0/l11a 0 2024-02-10T00:00:45.553 INFO:tasks.workunit.client.0.smithi164.stdout:3/888: chown d0/d103/d37/c6f 24 1 2024-02-10T00:00:45.555 INFO:tasks.workunit.client.0.smithi164.stdout:7/983: truncate d3/d5/f30 898257 0 2024-02-10T00:00:45.556 INFO:tasks.workunit.client.0.smithi164.stdout:9/958: readlink d6/de/d40/d74/lb4 0 2024-02-10T00:00:45.558 INFO:tasks.workunit.client.0.smithi164.stdout:0/948: symlink d6/d10/l12a 0 2024-02-10T00:00:45.558 INFO:tasks.workunit.client.0.smithi164.stdout:1/887: dwrite d1/d13/d2b/d52/da4/dc2/dcc/fd9 [4194304,4194304] 0 2024-02-10T00:00:45.559 INFO:tasks.workunit.client.0.smithi164.stdout:3/889: unlink d0/d3b/dce/de1/d84/f55 0 2024-02-10T00:00:45.560 INFO:tasks.workunit.client.0.smithi164.stdout:3/890: stat d0/d103/d37/d9b 0 2024-02-10T00:00:45.560 INFO:tasks.workunit.client.0.smithi164.stdout:7/984: mkdir d3/d11/d39/d44/dbd/d107/dda/d153 0 2024-02-10T00:00:45.563 INFO:tasks.workunit.client.0.smithi164.stdout:1/888: dread d1/d1a/d41/d18/f3e [0,4194304] 0 2024-02-10T00:00:45.563 INFO:tasks.workunit.client.0.smithi164.stdout:0/949: read d6/d10/d18/d2d/f5a [2164921,102408] 0 2024-02-10T00:00:45.570 INFO:tasks.workunit.client.0.smithi164.stdout:1/889: chown d1/d13/d2b/d52/da4/dc3 1 1 2024-02-10T00:00:45.572 INFO:tasks.workunit.client.0.smithi164.stdout:7/985: symlink d3/d11/d39/d44/d10d/d67/d11d/l154 0 2024-02-10T00:00:45.572 INFO:tasks.workunit.client.0.smithi164.stdout:9/959: dwrite d6/de/d22/d58/fbc [0,4194304] 0 2024-02-10T00:00:45.574 INFO:tasks.workunit.client.0.smithi164.stdout:9/960: write d6/de/de2/fbd [1732503,19403] 0 2024-02-10T00:00:45.579 INFO:tasks.workunit.client.0.smithi164.stdout:3/891: write d0/d1/d2/d19/d27/d5f/da5/f10e [901412,17632] 0 2024-02-10T00:00:45.580 INFO:tasks.workunit.client.0.smithi164.stdout:9/961: dwrite d6/de/d22/d58/dba/d61/ff6 [0,4194304] 0 2024-02-10T00:00:45.582 INFO:tasks.workunit.client.0.smithi164.stdout:3/892: creat d0/d103/d37/d3f/f11b x:0 0 0 2024-02-10T00:00:45.582 INFO:tasks.workunit.client.0.smithi164.stdout:3/893: fdatasync d0/d8f/f119 0 2024-02-10T00:00:45.583 INFO:tasks.workunit.client.0.smithi164.stdout:9/962: mkdir d6/de/d40/d74/d13e 0 2024-02-10T00:00:45.585 INFO:tasks.workunit.client.0.smithi164.stdout:9/963: unlink d6/de/c55 0 2024-02-10T00:00:45.589 INFO:tasks.workunit.client.0.smithi164.stdout:9/964: fdatasync d6/de/d2b/f3c 0 2024-02-10T00:00:45.589 INFO:tasks.workunit.client.0.smithi164.stdout:3/894: dwrite d0/d3b/dce/de1/d84/d82/f113 [0,4194304] 0 2024-02-10T00:00:45.591 INFO:tasks.workunit.client.0.smithi164.stdout:0/950: truncate d6/d10/d4a/f74 1686781 0 2024-02-10T00:00:45.596 INFO:tasks.workunit.client.0.smithi164.stdout:0/951: write d6/d10/d4a/dc7/fe7 [1299367,49280] 0 2024-02-10T00:00:45.596 INFO:tasks.workunit.client.0.smithi164.stdout:0/952: stat d6/d10/d4a/d60 0 2024-02-10T00:00:45.596 INFO:tasks.workunit.client.0.smithi164.stdout:9/965: unlink d6/f133 0 2024-02-10T00:00:45.597 INFO:tasks.workunit.client.0.smithi164.stdout:1/890: dwrite d1/d13/d2b/d52/f6b [0,4194304] 0 2024-02-10T00:00:45.602 INFO:tasks.workunit.client.0.smithi164.stdout:9/966: rename d6/de/d40/d74/fcc to d6/de/d22/dd3/d104/d8b/d24/d4f/dff/dd9/f13f 0 2024-02-10T00:00:45.602 INFO:tasks.workunit.client.0.smithi164.stdout:1/891: dwrite d1/d13/d1f/fac [4194304,4194304] 0 2024-02-10T00:00:45.603 INFO:tasks.workunit.client.0.smithi164.stdout:1/892: chown d1/d1a/d41/d18/c69 272463 1 2024-02-10T00:00:45.604 INFO:tasks.workunit.client.0.smithi164.stdout:7/986: truncate d3/d11/d39/d44/dbd/d107/dda/f55 3487346 0 2024-02-10T00:00:45.606 INFO:tasks.workunit.client.0.smithi164.stdout:9/967: unlink d6/de/d22/dd3/d104/d8b/d24/d4f/f8a 0 2024-02-10T00:00:45.611 INFO:tasks.workunit.client.0.smithi164.stdout:7/987: rmdir d3/d5/d2b/d4a/d100 39 2024-02-10T00:00:45.613 INFO:tasks.workunit.client.0.smithi164.stdout:9/968: mknod d6/de/dfa/c140 0 2024-02-10T00:00:45.614 INFO:tasks.workunit.client.0.smithi164.stdout:3/895: link d0/d3b/lcc d0/d1/d2/d19/d27/l11c 0 2024-02-10T00:00:45.615 INFO:tasks.workunit.client.0.smithi164.stdout:7/988: dwrite d3/d5/d9b/db7/d4b/f6a [0,4194304] 0 2024-02-10T00:00:45.617 INFO:tasks.workunit.client.0.smithi164.stdout:1/893: read d1/d1a/d9a/f11b [2422879,106611] 0 2024-02-10T00:00:45.617 INFO:tasks.workunit.client.0.smithi164.stdout:9/969: mknod d6/de/d22/d58/dba/da7/c141 0 2024-02-10T00:00:45.618 INFO:tasks.workunit.client.0.smithi164.stdout:3/896: symlink d0/l11d 0 2024-02-10T00:00:45.620 INFO:tasks.workunit.client.0.smithi164.stdout:1/894: mkdir d1/d13/d2b/d122 0 2024-02-10T00:00:45.622 INFO:tasks.workunit.client.0.smithi164.stdout:7/989: mknod d3/c155 0 2024-02-10T00:00:45.624 INFO:tasks.workunit.client.0.smithi164.stdout:3/897: mkdir d0/d11e 0 2024-02-10T00:00:45.625 INFO:tasks.workunit.client.0.smithi164.stdout:3/898: chown d0/d1/dd/l76 315494306 1 2024-02-10T00:00:45.626 INFO:tasks.workunit.client.0.smithi164.stdout:9/970: mknod d6/de/d22/dd3/d121/c142 0 2024-02-10T00:00:45.627 INFO:tasks.workunit.client.0.smithi164.stdout:7/990: dwrite d3/d5/fec [0,4194304] 0 2024-02-10T00:00:45.628 INFO:tasks.workunit.client.0.smithi164.stdout:9/971: write d6/de/d22/d58/fd6 [318350,118148] 0 2024-02-10T00:00:45.629 INFO:tasks.workunit.client.0.smithi164.stdout:9/972: write d6/de/d22/d58/dba/d75/dc0/f116 [778020,6033] 0 2024-02-10T00:00:45.632 INFO:tasks.workunit.client.0.smithi164.stdout:7/991: mknod d3/d11/d39/d44/d10d/da7/c156 0 2024-02-10T00:00:45.632 INFO:tasks.workunit.client.0.smithi164.stdout:3/899: fdatasync d0/d3b/dce/de1/d84/d82/fd3 0 2024-02-10T00:00:45.637 INFO:tasks.workunit.client.0.smithi164.stdout:3/900: symlink d0/d1/d2/d19/d27/d5f/da5/d94/l11f 0 2024-02-10T00:00:45.638 INFO:tasks.workunit.client.0.smithi164.stdout:9/973: creat d6/de/d40/d74/d12c/f143 x:0 0 0 2024-02-10T00:00:45.639 INFO:tasks.workunit.client.0.smithi164.stdout:9/974: chown d6/de/d22/d58/dba/d75/dc0/c131 76296 1 2024-02-10T00:00:45.641 INFO:tasks.workunit.client.0.smithi164.stdout:7/992: rename d3/d5/d9b/db7/ca5 to d3/d11/d39/d44/d6f/c157 0 2024-02-10T00:00:45.642 INFO:tasks.workunit.client.0.smithi164.stdout:7/993: read - d3/d11/f102 zero size 2024-02-10T00:00:45.642 INFO:tasks.workunit.client.0.smithi164.stdout:7/994: chown d3/d28/f3b 360584484 1 2024-02-10T00:00:45.642 INFO:tasks.workunit.client.0.smithi164.stdout:9/975: symlink d6/de/d22/dd3/d104/d8b/dc2/l144 0 2024-02-10T00:00:45.644 INFO:tasks.workunit.client.0.smithi164.stdout:7/995: readlink d3/d11/d39/d44/dbd/d107/dcf/l141 0 2024-02-10T00:00:45.646 INFO:tasks.workunit.client.0.smithi164.stdout:3/901: rename d0/d103/d37/d9b/lea to d0/d8f/d9a/db0/de7/l120 0 2024-02-10T00:00:45.654 INFO:tasks.workunit.client.0.smithi164.stdout:9/976: dwrite d6/de/d22/dd3/d104/d8b/d24/fce [4194304,4194304] 0 2024-02-10T00:00:45.654 INFO:tasks.workunit.client.0.smithi164.stdout:3/902: rename d0/d103/d37/d3f/d4e/d6d/fa3 to d0/d3b/dce/de1/df1/f121 0 2024-02-10T00:00:45.655 INFO:tasks.workunit.client.0.smithi164.stdout:9/977: chown d6/de/d40/d74/ca2 16 1 2024-02-10T00:00:45.672 INFO:tasks.workunit.client.0.smithi164.stdout:1/895: write d1/d1a/d41/f58 [1169095,100943] 0 2024-02-10T00:00:45.673 INFO:tasks.workunit.client.0.smithi164.stdout:3/903: creat d0/d1/d2/d19/d27/d5f/f122 x:0 0 0 2024-02-10T00:00:45.674 INFO:tasks.workunit.client.0.smithi164.stdout:3/904: stat d0/d103/d37/f90 0 2024-02-10T00:00:45.675 INFO:tasks.workunit.client.0.smithi164.stdout:3/905: write d0/d3b/dce/de1/d81/f9f [1999033,17991] 0 2024-02-10T00:00:45.675 INFO:tasks.workunit.client.0.smithi164.stdout:3/906: fsync d0/d1/fbe 0 2024-02-10T00:00:45.679 INFO:tasks.workunit.client.0.smithi164.stdout:0/953: sync 2024-02-10T00:00:45.682 INFO:tasks.workunit.client.0.smithi164.stdout:7/996: dwrite d3/d5/f8b [0,4194304] 0 2024-02-10T00:00:45.683 INFO:tasks.workunit.client.0.smithi164.stdout:9/978: mkdir d6/de/d22/dd3/d104/d12b/d145 0 2024-02-10T00:00:45.685 INFO:tasks.workunit.client.0.smithi164.stdout:3/907: mkdir d0/d1/d2/d19/d27/d5f/da5/d94/dbd/d123 0 2024-02-10T00:00:45.691 INFO:tasks.workunit.client.0.smithi164.stdout:3/908: dwrite d0/d3b/dce/de1/d84/f88 [0,4194304] 0 2024-02-10T00:00:45.693 INFO:tasks.workunit.client.0.smithi164.stdout:7/997: getdents d3/d28/d51 0 2024-02-10T00:00:45.695 INFO:tasks.workunit.client.0.smithi164.stdout:3/909: mknod d0/d3b/dce/de1/df1/d108/c124 0 2024-02-10T00:00:45.697 INFO:tasks.workunit.client.0.smithi164.stdout:7/998: mknod d3/d11/d39/d44/d48/d50/c158 0 2024-02-10T00:00:45.705 INFO:tasks.workunit.client.0.smithi164.stdout:7/999: creat d3/d11/d39/d44/d6f/f159 x:0 0 0 2024-02-10T00:00:45.718 INFO:tasks.workunit.client.0.smithi164.stdout:3/910: rmdir d0/d1/d2/d19/d27/d5f 39 2024-02-10T00:00:45.721 INFO:tasks.workunit.client.0.smithi164.stdout:1/896: dwrite d1/d13/d2b/d52/d56/fdc [0,4194304] 0 2024-02-10T00:00:45.730 INFO:tasks.workunit.client.0.smithi164.stdout:0/954: dread d6/d7/f58 [0,4194304] 0 2024-02-10T00:00:45.735 INFO:tasks.workunit.client.0.smithi164.stdout:0/955: read d6/d3a/d52/d7a/f4e [1734472,97074] 0 2024-02-10T00:00:45.737 INFO:tasks.workunit.client.0.smithi164.stdout:0/956: rmdir d6/dec/d79/dce/d101 39 2024-02-10T00:00:45.739 INFO:tasks.workunit.client.0.smithi164.stdout:0/957: symlink d6/d10/d18/d2d/d39/l12b 0 2024-02-10T00:00:45.740 INFO:tasks.workunit.client.0.smithi164.stdout:0/958: read d6/d3a/d52/d7a/f4e [1776677,53444] 0 2024-02-10T00:00:45.742 INFO:tasks.workunit.client.0.smithi164.stdout:3/911: dread d0/d103/d37/fa8 [0,4194304] 0 2024-02-10T00:00:45.743 INFO:tasks.workunit.client.0.smithi164.stdout:0/959: creat d6/d10/d18/d2d/d39/de0/f12c x:0 0 0 2024-02-10T00:00:45.745 INFO:tasks.workunit.client.0.smithi164.stdout:3/912: write d0/d1/d2/d19/d27/d5f/da5/f10e [771259,102058] 0 2024-02-10T00:00:45.746 INFO:tasks.workunit.client.0.smithi164.stdout:0/960: write d6/d10/d4a/d60/d6c/fb1 [1389331,89527] 0 2024-02-10T00:00:45.747 INFO:tasks.workunit.client.0.smithi164.stdout:0/961: fsync d6/d3a/d52/fc3 0 2024-02-10T00:00:45.747 INFO:tasks.workunit.client.0.smithi164.stdout:3/913: write d0/d1/d2/d19/d27/f80 [47434,111811] 0 2024-02-10T00:00:45.749 INFO:tasks.workunit.client.0.smithi164.stdout:1/897: dread d1/d1a/d41/d18/fb6 [0,4194304] 0 2024-02-10T00:00:45.749 INFO:tasks.workunit.client.0.smithi164.stdout:3/914: mknod d0/d1/c125 0 2024-02-10T00:00:45.750 INFO:tasks.workunit.client.0.smithi164.stdout:0/962: dread d6/dec/da6/dea/d44/d90/d9d/fbe [0,4194304] 0 2024-02-10T00:00:45.752 INFO:tasks.workunit.client.0.smithi164.stdout:3/915: creat d0/d3b/dce/de1/d81/d95/dfb/f126 x:0 0 0 2024-02-10T00:00:45.753 INFO:tasks.workunit.client.0.smithi164.stdout:0/963: mknod d6/d7/c12d 0 2024-02-10T00:00:45.753 INFO:tasks.workunit.client.0.smithi164.stdout:9/979: sync 2024-02-10T00:00:45.755 INFO:tasks.workunit.client.0.smithi164.stdout:3/916: write d0/d3b/dce/de1/df1/f115 [1450187,107259] 0 2024-02-10T00:00:45.755 INFO:tasks.workunit.client.0.smithi164.stdout:1/898: dwrite d1/d23/f92 [4194304,4194304] 0 2024-02-10T00:00:45.756 INFO:tasks.workunit.client.0.smithi164.stdout:9/980: readlink d6/de/d22/dd3/d104/d8b/dc2/l144 0 2024-02-10T00:00:45.756 INFO:tasks.workunit.client.0.smithi164.stdout:1/899: rename d1/d95 to d1/d95/d123 22 2024-02-10T00:00:45.759 INFO:tasks.workunit.client.0.smithi164.stdout:9/981: read d6/de/f3d [3368304,96434] 0 2024-02-10T00:00:45.761 INFO:tasks.workunit.client.0.smithi164.stdout:0/964: getdents d6/dec/da6 0 2024-02-10T00:00:45.761 INFO:tasks.workunit.client.0.smithi164.stdout:3/917: link d0/d1/dd/l61 d0/d1/d3c/l127 0 2024-02-10T00:00:45.762 INFO:tasks.workunit.client.0.smithi164.stdout:3/918: chown d0/d1/dd 296036505 1 2024-02-10T00:00:45.763 INFO:tasks.workunit.client.0.smithi164.stdout:1/900: dwrite d1/d13/f19 [0,4194304] 0 2024-02-10T00:00:45.766 INFO:tasks.workunit.client.0.smithi164.stdout:3/919: mknod d0/d103/d37/d3f/c128 0 2024-02-10T00:00:45.766 INFO:tasks.workunit.client.0.smithi164.stdout:9/982: link d6/de/d22/d58/dba/cb9 d6/de/d22/dd3/d104/d8b/d24/d10b/c146 0 2024-02-10T00:00:45.768 INFO:tasks.workunit.client.0.smithi164.stdout:1/901: unlink d1/d23/d37/lb8 0 2024-02-10T00:00:45.769 INFO:tasks.workunit.client.0.smithi164.stdout:9/983: chown d6/f79 362 1 2024-02-10T00:00:45.769 INFO:tasks.workunit.client.0.smithi164.stdout:3/920: truncate d0/d1/dd/dc8/fe6 1053380 0 2024-02-10T00:00:45.770 INFO:tasks.workunit.client.0.smithi164.stdout:3/921: dread - d0/d8f/d9a/f10b zero size 2024-02-10T00:00:45.771 INFO:tasks.workunit.client.0.smithi164.stdout:9/984: read d6/de/d22/d58/dba/d75/dc0/f116 [131690,87470] 0 2024-02-10T00:00:45.772 INFO:tasks.workunit.client.0.smithi164.stdout:1/902: symlink d1/d13/d2b/d52/db7/d117/l124 0 2024-02-10T00:00:45.772 INFO:tasks.workunit.client.0.smithi164.stdout:9/985: readlink d6/de/de2/l109 0 2024-02-10T00:00:45.773 INFO:tasks.workunit.client.0.smithi164.stdout:3/922: mknod d0/d3b/dce/de1/df1/d108/c129 0 2024-02-10T00:00:45.774 INFO:tasks.workunit.client.0.smithi164.stdout:0/965: dread d6/d7/f6b [0,4194304] 0 2024-02-10T00:00:45.776 INFO:tasks.workunit.client.0.smithi164.stdout:1/903: unlink d1/d13/d2b/d52/da4/dc2/fcf 0 2024-02-10T00:00:45.777 INFO:tasks.workunit.client.0.smithi164.stdout:9/986: dwrite d6/de/d22/dd3/d104/d12b/feb [0,4194304] 0 2024-02-10T00:00:45.777 INFO:tasks.workunit.client.0.smithi164.stdout:1/904: stat d1/d1a/d41/d18/d3a/l49 0 2024-02-10T00:00:45.779 INFO:tasks.workunit.client.0.smithi164.stdout:0/966: mknod d6/d10/d4a/d60/c12e 0 2024-02-10T00:00:45.779 INFO:tasks.workunit.client.0.smithi164.stdout:0/967: write d6/d10/d4a/d60/d6c/df7/ffc [79754,1176] 0 2024-02-10T00:00:45.781 INFO:tasks.workunit.client.0.smithi164.stdout:3/923: unlink d0/d8f/d9a/db0/de7/l120 0 2024-02-10T00:00:45.782 INFO:tasks.workunit.client.0.smithi164.stdout:9/987: creat d6/de/d22/dd3/d104/d12b/dfc/f147 x:0 0 0 2024-02-10T00:00:45.784 INFO:tasks.workunit.client.0.smithi164.stdout:0/968: rename d6/d10/d18/d1c/c3f to d6/dec/da6/dea/d44/c12f 0 2024-02-10T00:00:45.789 INFO:tasks.workunit.client.0.smithi164.stdout:0/969: dwrite d6/d10/d4a/d88/fcc [0,4194304] 0 2024-02-10T00:00:45.801 INFO:tasks.workunit.client.0.smithi164.stdout:3/924: rename d0/fb1 to d0/d3b/dce/de1/df1/d108/f12a 0 2024-02-10T00:00:45.801 INFO:tasks.workunit.client.0.smithi164.stdout:3/925: dread - d0/d3b/dce/de1/d81/d95/dfb/ffe zero size 2024-02-10T00:00:45.801 INFO:tasks.workunit.client.0.smithi164.stdout:0/970: mknod d6/dec/da6/c130 0 2024-02-10T00:00:45.801 INFO:tasks.workunit.client.0.smithi164.stdout:1/905: creat d1/d23/d61/f125 x:0 0 0 2024-02-10T00:00:45.802 INFO:tasks.workunit.client.0.smithi164.stdout:1/906: chown d1/d23/d61/c74 63 1 2024-02-10T00:00:45.802 INFO:tasks.workunit.client.0.smithi164.stdout:9/988: creat d6/de/d22/dd3/d104/d12b/d145/f148 x:0 0 0 2024-02-10T00:00:45.803 INFO:tasks.workunit.client.0.smithi164.stdout:9/989: readlink d6/lf4 0 2024-02-10T00:00:45.803 INFO:tasks.workunit.client.0.smithi164.stdout:1/907: write d1/d23/d37/da9/dd1/ddb/f110 [43752,17459] 0 2024-02-10T00:00:45.806 INFO:tasks.workunit.client.0.smithi164.stdout:9/990: dwrite d6/f117 [0,4194304] 0 2024-02-10T00:00:45.811 INFO:tasks.workunit.client.0.smithi164.stdout:9/991: dwrite d6/f86 [0,4194304] 0 2024-02-10T00:00:45.815 INFO:tasks.workunit.client.0.smithi164.stdout:9/992: dread d6/de/d22/d58/fbc [0,4194304] 0 2024-02-10T00:00:45.815 INFO:tasks.workunit.client.0.smithi164.stdout:3/926: symlink d0/d3b/dce/de1/d81/l12b 0 2024-02-10T00:00:45.815 INFO:tasks.workunit.client.0.smithi164.stdout:9/993: chown d6/de/d22/dd3/d104/d8b/f29 306 1 2024-02-10T00:00:45.817 INFO:tasks.workunit.client.0.smithi164.stdout:1/908: write d1/d23/f98 [1714479,23721] 0 2024-02-10T00:00:45.819 INFO:tasks.workunit.client.0.smithi164.stdout:0/971: fdatasync d6/dec/da6/dea/d44/d49/d95/dc0/ff1 0 2024-02-10T00:00:45.820 INFO:tasks.workunit.client.0.smithi164.stdout:9/994: dread - d6/de/d22/dd3/d104/d8b/d24/fb0 zero size 2024-02-10T00:00:45.822 INFO:tasks.workunit.client.0.smithi164.stdout:3/927: unlink d0/d3b/dce/de1/df1/d108/f12a 0 2024-02-10T00:00:45.825 INFO:tasks.workunit.client.0.smithi164.stdout:3/928: creat d0/d3b/dce/de1/df1/d108/f12c x:0 0 0 2024-02-10T00:00:45.833 INFO:tasks.workunit.client.0.smithi164.stdout:3/929: dwrite d0/d1/d2/d19/d27/f2c [0,4194304] 0 2024-02-10T00:00:45.835 INFO:tasks.workunit.client.0.smithi164.stdout:9/995: truncate d6/f86 2898002 0 2024-02-10T00:00:45.835 INFO:tasks.workunit.client.0.smithi164.stdout:9/996: readlink d6/de/d22/l7d 0 2024-02-10T00:00:45.837 INFO:tasks.workunit.client.0.smithi164.stdout:3/930: mknod d0/d1/d2/d19/d27/d5f/da5/d94/dbd/d123/c12d 0 2024-02-10T00:00:45.838 INFO:tasks.workunit.client.0.smithi164.stdout:9/997: symlink d6/de/d22/d58/dba/d61/d107/l149 0 2024-02-10T00:00:45.840 INFO:tasks.workunit.client.0.smithi164.stdout:0/972: dread d6/d3a/d52/d7a/f4e [0,4194304] 0 2024-02-10T00:00:45.842 INFO:tasks.workunit.client.0.smithi164.stdout:9/998: mkdir d6/de/d22/dd3/d104/d12b/dfc/d14a 0 2024-02-10T00:00:45.842 INFO:tasks.workunit.client.0.smithi164.stdout:3/931: dwrite d0/d1/f11 [0,4194304] 0 2024-02-10T00:00:45.847 INFO:tasks.workunit.client.0.smithi164.stdout:0/973: dwrite d6/d10/d66/dfb/f107 [0,4194304] 0 2024-02-10T00:00:45.848 INFO:tasks.workunit.client.0.smithi164.stdout:9/999: fdatasync d6/de/d22/dd3/d104/d8b/d24/d4f/dff/dd9/f13f 0 2024-02-10T00:00:45.850 INFO:tasks.workunit.client.0.smithi164.stdout:0/974: mkdir d6/d10/d18/d2d/d39/de0/d131 0 2024-02-10T00:00:45.853 INFO:tasks.workunit.client.0.smithi164.stdout:0/975: creat d6/d10/d18/d1c/f132 x:0 0 0 2024-02-10T00:00:45.857 INFO:tasks.workunit.client.0.smithi164.stdout:3/932: dwrite d0/d1/d2/faa [0,4194304] 0 2024-02-10T00:00:45.860 INFO:tasks.workunit.client.0.smithi164.stdout:3/933: symlink d0/d8f/d9a/db0/l12e 0 2024-02-10T00:00:45.861 INFO:tasks.workunit.client.0.smithi164.stdout:0/976: getdents d6/d10/d66 0 2024-02-10T00:00:45.864 INFO:tasks.workunit.client.0.smithi164.stdout:0/977: truncate d6/d10/fd0 718086 0 2024-02-10T00:00:45.865 INFO:tasks.workunit.client.0.smithi164.stdout:3/934: dwrite d0/d3b/dce/f77 [0,4194304] 0 2024-02-10T00:00:45.870 INFO:tasks.workunit.client.0.smithi164.stdout:0/978: rename d6/d10/d18/d2d/c32 to d6/d10/d18/d2d/d39/de0/d131/c133 0 2024-02-10T00:00:45.871 INFO:tasks.workunit.client.0.smithi164.stdout:1/909: sync 2024-02-10T00:00:45.871 INFO:tasks.workunit.client.0.smithi164.stdout:3/935: dwrite d0/f10c [0,4194304] 0 2024-02-10T00:00:45.872 INFO:tasks.workunit.client.0.smithi164.stdout:3/936: chown d0/d8f/fcf 2 1 2024-02-10T00:00:45.874 INFO:tasks.workunit.client.0.smithi164.stdout:3/937: read d0/d103/d37/d3f/d4e/d6d/f92 [3606229,119988] 0 2024-02-10T00:00:45.887 INFO:tasks.workunit.client.0.smithi164.stdout:3/938: rmdir d0 39 2024-02-10T00:00:45.891 INFO:tasks.workunit.client.0.smithi164.stdout:0/979: write d6/dec/da6/dea/d44/f98 [3194718,90229] 0 2024-02-10T00:00:45.893 INFO:tasks.workunit.client.0.smithi164.stdout:3/939: rename d0/d1/d2/d19/d27/d5f/da5/d94/dbd/d123 to d0/d103/d37/d12f 0 2024-02-10T00:00:45.894 INFO:tasks.workunit.client.0.smithi164.stdout:3/940: chown d0/d1/d2/d19/d27/d30/lb9 451604726 1 2024-02-10T00:00:45.895 INFO:tasks.workunit.client.0.smithi164.stdout:0/980: mkdir d6/dec/da6/de6/d134 0 2024-02-10T00:00:45.895 INFO:tasks.workunit.client.0.smithi164.stdout:0/981: dread - d6/d10/fdd zero size 2024-02-10T00:00:45.896 INFO:tasks.workunit.client.0.smithi164.stdout:3/941: unlink d0/d3b/dce/de1/df1/f115 0 2024-02-10T00:00:45.898 INFO:tasks.workunit.client.0.smithi164.stdout:0/982: stat d6/fe9 0 2024-02-10T00:00:45.899 INFO:tasks.workunit.client.0.smithi164.stdout:0/983: write d6/d7/f58 [241348,87723] 0 2024-02-10T00:00:45.900 INFO:tasks.workunit.client.0.smithi164.stdout:3/942: truncate d0/d3b/dce/de1/df1/d108/f12c 102224 0 2024-02-10T00:00:45.902 INFO:tasks.workunit.client.0.smithi164.stdout:3/943: creat d0/d8f/d9a/db0/de7/f130 x:0 0 0 2024-02-10T00:00:45.904 INFO:tasks.workunit.client.0.smithi164.stdout:0/984: dwrite d6/d3a/d52/f8e [0,4194304] 0 2024-02-10T00:00:45.908 INFO:tasks.workunit.client.0.smithi164.stdout:0/985: dread d6/d10/d4a/d88/fcc [0,4194304] 0 2024-02-10T00:00:45.914 INFO:tasks.workunit.client.0.smithi164.stdout:0/986: creat d6/d10/d18/d2d/f135 x:0 0 0 2024-02-10T00:00:45.918 INFO:tasks.workunit.client.0.smithi164.stdout:0/987: rename d6/d3a/d52/d7a/fa1 to d6/dec/d79/dce/d101/f136 0 2024-02-10T00:00:45.921 INFO:tasks.workunit.client.0.smithi164.stdout:0/988: mknod d6/d10/d4a/c137 0 2024-02-10T00:00:45.923 INFO:tasks.workunit.client.0.smithi164.stdout:0/989: readlink d6/d10/d4a/l111 0 2024-02-10T00:00:45.926 INFO:tasks.workunit.client.0.smithi164.stdout:0/990: unlink d6/d10/d4a/d60/fac 0 2024-02-10T00:00:45.927 INFO:tasks.workunit.client.0.smithi164.stdout:3/944: dread d0/d1/d2/d19/f29 [0,4194304] 0 2024-02-10T00:00:45.929 INFO:tasks.workunit.client.0.smithi164.stdout:1/910: sync 2024-02-10T00:00:45.930 INFO:tasks.workunit.client.0.smithi164.stdout:0/991: dwrite d6/d3a/d52/f53 [4194304,4194304] 0 2024-02-10T00:00:45.931 INFO:tasks.workunit.client.0.smithi164.stdout:1/911: read d1/d13/d1f/f7a [3683296,30680] 0 2024-02-10T00:00:45.939 INFO:tasks.workunit.client.0.smithi164.stdout:1/912: dread - d1/d1a/d41/d18/fe6 zero size 2024-02-10T00:00:45.942 INFO:tasks.workunit.client.0.smithi164.stdout:3/945: dwrite d0/d103/d37/fdc [0,4194304] 0 2024-02-10T00:00:45.942 INFO:tasks.workunit.client.0.smithi164.stdout:0/992: dwrite d6/d7/fdf [0,4194304] 0 2024-02-10T00:00:45.943 INFO:tasks.workunit.client.0.smithi164.stdout:3/946: stat d0/d1/d2/d19/d27/d5f/f122 0 2024-02-10T00:00:45.946 INFO:tasks.workunit.client.0.smithi164.stdout:0/993: creat d6/d10/d4a/d60/f138 x:0 0 0 2024-02-10T00:00:45.947 INFO:tasks.workunit.client.0.smithi164.stdout:1/913: creat d1/d1a/f126 x:0 0 0 2024-02-10T00:00:45.950 INFO:tasks.workunit.client.0.smithi164.stdout:1/914: read d1/d23/d37/da9/dd1/ddb/f110 [38368,33485] 0 2024-02-10T00:00:45.953 INFO:tasks.workunit.client.0.smithi164.stdout:3/947: link d0/d3b/dce/f77 d0/d103/d37/f131 0 2024-02-10T00:00:45.954 INFO:tasks.workunit.client.0.smithi164.stdout:0/994: creat d6/d10/d18/d2d/f139 x:0 0 0 2024-02-10T00:00:45.956 INFO:tasks.workunit.client.0.smithi164.stdout:3/948: creat d0/d8f/d9a/f132 x:0 0 0 2024-02-10T00:00:45.956 INFO:tasks.workunit.client.0.smithi164.stdout:0/995: fdatasync d6/d3a/d52/d7a/f4e 0 2024-02-10T00:00:45.957 INFO:tasks.workunit.client.0.smithi164.stdout:1/915: mknod d1/d1a/d75/c127 0 2024-02-10T00:00:45.959 INFO:tasks.workunit.client.0.smithi164.stdout:3/949: unlink d0/d103/d37/fdc 0 2024-02-10T00:00:45.959 INFO:tasks.workunit.client.0.smithi164.stdout:0/996: symlink d6/dec/da6/dea/d44/l13a 0 2024-02-10T00:00:45.961 INFO:tasks.workunit.client.0.smithi164.stdout:1/916: creat d1/d23/d37/f128 x:0 0 0 2024-02-10T00:00:45.963 INFO:tasks.workunit.client.0.smithi164.stdout:3/950: mknod d0/d103/d37/d3f/c133 0 2024-02-10T00:00:45.963 INFO:tasks.workunit.client.0.smithi164.stdout:1/917: rename d1/d1a/d41/d18/l21 to d1/d95/l129 0 2024-02-10T00:00:45.964 INFO:tasks.workunit.client.0.smithi164.stdout:3/951: rmdir d0/d3b/dce/de1 39 2024-02-10T00:00:45.966 INFO:tasks.workunit.client.0.smithi164.stdout:1/918: dread d1/d1a/d75/de0/ffe [0,4194304] 0 2024-02-10T00:00:45.969 INFO:tasks.workunit.client.0.smithi164.stdout:1/919: link d1/d13/d2b/cec d1/d13/d2b/c12a 0 2024-02-10T00:00:45.978 INFO:tasks.workunit.client.0.smithi164.stdout:1/920: write d1/f71 [1746490,73752] 0 2024-02-10T00:00:45.980 INFO:tasks.workunit.client.0.smithi164.stdout:3/952: dwrite d0/d3b/dce/de1/df1/d108/f12c [0,4194304] 0 2024-02-10T00:00:45.982 INFO:tasks.workunit.client.0.smithi164.stdout:3/953: creat d0/d3b/f134 x:0 0 0 2024-02-10T00:00:45.983 INFO:tasks.workunit.client.0.smithi164.stdout:3/954: stat d0/d3b/dce/de1/d81/d95/f114 0 2024-02-10T00:00:45.987 INFO:tasks.workunit.client.0.smithi164.stdout:3/955: dwrite d0/d8f/d9a/db0/de7/f116 [0,4194304] 0 2024-02-10T00:00:45.988 INFO:tasks.workunit.client.0.smithi164.stdout:3/956: fsync d0/d8f/d9a/db0/de7/f130 0 2024-02-10T00:00:46.007 INFO:tasks.workunit.client.0.smithi164.stdout:3/957: dwrite d0/d3b/dce/fe9 [0,4194304] 0 2024-02-10T00:00:46.010 INFO:tasks.workunit.client.0.smithi164.stdout:3/958: symlink d0/d1/d2/d19/d27/d30/l135 0 2024-02-10T00:00:46.013 INFO:tasks.workunit.client.0.smithi164.stdout:3/959: dwrite d0/d3b/dce/de1/d84/d82/f113 [0,4194304] 0 2024-02-10T00:00:46.014 INFO:tasks.workunit.client.0.smithi164.stdout:3/960: chown d0/d3b/c5c 0 1 2024-02-10T00:00:46.047 INFO:tasks.workunit.client.0.smithi164.stdout:0/997: sync 2024-02-10T00:00:46.051 INFO:tasks.workunit.client.0.smithi164.stdout:0/998: dwrite d6/dec/da6/dea/d44/d49/d95/dc0/ff1 [0,4194304] 0 2024-02-10T00:00:46.054 INFO:tasks.workunit.client.0.smithi164.stdout:0/999: read d6/d10/fb5 [1217635,76388] 0 2024-02-10T00:00:46.071 INFO:tasks.workunit.client.0.smithi164.stdout:1/921: sync 2024-02-10T00:00:46.071 INFO:tasks.workunit.client.0.smithi164.stdout:3/961: sync 2024-02-10T00:00:46.075 INFO:tasks.workunit.client.0.smithi164.stdout:3/962: dread d0/d8f/d9a/db0/de7/f116 [0,4194304] 0 2024-02-10T00:00:46.075 INFO:tasks.workunit.client.0.smithi164.stdout:1/922: dwrite d1/d23/f7c [0,4194304] 0 2024-02-10T00:00:46.081 INFO:tasks.workunit.client.0.smithi164.stdout:1/923: rename d1/f6 to d1/d13/d2b/d52/da4/dc2/f12b 0 2024-02-10T00:00:46.081 INFO:tasks.workunit.client.0.smithi164.stdout:3/963: dwrite d0/d103/fe0 [0,4194304] 0 2024-02-10T00:00:46.084 INFO:tasks.workunit.client.0.smithi164.stdout:3/964: unlink d0/d3b/dce/l118 0 2024-02-10T00:00:46.085 INFO:tasks.workunit.client.0.smithi164.stdout:1/924: dwrite d1/d23/f55 [0,4194304] 0 2024-02-10T00:00:46.090 INFO:tasks.workunit.client.0.smithi164.stdout:1/925: rmdir d1/d1a 39 2024-02-10T00:00:46.091 INFO:tasks.workunit.client.0.smithi164.stdout:1/926: chown d1/d13/d2b/d52/da4/dc3/f108 10 1 2024-02-10T00:00:46.095 INFO:tasks.workunit.client.0.smithi164.stdout:1/927: unlink d1/d1a/d41/d18/fb6 0 2024-02-10T00:00:46.096 INFO:tasks.workunit.client.0.smithi164.stdout:1/928: write d1/d23/f92 [4395162,45913] 0 2024-02-10T00:00:46.097 INFO:tasks.workunit.client.0.smithi164.stdout:1/929: chown d1/d13/d2b/d52/c48 47 1 2024-02-10T00:00:46.110 INFO:tasks.workunit.client.0.smithi164.stdout:1/930: write d1/d13/d2b/d52/da4/dc3/dcd/f6a [1541471,85295] 0 2024-02-10T00:00:46.112 INFO:tasks.workunit.client.0.smithi164.stdout:1/931: mknod d1/d1a/c12c 0 2024-02-10T00:00:46.115 INFO:tasks.workunit.client.0.smithi164.stdout:1/932: creat d1/d13/d2b/d52/da4/dc2/d11c/f12d x:0 0 0 2024-02-10T00:00:46.116 INFO:tasks.workunit.client.0.smithi164.stdout:3/965: dread d0/d3b/dce/de1/d81/fbb [0,4194304] 0 2024-02-10T00:00:46.118 INFO:tasks.workunit.client.0.smithi164.stdout:1/933: fsync d1/d23/f7d 0 2024-02-10T00:00:46.118 INFO:tasks.workunit.client.0.smithi164.stdout:3/966: mkdir d0/d8f/d9a/db0/d136 0 2024-02-10T00:00:46.119 INFO:tasks.workunit.client.0.smithi164.stdout:3/967: chown d0/d1/d2/d19/d27/fb5 112 1 2024-02-10T00:00:46.122 INFO:tasks.workunit.client.0.smithi164.stdout:3/968: creat d0/d3b/dce/de1/f137 x:0 0 0 2024-02-10T00:00:46.125 INFO:tasks.workunit.client.0.smithi164.stdout:3/969: creat d0/d1/d2/f138 x:0 0 0 2024-02-10T00:00:46.127 INFO:tasks.workunit.client.0.smithi164.stdout:3/970: chown d0/d3b/dce/de1/d84/ffa 106 1 2024-02-10T00:00:46.127 INFO:tasks.workunit.client.0.smithi164.stdout:1/934: dread d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:46.130 INFO:tasks.workunit.client.0.smithi164.stdout:1/935: creat d1/d23/d37/da9/f12e x:0 0 0 2024-02-10T00:00:46.130 INFO:tasks.workunit.client.0.smithi164.stdout:3/971: truncate d0/d103/d37/f131 1209480 0 2024-02-10T00:00:46.132 INFO:tasks.workunit.client.0.smithi164.stdout:1/936: symlink d1/d1a/d41/d18/l12f 0 2024-02-10T00:00:46.133 INFO:tasks.workunit.client.0.smithi164.stdout:3/972: creat d0/d1/d2/d19/f139 x:0 0 0 2024-02-10T00:00:46.135 INFO:tasks.workunit.client.0.smithi164.stdout:1/937: read d1/d1a/d9a/f11b [2102774,47597] 0 2024-02-10T00:00:46.136 INFO:tasks.workunit.client.0.smithi164.stdout:3/973: getdents d0/d1/d2/d19/d27/d30 0 2024-02-10T00:00:46.137 INFO:tasks.workunit.client.0.smithi164.stdout:1/938: creat d1/d23/d37/da9/f130 x:0 0 0 2024-02-10T00:00:46.138 INFO:tasks.workunit.client.0.smithi164.stdout:1/939: write d1/d1a/d35/f34 [7233989,65047] 0 2024-02-10T00:00:46.196 INFO:tasks.workunit.client.0.smithi164.stdout:3/974: sync 2024-02-10T00:00:46.199 INFO:tasks.workunit.client.0.smithi164.stdout:3/975: link d0/d103/d37/d3f/c133 d0/d1/dd/dc8/c13a 0 2024-02-10T00:00:46.202 INFO:tasks.workunit.client.0.smithi164.stdout:3/976: creat d0/d1/dd/f13b x:0 0 0 2024-02-10T00:00:46.208 INFO:tasks.workunit.client.0.smithi164.stdout:3/977: creat d0/d103/d37/f13c x:0 0 0 2024-02-10T00:00:46.208 INFO:tasks.workunit.client.0.smithi164.stdout:3/978: creat d0/d8f/d9a/f13d x:0 0 0 2024-02-10T00:00:46.209 INFO:tasks.workunit.client.0.smithi164.stdout:3/979: mkdir d0/d1/d3c/d13e 0 2024-02-10T00:00:46.211 INFO:tasks.workunit.client.0.smithi164.stdout:3/980: unlink d0/d1/d2/d19/d27/d5f/da5/f10e 0 2024-02-10T00:00:46.213 INFO:tasks.workunit.client.0.smithi164.stdout:3/981: mkdir d0/d3b/dce/de1/d81/d13f 0 2024-02-10T00:00:46.229 INFO:tasks.workunit.client.0.smithi164.stdout:1/940: sync 2024-02-10T00:00:46.233 INFO:tasks.workunit.client.0.smithi164.stdout:1/941: dwrite d1/d23/d37/da9/dd1/ddb/ff3 [0,4194304] 0 2024-02-10T00:00:46.249 INFO:tasks.workunit.client.0.smithi164.stdout:3/982: sync 2024-02-10T00:00:46.266 INFO:tasks.workunit.client.0.smithi164.stdout:3/983: dread d0/d3b/dce/de1/d84/f88 [4194304,4194304] 0 2024-02-10T00:00:46.270 INFO:tasks.workunit.client.0.smithi164.stdout:3/984: link d0/d103/d37/d3f/c128 d0/d1/dd/c140 0 2024-02-10T00:00:46.271 INFO:tasks.workunit.client.0.smithi164.stdout:3/985: readlink d0/d1/dd/l76 0 2024-02-10T00:00:46.272 INFO:tasks.workunit.client.0.smithi164.stdout:1/942: sync 2024-02-10T00:00:46.274 INFO:tasks.workunit.client.0.smithi164.stdout:3/986: dread d0/d3b/dce/fe9 [0,4194304] 0 2024-02-10T00:00:46.280 INFO:tasks.workunit.client.0.smithi164.stdout:1/943: dread d1/d13/d2b/d52/da4/fbd [0,4194304] 0 2024-02-10T00:00:46.282 INFO:tasks.workunit.client.0.smithi164.stdout:3/987: truncate d0/d1/dd/dc8/fe6 971210 0 2024-02-10T00:00:46.283 INFO:tasks.workunit.client.0.smithi164.stdout:3/988: chown d0/c98 123 1 2024-02-10T00:00:46.286 INFO:tasks.workunit.client.0.smithi164.stdout:3/989: mkdir d0/d8f/d9a/d141 0 2024-02-10T00:00:46.289 INFO:tasks.workunit.client.0.smithi164.stdout:1/944: dread d1/d1a/f2c [0,4194304] 0 2024-02-10T00:00:46.290 INFO:tasks.workunit.client.0.smithi164.stdout:3/990: dwrite d0/d1/d2/d19/f56 [4194304,4194304] 0 2024-02-10T00:00:46.298 INFO:tasks.workunit.client.0.smithi164.stdout:1/945: write d1/d1a/d41/f104 [4287888,77286] 0 2024-02-10T00:00:46.303 INFO:tasks.workunit.client.0.smithi164.stdout:3/991: dread d0/d3b/dce/de1/d84/d82/f87 [0,4194304] 0 2024-02-10T00:00:46.307 INFO:tasks.workunit.client.0.smithi164.stdout:3/992: rename d0/d1/d2/d19/d27/fb5 to d0/d3b/dce/de1/d81/d13f/f142 0 2024-02-10T00:00:46.307 INFO:tasks.workunit.client.0.smithi164.stdout:3/993: stat d0/d8f/f119 0 2024-02-10T00:00:46.307 INFO:tasks.workunit.client.0.smithi164.stdout:3/994: readlink d0/d1/d2/d19/d27/d5f/l6e 0 2024-02-10T00:00:46.308 INFO:tasks.workunit.client.0.smithi164.stdout:1/946: write d1/d13/d1f/f102 [785341,91320] 0 2024-02-10T00:00:46.310 INFO:tasks.workunit.client.0.smithi164.stdout:3/995: mkdir d0/d3b/dce/de1/df1/d108/d143 0 2024-02-10T00:00:46.327 INFO:tasks.workunit.client.0.smithi164.stdout:3/996: dread d0/d1/d2/d19/f73 [0,4194304] 0 2024-02-10T00:00:46.327 INFO:tasks.workunit.client.0.smithi164.stdout:1/947: dread d1/d1a/d41/f104 [0,4194304] 0 2024-02-10T00:00:46.328 INFO:tasks.workunit.client.0.smithi164.stdout:1/948: read - d1/d23/d37/f128 zero size 2024-02-10T00:00:46.331 INFO:tasks.workunit.client.0.smithi164.stdout:3/997: dread d0/d8f/d9a/db0/de7/f116 [0,4194304] 0 2024-02-10T00:00:46.332 INFO:tasks.workunit.client.0.smithi164.stdout:1/949: getdents d1/d1a/d41/d18 0 2024-02-10T00:00:46.335 INFO:tasks.workunit.client.0.smithi164.stdout:1/950: dread d1/d23/f67 [0,4194304] 0 2024-02-10T00:00:46.336 INFO:tasks.workunit.client.0.smithi164.stdout:3/998: getdents d0/d1/dd/dc8 0 2024-02-10T00:00:46.337 INFO:tasks.workunit.client.0.smithi164.stdout:1/951: fdatasync d1/d13/d2b/f5a 0 2024-02-10T00:00:46.339 INFO:tasks.workunit.client.0.smithi164.stdout:1/952: creat d1/d1a/d41/d18/d33/f131 x:0 0 0 2024-02-10T00:00:46.413 INFO:tasks.workunit.client.0.smithi164.stdout:3/999: sync 2024-02-10T00:00:46.413 INFO:tasks.workunit.client.0.smithi164.stdout:1/953: sync 2024-02-10T00:00:46.445 INFO:tasks.workunit.client.0.smithi164.stdout:1/954: symlink d1/d13/d2b/d52/da4/dc2/d11c/l132 0 2024-02-10T00:00:46.460 INFO:tasks.workunit.client.0.smithi164.stdout:1/955: truncate d1/d13/f19 3175575 0 2024-02-10T00:00:46.463 INFO:tasks.workunit.client.0.smithi164.stdout:1/956: dwrite d1/d23/d61/f125 [0,4194304] 0 2024-02-10T00:00:46.468 INFO:tasks.workunit.client.0.smithi164.stdout:1/957: mkdir d1/d13/d2b/d52/d133 0 2024-02-10T00:00:46.470 INFO:tasks.workunit.client.0.smithi164.stdout:1/958: symlink d1/d13/d2b/d52/d133/l134 0 2024-02-10T00:00:46.472 INFO:tasks.workunit.client.0.smithi164.stdout:1/959: creat d1/d13/d2b/d52/da4/dc2/d11c/f135 x:0 0 0 2024-02-10T00:00:46.473 INFO:tasks.workunit.client.0.smithi164.stdout:1/960: dread - d1/d1a/d41/fce zero size 2024-02-10T00:00:46.475 INFO:tasks.workunit.client.0.smithi164.stdout:1/961: creat d1/d23/d70/f136 x:0 0 0 2024-02-10T00:00:46.476 INFO:tasks.workunit.client.0.smithi164.stdout:1/962: fdatasync d1/d13/d2b/d52/da4/f111 0 2024-02-10T00:00:46.478 INFO:tasks.workunit.client.0.smithi164.stdout:1/963: creat d1/d1a/d75/f137 x:0 0 0 2024-02-10T00:00:46.485 INFO:tasks.workunit.client.0.smithi164.stdout:1/964: truncate d1/d23/d70/f107 1547735 0 2024-02-10T00:00:46.486 INFO:tasks.workunit.client.0.smithi164.stdout:1/965: write d1/d13/d2b/d52/db7/fa7 [3745564,32969] 0 2024-02-10T00:00:46.487 INFO:tasks.workunit.client.0.smithi164.stdout:1/966: chown d1/d13/d2b/d52/da4/dc3/f108 2 1 2024-02-10T00:00:46.490 INFO:tasks.workunit.client.0.smithi164.stdout:1/967: creat d1/d13/f138 x:0 0 0 2024-02-10T00:00:46.491 INFO:tasks.workunit.client.0.smithi164.stdout:1/968: write d1/d23/d70/f136 [933309,99236] 0 2024-02-10T00:00:46.504 INFO:tasks.workunit.client.0.smithi164.stdout:1/969: dread d1/d13/d2b/d52/d56/fbc [0,4194304] 0 2024-02-10T00:00:46.507 INFO:tasks.workunit.client.0.smithi164.stdout:1/970: symlink d1/d23/l139 0 2024-02-10T00:00:46.508 INFO:tasks.workunit.client.0.smithi164.stdout:1/971: mkdir d1/d23/d37/da9/dd1/ddb/d13a 0 2024-02-10T00:00:46.510 INFO:tasks.workunit.client.0.smithi164.stdout:1/972: mkdir d1/d1a/d41/d18/d33/d13b 0 2024-02-10T00:00:46.511 INFO:tasks.workunit.client.0.smithi164.stdout:1/973: chown d1/d1a/d75/lb2 2 1 2024-02-10T00:00:46.514 INFO:tasks.workunit.client.0.smithi164.stdout:1/974: dread d1/d23/d37/da9/dd1/ddb/ff3 [0,4194304] 0 2024-02-10T00:00:46.516 INFO:tasks.workunit.client.0.smithi164.stdout:1/975: symlink d1/d1a/d35/l13c 0 2024-02-10T00:00:46.518 INFO:tasks.workunit.client.0.smithi164.stdout:1/976: rename d1/d23/d37/l8c to d1/d13/d2b/d52/db7/d117/l13d 0 2024-02-10T00:00:46.548 INFO:tasks.workunit.client.0.smithi164.stdout:1/977: sync 2024-02-10T00:00:46.548 INFO:tasks.workunit.client.0.smithi164.stdout:1/978: read d1/d23/f97 [1093282,21244] 0 2024-02-10T00:00:46.563 INFO:tasks.workunit.client.0.smithi164.stdout:1/979: dread d1/d1a/f85 [0,4194304] 0 2024-02-10T00:00:46.564 INFO:tasks.workunit.client.0.smithi164.stdout:1/980: fdatasync d1/d23/fc8 0 2024-02-10T00:00:46.566 INFO:tasks.workunit.client.0.smithi164.stdout:1/981: write d1/d1a/d41/f104 [3857722,103079] 0 2024-02-10T00:00:46.571 INFO:tasks.workunit.client.0.smithi164.stdout:1/982: mknod d1/d13/d2b/d52/da4/dc2/dcc/c13e 0 2024-02-10T00:00:46.572 INFO:tasks.workunit.client.0.smithi164.stdout:1/983: chown d1/d13/l79 510289783 1 2024-02-10T00:00:46.572 INFO:tasks.workunit.client.0.smithi164.stdout:1/984: write d1/d1a/d41/f112 [248889,65366] 0 2024-02-10T00:00:46.576 INFO:tasks.workunit.client.0.smithi164.stdout:1/985: unlink d1/d13/d2b/cec 0 2024-02-10T00:00:46.585 INFO:tasks.workunit.client.0.smithi164.stdout:1/986: truncate d1/d13/d2b/d52/da4/dc2/dcc/ff7 298652 0 2024-02-10T00:00:46.589 INFO:tasks.workunit.client.0.smithi164.stdout:1/987: creat d1/d13/d2b/d52/da4/dc2/d11c/f13f x:0 0 0 2024-02-10T00:00:46.600 INFO:tasks.workunit.client.0.smithi164.stdout:1/988: mkdir d1/d13/d2b/d52/da4/d140 0 2024-02-10T00:00:46.612 INFO:tasks.workunit.client.0.smithi164.stdout:1/989: truncate d1/d13/d2b/d52/da4/dc2/d11c/f135 832477 0 2024-02-10T00:00:46.617 INFO:tasks.workunit.client.0.smithi164.stdout:1/990: read d1/d1a/ff5 [120738,102710] 0 2024-02-10T00:00:46.619 INFO:tasks.workunit.client.0.smithi164.stdout:1/991: readlink d1/d13/d2b/d52/db7/d117/l13d 0 2024-02-10T00:00:46.625 INFO:tasks.workunit.client.0.smithi164.stdout:1/992: dread d1/f94 [0,4194304] 0 2024-02-10T00:00:46.629 INFO:tasks.workunit.client.0.smithi164.stdout:1/993: dwrite d1/d13/d2b/d52/f6b [4194304,4194304] 0 2024-02-10T00:00:46.651 INFO:tasks.workunit.client.0.smithi164.stdout:1/994: dwrite d1/d23/d37/da9/dd1/ddb/f11d [0,4194304] 0 2024-02-10T00:00:46.655 INFO:tasks.workunit.client.0.smithi164.stdout:1/995: creat d1/d13/d2b/d52/da4/dc2/d11c/f141 x:0 0 0 2024-02-10T00:00:46.658 INFO:tasks.workunit.client.0.smithi164.stdout:1/996: creat d1/d1a/d75/de0/f142 x:0 0 0 2024-02-10T00:00:46.674 INFO:tasks.workunit.client.0.smithi164.stdout:1/997: write d1/d1a/f85 [1742788,111769] 0 2024-02-10T00:00:46.678 INFO:tasks.workunit.client.0.smithi164.stdout:1/998: dwrite d1/d1a/d41/d18/d33/f131 [0,4194304] 0 2024-02-10T00:00:46.679 INFO:tasks.workunit.client.0.smithi164.stdout:1/999: chown d1/d23/d70/cd0 12407 1 2024-02-10T00:00:46.682 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm -rf -- ./tmp.IMFJ2Wyv3x 2024-02-10T00:00:55.956 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-10T00:00:55.956 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-10T00:01:03.320 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-10T00:01:03.320 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-10T00:02:11.633 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-10T00:02:11.634 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-10T00:02:11.900 DEBUG:teuthology.parallel:result is None 2024-02-10T00:02:23.851 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-10T00:02:23.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-10T00:02:24.125 DEBUG:teuthology.parallel:result is None 2024-02-10T00:02:24.125 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-10T00:02:24.169 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-10T00:02:24.170 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-10T00:02:24.209 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-10T00:02:24.210 INFO:teuthology.run_tasks:Running task print... 2024-02-10T00:02:24.278 INFO:teuthology.task.print:**** done fsstress 2024-02-10T00:02:24.278 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2024-02-10T00:02:24.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:02:24.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.414+0000 7ff0ca2e8700 1 Processor -- start 2024-02-10T00:02:24.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.414+0000 7ff0ca2e8700 1 -- start start 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0ca2e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 0x7ff0c4063db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0ca2e8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0ca2e8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c4062ca0 con 0x7ff0c4135b40 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0ca2e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c40642a0 con 0x7ff0c4064c60 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0ca2e8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4065560 con 0x7ff0c4067040 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 0x7ff0c4063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41102/0 (socket says 172.21.15.89:41102) 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c8885700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff0c4135b40 0x7ff0c4135fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35336/0 (socket says 172.21.15.89:35336) 2024-02-10T00:02:24.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 -- 172.21.15.89:0/2144092898 learned_addr learned my addr 172.21.15.89:0/2144092898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 -- 172.21.15.89:0/2144092898 >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 msgr2=0x7ff0c4063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 --2- 172.21.15.89:0/2144092898 >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 0x7ff0c4063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 -- 172.21.15.89:0/2144092898 >> v1:172.21.15.89:6789/0 conn(0x7ff0c4135b40 legacy=0x7ff0c4135fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 -- 172.21.15.89:0/2144092898 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4066da0 con 0x7ff0c4067040 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c3fff700 1 --2- 172.21.15.89:0/2144092898 >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 0x7ff0c4063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c37fe700 1 --2- 172.21.15.89:0/2144092898 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff0b8002f70 tx=0x7ff0b8006e40).ready entity=mon.2 client_cookie=642b831eb8ae314f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c2ffd700 1 -- 172.21.15.89:0/2144092898 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b800bc90 con 0x7ff0c4067040 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c2ffd700 1 -- 172.21.15.89:0/2144092898 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8000e90 con 0x7ff0c4067040 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.415+0000 7ff0c2ffd700 1 -- 172.21.15.89:0/2144092898 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b80153f0 con 0x7ff0c4067040 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/2144092898 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 msgr2=0x7ff0c4067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/2144092898 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff0b8002f70 tx=0x7ff0b8006e40).stop 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/2144092898 shutdown_connections 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/2144092898 >> v2:172.21.15.89:3300/0 conn(0x7ff0c4064c60 0x7ff0c4063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/2144092898 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4067040 0x7ff0c4067460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/2144092898 >> 172.21.15.89:0/2144092898 conn(0x7ff0c406c0c0 msgr2=0x7ff0c406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:24.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/2144092898 shutdown_connections 2024-02-10T00:02:24.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.416+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/2144092898 wait complete. 2024-02-10T00:02:24.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.417+0000 7ff0ca2e8700 1 Processor -- start 2024-02-10T00:02:24.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.417+0000 7ff0ca2e8700 1 -- start start 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 0x7ff0c4099b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 0x7ff0c41490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c409bff0 con 0x7ff0c4067040 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c409d600 con 0x7ff0c4064c60 2024-02-10T00:02:24.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4148e50 con 0x7ff0c4135b40 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 0x7ff0c41490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 0x7ff0c4099b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52474/0 (socket says 172.21.15.89:52474) 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c37fe700 1 -- 172.21.15.89:0/925346424 learned_addr learned my addr 172.21.15.89:0/925346424 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 -- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 msgr2=0x7ff0c4099b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 0x7ff0c4099b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 -- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 msgr2=0x7ff0c409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 -- 172.21.15.89:0/925346424 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b400b180 con 0x7ff0c4135b40 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c37fe700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c3fff700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 0x7ff0c4099b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c8885700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 0x7ff0c41490f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff0c40a5e10 tx=0x7ff0bc007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc00ce80 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc005ae0 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b800d4d0 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc005e40 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.418+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c4098d20 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.419+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff0bc010070 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.419+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c409ced0 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.419+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff0bc049df0 con 0x7ff0c4135b40 2024-02-10T00:02:24.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.422+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff0bc02ecf0 con 0x7ff0c4135b40 2024-02-10T00:02:24.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.534+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c4062ca0 con 0x7ff0c4135b40 2024-02-10T00:02:24.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.534+0000 7ff0c17fa700 1 -- 172.21.15.89:0/925346424 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7ff0c4062ca0 con 0x7ff0c4135b40 2024-02-10T00:02:24.537 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:24.537 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:39.397746+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-10T00:02:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 >> v1:172.21.15.89:6816/39389 conn(0x7ff0a4038ef0 legacy=0x7ff0a403b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 msgr2=0x7ff0c41490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 0x7ff0c41490f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff0c40a5e10 tx=0x7ff0bc007ee0).stop 2024-02-10T00:02:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 shutdown_connections 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff0c4135b40 0x7ff0c41490f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0c4064c60 0x7ff0c4099b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 --2- 172.21.15.89:0/925346424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0c4067040 0x7ff0c409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 >> 172.21.15.89:0/925346424 conn(0x7ff0c406c0c0 msgr2=0x7ff0c4061c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 shutdown_connections 2024-02-10T00:02:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.536+0000 7ff0ca2e8700 1 -- 172.21.15.89:0/925346424 wait complete. 2024-02-10T00:02:24.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:02:24.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-10T00:02:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.653+0000 7f39572c9700 1 Processor -- start 2024-02-10T00:02:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.653+0000 7f39572c9700 1 -- start start 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f39572c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f39500a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f39572c9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 0x7f395009f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f39572c9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395009c8f0 con 0x7f395009f8e0 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f39572c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395009c5e0 con 0x7f395009f010 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f39572c9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39500a1540 con 0x7f39500a4fa0 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3955065700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f39500a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3954864700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 0x7f395009f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3955866700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f395009f8e0 0x7f39500a3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35352/0 (socket says 172.21.15.89:35352) 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3955866700 1 -- 172.21.15.89:0/3454756243 learned_addr learned my addr 172.21.15.89:0/3454756243 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f393ffff700 1 -- 172.21.15.89:0/3454756243 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77617597 0 0) 0x7f395009c8f0 con 0x7f395009f8e0 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f393ffff700 1 -- 172.21.15.89:0/3454756243 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3938003260 con 0x7f395009f8e0 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3955065700 1 -- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 msgr2=0x7f395009f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.654+0000 7f3955065700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 0x7f395009f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f3955065700 1 -- 172.21.15.89:0/3454756243 >> v1:172.21.15.89:6789/0 conn(0x7f395009f8e0 legacy=0x7f39500a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f3955065700 1 -- 172.21.15.89:0/3454756243 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395009cb20 con 0x7f395009f010 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f3954864700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 0x7f395009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f3955065700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f39500a1cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3940002f70 tx=0x7f3940006df0).ready entity=mon.1 client_cookie=2a70bf9d76a5aadc server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f393ffff700 1 -- 172.21.15.89:0/3454756243 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f394000d570 con 0x7f395009f010 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f393ffff700 1 -- 172.21.15.89:0/3454756243 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940000e90 con 0x7f395009f010 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f393ffff700 1 -- 172.21.15.89:0/3454756243 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f394000d8c0 con 0x7f395009f010 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 -- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 msgr2=0x7f39500a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f39500a1cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3940002f70 tx=0x7f3940006df0).stop 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 -- 172.21.15.89:0/3454756243 shutdown_connections 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f39500a1cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 --2- 172.21.15.89:0/3454756243 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f39500a4fa0 0x7f395009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 -- 172.21.15.89:0/3454756243 >> 172.21.15.89:0/3454756243 conn(0x7f39500a93f0 msgr2=0x7f39500a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 -- 172.21.15.89:0/3454756243 shutdown_connections 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.655+0000 7f39572c9700 1 -- 172.21.15.89:0/3454756243 wait complete. 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.656+0000 7f39572c9700 1 Processor -- start 2024-02-10T00:02:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.656+0000 7f39572c9700 1 -- start start 2024-02-10T00:02:24.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f395009f8e0 0x7f39501346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 0x7f3950134ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950063c50 con 0x7f39500a4fa0 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950064420 con 0x7f395009f010 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3950063e50 con 0x7f395009f8e0 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955866700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 0x7f3950134ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51084/0 (socket says 172.21.15.89:51084) 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 -- 172.21.15.89:0/2308322053 learned_addr learned my addr 172.21.15.89:0/2308322053 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3954864700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f395009f8e0 0x7f39501346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 -- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f395009f8e0 msgr2=0x7f39501346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f395009f8e0 0x7f39501346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 -- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 msgr2=0x7f3950134ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 0x7f3950134ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 -- 172.21.15.89:0/2308322053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c00b180 con 0x7f395009f010 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955866700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 0x7f3950134ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f3955065700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3950064b50 tx=0x7f3940014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f394000dea0 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940013da0 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394000b180 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.657+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f394001e5f0 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.658+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3950065270 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.658+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3940025030 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.659+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39500650c0 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.659+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f394004b480 con 0x7f395009f010 2024-02-10T00:02:24.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.662+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f39400027f0 con 0x7f395009f010 2024-02-10T00:02:24.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.773+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3950067710 con 0x7f395009f010 2024-02-10T00:02:24.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.773+0000 7f393e7fc700 1 -- 172.21.15.89:0/2308322053 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f394001fa50 con 0x7f395009f010 2024-02-10T00:02:24.776 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:02:24.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 >> v1:172.21.15.89:6816/39389 conn(0x7f3930038e30 legacy=0x7f393003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 msgr2=0x7f3950063760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3950064b50 tx=0x7f3940014000).stop 2024-02-10T00:02:24.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 shutdown_connections 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39500a4fa0 0x7f3950134ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f395009f010 0x7f3950063760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 --2- 172.21.15.89:0/2308322053 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f395009f8e0 0x7f39501346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 >> 172.21.15.89:0/2308322053 conn(0x7f39500a93f0 msgr2=0x7f39500a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 shutdown_connections 2024-02-10T00:02:24.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.775+0000 7f39572c9700 1 -- 172.21.15.89:0/2308322053 wait complete. 2024-02-10T00:02:24.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:02:24.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.889+0000 7f9f8b0cf700 1 Processor -- start 2024-02-10T00:02:24.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 -- start start 2024-02-10T00:02:24.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f84133bc0 0x7f9f84067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840a4c50 con 0x7f9f841337e0 2024-02-10T00:02:24.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f84133fe0 con 0x7f9f84133bc0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8b0cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840a4f10 con 0x7f9f84139fa0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8966c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f83fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f84133bc0 0x7f9f84067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8966c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51086/0 (socket says 172.21.15.89:51086) 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.890+0000 7f9f8966c700 1 -- 172.21.15.89:0/1543036986 learned_addr learned my addr 172.21.15.89:0/1543036986 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f83fff700 1 -- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 msgr2=0x7f9f84141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f83fff700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f83fff700 1 -- 172.21.15.89:0/1543036986 >> v1:172.21.15.89:6789/0 conn(0x7f9f841337e0 legacy=0x7f9f84139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f83fff700 1 -- 172.21.15.89:0/1543036986 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84060520 con 0x7f9f84133bc0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f837fe700 1 -- 172.21.15.89:0/1543036986 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294905695 0 0) 0x7f9f840a4c50 con 0x7f9f841337e0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8966c700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f83fff700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f84133bc0 0x7f9f84067570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9f70002f70 tx=0x7f9f70006df0).ready entity=mon.0 client_cookie=45794576239ac3f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f837fe700 1 -- 172.21.15.89:0/1543036986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7000d570 con 0x7f9f84133bc0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f837fe700 1 -- 172.21.15.89:0/1543036986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70000e90 con 0x7f9f84133bc0 2024-02-10T00:02:24.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f837fe700 1 -- 172.21.15.89:0/1543036986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7000d8c0 con 0x7f9f84133bc0 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f84133bc0 msgr2=0x7f9f84067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f84133bc0 0x7f9f84067570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9f70002f70 tx=0x7f9f70006df0).stop 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/1543036986 shutdown_connections 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/1543036986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f84133bc0 0x7f9f84067570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/1543036986 >> 172.21.15.89:0/1543036986 conn(0x7f9f840a93f0 msgr2=0x7f9f840a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/1543036986 shutdown_connections 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.891+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/1543036986 wait complete. 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.892+0000 7f9f8b0cf700 1 Processor -- start 2024-02-10T00:02:24.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.892+0000 7f9f8b0cf700 1 -- start start 2024-02-10T00:02:24.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 0x7f9f8409d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f84133bc0 0x7f9f84149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84093140 con 0x7f9f841337e0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409cb80 con 0x7f9f84139fa0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8b0cf700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409e390 con 0x7f9f84133bc0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f88e6b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 0x7f9f8409d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51090/0 (socket says 172.21.15.89:51090) 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f88e6b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 0x7f9f8409d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52510/0 (socket says 172.21.15.89:52510) 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 -- 172.21.15.89:0/927178309 learned_addr learned my addr 172.21.15.89:0/927178309 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f83fff700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f84133bc0 0x7f9f84149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 -- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f84133bc0 msgr2=0x7f9f84149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f84133bc0 0x7f9f84149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 -- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 msgr2=0x7f9f8409d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 0x7f9f8409d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 -- 172.21.15.89:0/927178309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009530 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f8966c700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f840a1420 tx=0x7f9f7c009290).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c009770 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.893+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00c850 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.894+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7000b180 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.894+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c00cbb0 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.894+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8409e5f0 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.894+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9f7c022070 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.895+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9f7c04aec0 con 0x7f9f84139fa0 2024-02-10T00:02:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.895+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8409d6e0 con 0x7f9f84139fa0 2024-02-10T00:02:24.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:24.898+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9f8409d6e0 con 0x7f9f84139fa0 2024-02-10T00:02:25.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.006+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9f8409d6e0 con 0x7f9f84139fa0 2024-02-10T00:02:25.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.007+0000 7f9f81ffb700 1 -- 172.21.15.89:0/927178309 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9f8409d6e0 con 0x7f9f84139fa0 2024-02-10T00:02:25.009 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:02:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 >> v1:172.21.15.89:6816/39389 conn(0x7f9f64038da0 legacy=0x7f9f6403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 msgr2=0x7f9f84149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f840a1420 tx=0x7f9f7c009290).stop 2024-02-10T00:02:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 shutdown_connections 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f84139fa0 0x7f9f84149580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f841337e0 0x7f9f8409d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 --2- 172.21.15.89:0/927178309 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f84133bc0 0x7f9f84149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 >> 172.21.15.89:0/927178309 conn(0x7f9f840a93f0 msgr2=0x7f9f8405c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 shutdown_connections 2024-02-10T00:02:25.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.008+0000 7f9f8b0cf700 1 -- 172.21.15.89:0/927178309 wait complete. 2024-02-10T00:02:25.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:02:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 Processor -- start 2024-02-10T00:02:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 -- start start 2024-02-10T00:02:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca5005e170 0x7fca500a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca500a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500a50b0 con 0x7fca500a4ab0 2024-02-10T00:02:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5009f800 con 0x7fca5005e170 2024-02-10T00:02:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca56288700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca5005e550 con 0x7fca5009d570 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca4ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca5005e170 0x7fca500a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca54825700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fca500a4ab0 0x7fca500a24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35368/0 (socket says 172.21.15.89:35368) 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca54825700 1 -- 172.21.15.89:0/2898834276 learned_addr learned my addr 172.21.15.89:0/2898834276 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.123+0000 7fca4f7fe700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca500a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4ffff700 1 -- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 msgr2=0x7fca500a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4ffff700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca500a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4ffff700 1 -- 172.21.15.89:0/2898834276 >> v1:172.21.15.89:6789/0 conn(0x7fca500a4ab0 legacy=0x7fca500a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4ffff700 1 -- 172.21.15.89:0/2898834276 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500a4190 con 0x7fca5005e170 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4effd700 1 -- 172.21.15.89:0/2898834276 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792766921 0 0) 0x7fca500a50b0 con 0x7fca500a4ab0 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4ffff700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a45c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fca40002f70 tx=0x7fca40006df0).ready entity=mon.0 client_cookie=8f9efccf5f55a158 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4effd700 1 -- 172.21.15.89:0/2898834276 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca4000d570 con 0x7fca5005e170 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4effd700 1 -- 172.21.15.89:0/2898834276 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40000e90 con 0x7fca5005e170 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca4effd700 1 -- 172.21.15.89:0/2898834276 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca4000d8c0 con 0x7fca5005e170 2024-02-10T00:02:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 -- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 msgr2=0x7fca500a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a45c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fca40002f70 tx=0x7fca40006df0).stop 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 -- 172.21.15.89:0/2898834276 shutdown_connections 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a45c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 --2- 172.21.15.89:0/2898834276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca500a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 -- 172.21.15.89:0/2898834276 >> 172.21.15.89:0/2898834276 conn(0x7fca500a93f0 msgr2=0x7fca500a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 -- 172.21.15.89:0/2898834276 shutdown_connections 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.124+0000 7fca56288700 1 -- 172.21.15.89:0/2898834276 wait complete. 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.125+0000 7fca56288700 1 Processor -- start 2024-02-10T00:02:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.125+0000 7fca56288700 1 -- start start 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca501492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501435e0 con 0x7fca5005e170 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5009feb0 con 0x7fca500a4ab0 2024-02-10T00:02:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca56288700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca500a11f0 con 0x7fca5009d570 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca54825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca54825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51106/0 (socket says 172.21.15.89:51106) 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52528/0 (socket says 172.21.15.89:52528) 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca54825700 1 -- 172.21.15.89:0/4025868713 learned_addr learned my addr 172.21.15.89:0/4025868713 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4f7fe700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca501492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 -- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 msgr2=0x7fca501492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca501492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 -- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 msgr2=0x7fca501497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 -- 172.21.15.89:0/4025868713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4000b180 con 0x7fca5005e170 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4f7fe700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca501492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca54825700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.126+0000 7fca4ffff700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fca40002f70 tx=0x7fca40014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca40013e50 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4001e400 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca4001e760 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50148ea0 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca50067220 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.127+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fca4001c070 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.128+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5009df90 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.128+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fca4004b290 con 0x7fca5005e170 2024-02-10T00:02:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.131+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fca40023030 con 0x7fca5005e170 2024-02-10T00:02:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.240+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca50139ed0 con 0x7fca5005e170 2024-02-10T00:02:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.240+0000 7fca4d7fa700 1 -- 172.21.15.89:0/4025868713 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca400275c0 con 0x7fca5005e170 2024-02-10T00:02:25.242 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 >> v1:172.21.15.89:6816/39389 conn(0x7fca34038ef0 legacy=0x7fca3403b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 msgr2=0x7fca500a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fca40002f70 tx=0x7fca40014000).stop 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 shutdown_connections 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca500a4ab0 0x7fca501497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca5005e170 0x7fca500a0820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 --2- 172.21.15.89:0/4025868713 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fca5009d570 0x7fca501492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 >> 172.21.15.89:0/4025868713 conn(0x7fca500a93f0 msgr2=0x7fca50136730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 shutdown_connections 2024-02-10T00:02:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.241+0000 7fca56288700 1 -- 172.21.15.89:0/4025868713 wait complete. 2024-02-10T00:02:25.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:02:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.359+0000 7f80e2107700 1 Processor -- start 2024-02-10T00:02:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.359+0000 7f80e2107700 1 -- start start 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80e2107700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 0x7f80dc0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80e2107700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80dc064700 0x7f80dc136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80e2107700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc09b2a0 con 0x7f80dc09adf0 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80e2107700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc09bc50 con 0x7f80dc064700 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80e2107700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1367e0 con 0x7f80dc09aa10 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 0x7f80dc0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80daffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80dc064700 0x7f80dc136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80dbfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f80dc09adf0 0x7f80dc132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35372/0 (socket says 172.21.15.89:35372) 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80dbfff700 1 -- 172.21.15.89:0/920868229 learned_addr learned my addr 172.21.15.89:0/920868229 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80db7fe700 1 -- 172.21.15.89:0/920868229 >> v2:172.21.15.89:3300/0 conn(0x7f80dc064700 msgr2=0x7f80dc136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80db7fe700 1 --2- 172.21.15.89:0/920868229 >> v2:172.21.15.89:3300/0 conn(0x7f80dc064700 0x7f80dc136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80db7fe700 1 -- 172.21.15.89:0/920868229 >> v1:172.21.15.89:6789/0 conn(0x7f80dc09adf0 legacy=0x7f80dc132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.360+0000 7f80db7fe700 1 -- 172.21.15.89:0/920868229 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc136aa0 con 0x7f80dc09aa10 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80db7fe700 1 --2- 172.21.15.89:0/920868229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 0x7f80dc0621e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f80cc002f70 tx=0x7f80cc006df0).ready entity=mon.1 client_cookie=1e8481e620c6e116 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80da7fc700 1 -- 172.21.15.89:0/920868229 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc00d570 con 0x7f80dc09aa10 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80da7fc700 1 -- 172.21.15.89:0/920868229 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc000e90 con 0x7f80dc09aa10 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80da7fc700 1 -- 172.21.15.89:0/920868229 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc00d8c0 con 0x7f80dc09aa10 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 -- 172.21.15.89:0/920868229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 msgr2=0x7f80dc0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 --2- 172.21.15.89:0/920868229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 0x7f80dc0621e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f80cc002f70 tx=0x7f80cc006df0).stop 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 -- 172.21.15.89:0/920868229 shutdown_connections 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 --2- 172.21.15.89:0/920868229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09aa10 0x7f80dc0621e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 --2- 172.21.15.89:0/920868229 >> v2:172.21.15.89:3300/0 conn(0x7f80dc064700 0x7f80dc136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 -- 172.21.15.89:0/920868229 >> 172.21.15.89:0/920868229 conn(0x7f80dc06c0c0 msgr2=0x7f80dc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 -- 172.21.15.89:0/920868229 shutdown_connections 2024-02-10T00:02:25.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.361+0000 7f80e2107700 1 -- 172.21.15.89:0/920868229 wait complete. 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.362+0000 7f80e2107700 1 Processor -- start 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 -- start start 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 0x7f80dc146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 0x7f80dc147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc067b80 con 0x7f80dc064700 2024-02-10T00:02:25.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc12f940 con 0x7f80dc09adf0 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80e2107700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc12ef00 con 0x7f80dc09aa10 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80dbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 0x7f80dc147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52542/0 (socket says 172.21.15.89:52542) 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80db7fe700 1 -- 172.21.15.89:0/404507307 learned_addr learned my addr 172.21.15.89:0/404507307 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.363+0000 7f80daffd700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 0x7f80dc146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 -- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 msgr2=0x7f80dc146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 0x7f80dc146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 -- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 msgr2=0x7f80dc067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 -- 172.21.15.89:0/404507307 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc00b180 con 0x7f80dc09adf0 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80db7fe700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80daffd700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 0x7f80dc146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80dbfff700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 0x7f80dc147150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f80dc09b960 tx=0x7f80d4007ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d400ce40 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d4005ba0 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0662e0 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d40070d0 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.364+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc12fdd0 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.365+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f80d4010070 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.365+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f80d4049ef0 con 0x7f80dc09adf0 2024-02-10T00:02:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.365+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc09b2a0 con 0x7f80dc09adf0 2024-02-10T00:02:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.368+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f80dc09b2a0 con 0x7f80dc09adf0 2024-02-10T00:02:25.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.479+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80dc09b2a0 con 0x7f80dc09adf0 2024-02-10T00:02:25.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.480+0000 7f80d8ff9700 1 -- 172.21.15.89:0/404507307 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80dc09b2a0 con 0x7f80dc09adf0 2024-02-10T00:02:25.482 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:02:25.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 >> v1:172.21.15.89:6816/39389 conn(0x7f80c0038da0 legacy=0x7f80c003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 msgr2=0x7f80dc147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 0x7f80dc147150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f80dc09b960 tx=0x7f80d4007ef0).stop 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 shutdown_connections 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80dc09adf0 0x7f80dc147150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80dc064700 0x7f80dc067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 --2- 172.21.15.89:0/404507307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f80dc09aa10 0x7f80dc146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 >> 172.21.15.89:0/404507307 conn(0x7f80dc06c0c0 msgr2=0x7f80dc12d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 shutdown_connections 2024-02-10T00:02:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.481+0000 7f80e2107700 1 -- 172.21.15.89:0/404507307 wait complete. 2024-02-10T00:02:25.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.595+0000 7f03acfcd700 1 Processor -- start 2024-02-10T00:02:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.595+0000 7f03acfcd700 1 -- start start 2024-02-10T00:02:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03acfcd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a81337e0 0x7f03a8133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03acfcd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 0x7f03a8139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03acfcd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a8067990 con 0x7f03a8139d80 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03acfcd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80a4c50 con 0x7f03a8067570 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03acfcd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80a4f10 con 0x7f03a81337e0 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 0x7f03a8139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a6d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f03a8139d80 0x7f03a8140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35376/0 (socket says 172.21.15.89:35376) 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a6d9d700 1 -- 172.21.15.89:0/526633375 learned_addr learned my addr 172.21.15.89:0/526633375 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a659c700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a81337e0 0x7f03a8133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 -- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a81337e0 msgr2=0x7f03a8133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a81337e0 0x7f03a8133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 -- 172.21.15.89:0/526633375 >> v1:172.21.15.89:6789/0 conn(0x7f03a8139d80 legacy=0x7f03a8140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 -- 172.21.15.89:0/526633375 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8060520 con 0x7f03a8067570 2024-02-10T00:02:25.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.596+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 0x7f03a8139890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c006df0).ready entity=mon.1 client_cookie=c62f088f5afd021c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.598+0000 7f03a559a700 1 -- 172.21.15.89:0/526633375 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c00d570 con 0x7f03a8067570 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.598+0000 7f03a559a700 1 -- 172.21.15.89:0/526633375 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c000e90 con 0x7f03a8067570 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.598+0000 7f03a559a700 1 -- 172.21.15.89:0/526633375 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c00d8c0 con 0x7f03a8067570 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.598+0000 7f03acfcd700 1 -- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 msgr2=0x7f03a8139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.598+0000 7f03acfcd700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 0x7f03a8139890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c006df0).stop 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 -- 172.21.15.89:0/526633375 shutdown_connections 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a81337e0 0x7f03a8133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 --2- 172.21.15.89:0/526633375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a8067570 0x7f03a8139890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 -- 172.21.15.89:0/526633375 >> 172.21.15.89:0/526633375 conn(0x7f03a80a93f0 msgr2=0x7f03a80a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 -- 172.21.15.89:0/526633375 shutdown_connections 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 -- 172.21.15.89:0/526633375 wait complete. 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 Processor -- start 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.599+0000 7f03acfcd700 1 -- start start 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 0x7f03a809c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03a8139d80 0x7f03a809cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a809f550 con 0x7f03a8139d80 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a809de30 con 0x7f03a81337e0 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03acfcd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a809e0f0 con 0x7f03a8067570 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41172/0 (socket says 172.21.15.89:41172) 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a659c700 1 -- 172.21.15.89:0/2614574552 learned_addr learned my addr 172.21.15.89:0/2614574552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a6d9d700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03a8139d80 0x7f03a809cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 0x7f03a809c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 -- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 msgr2=0x7f03a8092810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 -- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03a8139d80 msgr2=0x7f03a809cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03a8139d80 0x7f03a809cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a5d9b700 1 -- 172.21.15.89:0/2614574552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c00b180 con 0x7f03a81337e0 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.600+0000 7f03a659c700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03a5d9b700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 0x7f03a809c5c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f03a806c510 tx=0x7f039c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c013da0 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c01e400 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c01e760 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80a2760 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8092ec0 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.601+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f039c01c070 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.602+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f039c04b170 con 0x7f03a81337e0 2024-02-10T00:02:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.602+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8092ec0 con 0x7f03a81337e0 2024-02-10T00:02:25.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.605+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f03a8092ec0 con 0x7f03a81337e0 2024-02-10T00:02:25.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.745+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03a8092ec0 con 0x7f03a81337e0 2024-02-10T00:02:25.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.745+0000 7f03977fe700 1 -- 172.21.15.89:0/2614574552 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f03a8092ec0 con 0x7f03a81337e0 2024-02-10T00:02:25.748 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:25.748 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:01:04.433816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:25.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 >> v1:172.21.15.89:6816/39389 conn(0x7f0384038da0 legacy=0x7f038403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 msgr2=0x7f03a809c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 0x7f03a809c5c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f03a806c510 tx=0x7f039c014000).stop 2024-02-10T00:02:25.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 shutdown_connections 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03a8139d80 0x7f03a809cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f03a8067570 0x7f03a8092810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 --2- 172.21.15.89:0/2614574552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03a81337e0 0x7f03a809c5c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 >> 172.21.15.89:0/2614574552 conn(0x7f03a80a93f0 msgr2=0x7f03a80a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 shutdown_connections 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.746+0000 7f03acfcd700 1 -- 172.21.15.89:0/2614574552 wait complete. 2024-02-10T00:02:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 10 2024-02-10T00:02:25.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:02:25.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.858+0000 7fa1ac25e700 1 Processor -- start 2024-02-10T00:02:25.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.858+0000 7fa1ac25e700 1 -- start start 2024-02-10T00:02:25.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1ac25e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 0x7fa1a40a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1ac25e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1ac25e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a405d190 con 0x7fa1a40ac780 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1ac25e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a4136080 con 0x7fa1a405cd20 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1ac25e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4136340 con 0x7fa1a413e5c0 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1a97f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 0x7fa1a40a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1a9ffa700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa1a40ac780 0x7fa1a405d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35386/0 (socket says 172.21.15.89:35386) 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41182/0 (socket says 172.21.15.89:41182) 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1a9ffa700 1 -- 172.21.15.89:0/3348780851 learned_addr learned my addr 172.21.15.89:0/3348780851 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 -- 172.21.15.89:0/3348780851 >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 msgr2=0x7fa1a40a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 --2- 172.21.15.89:0/3348780851 >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 0x7fa1a40a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 -- 172.21.15.89:0/3348780851 >> v1:172.21.15.89:6789/0 conn(0x7fa1a40ac780 legacy=0x7fa1a405d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1aa7fb700 1 -- 172.21.15.89:0/3348780851 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a40a7880 con 0x7fa1a413e5c0 2024-02-10T00:02:25.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.859+0000 7fa1a97f9700 1 --2- 172.21.15.89:0/3348780851 >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 0x7fa1a40a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1aa7fb700 1 --2- 172.21.15.89:0/3348780851 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa19c0032f0 tx=0x7fa19c0091d0).ready entity=mon.2 client_cookie=cd8a8742cd45c5b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1a8ff8700 1 -- 172.21.15.89:0/3348780851 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19c00b6c0 con 0x7fa1a413e5c0 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1a8ff8700 1 -- 172.21.15.89:0/3348780851 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00b820 con 0x7fa1a413e5c0 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1a8ff8700 1 -- 172.21.15.89:0/3348780851 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19c00b990 con 0x7fa1a413e5c0 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 -- 172.21.15.89:0/3348780851 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 msgr2=0x7fa1a41409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/3348780851 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa19c0032f0 tx=0x7fa19c0091d0).stop 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 -- 172.21.15.89:0/3348780851 shutdown_connections 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/3348780851 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a413e5c0 0x7fa1a41409b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/3348780851 >> v2:172.21.15.89:3300/0 conn(0x7fa1a405cd20 0x7fa1a40a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 -- 172.21.15.89:0/3348780851 >> 172.21.15.89:0/3348780851 conn(0x7fa1a4067790 msgr2=0x7fa1a4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 -- 172.21.15.89:0/3348780851 shutdown_connections 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.860+0000 7fa1ac25e700 1 -- 172.21.15.89:0/3348780851 wait complete. 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.861+0000 7fa1ac25e700 1 Processor -- start 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.861+0000 7fa1ac25e700 1 -- start start 2024-02-10T00:02:25.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1a405cd20 0x7fa1a41399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 0x7fa1a413ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4138ff0 con 0x7fa1a413e5c0 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4139ea0 con 0x7fa1a405cd20 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a41373a0 con 0x7fa1a40ac780 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41196/0 (socket says 172.21.15.89:41196) 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1aa7fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 0x7fa1a413ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 -- 172.21.15.89:0/2940338734 learned_addr learned my addr 172.21.15.89:0/2940338734 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a9ffa700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1a405cd20 0x7fa1a41399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 -- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1a405cd20 msgr2=0x7fa1a41399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1a405cd20 0x7fa1a41399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 -- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 msgr2=0x7fa1a413ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 0x7fa1a413ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 -- 172.21.15.89:0/2940338734 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a000b180 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1aa7fb700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 0x7fa1a413ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1a97f9700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa1a000c000 tx=0x7fa1a0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a0010590 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00106f0 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a0010a50 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c009470 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.862+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a4137060 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.863+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa1a0010bb0 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.864+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa1a004ad30 con 0x7fa1a40ac780 2024-02-10T00:02:25.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.864+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a41388b0 con 0x7fa1a40ac780 2024-02-10T00:02:25.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.867+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa1a0033660 con 0x7fa1a40ac780 2024-02-10T00:02:25.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.978+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a4057a60 con 0x7fa1a40ac780 2024-02-10T00:02:25.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.979+0000 7fa192ffd700 1 -- 172.21.15.89:0/2940338734 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7fa1a0033250 con 0x7fa1a40ac780 2024-02-10T00:02:25.981 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:25.981 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:39.397746+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-10T00:02:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 >> v1:172.21.15.89:6816/39389 conn(0x7fa184038ec0 legacy=0x7fa18403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 msgr2=0x7fa1a413b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa1a000c000 tx=0x7fa1a0006df0).stop 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 shutdown_connections 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a413e5c0 0x7fa1a413ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1a405cd20 0x7fa1a41399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 --2- 172.21.15.89:0/2940338734 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1a40ac780 0x7fa1a413b530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 >> 172.21.15.89:0/2940338734 conn(0x7fa1a4067790 msgr2=0x7fa1a405d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 shutdown_connections 2024-02-10T00:02:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:25.980+0000 7fa1ac25e700 1 -- 172.21.15.89:0/2940338734 wait complete. 2024-02-10T00:02:25.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-10T00:02:26.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.095+0000 7f5996d91700 1 Processor -- start 2024-02-10T00:02:26.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.095+0000 7f5996d91700 1 -- start start 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.095+0000 7f5996d91700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.095+0000 7f5996d91700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 0x7f5990136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5996d91700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599009b2a0 con 0x7f599009adf0 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5996d91700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599009bc50 con 0x7f5990064700 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5996d91700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59901367e0 con 0x7f599009aa10 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f598ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 0x7f5990136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41210/0 (socket says 172.21.15.89:41210) 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 -- 172.21.15.89:0/4022860505 learned_addr learned my addr 172.21.15.89:0/4022860505 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f599532e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f599009adf0 0x7f5990132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35390/0 (socket says 172.21.15.89:35390) 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 -- 172.21.15.89:0/4022860505 >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 msgr2=0x7f5990136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 --2- 172.21.15.89:0/4022860505 >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 0x7f5990136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 -- 172.21.15.89:0/4022860505 >> v1:172.21.15.89:6789/0 conn(0x7f599009adf0 legacy=0x7f5990132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 -- 172.21.15.89:0/4022860505 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990136aa0 con 0x7f599009aa10 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f598ffff700 1 --2- 172.21.15.89:0/4022860505 >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 0x7f5990136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f5994b2d700 1 --2- 172.21.15.89:0/4022860505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5984002f70 tx=0x7f5984006eb0).ready entity=mon.2 client_cookie=d8603277c5a6f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f598f7fe700 1 -- 172.21.15.89:0/4022860505 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598400d570 con 0x7f599009aa10 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f598f7fe700 1 -- 172.21.15.89:0/4022860505 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984000e90 con 0x7f599009aa10 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.096+0000 7f598f7fe700 1 -- 172.21.15.89:0/4022860505 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598400d900 con 0x7f599009aa10 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 -- 172.21.15.89:0/4022860505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 msgr2=0x7f59900621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 --2- 172.21.15.89:0/4022860505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5984002f70 tx=0x7f5984006eb0).stop 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 -- 172.21.15.89:0/4022860505 shutdown_connections 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 --2- 172.21.15.89:0/4022860505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59900621e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 --2- 172.21.15.89:0/4022860505 >> v2:172.21.15.89:3300/0 conn(0x7f5990064700 0x7f5990136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 -- 172.21.15.89:0/4022860505 >> 172.21.15.89:0/4022860505 conn(0x7f599006c0c0 msgr2=0x7f599006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 -- 172.21.15.89:0/4022860505 shutdown_connections 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.097+0000 7f5996d91700 1 -- 172.21.15.89:0/4022860505 wait complete. 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 Processor -- start 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 -- start start 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 0x7f5990065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990097c50 con 0x7f599009adf0 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5990066230 con 0x7f5990064700 2024-02-10T00:02:26.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5996d91700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5990148e70 con 0x7f599009aa10 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f598ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f599532e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5994b2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 0x7f5990065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f598ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41212/0 (socket says 172.21.15.89:41212) 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f598ffff700 1 -- 172.21.15.89:0/3633798419 learned_addr learned my addr 172.21.15.89:0/3633798419 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f599532e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52582/0 (socket says 172.21.15.89:52582) 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.098+0000 7f5994b2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 0x7f5990065790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51144/0 (socket says 172.21.15.89:51144) 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 -- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 msgr2=0x7f5990065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 0x7f5990065790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 -- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 msgr2=0x7f59901495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 -- 172.21.15.89:0/3633798419 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c00d3b0 con 0x7f599009aa10 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f599532e700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598ffff700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f597c00e000 tx=0x7f597c006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:26.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597c00ee10 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c00ccc0 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598400b1e0 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597c010630 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.099+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5990065c80 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.100+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f597c010790 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.100+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990057a60 con 0x7f599009aa10 2024-02-10T00:02:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.100+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f597c04abc0 con 0x7f599009aa10 2024-02-10T00:02:26.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.103+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f597c02fa20 con 0x7f599009aa10 2024-02-10T00:02:26.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.242+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5990060880 con 0x7f599009aa10 2024-02-10T00:02:26.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.602+0000 7f598dffb700 1 -- 172.21.15.89:0/3633798419 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f597c033040 con 0x7f599009aa10 2024-02-10T00:02:26.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 >> v1:172.21.15.89:6816/39389 conn(0x7f5970038dd0 legacy=0x7f597003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 msgr2=0x7f59901490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f597c00e000 tx=0x7f597c006e20).stop 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 shutdown_connections 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f599009adf0 0x7f59901495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5990064700 0x7f5990065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 --2- 172.21.15.89:0/3633798419 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f599009aa10 0x7f59901490f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 >> 172.21.15.89:0/3633798419 conn(0x7f599006c0c0 msgr2=0x7f59901302e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 shutdown_connections 2024-02-10T00:02:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.604+0000 7f5996d91700 1 -- 172.21.15.89:0/3633798419 wait complete. 2024-02-10T00:02:26.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-02-10T00:02:26.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.723+0000 7f3b74532700 1 Processor -- start 2024-02-10T00:02:26.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.723+0000 7f3b74532700 1 -- start start 2024-02-10T00:02:26.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b74532700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 0x7f3b6c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b74532700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 0x7f3b6c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b74532700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c067990 con 0x7f3b6c139d80 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b74532700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0a4c50 con 0x7f3b6c1337e0 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b74532700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0a4f10 con 0x7f3b6c067570 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b71acd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 0x7f3b6c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b722ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 0x7f3b6c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b72acf700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3b6c139d80 0x7f3b6c140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35400/0 (socket says 172.21.15.89:35400) 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b72acf700 1 -- 172.21.15.89:0/1859309949 learned_addr learned my addr 172.21.15.89:0/1859309949 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:26.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.724+0000 7f3b712cc700 1 -- 172.21.15.89:0/1859309949 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148961981 0 0) 0x7f3b6c067990 con 0x7f3b6c139d80 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b712cc700 1 -- 172.21.15.89:0/1859309949 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b54003260 con 0x7f3b6c139d80 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b71acd700 1 -- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 msgr2=0x7f3b6c133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b71acd700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 0x7f3b6c133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b71acd700 1 -- 172.21.15.89:0/1859309949 >> v1:172.21.15.89:6789/0 conn(0x7f3b6c139d80 legacy=0x7f3b6c140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b71acd700 1 -- 172.21.15.89:0/1859309949 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c060520 con 0x7f3b6c067570 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b722ce700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 0x7f3b6c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b71acd700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 0x7f3b6c139890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3b68002f70 tx=0x7f3b68006df0).ready entity=mon.2 client_cookie=cf7c50dc175358e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b712cc700 1 -- 172.21.15.89:0/1859309949 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6800d570 con 0x7f3b6c067570 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b712cc700 1 -- 172.21.15.89:0/1859309949 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68000e90 con 0x7f3b6c067570 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b712cc700 1 -- 172.21.15.89:0/1859309949 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6800d8c0 con 0x7f3b6c067570 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 -- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 msgr2=0x7f3b6c139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 0x7f3b6c139890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3b68002f70 tx=0x7f3b68006df0).stop 2024-02-10T00:02:26.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 -- 172.21.15.89:0/1859309949 shutdown_connections 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c1337e0 0x7f3b6c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 --2- 172.21.15.89:0/1859309949 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c067570 0x7f3b6c139890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 -- 172.21.15.89:0/1859309949 >> 172.21.15.89:0/1859309949 conn(0x7f3b6c0a93f0 msgr2=0x7f3b6c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 -- 172.21.15.89:0/1859309949 shutdown_connections 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.725+0000 7f3b74532700 1 -- 172.21.15.89:0/1859309949 wait complete. 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.726+0000 7f3b74532700 1 Processor -- start 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.726+0000 7f3b74532700 1 -- start start 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c067570 0x7f3b6c09d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 0x7f3b6c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c09f430 con 0x7f3b6c1337e0 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0a12b0 con 0x7f3b6c067570 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b74532700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c09df70 con 0x7f3b6c139d80 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b71acd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 0x7f3b6c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b722ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c067570 0x7f3b6c09d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41224/0 (socket says 172.21.15.89:41224) 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 -- 172.21.15.89:0/3212853051 learned_addr learned my addr 172.21.15.89:0/3212853051 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b71acd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 0x7f3b6c148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52598/0 (socket says 172.21.15.89:52598) 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 -- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c067570 msgr2=0x7f3b6c09d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c067570 0x7f3b6c09d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 -- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 msgr2=0x7f3b6c148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 0x7f3b6c148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 -- 172.21.15.89:0/3212853051 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c00b180 con 0x7f3b6c139d80 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b72acf700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3b6c09cc10 tx=0x7f3b64007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.727+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64005ba0 con 0x7f3b6c139d80 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.728+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64005d00 con 0x7f3b6c139d80 2024-02-10T00:02:26.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.728+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6800b180 con 0x7f3b6c139d80 2024-02-10T00:02:26.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.728+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b640072c0 con 0x7f3b6c139d80 2024-02-10T00:02:26.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.728+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c09bc80 con 0x7f3b6c139d80 2024-02-10T00:02:26.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.729+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3b64010070 con 0x7f3b6c139d80 2024-02-10T00:02:26.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.729+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c065a50 con 0x7f3b6c139d80 2024-02-10T00:02:26.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.729+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3b6404a1b0 con 0x7f3b6c139d80 2024-02-10T00:02:26.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.732+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3b6402f0f0 con 0x7f3b6c139d80 2024-02-10T00:02:26.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:26.874+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f3b6c057a60 con 0x7f3b6c139d80 2024-02-10T00:02:27.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.606+0000 7f3b5b7fe700 1 -- 172.21.15.89:0/3212853051 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v12) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3b640326d0 con 0x7f3b6c139d80 2024-02-10T00:02:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.608+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 >> v1:172.21.15.89:6816/39389 conn(0x7f3b4c038dd0 legacy=0x7f3b4c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.608+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 msgr2=0x7f3b6c1492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.608+0000 7f3b74532700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3b6c09cc10 tx=0x7f3b64007e00).stop 2024-02-10T00:02:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 shutdown_connections 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3b6c139d80 0x7f3b6c1492a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b6c067570 0x7f3b6c09d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 --2- 172.21.15.89:0/3212853051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b6c1337e0 0x7f3b6c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 >> 172.21.15.89:0/3212853051 conn(0x7f3b6c0a93f0 msgr2=0x7f3b6c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 shutdown_connections 2024-02-10T00:02:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.609+0000 7f3b74532700 1 -- 172.21.15.89:0/3212853051 wait complete. 2024-02-10T00:02:27.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:27.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.728+0000 7fae26779700 1 Processor -- start 2024-02-10T00:02:27.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.728+0000 7fae26779700 1 -- start start 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 0x7fae2009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2009a380 con 0x7fae201366f0 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20135fe0 con 0x7fae20099a00 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae26779700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae20099e90 con 0x7fae2009b520 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51164/0 (socket says 172.21.15.89:51164) 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41234/0 (socket says 172.21.15.89:41234) 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 -- 172.21.15.89:0/1596997011 learned_addr learned my addr 172.21.15.89:0/1596997011 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1ffff700 1 --2- 172.21.15.89:0/1596997011 >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 0x7fae2009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 -- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 msgr2=0x7fae20136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 -- 172.21.15.89:0/1596997011 >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 msgr2=0x7fae2009bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 --2- 172.21.15.89:0/1596997011 >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 0x7fae2009bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 -- 172.21.15.89:0/1596997011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2009a0c0 con 0x7fae20099a00 2024-02-10T00:02:27.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1ffff700 1 --2- 172.21.15.89:0/1596997011 >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 0x7fae2009bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:27.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1f7fe700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:27.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae24d16700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fae180032f0 tx=0x7fae18009290).ready entity=mon.1 client_cookie=64f576f24ad3e7c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:27.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1effd700 1 -- 172.21.15.89:0/1596997011 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800b6c0 con 0x7fae20099a00 2024-02-10T00:02:27.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1effd700 1 -- 172.21.15.89:0/1596997011 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800b820 con 0x7fae20099a00 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.729+0000 7fae1effd700 1 -- 172.21.15.89:0/1596997011 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800b990 con 0x7fae20099a00 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 -- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 msgr2=0x7fae20139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fae180032f0 tx=0x7fae18009290).stop 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 -- 172.21.15.89:0/1596997011 shutdown_connections 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae20099a00 0x7fae20139530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 --2- 172.21.15.89:0/1596997011 >> v2:172.21.15.89:3300/0 conn(0x7fae201366f0 0x7fae2009bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 --2- 172.21.15.89:0/1596997011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae2009b520 0x7fae20136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 -- 172.21.15.89:0/1596997011 >> 172.21.15.89:0/1596997011 conn(0x7fae2006c0c0 msgr2=0x7fae2006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 -- 172.21.15.89:0/1596997011 shutdown_connections 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.730+0000 7fae26779700 1 -- 172.21.15.89:0/1596997011 wait complete. 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 Processor -- start 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 -- start start 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae20099a00 0x7fae20097830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 0x7fae20148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae20096f10 con 0x7fae2009b520 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20097110 con 0x7fae201366f0 2024-02-10T00:02:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae26779700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae20094f40 con 0x7fae20099a00 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae24d16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.731+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 0x7fae20148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51176/0 (socket says 172.21.15.89:51176) 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 -- 172.21.15.89:0/2871277185 learned_addr learned my addr 172.21.15.89:0/2871277185 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae1ffff700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae20099a00 0x7fae20097830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 -- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae20099a00 msgr2=0x7fae20097830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae20099a00 0x7fae20097830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 -- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 msgr2=0x7fae20148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 0x7fae20148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 -- 172.21.15.89:0/2871277185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1000b120 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae1f7fe700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 0x7fae20148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae24d16700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fae180032f0 tx=0x7fae18016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800b6c0 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800b030 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae18021670 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1400b180 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.732+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae18009530 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.733+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fae1800f070 con 0x7fae201366f0 2024-02-10T00:02:27.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.733+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20067cb0 con 0x7fae201366f0 2024-02-10T00:02:27.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.733+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fae1804b9d0 con 0x7fae201366f0 2024-02-10T00:02:27.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.736+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fae18022250 con 0x7fae201366f0 2024-02-10T00:02:27.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.875+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae20057a60 con 0x7fae201366f0 2024-02-10T00:02:27.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.875+0000 7fae1d7fa700 1 -- 172.21.15.89:0/2871277185 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7fae18026020 con 0x7fae201366f0 2024-02-10T00:02:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:27.878 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 >> v1:172.21.15.89:6816/39389 conn(0x7fae00038e30 legacy=0x7fae0003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 msgr2=0x7fae20149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fae180032f0 tx=0x7fae18016000).stop 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 shutdown_connections 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae201366f0 0x7fae20149160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae20099a00 0x7fae20097830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 --2- 172.21.15.89:0/2871277185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae2009b520 0x7fae20148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 >> 172.21.15.89:0/2871277185 conn(0x7fae2006c0c0 msgr2=0x7fae20133310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.876+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 shutdown_connections 2024-02-10T00:02:27.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:27.877+0000 7fae26779700 1 -- 172.21.15.89:0/2871277185 wait complete. 2024-02-10T00:02:27.881 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:28.191 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:28.191 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:29.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.303+0000 7f8ce0614700 1 Processor -- start 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.303+0000 7f8ce0614700 1 -- start start 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8ce0614700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8ce0614700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 0x7f8cd813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8ce0614700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8063520 con 0x7f8cd8063c30 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8ce0614700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd8134310 con 0x7f8cd813c690 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8ce0614700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8063750 con 0x7f8cd8133e30 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:29.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cdebb1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 0x7f8cd813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41248/0 (socket says 172.21.15.89:41248) 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cde3b0700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8cd8063c30 0x7f8cd8134730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35404/0 (socket says 172.21.15.89:35404) 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cdebb1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 0x7f8cd813ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52630/0 (socket says 172.21.15.89:52630) 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3054353669 learned_addr learned my addr 172.21.15.89:0/3054353669 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3054353669 >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 msgr2=0x7f8cd813ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 --2- 172.21.15.89:0/3054353669 >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 0x7f8cd813ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.304+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3054353669 >> v1:172.21.15.89:6789/0 conn(0x7f8cd8063c30 legacy=0x7f8cd8134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3054353669 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8063a10 con 0x7f8cd8133e30 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8cddbaf700 1 --2- 172.21.15.89:0/3054353669 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8cd806ce40 tx=0x7f8cc8006e50).ready entity=mon.2 client_cookie=6de62cad8d676ba0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8cdd3ae700 1 -- 172.21.15.89:0/3054353669 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc800d5c0 con 0x7f8cd8133e30 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8cdd3ae700 1 -- 172.21.15.89:0/3054353669 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8000e90 con 0x7f8cd8133e30 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8cdd3ae700 1 -- 172.21.15.89:0/3054353669 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc800d950 con 0x7f8cd8133e30 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 -- 172.21.15.89:0/3054353669 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 msgr2=0x7f8cd8064010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3054353669 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8cd806ce40 tx=0x7f8cc8006e50).stop 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 -- 172.21.15.89:0/3054353669 shutdown_connections 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3054353669 >> v2:172.21.15.89:3300/0 conn(0x7f8cd813c690 0x7f8cd813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3054353669 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8133e30 0x7f8cd8064010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 -- 172.21.15.89:0/3054353669 >> 172.21.15.89:0/3054353669 conn(0x7f8cd806c0c0 msgr2=0x7f8cd806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 -- 172.21.15.89:0/3054353669 shutdown_connections 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.305+0000 7f8ce0614700 1 -- 172.21.15.89:0/3054353669 wait complete. 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.306+0000 7f8ce0614700 1 Processor -- start 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.306+0000 7f8ce0614700 1 -- start start 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 0x7f8cd8096740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 0x7f8cd812cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80985a0 con 0x7f8cd8133e30 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8097270 con 0x7f8cd813c690 2024-02-10T00:02:29.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80974c0 con 0x7f8cd8063c30 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cde3b0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 0x7f8cd8096740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52646/0 (socket says 172.21.15.89:52646) 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3926130629 learned_addr learned my addr 172.21.15.89:0/3926130629 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cdebb1700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 0x7f8cd812cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 msgr2=0x7f8cd8096740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 0x7f8cd8096740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 msgr2=0x7f8cd812cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 0x7f8cd812cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 -- 172.21.15.89:0/3926130629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc800b1e0 con 0x7f8cd8133e30 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cde3b0700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 0x7f8cd8096740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cdebb1700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 0x7f8cd812cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cddbaf700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8cd806ce40 tx=0x7f8cc8012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:29.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc8002f70 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8006850 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd8067c30 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.307+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc8012dd0 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.308+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd813b4d0 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.308+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8cc801b070 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.309+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd809ad00 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.309+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8cc804afe0 con 0x7f8cd8133e30 2024-02-10T00:02:29.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.312+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8cd809ad00 con 0x7f8cd8133e30 2024-02-10T00:02:29.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.456+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cd809ad00 con 0x7f8cd8133e30 2024-02-10T00:02:29.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.457+0000 7f8cc77fe700 1 -- 172.21.15.89:0/3926130629 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f8cd809ad00 con 0x7f8cd8133e30 2024-02-10T00:02:29.461 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:29.461 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 >> v1:172.21.15.89:6816/39389 conn(0x7f8cb8038da0 legacy=0x7f8cb803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 msgr2=0x7f8cd812c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8cd806ce40 tx=0x7f8cc8012000).stop 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 shutdown_connections 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cd813c690 0x7f8cd812cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8cd8063c30 0x7f8cd8096740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 --2- 172.21.15.89:0/3926130629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cd8133e30 0x7f8cd812c9d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 >> 172.21.15.89:0/3926130629 conn(0x7f8cd806c0c0 msgr2=0x7f8cd8131280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 shutdown_connections 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:29.458+0000 7f8ce0614700 1 -- 172.21.15.89:0/3926130629 wait complete. 2024-02-10T00:02:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:29.773 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:29.773 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:30.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.886+0000 7f60ae570700 1 Processor -- start 2024-02-10T00:02:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.886+0000 7f60ae570700 1 -- start start 2024-02-10T00:02:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 0x7f60a8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a809a380 con 0x7f60a809b520 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8135fe0 con 0x7f60a8099a00 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60ae570700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8099eb0 con 0x7f60a81366f0 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60acb0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60a77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 0x7f60a8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41278/0 (socket says 172.21.15.89:41278) 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60acb0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51194/0 (socket says 172.21.15.89:51194) 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60a7fff700 1 -- 172.21.15.89:0/4246381373 learned_addr learned my addr 172.21.15.89:0/4246381373 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.887+0000 7f60a7fff700 1 -- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 msgr2=0x7f60a8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:30.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a7fff700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a7fff700 1 -- 172.21.15.89:0/4246381373 >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 msgr2=0x7f60a8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a7fff700 1 --2- 172.21.15.89:0/4246381373 >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 0x7f60a8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a7fff700 1 -- 172.21.15.89:0/4246381373 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a809a0c0 con 0x7f60a81366f0 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60acb0d700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a77fe700 1 --2- 172.21.15.89:0/4246381373 >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 0x7f60a8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a7fff700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6090002f70 tx=0x7f6090006eb0).ready entity=mon.2 client_cookie=2f620bccde7baa server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a6ffd700 1 -- 172.21.15.89:0/4246381373 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609000d570 con 0x7f60a81366f0 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a6ffd700 1 -- 172.21.15.89:0/4246381373 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6090000e90 con 0x7f60a81366f0 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60a6ffd700 1 -- 172.21.15.89:0/4246381373 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609000d900 con 0x7f60a81366f0 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 -- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 msgr2=0x7f60a809bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6090002f70 tx=0x7f6090006eb0).stop 2024-02-10T00:02:30.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 -- 172.21.15.89:0/4246381373 shutdown_connections 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 --2- 172.21.15.89:0/4246381373 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a81366f0 0x7f60a809bbb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 --2- 172.21.15.89:0/4246381373 >> v2:172.21.15.89:3300/0 conn(0x7f60a809b520 0x7f60a8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 -- 172.21.15.89:0/4246381373 >> 172.21.15.89:0/4246381373 conn(0x7f60a806c0c0 msgr2=0x7f60a806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 -- 172.21.15.89:0/4246381373 shutdown_connections 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.888+0000 7f60ae570700 1 -- 172.21.15.89:0/4246381373 wait complete. 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.889+0000 7f60ae570700 1 Processor -- start 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.889+0000 7f60ae570700 1 -- start start 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 0x7f60a8096b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8098570 con 0x7f60a81366f0 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8094ab0 con 0x7f60a8099a00 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60ae570700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8149a10 con 0x7f60a809b520 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51196/0 (socket says 172.21.15.89:51196) 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 0x7f60a8096b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a7fff700 1 -- 172.21.15.89:0/3095358682 learned_addr learned my addr 172.21.15.89:0/3095358682 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41282/0 (socket says 172.21.15.89:41282) 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 -- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 msgr2=0x7f60a8096680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 -- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 msgr2=0x7f60a8148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60acb0d700 1 -- 172.21.15.89:0/3095358682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0009470 con 0x7f60a81366f0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a7fff700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.890+0000 7f60a77fe700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60acb0d700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 0x7f60a8096b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f60a000c000 tx=0x7f60a00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a000ee60 con 0x7f60a81366f0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000c850 con 0x7f60a81366f0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a000cbb0 con 0x7f60a81366f0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609800b120 con 0x7f60a81366f0 2024-02-10T00:02:30.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.891+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609000b1e0 con 0x7f60a81366f0 2024-02-10T00:02:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.892+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f60a0022070 con 0x7f60a81366f0 2024-02-10T00:02:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.892+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a8098f10 con 0x7f60a81366f0 2024-02-10T00:02:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.892+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f60a004afd0 con 0x7f60a81366f0 2024-02-10T00:02:30.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:30.895+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f60a006c7c0 con 0x7f60a81366f0 2024-02-10T00:02:31.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.035+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a8057a60 con 0x7f60a81366f0 2024-02-10T00:02:31.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.036+0000 7f60a57fa700 1 -- 172.21.15.89:0/3095358682 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f60a0016020 con 0x7f60a81366f0 2024-02-10T00:02:31.038 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:31.038 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 >> v1:172.21.15.89:6816/39389 conn(0x7f608c038da0 legacy=0x7f608c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 msgr2=0x7f60a8096b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 0x7f60a8096b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f60a000c000 tx=0x7f60a00091d0).stop 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 shutdown_connections 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60a81366f0 0x7f60a8096b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60a8099a00 0x7f60a8148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 --2- 172.21.15.89:0/3095358682 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f60a809b520 0x7f60a8096680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 >> 172.21.15.89:0/3095358682 conn(0x7f60a806c0c0 msgr2=0x7f60a8133310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 shutdown_connections 2024-02-10T00:02:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:31.037+0000 7f60ae570700 1 -- 172.21.15.89:0/3095358682 wait complete. 2024-02-10T00:02:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:31.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:31.353 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:32.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:32.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.466+0000 7f6aa3729700 1 Processor -- start 2024-02-10T00:02:32.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.466+0000 7f6aa3729700 1 -- start start 2024-02-10T00:02:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa3729700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa3729700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a9c139fa0 0x7f6a9c141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa3729700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c067990 con 0x7f6a9c067570 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa3729700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0a4c50 con 0x7f6a9c139fa0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa3729700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0a4f10 con 0x7f6a9c1337e0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa1cc6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a9c139fa0 0x7f6a9c141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa0cc4700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6a9c067570 0x7f6a9c139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35410/0 (socket says 172.21.15.89:35410) 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa0cc4700 1 -- 172.21.15.89:0/269554025 learned_addr learned my addr 172.21.15.89:0/269554025 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41284/0 (socket says 172.21.15.89:41284) 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 -- 172.21.15.89:0/269554025 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c139fa0 msgr2=0x7f6a9c141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 --2- 172.21.15.89:0/269554025 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c139fa0 0x7f6a9c141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 -- 172.21.15.89:0/269554025 >> v1:172.21.15.89:6789/0 conn(0x7f6a9c067570 legacy=0x7f6a9c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 -- 172.21.15.89:0/269554025 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c060520 con 0x7f6a9c1337e0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.467+0000 7f6aa14c5700 1 --2- 172.21.15.89:0/269554025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6a8c002f70 tx=0x7f6a8c006df0).ready entity=mon.2 client_cookie=cdfda03854509d9e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6a8bfff700 1 -- 172.21.15.89:0/269554025 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00d570 con 0x7f6a9c1337e0 2024-02-10T00:02:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6a8bfff700 1 -- 172.21.15.89:0/269554025 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c000e90 con 0x7f6a9c1337e0 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6a8bfff700 1 -- 172.21.15.89:0/269554025 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00d8c0 con 0x7f6a9c1337e0 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 -- 172.21.15.89:0/269554025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 msgr2=0x7f6a9c133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 --2- 172.21.15.89:0/269554025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6a8c002f70 tx=0x7f6a8c006df0).stop 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 -- 172.21.15.89:0/269554025 shutdown_connections 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 --2- 172.21.15.89:0/269554025 >> v2:172.21.15.89:3300/0 conn(0x7f6a9c139fa0 0x7f6a9c141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 --2- 172.21.15.89:0/269554025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c133bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 -- 172.21.15.89:0/269554025 >> 172.21.15.89:0/269554025 conn(0x7f6a9c0a93f0 msgr2=0x7f6a9c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 -- 172.21.15.89:0/269554025 shutdown_connections 2024-02-10T00:02:32.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.468+0000 7f6aa3729700 1 -- 172.21.15.89:0/269554025 wait complete. 2024-02-10T00:02:32.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.469+0000 7f6aa3729700 1 Processor -- start 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.469+0000 7f6aa3729700 1 -- start start 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c0a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0a17e0 con 0x7f6a9c139fa0 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0a0050 con 0x7f6a9c067570 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c092030 con 0x7f6a9c1337e0 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa14c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa14c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51208/0 (socket says 172.21.15.89:51208) 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa14c5700 1 -- 172.21.15.89:0/854445952 learned_addr learned my addr 172.21.15.89:0/854445952 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52680/0 (socket says 172.21.15.89:52680) 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa0cc4700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c0a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:32.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 -- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 msgr2=0x7f6a9c0a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c0a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 -- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 msgr2=0x7f6a9c0a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 -- 172.21.15.89:0/854445952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c00b180 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa14c5700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa1cc6700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6a9c0a84b0 tx=0x7f6a940091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a94012600 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94012760 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c09fa20 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.470+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a94012ac0 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.471+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c092f40 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.471+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6a94022070 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.472+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6a9404ad30 con 0x7f6a9c139fa0 2024-02-10T00:02:32.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.472+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c065a50 con 0x7f6a9c139fa0 2024-02-10T00:02:32.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.475+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6a94033660 con 0x7f6a9c139fa0 2024-02-10T00:02:32.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.614+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a9c057a60 con 0x7f6a9c139fa0 2024-02-10T00:02:32.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.615+0000 7f6a8a7fc700 1 -- 172.21.15.89:0/854445952 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f6a94033250 con 0x7f6a9c139fa0 2024-02-10T00:02:32.617 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:32.617 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:32.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 >> v1:172.21.15.89:6816/39389 conn(0x7f6a7c038da0 legacy=0x7f6a7c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 msgr2=0x7f6a9c149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6a9c0a84b0 tx=0x7f6a940091d0).stop 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 shutdown_connections 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c139fa0 0x7f6a9c149370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a9c067570 0x7f6a9c0a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 --2- 172.21.15.89:0/854445952 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6a9c1337e0 0x7f6a9c0a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 >> 172.21.15.89:0/854445952 conn(0x7f6a9c0a93f0 msgr2=0x7f6a9c05b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 shutdown_connections 2024-02-10T00:02:32.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:32.616+0000 7f6aa3729700 1 -- 172.21.15.89:0/854445952 wait complete. 2024-02-10T00:02:32.620 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:32.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:32.932 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:33.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:34.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.047+0000 7fdac6c8e700 1 Processor -- start 2024-02-10T00:02:34.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.047+0000 7fdac6c8e700 1 -- start start 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdac009adf0 0x7fdac0132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac009b2a0 con 0x7fdac009adf0 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac009bc50 con 0x7fdac0064700 2024-02-10T00:02:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac6c8e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01367e0 con 0x7fdac009aa10 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdac009adf0 0x7fdac0132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac4a2a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdac009adf0 0x7fdac0132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52688/0 (socket says 172.21.15.89:52688) 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51216/0 (socket says 172.21.15.89:51216) 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 -- 172.21.15.89:0/3253520585 learned_addr learned my addr 172.21.15.89:0/3253520585 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac4a2a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41304/0 (socket says 172.21.15.89:41304) 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 -- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 msgr2=0x7fdac00621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 -- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 msgr2=0x7fdac0136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 -- 172.21.15.89:0/3253520585 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0136aa0 con 0x7fdac009adf0 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabffff700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac4a2a700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:34.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdac522b700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac009adf0 0x7fdac0132c40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdab80032f0 tx=0x7fdab8009290).ready entity=mon.0 client_cookie=690430fb00484d85 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabf7fe700 1 -- 172.21.15.89:0/3253520585 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab800b6c0 con 0x7fdac009adf0 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabf7fe700 1 -- 172.21.15.89:0/3253520585 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800b820 con 0x7fdac009adf0 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.048+0000 7fdabf7fe700 1 -- 172.21.15.89:0/3253520585 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab800b990 con 0x7fdac009adf0 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 -- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac009adf0 msgr2=0x7fdac0132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac009adf0 0x7fdac0132c40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdab80032f0 tx=0x7fdab8009290).stop 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 -- 172.21.15.89:0/3253520585 shutdown_connections 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac009adf0 0x7fdac0132c40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009aa10 0x7fdac00621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/3253520585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac0064700 0x7fdac0136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 -- 172.21.15.89:0/3253520585 >> 172.21.15.89:0/3253520585 conn(0x7fdac006c0c0 msgr2=0x7fdac006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 -- 172.21.15.89:0/3253520585 shutdown_connections 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.049+0000 7fdac6c8e700 1 -- 172.21.15.89:0/3253520585 wait complete. 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.050+0000 7fdac6c8e700 1 Processor -- start 2024-02-10T00:02:34.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.050+0000 7fdac6c8e700 1 -- start start 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac009aa10 0x7fdac012edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0097fd0 con 0x7fdac0064700 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00988e0 con 0x7fdac009aa10 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0098ba0 con 0x7fdac009adf0 2024-02-10T00:02:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac4a2a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:41320/0 (socket says 172.21.15.89:41320) 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 -- 172.21.15.89:0/439598552 learned_addr learned my addr 172.21.15.89:0/439598552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdabffff700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac009aa10 0x7fdac012edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac4a2a700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52700/0 (socket says 172.21.15.89:52700) 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 -- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac009aa10 msgr2=0x7fdac012edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac009aa10 0x7fdac012edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 -- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 msgr2=0x7fdac0097400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 -- 172.21.15.89:0/439598552 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac00d3b0 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac4a2a700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac522b700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdab80032f0 tx=0x7fdab8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab800b6c0 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab8021670 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab400b180 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab800bee0 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.051+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8009530 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.052+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdab800f070 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.052+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0098ba0 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.052+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdab804b3a0 con 0x7fdac009adf0 2024-02-10T00:02:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.055+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdab8024b80 con 0x7fdac009adf0 2024-02-10T00:02:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.194+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac00968e0 con 0x7fdac009adf0 2024-02-10T00:02:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.195+0000 7fdabdffb700 1 -- 172.21.15.89:0/439598552 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7fdab8015020 con 0x7fdac009adf0 2024-02-10T00:02:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:34.197 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 >> v1:172.21.15.89:6816/39389 conn(0x7fdaa0038da0 legacy=0x7fdaa003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 msgr2=0x7fdac012f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdab80032f0 tx=0x7fdab8016000).stop 2024-02-10T00:02:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 shutdown_connections 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdac009adf0 0x7fdac012f2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac0064700 0x7fdac0097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 --2- 172.21.15.89:0/439598552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac009aa10 0x7fdac012edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 >> 172.21.15.89:0/439598552 conn(0x7fdac006c0c0 msgr2=0x7fdac006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 shutdown_connections 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:34.196+0000 7fdac6c8e700 1 -- 172.21.15.89:0/439598552 wait complete. 2024-02-10T00:02:34.199 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:34.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:34.510 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:35.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:35.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 Processor -- start 2024-02-10T00:02:35.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 -- start start 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09c813e5c0 0x7f09c81409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c805d160 con 0x7f09c80ac780 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.625+0000 7f09d065b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c8136080 con 0x7f09c813e5c0 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09d065b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8136340 con 0x7f09c805cd20 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cdbf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09c813e5c0 0x7f09c81409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09c813e5c0 0x7f09c81409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47470/0 (socket says 172.21.15.89:47470) 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09ce3f7700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f09c80ac780 0x7f09c805d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40962/0 (socket says 172.21.15.89:40962) 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 -- 172.21.15.89:0/3667233609 learned_addr learned my addr 172.21.15.89:0/3667233609 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cdbf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36892/0 (socket says 172.21.15.89:36892) 2024-02-10T00:02:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 -- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 msgr2=0x7f09c80a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 -- 172.21.15.89:0/3667233609 >> v1:172.21.15.89:6789/0 conn(0x7f09c80ac780 legacy=0x7f09c805d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 -- 172.21.15.89:0/3667233609 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c80a7880 con 0x7f09c813e5c0 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cdbf6700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cebf8700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c813e5c0 0x7f09c81409b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f09c00032f0 tx=0x7f09c0009290).ready entity=mon.0 client_cookie=c7f0ebf29464a92d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cd3f5700 1 -- 172.21.15.89:0/3667233609 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000b8a0 con 0x7f09c813e5c0 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cd3f5700 1 -- 172.21.15.89:0/3667233609 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000ba00 con 0x7f09c813e5c0 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.626+0000 7f09cd3f5700 1 -- 172.21.15.89:0/3667233609 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000bb70 con 0x7f09c813e5c0 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 -- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c813e5c0 msgr2=0x7f09c81409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c813e5c0 0x7f09c81409b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f09c00032f0 tx=0x7f09c0009290).stop 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 -- 172.21.15.89:0/3667233609 shutdown_connections 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c813e5c0 0x7f09c81409b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 --2- 172.21.15.89:0/3667233609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c805cd20 0x7f09c80a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 -- 172.21.15.89:0/3667233609 >> 172.21.15.89:0/3667233609 conn(0x7f09c8067790 msgr2=0x7f09c8067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 -- 172.21.15.89:0/3667233609 shutdown_connections 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.627+0000 7f09d065b700 1 -- 172.21.15.89:0/3667233609 wait complete. 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 Processor -- start 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 -- start start 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c805cd20 0x7f09c8131860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 0x7f09c8130350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8148880 con 0x7f09c80ac780 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8142fe0 con 0x7f09c813e5c0 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.628+0000 7f09d065b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8138540 con 0x7f09c805cd20 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cebf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 0x7f09c8130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cebf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36900/0 (socket says 172.21.15.89:36900) 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09ce3f7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c805cd20 0x7f09c8131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cebf8700 1 -- 172.21.15.89:0/3442876600 learned_addr learned my addr 172.21.15.89:0/3442876600 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 -- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c805cd20 msgr2=0x7f09c8131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c805cd20 0x7f09c8131860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 -- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 msgr2=0x7f09c8148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 -- 172.21.15.89:0/3442876600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b800b180 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cebf8700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09cdbf6700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 0x7f09c8130350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f09b800c000 tx=0x7f09b8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b8010780 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80108e0 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c0009530 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b8010c40 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.629+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c8130840 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.630+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f09b801c460 con 0x7f09c80ac780 2024-02-10T00:02:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.630+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c8130af0 con 0x7f09c80ac780 2024-02-10T00:02:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.630+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f09b804adb0 con 0x7f09c80ac780 2024-02-10T00:02:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.633+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f09b80335d0 con 0x7f09c80ac780 2024-02-10T00:02:35.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.773+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09c8057a60 con 0x7f09c80ac780 2024-02-10T00:02:35.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.774+0000 7f09b77fe700 1 -- 172.21.15.89:0/3442876600 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f09b80331c0 con 0x7f09c80ac780 2024-02-10T00:02:35.776 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:35.777 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 >> v1:172.21.15.89:6816/39389 conn(0x7f09a8038e30 legacy=0x7f09a803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 msgr2=0x7f09c8130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 0x7f09c8130350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f09b800c000 tx=0x7f09b8006df0).stop 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 shutdown_connections 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09c813e5c0 0x7f09c8148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f09c805cd20 0x7f09c8131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 --2- 172.21.15.89:0/3442876600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09c80ac780 0x7f09c8130350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 >> 172.21.15.89:0/3442876600 conn(0x7f09c8067790 msgr2=0x7f09c8133b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 shutdown_connections 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:35.775+0000 7f09d065b700 1 -- 172.21.15.89:0/3442876600 wait complete. 2024-02-10T00:02:35.778 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:36.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:36.091 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:37.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:37.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 Processor -- start 2024-02-10T00:02:37.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 -- start start 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 0x7f6be8133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 0x7f6be8139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be8139d80 0x7f6be813a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be8067990 con 0x7f6be8139d80 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be813a6f0 con 0x7f6be8067570 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.205+0000 7f6bedcad700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80a4c50 con 0x7f6be81337e0 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 0x7f6be8139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 0x7f6be8133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be8139d80 0x7f6be813a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 0x7f6be8133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46546/0 (socket says 172.21.15.89:46546) 2024-02-10T00:02:37.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 0x7f6be8139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36904/0 (socket says 172.21.15.89:36904) 2024-02-10T00:02:37.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be77fe700 1 -- 172.21.15.89:0/2066132263 learned_addr learned my addr 172.21.15.89:0/2066132263 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 -- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 msgr2=0x7f6be8133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 0x7f6be8133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 -- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 msgr2=0x7f6be8139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 0x7f6be8139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 -- 172.21.15.89:0/2066132263 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80a4f10 con 0x7f6be8139d80 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be7fff700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be8139d80 0x7f6be813a200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6be00032f0 tx=0x7f6be00091d0).ready entity=mon.0 client_cookie=1b25172ed3961e15 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be67fc700 1 -- 172.21.15.89:0/2066132263 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be000b600 con 0x7f6be8139d80 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be67fc700 1 -- 172.21.15.89:0/2066132263 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000b760 con 0x7f6be8139d80 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.206+0000 7f6be67fc700 1 -- 172.21.15.89:0/2066132263 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be000b8d0 con 0x7f6be8139d80 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 -- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be8139d80 msgr2=0x7f6be813a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be8139d80 0x7f6be813a200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6be00032f0 tx=0x7f6be00091d0).stop 2024-02-10T00:02:37.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 -- 172.21.15.89:0/2066132263 shutdown_connections 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be8139d80 0x7f6be813a200 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be81337e0 0x7f6be8133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 --2- 172.21.15.89:0/2066132263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8067570 0x7f6be8139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 -- 172.21.15.89:0/2066132263 >> 172.21.15.89:0/2066132263 conn(0x7f6be80a93f0 msgr2=0x7f6be80a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 -- 172.21.15.89:0/2066132263 shutdown_connections 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.207+0000 7f6bedcad700 1 -- 172.21.15.89:0/2066132263 wait complete. 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 Processor -- start 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 -- start start 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 0x7f6be809c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be809f660 con 0x7f6be81337e0 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be809bf20 con 0x7f6be8139d80 2024-02-10T00:02:37.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6bedcad700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be809e0d0 con 0x7f6be8067570 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6be7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.208+0000 7f6be6ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 0x7f6be809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46562/0 (socket says 172.21.15.89:46562) 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be77fe700 1 -- 172.21.15.89:0/3657580446 learned_addr learned my addr 172.21.15.89:0/3657580446 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36920/0 (socket says 172.21.15.89:36920) 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 -- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 msgr2=0x7f6be8092990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 -- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 msgr2=0x7f6be809c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 0x7f6be809c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 -- 172.21.15.89:0/3657580446 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009470 con 0x7f6be8139d80 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be77fe700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be6ffd700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 0x7f6be809c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:37.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be7fff700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6be00032f0 tx=0x7f6be0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be000b600 con 0x7f6be8139d80 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0011b90 con 0x7f6be8139d80 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be809e390 con 0x7f6be8139d80 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be001f3f0 con 0x7f6be8139d80 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.209+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80a2640 con 0x7f6be8139d80 2024-02-10T00:02:37.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.210+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6be0026030 con 0x7f6be8139d80 2024-02-10T00:02:37.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.210+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be809de70 con 0x7f6be8139d80 2024-02-10T00:02:37.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.210+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6be004b180 con 0x7f6be8139d80 2024-02-10T00:02:37.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.213+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6be0002eb0 con 0x7f6be8139d80 2024-02-10T00:02:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.354+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be8057a60 con 0x7f6be8139d80 2024-02-10T00:02:37.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.355+0000 7f6be4ff9700 1 -- 172.21.15.89:0/3657580446 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f6be0024030 con 0x7f6be8139d80 2024-02-10T00:02:37.357 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:37.357 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 >> v1:172.21.15.89:6816/39389 conn(0x7f6bc8038da0 legacy=0x7f6bc803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 msgr2=0x7f6be809ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6be00032f0 tx=0x7f6be0016000).stop 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 shutdown_connections 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be8139d80 0x7f6be809ca30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be8067570 0x7f6be8092990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 --2- 172.21.15.89:0/3657580446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be81337e0 0x7f6be809c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 >> 172.21.15.89:0/3657580446 conn(0x7f6be80a93f0 msgr2=0x7f6be80a2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 shutdown_connections 2024-02-10T00:02:37.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:37.356+0000 7f6bedcad700 1 -- 172.21.15.89:0/3657580446 wait complete. 2024-02-10T00:02:37.360 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:37.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:37.672 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:38.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:38.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.784+0000 7f84db121700 1 Processor -- start 2024-02-10T00:02:38.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.784+0000 7f84db121700 1 -- start start 2024-02-10T00:02:38.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 0x7f84d4134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 0x7f84d4064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d4134310 con 0x7f84d4133e30 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4063520 con 0x7f84d4063c30 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84db121700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4063750 con 0x7f84d4137360 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d96be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d8ebd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 0x7f84d4134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 0x7f84d4064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d96be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46574/0 (socket says 172.21.15.89:46574) 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d8ebd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 0x7f84d4134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36926/0 (socket says 172.21.15.89:36926) 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.785+0000 7f84d96be700 1 -- 172.21.15.89:0/2659913754 learned_addr learned my addr 172.21.15.89:0/2659913754 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 -- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 msgr2=0x7f84d4134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 --2- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 0x7f84d4134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 -- 172.21.15.89:0/2659913754 >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 msgr2=0x7f84d4064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 --2- 172.21.15.89:0/2659913754 >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 0x7f84d4064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 -- 172.21.15.89:0/2659913754 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4063a10 con 0x7f84d4137360 2024-02-10T00:02:38.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d3fff700 1 --2- 172.21.15.89:0/2659913754 >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 0x7f84d4064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d96be700 1 --2- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f84cc0032f0 tx=0x7f84cc009290).ready entity=mon.2 client_cookie=aa1b6b3a33ce6871 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d37fe700 1 -- 172.21.15.89:0/2659913754 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84cc00b6c0 con 0x7f84d4137360 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d37fe700 1 -- 172.21.15.89:0/2659913754 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00b820 con 0x7f84d4137360 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84d37fe700 1 -- 172.21.15.89:0/2659913754 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84cc00b990 con 0x7f84d4137360 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 -- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 msgr2=0x7f84d4137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 --2- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f84cc0032f0 tx=0x7f84cc009290).stop 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 -- 172.21.15.89:0/2659913754 shutdown_connections 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 --2- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4137360 0x7f84d4137810 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 --2- 172.21.15.89:0/2659913754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4063c30 0x7f84d4134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 --2- 172.21.15.89:0/2659913754 >> v2:172.21.15.89:3300/0 conn(0x7f84d4133e30 0x7f84d4064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 -- 172.21.15.89:0/2659913754 >> 172.21.15.89:0/2659913754 conn(0x7f84d406c0c0 msgr2=0x7f84d406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 -- 172.21.15.89:0/2659913754 shutdown_connections 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.786+0000 7f84db121700 1 -- 172.21.15.89:0/2659913754 wait complete. 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.787+0000 7f84db121700 1 Processor -- start 2024-02-10T00:02:38.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.787+0000 7f84db121700 1 -- start start 2024-02-10T00:02:38.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4137360 0x7f84d4143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40933e0 con 0x7f84d4063c30 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4143340 con 0x7f84d4137360 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84db121700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40938a0 con 0x7f84d4133e30 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d8ebd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d96be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4137360 0x7f84d4143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:38.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d8ebd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47506/0 (socket says 172.21.15.89:47506) 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46590/0 (socket says 172.21.15.89:46590) 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d8ebd700 1 -- 172.21.15.89:0/1172777610 learned_addr learned my addr 172.21.15.89:0/1172777610 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 -- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4137360 msgr2=0x7f84d4143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4137360 0x7f84d4143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 -- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 msgr2=0x7f84d4093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d3fff700 1 -- 172.21.15.89:0/1172777610 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c000b120 con 0x7f84d4133e30 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.788+0000 7f84d8ebd700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84d3fff700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f84d4143260 tx=0x7f84c0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:38.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c0012850 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c00129b0 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc009530 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c0012d10 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.789+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4093030 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.790+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f84c001b460 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.790+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40936b0 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.790+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f84c004a780 con 0x7f84d4133e30 2024-02-10T00:02:38.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.793+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f84c00330b0 con 0x7f84d4133e30 2024-02-10T00:02:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.946+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84d405c980 con 0x7f84d4133e30 2024-02-10T00:02:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.946+0000 7f84d1ffb700 1 -- 172.21.15.89:0/1172777610 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f84c0016070 con 0x7f84d4133e30 2024-02-10T00:02:38.948 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:38.949 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.947+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 >> v1:172.21.15.89:6816/39389 conn(0x7f84b4038dd0 legacy=0x7f84b403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.947+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 msgr2=0x7f84d4143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.947+0000 7f84db121700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f84d4143260 tx=0x7f84c0008040).stop 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 shutdown_connections 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84d4137360 0x7f84d4143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84d4063c30 0x7f84d4093da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 --2- 172.21.15.89:0/1172777610 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f84d4133e30 0x7f84d4143590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 >> 172.21.15.89:0/1172777610 conn(0x7f84d406c0c0 msgr2=0x7f84d4137770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 shutdown_connections 2024-02-10T00:02:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:38.948+0000 7f84db121700 1 -- 172.21.15.89:0/1172777610 wait complete. 2024-02-10T00:02:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:39.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:39.263 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:40.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:40.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.377+0000 7f9352ac7700 1 Processor -- start 2024-02-10T00:02:40.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.377+0000 7f9352ac7700 1 -- start start 2024-02-10T00:02:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9352ac7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9352ac7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f934c139fa0 0x7f934c141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9352ac7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c067990 con 0x7f934c067570 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9352ac7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0a4c50 con 0x7f934c139fa0 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9352ac7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a4f10 con 0x7f934c1337e0 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9350863700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f934c139fa0 0x7f934c141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9350863700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46602/0 (socket says 172.21.15.89:46602) 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9350863700 1 -- 172.21.15.89:0/836508106 learned_addr learned my addr 172.21.15.89:0/836508106 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f934bfff700 1 --1- 172.21.15.89:0/836508106 >> v1:172.21.15.89:6789/0 conn(0x7f934c067570 0x7f934c139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40976/0 (socket says 172.21.15.89:40976) 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 -- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 msgr2=0x7f934c133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 -- 172.21.15.89:0/836508106 >> v1:172.21.15.89:6789/0 conn(0x7f934c067570 legacy=0x7f934c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 -- 172.21.15.89:0/836508106 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c060520 con 0x7f934c139fa0 2024-02-10T00:02:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f934b7fe700 1 -- 172.21.15.89:0/836508106 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377031873 0 0) 0x7f934c067990 con 0x7f934c067570 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9350863700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.378+0000 7f9351064700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c141c30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f93440032f0 tx=0x7f93440091d0).ready entity=mon.0 client_cookie=796e36ddfff13af9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f934b7fe700 1 -- 172.21.15.89:0/836508106 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400b6c0 con 0x7f934c139fa0 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f934b7fe700 1 -- 172.21.15.89:0/836508106 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400b820 con 0x7f934c139fa0 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f934b7fe700 1 -- 172.21.15.89:0/836508106 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400b990 con 0x7f934c139fa0 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 -- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 msgr2=0x7f934c141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c141c30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f93440032f0 tx=0x7f93440091d0).stop 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 -- 172.21.15.89:0/836508106 shutdown_connections 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c141c30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 --2- 172.21.15.89:0/836508106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 -- 172.21.15.89:0/836508106 >> 172.21.15.89:0/836508106 conn(0x7f934c0a93f0 msgr2=0x7f934c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 -- 172.21.15.89:0/836508106 shutdown_connections 2024-02-10T00:02:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.379+0000 7f9352ac7700 1 -- 172.21.15.89:0/836508106 wait complete. 2024-02-10T00:02:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.380+0000 7f9352ac7700 1 Processor -- start 2024-02-10T00:02:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.380+0000 7f9352ac7700 1 -- start start 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c09d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a1650 con 0x7f934c139fa0 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a13e0 con 0x7f934c067570 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f934c09f4b0 con 0x7f934c1337e0 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9350863700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:40.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f934bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c09d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47516/0 (socket says 172.21.15.89:47516) 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 -- 172.21.15.89:0/2474844140 learned_addr learned my addr 172.21.15.89:0/2474844140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9350863700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36946/0 (socket says 172.21.15.89:36946) 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 -- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 msgr2=0x7f934c09d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c09d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 -- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 msgr2=0x7f934c0a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 -- 172.21.15.89:0/2474844140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934000b1e0 con 0x7f934c139fa0 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9350863700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f934bfff700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c09d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9351064700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f93440032f0 tx=0x7f9344016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400b990 con 0x7f934c139fa0 2024-02-10T00:02:40.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9344021630 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344009470 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.381+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400b6c0 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.382+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c09e7b0 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.382+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9344027020 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.382+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c136eb0 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.383+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f934404bce0 con 0x7f934c139fa0 2024-02-10T00:02:40.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.386+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f934c136eb0 con 0x7f934c139fa0 2024-02-10T00:02:40.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.527+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f934c136eb0 con 0x7f934c139fa0 2024-02-10T00:02:40.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.527+0000 7f9349ffb700 1 -- 172.21.15.89:0/2474844140 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f934c136eb0 con 0x7f934c139fa0 2024-02-10T00:02:40.529 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:40.529 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 >> v1:172.21.15.89:6816/39389 conn(0x7f932c038da0 legacy=0x7f932c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 msgr2=0x7f934c09d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f93440032f0 tx=0x7f9344016000).stop 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 shutdown_connections 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c139fa0 0x7f934c09d9c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c067570 0x7f934c0a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 --2- 172.21.15.89:0/2474844140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f934c1337e0 0x7f934c09d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 >> 172.21.15.89:0/2474844140 conn(0x7f934c0a93f0 msgr2=0x7f934c0a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 shutdown_connections 2024-02-10T00:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:40.528+0000 7f9352ac7700 1 -- 172.21.15.89:0/2474844140 wait complete. 2024-02-10T00:02:40.532 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:40.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:40.843 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:41.844 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:41.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.956+0000 7f2c055df700 1 Processor -- start 2024-02-10T00:02:41.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.956+0000 7f2c055df700 1 -- start start 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2c055df700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 0x7f2c0005bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2c055df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2c055df700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0005b970 con 0x7f2c00136bf0 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2c055df700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0005d590 con 0x7f2c00136210 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2c055df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00136710 con 0x7f2c0013eb70 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36952/0 (socket says 172.21.15.89:36952) 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 -- 172.21.15.89:0/3902886445 learned_addr learned my addr 172.21.15.89:0/3902886445 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bfe7fc700 1 --2- 172.21.15.89:0/3902886445 >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 0x7f2c0005bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 -- 172.21.15.89:0/3902886445 >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 msgr2=0x7f2c0005bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 --2- 172.21.15.89:0/3902886445 >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 0x7f2c0005bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:41.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 -- 172.21.15.89:0/3902886445 >> v1:172.21.15.89:6789/0 conn(0x7f2c00136bf0 legacy=0x7f2c0005ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 -- 172.21.15.89:0/3902886445 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c001369d0 con 0x7f2c0013eb70 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bfe7fc700 1 --2- 172.21.15.89:0/3902886445 >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 0x7f2c0005bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.957+0000 7f2bff7fe700 1 --2- 172.21.15.89:0/3902886445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2bf80032f0 tx=0x7f2bf8009290).ready entity=mon.1 client_cookie=892df94c2dde4c39 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2bfdffb700 1 -- 172.21.15.89:0/3902886445 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf800b8a0 con 0x7f2c0013eb70 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2bfdffb700 1 -- 172.21.15.89:0/3902886445 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf800ba00 con 0x7f2c0013eb70 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2bfdffb700 1 -- 172.21.15.89:0/3902886445 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf800bb70 con 0x7f2c0013eb70 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 -- 172.21.15.89:0/3902886445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 msgr2=0x7f2c00140f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 --2- 172.21.15.89:0/3902886445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2bf80032f0 tx=0x7f2bf8009290).stop 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 -- 172.21.15.89:0/3902886445 shutdown_connections 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 --2- 172.21.15.89:0/3902886445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c00140f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 --2- 172.21.15.89:0/3902886445 >> v2:172.21.15.89:3300/0 conn(0x7f2c00136210 0x7f2c0005bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 -- 172.21.15.89:0/3902886445 >> 172.21.15.89:0/3902886445 conn(0x7f2c00066a50 msgr2=0x7f2c0006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 -- 172.21.15.89:0/3902886445 shutdown_connections 2024-02-10T00:02:41.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.958+0000 7f2c055df700 1 -- 172.21.15.89:0/3902886445 wait complete. 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.959+0000 7f2c055df700 1 Processor -- start 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.959+0000 7f2c055df700 1 -- start start 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 0x7f2c000a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 0x7f2c0013d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c001494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00139f70 con 0x7f2c00136210 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c000a1850 con 0x7f2c0013eb70 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c000a6ac0 con 0x7f2c00136bf0 2024-02-10T00:02:41.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfeffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 0x7f2c000a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bff7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c001494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfeffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 0x7f2c000a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47526/0 (socket says 172.21.15.89:47526) 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 0x7f2c0013d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfeffd700 1 -- 172.21.15.89:0/3168860329 learned_addr learned my addr 172.21.15.89:0/3168860329 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 -- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 msgr2=0x7f2c001494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c001494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 -- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 msgr2=0x7f2c000a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 0x7f2c000a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 -- 172.21.15.89:0/3168860329 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf000b180 con 0x7f2c00136bf0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bff7fe700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c001494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2bfe7fc700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 0x7f2c0013d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2bf000c000 tx=0x7f2bf0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf0010780 con 0x7f2c00136bf0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf00108e0 con 0x7f2c00136bf0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf8009530 con 0x7f2c00136bf0 2024-02-10T00:02:41.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf0010c40 con 0x7f2c00136bf0 2024-02-10T00:02:41.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.960+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c000a0c40 con 0x7f2c00136bf0 2024-02-10T00:02:41.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.961+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2bf001c460 con 0x7f2c00136bf0 2024-02-10T00:02:41.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.961+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c00060150 con 0x7f2c00136bf0 2024-02-10T00:02:41.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.962+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2bf004ad00 con 0x7f2c00136bf0 2024-02-10T00:02:41.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:41.964+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2bf004f070 con 0x7f2c00136bf0 2024-02-10T00:02:42.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.105+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c00057a60 con 0x7f2c00136bf0 2024-02-10T00:02:42.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.105+0000 7f2beffff700 1 -- 172.21.15.89:0/3168860329 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f2bf0033630 con 0x7f2c00136bf0 2024-02-10T00:02:42.108 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:42.108 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 >> v1:172.21.15.89:6816/39389 conn(0x7f2bdc038da0 legacy=0x7f2bdc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 msgr2=0x7f2c0013d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 0x7f2c0013d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2bf000c000 tx=0x7f2bf0006df0).stop 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 shutdown_connections 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0013eb70 0x7f2c001494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:42.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c00136210 0x7f2c000a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 --2- 172.21.15.89:0/3168860329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c00136bf0 0x7f2c0013d110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 >> 172.21.15.89:0/3168860329 conn(0x7f2c00066a50 msgr2=0x7f2c00134c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 shutdown_connections 2024-02-10T00:02:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:42.107+0000 7f2c055df700 1 -- 172.21.15.89:0/3168860329 wait complete. 2024-02-10T00:02:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:42.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:42.421 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:43.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:43.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.533+0000 7f04a29d8700 1 Processor -- start 2024-02-10T00:02:43.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.533+0000 7f04a29d8700 1 -- start start 2024-02-10T00:02:43.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c09a380 con 0x7f049c099a00 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c135fe0 con 0x7f049c1366f0 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a29d8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049c099eb0 con 0x7f049c09b520 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a0f75700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a0f75700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47536/0 (socket says 172.21.15.89:47536) 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36962/0 (socket says 172.21.15.89:36962) 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46622/0 (socket says 172.21.15.89:46622) 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a0f75700 1 -- 172.21.15.89:0/3352475819 learned_addr learned my addr 172.21.15.89:0/3352475819 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 -- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 msgr2=0x7f049c136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 -- 172.21.15.89:0/3352475819 >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 msgr2=0x7f049c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:43.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 --2- 172.21.15.89:0/3352475819 >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 -- 172.21.15.89:0/3352475819 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c09a0c0 con 0x7f049c1366f0 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f04a0f75700 1 --2- 172.21.15.89:0/3352475819 >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049b7fe700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049bfff700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0490002f70 tx=0x7f0490006df0).ready entity=mon.1 client_cookie=fc104378af3e40ab server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.534+0000 7f049affd700 1 -- 172.21.15.89:0/3352475819 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049000d4a0 con 0x7f049c1366f0 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f049affd700 1 -- 172.21.15.89:0/3352475819 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490000e90 con 0x7f049c1366f0 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f049affd700 1 -- 172.21.15.89:0/3352475819 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049000d7f0 con 0x7f049c1366f0 2024-02-10T00:02:43.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 -- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 msgr2=0x7f049c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0490002f70 tx=0x7f0490006df0).stop 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 -- 172.21.15.89:0/3352475819 shutdown_connections 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 --2- 172.21.15.89:0/3352475819 >> v2:172.21.15.89:3300/0 conn(0x7f049c099a00 0x7f049c139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c1366f0 0x7f049c09bbb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 --2- 172.21.15.89:0/3352475819 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c09b520 0x7f049c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 -- 172.21.15.89:0/3352475819 >> 172.21.15.89:0/3352475819 conn(0x7f049c06c0c0 msgr2=0x7f049c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 -- 172.21.15.89:0/3352475819 shutdown_connections 2024-02-10T00:02:43.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.535+0000 7f04a29d8700 1 -- 172.21.15.89:0/3352475819 wait complete. 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.536+0000 7f04a29d8700 1 Processor -- start 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.536+0000 7f04a29d8700 1 -- start start 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 0x7f049c12b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 0x7f049c12beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c092220 con 0x7f049c09b520 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c092470 con 0x7f049c099a00 2024-02-10T00:02:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049c131e00 con 0x7f049c1366f0 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 0x7f049c12b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 0x7f049c12beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36964/0 (socket says 172.21.15.89:36964) 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 0x7f049c12b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47546/0 (socket says 172.21.15.89:47546) 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049bfff700 1 -- 172.21.15.89:0/2313517731 learned_addr learned my addr 172.21.15.89:0/2313517731 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 -- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 msgr2=0x7f049c093050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:43.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 -- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 msgr2=0x7f049c12b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 0x7f049c12b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 -- 172.21.15.89:0/2313517731 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009530 con 0x7f049c1366f0 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f049bfff700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a0f75700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 0x7f049c12beb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f049400c000 tx=0x7f0494009290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049400c770 con 0x7f049c1366f0 2024-02-10T00:02:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049400c8d0 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c00b120 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049400cc30 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.537+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049000b180 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.538+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0494022070 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.538+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c092d70 con 0x7f049c1366f0 2024-02-10T00:02:43.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.539+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f049404af90 con 0x7f049c1366f0 2024-02-10T00:02:43.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.542+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f049406c7c0 con 0x7f049c1366f0 2024-02-10T00:02:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.684+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f049c057a60 con 0x7f049c1366f0 2024-02-10T00:02:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.684+0000 7f04997fa700 1 -- 172.21.15.89:0/2313517731 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f0494016020 con 0x7f049c1366f0 2024-02-10T00:02:43.687 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:43.687 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.685+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 >> v1:172.21.15.89:6816/39389 conn(0x7f047c038dd0 legacy=0x7f047c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.685+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 msgr2=0x7f049c12beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.685+0000 7f04a29d8700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 0x7f049c12beb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f049400c000 tx=0x7f0494009290).stop 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 shutdown_connections 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f049c1366f0 0x7f049c12beb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f049c099a00 0x7f049c093050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 --2- 172.21.15.89:0/2313517731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f049c09b520 0x7f049c12b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 >> 172.21.15.89:0/2313517731 conn(0x7f049c06c0c0 msgr2=0x7f049c0a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 shutdown_connections 2024-02-10T00:02:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:43.686+0000 7f04a29d8700 1 -- 172.21.15.89:0/2313517731 wait complete. 2024-02-10T00:02:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:44.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:44.000 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:45.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.114+0000 7fc953333700 1 Processor -- start 2024-02-10T00:02:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.114+0000 7fc953333700 1 -- start start 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc953333700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc953333700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 0x7fc94c09adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc953333700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c09bc50 con 0x7fc94c064700 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc953333700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c1365f0 con 0x7fc94c136140 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc953333700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c09b2e0 con 0x7fc94c09aa10 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50606/0 (socket says 172.21.15.89:50606) 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 -- 172.21.15.89:0/2848092029 learned_addr learned my addr 172.21.15.89:0/2848092029 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9518d0700 1 --2- 172.21.15.89:0/2848092029 >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 0x7fc94c09adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 -- 172.21.15.89:0/2848092029 >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 msgr2=0x7fc94c09adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 --2- 172.21.15.89:0/2848092029 >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 0x7fc94c09adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 -- 172.21.15.89:0/2848092029 >> v1:172.21.15.89:6789/0 conn(0x7fc94c064700 legacy=0x7fc94c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9510cf700 1 -- 172.21.15.89:0/2848092029 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c1367e0 con 0x7fc94c09aa10 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc93bfff700 1 -- 172.21.15.89:0/2848092029 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076312118 0 0) 0x7fc94c09bc50 con 0x7fc94c064700 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.115+0000 7fc9518d0700 1 --2- 172.21.15.89:0/2848092029 >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 0x7fc94c09adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc9510cf700 1 --2- 172.21.15.89:0/2848092029 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc93c002f70 tx=0x7fc93c006eb0).ready entity=mon.2 client_cookie=1510843d8a720989 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc93bfff700 1 -- 172.21.15.89:0/2848092029 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc93c00d570 con 0x7fc94c09aa10 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc93bfff700 1 -- 172.21.15.89:0/2848092029 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c000e90 con 0x7fc94c09aa10 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc93bfff700 1 -- 172.21.15.89:0/2848092029 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc93c00d8c0 con 0x7fc94c09aa10 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 -- 172.21.15.89:0/2848092029 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 msgr2=0x7fc94c0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 --2- 172.21.15.89:0/2848092029 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc93c002f70 tx=0x7fc93c006eb0).stop 2024-02-10T00:02:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 -- 172.21.15.89:0/2848092029 shutdown_connections 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 --2- 172.21.15.89:0/2848092029 >> v2:172.21.15.89:3300/0 conn(0x7fc94c136140 0x7fc94c09adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 --2- 172.21.15.89:0/2848092029 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c0621e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 -- 172.21.15.89:0/2848092029 >> 172.21.15.89:0/2848092029 conn(0x7fc94c06c0c0 msgr2=0x7fc94c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 -- 172.21.15.89:0/2848092029 shutdown_connections 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.116+0000 7fc953333700 1 -- 172.21.15.89:0/2848092029 wait complete. 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.117+0000 7fc953333700 1 Processor -- start 2024-02-10T00:02:45.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.117+0000 7fc953333700 1 -- start start 2024-02-10T00:02:45.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:45.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:45.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc94c136140 0x7fc94c12a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c065e60 con 0x7fc94c064700 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c146640 con 0x7fc94c136140 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c138e90 con 0x7fc94c09aa10 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34072/0 (socket says 172.21.15.89:34072) 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 -- 172.21.15.89:0/4084497530 learned_addr learned my addr 172.21.15.89:0/4084497530 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9508ce700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9518d0700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc94c136140 0x7fc94c12a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 -- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 msgr2=0x7fc94c145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 -- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc94c136140 msgr2=0x7fc94c12a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc94c136140 0x7fc94c12a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 -- 172.21.15.89:0/4084497530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009470 con 0x7fc94c064700 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc9510cf700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc93c002f70 tx=0x7fc93c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:45.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc93c00d8f0 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c011c30 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c00b1e0 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.118+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc93c01e460 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.119+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c133960 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.119+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc93c025030 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.120+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc93c04bcb0 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.120+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c145ac0 con 0x7fc94c064700 2024-02-10T00:02:45.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.123+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc93c023070 con 0x7fc94c064700 2024-02-10T00:02:45.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.262+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc94c057a60 con 0x7fc94c064700 2024-02-10T00:02:45.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.262+0000 7fc93a7fc700 1 -- 172.21.15.89:0/4084497530 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7fc93c023070 con 0x7fc94c064700 2024-02-10T00:02:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:45.265 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.263+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 >> v1:172.21.15.89:6816/39389 conn(0x7fc92c038df0 legacy=0x7fc92c03b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.263+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 msgr2=0x7fc94c139670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.263+0000 7fc953333700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc93c002f70 tx=0x7fc93c015000).stop 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 shutdown_connections 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc94c136140 0x7fc94c12a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c064700 0x7fc94c139670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 --2- 172.21.15.89:0/4084497530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc94c09aa10 0x7fc94c145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 >> 172.21.15.89:0/4084497530 conn(0x7fc94c06c0c0 msgr2=0x7fc94c13ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:45.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 shutdown_connections 2024-02-10T00:02:45.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:45.264+0000 7fc953333700 1 -- 172.21.15.89:0/4084497530 wait complete. 2024-02-10T00:02:45.267 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:45.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:45.579 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:46.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.692+0000 7f88e27dd700 1 Processor -- start 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.692+0000 7f88e27dd700 1 -- start start 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88dc09adf0 0x7f88dc132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc09b2a0 con 0x7f88dc09adf0 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc09bc50 con 0x7f88dc064700 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e27dd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1367e0 con 0x7f88dc09aa10 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88dc09adf0 0x7f88dc132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88db7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88dc09adf0 0x7f88dc132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34082/0 (socket says 172.21.15.89:34082) 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88db7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:51970/0 (socket says 172.21.15.89:51970) 2024-02-10T00:02:46.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 -- 172.21.15.89:0/2851690524 learned_addr learned my addr 172.21.15.89:0/2851690524 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88dbfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 -- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 msgr2=0x7f88dc0621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc0621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 -- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 msgr2=0x7f88dc136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 -- 172.21.15.89:0/2851690524 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc136aa0 con 0x7f88dc09adf0 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88db7fe700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:46.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.693+0000 7f88e0d7a700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc132c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f88d40032f0 tx=0x7f88d4009290).ready entity=mon.0 client_cookie=3358b776bd87a55e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:46.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88daffd700 1 -- 172.21.15.89:0/2851690524 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4012980 con 0x7f88dc09adf0 2024-02-10T00:02:46.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88daffd700 1 -- 172.21.15.89:0/2851690524 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4012ae0 con 0x7f88dc09adf0 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88daffd700 1 -- 172.21.15.89:0/2851690524 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4012e40 con 0x7f88dc09adf0 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 -- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 msgr2=0x7f88dc132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc132c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f88d40032f0 tx=0x7f88d4009290).stop 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 -- 172.21.15.89:0/2851690524 shutdown_connections 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc132c40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc0621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 --2- 172.21.15.89:0/2851690524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 -- 172.21.15.89:0/2851690524 >> 172.21.15.89:0/2851690524 conn(0x7f88dc06c0c0 msgr2=0x7f88dc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.695+0000 7f88e27dd700 1 -- 172.21.15.89:0/2851690524 shutdown_connections 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.696+0000 7f88e27dd700 1 -- 172.21.15.89:0/2851690524 wait complete. 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.696+0000 7f88e27dd700 1 Processor -- start 2024-02-10T00:02:46.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.696+0000 7f88e27dd700 1 -- start start 2024-02-10T00:02:46.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc095830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc12fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc094ad0 con 0x7f88dc09adf0 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc130840 con 0x7f88dc064700 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e27dd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc093460 con 0x7f88dc09aa10 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e0d7a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88dbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc095830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88db7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc12fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e0d7a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34092/0 (socket says 172.21.15.89:34092) 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.697+0000 7f88e0d7a700 1 -- 172.21.15.89:0/3503597917 learned_addr learned my addr 172.21.15.89:0/3503597917 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 -- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 msgr2=0x7f88dc12fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc12fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 -- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 msgr2=0x7f88dc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 -- 172.21.15.89:0/3503597917 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d000b120 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88db7fe700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc12fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88e0d7a700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88dbfff700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc095830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f88cc00c000 tx=0x7f88cc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc010780 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc0108e0 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc010c40 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d4009530 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.698+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc098d80 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.699+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f88cc01b410 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.699+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0951d0 con 0x7f88dc064700 2024-02-10T00:02:46.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.699+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f88cc04a860 con 0x7f88dc064700 2024-02-10T00:02:46.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.702+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f88dc0951d0 con 0x7f88dc064700 2024-02-10T00:02:46.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.841+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88dc0951d0 con 0x7f88dc064700 2024-02-10T00:02:46.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.841+0000 7f88d97fa700 1 -- 172.21.15.89:0/3503597917 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f88dc0951d0 con 0x7f88dc064700 2024-02-10T00:02:46.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:46.886 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 >> v1:172.21.15.89:6816/39389 conn(0x7f88bc038e30 legacy=0x7f88bc03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 msgr2=0x7f88dc095830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc095830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f88cc00c000 tx=0x7f88cc006df0).stop 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 shutdown_connections 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc09adf0 0x7f88dc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88dc064700 0x7f88dc095830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 --2- 172.21.15.89:0/3503597917 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f88dc09aa10 0x7f88dc12fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:46.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 >> 172.21.15.89:0/3503597917 conn(0x7f88dc06c0c0 msgr2=0x7f88dc0a9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:46.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 shutdown_connections 2024-02-10T00:02:46.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:46.843+0000 7f88e27dd700 1 -- 172.21.15.89:0/3503597917 wait complete. 2024-02-10T00:02:46.889 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:47.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:47.192 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:48.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:48.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 Processor -- start 2024-02-10T00:02:48.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 -- start start 2024-02-10T00:02:48.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:48.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:48.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c09b2a0 con 0x7f623c09adf0 2024-02-10T00:02:48.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c09bc50 con 0x7f623c064700 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6240fe8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f623c1367e0 con 0x7f623c09aa10 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f6239d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f623a59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.304+0000 7f623ad9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f623c09adf0 0x7f623c132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49500/0 (socket says 172.21.15.89:49500) 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623ad9d700 1 -- 172.21.15.89:0/4061890621 learned_addr learned my addr 172.21.15.89:0/4061890621 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623959a700 1 -- 172.21.15.89:0/4061890621 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880948328 0 0) 0x7f6234001490 con 0x7f623c09adf0 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f6239d9b700 1 -- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 msgr2=0x7f623c0621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f6239d9b700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c0621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f6239d9b700 1 -- 172.21.15.89:0/4061890621 >> v1:172.21.15.89:6789/0 conn(0x7f623c09adf0 legacy=0x7f623c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f6239d9b700 1 -- 172.21.15.89:0/4061890621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c136aa0 con 0x7f623c064700 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623a59c700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c0621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f6239d9b700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c136140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6230002f70 tx=0x7f6230006d90).ready entity=mon.1 client_cookie=898b2b38f95b021b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623959a700 1 -- 172.21.15.89:0/4061890621 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f623000d4a0 con 0x7f623c064700 2024-02-10T00:02:48.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623959a700 1 -- 172.21.15.89:0/4061890621 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230000e90 con 0x7f623c064700 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.305+0000 7f623959a700 1 -- 172.21.15.89:0/4061890621 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f623000d7f0 con 0x7f623c064700 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 -- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 msgr2=0x7f623c136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c136140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6230002f70 tx=0x7f6230006d90).stop 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 -- 172.21.15.89:0/4061890621 shutdown_connections 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c0621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 --2- 172.21.15.89:0/4061890621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c136140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 -- 172.21.15.89:0/4061890621 >> 172.21.15.89:0/4061890621 conn(0x7f623c06c0c0 msgr2=0x7f623c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 -- 172.21.15.89:0/4061890621 shutdown_connections 2024-02-10T00:02:48.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.306+0000 7f6240fe8700 1 -- 172.21.15.89:0/4061890621 wait complete. 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 Processor -- start 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 -- start start 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f623c09adf0 0x7f623c092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:48.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c095130 con 0x7f623c09adf0 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c146980 con 0x7f623c064700 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6240fe8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0931d0 con 0x7f623c09aa10 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f623a59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f623ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f623c09adf0 0x7f623c092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f623a59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:52004/0 (socket says 172.21.15.89:52004) 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f623a59c700 1 -- 172.21.15.89:0/2061865329 learned_addr learned my addr 172.21.15.89:0/2061865329 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.307+0000 7f6239d9b700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 -- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 msgr2=0x7f623c092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 -- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f623c09adf0 msgr2=0x7f623c092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f623c09adf0 0x7f623c092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 -- 172.21.15.89:0/2061865329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c00b180 con 0x7f623c064700 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f623a59c700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f622c00c000 tx=0x7f622c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f622c00c7e0 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c00c940 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623000b120 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f622c00cca0 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.308+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c066940 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.310+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f622c01c460 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.310+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f622c04ae00 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.310+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c057a60 con 0x7f623c064700 2024-02-10T00:02:48.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.312+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f622c033730 con 0x7f623c064700 2024-02-10T00:02:48.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.455+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f623c060880 con 0x7f623c064700 2024-02-10T00:02:48.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.455+0000 7f622b7fe700 1 -- 172.21.15.89:0/2061865329 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f622c00ce00 con 0x7f623c064700 2024-02-10T00:02:48.458 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:48.458 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.456+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 >> v1:172.21.15.89:6816/39389 conn(0x7f6218038da0 legacy=0x7f621803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.456+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 msgr2=0x7f623c145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.456+0000 7f6240fe8700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f622c00c000 tx=0x7f622c006df0).stop 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 shutdown_connections 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f623c09adf0 0x7f623c092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f623c064700 0x7f623c145fb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 --2- 172.21.15.89:0/2061865329 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f623c09aa10 0x7f623c092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:48.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 >> 172.21.15.89:0/2061865329 conn(0x7f623c06c0c0 msgr2=0x7f623c0a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:48.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 shutdown_connections 2024-02-10T00:02:48.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:48.457+0000 7f6240fe8700 1 -- 172.21.15.89:0/2061865329 wait complete. 2024-02-10T00:02:48.460 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:48.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:48.771 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:49.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:49.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.884+0000 7fac0510e700 1 Processor -- start 2024-02-10T00:02:49.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.884+0000 7fac0510e700 1 -- start start 2024-02-10T00:02:49.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fac0510e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac00133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:49.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fac0510e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac00139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:49.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fac0510e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac00067990 con 0x7fac00139d80 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fac0510e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000a4c50 con 0x7fac00067570 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fac0510e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac000a4f10 con 0x7fac001337e0 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabff59e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fac00139d80 0x7fac00140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49508/0 (socket says 172.21.15.89:49508) 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac00133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfe59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac00139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabff59e700 1 -- 172.21.15.89:0/3812881828 learned_addr learned my addr 172.21.15.89:0/3812881828 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfdd9b700 1 -- 172.21.15.89:0/3812881828 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610840388 0 0) 0x7fac00067990 con 0x7fac00139d80 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfdd9b700 1 -- 172.21.15.89:0/3812881828 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe4003260 con 0x7fac00139d80 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 -- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 msgr2=0x7fac00139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac00139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 -- 172.21.15.89:0/3812881828 >> v1:172.21.15.89:6789/0 conn(0x7fac00139d80 legacy=0x7fac00140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 -- 172.21.15.89:0/3812881828 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00060520 con 0x7fac001337e0 2024-02-10T00:02:49.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfe59c700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac00139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.885+0000 7fabfed9d700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac00133bc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fabf4002f70 tx=0x7fabf4006df0).ready entity=mon.2 client_cookie=3cf54a41a3e7fee8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fabfdd9b700 1 -- 172.21.15.89:0/3812881828 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf400d570 con 0x7fac001337e0 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fabfdd9b700 1 -- 172.21.15.89:0/3812881828 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf4000e90 con 0x7fac001337e0 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fabfdd9b700 1 -- 172.21.15.89:0/3812881828 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf400d8c0 con 0x7fac001337e0 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 -- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 msgr2=0x7fac00133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac00133bc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fabf4002f70 tx=0x7fabf4006df0).stop 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 -- 172.21.15.89:0/3812881828 shutdown_connections 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac00133bc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 --2- 172.21.15.89:0/3812881828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac00139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 -- 172.21.15.89:0/3812881828 >> 172.21.15.89:0/3812881828 conn(0x7fac000a93f0 msgr2=0x7fac000a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 -- 172.21.15.89:0/3812881828 shutdown_connections 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.886+0000 7fac0510e700 1 -- 172.21.15.89:0/3812881828 wait complete. 2024-02-10T00:02:49.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.887+0000 7fac0510e700 1 Processor -- start 2024-02-10T00:02:49.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.887+0000 7fac0510e700 1 -- start start 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac0009e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 0x7fac00145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac001390d0 con 0x7fac00139d80 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac001459b0 con 0x7fac00067570 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0009ee70 con 0x7fac001337e0 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfe59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac0009e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 0x7fac00145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:52024/0 (socket says 172.21.15.89:52024) 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfe59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac0009e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50636/0 (socket says 172.21.15.89:50636) 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfed9d700 1 -- 172.21.15.89:0/1821688936 learned_addr learned my addr 172.21.15.89:0/1821688936 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 -- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 msgr2=0x7fac0009e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac0009e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 -- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 msgr2=0x7fac0009ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 -- 172.21.15.89:0/1821688936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf000b180 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabfed9d700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabff59e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 0x7fac00145e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fabf8001490 tx=0x7fabf8007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf8005ba0 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8005d00 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf400b180 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf80072c0 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.888+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac001397d0 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.889+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00065a50 con 0x7fac00139d80 2024-02-10T00:02:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.889+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fabf8010070 con 0x7fac00139d80 2024-02-10T00:02:49.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.890+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fabf804a140 con 0x7fac00139d80 2024-02-10T00:02:49.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:49.893+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fabf802f080 con 0x7fac00139d80 2024-02-10T00:02:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.033+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac00057a60 con 0x7fac00139d80 2024-02-10T00:02:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.033+0000 7fabeffff700 1 -- 172.21.15.89:0/1821688936 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7fabf8032660 con 0x7fac00139d80 2024-02-10T00:02:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:50.045 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 >> v1:172.21.15.89:6816/39389 conn(0x7fabdc038da0 legacy=0x7fabdc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 msgr2=0x7fac00145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 0x7fac00145e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fabf8001490 tx=0x7fabf8007d40).stop 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 shutdown_connections 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac00139d80 0x7fac00145e60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac00067570 0x7fac0009ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 --2- 172.21.15.89:0/1821688936 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fac001337e0 0x7fac0009e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 >> 172.21.15.89:0/1821688936 conn(0x7fac000a93f0 msgr2=0x7fac0013a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 shutdown_connections 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:50.035+0000 7fac0510e700 1 -- 172.21.15.89:0/1821688936 wait complete. 2024-02-10T00:02:50.046 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:50.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:50.350 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:51.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:51.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.461+0000 7f5e65033700 1 Processor -- start 2024-02-10T00:02:51.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.461+0000 7f5e65033700 1 -- start start 2024-02-10T00:02:51.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.462+0000 7f5e65033700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:51.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.462+0000 7f5e65033700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e600a4ab0 0x7f5e600a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e65033700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600a4190 con 0x7f5e6009d570 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e65033700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600a62d0 con 0x7f5e600a4ab0 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e65033700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6009df90 con 0x7f5e6005dfb0 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5e59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5e6009d570 0x7f5e600a1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49510/0 (socket says 172.21.15.89:49510) 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e600a4ab0 0x7f5e600a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50650/0 (socket says 172.21.15.89:50650) 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5e59c700 1 -- 172.21.15.89:0/2389767516 learned_addr learned my addr 172.21.15.89:0/2389767516 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e600a4ab0 msgr2=0x7f5e600a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 --2- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e600a4ab0 0x7f5e600a26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2389767516 >> v1:172.21.15.89:6789/0 conn(0x7f5e6009d570 legacy=0x7f5e600a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5dd9b700 1 -- 172.21.15.89:0/2389767516 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133721053 0 0) 0x7f5e600a4190 con 0x7f5e6009d570 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2389767516 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60060520 con 0x7f5e6005dfb0 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5ed9d700 1 --2- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5e50002f70 tx=0x7f5e50006df0).ready entity=mon.2 client_cookie=3adc8f88613516a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5dd9b700 1 -- 172.21.15.89:0/2389767516 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5000d570 con 0x7f5e6005dfb0 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5dd9b700 1 -- 172.21.15.89:0/2389767516 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50000e90 con 0x7f5e6005dfb0 2024-02-10T00:02:51.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.463+0000 7f5e5dd9b700 1 -- 172.21.15.89:0/2389767516 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5000d8c0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 -- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 msgr2=0x7f5e600a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 --2- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5e50002f70 tx=0x7f5e50006df0).stop 2024-02-10T00:02:51.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 -- 172.21.15.89:0/2389767516 shutdown_connections 2024-02-10T00:02:51.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 --2- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e600a4ab0 0x7f5e600a26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 --2- 172.21.15.89:0/2389767516 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600a45c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 -- 172.21.15.89:0/2389767516 >> 172.21.15.89:0/2389767516 conn(0x7f5e600a93f0 msgr2=0x7f5e600a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 -- 172.21.15.89:0/2389767516 shutdown_connections 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.464+0000 7f5e65033700 1 -- 172.21.15.89:0/2389767516 wait complete. 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 Processor -- start 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 -- start start 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6009d570 0x7f5e60143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e600a4ab0 0x7f5e60144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60065860 con 0x7f5e600a4ab0 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60143790 con 0x7f5e6009d570 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e65033700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60066250 con 0x7f5e6005dfb0 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e5ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e5ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50660/0 (socket says 172.21.15.89:50660) 2024-02-10T00:02:51.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2834527475 learned_addr learned my addr 172.21.15.89:0/2834527475 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e5e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6009d570 0x7f5e60143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.465+0000 7f5e5f59e700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e600a4ab0 0x7f5e60144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6009d570 msgr2=0x7f5e60143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6009d570 0x7f5e60143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e600a4ab0 msgr2=0x7f5e60144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e600a4ab0 0x7f5e60144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 -- 172.21.15.89:0/2834527475 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5000b180 con 0x7f5e6005dfb0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.466+0000 7f5e5ed9d700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5e50002f70 tx=0x7f5e50014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.468+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5000dea0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.468+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50013de0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.468+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e60063ba0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.468+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e5001e5f0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.468+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e601444f0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.469+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5e50025030 con 0x7f5e6005dfb0 2024-02-10T00:02:51.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.469+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5e5004b630 con 0x7f5e6005dfb0 2024-02-10T00:02:51.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.469+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e600659b0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.472+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5e50006320 con 0x7f5e6005dfb0 2024-02-10T00:02:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.612+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e6009dc50 con 0x7f5e6005dfb0 2024-02-10T00:02:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.612+0000 7f5e4ffff700 1 -- 172.21.15.89:0/2834527475 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f5e500132d0 con 0x7f5e6005dfb0 2024-02-10T00:02:51.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:51.615 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.613+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 >> v1:172.21.15.89:6816/39389 conn(0x7f5e3c038e30 legacy=0x7f5e3c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.613+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 msgr2=0x7f5e600636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.613+0000 7f5e65033700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5e50002f70 tx=0x7f5e50014000).stop 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 shutdown_connections 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e600a4ab0 0x7f5e60144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e6005dfb0 0x7f5e600636b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 --2- 172.21.15.89:0/2834527475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6009d570 0x7f5e60143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 >> 172.21.15.89:0/2834527475 conn(0x7f5e600a93f0 msgr2=0x7f5e600a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 shutdown_connections 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:51.614+0000 7f5e65033700 1 -- 172.21.15.89:0/2834527475 wait complete. 2024-02-10T00:02:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:51.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:51.930 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:52.931 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.044+0000 7f5e10fc7700 1 Processor -- start 2024-02-10T00:02:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.044+0000 7f5e10fc7700 1 -- start start 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e10fc7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e0c09b520 0x7f5e0c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e10fc7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e10fc7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c136ef0 con 0x7f5e0c1366f0 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e10fc7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c09a380 con 0x7f5e0c09b520 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e10fc7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c135fe0 con 0x7f5e0c136ad0 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e0c09b520 0x7f5e0c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0a59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5e0c1366f0 0x7f5e0c139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49526/0 (socket says 172.21.15.89:49526) 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0a59c700 1 -- 172.21.15.89:0/3499774003 learned_addr learned my addr 172.21.15.89:0/3499774003 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 -- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 msgr2=0x7f5e0c099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 --2- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 -- 172.21.15.89:0/3499774003 >> v1:172.21.15.89:6789/0 conn(0x7f5e0c1366f0 legacy=0x7f5e0c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 -- 172.21.15.89:0/3499774003 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c09a0c0 con 0x7f5e0c09b520 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0959a700 1 -- 172.21.15.89:0/3499774003 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353646587 0 0) 0x7f5e0c136ef0 con 0x7f5e0c1366f0 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e09d9b700 1 --2- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c09b520 0x7f5e0c09bbb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5dfc002f70 tx=0x7f5dfc006d90).ready entity=mon.0 client_cookie=7d12c7e1c3b835de server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0959a700 1 -- 172.21.15.89:0/3499774003 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dfc00d4a0 con 0x7f5e0c09b520 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0959a700 1 -- 172.21.15.89:0/3499774003 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc000e90 con 0x7f5e0c09b520 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.045+0000 7f5e0959a700 1 -- 172.21.15.89:0/3499774003 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dfc00d7f0 con 0x7f5e0c09b520 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c09b520 msgr2=0x7f5e0c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c09b520 0x7f5e0c09bbb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5dfc002f70 tx=0x7f5dfc006d90).stop 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3499774003 shutdown_connections 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3499774003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c09b520 0x7f5e0c09bbb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3499774003 >> 172.21.15.89:0/3499774003 conn(0x7f5e0c06c0c0 msgr2=0x7f5e0c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3499774003 shutdown_connections 2024-02-10T00:02:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.046+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3499774003 wait complete. 2024-02-10T00:02:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 Processor -- start 2024-02-10T00:02:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 -- start start 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 0x7f5e0c097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 0x7f5e0c092fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c0934b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.047+0000 7f5e10fc7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a8640 con 0x7f5e0c1366f0 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e10fc7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c097300 con 0x7f5e0c09b520 2024-02-10T00:02:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e10fc7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c097dd0 con 0x7f5e0c136ad0 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c0934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 0x7f5e0c097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c0934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50680/0 (socket says 172.21.15.89:50680) 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0ad9d700 1 -- 172.21.15.89:0/3892392190 learned_addr learned my addr 172.21.15.89:0/3892392190 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e09d9b700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 0x7f5e0c092fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 -- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 msgr2=0x7f5e0c0934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c0934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 -- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 msgr2=0x7f5e0c092fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 0x7f5e0c092fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 -- 172.21.15.89:0/3892392190 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc00b120 con 0x7f5e0c09b520 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e09d9b700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 0x7f5e0c092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e0a59c700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 0x7f5e0c097800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5e00000ed0 tx=0x7f5e00007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e000070d0 con 0x7f5e0c09b520 2024-02-10T00:02:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00007230 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c0944f0 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e00005610 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.048+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c0954b0 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.049+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5e0001a060 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.049+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5e00049f30 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.049+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c096560 con 0x7f5e0c09b520 2024-02-10T00:02:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.052+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5e0c096560 con 0x7f5e0c09b520 2024-02-10T00:02:53.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.189+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e0c096560 con 0x7f5e0c09b520 2024-02-10T00:02:53.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.190+0000 7f5dfb7fe700 1 -- 172.21.15.89:0/3892392190 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2326 (secure 0 0 0) 0x7f5e0c096560 con 0x7f5e0c09b520 2024-02-10T00:02:53.192 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:53.192 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:27.607032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4193,"mds_1":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6818/1003489341","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":1003489341}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 >> v1:172.21.15.89:6816/39389 conn(0x7f5de8038dd0 legacy=0x7f5de803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 msgr2=0x7f5e0c097800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 0x7f5e0c097800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5e00000ed0 tx=0x7f5e00007a00).stop 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 shutdown_connections 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e0c136ad0 0x7f5e0c0934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e0c09b520 0x7f5e0c097800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 --2- 172.21.15.89:0/3892392190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0c1366f0 0x7f5e0c092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 >> 172.21.15.89:0/3892392190 conn(0x7f5e0c06c0c0 msgr2=0x7f5e0c132390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 shutdown_connections 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:53.191+0000 7f5e10fc7700 1 -- 172.21.15.89:0/3892392190 wait complete. 2024-02-10T00:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 13 2024-02-10T00:02:53.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:27.607032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4193, 'mds_1': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.89:6818/1003489341', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6818', 'nonce': 1003489341}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:53.505 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4190:up:stopping 2024-02-10T00:02:54.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:02:54.523 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2024-02-10T00:02:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.613+0000 7fb69b80a700 1 Processor -- start 2024-02-10T00:02:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.613+0000 7fb69b80a700 1 -- start start 2024-02-10T00:02:54.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb69b80a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6941337e0 0x7fb694133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:54.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb69b80a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:54.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb69b80a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb694067990 con 0x7fb694067570 2024-02-10T00:02:54.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb69b80a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6940a4c50 con 0x7fb6941337e0 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb69b80a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940a4f10 con 0x7fb694139fa0 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6941337e0 0x7fb694133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb699da7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6941337e0 0x7fb694133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48550/0 (socket says 172.21.15.89:48550) 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb699da7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45394/0 (socket says 172.21.15.89:45394) 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 -- 172.21.15.89:0/1743811064 learned_addr learned my addr 172.21.15.89:0/1743811064 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 -- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 msgr2=0x7fb694141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 -- 172.21.15.89:0/1743811064 >> v1:172.21.15.89:6789/0 conn(0x7fb694067570 legacy=0x7fb694139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb683fff700 1 -- 172.21.15.89:0/1743811064 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026375712 0 0) 0x7fb694067990 con 0x7fb694067570 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 -- 172.21.15.89:0/1743811064 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694060520 con 0x7fb6941337e0 2024-02-10T00:02:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb699da7700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb6995a6700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6941337e0 0x7fb694133bc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb690002f70 tx=0x7fb690006eb0).ready entity=mon.0 client_cookie=b77443cb064f430c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb683fff700 1 -- 172.21.15.89:0/1743811064 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69000d570 con 0x7fb6941337e0 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb683fff700 1 -- 172.21.15.89:0/1743811064 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690000e90 con 0x7fb6941337e0 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.614+0000 7fb683fff700 1 -- 172.21.15.89:0/1743811064 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69000d8c0 con 0x7fb6941337e0 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 -- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6941337e0 msgr2=0x7fb694133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6941337e0 0x7fb694133bc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb690002f70 tx=0x7fb690006eb0).stop 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 -- 172.21.15.89:0/1743811064 shutdown_connections 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6941337e0 0x7fb694133bc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 --2- 172.21.15.89:0/1743811064 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694139fa0 0x7fb694141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 -- 172.21.15.89:0/1743811064 >> 172.21.15.89:0/1743811064 conn(0x7fb6940a93f0 msgr2=0x7fb6940a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 -- 172.21.15.89:0/1743811064 shutdown_connections 2024-02-10T00:02:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.615+0000 7fb69b80a700 1 -- 172.21.15.89:0/1743811064 wait complete. 2024-02-10T00:02:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.616+0000 7fb69b80a700 1 Processor -- start 2024-02-10T00:02:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.616+0000 7fb69b80a700 1 -- start start 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 0x7fb694149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6941337e0 0x7fb69409c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 0x7fb69409ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694092670 con 0x7fb694139fa0 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414a010 con 0x7fb6941337e0 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414a2d0 con 0x7fb694067570 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6995a6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 0x7fb694149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:54.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6995a6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 0x7fb694149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45400/0 (socket says 172.21.15.89:45400) 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 0x7fb69409ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6995a6700 1 -- 172.21.15.89:0/2850466235 learned_addr learned my addr 172.21.15.89:0/2850466235 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb698da5700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6941337e0 0x7fb69409c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 -- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 msgr2=0x7fb694149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 0x7fb694149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 -- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6941337e0 msgr2=0x7fb69409c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6941337e0 0x7fb69409c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 -- 172.21.15.89:0/2850466235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009470 con 0x7fb694139fa0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb699da7700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 0x7fb69409ca30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb68c00c000 tx=0x7fb68c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68c00ee60 con 0x7fb694139fa0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00c850 con 0x7fb694139fa0 2024-02-10T00:02:54.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69000b1e0 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.617+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68c00cbb0 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.618+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6940930d0 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.618+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb68c022070 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.619+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb694149460 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.619+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb68c04afa0 con 0x7fb694139fa0 2024-02-10T00:02:54.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.622+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb68c06c7c0 con 0x7fb694139fa0 2024-02-10T00:02:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.762+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb694065a50 con 0x7fb694139fa0 2024-02-10T00:02:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.762+0000 7fb6827fc700 1 -- 172.21.15.89:0/2850466235 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2018 (secure 0 0 0) 0x7fb68c016030 con 0x7fb694139fa0 2024-02-10T00:02:54.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:02:54.765 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:54.474229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 >> v1:172.21.15.89:6816/39389 conn(0x7fb674038da0 legacy=0x7fb67403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 msgr2=0x7fb69409ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 0x7fb69409ca30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb68c00c000 tx=0x7fb68c0091d0).stop 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 shutdown_connections 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb694139fa0 0x7fb69409ca30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb694067570 0x7fb694149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 --2- 172.21.15.89:0/2850466235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6941337e0 0x7fb69409c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.763+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 >> 172.21.15.89:0/2850466235 conn(0x7fb6940a93f0 msgr2=0x7fb6940a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.764+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 shutdown_connections 2024-02-10T00:02:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:54.764+0000 7fb69b80a700 1 -- 172.21.15.89:0/2850466235 wait complete. 2024-02-10T00:02:54.767 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 14 2024-02-10T00:02:55.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:54.474229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4193}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:02:55.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-10T00:02:55.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-10T00:02:55.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.181+0000 7f6be8534700 1 Processor -- start 2024-02-10T00:02:55.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.181+0000 7f6be8534700 1 -- start start 2024-02-10T00:02:55.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be01337e0 0x7f6be0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be0067990 con 0x7f6be0067570 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be013a6f0 con 0x7f6be01337e0 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be8534700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00a4c50 con 0x7f6be0139d80 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be5acf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45412/0 (socket says 172.21.15.89:45412) 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be5acf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48564/0 (socket says 172.21.15.89:48564) 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4124619330 learned_addr learned my addr 172.21.15.89:0/4124619330 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.182+0000 7f6be62d0700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be01337e0 0x7f6be0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be01337e0 msgr2=0x7f6be0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be01337e0 0x7f6be0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4124619330 >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 msgr2=0x7f6be0139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4124619330 >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4124619330 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00a4f10 con 0x7f6be0139d80 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4124619330 >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6bd80032f0 tx=0x7f6bd8009290).ready entity=mon.2 client_cookie=ce53e37f91ad657c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be52ce700 1 -- 172.21.15.89:0/4124619330 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd800b6c0 con 0x7f6be0139d80 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be52ce700 1 -- 172.21.15.89:0/4124619330 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800b820 con 0x7f6be0139d80 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be52ce700 1 -- 172.21.15.89:0/4124619330 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd800b990 con 0x7f6be0139d80 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be8534700 1 -- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 msgr2=0x7f6be013a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be8534700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6bd80032f0 tx=0x7f6bd8009290).stop 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be8534700 1 -- 172.21.15.89:0/4124619330 shutdown_connections 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be8534700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be0139d80 0x7f6be013a200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.183+0000 7f6be8534700 1 --2- 172.21.15.89:0/4124619330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be01337e0 0x7f6be0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 --2- 172.21.15.89:0/4124619330 >> v2:172.21.15.89:3300/0 conn(0x7f6be0067570 0x7f6be0139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 -- 172.21.15.89:0/4124619330 >> 172.21.15.89:0/4124619330 conn(0x7f6be00a93f0 msgr2=0x7f6be00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 -- 172.21.15.89:0/4124619330 shutdown_connections 2024-02-10T00:02:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 -- 172.21.15.89:0/4124619330 wait complete. 2024-02-10T00:02:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 Processor -- start 2024-02-10T00:02:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.184+0000 7f6be8534700 1 -- start start 2024-02-10T00:02:55.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 0x7f6be0149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 0x7f6be0149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be009cce0 con 0x7f6be0067570 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be009ca30 con 0x7f6be0139d80 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be8534700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be009cf80 con 0x7f6be01337e0 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 0x7f6be0149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48572/0 (socket says 172.21.15.89:48572) 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 -- 172.21.15.89:0/3242047728 learned_addr learned my addr 172.21.15.89:0/3242047728 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 0x7f6be0149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 -- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 msgr2=0x7f6be0149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 0x7f6be0149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 -- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 msgr2=0x7f6be0149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 0x7f6be0149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 -- 172.21.15.89:0/3242047728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc00b180 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be5acf700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 0x7f6be0149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 0x7f6be0149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.185+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6bd000c000 tx=0x7f6bd0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6bcf7fe700 1 -- 172.21.15.89:0/3242047728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd0010780 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6bcf7fe700 1 -- 172.21.15.89:0/3242047728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00108e0 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8009530 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6bcf7fe700 1 -- 172.21.15.89:0/3242047728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd0010c40 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00a2740 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.186+0000 7f6bcf7fe700 1 -- 172.21.15.89:0/3242047728 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6bd001c460 con 0x7f6be0067570 2024-02-10T00:02:55.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.187+0000 7f6bcf7fe700 1 -- 172.21.15.89:0/3242047728 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6bd004ac60 con 0x7f6be0067570 2024-02-10T00:02:55.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 Processor -- start 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 -- start start 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 0x56198c261a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198c1fda10 con 0x56198c261590 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56198c1a2e10 con 0x56198c25c1d0 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.190+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x56198c1738b0 con 0x56198c25c5b0 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be62d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 0x56198c261a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be62d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45590/0 (socket says 172.21.15.89:45590) 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45430/0 (socket says 172.21.15.89:45430) 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be62d0700 1 -- 172.21.15.89:0/4234095835 learned_addr learned my addr 172.21.15.89:0/4234095835 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 msgr2=0x56198c25c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 msgr2=0x56198c24fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 -- 172.21.15.89:0/4234095835 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56198c209e20 con 0x56198c261590 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be62d0700 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 0x56198c261a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6bd801b000 tx=0x7f6bd8016000).ready entity=mon.0 client_cookie=303ffa902fb6d26a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be8534700 1 -- 172.21.15.89:0/4234095835 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd8006d20 con 0x56198c261590 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be8534700 1 -- 172.21.15.89:0/4234095835 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd8022480 con 0x56198c261590 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.191+0000 7f6be8534700 1 -- 172.21.15.89:0/4234095835 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd80227e0 con 0x56198c261590 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 msgr2=0x56198c261a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 0x56198c261a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6bd801b000 tx=0x7f6bd8016000).stop 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4234095835 shutdown_connections 2024-02-10T00:02:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c261590 0x56198c261a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c24fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4234095835 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c25c5b0 0x56198c25c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4234095835 >> 172.21.15.89:0/4234095835 conn(0x56198c1fb970 msgr2=0x56198c155690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4234095835 shutdown_connections 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4234095835 wait complete. 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 -- start start 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.192+0000 7f6bf9fbbb80 1 Processor -- start 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c26ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198c187180 con 0x56198c25c1d0 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56198c1677f0 con 0x56198c25c5b0 2024-02-10T00:02:55.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x56198c157710 con 0x56198c261590 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6bf9fbbb80 10 client.0 ll_register_callbacks cb 0x56198c17c570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45598/0 (socket says 172.21.15.89:45598) 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be5acf700 1 -- 172.21.15.89:0/3408919748 learned_addr learned my addr 172.21.15.89:0/3408919748 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45440/0 (socket says 172.21.15.89:45440) 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.193+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c26ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 -- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 msgr2=0x56198c253420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 -- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 msgr2=0x56198c252f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 -- 172.21.15.89:0/3408919748 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00a2740 con 0x56198c25c1d0 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be5acf700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6be62d0700 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c26ace0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6bd000a690 tx=0x7f6bd0017000).ready entity=mon.0 client_cookie=4d1ab8c076453ed5 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd002d070 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6bd0030370 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56198c0fe0c0 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd0032970 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 10 client.4923 fetch_fsmap learned FSMap version 14 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f6bdc013300 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56198c0fe0c0 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 14) v1 ==== 1185+0+0 (secure 0 0 0) 0x7f6bd0030070 con 0x56198c25c1d0 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 10 client.4923 fetch_fsmap finished waiting for FSMap version 14 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 10 client.4923 resolve_mds: resolved ID 'b' to GID 4193 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 20 client.4923 populate_metadata read hostname 'smithi089' 2024-02-10T00:02:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 4 client.4923 mds_command: new command op to 4193 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.194+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56198c17d230 con 0x56198c253910 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bbd7fa700 10 client.4923 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bbd7fa700 1 -- 172.21.15.89:0/3408919748 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x56198c17d230 con 0x56198c253910 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bbd7fa700 10 client.4923 handle_command_reply: tid=0 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 client.4923 shutdown 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 msgr2=0x56198c26ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c26ace0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6bd000a690 tx=0x7f6bd0017000).stop 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 shutdown_connections 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c253420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c26ace0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/3408919748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c252f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bbd7fa700 0 client.4923 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 >> 172.21.15.89:0/3408919748 conn(0x56198c1fb970 msgr2=0x56198c150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.195+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 shutdown_connections 2024-02-10T00:02:55.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.196+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/3408919748 wait complete. 2024-02-10T00:02:55.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.196+0000 7f6bf9fbbb80 20 client.4923 trim_cache size 0 max 16384 2024-02-10T00:02:55.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.211+0000 7f6bf9fbbb80 1 Processor -- start 2024-02-10T00:02:55.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 -- start start 2024-02-10T00:02:55.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c24f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c252f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198c2519a0 con 0x56198c25c1d0 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56198c22f280 con 0x56198c25c5b0 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x56198c26a9e0 con 0x56198c261590 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:45600/0 (socket says 172.21.15.89:45600) 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 -- 172.21.15.89:0/4275467164 learned_addr learned my addr 172.21.15.89:0/4275467164 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be62d0700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c24f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c252f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 -- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 msgr2=0x56198c252f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c252f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 -- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 msgr2=0x56198c24f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c24f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be5acf700 1 -- 172.21.15.89:0/4275467164 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56198c14c600 con 0x56198c25c5b0 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.212+0000 7f6be62d0700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c24f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x56198c22de80 tx=0x7f6bdc006df0).ready entity=mon.1 client_cookie=25712b423bd9f0c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bbf7fe700 1 -- 172.21.15.89:0/4275467164 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bdc0186f0 con 0x56198c25c5b0 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bbf7fe700 1 -- 172.21.15.89:0/4275467164 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc018850 con 0x56198c25c5b0 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bbf7fe700 1 -- 172.21.15.89:0/4275467164 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bdc018bb0 con 0x56198c25c5b0 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 msgr2=0x56198c251df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x56198c22de80 tx=0x7f6bdc006df0).stop 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4275467164 shutdown_connections 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c252f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c1d0 0x56198c24f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4275467164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c5b0 0x56198c251df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4275467164 >> 172.21.15.89:0/4275467164 conn(0x56198c1fb970 msgr2=0x56198c150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4275467164 shutdown_connections 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.213+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4275467164 wait complete. 2024-02-10T00:02:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 -- start start 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 Processor -- start 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c25f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198c260430 con 0x56198c25c5b0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56198c22e720 con 0x56198c25c1d0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x56198c257870 con 0x56198c261590 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6bf9fbbb80 10 client.0 ll_register_callbacks cb 0x56198c255160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be6ad1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be62d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c25f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be5acf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48618/0 (socket says 172.21.15.89:48618) 2024-02-10T00:02:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be5acf700 1 -- 172.21.15.89:0/4222132562 learned_addr learned my addr 172.21.15.89:0/4222132562 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.214+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45444/0 (socket says 172.21.15.89:45444) 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 -- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 msgr2=0x56198c25ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 -- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 msgr2=0x56198c25f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c25f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 -- 172.21.15.89:0/4222132562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc013300 con 0x56198c25c5b0 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be6ad1700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be62d0700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c25f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6be5acf700 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x56198c22e980 tx=0x7f6bdc01f000).ready entity=mon.0 client_cookie=7f059d181704bd1f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bdc026070 con 0x56198c25c5b0 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6bdc02b460 con 0x56198c25c5b0 2024-02-10T00:02:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6bd8022480 con 0x56198c25c5b0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bdc02b620 con 0x56198c25c5b0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 10 client.4929 fetch_fsmap learned FSMap version 14 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f6bdc013710 con 0x56198c25c5b0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd8022480 con 0x56198c25c5b0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 14) v1 ==== 1185+0+0 (secure 0 0 0) 0x7f6bdc033030 con 0x56198c25c5b0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 10 client.4929 fetch_fsmap finished waiting for FSMap version 14 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 10 client.4929 resolve_mds: resolved ID 'b' to GID 4193 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 20 client.4929 populate_metadata read hostname 'smithi089' 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 4 client.4929 mds_command: new command op to 4193 tid=0[{"prefix": "status"}] 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.215+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "status"}) v1 -- 0x56198c175570 con 0x56198c22e200 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bbe7fc700 10 client.4929 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bbe7fc700 1 -- 172.21.15.89:0/4222132562 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 1825236006) 0x56198c175570 con 0x56198c22e200 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bbe7fc700 10 client.4929 handle_command_reply: tid=0 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 client.4929 shutdown 2024-02-10T00:02:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 msgr2=0x56198c25fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x56198c22e980 tx=0x7f6bdc01f000).stop 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 shutdown_connections 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x56198c261590 0x56198c25ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56198c25c1d0 0x56198c25f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 --2- 172.21.15.89:0/4222132562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56198c25c5b0 0x56198c25fa50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bbe7fc700 0 client.4929 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 >> 172.21.15.89:0/4222132562 conn(0x56198c1fb970 msgr2=0x56198c25c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 shutdown_connections 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 1 -- 172.21.15.89:0/4222132562 wait complete. 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.216+0000 7f6bf9fbbb80 20 client.4929 trim_cache size 0 max 16384 2024-02-10T00:02:55.226 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4193, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 267.91006365800001, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 14, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 19, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 19, 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 276.45630882400002 2024-02-10T00:02:55.227 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 >> v1:172.21.15.89:6816/39389 conn(0x7f6bc0038da0 legacy=0x7f6bc003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 msgr2=0x7f6be009c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6bd000c000 tx=0x7f6bd0006df0).stop 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 shutdown_connections 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0139d80 0x7f6be0149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be0067570 0x7f6be009c540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 --2- 172.21.15.89:0/3242047728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f6be01337e0 0x7f6be0149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-10T00:02:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 >> 172.21.15.89:0/3242047728 conn(0x7f6be00a93f0 msgr2=0x7f6be00a3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:02:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 shutdown_connections 2024-02-10T00:02:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:02:55.217+0000 7f6be8534700 1 -- 172.21.15.89:0/3242047728 wait complete. 2024-02-10T00:02:55.230 INFO:teuthology.run_tasks:Running task print... 2024-02-10T00:02:55.253 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2024-02-10T00:02:55.253 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-02-10T00:02:55.267 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': '290212a1bfd33563ba76ee5b7f0b944fdb6c5d90'} 2024-02-10T00:02:55.268 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-02-10T00:02:55.268 INFO:teuthology.task.install:remote ubuntu@smithi089.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-02-10T00:02:55.268 INFO:teuthology.task.install:extra packages: [] 2024-02-10T00:02:55.274 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-10T00:02:55.274 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-02-10T00:02:55.274 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-02-10T00:02:55.296 INFO:teuthology.orchestra.run.smithi089.stdout:15.2.17-0.el8 2024-02-10T00:02:55.297 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-02-10T00:02:55.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-02-10T00:02:55.548 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-505.g72ce7c1d 2024-02-10T00:02:55.548 INFO:teuthology.task.install.rpm:Host smithi089 is: centos 8 x86_64 2024-02-10T00:02:55.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-02-10T00:02:55.784 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/quincy/72ce7c1d1d5a2a1807db94c08aa742a26968c21f/centos/8/flavors/default/ 2024-02-10T00:02:55.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-02-10T00:02:55.976 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/72ce7c1d1d5a2a1807db94c08aa742a26968c21f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/72ce7c1d1d5a2a1807db94c08aa742a26968c21f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/72ce7c1d1d5a2a1807db94c08aa742a26968c21f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-10T00:02:55.976 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-02-10T00:02:55.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-10T00:02:56.006 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-10T00:02:56.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-10T00:02:56.144 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-10T00:02:56.202 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-02-10T00:02:56.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-02-10T00:02:56.473 INFO:teuthology.orchestra.run.smithi089.stdout:71 files removed 2024-02-10T00:02:56.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-02-10T00:02:57.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 237 kB/s | 78 kB 00:00 2024-02-10T00:02:57.771 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 19 kB/s | 9.1 kB 00:00 2024-02-10T00:02:58.088 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2024-02-10T00:03:00.097 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - AppStream 14 MB/s | 27 MB 00:01 2024-02-10T00:03:09.190 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - BaseOS 2.5 MB/s | 10 MB 00:04 2024-02-10T00:03:11.207 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2024-02-10T00:03:11.600 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2024-02-10T00:03:16.217 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - PowerTools 1.1 MB/s | 4.8 MB 00:04 2024-02-10T00:03:17.252 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-02-10T00:03:18.337 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2024-02-10T00:03:22.129 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 394 kB/s | 24 kB 00:00 2024-02-10T00:03:25.618 INFO:teuthology.orchestra.run.smithi089.stderr:Package cephadm available, but not installed. 2024-02-10T00:03:25.618 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: cephadm 2024-02-10T00:03:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-02-10T00:03:25.624 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: ceph-mgr-dashboard 2024-02-10T00:03:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-02-10T00:03:25.625 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-02-10T00:03:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:Package ceph-mgr-rook available, but not installed. 2024-02-10T00:03:25.625 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: ceph-mgr-rook 2024-02-10T00:03:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-02-10T00:03:25.626 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: ceph-mgr-cephadm 2024-02-10T00:03:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:Package ceph-volume available, but not installed. 2024-02-10T00:03:25.628 INFO:teuthology.orchestra.run.smithi089.stdout:No match for argument: ceph-volume 2024-02-10T00:03:25.727 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-02-10T00:03:25.731 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 6.4 k 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 5.2 M 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 23 M 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 876 k 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 161 k 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 2.3 M 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 1.6 M 2024-02-10T00:03:25.732 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:17.2.7-505.g72ce7c1d.el8 ceph-noarch 239 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 3.9 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 17 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 17 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 24 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 52 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 25 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 798 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 130 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 3.5 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 506 k 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 3.6 M 2024-02-10T00:03:25.733 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 5.6 M 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 45 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 115 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 190 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 371 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 358 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 107 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 90 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 3.5 M 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 176 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:17.2.7-505.g72ce7c1d.el8 ceph 178 k 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-02-10T00:03:25.734 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 29 Packages 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 144 M 2024-02-10T00:03:25.735 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-02-10T00:03:26.031 INFO:teuthology.orchestra.run.smithi089.stdout:(1/31): ceph-17.2.7-505.g72ce7c1d.el8.x86_64.rp 43 kB/s | 6.4 kB 00:00 2024-02-10T00:03:26.098 INFO:teuthology.orchestra.run.smithi089.stdout:(2/31): libcephsqlite-17.2.7-505.g72ce7c1d.el8. 831 kB/s | 178 kB 00:00 2024-02-10T00:03:26.140 INFO:teuthology.orchestra.run.smithi089.stdout:(3/31): thrift-0.13.0-2.el8.x86_64.rpm 6.8 MB/s | 1.7 MB 00:00 2024-02-10T00:03:26.465 INFO:teuthology.orchestra.run.smithi089.stdout:(4/31): ceph-fuse-17.2.7-505.g72ce7c1d.el8.x86_ 2.6 MB/s | 876 kB 00:00 2024-02-10T00:03:26.532 INFO:teuthology.orchestra.run.smithi089.stdout:(5/31): ceph-immutable-object-cache-17.2.7-505. 2.4 MB/s | 161 kB 00:00 2024-02-10T00:03:26.874 INFO:teuthology.orchestra.run.smithi089.stdout:(6/31): ceph-base-17.2.7-505.g72ce7c1d.el8.x86_ 6.1 MB/s | 5.2 MB 00:00 2024-02-10T00:03:26.924 INFO:teuthology.orchestra.run.smithi089.stdout:(7/31): ceph-mds-17.2.7-505.g72ce7c1d.el8.x86_6 5.9 MB/s | 2.3 MB 00:00 2024-02-10T00:03:27.466 INFO:teuthology.orchestra.run.smithi089.stdout:(8/31): ceph-mon-17.2.7-505.g72ce7c1d.el8.x86_6 7.3 MB/s | 3.9 MB 00:00 2024-02-10T00:03:27.537 INFO:teuthology.orchestra.run.smithi089.stdout:(9/31): ceph-mgr-17.2.7-505.g72ce7c1d.el8.x86_6 2.4 MB/s | 1.6 MB 00:00 2024-02-10T00:03:27.826 INFO:teuthology.orchestra.run.smithi089.stdout:(10/31): ceph-common-17.2.7-505.g72ce7c1d.el8.x 14 MB/s | 23 MB 00:01 2024-02-10T00:03:27.892 INFO:teuthology.orchestra.run.smithi089.stdout:(11/31): ceph-selinux-17.2.7-505.g72ce7c1d.el8. 365 kB/s | 24 kB 00:00 2024-02-10T00:03:28.934 INFO:teuthology.orchestra.run.smithi089.stdout:(12/31): ceph-osd-17.2.7-505.g72ce7c1d.el8.x86_ 11 MB/s | 17 MB 00:01 2024-02-10T00:03:29.009 INFO:teuthology.orchestra.run.smithi089.stdout:(13/31): libcephfs-devel-17.2.7-505.g72ce7c1d.e 332 kB/s | 25 kB 00:00 2024-02-10T00:03:29.110 INFO:teuthology.orchestra.run.smithi089.stdout:(14/31): libcephfs2-17.2.7-505.g72ce7c1d.el8.x8 7.8 MB/s | 798 kB 00:00 2024-02-10T00:03:29.224 INFO:teuthology.orchestra.run.smithi089.stdout:(15/31): librados-devel-17.2.7-505.g72ce7c1d.el 1.1 MB/s | 130 kB 00:00 2024-02-10T00:03:29.602 INFO:teuthology.orchestra.run.smithi089.stdout:(16/31): librados2-17.2.7-505.g72ce7c1d.el8.x86 9.2 MB/s | 3.5 MB 00:00 2024-02-10T00:03:29.786 INFO:teuthology.orchestra.run.smithi089.stdout:(17/31): ceph-radosgw-17.2.7-505.g72ce7c1d.el8. 7.5 MB/s | 17 MB 00:02 2024-02-10T00:03:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:(18/31): libradosstriper1-17.2.7-505.g72ce7c1d. 2.3 MB/s | 506 kB 00:00 2024-02-10T00:03:30.328 INFO:teuthology.orchestra.run.smithi089.stdout:(19/31): librbd1-17.2.7-505.g72ce7c1d.el8.x86_6 6.6 MB/s | 3.6 MB 00:00 2024-02-10T00:03:30.454 INFO:teuthology.orchestra.run.smithi089.stdout:(20/31): librgw2-17.2.7-505.g72ce7c1d.el8.x86_6 8.8 MB/s | 5.6 MB 00:00 2024-02-10T00:03:30.596 INFO:teuthology.orchestra.run.smithi089.stdout:(21/31): python3-ceph-argparse-17.2.7-505.g72ce 167 kB/s | 45 kB 00:00 2024-02-10T00:03:30.621 INFO:teuthology.orchestra.run.smithi089.stdout:(22/31): python3-ceph-common-17.2.7-505.g72ce7c 691 kB/s | 115 kB 00:00 2024-02-10T00:03:30.647 INFO:teuthology.orchestra.run.smithi089.stdout:(23/31): python3-cephfs-17.2.7-505.g72ce7c1d.el 3.7 MB/s | 190 kB 00:00 2024-02-10T00:03:30.681 INFO:teuthology.orchestra.run.smithi089.stdout:(24/31): python3-rados-17.2.7-505.g72ce7c1d.el8 6.1 MB/s | 371 kB 00:00 2024-02-10T00:03:30.706 INFO:teuthology.orchestra.run.smithi089.stdout:(25/31): python3-rbd-17.2.7-505.g72ce7c1d.el8.x 6.0 MB/s | 358 kB 00:00 2024-02-10T00:03:30.740 INFO:teuthology.orchestra.run.smithi089.stdout:(26/31): python3-rgw-17.2.7-505.g72ce7c1d.el8.x 1.8 MB/s | 107 kB 00:00 2024-02-10T00:03:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:(27/31): rbd-fuse-17.2.7-505.g72ce7c1d.el8.x86_ 1.5 MB/s | 90 kB 00:00 2024-02-10T00:03:30.849 INFO:teuthology.orchestra.run.smithi089.stdout:(28/31): rbd-nbd-17.2.7-505.g72ce7c1d.el8.x86_6 2.1 MB/s | 176 kB 00:00 2024-02-10T00:03:30.949 INFO:teuthology.orchestra.run.smithi089.stdout:(29/31): ceph-mgr-modules-core-17.2.7-505.g72ce 2.3 MB/s | 239 kB 00:00 2024-02-10T00:03:31.066 INFO:teuthology.orchestra.run.smithi089.stdout:(30/31): rbd-mirror-17.2.7-505.g72ce7c1d.el8.x8 11 MB/s | 3.5 MB 00:00 2024-02-10T00:03:32.225 INFO:teuthology.orchestra.run.smithi089.stdout:(31/31): ceph-test-17.2.7-505.g72ce7c1d.el8.x86 12 MB/s | 52 MB 00:04 2024-02-10T00:03:32.228 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-02-10T00:03:32.228 INFO:teuthology.orchestra.run.smithi089.stdout:Total 22 MB/s | 144 MB 00:06 2024-02-10T00:03:32.229 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-02-10T00:03:32.288 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-02-10T00:03:32.288 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-02-10T00:03:32.934 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-02-10T00:03:32.937 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-02-10T00:03:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-02-10T00:03:35.466 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:17.2.7-505.g72ce7c1d.el8.x86_64 1/1 2024-02-10T00:03:36.064 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:17.2.7-505.g72ce7c1d.el8.x86_64 1/60 2024-02-10T00:03:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:17.2.7-505.g72ce7c1d.el8.x86_64 1/60 2024-02-10T00:03:36.680 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:17.2.7-505.g72ce7c1d.el8.x86_64 2/60 2024-02-10T00:03:36.792 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:17.2.7-505.g72ce7c1d.el8.x86_64 2/60 2024-02-10T00:03:37.064 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libcephfs2-2:17.2.7-505.g72ce7c1d.el8.x86_64 3/60 2024-02-10T00:03:37.159 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:17.2.7-505.g72ce7c1d.el8.x86_64 3/60 2024-02-10T00:03:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-rados-2:17.2.7-505.g72ce7c1d.el8.x86_64 4/60 2024-02-10T00:03:38.398 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-02-10T00:03:38.697 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librgw2-2:17.2.7-505.g72ce7c1d.el8.x86_64 6/60 2024-02-10T00:03:38.777 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:17.2.7-505.g72ce7c1d.el8.x86_64 6/60 2024-02-10T00:03:38.963 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:17.2.7-505.g72ce7c1d.el8.x86_64 7/60 2024-02-10T00:03:39.117 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:17.2.7-505.g72ce7c1d.el8.x86_64 7/60 2024-02-10T00:03:39.305 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libradosstriper1-2:17.2.7-505.g72ce7c1d.el8.x86_64 8/60 2024-02-10T00:03:39.355 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:17.2.7-505.g72ce7c1d.el8.x86_64 8/60 2024-02-10T00:03:39.575 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-505.g72ce7c1d.el8.x 9/60 2024-02-10T00:03:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-cephfs-2:17.2.7-505.g72ce7c1d.el8.x86_64 10/60 2024-02-10T00:03:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-rgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 11/60 2024-02-10T00:03:40.412 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-rbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 12/60 2024-02-10T00:03:40.709 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 13/60 2024-02-10T00:03:41.002 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-505.g72ce7c1d.el8.n 14/60 2024-02-10T00:03:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : python3-ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86 15/60 2024-02-10T00:03:43.667 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 16/60 2024-02-10T00:03:43.946 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 16/60 2024-02-10T00:03:44.554 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 16/60 2024-02-10T00:03:44.905 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-base-2:17.2.7-505.g72ce7c1d.el8.x86_64 17/60 2024-02-10T00:03:44.993 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:17.2.7-505.g72ce7c1d.el8.x86_64 17/60 2024-02-10T00:03:45.171 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-selinux-2:17.2.7-505.g72ce7c1d.el8.x86_64 18/60 2024-02-10T00:04:03.650 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:17.2.7-505.g72ce7c1d.el8.x86_64 18/60 2024-02-10T00:04:03.877 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-mds-2:17.2.7-505.g72ce7c1d.el8.x86_64 19/60 2024-02-10T00:04:04.025 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:17.2.7-505.g72ce7c1d.el8.x86_64 19/60 2024-02-10T00:04:04.344 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-mgr-2:17.2.7-505.g72ce7c1d.el8.x86_64 20/60 2024-02-10T00:04:04.778 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:17.2.7-505.g72ce7c1d.el8.x86_64 20/60 2024-02-10T00:04:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-mon-2:17.2.7-505.g72ce7c1d.el8.x86_64 21/60 2024-02-10T00:04:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:17.2.7-505.g72ce7c1d.el8.x86_64 21/60 2024-02-10T00:04:06.993 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-osd-2:17.2.7-505.g72ce7c1d.el8.x86_64 22/60 2024-02-10T00:04:07.004 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:17.2.7-505.g72ce7c1d.el8.x86_64 22/60 2024-02-10T00:04:09.020 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-2:17.2.7-505.g72ce7c1d.el8.x86_64 23/60 2024-02-10T00:04:09.351 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-radosgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 24/60 2024-02-10T00:04:09.431 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 24/60 2024-02-10T00:04:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-505.g72ce7c1d 25/60 2024-02-10T00:04:10.097 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-505.g72ce7c1d 25/60 2024-02-10T00:04:10.350 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : rbd-mirror-2:17.2.7-505.g72ce7c1d.el8.x86_64 26/60 2024-02-10T00:04:16.077 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:17.2.7-505.g72ce7c1d.el8.x86_64 26/60 2024-02-10T00:04:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-test-2:17.2.7-505.g72ce7c1d.el8.x86_64 27/60 2024-02-10T00:04:16.625 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libcephfs-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 28/60 2024-02-10T00:04:16.843 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : rbd-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 29/60 2024-02-10T00:04:17.144 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : rbd-nbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 30/60 2024-02-10T00:04:17.342 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : ceph-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 31/60 2024-02-10T00:04:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-02-10T00:04:17.692 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-02-10T00:04:17.700 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-02-10T00:04:17.700 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-02-10T00:04:17.968 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-02-10T00:04:18.126 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-02-10T00:04:18.132 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-02-10T00:04:18.133 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-02-10T00:04:18.351 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-02-10T00:04:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-02-10T00:04:18.524 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-02-10T00:04:18.524 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-02-10T00:04:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-02-10T00:04:18.867 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-02-10T00:04:19.017 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-02-10T00:04:19.023 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-02-10T00:04:19.024 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-02-10T00:04:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-02-10T00:04:19.267 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-02-10T00:04:19.268 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-02-10T00:04:19.617 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-02-10T00:04:19.622 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-02-10T00:04:19.623 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-02-10T00:04:19.792 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-02-10T00:04:19.797 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-02-10T00:04:19.797 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-02-10T00:04:20.017 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-02-10T00:04:20.017 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-02-10T00:04:20.159 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-02-10T00:04:20.179 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-02-10T00:04:20.179 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-02-10T00:04:20.502 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-02-10T00:04:20.503 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-02-10T00:04:20.684 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-02-10T00:04:20.684 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-02-10T00:04:20.917 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-02-10T00:04:21.092 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-02-10T00:04:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-02-10T00:04:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-02-10T00:04:21.558 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-02-10T00:04:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-02-10T00:04:21.775 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-02-10T00:04:22.000 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-02-10T00:04:22.224 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-02-10T00:04:22.225 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-02-10T00:04:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-02-10T00:04:22.652 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-02-10T00:04:22.768 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-02-10T00:04:22.986 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-02-10T00:04:23.167 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-02-10T00:04:23.167 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-02-10T00:04:23.966 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:17.2.7-505.g72ce7c1d.el8.x86_64 1/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:17.2.7-505.g72ce7c1d.el8.x86_64 3/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:17.2.7-505.g72ce7c1d.el8.x86_64 5/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 7/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 9/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-02-10T00:04:23.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-505.g72ce7c1d 11/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:17.2.7-505.g72ce7c1d.el8.x86_64 13/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:17.2.7-505.g72ce7c1d.el8.x86_64 15/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:17.2.7-505.g72ce7c1d.el8.x86_64 17/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:17.2.7-505.g72ce7c1d.el8.x86_64 19/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 21/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:17.2.7-505.g72ce7c1d.el8.x86_64 23/60 2024-02-10T00:04:23.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:17.2.7-505.g72ce7c1d.el8.x86_64 25/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 27/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:17.2.7-505.g72ce7c1d.el8.x86_64 29/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 31/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:17.2.7-505.g72ce7c1d.el8.x86_64 33/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-02-10T00:04:23.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:17.2.7-505.g72ce7c1d.el8.x86_64 35/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:17.2.7-505.g72ce7c1d.el8.x86_64 37/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:17.2.7-505.g72ce7c1d.el8.x86_64 39/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:17.2.7-505.g72ce7c1d.el8.x 41/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86 43/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:17.2.7-505.g72ce7c1d.el8.x86_64 45/60 2024-02-10T00:04:23.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:17.2.7-505.g72ce7c1d.el8.x86_64 47/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 49/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 51/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 53/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:17.2.7-505.g72ce7c1d.el8.x86_64 55/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-02-10T00:04:23.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 57/60 2024-02-10T00:04:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-02-10T00:04:23.972 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-505.g72ce7c1d.el8.n 59/60 2024-02-10T00:04:25.306 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:17.2.7-505.g72ce7c1d.el8.noarch 2024-02-10T00:04:25.307 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:17.2.7-505.g72ce7c1d.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:17.2.7-505.g72ce7c1d.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:25.309 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-02-10T00:04:25.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-02-10T00:04:25.923 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-10T00:04:25.947 INFO:teuthology.orchestra.run.smithi089.stdout:17.2.7-505.g72ce7c1d.el8 2024-02-10T00:04:25.948 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-505.g72ce7c1d.el8 2024-02-10T00:04:25.948 INFO:teuthology.task.install:The correct ceph version 17.2.7-505.g72ce7c1d is installed. 2024-02-10T00:04:25.950 INFO:teuthology.run_tasks:Running task print... 2024-02-10T00:04:25.959 INFO:teuthology.task.print:**** done install.upgrade the host 2024-02-10T00:04:25.959 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-02-10T00:04:25.968 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-10T00:04:25.968 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:25.999 INFO:tasks.ceph.mon.a:Stopped 2024-02-10T00:04:25.999 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-10T00:04:25.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-10T00:04:26.041 INFO:tasks.ceph.mon.a:Started 2024-02-10T00:04:26.041 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-10T00:04:26.042 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:26.053 INFO:tasks.ceph.mon.b:Stopped 2024-02-10T00:04:26.053 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-10T00:04:26.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-10T00:04:26.095 INFO:tasks.ceph.mon.b:Started 2024-02-10T00:04:26.095 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-10T00:04:26.095 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:26.108 INFO:tasks.ceph.mon.c:Stopped 2024-02-10T00:04:26.108 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-10T00:04:26.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-10T00:04:26.151 INFO:tasks.ceph.mon.c:Started 2024-02-10T00:04:26.152 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-10T00:04:26.152 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:26.168 INFO:tasks.ceph.mgr.x:Stopped 2024-02-10T00:04:26.168 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-10T00:04:26.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-10T00:04:26.210 INFO:tasks.ceph.mgr.x:Started 2024-02-10T00:04:26.210 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-10T00:04:26.211 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:26.233 INFO:tasks.ceph.mgr.y:Stopped 2024-02-10T00:04:26.233 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-10T00:04:26.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-10T00:04:26.275 INFO:tasks.ceph.mgr.y:Started 2024-02-10T00:04:26.275 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-02-10T00:04:26.308 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-10T00:04:26.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-10T00:04:26.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-10T00:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.436+0000 7f89781cc700 1 Processor -- start 2024-02-10T00:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.436+0000 7f89781cc700 1 -- start start 2024-02-10T00:04:26.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f89781cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f89781cc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f8970146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f89781cc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897013f6e0 con 0x7f8970063e50 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f89781cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700a8920 con 0x7f89700a9510 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f89781cc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8970064220 con 0x7f89700a75d0 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f8975f68700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8970063e50 0x7f89700a7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58860/0 (socket says 172.21.15.89:58860) 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f8975f68700 1 -- 172.21.15.89:0/1127083562 learned_addr learned my addr 172.21.15.89:0/1127083562 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.437+0000 7f8975767700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8974f66700 1 -- 172.21.15.89:0/1127083562 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015748358 0 0) 0x7f897013f6e0 con 0x7f8970063e50 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8975767700 1 -- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 msgr2=0x7f8970146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8975767700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f8970146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8975767700 1 -- 172.21.15.89:0/1127083562 >> v1:172.21.15.89:6789/0 conn(0x7f8970063e50 legacy=0x7f89700a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8975767700 1 -- 172.21.15.89:0/1127083562 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897013f910 con 0x7f89700a9510 2024-02-10T00:04:26.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8975767700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700afd30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8960009910 tx=0x7f89600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ab9d5ed3263724 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8974f66700 1 -- 172.21.15.89:0/1127083562 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000b860 con 0x7f89700a9510 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8974f66700 1 -- 172.21.15.89:0/1127083562 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896000b9c0 con 0x7f89700a9510 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.438+0000 7f8974f66700 1 -- 172.21.15.89:0/1127083562 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000bd60 con 0x7f89700a9510 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 -- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 msgr2=0x7f89700afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700afd30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8960009910 tx=0x7f89600091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 -- 172.21.15.89:0/1127083562 shutdown_connections 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f8970146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 --2- 172.21.15.89:0/1127083562 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700afd30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 -- 172.21.15.89:0/1127083562 >> 172.21.15.89:0/1127083562 conn(0x7f897006d8c0 msgr2=0x7f8970063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 -- 172.21.15.89:0/1127083562 shutdown_connections 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.439+0000 7f89781cc700 1 -- 172.21.15.89:0/1127083562 wait complete. 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 Processor -- start 2024-02-10T00:04:26.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 -- start start 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f897013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89700ae140 con 0x7f8970063e50 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700ae3e0 con 0x7f89700a9510 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f89781cc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89700aebf0 con 0x7f89700a75d0 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f8975f68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f8976769700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f8976769700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40720/0 (socket says 172.21.15.89:40720) 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f8976769700 1 -- 172.21.15.89:0/1490519362 learned_addr learned my addr 172.21.15.89:0/1490519362 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.440+0000 7f8975f68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60116/0 (socket says 172.21.15.89:60116) 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 -- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 msgr2=0x7f897013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f897013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 -- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 msgr2=0x7f89700adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 -- 172.21.15.89:0/1490519362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960009420 con 0x7f89700a9510 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8975f68700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8976769700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f896800bb60 tx=0x7f8968009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800c8c0 con 0x7f89700a9510 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800ca60 con 0x7f89700a9510 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.441+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800ce20 con 0x7f89700a9510 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.442+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89700ae890 con 0x7f89700a9510 2024-02-10T00:04:26.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.442+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89700abfc0 con 0x7f89700a9510 2024-02-10T00:04:26.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.443+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f8968014620 con 0x7f89700a9510 2024-02-10T00:04:26.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.443+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89700aea20 con 0x7f89700a9510 2024-02-10T00:04:26.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.443+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f896804b6d0 con 0x7f89700a9510 2024-02-10T00:04:26.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.443+0000 7f8975f68700 1 -- 172.21.15.89:0/1490519362 >> v1:172.21.15.89:6816/39389 conn(0x7f8954039500 legacy=0x7f895403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:26.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.446+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f89680300e0 con 0x7f89700a9510 2024-02-10T00:04:26.545 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:26.543+0000 7f0386f2b1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T00:04:26.550 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:26.548+0000 7f29a48591c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T00:04:26.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.602+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f897004c710 con 0x7f89700a9510 2024-02-10T00:04:26.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.605+0000 7f8965ffb700 1 -- 172.21.15.89:0/1490519362 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+85064 (secure 0 0 0) 0x7f8968033700 con 0x7f89700a9510 2024-02-10T00:04:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 >> v1:172.21.15.89:6816/39389 conn(0x7f8954039500 legacy=0x7f895403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 msgr2=0x7f89700aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f896800bb60 tx=0x7f8968009810 comp rx=0 tx=0).stop 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 shutdown_connections 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89700a9510 0x7f89700aac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8970063e50 0x7f89700adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 --2- 172.21.15.89:0/1490519362 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89700a75d0 0x7f897013c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 >> 172.21.15.89:0/1490519362 conn(0x7f897006d8c0 msgr2=0x7f8970071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 shutdown_connections 2024-02-10T00:04:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.607+0000 7f89781cc700 1 -- 172.21.15.89:0/1490519362 wait complete. 2024-02-10T00:04:26.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-02-10T00:04:26.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-02-10T00:04:26.622 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6816","nonce":39389}]},"active_addr":"172.21.15.89:6816/39389","active_change":"2024-02-09T23:58:10.547083+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2640344124}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3978228942}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3039776512}]}]} 2024-02-10T00:04:26.624 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-10T00:04:26.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-10T00:04:26.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:26.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.744+0000 7f9b6a9b5700 1 Processor -- start 2024-02-10T00:04:26.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.744+0000 7f9b6a9b5700 1 -- start start 2024-02-10T00:04:26.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 0x7f9b6406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b6406ce70 0x7f9b64141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b6406d260 0x7f9b64142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640a1130 con 0x7f9b6406ce70 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640a28c0 con 0x7f9b64063740 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b6a9b5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64063b10 con 0x7f9b6406d260 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b6406ce70 0x7f9b64141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 0x7f9b6406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b6406ce70 0x7f9b64141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60124/0 (socket says 172.21.15.89:60124) 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 -- 172.21.15.89:0/3257890530 learned_addr learned my addr 172.21.15.89:0/3257890530 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b68f52700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b6406d260 0x7f9b64142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 -- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b6406d260 msgr2=0x7f9b64142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b6406d260 0x7f9b64142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 -- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 msgr2=0x7f9b6406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 0x7f9b6406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 -- 172.21.15.89:0/3257890530 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b641428c0 con 0x7f9b6406ce70 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b63fff700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 0x7f9b6406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.745+0000 7f9b637fe700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406ce70 0x7f9b64141e40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b580099b0 tx=0x7f9b58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3148c0e379bce21d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b62ffd700 1 -- 172.21.15.89:0/3257890530 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800b680 con 0x7f9b6406ce70 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b62ffd700 1 -- 172.21.15.89:0/3257890530 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800b7e0 con 0x7f9b6406ce70 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b62ffd700 1 -- 172.21.15.89:0/3257890530 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800bb80 con 0x7f9b6406ce70 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406ce70 msgr2=0x7f9b64141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406ce70 0x7f9b64141e40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b580099b0 tx=0x7f9b58009250 comp rx=0 tx=0).stop 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/3257890530 shutdown_connections 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b6406d260 0x7f9b64142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b64063740 0x7f9b6406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/3257890530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406ce70 0x7f9b64141e40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/3257890530 >> 172.21.15.89:0/3257890530 conn(0x7f9b6406a820 msgr2=0x7f9b640b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/3257890530 shutdown_connections 2024-02-10T00:04:26.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.746+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/3257890530 wait complete. 2024-02-10T00:04:26.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.747+0000 7f9b6a9b5700 1 Processor -- start 2024-02-10T00:04:26.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.747+0000 7f9b6a9b5700 1 -- start start 2024-02-10T00:04:26.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b64063740 0x7f9b6409ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406d260 0x7f9b641511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64150fb0 con 0x7f9b6406d260 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6414b6e0 con 0x7f9b6406ce70 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b6a9b5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6409a840 con 0x7f9b64063740 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40746/0 (socket says 172.21.15.89:40746) 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 -- 172.21.15.89:0/2856113738 learned_addr learned my addr 172.21.15.89:0/2856113738 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b68f52700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406d260 0x7f9b641511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b63fff700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b64063740 0x7f9b6409ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 -- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b64063740 msgr2=0x7f9b6409ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b64063740 0x7f9b6409ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 -- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406d260 msgr2=0x7f9b641511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406d260 0x7f9b641511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.748+0000 7f9b637fe700 1 -- 172.21.15.89:0/2856113738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009420 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b637fe700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b580099b0 tx=0x7f9b58017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58002f90 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800b950 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5801a430 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b580094f0 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.749+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b64099c80 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.750+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f9b5801a880 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.750+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64099ed0 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.750+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9b5804d200 con 0x7f9b6406ce70 2024-02-10T00:04:26.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.750+0000 7f9b63fff700 1 -- 172.21.15.89:0/2856113738 >> v1:172.21.15.89:6816/39389 conn(0x7f9b50039500 legacy=0x7f9b5003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:26.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.756+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f9b64099ed0 con 0x7f9b6406ce70 2024-02-10T00:04:26.809 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:26.807+0000 7f29a48591c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T00:04:26.810 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:26.808+0000 7f0386f2b1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T00:04:26.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.880+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b64099ed0 con 0x7f9b6406ce70 2024-02-10T00:04:26.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.881+0000 7f9b4bfff700 1 -- 172.21.15.89:0/2856113738 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11292 (secure 0 0 0) 0x7f9b64099ed0 con 0x7f9b6406ce70 2024-02-10T00:04:26.884 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:26.884 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:39.397746+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 >> v1:172.21.15.89:6816/39389 conn(0x7f9b50039500 legacy=0x7f9b5003b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 msgr2=0x7f9b64099740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b580099b0 tx=0x7f9b58017000 comp rx=0 tx=0).stop 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 shutdown_connections 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b6406d260 0x7f9b641511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b64063740 0x7f9b6409ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 --2- 172.21.15.89:0/2856113738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b6406ce70 0x7f9b64099740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.882+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 >> 172.21.15.89:0/2856113738 conn(0x7f9b6406a820 msgr2=0x7f9b640a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.883+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 shutdown_connections 2024-02-10T00:04:26.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:26.883+0000 7f9b6a9b5700 1 -- 172.21.15.89:0/2856113738 wait complete. 2024-02-10T00:04:26.898 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-10T00:04:26.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:26.944 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:26.942+0000 7f29a48591c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-10T00:04:26.946 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:26.944+0000 7f0386f2b1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-10T00:04:27.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 Processor -- start 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 -- start start 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 0x7f98ec0a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 0x7f98ec13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec0a62d0 con 0x7f98ec0a5a70 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec064220 con 0x7f98ec0a5660 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98f1c73700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0a67f0 con 0x7f98ec063e50 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 0x7f98ec0a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40748/0 (socket says 172.21.15.89:40748) 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98ebfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 0x7f98ec13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.019+0000 7f98eaffd700 1 -- 172.21.15.89:0/2502824877 learned_addr learned my addr 172.21.15.89:0/2502824877 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 -- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 msgr2=0x7f98ec0a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 0x7f98ec0a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 -- 172.21.15.89:0/2502824877 >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 msgr2=0x7f98ec13bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2502824877 >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 0x7f98ec13bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 -- 172.21.15.89:0/2502824877 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0a7510 con 0x7f98ec0a5660 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98ebfff700 1 --2- 172.21.15.89:0/2502824877 >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 0x7f98ec13bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eb7fe700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 0x7f98ec0a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f98e00099b0 tx=0x7f98e0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01aece6af06368d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98ea7fc700 1 -- 172.21.15.89:0/2502824877 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000b680 con 0x7f98ec0a5660 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98ea7fc700 1 -- 172.21.15.89:0/2502824877 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e000b7e0 con 0x7f98ec0a5660 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.020+0000 7f98ea7fc700 1 -- 172.21.15.89:0/2502824877 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000bb80 con 0x7f98ec0a5660 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 -- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 msgr2=0x7f98ec13b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f98e00099b0 tx=0x7f98e0009250 comp rx=0 tx=0).stop 2024-02-10T00:04:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 -- 172.21.15.89:0/2502824877 shutdown_connections 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2502824877 >> v2:172.21.15.89:3300/0 conn(0x7f98ec0a5a70 0x7f98ec13bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec063e50 0x7f98ec0a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2502824877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5660 0x7f98ec13b6c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 -- 172.21.15.89:0/2502824877 >> 172.21.15.89:0/2502824877 conn(0x7f98ec06c7c0 msgr2=0x7f98ec063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 -- 172.21.15.89:0/2502824877 shutdown_connections 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.021+0000 7f98f1c73700 1 -- 172.21.15.89:0/2502824877 wait complete. 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.023+0000 7f98f1c73700 1 Processor -- start 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.023+0000 7f98f1c73700 1 -- start start 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 0x7f98ec14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5a70 0x7f98ec14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec143ff0 con 0x7f98ec063e50 2024-02-10T00:04:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0a8080 con 0x7f98ec0a5a70 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98f1c73700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0a9230 con 0x7f98ec0a5660 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47700/0 (socket says 172.21.15.89:47700) 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 -- 172.21.15.89:0/2302357513 learned_addr learned my addr 172.21.15.89:0/2302357513 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 0x7f98ec14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98ebfff700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5a70 0x7f98ec14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 -- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5a70 msgr2=0x7f98ec14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5a70 0x7f98ec14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 -- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 msgr2=0x7f98ec14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 0x7f98ec14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 -- 172.21.15.89:0/2302357513 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009420 con 0x7f98ec0a5660 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eb7fe700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 0x7f98ec14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.024+0000 7f98eaffd700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009290 tx=0x7f98e0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.025+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000b950 con 0x7f98ec0a5660 2024-02-10T00:04:27.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.025+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e000bab0 con 0x7f98ec0a5660 2024-02-10T00:04:27.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.025+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e4009a20 con 0x7f98ec0a5660 2024-02-10T00:04:27.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.025+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e001a660 con 0x7f98ec0a5660 2024-02-10T00:04:27.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.025+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00094f0 con 0x7f98ec0a5660 2024-02-10T00:04:27.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.026+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f98e001aa90 con 0x7f98ec0a5660 2024-02-10T00:04:27.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.026+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f98e004d210 con 0x7f98ec0a5660 2024-02-10T00:04:27.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.026+0000 7f98eb7fe700 1 -- 172.21.15.89:0/2302357513 >> v1:172.21.15.89:6816/39389 conn(0x7f98d8039500 legacy=0x7f98d803b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.026+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec14c4f0 con 0x7f98ec0a5660 2024-02-10T00:04:27.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.029+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f98e0015070 con 0x7f98ec0a5660 2024-02-10T00:04:27.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.155+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98ec04c710 con 0x7f98ec0a5660 2024-02-10T00:04:27.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.156+0000 7f98d37fe700 1 -- 172.21.15.89:0/2302357513 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11292 (secure 0 0 0) 0x7f98e0015030 con 0x7f98ec0a5660 2024-02-10T00:04:27.158 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:27.158 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-09T23:58:39.397746+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:27.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 >> v1:172.21.15.89:6816/39389 conn(0x7f98d8039500 legacy=0x7f98d803b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 msgr2=0x7f98ec14f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009290 tx=0x7f98e0017000 comp rx=0 tx=0).stop 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 shutdown_connections 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ec0a5a70 0x7f98ec14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ec063e50 0x7f98ec14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 --2- 172.21.15.89:0/2302357513 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f98ec0a5660 0x7f98ec14f340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 >> 172.21.15.89:0/2302357513 conn(0x7f98ec06c7c0 msgr2=0x7f98ec0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 shutdown_connections 2024-02-10T00:04:27.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.158+0000 7f98f1c73700 1 -- 172.21.15.89:0/2302357513 wait complete. 2024-02-10T00:04:27.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-10T00:04:27.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-10T00:04:27.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-10T00:04:27.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-10T00:04:27.261 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.258+0000 7f0386f2b1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T00:04:27.287 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.285+0000 7f29a48591c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T00:04:27.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.319+0000 7f2c9aa51700 1 Processor -- start 2024-02-10T00:04:27.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.319+0000 7f2c9aa51700 1 -- start start 2024-02-10T00:04:27.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c9aa51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 0x7f2c940a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c9aa51700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c940a2250 0x7f2c94146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c9aa51700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c94063b10 con 0x7f2c9409f280 2024-02-10T00:04:27.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c9aa51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940a0580 con 0x7f2c94063740 2024-02-10T00:04:27.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c9aa51700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940a26a0 con 0x7f2c940a2250 2024-02-10T00:04:27.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c98fee700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2c9409f280 0x7f2c9409f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58862/0 (socket says 172.21.15.89:58862) 2024-02-10T00:04:27.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c98fee700 1 -- 172.21.15.89:0/649413333 learned_addr learned my addr 172.21.15.89:0/649413333 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:27.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c93fff700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 0x7f2c940a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c92ffd700 1 -- 172.21.15.89:0/649413333 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400215440 0 0) 0x7f2c94063b10 con 0x7f2c9409f280 2024-02-10T00:04:27.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.320+0000 7f2c92ffd700 1 -- 172.21.15.89:0/649413333 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80003570 con 0x7f2c9409f280 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c937fe700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c940a2250 0x7f2c94146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c93fff700 1 -- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c940a2250 msgr2=0x7f2c94146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c93fff700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c940a2250 0x7f2c94146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c93fff700 1 -- 172.21.15.89:0/649413333 >> v1:172.21.15.89:6789/0 conn(0x7f2c9409f280 legacy=0x7f2c9409f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c93fff700 1 -- 172.21.15.89:0/649413333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940a2910 con 0x7f2c94063740 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c93fff700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 0x7f2c940a1590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009940 tx=0x7f2c7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98dd0f504ebf071d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c92ffd700 1 -- 172.21.15.89:0/649413333 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00b670 con 0x7f2c94063740 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c92ffd700 1 -- 172.21.15.89:0/649413333 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00b7d0 con 0x7f2c94063740 2024-02-10T00:04:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.321+0000 7f2c92ffd700 1 -- 172.21.15.89:0/649413333 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00bb70 con 0x7f2c94063740 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 -- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 msgr2=0x7f2c940a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 0x7f2c940a1590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009940 tx=0x7f2c7c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 -- 172.21.15.89:0/649413333 shutdown_connections 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c94063740 0x7f2c940a1590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 --2- 172.21.15.89:0/649413333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c940a2250 0x7f2c94146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 -- 172.21.15.89:0/649413333 >> 172.21.15.89:0/649413333 conn(0x7f2c9406a820 msgr2=0x7f2c940b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 -- 172.21.15.89:0/649413333 shutdown_connections 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.322+0000 7f2c9aa51700 1 -- 172.21.15.89:0/649413333 wait complete. 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.323+0000 7f2c9aa51700 1 Processor -- start 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 -- start start 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c94063740 0x7f2c940a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9409f280 0x7f2c94155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 0x7f2c94155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aa920 con 0x7f2c9409f280 2024-02-10T00:04:27.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940a8f10 con 0x7f2c940a2250 2024-02-10T00:04:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c9aa51700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aa6b0 con 0x7f2c94063740 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c98fee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 0x7f2c94155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c98fee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 0x7f2c94155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40780/0 (socket says 172.21.15.89:40780) 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.324+0000 7f2c98fee700 1 -- 172.21.15.89:0/4120521849 learned_addr learned my addr 172.21.15.89:0/4120521849 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c93fff700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c94063740 0x7f2c940a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c937fe700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9409f280 0x7f2c94155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 -- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c94063740 msgr2=0x7f2c940a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2c94063740 0x7f2c940a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 -- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9409f280 msgr2=0x7f2c94155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9409f280 0x7f2c94155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 -- 172.21.15.89:0/4120521849 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c009420 con 0x7f2c940a2250 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.325+0000 7f2c98fee700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 0x7f2c94155c90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c001460 tx=0x7f2c8c001ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.326+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00a940 con 0x7f2c940a2250 2024-02-10T00:04:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.326+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00aaa0 con 0x7f2c940a2250 2024-02-10T00:04:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.326+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00ae20 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.326+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940a91d0 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.326+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940a9b40 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.327+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c9404c710 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.327+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f2c8c007300 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.327+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2c8c050170 con 0x7f2c940a2250 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.327+0000 7f2c93fff700 1 -- 172.21.15.89:0/4120521849 >> v1:172.21.15.89:6816/39389 conn(0x7f2c74039550 legacy=0x7f2c7403ba00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.328+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 --> v1:172.21.15.89:6812/39987 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c74045ed0 con 0x7f2c740421f0 2024-02-10T00:04:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.328+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c8c050430 con 0x7f2c940a2250 2024-02-10T00:04:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.331+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== osd.1 v1:172.21.15.89:6812/39987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f2c74045ed0 con 0x7f2c740421f0 2024-02-10T00:04:27.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.352+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 --> v1:172.21.15.89:6812/39987 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c940a9170 con 0x7f2c740421f0 2024-02-10T00:04:27.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.356+0000 7f2c8bfff700 1 -- 172.21.15.89:0/4120521849 <== osd.1 v1:172.21.15.89:6812/39987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 546678321) 0x7f2c940a9170 con 0x7f2c740421f0 2024-02-10T00:04:27.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.356+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 >> v1:172.21.15.89:6812/39987 conn(0x7f2c740421f0 legacy=0x7f2c74044660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.357+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 >> v1:172.21.15.89:6816/39389 conn(0x7f2c74039550 legacy=0x7f2c7403ba00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.357+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 msgr2=0x7f2c94155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.357+0000 7f2c9aa51700 1 --2- 172.21.15.89:0/4120521849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c940a2250 0x7f2c94155c90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c001460 tx=0x7f2c8c001ae0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.357+0000 7f2c98fee700 1 -- 172.21.15.89:0/4120521849 reap_dead start 2024-02-10T00:04:27.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.358+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 shutdown_connections 2024-02-10T00:04:27.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.358+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 >> 172.21.15.89:0/4120521849 conn(0x7f2c9406a820 msgr2=0x7f2c940a1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.358+0000 7f3f4b7a8700 1 Processor -- start 2024-02-10T00:04:27.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.358+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 shutdown_connections 2024-02-10T00:04:27.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f2c9aa51700 1 -- 172.21.15.89:0/4120521849 wait complete. 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.358+0000 7f3f4b7a8700 1 -- start start 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f44063e50 0x7f3f440a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f440a9510 0x7f3f440afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440a8920 con 0x7f3f440a9510 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4413f6e0 con 0x7f3f44063e50 2024-02-10T00:04:27.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.359+0000 7f3f4b7a8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44064220 con 0x7f3f440a75d0 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.360+0000 7f3f49d45700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.360+0000 7f3f49d45700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47722/0 (socket says 172.21.15.89:47722) 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.360+0000 7f3f49d45700 1 -- 172.21.15.89:0/4201101005 learned_addr learned my addr 172.21.15.89:0/4201101005 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.360+0000 7f3f49544700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f44063e50 0x7f3f440a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.360+0000 7f3f48d43700 1 --2- 172.21.15.89:0/4201101005 >> v2:172.21.15.89:3300/0 conn(0x7f3f440a9510 0x7f3f440afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 -- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f44063e50 msgr2=0x7f3f440a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f44063e50 0x7f3f440a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 -- 172.21.15.89:0/4201101005 >> v2:172.21.15.89:3300/0 conn(0x7f3f440a9510 msgr2=0x7f3f440afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 --2- 172.21.15.89:0/4201101005 >> v2:172.21.15.89:3300/0 conn(0x7f3f440a9510 0x7f3f440afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 -- 172.21.15.89:0/4201101005 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4413f910 con 0x7f3f440a75d0 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f49d45700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009f20 tx=0x7f3f3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3d013c3f45b947 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f3bfff700 1 -- 172.21.15.89:0/4201101005 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00e070 con 0x7f3f440a75d0 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f3bfff700 1 -- 172.21.15.89:0/4201101005 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00ba00 con 0x7f3f440a75d0 2024-02-10T00:04:27.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.361+0000 7f3f3bfff700 1 -- 172.21.15.89:0/4201101005 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0092e0 con 0x7f3f440a75d0 2024-02-10T00:04:27.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.362+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 msgr2=0x7f3f4406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.362+0000 7f3f4b7a8700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009f20 tx=0x7f3f3c009840 comp rx=0 tx=0).stop 2024-02-10T00:04:27.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.364+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/4201101005 shutdown_connections 2024-02-10T00:04:27.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.364+0000 7f3f4b7a8700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f440a75d0 0x7f3f4406e550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.364+0000 7f3f4b7a8700 1 --2- 172.21.15.89:0/4201101005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f44063e50 0x7f3f440a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.364+0000 7f3f4b7a8700 1 --2- 172.21.15.89:0/4201101005 >> v2:172.21.15.89:3300/0 conn(0x7f3f440a9510 0x7f3f440afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.364+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/4201101005 >> 172.21.15.89:0/4201101005 conn(0x7f3f4406d8c0 msgr2=0x7f3f44063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.367+0000 7fae99553700 1 Processor -- start 2024-02-10T00:04:27.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.367+0000 7fae99553700 1 -- start start 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae99553700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 0x7fae940a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae99553700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae9414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae99553700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940a06a0 con 0x7fae940a3110 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae99553700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae94146b20 con 0x7fae940a3500 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae99553700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae94145be0 con 0x7fae940637d0 2024-02-10T00:04:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/4201101005 shutdown_connections 2024-02-10T00:04:27.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 0x7fae940a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae927fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fae940a3110 0x7fae9406f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58864/0 (socket says 172.21.15.89:58864) 2024-02-10T00:04:27.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae927fc700 1 -- 172.21.15.89:0/1683993693 learned_addr learned my addr 172.21.15.89:0/1683993693 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.368+0000 7fae937fe700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae9414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae91ffb700 1 -- 172.21.15.89:0/1683993693 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468481595 0 0) 0x7fae940a06a0 con 0x7fae940a3110 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae92ffd700 1 -- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 msgr2=0x7fae9414cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae92ffd700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae9414cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae92ffd700 1 -- 172.21.15.89:0/1683993693 >> v1:172.21.15.89:6789/0 conn(0x7fae940a3110 legacy=0x7fae9406f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae92ffd700 1 -- 172.21.15.89:0/1683993693 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94068970 con 0x7fae940637d0 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae937fe700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae9414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae92ffd700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 0x7fae940a1ca0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae84009910 tx=0x7fae840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b95d61385dd3044 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae91ffb700 1 -- 172.21.15.89:0/1683993693 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84011630 con 0x7fae940637d0 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae91ffb700 1 -- 172.21.15.89:0/1683993693 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84011790 con 0x7fae940637d0 2024-02-10T00:04:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.369+0000 7fae91ffb700 1 -- 172.21.15.89:0/1683993693 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84011b50 con 0x7fae940637d0 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 -- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 msgr2=0x7fae940a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 0x7fae940a1ca0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae84009910 tx=0x7fae840091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 -- 172.21.15.89:0/1683993693 shutdown_connections 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae9414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 --2- 172.21.15.89:0/1683993693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940637d0 0x7fae940a1ca0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae84009910 tx=0x7fae840091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fae99553700 1 -- 172.21.15.89:0/1683993693 >> 172.21.15.89:0/1683993693 conn(0x7fae9406a050 msgr2=0x7fae9406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fae99553700 1 -- 172.21.15.89:0/1683993693 shutdown_connections 2024-02-10T00:04:27.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/4201101005 wait complete. 2024-02-10T00:04:27.374 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.371+0000 7f0386f2b1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T00:04:27.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 Processor -- start 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 -- start start 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f44063e50 0x7f3f440a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f440a75d0 0x7f3f440ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f440a9510 0x7f3f4415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440aa210 con 0x7f3f440a75d0 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440aa830 con 0x7f3f440a9510 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.372+0000 7f3f4b7a8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415a480 con 0x7f3f44063e50 2024-02-10T00:04:27.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49544700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f44063e50 0x7f3f440a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fae99553700 1 -- 172.21.15.89:0/1683993693 wait complete. 2024-02-10T00:04:27.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49544700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f44063e50 0x7f3f440a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47744/0 (socket says 172.21.15.89:47744) 2024-02-10T00:04:27.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49544700 1 -- 172.21.15.89:0/2555692227 learned_addr learned my addr 172.21.15.89:0/2555692227 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7fae99553700 1 Processor -- start 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7fae99553700 1 -- start start 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f48d43700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f440a75d0 0x7f3f440ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f440a9510 0x7f3f4415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 -- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f44063e50 msgr2=0x7f3f440a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3f44063e50 0x7f3f440a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 -- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f440a75d0 msgr2=0x7f3f440ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f440a75d0 0x7f3f440ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.373+0000 7f3f49d45700 1 -- 172.21.15.89:0/2555692227 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009ae0 con 0x7f3f440a9510 2024-02-10T00:04:27.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7f3f49d45700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f440a9510 0x7f3f4415a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c015000 tx=0x7f3f3c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae940a3110 0x7fae940a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae94142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940a87d0 0x7fae941431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940a6b70 con 0x7fae940a3110 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940a71a0 con 0x7fae940a3500 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae99553700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae940a9370 con 0x7fae940a87d0 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae927fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae94142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae927fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae94142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40836/0 (socket says 172.21.15.89:40836) 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae927fc700 1 -- 172.21.15.89:0/2996157086 learned_addr learned my addr 172.21.15.89:0/2996157086 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae927fc700 1 -- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940a87d0 msgr2=0x7fae941431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c008c30 con 0x7f3f440a9510 2024-02-10T00:04:27.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440ab550 con 0x7f3f440a9510 2024-02-10T00:04:27.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7fae937fe700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940a87d0 0x7fae941431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.374+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44144670 con 0x7f3f440a9510 2024-02-10T00:04:27.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c026460 con 0x7f3f440a9510 2024-02-10T00:04:27.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0265d0 con 0x7f3f440a9510 2024-02-10T00:04:27.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae92ffd700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae940a3110 0x7fae940a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f24000fc0 con 0x7f3f440a9510 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f3f3c003040 con 0x7f3f440a9510 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae927fc700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940a87d0 0x7fae941431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae927fc700 1 -- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae940a3110 msgr2=0x7fae940a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae927fc700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae940a3110 0x7fae940a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae927fc700 1 -- 172.21.15.89:0/2996157086 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c009a20 con 0x7fae940a3500 2024-02-10T00:04:27.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.375+0000 7fae937fe700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fae940a87d0 0x7fae941431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-10T00:04:27.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7f3f49544700 1 -- 172.21.15.89:0/2555692227 >> v1:172.21.15.89:6816/39389 conn(0x7f3f28039500 legacy=0x7f3f2803b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3f3c04d4b0 con 0x7f3f440a9510 2024-02-10T00:04:27.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae927fc700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae94142c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c810 tx=0x7fae88007db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 --> v1:172.21.15.89:6800/39988 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f28045e00 con 0x7f3f28042120 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fece0d0f700 1 Processor -- start 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.370+0000 7fece0d0f700 1 -- start start 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc0a4e90 0x7fecdc06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecdc06c880 0x7fecdc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc06d190 0x7fecdc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc06ebb0 con 0x7fecdc06c880 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a5860 con 0x7fecdc0a4e90 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fece0d0f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc06ede0 con 0x7fecdc06d190 2024-02-10T00:04:27.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fecd9d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecdc06c880 0x7fecdc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fecd9d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecdc06c880 0x7fecdc06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60190/0 (socket says 172.21.15.89:60190) 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fecda59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc0a4e90 0x7fecdc06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fecd9d9b700 1 -- 172.21.15.89:0/3190048654 learned_addr learned my addr 172.21.15.89:0/3190048654 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.371+0000 7fecdad9d700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc06d190 0x7fecdc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88005c00 con 0x7fae940a3500 2024-02-10T00:04:27.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88005d60 con 0x7fae940a3500 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88007320 con 0x7fae940a3500 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae84009420 con 0x7fae940a3500 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.376+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940a9090 con 0x7fae940a3500 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 -- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc06d190 msgr2=0x7fecdc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc06d190 0x7fecdc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 -- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc0a4e90 msgr2=0x7fecdc06c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc0a4e90 0x7fecdc06c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 -- 172.21.15.89:0/3190048654 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc06f080 con 0x7fecdc06c880 2024-02-10T00:04:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fecd9d9b700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc06c880 0x7fecdc06cc50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fecd000ba50 tx=0x7fecd000a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dc16330efb415d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.387 INFO:teuthology.orchestra.run.smithi089.stdout:38654705741 2024-02-10T00:04:27.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.377+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fae8801b400 con 0x7fae940a3500 2024-02-10T00:04:27.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fae8804b1e0 con 0x7fae940a3500 2024-02-10T00:04:27.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 --> v1:172.21.15.89:6804/39985 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae9405f3e0 con 0x7fae9413d750 2024-02-10T00:04:27.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:04:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fecd959a700 1 -- 172.21.15.89:0/3190048654 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0009070 con 0x7fecdc06c880 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fecd959a700 1 -- 172.21.15.89:0/3190048654 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000cbf0 con 0x7fecdc06c880 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fecd959a700 1 -- 172.21.15.89:0/3190048654 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000d450 con 0x7fecdc06c880 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fae92ffd700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae940a3110 0x7fae940a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.378+0000 7fae92ffd700 1 -- 172.21.15.89:0/2996157086 >> v1:172.21.15.89:6816/39389 conn(0x7fae80039580 legacy=0x7fae8003ba30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 -- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc06c880 msgr2=0x7fecdc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc06c880 0x7fecdc06cc50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fecd000ba50 tx=0x7fecd000a200 comp rx=0 tx=0).stop 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== osd.3 v1:172.21.15.89:6804/39985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fae9405f3e0 con 0x7fae9413d750 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 -- 172.21.15.89:0/3190048654 shutdown_connections 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc06d190 0x7fecdc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc0a4e90 0x7fecdc06c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 --2- 172.21.15.89:0/3190048654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc06c880 0x7fecdc06cc50 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fecd000ba50 tx=0x7fecd000a200 comp rx=0 tx=0).stop 2024-02-10T00:04:27.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7fece0d0f700 1 -- 172.21.15.89:0/3190048654 >> 172.21.15.89:0/3190048654 conn(0x7fecdc06b6b0 msgr2=0x7fecdc063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f3c028070 con 0x7f3f440a9510 2024-02-10T00:04:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.379+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== osd.2 v1:172.21.15.89:6800/39988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f3f28045e00 con 0x7f3f28042120 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.380+0000 7fece0d0f700 1 -- 172.21.15.89:0/3190048654 shutdown_connections 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.381+0000 7fece0d0f700 1 -- 172.21.15.89:0/3190048654 wait complete. 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.382+0000 7fece0d0f700 1 Processor -- start 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.382+0000 7fece0d0f700 1 -- start start 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 0x7fecdc0a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc0a4e90 0x7fecdc0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc0ad910 0x7fecdc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc14e5b0 con 0x7fecdc0a4e90 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a8980 con 0x7fecdc06d190 2024-02-10T00:04:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fece0d0f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc14e810 con 0x7fecdc0ad910 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fecda59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 0x7fecdc0a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fecda59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 0x7fecdc0a7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40850/0 (socket says 172.21.15.89:40850) 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.383+0000 7fecda59c700 1 -- 172.21.15.89:0/2877308050 learned_addr learned my addr 172.21.15.89:0/2877308050 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 -- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc0ad910 msgr2=0x7fecdc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 --2- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecdc0ad910 0x7fecdc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 -- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc0a4e90 msgr2=0x7fecdc0a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 --2- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecdc0a4e90 0x7fecdc0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 -- 172.21.15.89:0/2877308050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd000b590 con 0x7fecdc06d190 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecda59c700 1 --2- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 0x7fecdc0a7f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feccc00ec80 tx=0x7feccc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00c9d0 con 0x7fecdc06d190 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00cb30 con 0x7fecdc06d190 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc0a7730 con 0x7fecdc06d190 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc013470 con 0x7fecdc06d190 2024-02-10T00:04:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.384+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0a9630 con 0x7fecdc06d190 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.385+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecdc0a6a20 con 0x7fecdc06d190 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.386+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7feccc013820 con 0x7fecdc06d190 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.386+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7feccc04bc00 con 0x7fecdc06d190 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.386+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 --> v1:172.21.15.89:6808/39986 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecbc045ed0 con 0x7fecbc0421f0 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.386+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7feccc050220 con 0x7fecdc06d190 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.386+0000 7fecd9d9b700 1 -- 172.21.15.89:0/2877308050 >> v1:172.21.15.89:6816/39389 conn(0x7fecbc039550 legacy=0x7fecbc03ba00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.388+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== osd.0 v1:172.21.15.89:6808/39986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fecbc045ed0 con 0x7fecbc0421f0 2024-02-10T00:04:27.395 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.389+0000 7f29a48591c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T00:04:27.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.397+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 --> v1:172.21.15.89:6800/39988 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f24002cf0 con 0x7f3f28042120 2024-02-10T00:04:27.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.398+0000 7f3f397fa700 1 -- 172.21.15.89:0/2555692227 <== osd.2 v1:172.21.15.89:6800/39988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3249460934) 0x7f3f24002cf0 con 0x7f3f28042120 2024-02-10T00:04:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.399+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 >> v1:172.21.15.89:6800/39988 conn(0x7f3f28042120 legacy=0x7f3f28044590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.399+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 >> v1:172.21.15.89:6816/39389 conn(0x7f3f28039500 legacy=0x7f3f2803b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.399+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f440a9510 msgr2=0x7f3f4415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.399+0000 7f3f4b7a8700 1 --2- 172.21.15.89:0/2555692227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f440a9510 0x7f3f4415a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c015000 tx=0x7f3f3c018000 comp rx=0 tx=0).stop 2024-02-10T00:04:27.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.401+0000 7f3f49d45700 1 -- 172.21.15.89:0/2555692227 reap_dead start 2024-02-10T00:04:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.401+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 shutdown_connections 2024-02-10T00:04:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.401+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 >> 172.21.15.89:0/2555692227 conn(0x7f3f4406d8c0 msgr2=0x7f3f4406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.402+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 shutdown_connections 2024-02-10T00:04:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.402+0000 7f3f4b7a8700 1 -- 172.21.15.89:0/2555692227 wait complete. 2024-02-10T00:04:27.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.404+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 --> v1:172.21.15.89:6804/39985 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae940a2670 con 0x7fae9413d750 2024-02-10T00:04:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.405+0000 7fae7affd700 1 -- 172.21.15.89:0/2996157086 <== osd.3 v1:172.21.15.89:6804/39985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 868570565) 0x7fae940a2670 con 0x7fae9413d750 2024-02-10T00:04:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.406+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 >> v1:172.21.15.89:6804/39985 conn(0x7fae9413d750 legacy=0x7fae9413db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.414+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 >> v1:172.21.15.89:6816/39389 conn(0x7fae80039580 legacy=0x7fae8003ba30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.414+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 msgr2=0x7fae94142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.414+0000 7fae99553700 1 --2- 172.21.15.89:0/2996157086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae940a3500 0x7fae94142c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c810 tx=0x7fae88007db0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.414+0000 7fae937fe700 1 -- 172.21.15.89:0/2996157086 reap_dead start 2024-02-10T00:04:27.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.415+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 --> v1:172.21.15.89:6808/39986 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecdc14d820 con 0x7fecbc0421f0 2024-02-10T00:04:27.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.415+0000 7fecca7fc700 1 -- 172.21.15.89:0/2877308050 <== osd.0 v1:172.21.15.89:6808/39986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 546678321) 0x7fecdc14d820 con 0x7fecbc0421f0 2024-02-10T00:04:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.416+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 >> v1:172.21.15.89:6808/39986 conn(0x7fecbc0421f0 legacy=0x7fecbc044660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.416+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 >> v1:172.21.15.89:6816/39389 conn(0x7fecbc039550 legacy=0x7fecbc03ba00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.416+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 msgr2=0x7fecdc0a7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.416+0000 7fece0d0f700 1 --2- 172.21.15.89:0/2877308050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecdc06d190 0x7fecdc0a7f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feccc00ec80 tx=0x7feccc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.416+0000 7fecdad9d700 1 -- 172.21.15.89:0/2877308050 reap_dead start 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.418+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 shutdown_connections 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.418+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 >> 172.21.15.89:0/2996157086 conn(0x7fae9406a050 msgr2=0x7fae94064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.421+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 shutdown_connections 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.420+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 shutdown_connections 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.420+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 >> 172.21.15.89:0/2877308050 conn(0x7fecdc06b6b0 msgr2=0x7fecdc06d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.421+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 shutdown_connections 2024-02-10T00:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.421+0000 7fece0d0f700 1 -- 172.21.15.89:0/2877308050 wait complete. 2024-02-10T00:04:27.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.421+0000 7fae99553700 1 -- 172.21.15.89:0/2996157086 wait complete. 2024-02-10T00:04:27.428 INFO:teuthology.orchestra.run.smithi089.stdout:38654705743 2024-02-10T00:04:27.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:04:27.445 INFO:teuthology.orchestra.run.smithi089.stdout:38654705741 2024-02-10T00:04:27.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:04:27.447 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:27.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:04:27.522 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.520+0000 7f0386f2b1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T00:04:27.532 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.529+0000 7f29a48591c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T00:04:27.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.548+0000 7f500f0eb700 1 Processor -- start 2024-02-10T00:04:27.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.548+0000 7f500f0eb700 1 -- start start 2024-02-10T00:04:27.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.549+0000 7f500f0eb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f50080a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.549+0000 7f500f0eb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f50080a2250 0x7f5008146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.549+0000 7f500f0eb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5008063b10 con 0x7f500809f280 2024-02-10T00:04:27.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.549+0000 7f500f0eb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080a0580 con 0x7f50080a2250 2024-02-10T00:04:27.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.549+0000 7f500f0eb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a26a0 con 0x7f5008063740 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f500d688700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f500809f280 0x7f500809f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58876/0 (socket says 172.21.15.89:58876) 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f500d688700 1 -- 172.21.15.89:0/4152383557 learned_addr learned my addr 172.21.15.89:0/4152383557 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f5007fff700 1 --2- 172.21.15.89:0/4152383557 >> v2:172.21.15.89:3300/0 conn(0x7f50080a2250 0x7f5008146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f5007fff700 1 -- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 msgr2=0x7f50080a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f5007fff700 1 --2- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f50080a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f5007fff700 1 -- 172.21.15.89:0/4152383557 >> v1:172.21.15.89:6789/0 conn(0x7f500809f280 legacy=0x7f500809f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.550+0000 7f5007fff700 1 -- 172.21.15.89:0/4152383557 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080a2910 con 0x7f50080a2250 2024-02-10T00:04:27.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.555+0000 7f5007fff700 1 --2- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50080a2250 0x7f5008146530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098e0 tx=0x7f4ff40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf233694e544587 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.556+0000 7f50077fe700 1 -- 172.21.15.89:0/4152383557 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4009e80 con 0x7f50080a2250 2024-02-10T00:04:27.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f50077fe700 1 -- 172.21.15.89:0/4152383557 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400b860 con 0x7f50080a2250 2024-02-10T00:04:27.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f50077fe700 1 -- 172.21.15.89:0/4152383557 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400bbe0 con 0x7f50080a2250 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 -- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50080a2250 msgr2=0x7f5008146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 --2- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50080a2250 0x7f5008146530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098e0 tx=0x7f4ff40091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 -- 172.21.15.89:0/4152383557 shutdown_connections 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 --2- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f50080a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 --2- 172.21.15.89:0/4152383557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50080a2250 0x7f5008146530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.557+0000 7f500f0eb700 1 -- 172.21.15.89:0/4152383557 >> 172.21.15.89:0/4152383557 conn(0x7f500806a820 msgr2=0x7f50080b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.558+0000 7f500f0eb700 1 -- 172.21.15.89:0/4152383557 shutdown_connections 2024-02-10T00:04:27.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.558+0000 7f500f0eb700 1 -- 172.21.15.89:0/4152383557 wait complete. 2024-02-10T00:04:27.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.559+0000 7f500f0eb700 1 Processor -- start 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.559+0000 7f500f0eb700 1 -- start start 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50080a2250 0x7f5008155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a8400 con 0x7f500809f280 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008148b60 con 0x7f50080a2250 2024-02-10T00:04:27.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500f0eb700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a6910 con 0x7f5008063740 2024-02-10T00:04:27.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f5007fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500ce87700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f5007fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60234/0 (socket says 172.21.15.89:60234) 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500ce87700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47786/0 (socket says 172.21.15.89:47786) 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f5007fff700 1 -- 172.21.15.89:0/424186333 learned_addr learned my addr 172.21.15.89:0/424186333 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.560+0000 7f500d688700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50080a2250 0x7f5008155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 -- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50080a2250 msgr2=0x7f5008155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50080a2250 0x7f5008155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 -- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 msgr2=0x7f50080a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 -- 172.21.15.89:0/424186333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009420 con 0x7f5008063740 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f5007fff700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500ce87700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00b5e0 tx=0x7f4ffc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00f510 con 0x7f5008063740 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00f690 con 0x7f5008063740 2024-02-10T00:04:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080a6bb0 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00fa50 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.561+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080a9220 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.563+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f4ffc01a400 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.563+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804c710 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.563+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4ffc04b2b0 con 0x7f5008063740 2024-02-10T00:04:27.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.563+0000 7f5007fff700 1 -- 172.21.15.89:0/424186333 >> v1:172.21.15.89:6816/39389 conn(0x7f4fec039530 legacy=0x7f4fec03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.566+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f4ffc02fbc0 con 0x7f5008063740 2024-02-10T00:04:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.610+0000 7f9fb8738700 1 Processor -- start 2024-02-10T00:04:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.610+0000 7f9fb8738700 1 -- start start 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fb0063e50 0x7f9fb009fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 0x7f9fb0142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f440 0x7f9fb0142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb009f890 con 0x7f9fb0063e50 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0064220 con 0x7f9fb006f440 2024-02-10T00:04:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.611+0000 7f9fb8738700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0142800 con 0x7f9fb006f030 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb5cd3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 0x7f9fb0142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fb0063e50 0x7f9fb009fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb5cd3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 0x7f9fb0142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47800/0 (socket says 172.21.15.89:47800) 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb5cd3700 1 -- 172.21.15.89:0/2916590556 learned_addr learned my addr 172.21.15.89:0/2916590556 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb6cd5700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f440 0x7f9fb0142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 -- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 msgr2=0x7f9fb0142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 0x7f9fb0142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 -- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f440 msgr2=0x7f9fb0142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f440 0x7f9fb0142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 -- 172.21.15.89:0/2916590556 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00a0260 con 0x7f9fb0063e50 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb64d4700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb009fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00098e0 tx=0x7f9fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5d37cafa827642 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.612+0000 7f9fb54d2700 1 -- 172.21.15.89:0/2916590556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000b640 con 0x7f9fb0063e50 2024-02-10T00:04:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.613+0000 7f9fb54d2700 1 -- 172.21.15.89:0/2916590556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000b7a0 con 0x7f9fb0063e50 2024-02-10T00:04:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.613+0000 7f9fb54d2700 1 -- 172.21.15.89:0/2916590556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000bb40 con 0x7f9fb0063e50 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.613+0000 7f9fb8738700 1 -- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 msgr2=0x7f9fb009fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb009fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00098e0 tx=0x7f9fa00091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 -- 172.21.15.89:0/2916590556 shutdown_connections 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f440 0x7f9fb0142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb009fd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 --2- 172.21.15.89:0/2916590556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f030 0x7f9fb0142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 -- 172.21.15.89:0/2916590556 >> 172.21.15.89:0/2916590556 conn(0x7f9fb006c7c0 msgr2=0x7f9fb0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 -- 172.21.15.89:0/2916590556 shutdown_connections 2024-02-10T00:04:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.614+0000 7f9fb8738700 1 -- 172.21.15.89:0/2916590556 wait complete. 2024-02-10T00:04:27.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.615+0000 7f9fb8738700 1 Processor -- start 2024-02-10T00:04:27.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.615+0000 7f9fb8738700 1 -- start start 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb00a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f440 0x7f9fb0143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00a68b0 con 0x7f9fb0063e50 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0145530 con 0x7f9fb006f030 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.616+0000 7f9fb8738700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00a63b0 con 0x7f9fb006f440 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb64d4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb00a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb64d4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb00a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60254/0 (socket says 172.21.15.89:60254) 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb64d4700 1 -- 172.21.15.89:0/3243892451 learned_addr learned my addr 172.21.15.89:0/3243892451 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40866/0 (socket says 172.21.15.89:40866) 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 -- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f440 msgr2=0x7f9fb0143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f440 0x7f9fb0143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 -- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 msgr2=0x7f9fb00a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb00a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 -- 172.21.15.89:0/3243892451 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0009420 con 0x7f9fb006f030 2024-02-10T00:04:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.617+0000 7f9fb5cd3700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006d40 tx=0x7f9fac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.618+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac013680 con 0x7f9fb006f030 2024-02-10T00:04:27.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.618+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0137e0 con 0x7f9fb006f030 2024-02-10T00:04:27.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.618+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac013b60 con 0x7f9fb006f030 2024-02-10T00:04:27.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.619+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb00a60d0 con 0x7f9fb006f030 2024-02-10T00:04:27.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.619+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb0144e90 con 0x7f9fb006f030 2024-02-10T00:04:27.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.620+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb004c710 con 0x7f9fb006f030 2024-02-10T00:04:27.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.620+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f9fac00c460 con 0x7f9fb006f030 2024-02-10T00:04:27.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.621+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9fac04b990 con 0x7f9fb006f030 2024-02-10T00:04:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.621+0000 7f9fb64d4700 1 -- 172.21.15.89:0/3243892451 >> v1:172.21.15.89:6816/39389 conn(0x7f9f9c039660 legacy=0x7f9f9c03bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.627+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f9fac033cd0 con 0x7f9fb006f030 2024-02-10T00:04:27.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.665+0000 7f4799330700 1 Processor -- start 2024-02-10T00:04:27.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.665+0000 7f4799330700 1 -- start start 2024-02-10T00:04:27.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47940b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f479406cb90 0x7f4794063580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479406e2d0 con 0x7f479406cb90 2024-02-10T00:04:27.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479406eb50 con 0x7f479406cfe0 2024-02-10T00:04:27.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.666+0000 7f4799330700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f479406edd0 con 0x7f479406f630 2024-02-10T00:04:27.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f47937fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f47937fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40880/0 (socket says 172.21.15.89:40880) 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f47937fe700 1 -- 172.21.15.89:0/3885272667 learned_addr learned my addr 172.21.15.89:0/3885272667 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47940b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f47927fc700 1 --2- 172.21.15.89:0/3885272667 >> v2:172.21.15.89:3300/0 conn(0x7f479406cb90 0x7f4794063580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 -- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 msgr2=0x7f4794139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 -- 172.21.15.89:0/3885272667 >> v2:172.21.15.89:3300/0 conn(0x7f479406cb90 msgr2=0x7f4794063580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 --2- 172.21.15.89:0/3885272667 >> v2:172.21.15.89:3300/0 conn(0x7f479406cb90 0x7f4794063580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f4792ffd700 1 -- 172.21.15.89:0/3885272667 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479406dbb0 con 0x7f479406f630 2024-02-10T00:04:27.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.667+0000 7f47937fe700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:27.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.669+0000 7f4792ffd700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47940b18b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47880098e0 tx=0x7f47880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d0cc2df0d6e85a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.670+0000 7f4791ffb700 1 -- 172.21.15.89:0/3885272667 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011630 con 0x7f479406f630 2024-02-10T00:04:27.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.670+0000 7f4791ffb700 1 -- 172.21.15.89:0/3885272667 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788011790 con 0x7f479406f630 2024-02-10T00:04:27.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.670+0000 7f4791ffb700 1 -- 172.21.15.89:0/3885272667 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011b30 con 0x7f479406f630 2024-02-10T00:04:27.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 -- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 msgr2=0x7f47940b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47940b18b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47880098e0 tx=0x7f47880091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 -- 172.21.15.89:0/3885272667 shutdown_connections 2024-02-10T00:04:27.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 --2- 172.21.15.89:0/3885272667 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47940b18b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 --2- 172.21.15.89:0/3885272667 >> v2:172.21.15.89:3300/0 conn(0x7f479406cb90 0x7f4794063580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 -- 172.21.15.89:0/3885272667 >> 172.21.15.89:0/3885272667 conn(0x7f479406a820 msgr2=0x7f47940b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 -- 172.21.15.89:0/3885272667 shutdown_connections 2024-02-10T00:04:27.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.671+0000 7f4799330700 1 -- 172.21.15.89:0/3885272667 wait complete. 2024-02-10T00:04:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.673+0000 7f4799330700 1 Processor -- start 2024-02-10T00:04:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.673+0000 7f4799330700 1 -- start start 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.673+0000 7f4799330700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479406cb90 0x7f47940972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4799330700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4799330700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47941294c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4799330700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479412b210 con 0x7f479406cb90 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4799330700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479412cc80 con 0x7f479406cfe0 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4799330700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f479412cf40 con 0x7f479406f630 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40886/0 (socket says 172.21.15.89:40886) 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 -- 172.21.15.89:0/112597939 learned_addr learned my addr 172.21.15.89:0/112597939 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f4792ffd700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479406cb90 0x7f47940972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 -- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 msgr2=0x7f47941294c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47941294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 -- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479406cb90 msgr2=0x7f47940972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479406cb90 0x7f47940972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 -- 172.21.15.89:0/112597939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009ae0 con 0x7f479406cfe0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.674+0000 7f47927fc700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f478400ec50 tx=0x7f47840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.675+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400c9d0 con 0x7f479406cfe0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.675+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400cb30 con 0x7f479406cfe0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.675+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4788009420 con 0x7f479406cfe0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.675+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784013470 con 0x7f479406cfe0 2024-02-10T00:04:27.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.675+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794097830 con 0x7f479406cfe0 2024-02-10T00:04:27.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.676+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479404c710 con 0x7f479406cfe0 2024-02-10T00:04:27.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.677+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f4784013820 con 0x7f479406cfe0 2024-02-10T00:04:27.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.678+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f478404bbb0 con 0x7f479406cfe0 2024-02-10T00:04:27.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.678+0000 7f4792ffd700 1 -- 172.21.15.89:0/112597939 >> v1:172.21.15.89:6816/39389 conn(0x7f4780039500 legacy=0x7f478003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.678+0000 7fcd7a551700 1 Processor -- start 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.678+0000 7fcd7a551700 1 -- start start 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd74139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd7413a390 0x7fcd740a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7406e2d0 con 0x7fcd7413a390 2024-02-10T00:04:27.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740b1c80 con 0x7fcd740b18b0 2024-02-10T00:04:27.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd7a551700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7406eb50 con 0x7fcd7406f630 2024-02-10T00:04:27.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd73fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.679+0000 7fcd73fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40896/0 (socket says 172.21.15.89:40896) 2024-02-10T00:04:27.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 -- 172.21.15.89:0/3143827211 learned_addr learned my addr 172.21.15.89:0/3143827211 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd78aee700 1 --2- 172.21.15.89:0/3143827211 >> v2:172.21.15.89:3300/0 conn(0x7fcd7413a390 0x7fcd740a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd737fe700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd74139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 -- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 msgr2=0x7fcd74139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd74139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 -- 172.21.15.89:0/3143827211 >> v2:172.21.15.89:3300/0 conn(0x7fcd7413a390 msgr2=0x7fcd740a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 --2- 172.21.15.89:0/3143827211 >> v2:172.21.15.89:3300/0 conn(0x7fcd7413a390 0x7fcd740a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 -- 172.21.15.89:0/3143827211 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7406edd0 con 0x7fcd740b18b0 2024-02-10T00:04:27.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.680+0000 7fcd73fff700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00ba50 tx=0x7fcd5c00a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ca618be46e35f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.684+0000 7fcd72ffd700 1 -- 172.21.15.89:0/3143827211 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c009070 con 0x7fcd740b18b0 2024-02-10T00:04:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.684+0000 7fcd72ffd700 1 -- 172.21.15.89:0/3143827211 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c00cb60 con 0x7fcd740b18b0 2024-02-10T00:04:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.684+0000 7fcd72ffd700 1 -- 172.21.15.89:0/3143827211 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00d450 con 0x7fcd740b18b0 2024-02-10T00:04:27.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.684+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f4784033ef0 con 0x7f479406cfe0 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 -- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 msgr2=0x7fcd7406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00ba50 tx=0x7fcd5c00a200 comp rx=0 tx=0).stop 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 -- 172.21.15.89:0/3143827211 shutdown_connections 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 --2- 172.21.15.89:0/3143827211 >> v2:172.21.15.89:3300/0 conn(0x7fcd7413a390 0x7fcd740a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd740b18b0 0x7fcd7406cb90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 --2- 172.21.15.89:0/3143827211 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd74139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.685+0000 7fcd7a551700 1 -- 172.21.15.89:0/3143827211 >> 172.21.15.89:0/3143827211 conn(0x7fcd7406a820 msgr2=0x7fcd740b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.692 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.690+0000 7f29a48591c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T00:04:27.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.693+0000 7fcd7a551700 1 -- 172.21.15.89:0/3143827211 shutdown_connections 2024-02-10T00:04:27.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.693+0000 7fcd7a551700 1 -- 172.21.15.89:0/3143827211 wait complete. 2024-02-10T00:04:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.694+0000 7fcd7a551700 1 Processor -- start 2024-02-10T00:04:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.695+0000 7fcd7a551700 1 -- start start 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd740a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 0x7fcd7414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740a63b0 con 0x7fcd740b18b0 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740a6d00 con 0x7fcd7413a390 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd7a551700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740a6f60 con 0x7fcd7406f630 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd737fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 0x7fcd7414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40902/0 (socket says 172.21.15.89:40902) 2024-02-10T00:04:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd737fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 0x7fcd7414c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60282/0 (socket says 172.21.15.89:60282) 2024-02-10T00:04:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 -- 172.21.15.89:0/294451132 learned_addr learned my addr 172.21.15.89:0/294451132 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:27.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 -- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 msgr2=0x7fcd740a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd740a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 -- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 msgr2=0x7fcd7414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 0x7fcd7414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.696+0000 7fcd78aee700 1 -- 172.21.15.89:0/294451132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c00b590 con 0x7fcd7413a390 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd78aee700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c010230 tx=0x7fcd6c00f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c012050 con 0x7fcd7413a390 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c013040 con 0x7fcd7413a390 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00d4f0 con 0x7fcd7413a390 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd740a88d0 con 0x7fcd7413a390 2024-02-10T00:04:27.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.697+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd740a5d10 con 0x7fcd7413a390 2024-02-10T00:04:27.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.698+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fcd6c00b960 con 0x7fcd7413a390 2024-02-10T00:04:27.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.699+0000 7fcd73fff700 1 -- 172.21.15.89:0/294451132 >> v1:172.21.15.89:6816/39389 conn(0x7fcd54039500 legacy=0x7fcd5403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.699+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcd6c04fe10 con 0x7fcd7413a390 2024-02-10T00:04:27.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.701+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd740a5ed0 con 0x7fcd7413a390 2024-02-10T00:04:27.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.706+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fcd6c0382b0 con 0x7fcd7413a390 2024-02-10T00:04:27.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.715+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50080b0760 con 0x7f5008063740 2024-02-10T00:04:27.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.715+0000 7f5004ff9700 1 -- 172.21.15.89:0/424186333 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ffc0331e0 con 0x7f5008063740 2024-02-10T00:04:27.720 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 >> v1:172.21.15.89:6816/39389 conn(0x7f4fec039530 legacy=0x7f4fec03b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 msgr2=0x7f5008148620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00b5e0 tx=0x7f4ffc0090f0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 shutdown_connections 2024-02-10T00:04:27.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50080a2250 0x7f5008155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5008063740 0x7f5008148620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 --2- 172.21.15.89:0/424186333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500809f280 0x7f50080a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.720+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 >> 172.21.15.89:0/424186333 conn(0x7f500806a820 msgr2=0x7f50080aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.721+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 shutdown_connections 2024-02-10T00:04:27.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.721+0000 7f500f0eb700 1 -- 172.21.15.89:0/424186333 wait complete. 2024-02-10T00:04:27.729 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.727+0000 7f0386f2b1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T00:04:27.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.1 2024-02-10T00:04:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.776+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fb00b0e00 con 0x7f9fb006f030 2024-02-10T00:04:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.777+0000 7f9fa67fc700 1 -- 172.21.15.89:0/3243892451 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fac0338c0 con 0x7f9fb006f030 2024-02-10T00:04:27.779 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 >> v1:172.21.15.89:6816/39389 conn(0x7f9f9c039660 legacy=0x7f9f9c03bb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 msgr2=0x7f9fb0143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006d40 tx=0x7f9fac009250 comp rx=0 tx=0).stop 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 shutdown_connections 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9fb006f440 0x7f9fb0143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0063e50 0x7f9fb00a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 --2- 172.21.15.89:0/3243892451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb006f030 0x7f9fb0143990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 >> 172.21.15.89:0/3243892451 conn(0x7f9fb006c7c0 msgr2=0x7f9fb00b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 shutdown_connections 2024-02-10T00:04:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.778+0000 7f9fb8738700 1 -- 172.21.15.89:0/3243892451 wait complete. 2024-02-10T00:04:27.791 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.789+0000 7f29a48591c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T00:04:27.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705743 got 38654705742 for osd.2 2024-02-10T00:04:27.842 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.839+0000 7f0386f2b1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T00:04:27.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.865+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd740a30a0 con 0x7fcd7413a390 2024-02-10T00:04:27.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.865+0000 7fcd6bfff700 1 -- 172.21.15.89:0/294451132 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd6c037ea0 con 0x7fcd7413a390 2024-02-10T00:04:27.868 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:27.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.867+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 >> v1:172.21.15.89:6816/39389 conn(0x7fcd54039500 legacy=0x7fcd5403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.867+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 msgr2=0x7fcd7414ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.867+0000 7fcd7a551700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c010230 tx=0x7fcd6c00f040 comp rx=0 tx=0).stop 2024-02-10T00:04:27.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 shutdown_connections 2024-02-10T00:04:27.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7413a390 0x7fcd7414ca30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcd7406f630 0x7fcd740a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 --2- 172.21.15.89:0/294451132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd740b18b0 0x7fcd7414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 >> 172.21.15.89:0/294451132 conn(0x7fcd7406a820 msgr2=0x7fcd74139af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 shutdown_connections 2024-02-10T00:04:27.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.868+0000 7fcd7a551700 1 -- 172.21.15.89:0/294451132 wait complete. 2024-02-10T00:04:27.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.879+0000 7f4792ffd700 1 -- 172.21.15.89:0/112597939 >> v1:172.21.15.89:6816/39389 conn(0x7f4780039500 legacy=0x7f478003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:27.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.0 2024-02-10T00:04:27.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.900+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f479406f410 con 0x7f479406cfe0 2024-02-10T00:04:27.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.901+0000 7f477affd700 1 -- 172.21.15.89:0/112597939 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4784033ae0 con 0x7f479406cfe0 2024-02-10T00:04:27.903 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:27.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 >> v1:172.21.15.89:6816/39389 conn(0x7f4780039500 legacy=0x7f478003b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:27.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 msgr2=0x7f4794128f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:27.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f478400ec50 tx=0x7f47840091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 shutdown_connections 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f479406f630 0x7f47941294c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479406cb90 0x7f47940972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 --2- 172.21.15.89:0/112597939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479406cfe0 0x7f4794128f80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.902+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 >> 172.21.15.89:0/112597939 conn(0x7f479406a820 msgr2=0x7f47940680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.903+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 shutdown_connections 2024-02-10T00:04:27.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:27.903+0000 7f4799330700 1 -- 172.21.15.89:0/112597939 wait complete. 2024-02-10T00:04:27.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705740 for osd.3 2024-02-10T00:04:27.927 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:27.925+0000 7f29a48591c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T00:04:27.981 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:27.979+0000 7f0386f2b1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T00:04:28.004 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.002+0000 7f29a48591c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T00:04:28.057 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.055+0000 7f0386f2b1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T00:04:28.080 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.078+0000 7f29a48591c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-10T00:04:28.133 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.131+0000 7f0386f2b1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-10T00:04:28.259 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.257+0000 7f29a48591c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T00:04:28.285 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.283+0000 7f0386f2b1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T00:04:28.417 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.415+0000 7f29a48591c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T00:04:28.418 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.416+0000 7f0386f2b1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T00:04:28.514 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.511+0000 7f29a48591c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T00:04:28.517 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.515+0000 7f0386f2b1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T00:04:28.669 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.667+0000 7f0386f2b1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T00:04:28.669 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.667+0000 7f29a48591c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T00:04:28.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:04:28.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:04:28.840 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.838+0000 7f0386f2b1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T00:04:28.841 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.839+0000 7f29a48591c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T00:04:28.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.868+0000 7f4fad837700 1 Processor -- start 2024-02-10T00:04:28.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.868+0000 7f4fad837700 1 -- start start 2024-02-10T00:04:28.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fad837700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fa806ce70 0x7f4fa8141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fad837700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa806d260 0x7f4fa8142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fad837700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa80a28c0 con 0x7f4fa8063740 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fad837700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa806e8d0 con 0x7f4fa806ce70 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fad837700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80a1130 con 0x7f4fa806d260 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fa6ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4fa8063740 0x7f4fa806e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58882/0 (socket says 172.21.15.89:58882) 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fa6ffd700 1 -- 172.21.15.89:0/1594545877 learned_addr learned my addr 172.21.15.89:0/1594545877 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fa67fc700 1 --2- 172.21.15.89:0/1594545877 >> v2:172.21.15.89:3300/0 conn(0x7f4fa806ce70 0x7f4fa8141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fa77fe700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa806d260 0x7f4fa8142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.869+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142934993 0 0) 0x7f4fa80a28c0 con 0x7f4fa8063740 2024-02-10T00:04:28.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f90003570 con 0x7f4fa8063740 2024-02-10T00:04:28.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256161757 0 0) 0x7f4f90003570 con 0x7f4fa8063740 2024-02-10T00:04:28.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa67fc700 1 -- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa806d260 msgr2=0x7f4fa8142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:28.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa67fc700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa806d260 0x7f4fa8142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa67fc700 1 -- 172.21.15.89:0/1594545877 >> v1:172.21.15.89:6789/0 conn(0x7f4fa8063740 legacy=0x7f4fa806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa67fc700 1 -- 172.21.15.89:0/1594545877 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8063b10 con 0x7f4fa806ce70 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa67fc700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806ce70 0x7f4fa8141e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098e0 tx=0x7f4f9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4869a83cffa32982 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98001470 con 0x7f4fa806ce70 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c011420 con 0x7f4fa806ce70 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.870+0000 7f4fa5ffb700 1 -- 172.21.15.89:0/1594545877 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0117a0 con 0x7f4fa806ce70 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 -- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806ce70 msgr2=0x7f4fa8141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806ce70 0x7f4fa8141e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098e0 tx=0x7f4f9c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 -- 172.21.15.89:0/1594545877 shutdown_connections 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa806d260 0x7f4fa8142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 --2- 172.21.15.89:0/1594545877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806ce70 0x7f4fa8141e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 -- 172.21.15.89:0/1594545877 >> 172.21.15.89:0/1594545877 conn(0x7f4fa806a820 msgr2=0x7f4fa80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 -- 172.21.15.89:0/1594545877 shutdown_connections 2024-02-10T00:04:28.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.871+0000 7f4fad837700 1 -- 172.21.15.89:0/1594545877 wait complete. 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.872+0000 7f4fad837700 1 Processor -- start 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.872+0000 7f4fad837700 1 -- start start 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 0x7f4fa8098090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fa806ce70 0x7f4fa8096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80ace70 con 0x7f4fa806d260 2024-02-10T00:04:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa814e8a0 con 0x7f4fa8063740 2024-02-10T00:04:28.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fad837700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa8096fb0 con 0x7f4fa806ce70 2024-02-10T00:04:28.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fa6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 0x7f4fa8098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fa77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fa6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 0x7f4fa8098090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40914/0 (socket says 172.21.15.89:40914) 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fa77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60306/0 (socket says 172.21.15.89:60306) 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.873+0000 7f4fa6ffd700 1 -- 172.21.15.89:0/1361797077 learned_addr learned my addr 172.21.15.89:0/1361797077 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 -- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fa806ce70 msgr2=0x7f4fa8096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fa806ce70 0x7f4fa8096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 -- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 msgr2=0x7f4fa8098090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 0x7f4fa8098090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 -- 172.21.15.89:0/1361797077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c009420 con 0x7f4fa806d260 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fa77fe700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ecc0 tx=0x7f4fa000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000c970 con 0x7f4fa806d260 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa814dda0 con 0x7f4fa806d260 2024-02-10T00:04:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa80aca10 con 0x7f4fa806d260 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000f040 con 0x7f4fa806d260 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.874+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000cd40 con 0x7f4fa806d260 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.875+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f4fa0014690 con 0x7f4fa806d260 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.875+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f880052a0 con 0x7f4fa806d260 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.875+0000 7f4fa6ffd700 1 -- 172.21.15.89:0/1361797077 >> v1:172.21.15.89:6816/39389 conn(0x7f4f94039500 legacy=0x7f4f9403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:28.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.875+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4fa004c2e0 con 0x7f4fa806d260 2024-02-10T00:04:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.881+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f4fa0034660 con 0x7f4fa806d260 2024-02-10T00:04:28.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:04:28.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:04:28.924 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:28.922+0000 7f29a48591c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T00:04:28.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.924+0000 7f8e8c803700 1 Processor -- start 2024-02-10T00:04:28.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.924+0000 7f8e8c803700 1 -- start start 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8c803700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e880a4e40 0x7f8e8813f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8c803700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e8813feb0 0x7f8e881467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8c803700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8813f480 con 0x7f8e88063580 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8c803700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e88140350 con 0x7f8e8813feb0 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8c803700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880a32e0 con 0x7f8e880a4e40 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e8813feb0 0x7f8e881467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e8813feb0 0x7f8e881467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60314/0 (socket says 172.21.15.89:60314) 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 -- 172.21.15.89:0/2068837795 learned_addr learned my addr 172.21.15.89:0/2068837795 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8659c700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e880a4e40 0x7f8e8813f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 -- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e880a4e40 msgr2=0x7f8e8813f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e880a4e40 0x7f8e8813f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 -- 172.21.15.89:0/2068837795 >> v1:172.21.15.89:6789/0 conn(0x7f8e88063580 legacy=0x7f8e880a27d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-10T00:04:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 -- 172.21.15.89:0/2068837795 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8813f6b0 con 0x7f8e8813feb0 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.925+0000 7f8e8759e700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e8813feb0 0x7f8e881467e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000f490 tx=0x7f8e8000dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355d7f704563512 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e85d9b700 1 -- 172.21.15.89:0/2068837795 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80012070 con 0x7f8e8813feb0 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e85d9b700 1 -- 172.21.15.89:0/2068837795 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000fe30 con 0x7f8e8813feb0 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e85d9b700 1 -- 172.21.15.89:0/2068837795 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000d530 con 0x7f8e8813feb0 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 -- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e8813feb0 msgr2=0x7f8e881467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e8813feb0 0x7f8e881467e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000f490 tx=0x7f8e8000dc50 comp rx=0 tx=0).stop 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 -- 172.21.15.89:0/2068837795 shutdown_connections 2024-02-10T00:04:28.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e8813feb0 0x7f8e881467e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2068837795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e880a4e40 0x7f8e8813f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.926+0000 7f8e8c803700 1 -- 172.21.15.89:0/2068837795 >> 172.21.15.89:0/2068837795 conn(0x7f8e8806c1c0 msgr2=0x7f8e88069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.927+0000 7f8e8c803700 1 -- 172.21.15.89:0/2068837795 shutdown_connections 2024-02-10T00:04:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.927+0000 7f8e8c803700 1 -- 172.21.15.89:0/2068837795 wait complete. 2024-02-10T00:04:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 Processor -- start 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 -- start start 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e88063580 0x7f8e880a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e880a4e40 0x7f8e8809e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8809a990 con 0x7f8e880a4e40 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8809c3b0 con 0x7f8e8813feb0 2024-02-10T00:04:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.928+0000 7f8e8c803700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8809c650 con 0x7f8e88063580 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40938/0 (socket says 172.21.15.89:40938) 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 -- 172.21.15.89:0/2847901054 learned_addr learned my addr 172.21.15.89:0/2847901054 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8659c700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e880a4e40 0x7f8e8809e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 -- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e88063580 msgr2=0x7f8e880a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e88063580 0x7f8e880a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 -- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e880a4e40 msgr2=0x7f8e8809e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e880a4e40 0x7f8e8809e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.929+0000 7f8e8759e700 1 -- 172.21.15.89:0/2847901054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8000f050 con 0x7f8e8813feb0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e8759e700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e880a3210 tx=0x7f8e8001b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80022430 con 0x7f8e8813feb0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80022590 con 0x7f8e8813feb0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8809dc00 con 0x7f8e8813feb0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80022950 con 0x7f8e8813feb0 2024-02-10T00:04:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.930+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8809b040 con 0x7f8e8813feb0 2024-02-10T00:04:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.931+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8806a630 con 0x7f8e8813feb0 2024-02-10T00:04:28.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.932+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f8e80022d40 con 0x7f8e8813feb0 2024-02-10T00:04:28.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.933+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e80052180 con 0x7f8e8813feb0 2024-02-10T00:04:28.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.933+0000 7f8e86d9d700 1 -- 172.21.15.89:0/2847901054 >> v1:172.21.15.89:6816/39389 conn(0x7f8e74039530 legacy=0x7f8e7403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:28.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:28.938+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f8e8002e060 con 0x7f8e8813feb0 2024-02-10T00:04:28.953 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:28.948+0000 7f0386f2b1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T00:04:29.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.032+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f88005550 con 0x7f4fa806d260 2024-02-10T00:04:29.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.033+0000 7f4f8effd700 1 -- 172.21.15.89:0/1361797077 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4fa0018020 con 0x7f4fa806d260 2024-02-10T00:04:29.037 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:29.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.035+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 >> v1:172.21.15.89:6816/39389 conn(0x7f4f94039500 legacy=0x7f4f9403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:29.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.035+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 msgr2=0x7f4fa80ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.035+0000 7f4fad837700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ecc0 tx=0x7f4fa000b040 comp rx=0 tx=0).stop 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 shutdown_connections 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa806d260 0x7f4fa80ab050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa8063740 0x7f4fa8098090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 --2- 172.21.15.89:0/1361797077 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fa806ce70 0x7f4fa8096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 >> 172.21.15.89:0/1361797077 conn(0x7f4fa806a820 msgr2=0x7f4fa806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 shutdown_connections 2024-02-10T00:04:29.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.036+0000 7f4fad837700 1 -- 172.21.15.89:0/1361797077 wait complete. 2024-02-10T00:04:29.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.1 2024-02-10T00:04:29.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.055+0000 7f186c429700 1 Processor -- start 2024-02-10T00:04:29.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 -- start start 2024-02-10T00:04:29.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 0x7f186413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f186413bc00 0x7f18641458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18640a62d0 con 0x7f1864063e50 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1864064220 con 0x7f186413bc00 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.056+0000 7f186c429700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18640a67f0 con 0x7f18640a6fd0 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f186a1c5700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1864063e50 0x7f18640a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58890/0 (socket says 172.21.15.89:58890) 2024-02-10T00:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f186a1c5700 1 -- 172.21.15.89:0/1592013633 learned_addr learned my addr 172.21.15.89:0/1592013633 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:29.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 --2- 172.21.15.89:0/1592013633 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 0x7f186413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f186a9c6700 1 --2- 172.21.15.89:0/1592013633 >> v2:172.21.15.89:3300/0 conn(0x7f186413bc00 0x7f18641458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 -- 172.21.15.89:0/1592013633 >> v2:172.21.15.89:3300/0 conn(0x7f186413bc00 msgr2=0x7f18641458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 --2- 172.21.15.89:0/1592013633 >> v2:172.21.15.89:3300/0 conn(0x7f186413bc00 0x7f18641458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 -- 172.21.15.89:0/1592013633 >> v1:172.21.15.89:6789/0 conn(0x7f1864063e50 legacy=0x7f18640a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 -- 172.21.15.89:0/1592013633 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18640a6030 con 0x7f18640a6fd0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18699c4700 1 --2- 172.21.15.89:0/1592013633 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 0x7f186413b6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f185400fb00 tx=0x7f18540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdeb15b4d2489ff server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18691c3700 1 -- 172.21.15.89:0/1592013633 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854009900 con 0x7f18640a6fd0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18691c3700 1 -- 172.21.15.89:0/1592013633 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854009a80 con 0x7f18640a6fd0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.057+0000 7f18691c3700 1 -- 172.21.15.89:0/1592013633 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854009e40 con 0x7f18640a6fd0 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 -- 172.21.15.89:0/1592013633 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 msgr2=0x7f186413b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 --2- 172.21.15.89:0/1592013633 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 0x7f186413b6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f185400fb00 tx=0x7f18540091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 -- 172.21.15.89:0/1592013633 shutdown_connections 2024-02-10T00:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 --2- 172.21.15.89:0/1592013633 >> v2:172.21.15.89:3300/0 conn(0x7f186413bc00 0x7f18641458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 --2- 172.21.15.89:0/1592013633 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f18640a6fd0 0x7f186413b6c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 -- 172.21.15.89:0/1592013633 >> 172.21.15.89:0/1592013633 conn(0x7f186406c7c0 msgr2=0x7f1864063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 -- 172.21.15.89:0/1592013633 shutdown_connections 2024-02-10T00:04:29.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.058+0000 7f186c429700 1 -- 172.21.15.89:0/1592013633 wait complete. 2024-02-10T00:04:29.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.059+0000 7f186c429700 1 Processor -- start 2024-02-10T00:04:29.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 -- start start 2024-02-10T00:04:29.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18640a6fd0 0x7f18640aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f186413bc00 0x7f18640ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ab070 con 0x7f18640a6fd0 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640b1960 con 0x7f186413bc00 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186c429700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18640b1c00 con 0x7f1864063e50 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.060+0000 7f186a1c5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47904/0 (socket says 172.21.15.89:47904) 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 -- 172.21.15.89:0/1745073409 learned_addr learned my addr 172.21.15.89:0/1745073409 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a9c6700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f186413bc00 0x7f18640ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 -- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f186413bc00 msgr2=0x7f18640ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f186413bc00 0x7f18640ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 -- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18640a6fd0 msgr2=0x7f18640aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18640a6fd0 0x7f18640aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 -- 172.21.15.89:0/1745073409 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185400f610 con 0x7f1864063e50 2024-02-10T00:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.061+0000 7f186a1c5700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7c0 tx=0x7f1860007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860005b30 con 0x7f1864063e50 2024-02-10T00:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860005c90 con 0x7f1864063e50 2024-02-10T00:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860004a80 con 0x7f1864063e50 2024-02-10T00:04:29.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f82caf38700 1 Processor -- start 2024-02-10T00:04:29.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18640abbd0 con 0x7f1864063e50 2024-02-10T00:04:29.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18640aef50 con 0x7f1864063e50 2024-02-10T00:04:29.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.062+0000 7f82caf38700 1 -- start start 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82caf38700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c406ebb0 0x7f82c413e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82caf38700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82c413e630 0x7f82c4144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82caf38700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c413da70 con 0x7f82c40b1540 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82caf38700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c406f350 con 0x7f82c413e630 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82caf38700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40b1910 con 0x7f82c406ebb0 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186404c710 con 0x7f1864063e50 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f18600070f0 con 0x7f1864063e50 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f18699c4700 1 -- 172.21.15.89:0/1745073409 >> v1:172.21.15.89:6816/39389 conn(0x7f1848039500 legacy=0x7f184803b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1860031200 con 0x7f1864063e50 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82c94d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82c413e630 0x7f82c4144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82c8cd4700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f82c40b1540 0x7f82c406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58894/0 (socket says 172.21.15.89:58894) 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82c8cd4700 1 -- 172.21.15.89:0/769083511 learned_addr learned my addr 172.21.15.89:0/769083511 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.063+0000 7f82c94d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82c413e630 0x7f82c4144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60352/0 (socket says 172.21.15.89:60352) 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c3fff700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c406ebb0 0x7f82c413e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c94d5700 1 -- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c406ebb0 msgr2=0x7f82c413e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c94d5700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c406ebb0 0x7f82c413e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c94d5700 1 -- 172.21.15.89:0/769083511 >> v1:172.21.15.89:6789/0 conn(0x7f82c40b1540 legacy=0x7f82c406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c94d5700 1 -- 172.21.15.89:0/769083511 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c406cfb0 con 0x7f82c413e630 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c94d5700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c413e630 0x7f82c4144e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00d0d0 tx=0x7f82bc00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc6695843432db0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c37fe700 1 -- 172.21.15.89:0/769083511 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc010070 con 0x7f82c413e630 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c37fe700 1 -- 172.21.15.89:0/769083511 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc00dbe0 con 0x7f82c413e630 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.064+0000 7f82c37fe700 1 -- 172.21.15.89:0/769083511 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc016400 con 0x7f82c413e630 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.065+0000 7f82caf38700 1 -- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c413e630 msgr2=0x7f82c4144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.065+0000 7f82caf38700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c413e630 0x7f82c4144e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00d0d0 tx=0x7f82bc00b990 comp rx=0 tx=0).stop 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 -- 172.21.15.89:0/769083511 shutdown_connections 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c413e630 0x7f82c4144e10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 --2- 172.21.15.89:0/769083511 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c406ebb0 0x7f82c413e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 -- 172.21.15.89:0/769083511 >> 172.21.15.89:0/769083511 conn(0x7f82c4069a80 msgr2=0x7f82c40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 -- 172.21.15.89:0/769083511 shutdown_connections 2024-02-10T00:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.066+0000 7f82caf38700 1 -- 172.21.15.89:0/769083511 wait complete. 2024-02-10T00:04:29.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.067+0000 7f82caf38700 1 Processor -- start 2024-02-10T00:04:29.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.067+0000 7f82caf38700 1 -- start start 2024-02-10T00:04:29.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 0x7f82c40aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c413e630 0x7f82c4139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40a8290 con 0x7f82c406ebb0 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40a7b70 con 0x7f82c40b1540 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82caf38700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40a84f0 con 0x7f82c413e630 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40958/0 (socket says 172.21.15.89:40958) 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82c3fff700 1 -- 172.21.15.89:0/3463529787 learned_addr learned my addr 172.21.15.89:0/3463529787 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.068+0000 7f82c94d5700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c413e630 0x7f82c4139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c8cd4700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 0x7f82c40aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 -- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c413e630 msgr2=0x7f82c4139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c413e630 0x7f82c4139930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 -- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 msgr2=0x7f82c40aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 0x7f82c40aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 -- 172.21.15.89:0/3463529787 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc00bc30 con 0x7f82c40b1540 2024-02-10T00:04:29.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c8cd4700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 0x7f82c40aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-10T00:04:29.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c3fff700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82b000d890 tx=0x7f82b0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:29.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f186002f400 con 0x7f1864063e50 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b00125f0 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b0012750 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40aa150 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0012ad0 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.069+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c40aaef0 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.070+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c404c710 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.072+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f82b001e460 con 0x7f82c40b1540 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.072+0000 7f82c8cd4700 1 -- 172.21.15.89:0/3463529787 >> v1:172.21.15.89:6816/39389 conn(0x7f82a803d960 legacy=0x7f82a803fe10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.072+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f82b004bcc0 con 0x7f82c40b1540 2024-02-10T00:04:29.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.081+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f82b0034000 con 0x7f82c40b1540 2024-02-10T00:04:29.109 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:29.107+0000 7f29a48591c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T00:04:29.115 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:29.113+0000 7f0386f2b1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T00:04:29.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.134+0000 7f8e86d9d700 1 -- 172.21.15.89:0/2847901054 >> v1:172.21.15.89:6816/39389 conn(0x7f8e74039530 legacy=0x7f8e7403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.89:6816/39389 2024-02-10T00:04:29.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.184+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e8804bed0 con 0x7f8e8813feb0 2024-02-10T00:04:29.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.185+0000 7f8e6effd700 1 -- 172.21.15.89:0/2847901054 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e80018030 con 0x7f8e8813feb0 2024-02-10T00:04:29.187 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 >> v1:172.21.15.89:6816/39389 conn(0x7f8e74039530 legacy=0x7f8e7403b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 msgr2=0x7f8e88138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e880a3210 tx=0x7f8e8001b000 comp rx=0 tx=0).stop 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 shutdown_connections 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e8813feb0 0x7f8e88138580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8e88063580 0x7f8e880a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 --2- 172.21.15.89:0/2847901054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e880a4e40 0x7f8e8809e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 >> 172.21.15.89:0/2847901054 conn(0x7f8e8806c1c0 msgr2=0x7f8e8813c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 shutdown_connections 2024-02-10T00:04:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.187+0000 7f8e8c803700 1 -- 172.21.15.89:0/2847901054 wait complete. 2024-02-10T00:04:29.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705743 got 38654705742 for osd.2 2024-02-10T00:04:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.215+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82c4071600 con 0x7f82c40b1540 2024-02-10T00:04:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.215+0000 7f82c0ff9700 1 -- 172.21.15.89:0/3463529787 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82b0033bf0 con 0x7f82c40b1540 2024-02-10T00:04:29.218 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 >> v1:172.21.15.89:6816/39389 conn(0x7f82a803d960 legacy=0x7f82a803fe10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 msgr2=0x7f82c41393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82b000d890 tx=0x7f82b0008040 comp rx=0 tx=0).stop 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 shutdown_connections 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f82c413e630 0x7f82c4139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c406ebb0 0x7f82c40aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 --2- 172.21.15.89:0/3463529787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c40b1540 0x7f82c41393f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 >> 172.21.15.89:0/3463529787 conn(0x7f82c4069a80 msgr2=0x7f82c413a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 shutdown_connections 2024-02-10T00:04:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.217+0000 7f82caf38700 1 -- 172.21.15.89:0/3463529787 wait complete. 2024-02-10T00:04:29.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705740 for osd.3 2024-02-10T00:04:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.253+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18640a5d70 con 0x7f1864063e50 2024-02-10T00:04:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.254+0000 7f185a7fc700 1 -- 172.21.15.89:0/1745073409 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1860018020 con 0x7f1864063e50 2024-02-10T00:04:29.256 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:29.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 >> v1:172.21.15.89:6816/39389 conn(0x7f1848039500 legacy=0x7f184803b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 msgr2=0x7f18640a8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7c0 tx=0x7f1860007f70 comp rx=0 tx=0).stop 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 shutdown_connections 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f186413bc00 0x7f18640ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1864063e50 0x7f18640a8e10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 --2- 172.21.15.89:0/1745073409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18640a6fd0 0x7f18640aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 >> 172.21.15.89:0/1745073409 conn(0x7f186406c7c0 msgr2=0x7f1864064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 shutdown_connections 2024-02-10T00:04:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:29.255+0000 7f186c429700 1 -- 172.21.15.89:0/1745073409 wait complete. 2024-02-10T00:04:29.264 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:29.262+0000 7f29a48591c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T00:04:29.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.0 2024-02-10T00:04:29.269 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:29.267+0000 7f0386f2b1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T00:04:29.741 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:29.739+0000 7f0386f2b1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T00:04:29.742 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:29.740+0000 7f29a48591c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T00:04:29.859 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:29.856+0000 7f29a48591c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T00:04:29.859 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:29.857+0000 7f0386f2b1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T00:04:30.011 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:30.008+0000 7f29a48591c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-10T00:04:30.012 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.009+0000 7f0386f2b1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-10T00:04:30.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:04:30.114 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-02-10T00:04:30.112+0000 7f29a48591c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T00:04:30.116 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.114+0000 7f0386f2b1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T00:04:30.191 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.188+0000 7f0348e34700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.191 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.188+0000 7f0348e34700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.191 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.188+0000 7f0348e34700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.191 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.188+0000 7f0348e34700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.192 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.188+0000 7f0348e34700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.195 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.192+0000 7f034be3a700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.195 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.192+0000 7f034be3a700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.195 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.192+0000 7f034be3a700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.195 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.192+0000 7f034be3a700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.195 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:30.192+0000 7f034be3a700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-10T00:04:30.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.199+0000 7f92c8657700 1 Processor -- start 2024-02-10T00:04:30.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.199+0000 7f92c8657700 1 -- start start 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c8657700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c8657700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92c013e010 0x7f92c0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c8657700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00a6aa0 con 0x7f92c00b55b0 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c8657700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00a4450 con 0x7f92c013e010 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c8657700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00a2db0 con 0x7f92c00a29c0 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c5bf2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c5bf2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41068/0 (socket says 172.21.15.89:41068) 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c5bf2700 1 -- 172.21.15.89:0/1374475309 learned_addr learned my addr 172.21.15.89:0/1374475309 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c63f3700 1 --1- 172.21.15.89:0/1374475309 >> v1:172.21.15.89:6789/0 conn(0x7f92c00b55b0 0x7f92c00a3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58902/0 (socket says 172.21.15.89:58902) 2024-02-10T00:04:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.200+0000 7f92c6bf4700 1 --2- 172.21.15.89:0/1374475309 >> v2:172.21.15.89:3300/0 conn(0x7f92c013e010 0x7f92c0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c53f1700 1 -- 172.21.15.89:0/1374475309 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071434470 0 0) 0x7f92c00a6aa0 con 0x7f92c00b55b0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c53f1700 1 -- 172.21.15.89:0/1374475309 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ac003570 con 0x7f92c00b55b0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c5bf2700 1 -- 172.21.15.89:0/1374475309 >> v2:172.21.15.89:3300/0 conn(0x7f92c013e010 msgr2=0x7f92c0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c5bf2700 1 --2- 172.21.15.89:0/1374475309 >> v2:172.21.15.89:3300/0 conn(0x7f92c013e010 0x7f92c0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c5bf2700 1 -- 172.21.15.89:0/1374475309 >> v1:172.21.15.89:6789/0 conn(0x7f92c00b55b0 legacy=0x7f92c00a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c5bf2700 1 -- 172.21.15.89:0/1374475309 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00a1a60 con 0x7f92c00a29c0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c5bf2700 1 --2- 172.21.15.89:0/1374475309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92b00099b0 tx=0x7f92b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44992b3ab566bb5f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c53f1700 1 -- 172.21.15.89:0/1374475309 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b000b680 con 0x7f92c00a29c0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c53f1700 1 -- 172.21.15.89:0/1374475309 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b000b7e0 con 0x7f92c00a29c0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.201+0000 7f92c53f1700 1 -- 172.21.15.89:0/1374475309 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b000bb60 con 0x7f92c00a29c0 2024-02-10T00:04:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 -- 172.21.15.89:0/1374475309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 msgr2=0x7f92c013dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 --2- 172.21.15.89:0/1374475309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92b00099b0 tx=0x7f92b0009250 comp rx=0 tx=0).stop 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 -- 172.21.15.89:0/1374475309 shutdown_connections 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 --2- 172.21.15.89:0/1374475309 >> v2:172.21.15.89:3300/0 conn(0x7f92c013e010 0x7f92c0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 --2- 172.21.15.89:0/1374475309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c013dad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 -- 172.21.15.89:0/1374475309 >> 172.21.15.89:0/1374475309 conn(0x7f92c0064050 msgr2=0x7f92c00b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 -- 172.21.15.89:0/1374475309 shutdown_connections 2024-02-10T00:04:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.202+0000 7f92c8657700 1 -- 172.21.15.89:0/1374475309 wait complete. 2024-02-10T00:04:30.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:04:30.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 Processor -- start 2024-02-10T00:04:30.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 -- start start 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f92c00b55b0 0x7f92c0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c013e010 0x7f92c0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0140ee0 con 0x7f92c013e010 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00aa440 con 0x7f92c00a29c0 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c8657700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00a8810 con 0x7f92c00b55b0 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c63f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c63f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41080/0 (socket says 172.21.15.89:41080) 2024-02-10T00:04:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c63f3700 1 -- 172.21.15.89:0/2565925586 learned_addr learned my addr 172.21.15.89:0/2565925586 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c5bf2700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f92c00b55b0 0x7f92c0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.203+0000 7f92c6bf4700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c013e010 0x7f92c0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 -- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f92c00b55b0 msgr2=0x7f92c0151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f92c00b55b0 0x7f92c0151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 -- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c013e010 msgr2=0x7f92c0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c013e010 0x7f92c0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 -- 172.21.15.89:0/2565925586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00094f0 con 0x7f92c00a29c0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c63f3700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c790 tx=0x7f92bc007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0072e0 con 0x7f92c00a29c0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc007440 con 0x7f92c00a29c0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c00b24f0 con 0x7f92c00a29c0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0057f0 con 0x7f92c00a29c0 2024-02-10T00:04:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.204+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c00aa1f0 con 0x7f92c00a29c0 2024-02-10T00:04:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.205+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c00a97b0 con 0x7f92c00a29c0 2024-02-10T00:04:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.205+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 7) v1 ==== 47589+0+0 (secure 0 0 0) 0x7f92bc005ba0 con 0x7f92c00a29c0 2024-02-10T00:04:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.205+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f92bc052470 con 0x7f92c00a29c0 2024-02-10T00:04:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.208+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f92bc030d00 con 0x7f92c00a29c0 2024-02-10T00:04:30.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:04:30.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:04:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.332+0000 7fc4f86fe700 1 Processor -- start 2024-02-10T00:04:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.332+0000 7fc4f86fe700 1 -- start start 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.333+0000 7fc4f86fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f00b18b0 0x7fc4f006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.333+0000 7fc4f86fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f0139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.333+0000 7fc4f86fe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f006e2d0 con 0x7fc4f013a390 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.333+0000 7fc4f86fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b1c80 con 0x7fc4f00b18b0 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.333+0000 7fc4f86fe700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f006eb50 con 0x7fc4f006f630 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f0139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f6c9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc4f013a390 0x7fc4f00a1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58912/0 (socket says 172.21.15.89:58912) 2024-02-10T00:04:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f6c9b700 1 -- 172.21.15.89:0/877711056 learned_addr learned my addr 172.21.15.89:0/877711056 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f649a700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f00b18b0 0x7fc4f006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 -- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f00b18b0 msgr2=0x7fc4f006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f00b18b0 0x7fc4f006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 -- 172.21.15.89:0/877711056 >> v1:172.21.15.89:6789/0 conn(0x7fc4f013a390 legacy=0x7fc4f00a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 -- 172.21.15.89:0/877711056 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f006edd0 con 0x7fc4f006f630 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5c99700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f0139e50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000aac0 tx=0x7fc4e000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=630c3bbbe41be48a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5498700 1 -- 172.21.15.89:0/877711056 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0013a90 con 0x7fc4f006f630 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5498700 1 -- 172.21.15.89:0/877711056 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e0013bf0 con 0x7fc4f006f630 2024-02-10T00:04:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.334+0000 7fc4f5498700 1 -- 172.21.15.89:0/877711056 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000c760 con 0x7fc4f006f630 2024-02-10T00:04:30.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.335+0000 7fc4f86fe700 1 -- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 msgr2=0x7fc4f0139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.335+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f0139e50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000aac0 tx=0x7fc4e000a330 comp rx=0 tx=0).stop 2024-02-10T00:04:30.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.335+0000 7fc4f86fe700 1 -- 172.21.15.89:0/877711056 shutdown_connections 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.335+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f00b18b0 0x7fc4f006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.335+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/877711056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f0139e50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.336+0000 7fc4f86fe700 1 -- 172.21.15.89:0/877711056 >> 172.21.15.89:0/877711056 conn(0x7fc4f006a820 msgr2=0x7fc4f00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.336+0000 7fc4f86fe700 1 -- 172.21.15.89:0/877711056 shutdown_connections 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.336+0000 7fc4f86fe700 1 -- 172.21.15.89:0/877711056 wait complete. 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.337+0000 7fc4f86fe700 1 Processor -- start 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.337+0000 7fc4f86fe700 1 -- start start 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f009d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92c004c710 con 0x7f92c00a29c0 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f013a390 0x7fc4f014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f009efe0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f009c790 con 0x7fc4f013a390 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f86fe700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f009d6b0 con 0x7fc4f006f630 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f5c99700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f5c99700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60444/0 (socket says 172.21.15.89:60444) 2024-02-10T00:04:30.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f6c9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f013a390 0x7fc4f014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f5c99700 1 -- 172.21.15.89:0/3761988082 learned_addr learned my addr 172.21.15.89:0/3761988082 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.338+0000 7fc4f649a700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f009d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 -- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 msgr2=0x7fc4f009d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f009d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 -- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f013a390 msgr2=0x7fc4f014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f013a390 0x7fc4f014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 -- 172.21.15.89:0/3761988082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e000a5d0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7f92b67fc700 1 -- 172.21.15.89:0/2565925586 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92bc0344b0 con 0x7f92c00a29c0 2024-02-10T00:04:30.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f5c99700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0008010 tx=0x7fc4e001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.345 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0013380 con 0x7fc4f00b18b0 2024-02-10T00:04:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e0013520 con 0x7fc4f00b18b0 2024-02-10T00:04:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f009efe0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f009f4e0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.339+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e001b6d0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.340+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 7) v1 ==== 47589+0+0 (secure 0 0 0) 0x7fc4e001ba40 con 0x7fc4f00b18b0 2024-02-10T00:04:30.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.340+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d80052a0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.341+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fc4e0054020 con 0x7fc4f00b18b0 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.341+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 msgr2=0x7f92c00a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.341+0000 7f92c8657700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c790 tx=0x7f92bc007d30 comp rx=0 tx=0).stop 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 shutdown_connections 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c013e010 0x7f92c0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c00a29c0 0x7f92c00a9a70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 --2- 172.21.15.89:0/2565925586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f92c00b55b0 0x7f92c0151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 >> 172.21.15.89:0/2565925586 conn(0x7f92c0064050 msgr2=0x7f92c013e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 shutdown_connections 2024-02-10T00:04:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.343+0000 7f92c8657700 1 -- 172.21.15.89:0/2565925586 wait complete. 2024-02-10T00:04:30.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.344+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fc4e00067a0 con 0x7fc4f00b18b0 2024-02-10T00:04:30.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.1 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 Processor -- start 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 -- start start 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2ec0a80c0 0x7fb2ec13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec140410 0x7fb2ec146b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec064220 con 0x7fb2ec063e50 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec13f7c0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.378+0000 7fb2f42be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec13fa80 con 0x7fb2ec140410 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2ec0a80c0 0x7fb2ec13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f205a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb2ec063e50 0x7fb2ec0a6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58928/0 (socket says 172.21.15.89:58928) 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f205a700 1 -- 172.21.15.89:0/4263688540 learned_addr learned my addr 172.21.15.89:0/4263688540 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f285b700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec140410 0x7fb2ec146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 -- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec140410 msgr2=0x7fb2ec146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec140410 0x7fb2ec146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 -- 172.21.15.89:0/4263688540 >> v1:172.21.15.89:6789/0 conn(0x7fb2ec063e50 legacy=0x7fb2ec0a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 -- 172.21.15.89:0/4263688540 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0a6820 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1058700 1 -- 172.21.15.89:0/4263688540 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440467771 0 0) 0x7fb2ec064220 con 0x7fb2ec063e50 2024-02-10T00:04:30.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1859700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec0a80c0 0x7fb2ec13fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098e0 tx=0x7fb2dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17261ce7b1cf6c76 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1058700 1 -- 172.21.15.89:0/4263688540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00b6d0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1058700 1 -- 172.21.15.89:0/4263688540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00b830 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.379+0000 7fb2f1058700 1 -- 172.21.15.89:0/4263688540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00bbd0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 -- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec0a80c0 msgr2=0x7fb2ec13fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec0a80c0 0x7fb2ec13fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098e0 tx=0x7fb2dc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 -- 172.21.15.89:0/4263688540 shutdown_connections 2024-02-10T00:04:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec140410 0x7fb2ec146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 --2- 172.21.15.89:0/4263688540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec0a80c0 0x7fb2ec13fed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 -- 172.21.15.89:0/4263688540 >> 172.21.15.89:0/4263688540 conn(0x7fb2ec06c7c0 msgr2=0x7fb2ec063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 -- 172.21.15.89:0/4263688540 shutdown_connections 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.380+0000 7fb2f42be700 1 -- 172.21.15.89:0/4263688540 wait complete. 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.381+0000 7fb2f42be700 1 Processor -- start 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.381+0000 7fb2f42be700 1 -- start start 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2ec063e50 0x7fb2ec0aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 0x7fb2ec0a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0ace40 con 0x7fb2ec140410 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0acbd0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f1859700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f1859700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41106/0 (socket says 172.21.15.89:41106) 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f42be700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b0f60 con 0x7fb2ec063e50 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f1859700 1 -- 172.21.15.89:0/1587322966 learned_addr learned my addr 172.21.15.89:0/1587322966 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.382+0000 7fb2f285b700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 0x7fb2ec0a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 -- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2ec063e50 msgr2=0x7fb2ec0aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2ec063e50 0x7fb2ec0aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 -- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 msgr2=0x7fb2ec0a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 0x7fb2ec0a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 -- 172.21.15.89:0/1587322966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009420 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f285b700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 0x7fb2ec0a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f1859700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009f80 tx=0x7fb2dc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00bbb0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc011420 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0b1220 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc011800 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.383+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec0ab1b0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.384+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 7) v1 ==== 47589+0+0 (secure 0 0 0) 0x7fb2dc011c30 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.384+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fb2dc0548d0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.384+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec0ae150 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.387+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fb2dc000ed0 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.435+0000 7fe8b6c72700 1 Processor -- start 2024-02-10T00:04:30.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.435+0000 7fe8b6c72700 1 -- start start 2024-02-10T00:04:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b6c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 0x7fe8b006a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b6c72700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 0x7fe8b0149040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b6c72700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b006ff80 con 0x7fe8b00ab6d0 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b6c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00aab20 con 0x7fe8b0063c90 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b6c72700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0142830 con 0x7fe8b0146c60 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b4a0e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 0x7fe8b006a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8affff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe8b00ab6d0 0x7fe8b0142120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58936/0 (socket says 172.21.15.89:58936) 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 0x7fe8b0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8affff700 1 -- 172.21.15.89:0/765071818 learned_addr learned my addr 172.21.15.89:0/765071818 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8af7fe700 1 -- 172.21.15.89:0/765071818 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534768080 0 0) 0x7fe8b006ff80 con 0x7fe8b00ab6d0 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 -- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 msgr2=0x7fe8b006a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 0x7fe8b006a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 -- 172.21.15.89:0/765071818 >> v1:172.21.15.89:6789/0 conn(0x7fe8b00ab6d0 legacy=0x7fe8b0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 -- 172.21.15.89:0/765071818 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0141a50 con 0x7fe8b0146c60 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b4a0e700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 0x7fe8b006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.436+0000 7fe8b520f700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 0x7fe8b0149040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009e90 tx=0x7fe8a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c794c5f2d260580 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8af7fe700 1 -- 172.21.15.89:0/765071818 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800e070 con 0x7fe8b0146c60 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8af7fe700 1 -- 172.21.15.89:0/765071818 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800bc30 con 0x7fe8b0146c60 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8af7fe700 1 -- 172.21.15.89:0/765071818 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8012430 con 0x7fe8b0146c60 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 -- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 msgr2=0x7fe8b0149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 0x7fe8b0149040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009e90 tx=0x7fe8a8009780 comp rx=0 tx=0).stop 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 -- 172.21.15.89:0/765071818 shutdown_connections 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0063c90 0x7fe8b006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/765071818 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b0146c60 0x7fe8b0149040 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 -- 172.21.15.89:0/765071818 >> 172.21.15.89:0/765071818 conn(0x7fe8b006d8c0 msgr2=0x7fe8b0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 -- 172.21.15.89:0/765071818 shutdown_connections 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.437+0000 7fe8b6c72700 1 -- 172.21.15.89:0/765071818 wait complete. 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.438+0000 7fe8b6c72700 1 Processor -- start 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.438+0000 7fe8b6c72700 1 -- start start 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 0x7fe8b00ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 0x7fe8b0150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00ade80 con 0x7fe8b0063c90 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00ac860 con 0x7fe8b0146c60 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b6c72700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b01458e0 con 0x7fe8b00ab6d0 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60472/0 (socket says 172.21.15.89:60472) 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 -- 172.21.15.89:0/2069648784 learned_addr learned my addr 172.21.15.89:0/2069648784 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b520f700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 0x7fe8b0150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8affff700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 0x7fe8b00ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 -- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 msgr2=0x7fe8b00ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 0x7fe8b00ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 -- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 msgr2=0x7fe8b0150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 0x7fe8b0150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b4a0e700 1 -- 172.21.15.89:0/2069648784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4009420 con 0x7fe8b0063c90 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8affff700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 0x7fe8b00ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.439+0000 7fe8b520f700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 0x7fe8b0150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8b4a0e700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400ec80 tx=0x7fe8a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400c920 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a400ca80 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8009a20 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400ce00 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.440+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b00adc30 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.441+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b00ad1f0 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.441+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 7) v1 ==== 47589+0+0 (secure 0 0 0) 0x7fe8a4013680 con 0x7fe8b0063c90 2024-02-10T00:04:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.441+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fe8a4053770 con 0x7fe8b0063c90 2024-02-10T00:04:30.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.447+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fe8b00ad1f0 con 0x7fe8b0063c90 2024-02-10T00:04:30.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.482+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc4d8005550 con 0x7fc4f00b18b0 2024-02-10T00:04:30.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.482+0000 7fc4e67fc700 1 -- 172.21.15.89:0/3761988082 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4e0005a00 con 0x7fc4f00b18b0 2024-02-10T00:04:30.485 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:30.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 msgr2=0x7fc4f014d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0008010 tx=0x7fc4e001b000 comp rx=0 tx=0).stop 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 shutdown_connections 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f013a390 0x7fc4f014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc4f006f630 0x7fc4f009d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 --2- 172.21.15.89:0/3761988082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f00b18b0 0x7fc4f014d310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.483+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 >> 172.21.15.89:0/3761988082 conn(0x7fc4f006a820 msgr2=0x7fc4f00af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.484+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 shutdown_connections 2024-02-10T00:04:30.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.484+0000 7fc4f86fe700 1 -- 172.21.15.89:0/3761988082 wait complete. 2024-02-10T00:04:30.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705743 got 38654705742 for osd.2 2024-02-10T00:04:30.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.518+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2ec04c710 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.519+0000 7fb2e27fc700 1 -- 172.21.15.89:0/1587322966 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2dc015020 con 0x7fb2ec0a80c0 2024-02-10T00:04:30.521 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:30.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 msgr2=0x7fb2ec0a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009f80 tx=0x7fb2dc017000 comp rx=0 tx=0).stop 2024-02-10T00:04:30.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 shutdown_connections 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2ec140410 0x7fb2ec0a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2ec063e50 0x7fb2ec0aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 --2- 172.21.15.89:0/1587322966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2ec0a80c0 0x7fb2ec0a8d70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 >> 172.21.15.89:0/1587322966 conn(0x7fb2ec06c7c0 msgr2=0x7fb2ec0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 shutdown_connections 2024-02-10T00:04:30.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.520+0000 7fb2f42be700 1 -- 172.21.15.89:0/1587322966 wait complete. 2024-02-10T00:04:30.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705740 for osd.3 2024-02-10T00:04:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.571+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8b00ad1f0 con 0x7fe8b0063c90 2024-02-10T00:04:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.571+0000 7fe8acff9700 1 -- 172.21.15.89:0/2069648784 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8b00ad1f0 con 0x7fe8b0063c90 2024-02-10T00:04:30.574 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 msgr2=0x7fe8b00afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400ec80 tx=0x7fe8a40091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 shutdown_connections 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b0146c60 0x7fe8b0150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b0063c90 0x7fe8b00afb10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 --2- 172.21.15.89:0/2069648784 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe8b00ab6d0 0x7fe8b00ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 >> 172.21.15.89:0/2069648784 conn(0x7fe8b006d8c0 msgr2=0x7fe8b0069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 shutdown_connections 2024-02-10T00:04:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:30.573+0000 7fe8b6c72700 1 -- 172.21.15.89:0/2069648784 wait complete. 2024-02-10T00:04:30.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.0 2024-02-10T00:04:31.129 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:31.126+0000 7f0365e6e700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-10T00:04:31.130 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:31.127+0000 7f0365e6e700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-10T00:04:31.131 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-02-10T00:04:31.130+0000 7f0365e6e700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-10T00:04:31.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:04:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.488+0000 7fd3c04c0700 1 Processor -- start 2024-02-10T00:04:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 -- start start 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3b8063740 0x7fd3b80a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 0x7fd3b80a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b8063b10 con 0x7fd3b813f6e0 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b8139bb0 con 0x7fd3b8063740 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3c04c0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80a2100 con 0x7fd3b80a5130 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3be25c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3b8063740 0x7fd3b80a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3bda5b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd3b813f6e0 0x7fd3b813fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58946/0 (socket says 172.21.15.89:58946) 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3bea5d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 0x7fd3b80a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.489+0000 7fd3bda5b700 1 -- 172.21.15.89:0/2110609202 learned_addr learned my addr 172.21.15.89:0/2110609202 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3be25c700 1 -- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 msgr2=0x7fd3b80a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3be25c700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 0x7fd3b80a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3be25c700 1 -- 172.21.15.89:0/2110609202 >> v1:172.21.15.89:6789/0 conn(0x7fd3b813f6e0 legacy=0x7fd3b813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3bd25a700 1 -- 172.21.15.89:0/2110609202 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023079315 0 0) 0x7fd3b8063b10 con 0x7fd3b813f6e0 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3be25c700 1 -- 172.21.15.89:0/2110609202 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b813fb70 con 0x7fd3b8063740 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3bea5d700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 0x7fd3b80a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3be25c700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a3240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009910 tx=0x7fd3a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65eaa2d6875e608 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3bd25a700 1 -- 172.21.15.89:0/2110609202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800b6d0 con 0x7fd3b8063740 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3bd25a700 1 -- 172.21.15.89:0/2110609202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800b830 con 0x7fd3b8063740 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.490+0000 7fd3bd25a700 1 -- 172.21.15.89:0/2110609202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800bbf0 con 0x7fd3b8063740 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 -- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 msgr2=0x7fd3b80a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a3240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009910 tx=0x7fd3a80091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 -- 172.21.15.89:0/2110609202 shutdown_connections 2024-02-10T00:04:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a3240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/2110609202 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b80a5130 0x7fd3b80a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 -- 172.21.15.89:0/2110609202 >> 172.21.15.89:0/2110609202 conn(0x7fd3b806a820 msgr2=0x7fd3b80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 -- 172.21.15.89:0/2110609202 shutdown_connections 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.491+0000 7fd3c04c0700 1 -- 172.21.15.89:0/2110609202 wait complete. 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 Processor -- start 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 -- start start 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80a5130 0x7fd3b80a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b813f6e0 0x7fd3b814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8144810 con 0x7fd3b8063740 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814be60 con 0x7fd3b80a5130 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3c04c0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80a78b0 con 0x7fd3b813f6e0 2024-02-10T00:04:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3be25c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3bea5d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b813f6e0 0x7fd3b814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3be25c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60486/0 (socket says 172.21.15.89:60486) 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3be25c700 1 -- 172.21.15.89:0/1751862857 learned_addr learned my addr 172.21.15.89:0/1751862857 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.492+0000 7fd3bda5b700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80a5130 0x7fd3b80a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 -- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b813f6e0 msgr2=0x7fd3b814c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b813f6e0 0x7fd3b814c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 -- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80a5130 msgr2=0x7fd3b80a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80a5130 0x7fd3b80a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 -- 172.21.15.89:0/1751862857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009a20 con 0x7fd3b8063740 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3be25c700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009fb0 tx=0x7fd3a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a801f070 con 0x7fd3b8063740 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8000bc0 con 0x7fd3b8063740 2024-02-10T00:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8009420 con 0x7fd3b8063740 2024-02-10T00:04:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800bbf0 con 0x7fd3b8063740 2024-02-10T00:04:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.493+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b80a6c40 con 0x7fd3b8063740 2024-02-10T00:04:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.494+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b813acd0 con 0x7fd3b8063740 2024-02-10T00:04:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.494+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7fd3a8023070 con 0x7fd3b8063740 2024-02-10T00:04:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.494+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fd3a805c030 con 0x7fd3b8063740 2024-02-10T00:04:31.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:04:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.498+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd3a8006fe0 con 0x7fd3b8063740 2024-02-10T00:04:31.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:04:31.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:04:31.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 Processor -- start 2024-02-10T00:04:31.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 -- start start 2024-02-10T00:04:31.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19280a2250 0x7f1928146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1928063b10 con 0x7f192809f280 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280a0580 con 0x7f19280a2250 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.625+0000 7f192f5f1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19280a26a0 con 0x7f1928063740 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48130/0 (socket says 172.21.15.89:48130) 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 -- 172.21.15.89:0/837855626 learned_addr learned my addr 172.21.15.89:0/837855626 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192cb8c700 1 --2- 172.21.15.89:0/837855626 >> v2:172.21.15.89:3300/0 conn(0x7f19280a2250 0x7f1928146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 -- 172.21.15.89:0/837855626 >> v2:172.21.15.89:3300/0 conn(0x7f19280a2250 msgr2=0x7f1928146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 --2- 172.21.15.89:0/837855626 >> v2:172.21.15.89:3300/0 conn(0x7f19280a2250 0x7f1928146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 -- 172.21.15.89:0/837855626 >> v1:172.21.15.89:6789/0 conn(0x7f192809f280 legacy=0x7f192809f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 -- 172.21.15.89:0/837855626 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280a2910 con 0x7f1928063740 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f192d38d700 1 --2- 172.21.15.89:0/837855626 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19240099b0 tx=0x7f1924009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda3eeb8b48f82c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f191ffff700 1 -- 172.21.15.89:0/837855626 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924009ea0 con 0x7f1928063740 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f191ffff700 1 -- 172.21.15.89:0/837855626 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400b860 con 0x7f1928063740 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.626+0000 7f191ffff700 1 -- 172.21.15.89:0/837855626 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bc00 con 0x7f1928063740 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 -- 172.21.15.89:0/837855626 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 msgr2=0x7f19280a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 --2- 172.21.15.89:0/837855626 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19240099b0 tx=0x7f1924009250 comp rx=0 tx=0).stop 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 -- 172.21.15.89:0/837855626 shutdown_connections 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 --2- 172.21.15.89:0/837855626 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1928063740 0x7f19280a1590 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 --2- 172.21.15.89:0/837855626 >> v2:172.21.15.89:3300/0 conn(0x7f19280a2250 0x7f1928146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 -- 172.21.15.89:0/837855626 >> 172.21.15.89:0/837855626 conn(0x7f192806a820 msgr2=0x7f19280b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 -- 172.21.15.89:0/837855626 shutdown_connections 2024-02-10T00:04:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.627+0000 7f192f5f1700 1 -- 172.21.15.89:0/837855626 wait complete. 2024-02-10T00:04:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.628+0000 7f192f5f1700 1 Processor -- start 2024-02-10T00:04:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.628+0000 7f192f5f1700 1 -- start start 2024-02-10T00:04:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192809f280 0x7f192814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f19280a2250 0x7f1928141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192814c480 con 0x7f1928063740 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192814c6b0 con 0x7f192809f280 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192f5f1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192814c950 con 0x7f19280a2250 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60502/0 (socket says 172.21.15.89:60502) 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 -- 172.21.15.89:0/1461573159 learned_addr learned my addr 172.21.15.89:0/1461573159 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192db8e700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f19280a2250 0x7f1928141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 -- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f19280a2250 msgr2=0x7f1928141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f19280a2250 0x7f1928141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 -- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192809f280 msgr2=0x7f192814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192809f280 0x7f192814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.629+0000 7f192d38d700 1 -- 172.21.15.89:0/1461573159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240094f0 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f192d38d700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19280a27e0 tx=0x7f1924017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bbe0 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924011420 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19281437f0 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240117c0 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.630+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192814ac80 con 0x7f1928063740 2024-02-10T00:04:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.631+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f1924011bf0 con 0x7f1928063740 2024-02-10T00:04:31.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.631+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f192405c510 con 0x7f1928063740 2024-02-10T00:04:31.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.633+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192804c710 con 0x7f1928063740 2024-02-10T00:04:31.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.636+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f192402ff60 con 0x7f1928063740 2024-02-10T00:04:31.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 Processor -- start 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 -- start start 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea3413bc00 0x7fea341458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea340a62d0 con 0x7fea34063e50 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.666+0000 7fea39aff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea34064220 con 0x7fea3413bc00 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea39aff700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea340a67f0 con 0x7fea340a6fd0 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48152/0 (socket says 172.21.15.89:48152) 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 -- 172.21.15.89:0/844752146 learned_addr learned my addr 172.21.15.89:0/844752146 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea337fe700 1 --1- 172.21.15.89:0/844752146 >> v1:172.21.15.89:6789/0 conn(0x7fea34063e50 0x7fea340a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58970/0 (socket says 172.21.15.89:58970) 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea33fff700 1 --2- 172.21.15.89:0/844752146 >> v2:172.21.15.89:3300/0 conn(0x7fea3413bc00 0x7fea341458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 -- 172.21.15.89:0/844752146 >> v2:172.21.15.89:3300/0 conn(0x7fea3413bc00 msgr2=0x7fea341458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 --2- 172.21.15.89:0/844752146 >> v2:172.21.15.89:3300/0 conn(0x7fea3413bc00 0x7fea341458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 -- 172.21.15.89:0/844752146 >> v1:172.21.15.89:6789/0 conn(0x7fea34063e50 legacy=0x7fea340a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 -- 172.21.15.89:0/844752146 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340a6030 con 0x7fea340a6fd0 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea32ffd700 1 --2- 172.21.15.89:0/844752146 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea2800bc80 tx=0x7fea2800b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ab279a8ebfe633 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea327fc700 1 -- 172.21.15.89:0/844752146 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800dbb0 con 0x7fea340a6fd0 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea327fc700 1 -- 172.21.15.89:0/844752146 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800dd10 con 0x7fea340a6fd0 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.667+0000 7fea327fc700 1 -- 172.21.15.89:0/844752146 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea280196b0 con 0x7fea340a6fd0 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 -- 172.21.15.89:0/844752146 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 msgr2=0x7fea3413b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 --2- 172.21.15.89:0/844752146 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea2800bc80 tx=0x7fea2800b4f0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 -- 172.21.15.89:0/844752146 shutdown_connections 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 --2- 172.21.15.89:0/844752146 >> v2:172.21.15.89:3300/0 conn(0x7fea3413bc00 0x7fea341458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 --2- 172.21.15.89:0/844752146 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea340a6fd0 0x7fea3413b6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 -- 172.21.15.89:0/844752146 >> 172.21.15.89:0/844752146 conn(0x7fea3406c7c0 msgr2=0x7fea34063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 -- 172.21.15.89:0/844752146 shutdown_connections 2024-02-10T00:04:31.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.668+0000 7fea39aff700 1 -- 172.21.15.89:0/844752146 wait complete. 2024-02-10T00:04:31.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.669+0000 7fea39aff700 1 Processor -- start 2024-02-10T00:04:31.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.669+0000 7fea39aff700 1 -- start start 2024-02-10T00:04:31.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea34063e50 0x7fea340aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea3413bc00 0x7fea340a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340aa160 con 0x7fea340a6fd0 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea340ab4c0 con 0x7fea34063e50 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea39aff700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea340aba60 con 0x7fea3413bc00 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60512/0 (socket says 172.21.15.89:60512) 2024-02-10T00:04:31.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 -- 172.21.15.89:0/3645719482 learned_addr learned my addr 172.21.15.89:0/3645719482 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea33fff700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea3413bc00 0x7fea340a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 -- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea3413bc00 msgr2=0x7fea340a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea3413bc00 0x7fea340a8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 -- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea34063e50 msgr2=0x7fea340aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea34063e50 0x7fea340aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 -- 172.21.15.89:0/3645719482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2800b790 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.670+0000 7fea32ffd700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea340a6930 tx=0x7fea28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.671+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28010680 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.671+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2801e070 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.671+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28010a10 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.671+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea340ab220 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.671+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea340a9b00 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.672+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea340a9fb0 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.672+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7fea2802c410 con 0x7fea340a6fd0 2024-02-10T00:04:31.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.672+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fea28014070 con 0x7fea340a6fd0 2024-02-10T00:04:31.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.679+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fea2800d130 con 0x7fea340a6fd0 2024-02-10T00:04:31.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.694+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3b80a5c40 con 0x7fd3b8063740 2024-02-10T00:04:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.695+0000 7fd3ae7fc700 1 -- 172.21.15.89:0/1751862857 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3a802a070 con 0x7fd3b8063740 2024-02-10T00:04:31.697 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 >> v1:172.21.15.89:6816/47970 conn(0x7fd39c045da0 legacy=0x7fd39c048250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 msgr2=0x7fd3b80a7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009fb0 tx=0x7fd3a8017000 comp rx=0 tx=0).stop 2024-02-10T00:04:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 shutdown_connections 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd3b813f6e0 0x7fd3b814c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b8063740 0x7fd3b80a7370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 --2- 172.21.15.89:0/1751862857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80a5130 0x7fd3b80a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 >> 172.21.15.89:0/1751862857 conn(0x7fd3b806a820 msgr2=0x7fd3b80680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 shutdown_connections 2024-02-10T00:04:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.697+0000 7fd3c04c0700 1 -- 172.21.15.89:0/1751862857 wait complete. 2024-02-10T00:04:31.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.1 2024-02-10T00:04:31.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.715+0000 7f5bcd301700 1 Processor -- start 2024-02-10T00:04:31.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.715+0000 7f5bcd301700 1 -- start start 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bcd301700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc813e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bcd301700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bcd301700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc8064220 con 0x7f5bc8063e50 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bcd301700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc80a9e00 con 0x7f5bc813ee70 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bcd301700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80aa6e0 con 0x7f5bc80aa290 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60526/0 (socket says 172.21.15.89:60526) 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc77fe700 1 -- 172.21.15.89:0/2445171745 learned_addr learned my addr 172.21.15.89:0/2445171745 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc6ffd700 1 --1- 172.21.15.89:0/2445171745 >> v1:172.21.15.89:6789/0 conn(0x7f5bc8063e50 0x7f5bc806ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58982/0 (socket says 172.21.15.89:58982) 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 -- 172.21.15.89:0/2445171745 >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 msgr2=0x7f5bc8148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 --2- 172.21.15.89:0/2445171745 >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 -- 172.21.15.89:0/2445171745 >> v1:172.21.15.89:6789/0 conn(0x7f5bc8063e50 legacy=0x7f5bc806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc5ffb700 1 -- 172.21.15.89:0/2445171745 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879236528 0 0) 0x7f5bc8064220 con 0x7f5bc8063e50 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 -- 172.21.15.89:0/2445171745 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc813e480 con 0x7f5bc80aa290 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc77fe700 1 --2- 172.21.15.89:0/2445171745 >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.716+0000 7f5bc67fc700 1 --2- 172.21.15.89:0/2445171745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc813e930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0098e0 tx=0x7f5bbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83fa86f5597cb4bd server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bc5ffb700 1 -- 172.21.15.89:0/2445171745 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00b6d0 con 0x7f5bc80aa290 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bc5ffb700 1 -- 172.21.15.89:0/2445171745 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00b830 con 0x7f5bc80aa290 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bc5ffb700 1 -- 172.21.15.89:0/2445171745 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00bbd0 con 0x7f5bc80aa290 2024-02-10T00:04:31.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 -- 172.21.15.89:0/2445171745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 msgr2=0x7f5bc813e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 --2- 172.21.15.89:0/2445171745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc813e930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0098e0 tx=0x7f5bbc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 -- 172.21.15.89:0/2445171745 shutdown_connections 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 --2- 172.21.15.89:0/2445171745 >> v2:172.21.15.89:3300/0 conn(0x7f5bc813ee70 0x7f5bc8148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 --2- 172.21.15.89:0/2445171745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc813e930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 -- 172.21.15.89:0/2445171745 >> 172.21.15.89:0/2445171745 conn(0x7f5bc806c7c0 msgr2=0x7f5bc8063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 -- 172.21.15.89:0/2445171745 shutdown_connections 2024-02-10T00:04:31.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.717+0000 7f5bcd301700 1 -- 172.21.15.89:0/2445171745 wait complete. 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.718+0000 7f5bcd301700 1 Processor -- start 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.718+0000 7f5bcd301700 1 -- start start 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc80abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc813ee70 0x7f5bc80ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:31.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8097720 con 0x7f5bc8063e50 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80974b0 con 0x7f5bc813ee70 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bcd301700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80ab3f0 con 0x7f5bc80aa290 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc67fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc80abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60534/0 (socket says 172.21.15.89:60534) 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 -- 172.21.15.89:0/1962111523 learned_addr learned my addr 172.21.15.89:0/1962111523 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc77fe700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc813ee70 0x7f5bc80ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:31.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 -- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 msgr2=0x7f5bc80abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc80abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 -- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc813ee70 msgr2=0x7f5bc80ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc813ee70 0x7f5bc80ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 -- 172.21.15.89:0/1962111523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0009ae0 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.719+0000 7f5bc6ffd700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c810 tx=0x7f5bb8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.720+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8005b40 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.720+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8005cc0 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.720+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc009420 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.720+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8007320 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.720+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc80ac580 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.721+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc8096e80 con 0x7f5bc8063e50 2024-02-10T00:04:31.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.721+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f5bb801b3b0 con 0x7f5bc8063e50 2024-02-10T00:04:31.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.721+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f5bb805a220 con 0x7f5bc8063e50 2024-02-10T00:04:31.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.725+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f5bb80387c0 con 0x7f5bc8063e50 2024-02-10T00:04:31.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.838+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f19280a0c00 con 0x7f1928063740 2024-02-10T00:04:31.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.838+0000 7f191d7fa700 1 -- 172.21.15.89:0/1461573159 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1924015020 con 0x7f1928063740 2024-02-10T00:04:31.840 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:31.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 >> v1:172.21.15.89:6816/47970 conn(0x7f190c045da0 legacy=0x7f190c048250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 msgr2=0x7f19281432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19280a27e0 tx=0x7f1924017000 comp rx=0 tx=0).stop 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 shutdown_connections 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f19280a2250 0x7f1928141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1928063740 0x7f19281432b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 --2- 172.21.15.89:0/1461573159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f192809f280 0x7f192814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 >> 172.21.15.89:0/1461573159 conn(0x7f192806a820 msgr2=0x7f1928064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 shutdown_connections 2024-02-10T00:04:31.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.840+0000 7f192f5f1700 1 -- 172.21.15.89:0/1461573159 wait complete. 2024-02-10T00:04:31.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.844+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea3404c710 con 0x7fea340a6fd0 2024-02-10T00:04:31.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.844+0000 7fea1b7fe700 1 -- 172.21.15.89:0/3645719482 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea2800cb90 con 0x7fea340a6fd0 2024-02-10T00:04:31.846 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:31.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 >> v1:172.21.15.89:6816/47970 conn(0x7fea20045d70 legacy=0x7fea20048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 msgr2=0x7fea340a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea340a6930 tx=0x7fea28019000 comp rx=0 tx=0).stop 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 shutdown_connections 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fea3413bc00 0x7fea340a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea34063e50 0x7fea340aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 --2- 172.21.15.89:0/3645719482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea340a6fd0 0x7fea340a7c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 >> 172.21.15.89:0/3645719482 conn(0x7fea3406c7c0 msgr2=0x7fea3413c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 shutdown_connections 2024-02-10T00:04:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.846+0000 7fea39aff700 1 -- 172.21.15.89:0/3645719482 wait complete. 2024-02-10T00:04:31.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705743 got 38654705742 for osd.2 2024-02-10T00:04:31.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705740 for osd.3 2024-02-10T00:04:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.885+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5bc804c710 con 0x7f5bc8063e50 2024-02-10T00:04:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.885+0000 7f5baeffd700 1 -- 172.21.15.89:0/1962111523 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bb8017030 con 0x7f5bc8063e50 2024-02-10T00:04:31.887 INFO:teuthology.orchestra.run.smithi089.stdout:38654705740 2024-02-10T00:04:31.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 >> v1:172.21.15.89:6816/47970 conn(0x7f5bb4045d70 legacy=0x7f5bb4048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 msgr2=0x7f5bc80aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:31.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c810 tx=0x7f5bb8007d90 comp rx=0 tx=0).stop 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 shutdown_connections 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc813ee70 0x7f5bc80ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc8063e50 0x7f5bc80aea70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 --2- 172.21.15.89:0/1962111523 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5bc80aa290 0x7f5bc80abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 >> 172.21.15.89:0/1962111523 conn(0x7f5bc806c7c0 msgr2=0x7f5bc8064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 shutdown_connections 2024-02-10T00:04:31.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:31.887+0000 7f5bcd301700 1 -- 172.21.15.89:0/1962111523 wait complete. 2024-02-10T00:04:31.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705740 for osd.0 2024-02-10T00:04:32.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:04:32.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-02-10T00:04:32.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 Processor -- start 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 -- start start 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 0x7f29ec0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec064220 con 0x7f29ec0a9070 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0a80d0 con 0x7f29ec0a9440 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.845+0000 7f29f1d32700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec13f810 con 0x7f29ec063e50 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29eaffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 0x7f29ec0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41172/0 (socket says 172.21.15.89:41172) 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48194/0 (socket says 172.21.15.89:48194) 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 -- 172.21.15.89:0/4107605259 learned_addr learned my addr 172.21.15.89:0/4107605259 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 -- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 msgr2=0x7f29ec0a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 -- 172.21.15.89:0/4107605259 >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 msgr2=0x7f29ec0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 --2- 172.21.15.89:0/4107605259 >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 0x7f29ec0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 -- 172.21.15.89:0/4107605259 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec13fab0 con 0x7f29ec0a9440 2024-02-10T00:04:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29eb7fe700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29eaffd700 1 --2- 172.21.15.89:0/4107605259 >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 0x7f29ec0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ebfff700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009f20 tx=0x7f29e4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f1664ebf22caf server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ea7fc700 1 -- 172.21.15.89:0/4107605259 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400e070 con 0x7f29ec0a9440 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ea7fc700 1 -- 172.21.15.89:0/4107605259 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ba00 con 0x7f29ec0a9440 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.846+0000 7f29ea7fc700 1 -- 172.21.15.89:0/4107605259 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40092e0 con 0x7f29ec0a9440 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 -- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 msgr2=0x7f29ec0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009f20 tx=0x7f29e4009840 comp rx=0 tx=0).stop 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 -- 172.21.15.89:0/4107605259 shutdown_connections 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9440 0x7f29ec0b01c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4107605259 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4107605259 >> v2:172.21.15.89:3300/0 conn(0x7f29ec0a9070 0x7f29ec0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 -- 172.21.15.89:0/4107605259 >> 172.21.15.89:0/4107605259 conn(0x7f29ec06d8c0 msgr2=0x7f29ec063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 -- 172.21.15.89:0/4107605259 shutdown_connections 2024-02-10T00:04:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.847+0000 7f29f1d32700 1 -- 172.21.15.89:0/4107605259 wait complete. 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 Processor -- start 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 -- start start 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 0x7f29ec0ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 0x7f29ec14b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0adf90 con 0x7f29ec0a9440 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1491d0 con 0x7f29ec0a9070 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29f1d32700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0ab8f0 con 0x7f29ec063e50 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.848+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eaffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 0x7f29ec0ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48206/0 (socket says 172.21.15.89:48206) 2024-02-10T00:04:32.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 -- 172.21.15.89:0/4005163016 learned_addr learned my addr 172.21.15.89:0/4005163016 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29ebfff700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 0x7f29ec14b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 -- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 msgr2=0x7f29ec0ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 0x7f29ec0ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 -- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 msgr2=0x7f29ec14b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 0x7f29ec14b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 -- 172.21.15.89:0/4005163016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009420 con 0x7f29ec063e50 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29ebfff700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 0x7f29ec14b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eaffd700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 0x7f29ec0ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29eb7fe700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00ec80 tx=0x7f29dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00c9b0 con 0x7f29ec063e50 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00cb10 con 0x7f29ec063e50 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e0009420 con 0x7f29ec063e50 2024-02-10T00:04:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00ce90 con 0x7f29ec063e50 2024-02-10T00:04:32.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.849+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e4009ae0 con 0x7f29ec063e50 2024-02-10T00:04:32.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.850+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec0acb00 con 0x7f29ec063e50 2024-02-10T00:04:32.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.850+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f29dc013680 con 0x7f29ec063e50 2024-02-10T00:04:32.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.850+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f29dc05b100 con 0x7f29ec063e50 2024-02-10T00:04:32.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:04:32.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.854+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f29ec0acb00 con 0x7f29ec063e50 2024-02-10T00:04:32.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:04:32.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:04:32.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.977+0000 7f8846fd5700 1 Processor -- start 2024-02-10T00:04:32.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.977+0000 7f8846fd5700 1 -- start start 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8846fd5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f88400a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8846fd5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88400a5130 0x7f88400a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8846fd5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8840063b10 con 0x7f8840063740 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8846fd5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8840139bb0 con 0x7f88400a5130 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8846fd5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400a2100 con 0x7f884013f6e0 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8844d71700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8840063740 0x7f884013fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58990/0 (socket says 172.21.15.89:58990) 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8844d71700 1 -- 172.21.15.89:0/2992994126 learned_addr learned my addr 172.21.15.89:0/2992994126 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f8845572700 1 --2- 172.21.15.89:0/2992994126 >> v2:172.21.15.89:3300/0 conn(0x7f88400a5130 0x7f88400a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f883ffff700 1 --2- 172.21.15.89:0/2992994126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f88400a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f883f7fe700 1 -- 172.21.15.89:0/2992994126 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774639450 0 0) 0x7f8840063b10 con 0x7f8840063740 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f883f7fe700 1 -- 172.21.15.89:0/2992994126 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8830003570 con 0x7f8840063740 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f883ffff700 1 -- 172.21.15.89:0/2992994126 >> v2:172.21.15.89:3300/0 conn(0x7f88400a5130 msgr2=0x7f88400a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.978+0000 7f883ffff700 1 --2- 172.21.15.89:0/2992994126 >> v2:172.21.15.89:3300/0 conn(0x7f88400a5130 0x7f88400a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883ffff700 1 -- 172.21.15.89:0/2992994126 >> v1:172.21.15.89:6789/0 conn(0x7f8840063740 legacy=0x7f884013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883ffff700 1 -- 172.21.15.89:0/2992994126 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884013fb70 con 0x7f884013f6e0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883ffff700 1 --2- 172.21.15.89:0/2992994126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f88400a3240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f882c0098e0 tx=0x7f882c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e3beb3fc6e06df server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883f7fe700 1 -- 172.21.15.89:0/2992994126 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00b6d0 con 0x7f884013f6e0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883f7fe700 1 -- 172.21.15.89:0/2992994126 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00b830 con 0x7f884013f6e0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.979+0000 7f883f7fe700 1 -- 172.21.15.89:0/2992994126 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00bbb0 con 0x7f884013f6e0 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 -- 172.21.15.89:0/2992994126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 msgr2=0x7f88400a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2992994126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f88400a3240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f882c0098e0 tx=0x7f882c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 -- 172.21.15.89:0/2992994126 shutdown_connections 2024-02-10T00:04:32.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2992994126 >> v2:172.21.15.89:3300/0 conn(0x7f88400a5130 0x7f88400a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2992994126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f88400a3240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 -- 172.21.15.89:0/2992994126 >> 172.21.15.89:0/2992994126 conn(0x7f884006a820 msgr2=0x7f88400b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:32.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 -- 172.21.15.89:0/2992994126 shutdown_connections 2024-02-10T00:04:32.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.980+0000 7f8846fd5700 1 -- 172.21.15.89:0/2992994126 wait complete. 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.981+0000 7f8846fd5700 1 Processor -- start 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.981+0000 7f8846fd5700 1 -- start start 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8840063740 0x7f8840141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f884014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840142320 con 0x7f88400a5130 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88401425c0 con 0x7f884013f6e0 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f8846fd5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8840145800 con 0x7f8840063740 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f883ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f883ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60560/0 (socket says 172.21.15.89:60560) 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.982+0000 7f883ffff700 1 -- 172.21.15.89:0/2221218453 learned_addr learned my addr 172.21.15.89:0/2221218453 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f8844d71700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8840063740 0x7f8840141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f8845572700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f884014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 -- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8840063740 msgr2=0x7f8840141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8840063740 0x7f8840141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 -- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 msgr2=0x7f884014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f884014f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 -- 172.21.15.89:0/2221218453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009420 con 0x7f88400a5130 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883ffff700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8840139cf0 tx=0x7f882c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c000d10 con 0x7f88400a5130 2024-02-10T00:04:32.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00b9a0 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8840144510 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c025690 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.983+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8840144db0 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.985+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f882c023070 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.985+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f882c05c230 con 0x7f88400a5130 2024-02-10T00:04:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.985+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840144c10 con 0x7f88400a5130 2024-02-10T00:04:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:32.989+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f8840144c10 con 0x7f88400a5130 2024-02-10T00:04:33.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.020+0000 7f694f3a2700 1 Processor -- start 2024-02-10T00:04:33.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.020+0000 7f694f3a2700 1 -- start start 2024-02-10T00:04:33.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6948063740 0x7f694806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f694813eed0 0x7f69480a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694813f370 con 0x7f694813eed0 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6948063b10 con 0x7f6948063740 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694f3a2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f694806edd0 con 0x7f694806d860 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694eba1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f694813eed0 0x7f69480a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48236/0 (socket says 172.21.15.89:48236) 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 -- 172.21.15.89:0/2293898365 learned_addr learned my addr 172.21.15.89:0/2293898365 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694e3a0700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6948063740 0x7f694806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 -- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6948063740 msgr2=0x7f694806f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6948063740 0x7f694806f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 -- 172.21.15.89:0/2293898365 >> v2:172.21.15.89:3300/0 conn(0x7f694813eed0 msgr2=0x7f69480a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 --2- 172.21.15.89:0/2293898365 >> v2:172.21.15.89:3300/0 conn(0x7f694813eed0 0x7f69480a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 -- 172.21.15.89:0/2293898365 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694813e3f0 con 0x7f694806d860 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.021+0000 7f694db9f700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69380099b0 tx=0x7f6938009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b95ae14315a4461 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694d39e700 1 -- 172.21.15.89:0/2293898365 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800b680 con 0x7f694806d860 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694d39e700 1 -- 172.21.15.89:0/2293898365 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693800b7e0 con 0x7f694806d860 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694d39e700 1 -- 172.21.15.89:0/2293898365 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800bb80 con 0x7f694806d860 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 -- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 msgr2=0x7f694813e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69380099b0 tx=0x7f6938009250 comp rx=0 tx=0).stop 2024-02-10T00:04:33.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 -- 172.21.15.89:0/2293898365 shutdown_connections 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 --2- 172.21.15.89:0/2293898365 >> v2:172.21.15.89:3300/0 conn(0x7f694813eed0 0x7f69480a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6948063740 0x7f694806f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 --2- 172.21.15.89:0/2293898365 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694806d860 0x7f694813e990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 -- 172.21.15.89:0/2293898365 >> 172.21.15.89:0/2293898365 conn(0x7f694806c1c0 msgr2=0x7f6948069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 -- 172.21.15.89:0/2293898365 shutdown_connections 2024-02-10T00:04:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.022+0000 7f694f3a2700 1 -- 172.21.15.89:0/2293898365 wait complete. 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.023+0000 7f694f3a2700 1 Processor -- start 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.023+0000 7f694f3a2700 1 -- start start 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6948063740 0x7f694809b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694809ae60 con 0x7f6948063740 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6948099a60 con 0x7f694806d860 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694f3a2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b1730 con 0x7f694813eed0 2024-02-10T00:04:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694db9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48240/0 (socket says 172.21.15.89:48240) 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694db9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41218/0 (socket says 172.21.15.89:41218) 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 -- 172.21.15.89:0/3510820084 learned_addr learned my addr 172.21.15.89:0/3510820084 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694e3a0700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6948063740 0x7f694809b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 -- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 msgr2=0x7f694814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 -- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6948063740 msgr2=0x7f694809b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6948063740 0x7f694809b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 -- 172.21.15.89:0/3510820084 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380094f0 con 0x7f694813eed0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694db9f700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.024+0000 7f694eba1700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6940012470 tx=0x7f6940011040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.025+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940014040 con 0x7f694813eed0 2024-02-10T00:04:33.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.025+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940012e80 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.025+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694809baa0 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.025+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940018630 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.025+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69480982b0 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.026+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694814a080 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.026+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f6940018a20 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.026+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f69400673b0 con 0x7f694813eed0 2024-02-10T00:04:33.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.030+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f694003d1a0 con 0x7f694813eed0 2024-02-10T00:04:33.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.042+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f29ec0acb00 con 0x7f29ec063e50 2024-02-10T00:04:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.042+0000 7f29d37fe700 1 -- 172.21.15.89:0/4005163016 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29ec0acb00 con 0x7f29ec063e50 2024-02-10T00:04:33.045 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:33.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 >> v1:172.21.15.89:6816/47970 conn(0x7f29d8045da0 legacy=0x7f29d8048250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 msgr2=0x7f29ec0ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00ec80 tx=0x7f29dc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 shutdown_connections 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29ec0a9440 0x7f29ec14b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f29ec063e50 0x7f29ec0ac5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 --2- 172.21.15.89:0/4005163016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29ec0a9070 0x7f29ec0ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 >> 172.21.15.89:0/4005163016 conn(0x7f29ec06d8c0 msgr2=0x7f29ec06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 shutdown_connections 2024-02-10T00:04:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.045+0000 7f29f1d32700 1 -- 172.21.15.89:0/4005163016 wait complete. 2024-02-10T00:04:33.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705742 for osd.1 2024-02-10T00:04:33.065 DEBUG:teuthology.parallel:result is None 2024-02-10T00:04:33.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.072+0000 7f0c93b5d700 1 Processor -- start 2024-02-10T00:04:33.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.072+0000 7f0c93b5d700 1 -- start start 2024-02-10T00:04:33.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c93b5d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 0x7f0c8c0a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c93b5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 0x7f0c8c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c93b5d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c064220 con 0x7f0c8c140410 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c93b5d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0a8600 con 0x7f0c8c063e50 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c93b5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c13f7c0 con 0x7f0c8c0a6110 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c918f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 0x7f0c8c0a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c920fa700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0c8c140410 0x7f0c8c067970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58992/0 (socket says 172.21.15.89:58992) 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c920fa700 1 -- 172.21.15.89:0/1115629297 learned_addr learned my addr 172.21.15.89:0/1115629297 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c910f8700 1 --2- 172.21.15.89:0/1115629297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 0x7f0c8c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c908f7700 1 -- 172.21.15.89:0/1115629297 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288504553 0 0) 0x7f0c8c064220 con 0x7f0c8c140410 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.073+0000 7f0c908f7700 1 -- 172.21.15.89:0/1115629297 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c78003570 con 0x7f0c8c140410 2024-02-10T00:04:33.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c910f8700 1 -- 172.21.15.89:0/1115629297 >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 msgr2=0x7f0c8c0a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c910f8700 1 --2- 172.21.15.89:0/1115629297 >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 0x7f0c8c0a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c910f8700 1 -- 172.21.15.89:0/1115629297 >> v1:172.21.15.89:6789/0 conn(0x7f0c8c140410 legacy=0x7f0c8c067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c910f8700 1 -- 172.21.15.89:0/1115629297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c13fa80 con 0x7f0c8c0a6110 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c918f9700 1 --2- 172.21.15.89:0/1115629297 >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 0x7f0c8c0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c910f8700 1 --2- 172.21.15.89:0/1115629297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 0x7f0c8c13fed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098e0 tx=0x7f0c7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37f1ad14d7a6ee7 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c908f7700 1 -- 172.21.15.89:0/1115629297 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011630 con 0x7f0c8c0a6110 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c908f7700 1 -- 172.21.15.89:0/1115629297 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c011790 con 0x7f0c8c0a6110 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.074+0000 7f0c908f7700 1 -- 172.21.15.89:0/1115629297 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011b30 con 0x7f0c8c0a6110 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 -- 172.21.15.89:0/1115629297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 msgr2=0x7f0c8c13fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/1115629297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 0x7f0c8c13fed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098e0 tx=0x7f0c7c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 -- 172.21.15.89:0/1115629297 shutdown_connections 2024-02-10T00:04:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/1115629297 >> v2:172.21.15.89:3300/0 conn(0x7f0c8c063e50 0x7f0c8c0a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/1115629297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c0a6110 0x7f0c8c13fed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 -- 172.21.15.89:0/1115629297 >> 172.21.15.89:0/1115629297 conn(0x7f0c8c06c7c0 msgr2=0x7f0c8c063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 -- 172.21.15.89:0/1115629297 shutdown_connections 2024-02-10T00:04:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.075+0000 7f0c93b5d700 1 -- 172.21.15.89:0/1115629297 wait complete. 2024-02-10T00:04:33.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.076+0000 7f0c93b5d700 1 Processor -- start 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.076+0000 7f0c93b5d700 1 -- start start 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 0x7f0c8c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 0x7f0c8c0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c096d80 con 0x7f0c8c0a6110 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c096f80 con 0x7f0c8c140410 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c93b5d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c06dee0 con 0x7f0c8c063e50 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c918f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c920fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 0x7f0c8c0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c918f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48246/0 (socket says 172.21.15.89:48246) 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c918f9700 1 -- 172.21.15.89:0/2454761607 learned_addr learned my addr 172.21.15.89:0/2454761607 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.077+0000 7f0c910f8700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 0x7f0c8c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 -- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 msgr2=0x7f0c8c0ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 0x7f0c8c0ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 -- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 msgr2=0x7f0c8c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 0x7f0c8c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 -- 172.21.15.89:0/2454761607 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88009420 con 0x7f0c8c063e50 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c920fa700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 0x7f0c8c0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c910f8700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 0x7f0c8c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c918f9700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800ec80 tx=0x7f0c880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800c920 con 0x7f0c8c063e50 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8800ca80 con 0x7f0c8c063e50 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c009420 con 0x7f0c8c063e50 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800ce00 con 0x7f0c8c063e50 2024-02-10T00:04:33.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.078+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c0b1620 con 0x7f0c8c063e50 2024-02-10T00:04:33.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.079+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f0c88013680 con 0x7f0c8c063e50 2024-02-10T00:04:33.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.079+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c0a3cc0 con 0x7f0c8c063e50 2024-02-10T00:04:33.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.079+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f0c8805b0b0 con 0x7f0c8c063e50 2024-02-10T00:04:33.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.087+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0c88039650 con 0x7f0c8c063e50 2024-02-10T00:04:33.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.131+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f882c006710 con 0x7f88400a5130 2024-02-10T00:04:33.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.139+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f6940018cd0 con 0x7f694813eed0 2024-02-10T00:04:33.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.140+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f0c880392d0 con 0x7f0c8c063e50 2024-02-10T00:04:33.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.182+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8840144c10 con 0x7f88400a5130 2024-02-10T00:04:33.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.182+0000 7f883cff9700 1 -- 172.21.15.89:0/2221218453 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8840144c10 con 0x7f88400a5130 2024-02-10T00:04:33.185 INFO:teuthology.orchestra.run.smithi089.stdout:38654705744 2024-02-10T00:04:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 >> v1:172.21.15.89:6816/47970 conn(0x7f8824045d70 legacy=0x7f8824048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 msgr2=0x7f884014ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8840139cf0 tx=0x7f882c017000 comp rx=0 tx=0).stop 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 shutdown_connections 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884013f6e0 0x7f884014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8840063740 0x7f8840141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 --2- 172.21.15.89:0/2221218453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88400a5130 0x7f884014ef90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 >> 172.21.15.89:0/2221218453 conn(0x7f884006a820 msgr2=0x7f88400680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 shutdown_connections 2024-02-10T00:04:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.184+0000 7f8846fd5700 1 -- 172.21.15.89:0/2221218453 wait complete. 2024-02-10T00:04:33.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705743 got 38654705744 for osd.2 2024-02-10T00:04:33.198 DEBUG:teuthology.parallel:result is None 2024-02-10T00:04:33.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.206+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f694806a6d0 con 0x7f694813eed0 2024-02-10T00:04:33.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.206+0000 7f693e7fc700 1 -- 172.21.15.89:0/3510820084 <== mon.2 v2:172.21.15.89:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f694005bb70 con 0x7f694813eed0 2024-02-10T00:04:33.212 INFO:teuthology.orchestra.run.smithi089.stdout:38654705743 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 >> v1:172.21.15.89:6816/47970 conn(0x7f692c045d70 legacy=0x7f692c048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 msgr2=0x7f6948099d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6940012470 tx=0x7f6940011040 comp rx=0 tx=0).stop 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 shutdown_connections 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f694813eed0 0x7f6948099d20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6948063740 0x7f694809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 --2- 172.21.15.89:0/3510820084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f694806d860 0x7f694814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 >> 172.21.15.89:0/3510820084 conn(0x7f694806c1c0 msgr2=0x7f694813d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 shutdown_connections 2024-02-10T00:04:33.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.208+0000 7f694f3a2700 1 -- 172.21.15.89:0/3510820084 wait complete. 2024-02-10T00:04:33.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705743 for osd.3 2024-02-10T00:04:33.222 DEBUG:teuthology.parallel:result is None 2024-02-10T00:04:33.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.253+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c8c04c710 con 0x7f0c8c063e50 2024-02-10T00:04:33.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.253+0000 7f0c81ffb700 1 -- 172.21.15.89:0/2454761607 <== mon.2 v2:172.21.15.89:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c88044a10 con 0x7f0c8c063e50 2024-02-10T00:04:33.256 INFO:teuthology.orchestra.run.smithi089.stdout:38654705742 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 >> v1:172.21.15.89:6816/47970 conn(0x7f0c70045d70 legacy=0x7f0c70048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 msgr2=0x7f0c8c06ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800ec80 tx=0x7f0c880091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 shutdown_connections 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c8c140410 0x7f0c8c0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0c8c063e50 0x7f0c8c06ef40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 --2- 172.21.15.89:0/2454761607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c8c0a6110 0x7f0c8c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 >> 172.21.15.89:0/2454761607 conn(0x7f0c8c06c7c0 msgr2=0x7f0c8c13c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 shutdown_connections 2024-02-10T00:04:33.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.255+0000 7f0c93b5d700 1 -- 172.21.15.89:0/2454761607 wait complete. 2024-02-10T00:04:33.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705741 got 38654705742 for osd.0 2024-02-10T00:04:33.269 DEBUG:teuthology.parallel:result is None 2024-02-10T00:04:33.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-10T00:04:33.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 Processor -- start 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 -- start start 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753406dbb0 con 0x7f753406f7c0 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753413f500 con 0x7f7534063740 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f753a739700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b1a10 con 0x7f753413f060 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f75337fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f7538cd6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f7533fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f7533fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41242/0 (socket says 172.21.15.89:41242) 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f75337fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60596/0 (socket says 172.21.15.89:60596) 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f7533fff700 1 -- 172.21.15.89:0/2680442910 learned_addr learned my addr 172.21.15.89:0/2680442910 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.425+0000 7f7538cd6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48248/0 (socket says 172.21.15.89:48248) 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 -- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 msgr2=0x7f75340a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 -- 172.21.15.89:0/2680442910 >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 msgr2=0x7f753413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 --2- 172.21.15.89:0/2680442910 >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 -- 172.21.15.89:0/2680442910 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534063b10 con 0x7f7534063740 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f75337fe700 1 --2- 172.21.15.89:0/2680442910 >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7538cd6700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7533fff700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f752400ba60 tx=0x7f75240090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccea41961b4a1a0a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7532ffd700 1 -- 172.21.15.89:0/2680442910 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400bea0 con 0x7f7534063740 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7532ffd700 1 -- 172.21.15.89:0/2680442910 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400caf0 con 0x7f7534063740 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f7532ffd700 1 -- 172.21.15.89:0/2680442910 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400f460 con 0x7f7534063740 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 -- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 msgr2=0x7f753406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f752400ba60 tx=0x7f75240090f0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 -- 172.21.15.89:0/2680442910 shutdown_connections 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753413f060 0x7f75340a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 --2- 172.21.15.89:0/2680442910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7534063740 0x7f753406dfd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 --2- 172.21.15.89:0/2680442910 >> v2:172.21.15.89:3300/0 conn(0x7f753406f7c0 0x7f753413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 -- 172.21.15.89:0/2680442910 >> 172.21.15.89:0/2680442910 conn(0x7f753406a820 msgr2=0x7f75340b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 -- 172.21.15.89:0/2680442910 shutdown_connections 2024-02-10T00:04:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.426+0000 7f753a739700 1 -- 172.21.15.89:0/2680442910 wait complete. 2024-02-10T00:04:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.427+0000 7f753a739700 1 Processor -- start 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 -- start start 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 0x7f7534096b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 0x7f75340970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534139e00 con 0x7f7534063740 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753414e060 con 0x7f753413f060 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f753a739700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75340a09e0 con 0x7f753406f7c0 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7538cd6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 0x7f75340970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60598/0 (socket says 172.21.15.89:60598) 2024-02-10T00:04:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 -- 172.21.15.89:0/3416860963 learned_addr learned my addr 172.21.15.89:0/3416860963 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f75337fe700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 0x7f7534096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 -- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 msgr2=0x7f7534096b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 0x7f7534096b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 -- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 msgr2=0x7f75340970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 0x7f75340970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7533fff700 1 -- 172.21.15.89:0/3416860963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c00d8d0 con 0x7f7534063740 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f75337fe700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 0x7f7534096b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.428+0000 7f7538cd6700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 0x7f75340970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f7533fff700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7524006fd0 tx=0x7f7524017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524017400 con 0x7f7534063740 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752401d040 con 0x7f7534063740 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240177d0 con 0x7f7534063740 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c009a20 con 0x7f7534063740 2024-02-10T00:04:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.429+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752400b5a0 con 0x7f7534063740 2024-02-10T00:04:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.430+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f7524017bc0 con 0x7f7534063740 2024-02-10T00:04:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.430+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404c710 con 0x7f7534063740 2024-02-10T00:04:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.430+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f752405d010 con 0x7f7534063740 2024-02-10T00:04:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.433+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f7524001d40 con 0x7f7534063740 2024-02-10T00:04:33.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.580+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75340a34b0 con 0x7f7514045fb0 2024-02-10T00:04:33.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.587+0000 7f752bfff700 1 -- 172.21.15.89:0/3416860963 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272605 (unknown 2965378022 0 2168064033) 0x7f75340a34b0 con 0x7f7514045fb0 2024-02-10T00:04:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 >> v1:172.21.15.89:6816/47970 conn(0x7f7514045fb0 legacy=0x7f7514048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 msgr2=0x7f753414d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7524006fd0 tx=0x7f7524017000 comp rx=0 tx=0).stop 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 shutdown_connections 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753413f060 0x7f75340970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7534063740 0x7f753414d690 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 --2- 172.21.15.89:0/3416860963 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f753406f7c0 0x7f7534096b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 >> 172.21.15.89:0/3416860963 conn(0x7f753406a820 msgr2=0x7f753413c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 shutdown_connections 2024-02-10T00:04:33.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.590+0000 7f753a739700 1 -- 172.21.15.89:0/3416860963 wait complete. 2024-02-10T00:04:33.597 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:04:33.604 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-02-10T00:04:33.130814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147592590,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5942,"num_read_kb":2811092,"num_write":65162,"num_write_kb":9043889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71627,"ondisk_log_size":71627,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4483384,"kb_used_data":289048,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373003976,"statfs":{"total":386547056640,"available":381956071424,"internally_reserved":4294967296,"allocated":295985152,"data_stored":295416666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998942"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":892,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.414645+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-10T00:02:21.414645+0000","last_peered":"2024-02-10T00:02:21.414645+0000","last_clean":"2024-02-10T00:02:21.414645+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-10T00:02:21.414645+0000","last_undegraded":"2024-02-10T00:02:21.414645+0000","last_fullsized":"2024-02-10T00:02:21.414645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":927,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.380315+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-10T00:02:21.380315+0000","last_peered":"2024-02-10T00:02:21.380315+0000","last_clean":"2024-02-10T00:02:21.380315+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-10T00:02:21.380315+0000","last_undegraded":"2024-02-10T00:02:21.380315+0000","last_fullsized":"2024-02-10T00:02:21.380315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":889,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369322+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-10T00:02:22.369322+0000","last_peered":"2024-02-10T00:02:22.369322+0000","last_clean":"2024-02-10T00:02:22.369322+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-10T00:02:22.369322+0000","last_undegraded":"2024-02-10T00:02:22.369322+0000","last_fullsized":"2024-02-10T00:02:22.369322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":813,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.359268+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-10T00:02:22.359268+0000","last_peered":"2024-02-10T00:02:22.359268+0000","last_clean":"2024-02-10T00:02:22.359268+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-10T00:02:22.359268+0000","last_undegraded":"2024-02-10T00:02:22.359268+0000","last_fullsized":"2024-02-10T00:02:22.359268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":808,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372610+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-10T00:02:22.372610+0000","last_peered":"2024-02-10T00:02:22.372610+0000","last_clean":"2024-02-10T00:02:22.372610+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-10T00:02:22.372610+0000","last_undegraded":"2024-02-10T00:02:22.372610+0000","last_fullsized":"2024-02-10T00:02:22.372610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":840,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.365912+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-10T00:02:22.365912+0000","last_peered":"2024-02-10T00:02:22.365912+0000","last_clean":"2024-02-10T00:02:22.365912+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-10T00:02:22.365912+0000","last_undegraded":"2024-02-10T00:02:22.365912+0000","last_fullsized":"2024-02-10T00:02:22.365912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.337608+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-10T00:02:22.337608+0000","last_peered":"2024-02-10T00:02:22.337608+0000","last_clean":"2024-02-10T00:02:22.337608+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-10T00:02:22.337608+0000","last_undegraded":"2024-02-10T00:02:22.337608+0000","last_fullsized":"2024-02-10T00:02:22.337608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":774,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364278+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-10T00:02:22.364278+0000","last_peered":"2024-02-10T00:02:22.364278+0000","last_clean":"2024-02-10T00:02:22.364278+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-10T00:02:22.364278+0000","last_undegraded":"2024-02-10T00:02:22.364278+0000","last_fullsized":"2024-02-10T00:02:22.364278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":902,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.356794+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-10T00:02:22.356794+0000","last_peered":"2024-02-10T00:02:22.356794+0000","last_clean":"2024-02-10T00:02:22.356794+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-10T00:02:22.356794+0000","last_undegraded":"2024-02-10T00:02:22.356794+0000","last_fullsized":"2024-02-10T00:02:22.356794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":876,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.347824+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-10T00:02:22.347824+0000","last_peered":"2024-02-10T00:02:22.347824+0000","last_clean":"2024-02-10T00:02:22.347824+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-10T00:02:22.347824+0000","last_undegraded":"2024-02-10T00:02:22.347824+0000","last_fullsized":"2024-02-10T00:02:22.347824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":821,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391360+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-10T00:02:21.391360+0000","last_peered":"2024-02-10T00:02:21.391360+0000","last_clean":"2024-02-10T00:02:21.391360+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-10T00:02:21.391360+0000","last_undegraded":"2024-02-10T00:02:21.391360+0000","last_fullsized":"2024-02-10T00:02:21.391360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.366948+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-10T00:02:22.366948+0000","last_peered":"2024-02-10T00:02:22.366948+0000","last_clean":"2024-02-10T00:02:22.366948+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-10T00:02:22.366948+0000","last_undegraded":"2024-02-10T00:02:22.366948+0000","last_fullsized":"2024-02-10T00:02:22.366948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":937,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372642+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-10T00:02:22.372642+0000","last_peered":"2024-02-10T00:02:22.372642+0000","last_clean":"2024-02-10T00:02:22.372642+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-10T00:02:22.372642+0000","last_undegraded":"2024-02-10T00:02:22.372642+0000","last_fullsized":"2024-02-10T00:02:22.372642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":912,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.367103+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-10T00:02:22.367103+0000","last_peered":"2024-02-10T00:02:22.367103+0000","last_clean":"2024-02-10T00:02:22.367103+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-10T00:02:22.367103+0000","last_undegraded":"2024-02-10T00:02:22.367103+0000","last_fullsized":"2024-02-10T00:02:22.367103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":965,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.343258+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-10T00:02:22.343258+0000","last_peered":"2024-02-10T00:02:22.343258+0000","last_clean":"2024-02-10T00:02:22.343258+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-10T00:02:22.343258+0000","last_undegraded":"2024-02-10T00:02:22.343258+0000","last_fullsized":"2024-02-10T00:02:22.343258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.418567+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-10T00:02:21.418567+0000","last_peered":"2024-02-10T00:02:21.418567+0000","last_clean":"2024-02-10T00:02:21.418567+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-10T00:02:21.418567+0000","last_undegraded":"2024-02-10T00:02:21.418567+0000","last_fullsized":"2024-02-10T00:02:21.418567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":957,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.346719+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-10T00:02:22.346719+0000","last_peered":"2024-02-10T00:02:22.346719+0000","last_clean":"2024-02-10T00:02:22.346719+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-10T00:02:22.346719+0000","last_undegraded":"2024-02-10T00:02:22.346719+0000","last_fullsized":"2024-02-10T00:02:22.346719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":758,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.411128+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-10T00:02:21.411128+0000","last_peered":"2024-02-10T00:02:21.411128+0000","last_clean":"2024-02-10T00:02:21.411128+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-10T00:02:21.411128+0000","last_undegraded":"2024-02-10T00:02:21.411128+0000","last_fullsized":"2024-02-10T00:02:21.411128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":986,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.392376+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-10T00:02:21.392376+0000","last_peered":"2024-02-10T00:02:21.392376+0000","last_clean":"2024-02-10T00:02:21.392376+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-10T00:02:21.392376+0000","last_undegraded":"2024-02-10T00:02:21.392376+0000","last_fullsized":"2024-02-10T00:02:21.392376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":862,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.338093+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-10T00:02:22.338093+0000","last_peered":"2024-02-10T00:02:22.338093+0000","last_clean":"2024-02-10T00:02:22.338093+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-10T00:02:22.338093+0000","last_undegraded":"2024-02-10T00:02:22.338093+0000","last_fullsized":"2024-02-10T00:02:22.338093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":927,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.349808+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-10T00:02:22.349808+0000","last_peered":"2024-02-10T00:02:22.349808+0000","last_clean":"2024-02-10T00:02:22.349808+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-10T00:02:22.349808+0000","last_undegraded":"2024-02-10T00:02:22.349808+0000","last_fullsized":"2024-02-10T00:02:22.349808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":943,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369434+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-10T00:02:22.369434+0000","last_peered":"2024-02-10T00:02:22.369434+0000","last_clean":"2024-02-10T00:02:22.369434+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-10T00:02:22.369434+0000","last_undegraded":"2024-02-10T00:02:22.369434+0000","last_fullsized":"2024-02-10T00:02:22.369434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":929,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369890+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-10T00:02:22.369890+0000","last_peered":"2024-02-10T00:02:22.369890+0000","last_clean":"2024-02-10T00:02:22.369890+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-10T00:02:22.369890+0000","last_undegraded":"2024-02-10T00:02:22.369890+0000","last_fullsized":"2024-02-10T00:02:22.369890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":931,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.340544+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-10T00:02:22.340544+0000","last_peered":"2024-02-10T00:02:22.340544+0000","last_clean":"2024-02-10T00:02:22.340544+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-10T00:02:22.340544+0000","last_undegraded":"2024-02-10T00:02:22.340544+0000","last_fullsized":"2024-02-10T00:02:22.340544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":951,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.370575+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-10T00:02:22.370575+0000","last_peered":"2024-02-10T00:02:22.370575+0000","last_clean":"2024-02-10T00:02:22.370575+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-10T00:02:22.370575+0000","last_undegraded":"2024-02-10T00:02:22.370575+0000","last_fullsized":"2024-02-10T00:02:22.370575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":915,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364176+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-10T00:02:22.364176+0000","last_peered":"2024-02-10T00:02:22.364176+0000","last_clean":"2024-02-10T00:02:22.364176+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-10T00:02:22.364176+0000","last_undegraded":"2024-02-10T00:02:22.364176+0000","last_fullsized":"2024-02-10T00:02:22.364176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372567+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-10T00:02:22.372567+0000","last_peered":"2024-02-10T00:02:22.372567+0000","last_clean":"2024-02-10T00:02:22.372567+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-10T00:02:22.372567+0000","last_undegraded":"2024-02-10T00:02:22.372567+0000","last_fullsized":"2024-02-10T00:02:22.372567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1479,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.821086+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-10T00:02:43.821086+0000","last_peered":"2024-02-10T00:02:43.821086+0000","last_clean":"2024-02-10T00:02:43.821086+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-10T00:02:43.821086+0000","last_undegraded":"2024-02-10T00:02:43.821086+0000","last_fullsized":"2024-02-10T00:02:43.821086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":844,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.344684+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-10T00:02:22.344684+0000","last_peered":"2024-02-10T00:02:22.344684+0000","last_clean":"2024-02-10T00:02:22.344684+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-10T00:02:22.344684+0000","last_undegraded":"2024-02-10T00:02:22.344684+0000","last_fullsized":"2024-02-10T00:02:22.344684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":865,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.829032+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-10T00:02:43.829032+0000","last_peered":"2024-02-10T00:02:43.829032+0000","last_clean":"2024-02-10T00:02:43.829032+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-10T00:02:43.829032+0000","last_undegraded":"2024-02-10T00:02:43.829032+0000","last_fullsized":"2024-02-10T00:02:43.829032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":300,"num_read_kb":1528,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":875,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.345472+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-10T00:02:21.345472+0000","last_peered":"2024-02-10T00:02:21.345472+0000","last_clean":"2024-02-10T00:02:21.345472+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-10T00:02:21.345472+0000","last_undegraded":"2024-02-10T00:02:21.345472+0000","last_fullsized":"2024-02-10T00:02:21.345472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1126,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.825105+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-10T00:02:38.825105+0000","last_peered":"2024-02-10T00:02:38.825105+0000","last_clean":"2024-02-10T00:02:38.825105+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-10T00:02:38.825105+0000","last_undegraded":"2024-02-10T00:02:38.825105+0000","last_fullsized":"2024-02-10T00:02:38.825105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":879,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.398351+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-10T00:02:21.398351+0000","last_peered":"2024-02-10T00:02:21.398351+0000","last_clean":"2024-02-10T00:02:21.398351+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-10T00:02:21.398351+0000","last_undegraded":"2024-02-10T00:02:21.398351+0000","last_fullsized":"2024-02-10T00:02:21.398351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'142","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:48.809274+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-10T00:02:48.809274+0000","last_peered":"2024-02-10T00:02:48.809274+0000","last_clean":"2024-02-10T00:02:48.809274+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-10T00:02:48.809274+0000","last_undegraded":"2024-02-10T00:02:48.809274+0000","last_fullsized":"2024-02-10T00:02:48.809274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":913,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364375+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-10T00:02:22.364375+0000","last_peered":"2024-02-10T00:02:22.364375+0000","last_clean":"2024-02-10T00:02:22.364375+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-10T00:02:22.364375+0000","last_undegraded":"2024-02-10T00:02:22.364375+0000","last_fullsized":"2024-02-10T00:02:22.364375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1008,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.838974+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-10T00:02:43.838974+0000","last_peered":"2024-02-10T00:02:43.838974+0000","last_clean":"2024-02-10T00:02:43.838974+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-10T00:02:43.838974+0000","last_undegraded":"2024-02-10T00:02:43.838974+0000","last_fullsized":"2024-02-10T00:02:43.838974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1030,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350531+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-10T00:02:22.350531+0000","last_peered":"2024-02-10T00:02:22.350531+0000","last_clean":"2024-02-10T00:02:22.350531+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-10T00:02:22.350531+0000","last_undegraded":"2024-02-10T00:02:22.350531+0000","last_fullsized":"2024-02-10T00:02:22.350531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'395","reported_seq":407,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.810840+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-10T00:02:43.810840+0000","last_peered":"2024-02-10T00:02:43.810840+0000","last_clean":"2024-02-10T00:02:43.810840+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-10T00:02:43.810840+0000","last_undegraded":"2024-02-10T00:02:43.810840+0000","last_fullsized":"2024-02-10T00:02:43.810840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":996,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.344098+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-10T00:02:22.344098+0000","last_peered":"2024-02-10T00:02:22.344098+0000","last_clean":"2024-02-10T00:02:22.344098+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-10T00:02:22.344098+0000","last_undegraded":"2024-02-10T00:02:22.344098+0000","last_fullsized":"2024-02-10T00:02:22.344098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'657","reported_seq":669,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-10T00:04:30.129068+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-10T00:04:30.129068+0000","last_peered":"2024-02-10T00:04:30.129068+0000","last_clean":"2024-02-10T00:04:30.129068+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-10T00:04:30.129068+0000","last_undegraded":"2024-02-10T00:04:30.129068+0000","last_fullsized":"2024-02-10T00:04:30.129068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":560,"num_write_kb":12586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":968,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372536+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-10T00:02:22.372536+0000","last_peered":"2024-02-10T00:02:22.372536+0000","last_clean":"2024-02-10T00:02:22.372536+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-10T00:02:22.372536+0000","last_undegraded":"2024-02-10T00:02:22.372536+0000","last_fullsized":"2024-02-10T00:02:22.372536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":399,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.816585+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-10T00:02:38.816585+0000","last_peered":"2024-02-10T00:02:38.816585+0000","last_clean":"2024-02-10T00:02:38.816585+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-10T00:02:38.816585+0000","last_undegraded":"2024-02-10T00:02:38.816585+0000","last_fullsized":"2024-02-10T00:02:38.816585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1066,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350819+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-10T00:02:22.350819+0000","last_peered":"2024-02-10T00:02:22.350819+0000","last_clean":"2024-02-10T00:02:22.350819+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-10T00:02:22.350819+0000","last_undegraded":"2024-02-10T00:02:22.350819+0000","last_fullsized":"2024-02-10T00:02:22.350819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.826761+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-10T00:02:38.826761+0000","last_peered":"2024-02-10T00:02:38.826761+0000","last_clean":"2024-02-10T00:02:38.826761+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-10T00:02:38.826761+0000","last_undegraded":"2024-02-10T00:02:38.826761+0000","last_fullsized":"2024-02-10T00:02:38.826761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":928,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.362005+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-10T00:02:22.362005+0000","last_peered":"2024-02-10T00:02:22.362005+0000","last_clean":"2024-02-10T00:02:22.362005+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-10T00:02:22.362005+0000","last_undegraded":"2024-02-10T00:02:22.362005+0000","last_fullsized":"2024-02-10T00:02:22.362005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'478","reported_seq":490,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.818996+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-10T00:02:43.818996+0000","last_peered":"2024-02-10T00:02:43.818996+0000","last_clean":"2024-02-10T00:02:43.818996+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-10T00:02:43.818996+0000","last_undegraded":"2024-02-10T00:02:43.818996+0000","last_fullsized":"2024-02-10T00:02:43.818996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":912,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.386774+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-10T00:02:21.386774+0000","last_peered":"2024-02-10T00:02:21.386774+0000","last_clean":"2024-02-10T00:02:21.386774+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-10T00:02:21.386774+0000","last_undegraded":"2024-02-10T00:02:21.386774+0000","last_fullsized":"2024-02-10T00:02:21.386774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":506,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.817098+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-10T00:02:38.817098+0000","last_peered":"2024-02-10T00:02:38.817098+0000","last_clean":"2024-02-10T00:02:38.817098+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-10T00:02:38.817098+0000","last_undegraded":"2024-02-10T00:02:38.817098+0000","last_fullsized":"2024-02-10T00:02:38.817098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":827,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.346453+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-10T00:02:22.346453+0000","last_peered":"2024-02-10T00:02:22.346453+0000","last_clean":"2024-02-10T00:02:22.346453+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-10T00:02:22.346453+0000","last_undegraded":"2024-02-10T00:02:22.346453+0000","last_fullsized":"2024-02-10T00:02:22.346453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:16.355781+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-10T00:02:16.355781+0000","last_peered":"2024-02-10T00:02:16.355781+0000","last_clean":"2024-02-10T00:02:16.355781+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-10T00:02:16.355781+0000","last_undegraded":"2024-02-10T00:02:16.355781+0000","last_fullsized":"2024-02-10T00:02:16.355781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1052,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.337459+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-10T00:02:22.337459+0000","last_peered":"2024-02-10T00:02:22.337459+0000","last_clean":"2024-02-10T00:02:22.337459+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-10T00:02:22.337459+0000","last_undegraded":"2024-02-10T00:02:22.337459+0000","last_fullsized":"2024-02-10T00:02:22.337459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":436,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.357993+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-10T00:02:17.357993+0000","last_peered":"2024-02-10T00:02:17.357993+0000","last_clean":"2024-02-10T00:02:17.357993+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-10T00:02:17.357993+0000","last_undegraded":"2024-02-10T00:02:17.357993+0000","last_fullsized":"2024-02-10T00:02:17.357993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":947,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350066+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-10T00:02:22.350066+0000","last_peered":"2024-02-10T00:02:22.350066+0000","last_clean":"2024-02-10T00:02:22.350066+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-10T00:02:22.350066+0000","last_undegraded":"2024-02-10T00:02:22.350066+0000","last_fullsized":"2024-02-10T00:02:22.350066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":753,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833340+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-10T00:02:43.833340+0000","last_peered":"2024-02-10T00:02:43.833340+0000","last_clean":"2024-02-10T00:02:43.833340+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-10T00:02:43.833340+0000","last_undegraded":"2024-02-10T00:02:43.833340+0000","last_fullsized":"2024-02-10T00:02:43.833340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":870,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.370051+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-10T00:02:22.370051+0000","last_peered":"2024-02-10T00:02:22.370051+0000","last_clean":"2024-02-10T00:02:22.370051+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-10T00:02:22.370051+0000","last_undegraded":"2024-02-10T00:02:22.370051+0000","last_fullsized":"2024-02-10T00:02:22.370051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.411853+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-10T00:02:21.411853+0000","last_peered":"2024-02-10T00:02:21.411853+0000","last_clean":"2024-02-10T00:02:21.411853+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-10T00:02:21.411853+0000","last_undegraded":"2024-02-10T00:02:21.411853+0000","last_fullsized":"2024-02-10T00:02:21.411853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":907,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.414773+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-10T00:02:21.414773+0000","last_peered":"2024-02-10T00:02:21.414773+0000","last_clean":"2024-02-10T00:02:21.414773+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-10T00:02:21.414773+0000","last_undegraded":"2024-02-10T00:02:21.414773+0000","last_fullsized":"2024-02-10T00:02:21.414773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'1165","reported_seq":1177,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833202+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-10T00:02:43.833202+0000","last_peered":"2024-02-10T00:02:43.833202+0000","last_clean":"2024-02-10T00:02:43.833202+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-10T00:02:43.833202+0000","last_undegraded":"2024-02-10T00:02:43.833202+0000","last_fullsized":"2024-02-10T00:02:43.833202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1002,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.386755+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-10T00:02:21.386755+0000","last_peered":"2024-02-10T00:02:21.386755+0000","last_clean":"2024-02-10T00:02:21.386755+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-10T00:02:21.386755+0000","last_undegraded":"2024-02-10T00:02:21.386755+0000","last_fullsized":"2024-02-10T00:02:21.386755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.822575+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-10T00:02:43.822575+0000","last_peered":"2024-02-10T00:02:43.822575+0000","last_clean":"2024-02-10T00:02:43.822575+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-10T00:02:43.822575+0000","last_undegraded":"2024-02-10T00:02:43.822575+0000","last_fullsized":"2024-02-10T00:02:43.822575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391487+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-10T00:02:21.391487+0000","last_peered":"2024-02-10T00:02:21.391487+0000","last_clean":"2024-02-10T00:02:21.391487+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-10T00:02:21.391487+0000","last_undegraded":"2024-02-10T00:02:21.391487+0000","last_fullsized":"2024-02-10T00:02:21.391487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"20'325","reported_seq":337,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-10T00:04:30.195113+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-10T00:04:30.195113+0000","last_peered":"2024-02-10T00:04:30.195113+0000","last_clean":"2024-02-10T00:04:30.195113+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-10T00:04:30.195113+0000","last_undegraded":"2024-02-10T00:04:30.195113+0000","last_fullsized":"2024-02-10T00:04:30.195113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":224,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.367024+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-10T00:02:22.367024+0000","last_peered":"2024-02-10T00:02:22.367024+0000","last_clean":"2024-02-10T00:02:22.367024+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-10T00:02:22.367024+0000","last_undegraded":"2024-02-10T00:02:22.367024+0000","last_fullsized":"2024-02-10T00:02:22.367024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1840,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.834023+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-10T00:02:43.834023+0000","last_peered":"2024-02-10T00:02:43.834023+0000","last_clean":"2024-02-10T00:02:43.834023+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-10T00:02:43.834023+0000","last_undegraded":"2024-02-10T00:02:43.834023+0000","last_fullsized":"2024-02-10T00:02:43.834023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":887,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.358284+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-10T00:02:22.358284+0000","last_peered":"2024-02-10T00:02:22.358284+0000","last_clean":"2024-02-10T00:02:22.358284+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-10T00:02:22.358284+0000","last_undegraded":"2024-02-10T00:02:22.358284+0000","last_fullsized":"2024-02-10T00:02:22.358284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.406853+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:39.406853+0000","last_peered":"2024-02-09T23:58:39.406853+0000","last_clean":"2024-02-09T23:58:39.406853+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:39.406853+0000","last_undegraded":"2024-02-09T23:58:39.406853+0000","last_fullsized":"2024-02-09T23:58:39.406853+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":234,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.357349+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-10T00:02:17.357349+0000","last_peered":"2024-02-10T00:02:17.357349+0000","last_clean":"2024-02-10T00:02:17.357349+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-10T00:02:17.357349+0000","last_undegraded":"2024-02-10T00:02:17.357349+0000","last_fullsized":"2024-02-10T00:02:17.357349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":833,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.339603+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-10T00:02:22.339603+0000","last_peered":"2024-02-10T00:02:22.339603+0000","last_clean":"2024-02-10T00:02:22.339603+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-10T00:02:22.339603+0000","last_undegraded":"2024-02-10T00:02:22.339603+0000","last_fullsized":"2024-02-10T00:02:22.339603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404530+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:39.404530+0000","last_peered":"2024-02-09T23:58:39.404530+0000","last_clean":"2024-02-09T23:58:39.404530+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:39.404530+0000","last_undegraded":"2024-02-09T23:58:39.404530+0000","last_fullsized":"2024-02-09T23:58:39.404530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'681","reported_seq":693,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.815896+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-10T00:02:43.815896+0000","last_peered":"2024-02-10T00:02:43.815896+0000","last_clean":"2024-02-10T00:02:43.815896+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-10T00:02:43.815896+0000","last_undegraded":"2024-02-10T00:02:43.815896+0000","last_fullsized":"2024-02-10T00:02:43.815896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":991,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.328743+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-10T00:02:17.328743+0000","last_peered":"2024-02-10T00:02:17.328743+0000","last_clean":"2024-02-10T00:02:17.328743+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-10T00:02:17.328743+0000","last_undegraded":"2024-02-10T00:02:17.328743+0000","last_fullsized":"2024-02-10T00:02:17.328743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:40.325375+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:40.325375+0000","last_peered":"2024-02-09T23:58:40.325375+0000","last_clean":"2024-02-09T23:58:40.325375+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:40.325375+0000","last_undegraded":"2024-02-09T23:58:40.325375+0000","last_fullsized":"2024-02-09T23:58:40.325375+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'792","reported_seq":804,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833533+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-10T00:02:43.833533+0000","last_peered":"2024-02-10T00:02:43.833533+0000","last_clean":"2024-02-10T00:02:43.833533+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-10T00:02:43.833533+0000","last_undegraded":"2024-02-10T00:02:43.833533+0000","last_fullsized":"2024-02-10T00:02:43.833533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":791,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.354126+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-10T00:02:22.354126+0000","last_peered":"2024-02-10T00:02:22.354126+0000","last_clean":"2024-02-10T00:02:22.354126+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-10T00:02:22.354126+0000","last_undegraded":"2024-02-10T00:02:22.354126+0000","last_fullsized":"2024-02-10T00:02:22.354126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404567+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:39.404567+0000","last_peered":"2024-02-09T23:58:39.404567+0000","last_clean":"2024-02-09T23:58:39.404567+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:39.404567+0000","last_undegraded":"2024-02-09T23:58:39.404567+0000","last_fullsized":"2024-02-09T23:58:39.404567+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404108+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:39.404108+0000","last_peered":"2024-02-09T23:58:39.404108+0000","last_clean":"2024-02-09T23:58:39.404108+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:39.404108+0000","last_undegraded":"2024-02-09T23:58:39.404108+0000","last_fullsized":"2024-02-09T23:58:39.404108+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1412,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.822472+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-10T00:02:43.822472+0000","last_peered":"2024-02-10T00:02:43.822472+0000","last_clean":"2024-02-10T00:02:43.822472+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-10T00:02:43.822472+0000","last_undegraded":"2024-02-10T00:02:43.822472+0000","last_fullsized":"2024-02-10T00:02:43.822472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391589+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-10T00:02:21.391589+0000","last_peered":"2024-02-10T00:02:21.391589+0000","last_clean":"2024-02-10T00:02:21.391589+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-10T00:02:21.391589+0000","last_undegraded":"2024-02-10T00:02:21.391589+0000","last_fullsized":"2024-02-10T00:02:21.391589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.403488+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:39.403488+0000","last_peered":"2024-02-09T23:58:39.403488+0000","last_clean":"2024-02-09T23:58:39.403488+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:39.403488+0000","last_undegraded":"2024-02-09T23:58:39.403488+0000","last_fullsized":"2024-02-09T23:58:39.403488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'697","reported_seq":994,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833980+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-10T00:02:43.833980+0000","last_peered":"2024-02-10T00:02:43.833980+0000","last_clean":"2024-02-10T00:02:43.833980+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-10T00:02:43.833980+0000","last_undegraded":"2024-02-10T00:02:43.833980+0000","last_fullsized":"2024-02-10T00:02:43.833980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":1714,"num_write":585,"num_write_kb":10068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":906,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.360709+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-10T00:02:22.360709+0000","last_peered":"2024-02-10T00:02:22.360709+0000","last_clean":"2024-02-10T00:02:22.360709+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-10T00:02:22.360709+0000","last_undegraded":"2024-02-10T00:02:22.360709+0000","last_fullsized":"2024-02-10T00:02:22.360709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404810+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:39.404810+0000","last_peered":"2024-02-09T23:58:39.404810+0000","last_clean":"2024-02-09T23:58:39.404810+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:39.404810+0000","last_undegraded":"2024-02-09T23:58:39.404810+0000","last_fullsized":"2024-02-09T23:58:39.404810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'1023","reported_seq":1035,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.838731+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-10T00:02:43.838731+0000","last_peered":"2024-02-10T00:02:43.838731+0000","last_clean":"2024-02-10T00:02:43.838731+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-10T00:02:43.838731+0000","last_undegraded":"2024-02-10T00:02:43.838731+0000","last_fullsized":"2024-02-10T00:02:43.838731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":960,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.354980+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-10T00:02:22.354980+0000","last_peered":"2024-02-10T00:02:22.354980+0000","last_clean":"2024-02-10T00:02:22.354980+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-10T00:02:22.354980+0000","last_undegraded":"2024-02-10T00:02:22.354980+0000","last_fullsized":"2024-02-10T00:02:22.354980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.836137+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-10T00:02:43.836137+0000","last_peered":"2024-02-10T00:02:43.836137+0000","last_clean":"2024-02-10T00:02:43.836137+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-10T00:02:43.836137+0000","last_undegraded":"2024-02-10T00:02:43.836137+0000","last_fullsized":"2024-02-10T00:02:43.836137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.406565+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:39.406565+0000","last_peered":"2024-02-09T23:58:39.406565+0000","last_clean":"2024-02-09T23:58:39.406565+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:39.406565+0000","last_undegraded":"2024-02-09T23:58:39.406565+0000","last_fullsized":"2024-02-09T23:58:39.406565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":962,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.366616+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-10T00:02:22.366616+0000","last_peered":"2024-02-10T00:02:22.366616+0000","last_clean":"2024-02-10T00:02:22.366616+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-10T00:02:22.366616+0000","last_undegraded":"2024-02-10T00:02:22.366616+0000","last_fullsized":"2024-02-10T00:02:22.366616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404410+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:39.404410+0000","last_peered":"2024-02-09T23:58:39.404410+0000","last_clean":"2024-02-09T23:58:39.404410+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:39.404410+0000","last_undegraded":"2024-02-09T23:58:39.404410+0000","last_fullsized":"2024-02-09T23:58:39.404410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'736","reported_seq":748,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.817583+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-10T00:02:43.817583+0000","last_peered":"2024-02-10T00:02:43.817583+0000","last_clean":"2024-02-10T00:02:43.817583+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-10T00:02:43.817583+0000","last_undegraded":"2024-02-10T00:02:43.817583+0000","last_fullsized":"2024-02-10T00:02:43.817583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":875,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.355228+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-10T00:02:22.355228+0000","last_peered":"2024-02-10T00:02:22.355228+0000","last_clean":"2024-02-10T00:02:22.355228+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-10T00:02:22.355228+0000","last_undegraded":"2024-02-10T00:02:22.355228+0000","last_fullsized":"2024-02-10T00:02:22.355228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.826814+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-10T00:02:38.826814+0000","last_peered":"2024-02-10T00:02:38.826814+0000","last_clean":"2024-02-10T00:02:38.826814+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-10T00:02:38.826814+0000","last_undegraded":"2024-02-10T00:02:38.826814+0000","last_fullsized":"2024-02-10T00:02:38.826814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":918,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350461+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-10T00:02:22.350461+0000","last_peered":"2024-02-10T00:02:22.350461+0000","last_clean":"2024-02-10T00:02:22.350461+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-10T00:02:22.350461+0000","last_undegraded":"2024-02-10T00:02:22.350461+0000","last_fullsized":"2024-02-10T00:02:22.350461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.331985+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-10T00:02:22.331985+0000","last_peered":"2024-02-10T00:02:22.331985+0000","last_clean":"2024-02-10T00:02:22.331985+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-10T00:02:22.331985+0000","last_undegraded":"2024-02-10T00:02:22.331985+0000","last_fullsized":"2024-02-10T00:02:22.331985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372683+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-10T00:02:22.372683+0000","last_peered":"2024-02-10T00:02:22.372683+0000","last_clean":"2024-02-10T00:02:22.372683+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-10T00:02:22.372683+0000","last_undegraded":"2024-02-10T00:02:22.372683+0000","last_fullsized":"2024-02-10T00:02:22.372683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'617","reported_seq":629,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.832332+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-10T00:02:43.832332+0000","last_peered":"2024-02-10T00:02:43.832332+0000","last_clean":"2024-02-10T00:02:43.832332+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-10T00:02:43.832332+0000","last_undegraded":"2024-02-10T00:02:43.832332+0000","last_fullsized":"2024-02-10T00:02:43.832332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.378218+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-10T00:02:21.378218+0000","last_peered":"2024-02-10T00:02:21.378218+0000","last_clean":"2024-02-10T00:02:21.378218+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-10T00:02:21.378218+0000","last_undegraded":"2024-02-10T00:02:21.378218+0000","last_fullsized":"2024-02-10T00:02:21.378218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":265,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.811774+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-10T00:02:38.811774+0000","last_peered":"2024-02-10T00:02:38.811774+0000","last_clean":"2024-02-10T00:02:38.811774+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-10T00:02:38.811774+0000","last_undegraded":"2024-02-10T00:02:38.811774+0000","last_fullsized":"2024-02-10T00:02:38.811774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":923,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.355067+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-10T00:02:22.355067+0000","last_peered":"2024-02-10T00:02:22.355067+0000","last_clean":"2024-02-10T00:02:22.355067+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-10T00:02:22.355067+0000","last_undegraded":"2024-02-10T00:02:22.355067+0000","last_fullsized":"2024-02-10T00:02:22.355067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'201","reported_seq":213,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:20.373254+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-10T00:02:20.373254+0000","last_peered":"2024-02-10T00:02:20.373254+0000","last_clean":"2024-02-10T00:02:20.373254+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-10T00:02:20.373254+0000","last_undegraded":"2024-02-10T00:02:20.373254+0000","last_fullsized":"2024-02-10T00:02:20.373254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":961,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364689+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-10T00:02:22.364689+0000","last_peered":"2024-02-10T00:02:22.364689+0000","last_clean":"2024-02-10T00:02:22.364689+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-10T00:02:22.364689+0000","last_undegraded":"2024-02-10T00:02:22.364689+0000","last_fullsized":"2024-02-10T00:02:22.364689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":908,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.361326+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-10T00:02:22.361326+0000","last_peered":"2024-02-10T00:02:22.361326+0000","last_clean":"2024-02-10T00:02:22.361326+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-10T00:02:22.361326+0000","last_undegraded":"2024-02-10T00:02:22.361326+0000","last_fullsized":"2024-02-10T00:02:22.361326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1031,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364409+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-10T00:02:22.364409+0000","last_peered":"2024-02-10T00:02:22.364409+0000","last_clean":"2024-02-10T00:02:22.364409+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-10T00:02:22.364409+0000","last_undegraded":"2024-02-10T00:02:22.364409+0000","last_fullsized":"2024-02-10T00:02:22.364409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":938,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369780+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-10T00:02:22.369780+0000","last_peered":"2024-02-10T00:02:22.369780+0000","last_clean":"2024-02-10T00:02:22.369780+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-10T00:02:22.369780+0000","last_undegraded":"2024-02-10T00:02:22.369780+0000","last_fullsized":"2024-02-10T00:02:22.369780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.381134+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-10T00:02:21.381134+0000","last_peered":"2024-02-10T00:02:21.381134+0000","last_clean":"2024-02-10T00:02:21.381134+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-10T00:02:21.381134+0000","last_undegraded":"2024-02-10T00:02:21.381134+0000","last_fullsized":"2024-02-10T00:02:21.381134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":765,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.403952+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-10T00:02:21.403952+0000","last_peered":"2024-02-10T00:02:21.403952+0000","last_clean":"2024-02-10T00:02:21.403952+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-10T00:02:21.403952+0000","last_undegraded":"2024-02-10T00:02:21.403952+0000","last_fullsized":"2024-02-10T00:02:21.403952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147592590,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":597,"num_read_kb":3242,"num_write":16315,"num_write_kb":272930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295305216,"data_stored":295185180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19882,"ondisk_log_size":19882,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705743,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1146348,"kb_used_data":97764,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93225492,"statfs":{"total":96636764160,"available":95462903808,"internally_reserved":1073741824,"allocated":100110336,"data_stored":99948802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.35899999999999999,"15min":0.33600000000000002},"min":{"1min":0.16600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.52200000000000002,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.221,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.44,"5min":1.944,"15min":1.944},"last":0.373}]},{"osd":1,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.30199999999999999,"15min":0.32000000000000001},"min":{"1min":0.20000000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.499,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.223,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.20999999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54600000000000004,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.191,"5min":0.187,"15min":0.187},"max":{"1min":0.47999999999999998,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.41299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705744,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1109660,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93262180,"statfs":{"total":96636764160,"available":95500472320,"internally_reserved":1073741824,"allocated":62541824,"data_stored":62403300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.17399999999999999,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.31,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.38500000000000001,"15min":0.379},"min":{"1min":0.219,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.35799999999999998,"5min":3.048,"15min":3.048},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.34000000000000002,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.32100000000000001,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.30299999999999999,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.34499999999999997,"15min":0.35599999999999998},"min":{"1min":0.19700000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.32300000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.39500000000000002,"15min":0.38600000000000001},"min":{"1min":0.219,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.372,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.29199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119936,"kb_used_data":71352,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251904,"statfs":{"total":96636764160,"available":95489949696,"internally_reserved":1073741824,"allocated":73064448,"data_stored":72924067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.28799999999999998,"15min":0.31900000000000001},"min":{"1min":0.17100000000000001,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.67300000000000004,"5min":1.665,"15min":1.665},"last":0.245},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.34699999999999998,"15min":0.33100000000000002},"min":{"1min":0.17499999999999999,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.73499999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.70299999999999996,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.318},"min":{"1min":0.184,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71699999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.16500000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.68899999999999995,"5min":2.367,"15min":2.367},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35999999999999999,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.751,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705742,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1107440,"kb_used_data":58856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93264400,"statfs":{"total":96636764160,"available":95502745600,"internally_reserved":1073741824,"allocated":60268544,"data_stored":60140497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.54100000000000004,"15min":0.38300000000000001},"min":{"1min":0.20300000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.39400000000000002,"5min":10.680999999999999,"15min":10.680999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.51300000000000001,"15min":0.38600000000000001},"min":{"1min":0.214,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.38700000000000001,"5min":5.7439999999999998,"15min":5.7439999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.40999999999999998,"15min":0.33600000000000002},"min":{"1min":0.185,"5min":0.159,"15min":0.159},"max":{"1min":0.37,"5min":5.1680000000000001,"15min":5.1680000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.41299999999999998,"15min":0.34300000000000003},"min":{"1min":0.22,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.36399999999999999,"5min":5.0960000000000001,"15min":5.0960000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.39500000000000002,"15min":0.34100000000000003},"min":{"1min":0.19400000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40600000000000003,"5min":3.9249999999999998,"15min":3.9249999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.47799999999999998,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.38600000000000001,"5min":4.524,"15min":4.524},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62369792,"data_stored":62344376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99938304,"data_stored":99889878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:04:33.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:04:33.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.759+0000 7f4955c74700 1 Processor -- start 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.759+0000 7f4955c74700 1 -- start start 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500a5660 0x7f495013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500a62d0 con 0x7f49500a5a70 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4950064220 con 0x7f49500a5660 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f4955c74700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49500a67f0 con 0x7f4950063e50 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500a5660 0x7f495013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48270/0 (socket says 172.21.15.89:48270) 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60606/0 (socket says 172.21.15.89:60606) 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 -- 172.21.15.89:0/4084942735 learned_addr learned my addr 172.21.15.89:0/4084942735 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 -- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500a5660 msgr2=0x7f495013b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 --2- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500a5660 0x7f495013b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 -- 172.21.15.89:0/4084942735 >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 msgr2=0x7f495013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 --2- 172.21.15.89:0/4084942735 >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 -- 172.21.15.89:0/4084942735 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500a7510 con 0x7f4950063e50 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494ffff700 1 --2- 172.21.15.89:0/4084942735 >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.760+0000 7f494f7fe700 1 --2- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49400099b0 tx=0x7f4940009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de05083240a9aa53 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f494e7fc700 1 -- 172.21.15.89:0/4084942735 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000b680 con 0x7f4950063e50 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f494e7fc700 1 -- 172.21.15.89:0/4084942735 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000b7e0 con 0x7f4950063e50 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f494e7fc700 1 -- 172.21.15.89:0/4084942735 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000bb80 con 0x7f4950063e50 2024-02-10T00:04:33.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 -- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 msgr2=0x7f49500a6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 --2- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49400099b0 tx=0x7f4940009250 comp rx=0 tx=0).stop 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 -- 172.21.15.89:0/4084942735 shutdown_connections 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 --2- 172.21.15.89:0/4084942735 >> v2:172.21.15.89:3300/0 conn(0x7f49500a5a70 0x7f495013bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 --2- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4950063e50 0x7f49500a6fd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 --2- 172.21.15.89:0/4084942735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500a5660 0x7f495013b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 -- 172.21.15.89:0/4084942735 >> 172.21.15.89:0/4084942735 conn(0x7f495006c7c0 msgr2=0x7f4950063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 -- 172.21.15.89:0/4084942735 shutdown_connections 2024-02-10T00:04:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.761+0000 7f4955c74700 1 -- 172.21.15.89:0/4084942735 wait complete. 2024-02-10T00:04:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.762+0000 7f4955c74700 1 Processor -- start 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.762+0000 7f4955c74700 1 -- start start 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950063e50 0x7f49500acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 0x7f495014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495014dca0 con 0x7f49500a5660 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500a9a60 con 0x7f4950063e50 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f4955c74700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49500a9c20 con 0x7f49500a5a70 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 0x7f495014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950063e50 0x7f49500acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60616/0 (socket says 172.21.15.89:60616) 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494effd700 1 -- 172.21.15.89:0/2922019518 learned_addr learned my addr 172.21.15.89:0/2922019518 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 -- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950063e50 msgr2=0x7f49500acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950063e50 0x7f49500acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 -- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 msgr2=0x7f495014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 -- 172.21.15.89:0/2922019518 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009a20 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494effd700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f494ffff700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 0x7f495014e480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4948009f10 tx=0x7f494800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.763+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cb70 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.764+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800f040 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.764+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400094f0 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.764+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948014480 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.764+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500ac3b0 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.764+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495004c710 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.765+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f4948003020 con 0x7f49500a5a70 2024-02-10T00:04:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.765+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f494805c800 con 0x7f49500a5a70 2024-02-10T00:04:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.769+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f494803a9e0 con 0x7f49500a5a70 2024-02-10T00:04:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.916+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49500a79c0 con 0x7f493c045fb0 2024-02-10T00:04:33.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.922+0000 7f49377fe700 1 -- 172.21.15.89:0/2922019518 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272605 (unknown 2965378022 0 2168064033) 0x7f49500a79c0 con 0x7f493c045fb0 2024-02-10T00:04:33.929 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 >> v1:172.21.15.89:6816/47970 conn(0x7f493c045fb0 legacy=0x7f493c048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 msgr2=0x7f495014e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 0x7f495014e480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4948009f10 tx=0x7f494800b040 comp rx=0 tx=0).stop 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 shutdown_connections 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f49500a5a70 0x7f495014e480 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950063e50 0x7f49500acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 --2- 172.21.15.89:0/2922019518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500a5660 0x7f495014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 >> 172.21.15.89:0/2922019518 conn(0x7f495006c7c0 msgr2=0x7f4950063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 shutdown_connections 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:33.925+0000 7f4955c74700 1 -- 172.21.15.89:0/2922019518 wait complete. 2024-02-10T00:04:33.932 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:04:33.939 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-02-10T00:04:33.130814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":147592590,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5942,"num_read_kb":2811092,"num_write":65162,"num_write_kb":9043889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71627,"ondisk_log_size":71627,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4483384,"kb_used_data":289048,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373003976,"statfs":{"total":386547056640,"available":381956071424,"internally_reserved":4294967296,"allocated":295985152,"data_stored":295416666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998942"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":892,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.414645+0000","last_change":"2024-02-09T23:58:27.328965+0000","last_active":"2024-02-10T00:02:21.414645+0000","last_peered":"2024-02-10T00:02:21.414645+0000","last_clean":"2024-02-10T00:02:21.414645+0000","last_became_active":"2024-02-09T23:58:27.324755+0000","last_became_peered":"2024-02-09T23:58:27.324755+0000","last_unstale":"2024-02-10T00:02:21.414645+0000","last_undegraded":"2024-02-10T00:02:21.414645+0000","last_fullsized":"2024-02-10T00:02:21.414645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":927,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.380315+0000","last_change":"2024-02-09T23:58:27.354897+0000","last_active":"2024-02-10T00:02:21.380315+0000","last_peered":"2024-02-10T00:02:21.380315+0000","last_clean":"2024-02-10T00:02:21.380315+0000","last_became_active":"2024-02-09T23:58:27.354584+0000","last_became_peered":"2024-02-09T23:58:27.354584+0000","last_unstale":"2024-02-10T00:02:21.380315+0000","last_undegraded":"2024-02-10T00:02:21.380315+0000","last_fullsized":"2024-02-10T00:02:21.380315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":889,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369322+0000","last_change":"2024-02-09T23:58:27.345155+0000","last_active":"2024-02-10T00:02:22.369322+0000","last_peered":"2024-02-10T00:02:22.369322+0000","last_clean":"2024-02-10T00:02:22.369322+0000","last_became_active":"2024-02-09T23:58:27.344257+0000","last_became_peered":"2024-02-09T23:58:27.344257+0000","last_unstale":"2024-02-10T00:02:22.369322+0000","last_undegraded":"2024-02-10T00:02:22.369322+0000","last_fullsized":"2024-02-10T00:02:22.369322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":813,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.359268+0000","last_change":"2024-02-09T23:58:27.341649+0000","last_active":"2024-02-10T00:02:22.359268+0000","last_peered":"2024-02-10T00:02:22.359268+0000","last_clean":"2024-02-10T00:02:22.359268+0000","last_became_active":"2024-02-09T23:58:27.341356+0000","last_became_peered":"2024-02-09T23:58:27.341356+0000","last_unstale":"2024-02-10T00:02:22.359268+0000","last_undegraded":"2024-02-10T00:02:22.359268+0000","last_fullsized":"2024-02-10T00:02:22.359268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":808,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372610+0000","last_change":"2024-02-09T23:58:27.325928+0000","last_active":"2024-02-10T00:02:22.372610+0000","last_peered":"2024-02-10T00:02:22.372610+0000","last_clean":"2024-02-10T00:02:22.372610+0000","last_became_active":"2024-02-09T23:58:27.325626+0000","last_became_peered":"2024-02-09T23:58:27.325626+0000","last_unstale":"2024-02-10T00:02:22.372610+0000","last_undegraded":"2024-02-10T00:02:22.372610+0000","last_fullsized":"2024-02-10T00:02:22.372610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":840,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.365912+0000","last_change":"2024-02-09T23:58:27.336680+0000","last_active":"2024-02-10T00:02:22.365912+0000","last_peered":"2024-02-10T00:02:22.365912+0000","last_clean":"2024-02-10T00:02:22.365912+0000","last_became_active":"2024-02-09T23:58:27.336369+0000","last_became_peered":"2024-02-09T23:58:27.336369+0000","last_unstale":"2024-02-10T00:02:22.365912+0000","last_undegraded":"2024-02-10T00:02:22.365912+0000","last_fullsized":"2024-02-10T00:02:22.365912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.337608+0000","last_change":"2024-02-09T23:58:27.332201+0000","last_active":"2024-02-10T00:02:22.337608+0000","last_peered":"2024-02-10T00:02:22.337608+0000","last_clean":"2024-02-10T00:02:22.337608+0000","last_became_active":"2024-02-09T23:58:27.329390+0000","last_became_peered":"2024-02-09T23:58:27.329390+0000","last_unstale":"2024-02-10T00:02:22.337608+0000","last_undegraded":"2024-02-10T00:02:22.337608+0000","last_fullsized":"2024-02-10T00:02:22.337608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":774,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364278+0000","last_change":"2024-02-09T23:58:27.352692+0000","last_active":"2024-02-10T00:02:22.364278+0000","last_peered":"2024-02-10T00:02:22.364278+0000","last_clean":"2024-02-10T00:02:22.364278+0000","last_became_active":"2024-02-09T23:58:27.349823+0000","last_became_peered":"2024-02-09T23:58:27.349823+0000","last_unstale":"2024-02-10T00:02:22.364278+0000","last_undegraded":"2024-02-10T00:02:22.364278+0000","last_fullsized":"2024-02-10T00:02:22.364278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":902,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.356794+0000","last_change":"2024-02-09T23:58:27.325219+0000","last_active":"2024-02-10T00:02:22.356794+0000","last_peered":"2024-02-10T00:02:22.356794+0000","last_clean":"2024-02-10T00:02:22.356794+0000","last_became_active":"2024-02-09T23:58:27.324804+0000","last_became_peered":"2024-02-09T23:58:27.324804+0000","last_unstale":"2024-02-10T00:02:22.356794+0000","last_undegraded":"2024-02-10T00:02:22.356794+0000","last_fullsized":"2024-02-10T00:02:22.356794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":876,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.347824+0000","last_change":"2024-02-09T23:58:27.347929+0000","last_active":"2024-02-10T00:02:22.347824+0000","last_peered":"2024-02-10T00:02:22.347824+0000","last_clean":"2024-02-10T00:02:22.347824+0000","last_became_active":"2024-02-09T23:58:27.347529+0000","last_became_peered":"2024-02-09T23:58:27.347529+0000","last_unstale":"2024-02-10T00:02:22.347824+0000","last_undegraded":"2024-02-10T00:02:22.347824+0000","last_fullsized":"2024-02-10T00:02:22.347824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":821,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391360+0000","last_change":"2024-02-09T23:58:27.347930+0000","last_active":"2024-02-10T00:02:21.391360+0000","last_peered":"2024-02-10T00:02:21.391360+0000","last_clean":"2024-02-10T00:02:21.391360+0000","last_became_active":"2024-02-09T23:58:27.347644+0000","last_became_peered":"2024-02-09T23:58:27.347644+0000","last_unstale":"2024-02-10T00:02:21.391360+0000","last_undegraded":"2024-02-10T00:02:21.391360+0000","last_fullsized":"2024-02-10T00:02:21.391360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.366948+0000","last_change":"2024-02-09T23:58:27.335721+0000","last_active":"2024-02-10T00:02:22.366948+0000","last_peered":"2024-02-10T00:02:22.366948+0000","last_clean":"2024-02-10T00:02:22.366948+0000","last_became_active":"2024-02-09T23:58:27.335110+0000","last_became_peered":"2024-02-09T23:58:27.335110+0000","last_unstale":"2024-02-10T00:02:22.366948+0000","last_undegraded":"2024-02-10T00:02:22.366948+0000","last_fullsized":"2024-02-10T00:02:22.366948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":937,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372642+0000","last_change":"2024-02-09T23:58:27.326464+0000","last_active":"2024-02-10T00:02:22.372642+0000","last_peered":"2024-02-10T00:02:22.372642+0000","last_clean":"2024-02-10T00:02:22.372642+0000","last_became_active":"2024-02-09T23:58:27.325806+0000","last_became_peered":"2024-02-09T23:58:27.325806+0000","last_unstale":"2024-02-10T00:02:22.372642+0000","last_undegraded":"2024-02-10T00:02:22.372642+0000","last_fullsized":"2024-02-10T00:02:22.372642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":912,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.367103+0000","last_change":"2024-02-09T23:58:27.350195+0000","last_active":"2024-02-10T00:02:22.367103+0000","last_peered":"2024-02-10T00:02:22.367103+0000","last_clean":"2024-02-10T00:02:22.367103+0000","last_became_active":"2024-02-09T23:58:27.348915+0000","last_became_peered":"2024-02-09T23:58:27.348915+0000","last_unstale":"2024-02-10T00:02:22.367103+0000","last_undegraded":"2024-02-10T00:02:22.367103+0000","last_fullsized":"2024-02-10T00:02:22.367103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":965,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.343258+0000","last_change":"2024-02-09T23:58:27.341536+0000","last_active":"2024-02-10T00:02:22.343258+0000","last_peered":"2024-02-10T00:02:22.343258+0000","last_clean":"2024-02-10T00:02:22.343258+0000","last_became_active":"2024-02-09T23:58:27.341228+0000","last_became_peered":"2024-02-09T23:58:27.341228+0000","last_unstale":"2024-02-10T00:02:22.343258+0000","last_undegraded":"2024-02-10T00:02:22.343258+0000","last_fullsized":"2024-02-10T00:02:22.343258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.418567+0000","last_change":"2024-02-09T23:58:27.328186+0000","last_active":"2024-02-10T00:02:21.418567+0000","last_peered":"2024-02-10T00:02:21.418567+0000","last_clean":"2024-02-10T00:02:21.418567+0000","last_became_active":"2024-02-09T23:58:27.327882+0000","last_became_peered":"2024-02-09T23:58:27.327882+0000","last_unstale":"2024-02-10T00:02:21.418567+0000","last_undegraded":"2024-02-10T00:02:21.418567+0000","last_fullsized":"2024-02-10T00:02:21.418567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":957,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.346719+0000","last_change":"2024-02-09T23:58:27.327004+0000","last_active":"2024-02-10T00:02:22.346719+0000","last_peered":"2024-02-10T00:02:22.346719+0000","last_clean":"2024-02-10T00:02:22.346719+0000","last_became_active":"2024-02-09T23:58:27.326697+0000","last_became_peered":"2024-02-09T23:58:27.326697+0000","last_unstale":"2024-02-10T00:02:22.346719+0000","last_undegraded":"2024-02-10T00:02:22.346719+0000","last_fullsized":"2024-02-10T00:02:22.346719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":758,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.411128+0000","last_change":"2024-02-09T23:58:27.327299+0000","last_active":"2024-02-10T00:02:21.411128+0000","last_peered":"2024-02-10T00:02:21.411128+0000","last_clean":"2024-02-10T00:02:21.411128+0000","last_became_active":"2024-02-09T23:58:27.326968+0000","last_became_peered":"2024-02-09T23:58:27.326968+0000","last_unstale":"2024-02-10T00:02:21.411128+0000","last_undegraded":"2024-02-10T00:02:21.411128+0000","last_fullsized":"2024-02-10T00:02:21.411128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":986,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.392376+0000","last_change":"2024-02-09T23:58:27.335484+0000","last_active":"2024-02-10T00:02:21.392376+0000","last_peered":"2024-02-10T00:02:21.392376+0000","last_clean":"2024-02-10T00:02:21.392376+0000","last_became_active":"2024-02-09T23:58:27.335169+0000","last_became_peered":"2024-02-09T23:58:27.335169+0000","last_unstale":"2024-02-10T00:02:21.392376+0000","last_undegraded":"2024-02-10T00:02:21.392376+0000","last_fullsized":"2024-02-10T00:02:21.392376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":862,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.338093+0000","last_change":"2024-02-09T23:58:27.341796+0000","last_active":"2024-02-10T00:02:22.338093+0000","last_peered":"2024-02-10T00:02:22.338093+0000","last_clean":"2024-02-10T00:02:22.338093+0000","last_became_active":"2024-02-09T23:58:27.341487+0000","last_became_peered":"2024-02-09T23:58:27.341487+0000","last_unstale":"2024-02-10T00:02:22.338093+0000","last_undegraded":"2024-02-10T00:02:22.338093+0000","last_fullsized":"2024-02-10T00:02:22.338093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":927,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.349808+0000","last_change":"2024-02-09T23:58:27.341174+0000","last_active":"2024-02-10T00:02:22.349808+0000","last_peered":"2024-02-10T00:02:22.349808+0000","last_clean":"2024-02-10T00:02:22.349808+0000","last_became_active":"2024-02-09T23:58:27.340820+0000","last_became_peered":"2024-02-09T23:58:27.340820+0000","last_unstale":"2024-02-10T00:02:22.349808+0000","last_undegraded":"2024-02-10T00:02:22.349808+0000","last_fullsized":"2024-02-10T00:02:22.349808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":943,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369434+0000","last_change":"2024-02-09T23:58:27.348340+0000","last_active":"2024-02-10T00:02:22.369434+0000","last_peered":"2024-02-10T00:02:22.369434+0000","last_clean":"2024-02-10T00:02:22.369434+0000","last_became_active":"2024-02-09T23:58:27.348024+0000","last_became_peered":"2024-02-09T23:58:27.348024+0000","last_unstale":"2024-02-10T00:02:22.369434+0000","last_undegraded":"2024-02-10T00:02:22.369434+0000","last_fullsized":"2024-02-10T00:02:22.369434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":929,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369890+0000","last_change":"2024-02-09T23:58:27.330768+0000","last_active":"2024-02-10T00:02:22.369890+0000","last_peered":"2024-02-10T00:02:22.369890+0000","last_clean":"2024-02-10T00:02:22.369890+0000","last_became_active":"2024-02-09T23:58:27.328741+0000","last_became_peered":"2024-02-09T23:58:27.328741+0000","last_unstale":"2024-02-10T00:02:22.369890+0000","last_undegraded":"2024-02-10T00:02:22.369890+0000","last_fullsized":"2024-02-10T00:02:22.369890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":931,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.340544+0000","last_change":"2024-02-09T23:58:27.352309+0000","last_active":"2024-02-10T00:02:22.340544+0000","last_peered":"2024-02-10T00:02:22.340544+0000","last_clean":"2024-02-10T00:02:22.340544+0000","last_became_active":"2024-02-09T23:58:27.347551+0000","last_became_peered":"2024-02-09T23:58:27.347551+0000","last_unstale":"2024-02-10T00:02:22.340544+0000","last_undegraded":"2024-02-10T00:02:22.340544+0000","last_fullsized":"2024-02-10T00:02:22.340544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":951,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.370575+0000","last_change":"2024-02-09T23:58:27.346106+0000","last_active":"2024-02-10T00:02:22.370575+0000","last_peered":"2024-02-10T00:02:22.370575+0000","last_clean":"2024-02-10T00:02:22.370575+0000","last_became_active":"2024-02-09T23:58:27.345553+0000","last_became_peered":"2024-02-09T23:58:27.345553+0000","last_unstale":"2024-02-10T00:02:22.370575+0000","last_undegraded":"2024-02-10T00:02:22.370575+0000","last_fullsized":"2024-02-10T00:02:22.370575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":915,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364176+0000","last_change":"2024-02-09T23:58:27.350703+0000","last_active":"2024-02-10T00:02:22.364176+0000","last_peered":"2024-02-10T00:02:22.364176+0000","last_clean":"2024-02-10T00:02:22.364176+0000","last_became_active":"2024-02-09T23:58:27.348858+0000","last_became_peered":"2024-02-09T23:58:27.348858+0000","last_unstale":"2024-02-10T00:02:22.364176+0000","last_undegraded":"2024-02-10T00:02:22.364176+0000","last_fullsized":"2024-02-10T00:02:22.364176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372567+0000","last_change":"2024-02-09T23:58:27.333892+0000","last_active":"2024-02-10T00:02:22.372567+0000","last_peered":"2024-02-10T00:02:22.372567+0000","last_clean":"2024-02-10T00:02:22.372567+0000","last_became_active":"2024-02-09T23:58:27.329356+0000","last_became_peered":"2024-02-09T23:58:27.329356+0000","last_unstale":"2024-02-10T00:02:22.372567+0000","last_undegraded":"2024-02-10T00:02:22.372567+0000","last_fullsized":"2024-02-10T00:02:22.372567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1479,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.821086+0000","last_change":"2024-02-09T23:58:27.023363+0000","last_active":"2024-02-10T00:02:43.821086+0000","last_peered":"2024-02-10T00:02:43.821086+0000","last_clean":"2024-02-10T00:02:43.821086+0000","last_became_active":"2024-02-09T23:58:27.023076+0000","last_became_peered":"2024-02-09T23:58:27.023076+0000","last_unstale":"2024-02-10T00:02:43.821086+0000","last_undegraded":"2024-02-10T00:02:43.821086+0000","last_fullsized":"2024-02-10T00:02:43.821086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":844,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.344684+0000","last_change":"2024-02-09T23:58:27.352211+0000","last_active":"2024-02-10T00:02:22.344684+0000","last_peered":"2024-02-10T00:02:22.344684+0000","last_clean":"2024-02-10T00:02:22.344684+0000","last_became_active":"2024-02-09T23:58:27.351034+0000","last_became_peered":"2024-02-09T23:58:27.351034+0000","last_unstale":"2024-02-10T00:02:22.344684+0000","last_undegraded":"2024-02-10T00:02:22.344684+0000","last_fullsized":"2024-02-10T00:02:22.344684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":865,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.829032+0000","last_change":"2024-02-09T23:58:27.031638+0000","last_active":"2024-02-10T00:02:43.829032+0000","last_peered":"2024-02-10T00:02:43.829032+0000","last_clean":"2024-02-10T00:02:43.829032+0000","last_became_active":"2024-02-09T23:58:27.031287+0000","last_became_peered":"2024-02-09T23:58:27.031287+0000","last_unstale":"2024-02-10T00:02:43.829032+0000","last_undegraded":"2024-02-10T00:02:43.829032+0000","last_fullsized":"2024-02-10T00:02:43.829032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":300,"num_read_kb":1528,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":875,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.345472+0000","last_change":"2024-02-09T23:58:27.354499+0000","last_active":"2024-02-10T00:02:21.345472+0000","last_peered":"2024-02-10T00:02:21.345472+0000","last_clean":"2024-02-10T00:02:21.345472+0000","last_became_active":"2024-02-09T23:58:27.353817+0000","last_became_peered":"2024-02-09T23:58:27.353817+0000","last_unstale":"2024-02-10T00:02:21.345472+0000","last_undegraded":"2024-02-10T00:02:21.345472+0000","last_fullsized":"2024-02-10T00:02:21.345472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1126,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.825105+0000","last_change":"2024-02-09T23:58:27.036116+0000","last_active":"2024-02-10T00:02:38.825105+0000","last_peered":"2024-02-10T00:02:38.825105+0000","last_clean":"2024-02-10T00:02:38.825105+0000","last_became_active":"2024-02-09T23:58:27.034969+0000","last_became_peered":"2024-02-09T23:58:27.034969+0000","last_unstale":"2024-02-10T00:02:38.825105+0000","last_undegraded":"2024-02-10T00:02:38.825105+0000","last_fullsized":"2024-02-10T00:02:38.825105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":879,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.398351+0000","last_change":"2024-02-09T23:58:27.352436+0000","last_active":"2024-02-10T00:02:21.398351+0000","last_peered":"2024-02-10T00:02:21.398351+0000","last_clean":"2024-02-10T00:02:21.398351+0000","last_became_active":"2024-02-09T23:58:27.351995+0000","last_became_peered":"2024-02-09T23:58:27.351995+0000","last_unstale":"2024-02-10T00:02:21.398351+0000","last_undegraded":"2024-02-10T00:02:21.398351+0000","last_fullsized":"2024-02-10T00:02:21.398351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'142","reported_seq":154,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:48.809274+0000","last_change":"2024-02-09T23:58:27.032955+0000","last_active":"2024-02-10T00:02:48.809274+0000","last_peered":"2024-02-10T00:02:48.809274+0000","last_clean":"2024-02-10T00:02:48.809274+0000","last_became_active":"2024-02-09T23:58:27.032417+0000","last_became_peered":"2024-02-09T23:58:27.032417+0000","last_unstale":"2024-02-10T00:02:48.809274+0000","last_undegraded":"2024-02-10T00:02:48.809274+0000","last_fullsized":"2024-02-10T00:02:48.809274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":913,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364375+0000","last_change":"2024-02-09T23:58:27.354221+0000","last_active":"2024-02-10T00:02:22.364375+0000","last_peered":"2024-02-10T00:02:22.364375+0000","last_clean":"2024-02-10T00:02:22.364375+0000","last_became_active":"2024-02-09T23:58:27.353376+0000","last_became_peered":"2024-02-09T23:58:27.353376+0000","last_unstale":"2024-02-10T00:02:22.364375+0000","last_undegraded":"2024-02-10T00:02:22.364375+0000","last_fullsized":"2024-02-10T00:02:22.364375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1008,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.838974+0000","last_change":"2024-02-09T23:58:27.028619+0000","last_active":"2024-02-10T00:02:43.838974+0000","last_peered":"2024-02-10T00:02:43.838974+0000","last_clean":"2024-02-10T00:02:43.838974+0000","last_became_active":"2024-02-09T23:58:27.028243+0000","last_became_peered":"2024-02-09T23:58:27.028243+0000","last_unstale":"2024-02-10T00:02:43.838974+0000","last_undegraded":"2024-02-10T00:02:43.838974+0000","last_fullsized":"2024-02-10T00:02:43.838974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1030,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350531+0000","last_change":"2024-02-09T23:58:27.335029+0000","last_active":"2024-02-10T00:02:22.350531+0000","last_peered":"2024-02-10T00:02:22.350531+0000","last_clean":"2024-02-10T00:02:22.350531+0000","last_became_active":"2024-02-09T23:58:27.334698+0000","last_became_peered":"2024-02-09T23:58:27.334698+0000","last_unstale":"2024-02-10T00:02:22.350531+0000","last_undegraded":"2024-02-10T00:02:22.350531+0000","last_fullsized":"2024-02-10T00:02:22.350531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'395","reported_seq":407,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.810840+0000","last_change":"2024-02-09T23:58:27.030307+0000","last_active":"2024-02-10T00:02:43.810840+0000","last_peered":"2024-02-10T00:02:43.810840+0000","last_clean":"2024-02-10T00:02:43.810840+0000","last_became_active":"2024-02-09T23:58:27.030008+0000","last_became_peered":"2024-02-09T23:58:27.030008+0000","last_unstale":"2024-02-10T00:02:43.810840+0000","last_undegraded":"2024-02-10T00:02:43.810840+0000","last_fullsized":"2024-02-10T00:02:43.810840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":996,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.344098+0000","last_change":"2024-02-09T23:58:27.347143+0000","last_active":"2024-02-10T00:02:22.344098+0000","last_peered":"2024-02-10T00:02:22.344098+0000","last_clean":"2024-02-10T00:02:22.344098+0000","last_became_active":"2024-02-09T23:58:27.346804+0000","last_became_peered":"2024-02-09T23:58:27.346804+0000","last_unstale":"2024-02-10T00:02:22.344098+0000","last_undegraded":"2024-02-10T00:02:22.344098+0000","last_fullsized":"2024-02-10T00:02:22.344098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'657","reported_seq":669,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-10T00:04:30.129068+0000","last_change":"2024-02-09T23:58:27.039829+0000","last_active":"2024-02-10T00:04:30.129068+0000","last_peered":"2024-02-10T00:04:30.129068+0000","last_clean":"2024-02-10T00:04:30.129068+0000","last_became_active":"2024-02-09T23:58:27.039501+0000","last_became_peered":"2024-02-09T23:58:27.039501+0000","last_unstale":"2024-02-10T00:04:30.129068+0000","last_undegraded":"2024-02-10T00:04:30.129068+0000","last_fullsized":"2024-02-10T00:04:30.129068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":560,"num_write_kb":12586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":968,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372536+0000","last_change":"2024-02-09T23:58:27.326111+0000","last_active":"2024-02-10T00:02:22.372536+0000","last_peered":"2024-02-10T00:02:22.372536+0000","last_clean":"2024-02-10T00:02:22.372536+0000","last_became_active":"2024-02-09T23:58:27.324903+0000","last_became_peered":"2024-02-09T23:58:27.324903+0000","last_unstale":"2024-02-10T00:02:22.372536+0000","last_undegraded":"2024-02-10T00:02:22.372536+0000","last_fullsized":"2024-02-10T00:02:22.372536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":399,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.816585+0000","last_change":"2024-02-09T23:58:27.035814+0000","last_active":"2024-02-10T00:02:38.816585+0000","last_peered":"2024-02-10T00:02:38.816585+0000","last_clean":"2024-02-10T00:02:38.816585+0000","last_became_active":"2024-02-09T23:58:27.035367+0000","last_became_peered":"2024-02-09T23:58:27.035367+0000","last_unstale":"2024-02-10T00:02:38.816585+0000","last_undegraded":"2024-02-10T00:02:38.816585+0000","last_fullsized":"2024-02-10T00:02:38.816585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1066,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350819+0000","last_change":"2024-02-09T23:58:27.351524+0000","last_active":"2024-02-10T00:02:22.350819+0000","last_peered":"2024-02-10T00:02:22.350819+0000","last_clean":"2024-02-10T00:02:22.350819+0000","last_became_active":"2024-02-09T23:58:27.351223+0000","last_became_peered":"2024-02-09T23:58:27.351223+0000","last_unstale":"2024-02-10T00:02:22.350819+0000","last_undegraded":"2024-02-10T00:02:22.350819+0000","last_fullsized":"2024-02-10T00:02:22.350819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.826761+0000","last_change":"2024-02-09T23:58:27.024702+0000","last_active":"2024-02-10T00:02:38.826761+0000","last_peered":"2024-02-10T00:02:38.826761+0000","last_clean":"2024-02-10T00:02:38.826761+0000","last_became_active":"2024-02-09T23:58:27.024354+0000","last_became_peered":"2024-02-09T23:58:27.024354+0000","last_unstale":"2024-02-10T00:02:38.826761+0000","last_undegraded":"2024-02-10T00:02:38.826761+0000","last_fullsized":"2024-02-10T00:02:38.826761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":928,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.362005+0000","last_change":"2024-02-09T23:58:27.333816+0000","last_active":"2024-02-10T00:02:22.362005+0000","last_peered":"2024-02-10T00:02:22.362005+0000","last_clean":"2024-02-10T00:02:22.362005+0000","last_became_active":"2024-02-09T23:58:27.333505+0000","last_became_peered":"2024-02-09T23:58:27.333505+0000","last_unstale":"2024-02-10T00:02:22.362005+0000","last_undegraded":"2024-02-10T00:02:22.362005+0000","last_fullsized":"2024-02-10T00:02:22.362005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'478","reported_seq":490,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.818996+0000","last_change":"2024-02-09T23:58:27.039982+0000","last_active":"2024-02-10T00:02:43.818996+0000","last_peered":"2024-02-10T00:02:43.818996+0000","last_clean":"2024-02-10T00:02:43.818996+0000","last_became_active":"2024-02-09T23:58:27.039621+0000","last_became_peered":"2024-02-09T23:58:27.039621+0000","last_unstale":"2024-02-10T00:02:43.818996+0000","last_undegraded":"2024-02-10T00:02:43.818996+0000","last_fullsized":"2024-02-10T00:02:43.818996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":912,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.386774+0000","last_change":"2024-02-09T23:58:27.326907+0000","last_active":"2024-02-10T00:02:21.386774+0000","last_peered":"2024-02-10T00:02:21.386774+0000","last_clean":"2024-02-10T00:02:21.386774+0000","last_became_active":"2024-02-09T23:58:27.326517+0000","last_became_peered":"2024-02-09T23:58:27.326517+0000","last_unstale":"2024-02-10T00:02:21.386774+0000","last_undegraded":"2024-02-10T00:02:21.386774+0000","last_fullsized":"2024-02-10T00:02:21.386774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":506,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.817098+0000","last_change":"2024-02-09T23:58:27.033228+0000","last_active":"2024-02-10T00:02:38.817098+0000","last_peered":"2024-02-10T00:02:38.817098+0000","last_clean":"2024-02-10T00:02:38.817098+0000","last_became_active":"2024-02-09T23:58:27.032912+0000","last_became_peered":"2024-02-09T23:58:27.032912+0000","last_unstale":"2024-02-10T00:02:38.817098+0000","last_undegraded":"2024-02-10T00:02:38.817098+0000","last_fullsized":"2024-02-10T00:02:38.817098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":827,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.346453+0000","last_change":"2024-02-09T23:58:27.352241+0000","last_active":"2024-02-10T00:02:22.346453+0000","last_peered":"2024-02-10T00:02:22.346453+0000","last_clean":"2024-02-10T00:02:22.346453+0000","last_became_active":"2024-02-09T23:58:27.351676+0000","last_became_peered":"2024-02-09T23:58:27.351676+0000","last_unstale":"2024-02-10T00:02:22.346453+0000","last_undegraded":"2024-02-10T00:02:22.346453+0000","last_fullsized":"2024-02-10T00:02:22.346453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:16.355781+0000","last_change":"2024-02-09T23:58:27.028040+0000","last_active":"2024-02-10T00:02:16.355781+0000","last_peered":"2024-02-10T00:02:16.355781+0000","last_clean":"2024-02-10T00:02:16.355781+0000","last_became_active":"2024-02-09T23:58:27.027739+0000","last_became_peered":"2024-02-09T23:58:27.027739+0000","last_unstale":"2024-02-10T00:02:16.355781+0000","last_undegraded":"2024-02-10T00:02:16.355781+0000","last_fullsized":"2024-02-10T00:02:16.355781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1052,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.337459+0000","last_change":"2024-02-09T23:58:27.354253+0000","last_active":"2024-02-10T00:02:22.337459+0000","last_peered":"2024-02-10T00:02:22.337459+0000","last_clean":"2024-02-10T00:02:22.337459+0000","last_became_active":"2024-02-09T23:58:27.353835+0000","last_became_peered":"2024-02-09T23:58:27.353835+0000","last_unstale":"2024-02-10T00:02:22.337459+0000","last_undegraded":"2024-02-10T00:02:22.337459+0000","last_fullsized":"2024-02-10T00:02:22.337459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":436,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.357993+0000","last_change":"2024-02-09T23:58:27.034309+0000","last_active":"2024-02-10T00:02:17.357993+0000","last_peered":"2024-02-10T00:02:17.357993+0000","last_clean":"2024-02-10T00:02:17.357993+0000","last_became_active":"2024-02-09T23:58:27.034000+0000","last_became_peered":"2024-02-09T23:58:27.034000+0000","last_unstale":"2024-02-10T00:02:17.357993+0000","last_undegraded":"2024-02-10T00:02:17.357993+0000","last_fullsized":"2024-02-10T00:02:17.357993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":947,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350066+0000","last_change":"2024-02-09T23:58:27.338581+0000","last_active":"2024-02-10T00:02:22.350066+0000","last_peered":"2024-02-10T00:02:22.350066+0000","last_clean":"2024-02-10T00:02:22.350066+0000","last_became_active":"2024-02-09T23:58:27.338267+0000","last_became_peered":"2024-02-09T23:58:27.338267+0000","last_unstale":"2024-02-10T00:02:22.350066+0000","last_undegraded":"2024-02-10T00:02:22.350066+0000","last_fullsized":"2024-02-10T00:02:22.350066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":753,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833340+0000","last_change":"2024-02-09T23:58:27.036128+0000","last_active":"2024-02-10T00:02:43.833340+0000","last_peered":"2024-02-10T00:02:43.833340+0000","last_clean":"2024-02-10T00:02:43.833340+0000","last_became_active":"2024-02-09T23:58:27.035739+0000","last_became_peered":"2024-02-09T23:58:27.035739+0000","last_unstale":"2024-02-10T00:02:43.833340+0000","last_undegraded":"2024-02-10T00:02:43.833340+0000","last_fullsized":"2024-02-10T00:02:43.833340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":870,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.370051+0000","last_change":"2024-02-09T23:58:27.331152+0000","last_active":"2024-02-10T00:02:22.370051+0000","last_peered":"2024-02-10T00:02:22.370051+0000","last_clean":"2024-02-10T00:02:22.370051+0000","last_became_active":"2024-02-09T23:58:27.330462+0000","last_became_peered":"2024-02-09T23:58:27.330462+0000","last_unstale":"2024-02-10T00:02:22.370051+0000","last_undegraded":"2024-02-10T00:02:22.370051+0000","last_fullsized":"2024-02-10T00:02:22.370051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.411853+0000","last_change":"2024-02-09T23:58:27.028000+0000","last_active":"2024-02-10T00:02:21.411853+0000","last_peered":"2024-02-10T00:02:21.411853+0000","last_clean":"2024-02-10T00:02:21.411853+0000","last_became_active":"2024-02-09T23:58:27.027681+0000","last_became_peered":"2024-02-09T23:58:27.027681+0000","last_unstale":"2024-02-10T00:02:21.411853+0000","last_undegraded":"2024-02-10T00:02:21.411853+0000","last_fullsized":"2024-02-10T00:02:21.411853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":907,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.414773+0000","last_change":"2024-02-09T23:58:27.342710+0000","last_active":"2024-02-10T00:02:21.414773+0000","last_peered":"2024-02-10T00:02:21.414773+0000","last_clean":"2024-02-10T00:02:21.414773+0000","last_became_active":"2024-02-09T23:58:27.341626+0000","last_became_peered":"2024-02-09T23:58:27.341626+0000","last_unstale":"2024-02-10T00:02:21.414773+0000","last_undegraded":"2024-02-10T00:02:21.414773+0000","last_fullsized":"2024-02-10T00:02:21.414773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'1165","reported_seq":1177,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833202+0000","last_change":"2024-02-09T23:58:27.036315+0000","last_active":"2024-02-10T00:02:43.833202+0000","last_peered":"2024-02-10T00:02:43.833202+0000","last_clean":"2024-02-10T00:02:43.833202+0000","last_became_active":"2024-02-09T23:58:27.035600+0000","last_became_peered":"2024-02-09T23:58:27.035600+0000","last_unstale":"2024-02-10T00:02:43.833202+0000","last_undegraded":"2024-02-10T00:02:43.833202+0000","last_fullsized":"2024-02-10T00:02:43.833202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1002,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.386755+0000","last_change":"2024-02-09T23:58:27.320908+0000","last_active":"2024-02-10T00:02:21.386755+0000","last_peered":"2024-02-10T00:02:21.386755+0000","last_clean":"2024-02-10T00:02:21.386755+0000","last_became_active":"2024-02-09T23:58:27.320585+0000","last_became_peered":"2024-02-09T23:58:27.320585+0000","last_unstale":"2024-02-10T00:02:21.386755+0000","last_undegraded":"2024-02-10T00:02:21.386755+0000","last_fullsized":"2024-02-10T00:02:21.386755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.822575+0000","last_change":"2024-02-09T23:58:27.036356+0000","last_active":"2024-02-10T00:02:43.822575+0000","last_peered":"2024-02-10T00:02:43.822575+0000","last_clean":"2024-02-10T00:02:43.822575+0000","last_became_active":"2024-02-09T23:58:27.036033+0000","last_became_peered":"2024-02-09T23:58:27.036033+0000","last_unstale":"2024-02-10T00:02:43.822575+0000","last_undegraded":"2024-02-10T00:02:43.822575+0000","last_fullsized":"2024-02-10T00:02:43.822575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391487+0000","last_change":"2024-02-09T23:58:27.352397+0000","last_active":"2024-02-10T00:02:21.391487+0000","last_peered":"2024-02-10T00:02:21.391487+0000","last_clean":"2024-02-10T00:02:21.391487+0000","last_became_active":"2024-02-09T23:58:27.351476+0000","last_became_peered":"2024-02-09T23:58:27.351476+0000","last_unstale":"2024-02-10T00:02:21.391487+0000","last_undegraded":"2024-02-10T00:02:21.391487+0000","last_fullsized":"2024-02-10T00:02:21.391487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"20'325","reported_seq":337,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-10T00:04:30.195113+0000","last_change":"2024-02-09T23:58:27.039995+0000","last_active":"2024-02-10T00:04:30.195113+0000","last_peered":"2024-02-10T00:04:30.195113+0000","last_clean":"2024-02-10T00:04:30.195113+0000","last_became_active":"2024-02-09T23:58:27.039656+0000","last_became_peered":"2024-02-09T23:58:27.039656+0000","last_unstale":"2024-02-10T00:04:30.195113+0000","last_undegraded":"2024-02-10T00:04:30.195113+0000","last_fullsized":"2024-02-10T00:04:30.195113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":224,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.367024+0000","last_change":"2024-02-09T23:58:27.325573+0000","last_active":"2024-02-10T00:02:22.367024+0000","last_peered":"2024-02-10T00:02:22.367024+0000","last_clean":"2024-02-10T00:02:22.367024+0000","last_became_active":"2024-02-09T23:58:27.325296+0000","last_became_peered":"2024-02-09T23:58:27.325296+0000","last_unstale":"2024-02-10T00:02:22.367024+0000","last_undegraded":"2024-02-10T00:02:22.367024+0000","last_fullsized":"2024-02-10T00:02:22.367024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1840,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.834023+0000","last_change":"2024-02-09T23:58:27.041485+0000","last_active":"2024-02-10T00:02:43.834023+0000","last_peered":"2024-02-10T00:02:43.834023+0000","last_clean":"2024-02-10T00:02:43.834023+0000","last_became_active":"2024-02-09T23:58:27.041126+0000","last_became_peered":"2024-02-09T23:58:27.041126+0000","last_unstale":"2024-02-10T00:02:43.834023+0000","last_undegraded":"2024-02-10T00:02:43.834023+0000","last_fullsized":"2024-02-10T00:02:43.834023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":887,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.358284+0000","last_change":"2024-02-09T23:58:27.346222+0000","last_active":"2024-02-10T00:02:22.358284+0000","last_peered":"2024-02-10T00:02:22.358284+0000","last_clean":"2024-02-10T00:02:22.358284+0000","last_became_active":"2024-02-09T23:58:27.345863+0000","last_became_peered":"2024-02-09T23:58:27.345863+0000","last_unstale":"2024-02-10T00:02:22.358284+0000","last_undegraded":"2024-02-10T00:02:22.358284+0000","last_fullsized":"2024-02-10T00:02:22.358284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.406853+0000","last_change":"2024-02-09T23:58:18.654929+0000","last_active":"2024-02-09T23:58:39.406853+0000","last_peered":"2024-02-09T23:58:39.406853+0000","last_clean":"2024-02-09T23:58:39.406853+0000","last_became_active":"2024-02-09T23:58:18.654545+0000","last_became_peered":"2024-02-09T23:58:18.654545+0000","last_unstale":"2024-02-09T23:58:39.406853+0000","last_undegraded":"2024-02-09T23:58:39.406853+0000","last_fullsized":"2024-02-09T23:58:39.406853+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":234,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.357349+0000","last_change":"2024-02-09T23:58:27.031822+0000","last_active":"2024-02-10T00:02:17.357349+0000","last_peered":"2024-02-10T00:02:17.357349+0000","last_clean":"2024-02-10T00:02:17.357349+0000","last_became_active":"2024-02-09T23:58:27.031474+0000","last_became_peered":"2024-02-09T23:58:27.031474+0000","last_unstale":"2024-02-10T00:02:17.357349+0000","last_undegraded":"2024-02-10T00:02:17.357349+0000","last_fullsized":"2024-02-10T00:02:17.357349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":833,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.339603+0000","last_change":"2024-02-09T23:58:27.347097+0000","last_active":"2024-02-10T00:02:22.339603+0000","last_peered":"2024-02-10T00:02:22.339603+0000","last_clean":"2024-02-10T00:02:22.339603+0000","last_became_active":"2024-02-09T23:58:27.346751+0000","last_became_peered":"2024-02-09T23:58:27.346751+0000","last_unstale":"2024-02-10T00:02:22.339603+0000","last_undegraded":"2024-02-10T00:02:22.339603+0000","last_fullsized":"2024-02-10T00:02:22.339603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404530+0000","last_change":"2024-02-09T23:58:18.657543+0000","last_active":"2024-02-09T23:58:39.404530+0000","last_peered":"2024-02-09T23:58:39.404530+0000","last_clean":"2024-02-09T23:58:39.404530+0000","last_became_active":"2024-02-09T23:58:18.657194+0000","last_became_peered":"2024-02-09T23:58:18.657194+0000","last_unstale":"2024-02-09T23:58:39.404530+0000","last_undegraded":"2024-02-09T23:58:39.404530+0000","last_fullsized":"2024-02-09T23:58:39.404530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'681","reported_seq":693,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.815896+0000","last_change":"2024-02-09T23:58:27.032479+0000","last_active":"2024-02-10T00:02:43.815896+0000","last_peered":"2024-02-10T00:02:43.815896+0000","last_clean":"2024-02-10T00:02:43.815896+0000","last_became_active":"2024-02-09T23:58:27.032105+0000","last_became_peered":"2024-02-09T23:58:27.032105+0000","last_unstale":"2024-02-10T00:02:43.815896+0000","last_undegraded":"2024-02-10T00:02:43.815896+0000","last_fullsized":"2024-02-10T00:02:43.815896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":991,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:17.328743+0000","last_change":"2024-02-09T23:58:27.352307+0000","last_active":"2024-02-10T00:02:17.328743+0000","last_peered":"2024-02-10T00:02:17.328743+0000","last_clean":"2024-02-10T00:02:17.328743+0000","last_became_active":"2024-02-09T23:58:27.350686+0000","last_became_peered":"2024-02-09T23:58:27.350686+0000","last_unstale":"2024-02-10T00:02:17.328743+0000","last_undegraded":"2024-02-10T00:02:17.328743+0000","last_fullsized":"2024-02-10T00:02:17.328743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:40.325375+0000","last_change":"2024-02-09T23:58:18.658501+0000","last_active":"2024-02-09T23:58:40.325375+0000","last_peered":"2024-02-09T23:58:40.325375+0000","last_clean":"2024-02-09T23:58:40.325375+0000","last_became_active":"2024-02-09T23:58:18.658126+0000","last_became_peered":"2024-02-09T23:58:18.658126+0000","last_unstale":"2024-02-09T23:58:40.325375+0000","last_undegraded":"2024-02-09T23:58:40.325375+0000","last_fullsized":"2024-02-09T23:58:40.325375+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'792","reported_seq":804,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833533+0000","last_change":"2024-02-09T23:58:27.021875+0000","last_active":"2024-02-10T00:02:43.833533+0000","last_peered":"2024-02-10T00:02:43.833533+0000","last_clean":"2024-02-10T00:02:43.833533+0000","last_became_active":"2024-02-09T23:58:27.021543+0000","last_became_peered":"2024-02-09T23:58:27.021543+0000","last_unstale":"2024-02-10T00:02:43.833533+0000","last_undegraded":"2024-02-10T00:02:43.833533+0000","last_fullsized":"2024-02-10T00:02:43.833533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":791,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.354126+0000","last_change":"2024-02-09T23:58:27.347986+0000","last_active":"2024-02-10T00:02:22.354126+0000","last_peered":"2024-02-10T00:02:22.354126+0000","last_clean":"2024-02-10T00:02:22.354126+0000","last_became_active":"2024-02-09T23:58:27.347615+0000","last_became_peered":"2024-02-09T23:58:27.347615+0000","last_unstale":"2024-02-10T00:02:22.354126+0000","last_undegraded":"2024-02-10T00:02:22.354126+0000","last_fullsized":"2024-02-10T00:02:22.354126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404567+0000","last_change":"2024-02-09T23:58:18.656572+0000","last_active":"2024-02-09T23:58:39.404567+0000","last_peered":"2024-02-09T23:58:39.404567+0000","last_clean":"2024-02-09T23:58:39.404567+0000","last_became_active":"2024-02-09T23:58:18.656194+0000","last_became_peered":"2024-02-09T23:58:18.656194+0000","last_unstale":"2024-02-09T23:58:39.404567+0000","last_undegraded":"2024-02-09T23:58:39.404567+0000","last_fullsized":"2024-02-09T23:58:39.404567+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404108+0000","last_change":"2024-02-09T23:58:14.581752+0000","last_active":"2024-02-09T23:58:39.404108+0000","last_peered":"2024-02-09T23:58:39.404108+0000","last_clean":"2024-02-09T23:58:39.404108+0000","last_became_active":"2024-02-09T23:58:14.581139+0000","last_became_peered":"2024-02-09T23:58:14.581139+0000","last_unstale":"2024-02-09T23:58:39.404108+0000","last_undegraded":"2024-02-09T23:58:39.404108+0000","last_fullsized":"2024-02-09T23:58:39.404108+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1412,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.822472+0000","last_change":"2024-02-09T23:58:27.039324+0000","last_active":"2024-02-10T00:02:43.822472+0000","last_peered":"2024-02-10T00:02:43.822472+0000","last_clean":"2024-02-10T00:02:43.822472+0000","last_became_active":"2024-02-09T23:58:27.038980+0000","last_became_peered":"2024-02-09T23:58:27.038980+0000","last_unstale":"2024-02-10T00:02:43.822472+0000","last_undegraded":"2024-02-10T00:02:43.822472+0000","last_fullsized":"2024-02-10T00:02:43.822472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.391589+0000","last_change":"2024-02-09T23:58:27.352724+0000","last_active":"2024-02-10T00:02:21.391589+0000","last_peered":"2024-02-10T00:02:21.391589+0000","last_clean":"2024-02-10T00:02:21.391589+0000","last_became_active":"2024-02-09T23:58:27.351882+0000","last_became_peered":"2024-02-09T23:58:27.351882+0000","last_unstale":"2024-02-10T00:02:21.391589+0000","last_undegraded":"2024-02-10T00:02:21.391589+0000","last_fullsized":"2024-02-10T00:02:21.391589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.403488+0000","last_change":"2024-02-09T23:58:18.654624+0000","last_active":"2024-02-09T23:58:39.403488+0000","last_peered":"2024-02-09T23:58:39.403488+0000","last_clean":"2024-02-09T23:58:39.403488+0000","last_became_active":"2024-02-09T23:58:18.654283+0000","last_became_peered":"2024-02-09T23:58:18.654283+0000","last_unstale":"2024-02-09T23:58:39.403488+0000","last_undegraded":"2024-02-09T23:58:39.403488+0000","last_fullsized":"2024-02-09T23:58:39.403488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'697","reported_seq":994,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.833980+0000","last_change":"2024-02-09T23:58:27.023243+0000","last_active":"2024-02-10T00:02:43.833980+0000","last_peered":"2024-02-10T00:02:43.833980+0000","last_clean":"2024-02-10T00:02:43.833980+0000","last_became_active":"2024-02-09T23:58:27.022904+0000","last_became_peered":"2024-02-09T23:58:27.022904+0000","last_unstale":"2024-02-10T00:02:43.833980+0000","last_undegraded":"2024-02-10T00:02:43.833980+0000","last_fullsized":"2024-02-10T00:02:43.833980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":1714,"num_write":585,"num_write_kb":10068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":906,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.360709+0000","last_change":"2024-02-09T23:58:27.342500+0000","last_active":"2024-02-10T00:02:22.360709+0000","last_peered":"2024-02-10T00:02:22.360709+0000","last_clean":"2024-02-10T00:02:22.360709+0000","last_became_active":"2024-02-09T23:58:27.342275+0000","last_became_peered":"2024-02-09T23:58:27.342275+0000","last_unstale":"2024-02-10T00:02:22.360709+0000","last_undegraded":"2024-02-10T00:02:22.360709+0000","last_fullsized":"2024-02-10T00:02:22.360709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404810+0000","last_change":"2024-02-09T23:58:18.655995+0000","last_active":"2024-02-09T23:58:39.404810+0000","last_peered":"2024-02-09T23:58:39.404810+0000","last_clean":"2024-02-09T23:58:39.404810+0000","last_became_active":"2024-02-09T23:58:18.654074+0000","last_became_peered":"2024-02-09T23:58:18.654074+0000","last_unstale":"2024-02-09T23:58:39.404810+0000","last_undegraded":"2024-02-09T23:58:39.404810+0000","last_fullsized":"2024-02-09T23:58:39.404810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'1023","reported_seq":1035,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.838731+0000","last_change":"2024-02-09T23:58:27.024114+0000","last_active":"2024-02-10T00:02:43.838731+0000","last_peered":"2024-02-10T00:02:43.838731+0000","last_clean":"2024-02-10T00:02:43.838731+0000","last_became_active":"2024-02-09T23:58:27.023800+0000","last_became_peered":"2024-02-09T23:58:27.023800+0000","last_unstale":"2024-02-10T00:02:43.838731+0000","last_undegraded":"2024-02-10T00:02:43.838731+0000","last_fullsized":"2024-02-10T00:02:43.838731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":960,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.354980+0000","last_change":"2024-02-09T23:58:27.333192+0000","last_active":"2024-02-10T00:02:22.354980+0000","last_peered":"2024-02-10T00:02:22.354980+0000","last_clean":"2024-02-10T00:02:22.354980+0000","last_became_active":"2024-02-09T23:58:27.324259+0000","last_became_peered":"2024-02-09T23:58:27.324259+0000","last_unstale":"2024-02-10T00:02:22.354980+0000","last_undegraded":"2024-02-10T00:02:22.354980+0000","last_fullsized":"2024-02-10T00:02:22.354980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.836137+0000","last_change":"2024-02-09T23:58:27.041488+0000","last_active":"2024-02-10T00:02:43.836137+0000","last_peered":"2024-02-10T00:02:43.836137+0000","last_clean":"2024-02-10T00:02:43.836137+0000","last_became_active":"2024-02-09T23:58:27.041155+0000","last_became_peered":"2024-02-09T23:58:27.041155+0000","last_unstale":"2024-02-10T00:02:43.836137+0000","last_undegraded":"2024-02-10T00:02:43.836137+0000","last_fullsized":"2024-02-10T00:02:43.836137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.406565+0000","last_change":"2024-02-09T23:58:18.657120+0000","last_active":"2024-02-09T23:58:39.406565+0000","last_peered":"2024-02-09T23:58:39.406565+0000","last_clean":"2024-02-09T23:58:39.406565+0000","last_became_active":"2024-02-09T23:58:18.656736+0000","last_became_peered":"2024-02-09T23:58:18.656736+0000","last_unstale":"2024-02-09T23:58:39.406565+0000","last_undegraded":"2024-02-09T23:58:39.406565+0000","last_fullsized":"2024-02-09T23:58:39.406565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":962,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.366616+0000","last_change":"2024-02-09T23:58:27.354059+0000","last_active":"2024-02-10T00:02:22.366616+0000","last_peered":"2024-02-10T00:02:22.366616+0000","last_clean":"2024-02-10T00:02:22.366616+0000","last_became_active":"2024-02-09T23:58:27.353344+0000","last_became_peered":"2024-02-09T23:58:27.353344+0000","last_unstale":"2024-02-10T00:02:22.366616+0000","last_undegraded":"2024-02-10T00:02:22.366616+0000","last_fullsized":"2024-02-10T00:02:22.366616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-09T23:58:39.404410+0000","last_change":"2024-02-09T23:58:18.656394+0000","last_active":"2024-02-09T23:58:39.404410+0000","last_peered":"2024-02-09T23:58:39.404410+0000","last_clean":"2024-02-09T23:58:39.404410+0000","last_became_active":"2024-02-09T23:58:18.656085+0000","last_became_peered":"2024-02-09T23:58:18.656085+0000","last_unstale":"2024-02-09T23:58:39.404410+0000","last_undegraded":"2024-02-09T23:58:39.404410+0000","last_fullsized":"2024-02-09T23:58:39.404410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'736","reported_seq":748,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.817583+0000","last_change":"2024-02-09T23:58:27.021382+0000","last_active":"2024-02-10T00:02:43.817583+0000","last_peered":"2024-02-10T00:02:43.817583+0000","last_clean":"2024-02-10T00:02:43.817583+0000","last_became_active":"2024-02-09T23:58:27.020028+0000","last_became_peered":"2024-02-09T23:58:27.020028+0000","last_unstale":"2024-02-10T00:02:43.817583+0000","last_undegraded":"2024-02-10T00:02:43.817583+0000","last_fullsized":"2024-02-10T00:02:43.817583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":875,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.355228+0000","last_change":"2024-02-09T23:58:27.329995+0000","last_active":"2024-02-10T00:02:22.355228+0000","last_peered":"2024-02-10T00:02:22.355228+0000","last_clean":"2024-02-10T00:02:22.355228+0000","last_became_active":"2024-02-09T23:58:27.327706+0000","last_became_peered":"2024-02-09T23:58:27.327706+0000","last_unstale":"2024-02-10T00:02:22.355228+0000","last_undegraded":"2024-02-10T00:02:22.355228+0000","last_fullsized":"2024-02-10T00:02:22.355228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.826814+0000","last_change":"2024-02-09T23:58:27.031890+0000","last_active":"2024-02-10T00:02:38.826814+0000","last_peered":"2024-02-10T00:02:38.826814+0000","last_clean":"2024-02-10T00:02:38.826814+0000","last_became_active":"2024-02-09T23:58:27.031580+0000","last_became_peered":"2024-02-09T23:58:27.031580+0000","last_unstale":"2024-02-10T00:02:38.826814+0000","last_undegraded":"2024-02-10T00:02:38.826814+0000","last_fullsized":"2024-02-10T00:02:38.826814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":918,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.350461+0000","last_change":"2024-02-09T23:58:27.351614+0000","last_active":"2024-02-10T00:02:22.350461+0000","last_peered":"2024-02-10T00:02:22.350461+0000","last_clean":"2024-02-10T00:02:22.350461+0000","last_became_active":"2024-02-09T23:58:27.351341+0000","last_became_peered":"2024-02-09T23:58:27.351341+0000","last_unstale":"2024-02-10T00:02:22.350461+0000","last_undegraded":"2024-02-10T00:02:22.350461+0000","last_fullsized":"2024-02-10T00:02:22.350461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.331985+0000","last_change":"2024-02-09T23:58:27.035107+0000","last_active":"2024-02-10T00:02:22.331985+0000","last_peered":"2024-02-10T00:02:22.331985+0000","last_clean":"2024-02-10T00:02:22.331985+0000","last_became_active":"2024-02-09T23:58:27.034753+0000","last_became_peered":"2024-02-09T23:58:27.034753+0000","last_unstale":"2024-02-10T00:02:22.331985+0000","last_undegraded":"2024-02-10T00:02:22.331985+0000","last_fullsized":"2024-02-10T00:02:22.331985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.372683+0000","last_change":"2024-02-09T23:58:27.326293+0000","last_active":"2024-02-10T00:02:22.372683+0000","last_peered":"2024-02-10T00:02:22.372683+0000","last_clean":"2024-02-10T00:02:22.372683+0000","last_became_active":"2024-02-09T23:58:27.325383+0000","last_became_peered":"2024-02-09T23:58:27.325383+0000","last_unstale":"2024-02-10T00:02:22.372683+0000","last_undegraded":"2024-02-10T00:02:22.372683+0000","last_fullsized":"2024-02-10T00:02:22.372683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'617","reported_seq":629,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:43.832332+0000","last_change":"2024-02-09T23:58:27.038824+0000","last_active":"2024-02-10T00:02:43.832332+0000","last_peered":"2024-02-10T00:02:43.832332+0000","last_clean":"2024-02-10T00:02:43.832332+0000","last_became_active":"2024-02-09T23:58:27.038495+0000","last_became_peered":"2024-02-09T23:58:27.038495+0000","last_unstale":"2024-02-10T00:02:43.832332+0000","last_undegraded":"2024-02-10T00:02:43.832332+0000","last_fullsized":"2024-02-10T00:02:43.832332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.378218+0000","last_change":"2024-02-09T23:58:27.331338+0000","last_active":"2024-02-10T00:02:21.378218+0000","last_peered":"2024-02-10T00:02:21.378218+0000","last_clean":"2024-02-10T00:02:21.378218+0000","last_became_active":"2024-02-09T23:58:27.330827+0000","last_became_peered":"2024-02-09T23:58:27.330827+0000","last_unstale":"2024-02-10T00:02:21.378218+0000","last_undegraded":"2024-02-10T00:02:21.378218+0000","last_fullsized":"2024-02-10T00:02:21.378218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":265,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:38.811774+0000","last_change":"2024-02-09T23:58:27.038084+0000","last_active":"2024-02-10T00:02:38.811774+0000","last_peered":"2024-02-10T00:02:38.811774+0000","last_clean":"2024-02-10T00:02:38.811774+0000","last_became_active":"2024-02-09T23:58:27.037761+0000","last_became_peered":"2024-02-09T23:58:27.037761+0000","last_unstale":"2024-02-10T00:02:38.811774+0000","last_undegraded":"2024-02-10T00:02:38.811774+0000","last_fullsized":"2024-02-10T00:02:38.811774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":923,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.355067+0000","last_change":"2024-02-09T23:58:27.332404+0000","last_active":"2024-02-10T00:02:22.355067+0000","last_peered":"2024-02-10T00:02:22.355067+0000","last_clean":"2024-02-10T00:02:22.355067+0000","last_became_active":"2024-02-09T23:58:27.331608+0000","last_became_peered":"2024-02-09T23:58:27.331608+0000","last_unstale":"2024-02-10T00:02:22.355067+0000","last_undegraded":"2024-02-10T00:02:22.355067+0000","last_fullsized":"2024-02-10T00:02:22.355067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'201","reported_seq":213,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:20.373254+0000","last_change":"2024-02-09T23:58:27.033137+0000","last_active":"2024-02-10T00:02:20.373254+0000","last_peered":"2024-02-10T00:02:20.373254+0000","last_clean":"2024-02-10T00:02:20.373254+0000","last_became_active":"2024-02-09T23:58:27.032723+0000","last_became_peered":"2024-02-09T23:58:27.032723+0000","last_unstale":"2024-02-10T00:02:20.373254+0000","last_undegraded":"2024-02-10T00:02:20.373254+0000","last_fullsized":"2024-02-10T00:02:20.373254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":961,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364689+0000","last_change":"2024-02-09T23:58:27.344234+0000","last_active":"2024-02-10T00:02:22.364689+0000","last_peered":"2024-02-10T00:02:22.364689+0000","last_clean":"2024-02-10T00:02:22.364689+0000","last_became_active":"2024-02-09T23:58:27.343916+0000","last_became_peered":"2024-02-09T23:58:27.343916+0000","last_unstale":"2024-02-10T00:02:22.364689+0000","last_undegraded":"2024-02-10T00:02:22.364689+0000","last_fullsized":"2024-02-10T00:02:22.364689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":908,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.361326+0000","last_change":"2024-02-09T23:58:27.352936+0000","last_active":"2024-02-10T00:02:22.361326+0000","last_peered":"2024-02-10T00:02:22.361326+0000","last_clean":"2024-02-10T00:02:22.361326+0000","last_became_active":"2024-02-09T23:58:27.352604+0000","last_became_peered":"2024-02-09T23:58:27.352604+0000","last_unstale":"2024-02-10T00:02:22.361326+0000","last_undegraded":"2024-02-10T00:02:22.361326+0000","last_fullsized":"2024-02-10T00:02:22.361326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1031,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.364409+0000","last_change":"2024-02-09T23:58:27.351404+0000","last_active":"2024-02-10T00:02:22.364409+0000","last_peered":"2024-02-10T00:02:22.364409+0000","last_clean":"2024-02-10T00:02:22.364409+0000","last_became_active":"2024-02-09T23:58:27.351084+0000","last_became_peered":"2024-02-09T23:58:27.351084+0000","last_unstale":"2024-02-10T00:02:22.364409+0000","last_undegraded":"2024-02-10T00:02:22.364409+0000","last_fullsized":"2024-02-10T00:02:22.364409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":938,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:22.369780+0000","last_change":"2024-02-09T23:58:27.329586+0000","last_active":"2024-02-10T00:02:22.369780+0000","last_peered":"2024-02-10T00:02:22.369780+0000","last_clean":"2024-02-10T00:02:22.369780+0000","last_became_active":"2024-02-09T23:58:27.329262+0000","last_became_peered":"2024-02-09T23:58:27.329262+0000","last_unstale":"2024-02-10T00:02:22.369780+0000","last_undegraded":"2024-02-10T00:02:22.369780+0000","last_fullsized":"2024-02-10T00:02:22.369780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.381134+0000","last_change":"2024-02-09T23:58:27.353170+0000","last_active":"2024-02-10T00:02:21.381134+0000","last_peered":"2024-02-10T00:02:21.381134+0000","last_clean":"2024-02-10T00:02:21.381134+0000","last_became_active":"2024-02-09T23:58:27.352883+0000","last_became_peered":"2024-02-09T23:58:27.352883+0000","last_unstale":"2024-02-10T00:02:21.381134+0000","last_undegraded":"2024-02-10T00:02:21.381134+0000","last_fullsized":"2024-02-10T00:02:21.381134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":765,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-10T00:02:21.403952+0000","last_change":"2024-02-09T23:58:27.349719+0000","last_active":"2024-02-10T00:02:21.403952+0000","last_peered":"2024-02-10T00:02:21.403952+0000","last_clean":"2024-02-10T00:02:21.403952+0000","last_became_active":"2024-02-09T23:58:27.348899+0000","last_became_peered":"2024-02-09T23:58:27.348899+0000","last_unstale":"2024-02-10T00:02:21.403952+0000","last_undegraded":"2024-02-10T00:02:21.403952+0000","last_fullsized":"2024-02-10T00:02:21.403952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147592590,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":597,"num_read_kb":3242,"num_write":16315,"num_write_kb":272930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295305216,"data_stored":295185180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19882,"ondisk_log_size":19882,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705743,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1146348,"kb_used_data":97764,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93225492,"statfs":{"total":96636764160,"available":95462903808,"internally_reserved":1073741824,"allocated":100110336,"data_stored":99948802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.35899999999999999,"15min":0.33600000000000002},"min":{"1min":0.16600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.52200000000000002,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.221,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.44,"5min":1.944,"15min":1.944},"last":0.373}]},{"osd":1,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.30199999999999999,"15min":0.32000000000000001},"min":{"1min":0.20000000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.499,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.223,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:04:31 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.20999999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54600000000000004,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.191,"5min":0.187,"15min":0.187},"max":{"1min":0.47999999999999998,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.41299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705744,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1109660,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93262180,"statfs":{"total":96636764160,"available":95500472320,"internally_reserved":1073741824,"allocated":62541824,"data_stored":62403300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.17399999999999999,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.31,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.38500000000000001,"15min":0.379},"min":{"1min":0.219,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.35799999999999998,"5min":3.048,"15min":3.048},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.34000000000000002,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.32100000000000001,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.30299999999999999,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.34499999999999997,"15min":0.35599999999999998},"min":{"1min":0.19700000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.32300000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.39500000000000002,"15min":0.38600000000000001},"min":{"1min":0.219,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.372,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.29199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119936,"kb_used_data":71352,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251904,"statfs":{"total":96636764160,"available":95489949696,"internally_reserved":1073741824,"allocated":73064448,"data_stored":72924067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.28799999999999998,"15min":0.31900000000000001},"min":{"1min":0.17100000000000001,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.67300000000000004,"5min":1.665,"15min":1.665},"last":0.245},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.34699999999999998,"15min":0.33100000000000002},"min":{"1min":0.17499999999999999,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.73499999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.70299999999999996,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.318},"min":{"1min":0.184,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71699999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:04:24 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.16500000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.68899999999999995,"5min":2.367,"15min":2.367},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.35999999999999999,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.751,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705742,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1107440,"kb_used_data":58856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93264400,"statfs":{"total":96636764160,"available":95502745600,"internally_reserved":1073741824,"allocated":60268544,"data_stored":60140497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.54100000000000004,"15min":0.38300000000000001},"min":{"1min":0.20300000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.39400000000000002,"5min":10.680999999999999,"15min":10.680999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.51300000000000001,"15min":0.38600000000000001},"min":{"1min":0.214,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.38700000000000001,"5min":5.7439999999999998,"15min":5.7439999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.40999999999999998,"15min":0.33600000000000002},"min":{"1min":0.185,"5min":0.159,"15min":0.159},"max":{"1min":0.37,"5min":5.1680000000000001,"15min":5.1680000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.41299999999999998,"15min":0.34300000000000003},"min":{"1min":0.22,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.36399999999999999,"5min":5.0960000000000001,"15min":5.0960000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:04:26 2024","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.39500000000000002,"15min":0.34100000000000003},"min":{"1min":0.19400000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40600000000000003,"5min":3.9249999999999998,"15min":3.9249999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.47799999999999998,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.38600000000000001,"5min":4.524,"15min":4.524},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62369792,"data_stored":62344376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99938304,"data_stored":99889878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:04:33.945 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-10T00:04:33.945 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-10T00:04:33.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-10T00:04:33.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-10T00:04:34.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 Processor -- start 2024-02-10T00:04:34.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 -- start start 2024-02-10T00:04:34.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 0x7f33180a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331813fce0 con 0x7f33180b0040 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180641d0 con 0x7f33180a9690 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.091+0000 7f331ccb3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331813ff80 con 0x7f33180a7960 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f331659c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 0x7f33180a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:41290/0 (socket says 172.21.15.89:41290) 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:48296/0 (socket says 172.21.15.89:48296) 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 -- 172.21.15.89:0/909508469 learned_addr learned my addr 172.21.15.89:0/909508469 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:34.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 -- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 msgr2=0x7f331806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 -- 172.21.15.89:0/909508469 >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 msgr2=0x7f33180a80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 --2- 172.21.15.89:0/909508469 >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 0x7f33180a80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 -- 172.21.15.89:0/909508469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180a6ee0 con 0x7f33180a9690 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f331659c700 1 --2- 172.21.15.89:0/909508469 >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 0x7f33180a80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3316d9d700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f3315d9b700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f330c0099b0 tx=0x7f330c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bee1433472a4ad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f331559a700 1 -- 172.21.15.89:0/909508469 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00b680 con 0x7f33180a9690 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f331559a700 1 -- 172.21.15.89:0/909508469 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00b7e0 con 0x7f33180a9690 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.092+0000 7f331559a700 1 -- 172.21.15.89:0/909508469 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00bb80 con 0x7f33180a9690 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 -- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 msgr2=0x7f3318063c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f330c0099b0 tx=0x7f330c009250 comp rx=0 tx=0).stop 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 -- 172.21.15.89:0/909508469 shutdown_connections 2024-02-10T00:04:34.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f331806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 --2- 172.21.15.89:0/909508469 >> v2:172.21.15.89:3300/0 conn(0x7f33180b0040 0x7f33180a80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 --2- 172.21.15.89:0/909508469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180a9690 0x7f3318063c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 -- 172.21.15.89:0/909508469 >> 172.21.15.89:0/909508469 conn(0x7f331806d950 msgr2=0x7f3318063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 -- 172.21.15.89:0/909508469 shutdown_connections 2024-02-10T00:04:34.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.093+0000 7f331ccb3700 1 -- 172.21.15.89:0/909508469 wait complete. 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.094+0000 7f331ccb3700 1 Processor -- start 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.094+0000 7f331ccb3700 1 -- start start 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f33180ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 0x7f331814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331811ab50 con 0x7f33180a9690 2024-02-10T00:04:34.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180ac8f0 con 0x7f33180b0040 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331ccb3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33180ad4b0 con 0x7f33180a7960 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3315d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f33180ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3316d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 0x7f331814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3315d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60640/0 (socket says 172.21.15.89:60640) 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3315d9b700 1 -- 172.21.15.89:0/4834144 learned_addr learned my addr 172.21.15.89:0/4834144 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 -- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 msgr2=0x7f331814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 0x7f331814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 -- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 msgr2=0x7f331814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 -- 172.21.15.89:0/4834144 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3310009a20 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3316d9d700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 0x7f331814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f3315d9b700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f331659c700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f33180ad970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f330800ec80 tx=0x7f33080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.095+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800c7f0 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800c950 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3308009420 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800ccf0 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c0094f0 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f3308013680 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.096+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331804c710 con 0x7f33180a7960 2024-02-10T00:04:34.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.097+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f330805b2b0 con 0x7f33180a7960 2024-02-10T00:04:34.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.100+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3308039600 con 0x7f33180a7960 2024-02-10T00:04:34.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.314+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f33180a9b90 con 0x7f33180a7960 2024-02-10T00:04:34.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.315+0000 7f33067fc700 1 -- 172.21.15.89:0/4834144 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f330803cdf0 con 0x7f33180a7960 2024-02-10T00:04:34.317 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:34.317 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 >> v1:172.21.15.89:6816/47970 conn(0x7f32f8045fb0 legacy=0x7f32f8048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 msgr2=0x7f33180ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f33180ad970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f330800ec80 tx=0x7f33080091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 shutdown_connections 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33180b0040 0x7f331814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f33180a7960 0x7f33180ad970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 --2- 172.21.15.89:0/4834144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33180a9690 0x7f331814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.316+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 >> 172.21.15.89:0/4834144 conn(0x7f331806d950 msgr2=0x7f331813c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.317+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 shutdown_connections 2024-02-10T00:04:34.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.317+0000 7f331ccb3700 1 -- 172.21.15.89:0/4834144 wait complete. 2024-02-10T00:04:34.331 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-10T00:04:34.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:34.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.455+0000 7fc0f99df700 1 Processor -- start 2024-02-10T00:04:34.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.455+0000 7fc0f99df700 1 -- start start 2024-02-10T00:04:34.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f99df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f99df700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0f40b0390 0x7fc0f4146a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f99df700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f4064220 con 0x7fc0f40a9070 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f99df700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f40a80d0 con 0x7fc0f40b0390 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f99df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f413f810 con 0x7fc0f4063e50 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f37fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0f40b0390 0x7fc0f4146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f27fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc0f40a9070 0x7fc0f40afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33004/0 (socket says 172.21.15.89:33004) 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55524/0 (socket says 172.21.15.89:55524) 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f27fc700 1 -- 172.21.15.89:0/1364756967 learned_addr learned my addr 172.21.15.89:0/1364756967 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f37fe700 1 -- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 msgr2=0x7fc0f40a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f37fe700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f37fe700 1 -- 172.21.15.89:0/1364756967 >> v1:172.21.15.89:6789/0 conn(0x7fc0f40a9070 legacy=0x7fc0f40afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f37fe700 1 -- 172.21.15.89:0/1364756967 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f413fab0 con 0x7fc0f40b0390 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.456+0000 7fc0f1ffb700 1 -- 172.21.15.89:0/1364756967 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920754443 0 0) 0x7fc0f4064220 con 0x7fc0f40a9070 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f2ffd700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f37fe700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f40b0390 0x7fc0f4146a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009e60 tx=0x7fc0ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1f81e2d6940846 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f1ffb700 1 -- 172.21.15.89:0/1364756967 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00e070 con 0x7fc0f40b0390 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f1ffb700 1 -- 172.21.15.89:0/1364756967 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec00bbf0 con 0x7fc0f40b0390 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f1ffb700 1 -- 172.21.15.89:0/1364756967 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec012430 con 0x7fc0f40b0390 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 -- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f40b0390 msgr2=0x7fc0f4146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f40b0390 0x7fc0f4146a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009e60 tx=0x7fc0ec009780 comp rx=0 tx=0).stop 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 -- 172.21.15.89:0/1364756967 shutdown_connections 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f40b0390 0x7fc0f4146a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 --2- 172.21.15.89:0/1364756967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f4063e50 0x7fc0f40a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.457+0000 7fc0f99df700 1 -- 172.21.15.89:0/1364756967 >> 172.21.15.89:0/1364756967 conn(0x7fc0f406d8c0 msgr2=0x7fc0f4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.458+0000 7fc0f99df700 1 -- 172.21.15.89:0/1364756967 shutdown_connections 2024-02-10T00:04:34.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.458+0000 7fc0f99df700 1 -- 172.21.15.89:0/1364756967 wait complete. 2024-02-10T00:04:34.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 Processor -- start 2024-02-10T00:04:34.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 -- start start 2024-02-10T00:04:34.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f40a9070 0x7fc0f4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 0x7fc0f41516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f406a3e0 con 0x7fc0f4063e50 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f411b260 con 0x7fc0f40a9070 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f99df700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f406a8c0 con 0x7fc0f40b0390 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 0x7fc0f41516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57508/0 (socket says 172.21.15.89:57508) 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f2ffd700 1 -- 172.21.15.89:0/2173996507 learned_addr learned my addr 172.21.15.89:0/2173996507 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.459+0000 7fc0f27fc700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f40a9070 0x7fc0f4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 -- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 msgr2=0x7fc0f41516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 0x7fc0f41516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 -- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f40a9070 msgr2=0x7fc0f4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f40a9070 0x7fc0f4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 -- 172.21.15.89:0/2173996507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4009420 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f37fe700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 0x7fc0f41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f2ffd700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400ecb0 tx=0x7fc0e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400c920 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e400ca80 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec009a20 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400ce00 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.460+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f406a140 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.461+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f40af580 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.461+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fc0e4013680 con 0x7fc0f4063e50 2024-02-10T00:04:34.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.461+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc0e405b300 con 0x7fc0f4063e50 2024-02-10T00:04:34.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.465+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fc0e4039690 con 0x7fc0f4063e50 2024-02-10T00:04:34.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.629+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0f404c710 con 0x7fc0f4063e50 2024-02-10T00:04:34.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.630+0000 7fc0daffd700 1 -- 172.21.15.89:0/2173996507 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7fc0e403ce80 con 0x7fc0f4063e50 2024-02-10T00:04:34.633 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:34.633 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:34.130455+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 >> v1:172.21.15.89:6816/47970 conn(0x7fc0e0045fe0 legacy=0x7fc0e0048490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 msgr2=0x7fc0f40699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400ecb0 tx=0x7fc0e40091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 shutdown_connections 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc0f40b0390 0x7fc0f41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f4063e50 0x7fc0f40699a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 --2- 172.21.15.89:0/2173996507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f40a9070 0x7fc0f4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 >> 172.21.15.89:0/2173996507 conn(0x7fc0f406d8c0 msgr2=0x7fc0f40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 shutdown_connections 2024-02-10T00:04:34.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.632+0000 7fc0f99df700 1 -- 172.21.15.89:0/2173996507 wait complete. 2024-02-10T00:04:34.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:04:34.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:04:34.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.769+0000 7fa472b78700 1 Processor -- start 2024-02-10T00:04:34.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.769+0000 7fa472b78700 1 -- start start 2024-02-10T00:04:34.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0b2040 0x7fa46c0a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa46c06d430 0x7fa46c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0a7050 con 0x7fa46c06d430 2024-02-10T00:04:34.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0a57b0 con 0x7fa46c0b2040 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa472b78700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0a7c60 con 0x7fa46c0a53e0 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa471115700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa46c06d430 0x7fa46c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60100/0 (socket says 172.21.15.89:60100) 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa471115700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa46c06d430 0x7fa46c06d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57518/0 (socket says 172.21.15.89:57518) 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa46bfff700 1 -- 172.21.15.89:0/2569578135 learned_addr learned my addr 172.21.15.89:0/2569578135 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:34.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.770+0000 7fa470914700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0b2040 0x7fa46c0a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 -- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 msgr2=0x7fa46c13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 -- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0b2040 msgr2=0x7fa46c0a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0b2040 0x7fa46c0a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 -- 172.21.15.89:0/2569578135 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0b2410 con 0x7fa46c06d430 2024-02-10T00:04:34.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa46bfff700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa471115700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c06d8a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa464009e60 tx=0x7fa464009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb8219b466d0b08 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa46b7fe700 1 -- 172.21.15.89:0/2569578135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400e070 con 0x7fa46c06d430 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa46b7fe700 1 -- 172.21.15.89:0/2569578135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400bae0 con 0x7fa46c06d430 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa46b7fe700 1 -- 172.21.15.89:0/2569578135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400bea0 con 0x7fa46c06d430 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa472b78700 1 -- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 msgr2=0x7fa46c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.771+0000 7fa472b78700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c06d8a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa464009e60 tx=0x7fa464009780 comp rx=0 tx=0).stop 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 -- 172.21.15.89:0/2569578135 shutdown_connections 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c06d8a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0b2040 0x7fa46c0a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 --2- 172.21.15.89:0/2569578135 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0a53e0 0x7fa46c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 -- 172.21.15.89:0/2569578135 >> 172.21.15.89:0/2569578135 conn(0x7fa46c06fd50 msgr2=0x7fa46c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 -- 172.21.15.89:0/2569578135 shutdown_connections 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.772+0000 7fa472b78700 1 -- 172.21.15.89:0/2569578135 wait complete. 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.773+0000 7fa472b78700 1 Processor -- start 2024-02-10T00:04:34.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.773+0000 7fa472b78700 1 -- start start 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c0984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 0x7fa46c0970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0ae8e0 con 0x7fa46c06d430 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0aeba0 con 0x7fa46c0a53e0 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa472b78700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c096a70 con 0x7fa46c0b2040 2024-02-10T00:04:34.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa471115700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa470914700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c0984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 0x7fa46c0970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa471115700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60102/0 (socket says 172.21.15.89:60102) 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa471115700 1 -- 172.21.15.89:0/3951203900 learned_addr learned my addr 172.21.15.89:0/3951203900 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 -- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 msgr2=0x7fa46c14e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 -- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 msgr2=0x7fa46c0984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c0984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 -- 172.21.15.89:0/3951203900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580094f0 con 0x7fa46c0a53e0 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa471115700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.774+0000 7fa46bfff700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 0x7fa46c0970c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:34.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.793+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800c820 con 0x7fa46c0a53e0 2024-02-10T00:04:34.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.793+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800c980 con 0x7fa46c0a53e0 2024-02-10T00:04:34.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.793+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464009a20 con 0x7fa46c0a53e0 2024-02-10T00:04:34.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.793+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800cd40 con 0x7fa46c0a53e0 2024-02-10T00:04:34.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.793+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c0aef30 con 0x7fa46c0a53e0 2024-02-10T00:04:34.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.794+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c097d30 con 0x7fa46c0a53e0 2024-02-10T00:04:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.794+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fa458013680 con 0x7fa46c0a53e0 2024-02-10T00:04:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.794+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa45805b4a0 con 0x7fa46c0a53e0 2024-02-10T00:04:34.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.798+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fa458039830 con 0x7fa46c0a53e0 2024-02-10T00:04:34.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.958+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa46c0a7520 con 0x7fa46c0a53e0 2024-02-10T00:04:34.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.958+0000 7fa468ff9700 1 -- 172.21.15.89:0/3951203900 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa45803d020 con 0x7fa46c0a53e0 2024-02-10T00:04:34.961 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 >> v1:172.21.15.89:6816/47970 conn(0x7fa450045fb0 legacy=0x7fa450048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 msgr2=0x7fa46c0970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 0x7fa46c0970c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458009250 comp rx=0 tx=0).stop 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 shutdown_connections 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c0b2040 0x7fa46c14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c06d430 0x7fa46c0984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 --2- 172.21.15.89:0/3951203900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c0a53e0 0x7fa46c0970c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 >> 172.21.15.89:0/3951203900 conn(0x7fa46c06fd50 msgr2=0x7fa46c141070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 shutdown_connections 2024-02-10T00:04:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:34.960+0000 7fa472b78700 1 -- 172.21.15.89:0/3951203900 wait complete. 2024-02-10T00:04:34.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:04:35.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.094+0000 7f17ffc27700 1 Processor -- start 2024-02-10T00:04:35.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.094+0000 7f17ffc27700 1 -- start start 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17ffc27700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17f8063e50 0x7f17f80afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17ffc27700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17ffc27700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f80a9040 con 0x7f17f80a9470 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17ffc27700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f8064220 con 0x7f17f8063e50 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17ffc27700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80a8b40 con 0x7f17f813c0f0 2024-02-10T00:04:35.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd9c3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17f8063e50 0x7f17f80afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd1c2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fe1c4700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f17f80a9470 0x7f17f806e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33008/0 (socket says 172.21.15.89:33008) 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fe1c4700 1 -- 172.21.15.89:0/3953149047 learned_addr learned my addr 172.21.15.89:0/3953149047 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd9c3700 1 -- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 msgr2=0x7f17f80a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd9c3700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd9c3700 1 -- 172.21.15.89:0/3953149047 >> v1:172.21.15.89:6789/0 conn(0x7f17f80a9470 legacy=0x7f17f806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd9c3700 1 -- 172.21.15.89:0/3953149047 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f813c5f0 con 0x7f17f8063e50 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fc9c1700 1 -- 172.21.15.89:0/3953149047 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246270922 0 0) 0x7f17f80a9040 con 0x7f17f80a9470 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.095+0000 7f17fd1c2700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17fd9c3700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f8063e50 0x7f17f80afee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098e0 tx=0x7f17e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0eb2f697d7f40f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17fc9c1700 1 -- 172.21.15.89:0/3953149047 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800b640 con 0x7f17f8063e50 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17fc9c1700 1 -- 172.21.15.89:0/3953149047 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e800b7a0 con 0x7f17f8063e50 2024-02-10T00:04:35.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17fc9c1700 1 -- 172.21.15.89:0/3953149047 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800bb40 con 0x7f17f8063e50 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 -- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f8063e50 msgr2=0x7f17f80afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f8063e50 0x7f17f80afee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098e0 tx=0x7f17e80091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 -- 172.21.15.89:0/3953149047 shutdown_connections 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f8063e50 0x7f17f80afee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 --2- 172.21.15.89:0/3953149047 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 -- 172.21.15.89:0/3953149047 >> 172.21.15.89:0/3953149047 conn(0x7f17f806d8a0 msgr2=0x7f17f8063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 -- 172.21.15.89:0/3953149047 shutdown_connections 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.096+0000 7f17ffc27700 1 -- 172.21.15.89:0/3953149047 wait complete. 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.097+0000 7f17ffc27700 1 Processor -- start 2024-02-10T00:04:35.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.097+0000 7f17ffc27700 1 -- start start 2024-02-10T00:04:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f8063e50 0x7f17f80ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80ad990 con 0x7f17f80a9470 2024-02-10T00:04:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80ae850 con 0x7f17f8063e50 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17ffc27700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80abd80 con 0x7f17f813c0f0 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57546/0 (socket says 172.21.15.89:57546) 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fe1c4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 -- 172.21.15.89:0/2403826290 learned_addr learned my addr 172.21.15.89:0/2403826290 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd9c3700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f8063e50 0x7f17f80ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 -- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 msgr2=0x7f17f80aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 -- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f8063e50 msgr2=0x7f17f80ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f8063e50 0x7f17f80ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 -- 172.21.15.89:0/2403826290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009420 con 0x7f17f80a9470 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.098+0000 7f17fd1c2700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17f400ec80 tx=0x7f17f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.099+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400c8e0 con 0x7f17f80a9470 2024-02-10T00:04:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.099+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400ca40 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.099+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e8009420 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.099+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400cdc0 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.099+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f813ff50 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.100+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f804c710 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.100+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f17f4013680 con 0x7f17f80a9470 2024-02-10T00:04:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.100+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f17f405ba50 con 0x7f17f80a9470 2024-02-10T00:04:35.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.104+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f17f4039fd0 con 0x7f17f80a9470 2024-02-10T00:04:35.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.256+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f17f80a6990 con 0x7f17f80a9470 2024-02-10T00:04:35.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.257+0000 7f17edffb700 1 -- 172.21.15.89:0/2403826290 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f17f403d5f0 con 0x7f17f80a9470 2024-02-10T00:04:35.259 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.258+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 >> v1:172.21.15.89:6816/47970 conn(0x7f17dc045fb0 legacy=0x7f17dc048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.258+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 msgr2=0x7f17f80a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.258+0000 7f17ffc27700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17f400ec80 tx=0x7f17f40091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 shutdown_connections 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f17f813c0f0 0x7f17f80aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17f8063e50 0x7f17f80ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 --2- 172.21.15.89:0/2403826290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17f80a9470 0x7f17f80a9cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 >> 172.21.15.89:0/2403826290 conn(0x7f17f806d8a0 msgr2=0x7f17f80a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 shutdown_connections 2024-02-10T00:04:35.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.259+0000 7f17ffc27700 1 -- 172.21.15.89:0/2403826290 wait complete. 2024-02-10T00:04:35.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:04:35.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 Processor -- start 2024-02-10T00:04:35.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 -- start start 2024-02-10T00:04:35.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f327006e980 0x7f32700b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f32701491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327006ed50 con 0x7f3270067970 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32700aa290 con 0x7f327006e980 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f327500a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32700aab40 con 0x7f3270068480 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f326ed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f327006e980 0x7f32700b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f326f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f32701491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f326e59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3270067970 0x7f3270067d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33010/0 (socket says 172.21.15.89:33010) 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.394+0000 7f326e59c700 1 -- 172.21.15.89:0/1177201373 learned_addr learned my addr 172.21.15.89:0/1177201373 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326dd9b700 1 -- 172.21.15.89:0/1177201373 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073749840 0 0) 0x7f327006ed50 con 0x7f3270067970 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326dd9b700 1 -- 172.21.15.89:0/1177201373 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3258003570 con 0x7f3270067970 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326ed9d700 1 -- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 msgr2=0x7f32701491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326ed9d700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f32701491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326ed9d700 1 -- 172.21.15.89:0/1177201373 >> v1:172.21.15.89:6789/0 conn(0x7f3270067970 legacy=0x7f3270067d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326ed9d700 1 -- 172.21.15.89:0/1177201373 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700aade0 con 0x7f327006e980 2024-02-10T00:04:35.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326f59e700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f32701491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326ed9d700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f327006e980 0x7f32700b1f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32600098e0 tx=0x7f32600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551272eb8825186f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326dd9b700 1 -- 172.21.15.89:0/1177201373 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260011630 con 0x7f327006e980 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326dd9b700 1 -- 172.21.15.89:0/1177201373 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260011790 con 0x7f327006e980 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f326dd9b700 1 -- 172.21.15.89:0/1177201373 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260011b30 con 0x7f327006e980 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 -- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f327006e980 msgr2=0x7f32700b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f327006e980 0x7f32700b1f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32600098e0 tx=0x7f32600091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 -- 172.21.15.89:0/1177201373 shutdown_connections 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f32701491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 --2- 172.21.15.89:0/1177201373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f327006e980 0x7f32700b1f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 -- 172.21.15.89:0/1177201373 >> 172.21.15.89:0/1177201373 conn(0x7f327006fd50 msgr2=0x7f327006c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 -- 172.21.15.89:0/1177201373 shutdown_connections 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.395+0000 7f327500a700 1 -- 172.21.15.89:0/1177201373 wait complete. 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.396+0000 7f327500a700 1 Processor -- start 2024-02-10T00:04:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.396+0000 7f327500a700 1 -- start start 2024-02-10T00:04:35.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f327006e980 0x7f327009b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327014e570 con 0x7f3270067970 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32700a0060 con 0x7f3270068480 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f327500a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327014e810 con 0x7f327006e980 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326ed9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326f59e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f327006e980 0x7f327009b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55572/0 (socket says 172.21.15.89:55572) 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326ed9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57572/0 (socket says 172.21.15.89:57572) 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 -- 172.21.15.89:0/2577986599 learned_addr learned my addr 172.21.15.89:0/2577986599 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:35.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 -- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f327006e980 msgr2=0x7f327009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f327006e980 0x7f327009b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 -- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 msgr2=0x7f327009ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326e59c700 1 -- 172.21.15.89:0/2577986599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268009a20 con 0x7f3270068480 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.397+0000 7f326ed9d700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f326e59c700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7c0 tx=0x7f3264007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264005b30 con 0x7f3270068480 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3264005cb0 con 0x7f3270068480 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3260009420 con 0x7f3270068480 2024-02-10T00:04:35.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264007320 con 0x7f3270068480 2024-02-10T00:04:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.398+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327014ef50 con 0x7f3270068480 2024-02-10T00:04:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.399+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327004c710 con 0x7f3270068480 2024-02-10T00:04:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.399+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f326401b3b0 con 0x7f3270068480 2024-02-10T00:04:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.399+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f326405a480 con 0x7f3270068480 2024-02-10T00:04:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.402+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3264038870 con 0x7f3270068480 2024-02-10T00:04:35.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.553+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32700a9cf0 con 0x7f3270068480 2024-02-10T00:04:35.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.553+0000 7f3256ffd700 1 -- 172.21.15.89:0/2577986599 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32640170a0 con 0x7f3270068480 2024-02-10T00:04:35.556 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 >> v1:172.21.15.89:6816/47970 conn(0x7f325c045fb0 legacy=0x7f325c048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 msgr2=0x7f327009fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7c0 tx=0x7f3264007e00 comp rx=0 tx=0).stop 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 shutdown_connections 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f327006e980 0x7f327009b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270067970 0x7f327009ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 --2- 172.21.15.89:0/2577986599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270068480 0x7f327009fb20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 >> 172.21.15.89:0/2577986599 conn(0x7f327006fd50 msgr2=0x7f32700b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 shutdown_connections 2024-02-10T00:04:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.555+0000 7f327500a700 1 -- 172.21.15.89:0/2577986599 wait complete. 2024-02-10T00:04:35.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:04:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 Processor -- start 2024-02-10T00:04:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 -- start start 2024-02-10T00:04:35.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 0x7f7a44137b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4406e600 con 0x7f7a44138070 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4406e400 con 0x7f7a4406eb00 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4bdee700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4413e9c0 con 0x7f7a440b19b0 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a49b8a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a49389700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 0x7f7a44137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a49b8a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60142/0 (socket says 172.21.15.89:60142) 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a49b8a700 1 -- 172.21.15.89:0/3338360728 learned_addr learned my addr 172.21.15.89:0/3338360728 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.686+0000 7f7a4a38b700 1 --1- 172.21.15.89:0/3338360728 >> v1:172.21.15.89:6789/0 conn(0x7f7a44138070 0x7f7a440a1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33018/0 (socket says 172.21.15.89:33018) 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49b8a700 1 -- 172.21.15.89:0/3338360728 >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 msgr2=0x7f7a44137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49b8a700 1 --2- 172.21.15.89:0/3338360728 >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 0x7f7a44137b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49b8a700 1 -- 172.21.15.89:0/3338360728 >> v1:172.21.15.89:6789/0 conn(0x7f7a44138070 legacy=0x7f7a440a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49b8a700 1 -- 172.21.15.89:0/3338360728 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4413ec80 con 0x7f7a440b19b0 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a48b88700 1 -- 172.21.15.89:0/3338360728 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945963242 0 0) 0x7f7a4406e600 con 0x7f7a44138070 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49389700 1 --2- 172.21.15.89:0/3338360728 >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 0x7f7a44137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a49b8a700 1 --2- 172.21.15.89:0/3338360728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a340099b0 tx=0x7f7a34009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd1d1f7511b29fe server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a48b88700 1 -- 172.21.15.89:0/3338360728 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34009ea0 con 0x7f7a440b19b0 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a48b88700 1 -- 172.21.15.89:0/3338360728 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400b860 con 0x7f7a440b19b0 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.687+0000 7f7a48b88700 1 -- 172.21.15.89:0/3338360728 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400bc00 con 0x7f7a440b19b0 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 -- 172.21.15.89:0/3338360728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 msgr2=0x7f7a4413e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/3338360728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a340099b0 tx=0x7f7a34009250 comp rx=0 tx=0).stop 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 -- 172.21.15.89:0/3338360728 shutdown_connections 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/3338360728 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a440b19b0 0x7f7a4413e100 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/3338360728 >> v2:172.21.15.89:3300/0 conn(0x7f7a4406eb00 0x7f7a44137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 -- 172.21.15.89:0/3338360728 >> 172.21.15.89:0/3338360728 conn(0x7f7a4406a910 msgr2=0x7f7a440b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 -- 172.21.15.89:0/3338360728 shutdown_connections 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.688+0000 7f7a4bdee700 1 -- 172.21.15.89:0/3338360728 wait complete. 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 Processor -- start 2024-02-10T00:04:35.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 -- start start 2024-02-10T00:04:35.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 0x7f7a440aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 0x7f7a4414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440ab3d0 con 0x7f7a440b19b0 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440aa6b0 con 0x7f7a4406eb00 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4bdee700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440ab5e0 con 0x7f7a44138070 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4a38b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 0x7f7a4414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49b8a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 0x7f7a440aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57592/0 (socket says 172.21.15.89:57592) 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a4a38b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 0x7f7a4414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60146/0 (socket says 172.21.15.89:60146) 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 -- 172.21.15.89:0/369425476 learned_addr learned my addr 172.21.15.89:0/369425476 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49b8a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 0x7f7a440aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55574/0 (socket says 172.21.15.89:55574) 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 -- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 msgr2=0x7f7a4414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 0x7f7a4414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 -- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 msgr2=0x7f7a440aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 0x7f7a440aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.689+0000 7f7a49389700 1 -- 172.21.15.89:0/369425476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009420 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a49389700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000ec50 tx=0x7f7a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000c8e0 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000ca40 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a340094f0 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000cde0 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.690+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a440ae980 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.691+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f7a40013680 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.691+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4404c710 con 0x7f7a440b19b0 2024-02-10T00:04:35.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.691+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7a4005b350 con 0x7f7a440b19b0 2024-02-10T00:04:35.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.695+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f7a400396e0 con 0x7f7a440b19b0 2024-02-10T00:04:35.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.845+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a440a2920 con 0x7f7a440b19b0 2024-02-10T00:04:35.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.845+0000 7f7a39ffb700 1 -- 172.21.15.89:0/369425476 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a4003ced0 con 0x7f7a440b19b0 2024-02-10T00:04:35.848 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 >> v1:172.21.15.89:6816/47970 conn(0x7f7a28045fe0 legacy=0x7f7a28048490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 msgr2=0x7f7a4414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000ec50 tx=0x7f7a400091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 shutdown_connections 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7a44138070 0x7f7a4414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a4406eb00 0x7f7a440aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 --2- 172.21.15.89:0/369425476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a440b19b0 0x7f7a4414f510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 >> 172.21.15.89:0/369425476 conn(0x7f7a4406a910 msgr2=0x7f7a44063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 shutdown_connections 2024-02-10T00:04:35.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.847+0000 7f7a4bdee700 1 -- 172.21.15.89:0/369425476 wait complete. 2024-02-10T00:04:35.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:04:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.975+0000 7f75c1b6f700 1 Processor -- start 2024-02-10T00:04:35.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.975+0000 7f75c1b6f700 1 -- start start 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75c1b6f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75c1b6f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75bc06d260 0x7f75bc142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75c1b6f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0a28c0 con 0x7f75bc06ce70 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75c1b6f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0a1130 con 0x7f75bc06d260 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75c1b6f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc063b10 con 0x7f75bc063740 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75bc06d260 0x7f75bc142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75b3fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f75bc06ce70 0x7f75bc141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33024/0 (socket says 172.21.15.89:33024) 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60156/0 (socket says 172.21.15.89:60156) 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75bc06d260 0x7f75bc142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57596/0 (socket says 172.21.15.89:57596) 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75b3fff700 1 -- 172.21.15.89:0/755819242 learned_addr learned my addr 172.21.15.89:0/755819242 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:35.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 -- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 msgr2=0x7f75bc06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 -- 172.21.15.89:0/755819242 >> v1:172.21.15.89:6789/0 conn(0x7f75bc06ce70 legacy=0x7f75bc141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 -- 172.21.15.89:0/755819242 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc141ba0 con 0x7f75bc06d260 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75baffd700 1 -- 172.21.15.89:0/755819242 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650936322 0 0) 0x7f75bc0a28c0 con 0x7f75bc06ce70 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bb7fe700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.976+0000 7f75bbfff700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc142550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009e60 tx=0x7f75b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888b524943637bb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75baffd700 1 -- 172.21.15.89:0/755819242 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400e070 con 0x7f75bc06d260 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75baffd700 1 -- 172.21.15.89:0/755819242 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400bb60 con 0x7f75bc06d260 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75baffd700 1 -- 172.21.15.89:0/755819242 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4012430 con 0x7f75bc06d260 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 -- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 msgr2=0x7f75bc142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc142550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009e60 tx=0x7f75b4009780 comp rx=0 tx=0).stop 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 -- 172.21.15.89:0/755819242 shutdown_connections 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc142550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/755819242 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 -- 172.21.15.89:0/755819242 >> 172.21.15.89:0/755819242 conn(0x7f75bc06a820 msgr2=0x7f75bc0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:35.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 -- 172.21.15.89:0/755819242 shutdown_connections 2024-02-10T00:04:35.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.977+0000 7f75c1b6f700 1 -- 172.21.15.89:0/755819242 wait complete. 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.978+0000 7f75c1b6f700 1 Processor -- start 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.978+0000 7f75c1b6f700 1 -- start start 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 0x7f75bc140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1456e0 con 0x7f75bc06d260 2024-02-10T00:04:35.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1432b0 con 0x7f75bc06ce70 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc097b20 con 0x7f75bc063740 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bbfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60168/0 (socket says 172.21.15.89:60168) 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 -- 172.21.15.89:0/106830018 learned_addr learned my addr 172.21.15.89:0/106830018 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75b3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 0x7f75bc140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 -- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 msgr2=0x7f75bc140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 0x7f75bc140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 -- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 msgr2=0x7f75bc141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 -- 172.21.15.89:0/106830018 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009420 con 0x7f75bc063740 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75b3fff700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 0x7f75bc140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bbfff700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:35.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75bb7fe700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00ecb0 tx=0x7f75ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00c920 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00ca80 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00ce00 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b4009a20 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.979+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc144ff0 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.980+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f75ac013680 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.980+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc04c710 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.981+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f75ac05b310 con 0x7f75bc063740 2024-02-10T00:04:35.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:35.984+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f75ac0396a0 con 0x7f75bc063740 2024-02-10T00:04:36.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.168+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75bc0a0b90 con 0x7f75bc063740 2024-02-10T00:04:36.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.170+0000 7f75b37fe700 1 -- 172.21.15.89:0/106830018 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3662 (secure 0 0 0) 0x7f75ac03ce90 con 0x7f75bc063740 2024-02-10T00:04:36.172 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:36.172 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/3706839334","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":3706839334}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:54.474229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:04:36.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 >> v1:172.21.15.89:6816/47970 conn(0x7f759c045fb0 legacy=0x7f759c048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 msgr2=0x7f75bc1461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00ecb0 tx=0x7f75ac0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 shutdown_connections 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75bc06d260 0x7f75bc141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f75bc063740 0x7f75bc1461e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 --2- 172.21.15.89:0/106830018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75bc06ce70 0x7f75bc140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 >> 172.21.15.89:0/106830018 conn(0x7f75bc06a820 msgr2=0x7f75bc06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 shutdown_connections 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.172+0000 7f75c1b6f700 1 -- 172.21.15.89:0/106830018 wait complete. 2024-02-10T00:04:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-02-10T00:04:36.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:36.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.299+0000 7fc9bb519700 1 Processor -- start 2024-02-10T00:04:36.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.299+0000 7fc9bb519700 1 -- start start 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9bb519700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9bb519700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b4142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9bb519700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b40a28c0 con 0x7fc9b406ce70 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9bb519700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40a1130 con 0x7fc9b4063740 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9bb519700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4063b10 con 0x7fc9b406d260 2024-02-10T00:04:36.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b92b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b9ab6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b4142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b8ab4700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc9b406ce70 0x7fc9b4141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33032/0 (socket says 172.21.15.89:33032) 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b8ab4700 1 -- 172.21.15.89:0/130587232 learned_addr learned my addr 172.21.15.89:0/130587232 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9abfff700 1 -- 172.21.15.89:0/130587232 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043968363 0 0) 0x7fc9b40a28c0 con 0x7fc9b406ce70 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9abfff700 1 -- 172.21.15.89:0/130587232 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a0003570 con 0x7fc9b406ce70 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b9ab6700 1 -- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 msgr2=0x7fc9b406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b9ab6700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b9ab6700 1 -- 172.21.15.89:0/130587232 >> v1:172.21.15.89:6789/0 conn(0x7fc9b406ce70 legacy=0x7fc9b4141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b9ab6700 1 -- 172.21.15.89:0/130587232 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4141ba0 con 0x7fc9b406d260 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.300+0000 7fc9b92b5700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9b9ab6700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b4142550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009e90 tx=0x7fc9ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f341d270ffba7352 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9abfff700 1 -- 172.21.15.89:0/130587232 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00e070 con 0x7fc9b406d260 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9abfff700 1 -- 172.21.15.89:0/130587232 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00bb80 con 0x7fc9b406d260 2024-02-10T00:04:36.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9abfff700 1 -- 172.21.15.89:0/130587232 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac012430 con 0x7fc9b406d260 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 -- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 msgr2=0x7fc9b4142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b4142550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009e90 tx=0x7fc9ac009780 comp rx=0 tx=0).stop 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 -- 172.21.15.89:0/130587232 shutdown_connections 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 --2- 172.21.15.89:0/130587232 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b4142550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 -- 172.21.15.89:0/130587232 >> 172.21.15.89:0/130587232 conn(0x7fc9b406a820 msgr2=0x7fc9b40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 -- 172.21.15.89:0/130587232 shutdown_connections 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.301+0000 7fc9bb519700 1 -- 172.21.15.89:0/130587232 wait complete. 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.302+0000 7fc9bb519700 1 Processor -- start 2024-02-10T00:04:36.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.302+0000 7fc9bb519700 1 -- start start 2024-02-10T00:04:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 0x7fc9b40a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b40a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b413de00 con 0x7fc9b406ce70 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40aae30 con 0x7fc9b4063740 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9bb519700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40ad5a0 con 0x7fc9b406d260 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b92b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 0x7fc9b40a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b92b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55602/0 (socket says 172.21.15.89:55602) 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b92b5700 1 -- 172.21.15.89:0/3719207485 learned_addr learned my addr 172.21.15.89:0/3719207485 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b9ab6700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b40a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 -- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 msgr2=0x7fc9b40a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b40a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 -- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 msgr2=0x7fc9b40ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b8ab4700 1 -- 172.21.15.89:0/3719207485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009420 con 0x7fc9b406ce70 2024-02-10T00:04:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.303+0000 7fc9b92b5700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9b8ab4700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 0x7fc9b40a8db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40b0fb0 tx=0x7fc9b0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0005b30 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0005cb0 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac009a20 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007320 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.304+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b40acd90 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.305+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fc9b001b3b0 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.305+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b40aaf70 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.305+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc9b005a400 con 0x7fc9b406ce70 2024-02-10T00:04:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.309+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fc9b0038730 con 0x7fc9b406ce70 2024-02-10T00:04:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.462+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9b404c710 con 0x7fc9b406ce70 2024-02-10T00:04:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.462+0000 7fc9a97fa700 1 -- 172.21.15.89:0/3719207485 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7fc9b0017020 con 0x7fc9b406ce70 2024-02-10T00:04:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:36.465 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:34.130455+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:36.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 >> v1:172.21.15.89:6816/47970 conn(0x7fc998045fe0 legacy=0x7fc998048490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 msgr2=0x7fc9b40a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 0x7fc9b40a8db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40b0fb0 tx=0x7fc9b0007d50 comp rx=0 tx=0).stop 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 shutdown_connections 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc9b406d260 0x7fc9b40a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9b4063740 0x7fc9b40ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 --2- 172.21.15.89:0/3719207485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9b406ce70 0x7fc9b40a8db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 >> 172.21.15.89:0/3719207485 conn(0x7fc9b406a820 msgr2=0x7fc9b4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 shutdown_connections 2024-02-10T00:04:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.464+0000 7fc9bb519700 1 -- 172.21.15.89:0/3719207485 wait complete. 2024-02-10T00:04:36.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:04:36.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:04:36.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.594+0000 7f4450ac2700 1 Processor -- start 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.594+0000 7f4450ac2700 1 -- start start 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0a7050 con 0x7f444c06d430 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0a57b0 con 0x7f444c0a53e0 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4450ac2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0a7c60 con 0x7f444c0b2040 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f444ad9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f444a59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55608/0 (socket says 172.21.15.89:55608) 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f444ad9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57618/0 (socket says 172.21.15.89:57618) 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f444a59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60212/0 (socket says 172.21.15.89:60212) 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.595+0000 7f4449d9b700 1 -- 172.21.15.89:0/2684729096 learned_addr learned my addr 172.21.15.89:0/2684729096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 -- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 msgr2=0x7f444c13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 -- 172.21.15.89:0/2684729096 >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 msgr2=0x7f444c06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 --2- 172.21.15.89:0/2684729096 >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 -- 172.21.15.89:0/2684729096 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0b2410 con 0x7f444c0b2040 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4449d9b700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444ad9d700 1 --2- 172.21.15.89:0/2684729096 >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444a59c700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44400098e0 tx=0x7f44400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba3e1b659e20d72 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444959a700 1 -- 172.21.15.89:0/2684729096 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000f6b0 con 0x7f444c0b2040 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444959a700 1 -- 172.21.15.89:0/2684729096 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000f810 con 0x7f444c0b2040 2024-02-10T00:04:36.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f444959a700 1 -- 172.21.15.89:0/2684729096 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000fbb0 con 0x7f444c0b2040 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 -- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 msgr2=0x7f444c0a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44400098e0 tx=0x7f44400091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 -- 172.21.15.89:0/2684729096 shutdown_connections 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2684729096 >> v2:172.21.15.89:3300/0 conn(0x7f444c06d430 0x7f444c06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0b2040 0x7f444c0a6040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2684729096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c0a53e0 0x7f444c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.596+0000 7f4450ac2700 1 -- 172.21.15.89:0/2684729096 >> 172.21.15.89:0/2684729096 conn(0x7f444c06fd50 msgr2=0x7f444c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.597+0000 7f4450ac2700 1 -- 172.21.15.89:0/2684729096 shutdown_connections 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.597+0000 7f4450ac2700 1 -- 172.21.15.89:0/2684729096 wait complete. 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.597+0000 7f4450ac2700 1 Processor -- start 2024-02-10T00:04:36.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.597+0000 7f4450ac2700 1 -- start start 2024-02-10T00:04:36.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c06d430 0x7f444c099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c0b2040 0x7f444c098180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0aecc0 con 0x7f444c0b2040 2024-02-10T00:04:36.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c099200 con 0x7f444c06d430 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4450ac2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f444c097ee0 con 0x7f444c0a53e0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f444ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c0b2040 0x7f444c098180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60226/0 (socket says 172.21.15.89:60226) 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 -- 172.21.15.89:0/2315523492 learned_addr learned my addr 172.21.15.89:0/2315523492 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f444a59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c06d430 0x7f444c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 -- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c06d430 msgr2=0x7f444c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c06d430 0x7f444c099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 -- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c0b2040 msgr2=0x7f444c098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c0b2040 0x7f444c098180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 -- 172.21.15.89:0/2315523492 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009a20 con 0x7f444c0a53e0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.598+0000 7f4449d9b700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f443c00ec50 tx=0x7f443c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00c8c0 con 0x7f444c0a53e0 2024-02-10T00:04:36.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c00ca20 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00cdc0 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0094f0 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440009420 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f443c013680 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.599+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c04c710 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.600+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f443c05b2c0 con 0x7f444c0a53e0 2024-02-10T00:04:36.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.603+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f443c039710 con 0x7f444c0a53e0 2024-02-10T00:04:36.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.753+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f444c0a7ed0 con 0x7f444c0a53e0 2024-02-10T00:04:36.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.754+0000 7f443a7fc700 1 -- 172.21.15.89:0/2315523492 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f443c03cf00 con 0x7f444c0a53e0 2024-02-10T00:04:36.756 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 >> v1:172.21.15.89:6816/47970 conn(0x7f442c045fb0 legacy=0x7f442c048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 msgr2=0x7f444c14e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f443c00ec50 tx=0x7f443c009250 comp rx=0 tx=0).stop 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 shutdown_connections 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c0b2040 0x7f444c098180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c06d430 0x7f444c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 --2- 172.21.15.89:0/2315523492 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f444c0a53e0 0x7f444c14e900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.755+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 >> 172.21.15.89:0/2315523492 conn(0x7f444c06fd50 msgr2=0x7f444c13e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.756+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 shutdown_connections 2024-02-10T00:04:36.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.756+0000 7f4450ac2700 1 -- 172.21.15.89:0/2315523492 wait complete. 2024-02-10T00:04:36.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.885+0000 7f2e6dffd700 1 Processor -- start 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.885+0000 7f2e6dffd700 1 -- start start 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680a7050 con 0x7f2e680b2040 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a57b0 con 0x7f2e6806d430 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e6dffd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a7c60 con 0x7f2e680a53e0 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e677fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e677fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57632/0 (socket says 172.21.15.89:57632) 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60242/0 (socket says 172.21.15.89:60242) 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e677fe700 1 -- 172.21.15.89:0/3178273374 learned_addr learned my addr 172.21.15.89:0/3178273374 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55622/0 (socket says 172.21.15.89:55622) 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 -- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 msgr2=0x7f2e6813edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 -- 172.21.15.89:0/3178273374 >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 msgr2=0x7f2e680a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 --2- 172.21.15.89:0/3178273374 >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 -- 172.21.15.89:0/3178273374 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680b2410 con 0x7f2e6806d430 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e66ffd700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e677fe700 1 --2- 172.21.15.89:0/3178273374 >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.886+0000 7f2e67fff700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e60 tx=0x7f2e60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2294a3720e9b3bb9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e667fc700 1 -- 172.21.15.89:0/3178273374 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000e070 con 0x7f2e6806d430 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e667fc700 1 -- 172.21.15.89:0/3178273374 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000bae0 con 0x7f2e6806d430 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e667fc700 1 -- 172.21.15.89:0/3178273374 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000bea0 con 0x7f2e6806d430 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 msgr2=0x7f2e6806d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e60 tx=0x7f2e60009780 comp rx=0 tx=0).stop 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3178273374 shutdown_connections 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e6806d430 0x7f2e6806d880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3178273374 >> v2:172.21.15.89:3300/0 conn(0x7f2e680b2040 0x7f2e680a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3178273374 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e6813edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3178273374 >> 172.21.15.89:0/3178273374 conn(0x7f2e6806fd50 msgr2=0x7f2e6806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3178273374 shutdown_connections 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.887+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3178273374 wait complete. 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.888+0000 7f2e6dffd700 1 Processor -- start 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.888+0000 7f2e6dffd700 1 -- start start 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e680a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e680b2040 0x7f2e680a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a9600 con 0x7f2e6806d430 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a62c0 con 0x7f2e680b2040 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e6dffd700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a8850 con 0x7f2e680a53e0 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e680a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57634/0 (socket says 172.21.15.89:57634) 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e677fe700 1 -- 172.21.15.89:0/3260630460 learned_addr learned my addr 172.21.15.89:0/3260630460 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e67fff700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e680b2040 0x7f2e680a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 -- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e680b2040 msgr2=0x7f2e680a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e680b2040 0x7f2e680a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 -- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 msgr2=0x7f2e68143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 -- 172.21.15.89:0/3260630460 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58009420 con 0x7f2e680a53e0 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e677fe700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.889+0000 7f2e66ffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e680a8190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800ec80 tx=0x7f2e580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800c850 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800c9b0 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800cd70 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0094f0 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60009a20 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.890+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f2e58013680 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.891+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6804c710 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.891+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2e5805b220 con 0x7f2e680a53e0 2024-02-10T00:04:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:36.894+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f2e5803d1b0 con 0x7f2e680a53e0 2024-02-10T00:04:37.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.044+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e680a7ed0 con 0x7f2e680a53e0 2024-02-10T00:04:37.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.045+0000 7f2e4f7fe700 1 -- 172.21.15.89:0/3260630460 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e5803cda0 con 0x7f2e680a53e0 2024-02-10T00:04:37.048 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 >> v1:172.21.15.89:6816/47970 conn(0x7f2e54045fb0 legacy=0x7f2e54048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 msgr2=0x7f2e680a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e680a8190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800ec80 tx=0x7f2e580091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 shutdown_connections 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e680b2040 0x7f2e680a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e6806d430 0x7f2e68143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 --2- 172.21.15.89:0/3260630460 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2e680a53e0 0x7f2e680a8190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 >> 172.21.15.89:0/3260630460 conn(0x7f2e6806fd50 msgr2=0x7f2e6806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 shutdown_connections 2024-02-10T00:04:37.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.046+0000 7f2e6dffd700 1 -- 172.21.15.89:0/3260630460 wait complete. 2024-02-10T00:04:37.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:04:37.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.180+0000 7f051bbc1700 1 Processor -- start 2024-02-10T00:04:37.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.180+0000 7f051bbc1700 1 -- start start 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 0x7f051413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051406e400 con 0x7f051406cc00 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051413e970 con 0x7f0514063580 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051bbc1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f051413e660 con 0x7f051406d800 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051995d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051a15e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 0x7f051413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051995d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55632/0 (socket says 172.21.15.89:55632) 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051a15e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57644/0 (socket says 172.21.15.89:57644) 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051995d700 1 -- 172.21.15.89:0/1429793220 learned_addr learned my addr 172.21.15.89:0/1429793220 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 -- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 msgr2=0x7f051406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 -- 172.21.15.89:0/1429793220 >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 msgr2=0x7f051413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 --2- 172.21.15.89:0/1429793220 >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.181+0000 7f051915c700 1 -- 172.21.15.89:0/1429793220 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051406f730 con 0x7f051406d800 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051995d700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051a15e700 1 --2- 172.21.15.89:0/1429793220 >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051915c700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 0x7f051413ec30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0510009910 tx=0x7f05100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219398bcbbd341ba server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051895b700 1 -- 172.21.15.89:0/1429793220 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510011630 con 0x7f051406d800 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051895b700 1 -- 172.21.15.89:0/1429793220 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510011790 con 0x7f051406d800 2024-02-10T00:04:37.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051895b700 1 -- 172.21.15.89:0/1429793220 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510011b30 con 0x7f051406d800 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 -- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 msgr2=0x7f051413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 0x7f051413ec30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0510009910 tx=0x7f05100091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 -- 172.21.15.89:0/1429793220 shutdown_connections 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 --2- 172.21.15.89:0/1429793220 >> v2:172.21.15.89:3300/0 conn(0x7f051406cc00 0x7f051413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0514063580 0x7f051406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 --2- 172.21.15.89:0/1429793220 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f051406d800 0x7f051413ec30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 -- 172.21.15.89:0/1429793220 >> 172.21.15.89:0/1429793220 conn(0x7f051406a910 msgr2=0x7f05140b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 -- 172.21.15.89:0/1429793220 shutdown_connections 2024-02-10T00:04:37.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.182+0000 7f051bbc1700 1 -- 172.21.15.89:0/1429793220 wait complete. 2024-02-10T00:04:37.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.183+0000 7f051bbc1700 1 Processor -- start 2024-02-10T00:04:37.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.183+0000 7f051bbc1700 1 -- start start 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f051406cc00 0x7f0514137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f051406d800 0x7f05141380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140a7750 con 0x7f051406cc00 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140a9400 con 0x7f051406d800 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051bbc1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05140a96e0 con 0x7f0514063580 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60260/0 (socket says 172.21.15.89:60260) 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 -- 172.21.15.89:0/2351805471 learned_addr learned my addr 172.21.15.89:0/2351805471 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051915c700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f051406cc00 0x7f0514137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051a15e700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f051406d800 0x7f05141380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 -- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f051406d800 msgr2=0x7f05141380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f051406d800 0x7f05141380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 -- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f051406cc00 msgr2=0x7f0514137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f051406cc00 0x7f0514137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 -- 172.21.15.89:0/2351805471 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040094f0 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.184+0000 7f051995d700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f050400ec50 tx=0x7f0504009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.185+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400c920 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.185+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050400ca80 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.185+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c009a20 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.185+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400ce00 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.185+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510009420 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.186+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0504013680 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.186+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051404c710 con 0x7f0514063580 2024-02-10T00:04:37.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.186+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f050405b420 con 0x7f0514063580 2024-02-10T00:04:37.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.190+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0504039730 con 0x7f0514063580 2024-02-10T00:04:37.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.341+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05140a8630 con 0x7f0514063580 2024-02-10T00:04:37.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.341+0000 7f0509ffb700 1 -- 172.21.15.89:0/2351805471 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f050403cf20 con 0x7f0514063580 2024-02-10T00:04:37.344 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 >> v1:172.21.15.89:6816/47970 conn(0x7f04f8046070 legacy=0x7f04f8048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 msgr2=0x7f05140a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f050400ec50 tx=0x7f0504009250 comp rx=0 tx=0).stop 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 shutdown_connections 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f051406d800 0x7f05141380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0514063580 0x7f05140a9be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 --2- 172.21.15.89:0/2351805471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f051406cc00 0x7f0514137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 >> 172.21.15.89:0/2351805471 conn(0x7f051406a910 msgr2=0x7f05140aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 shutdown_connections 2024-02-10T00:04:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.343+0000 7f051bbc1700 1 -- 172.21.15.89:0/2351805471 wait complete. 2024-02-10T00:04:37.357 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:04:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 Processor -- start 2024-02-10T00:04:37.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 -- start start 2024-02-10T00:04:37.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 0x7f94ec146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec1406f0 con 0x7f94ec0637d0 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0a3a60 con 0x7f94ec140250 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94f0db9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec13f7d0 con 0x7f94ec0a5300 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94ea59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f94ec0637d0 0x7f94ec0a2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33044/0 (socket says 172.21.15.89:33044) 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94ea59c700 1 -- 172.21.15.89:0/2097825465 learned_addr learned my addr 172.21.15.89:0/2097825465 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94ead9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 0x7f94ec146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.474+0000 7f94e9d9b700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94ead9d700 1 -- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 msgr2=0x7f94ec13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94e959a700 1 -- 172.21.15.89:0/2097825465 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143927887 0 0) 0x7f94dc001110 con 0x7f94ec0637d0 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94ead9d700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94ead9d700 1 -- 172.21.15.89:0/2097825465 >> v1:172.21.15.89:6789/0 conn(0x7f94ec0637d0 legacy=0x7f94ec0a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94ead9d700 1 -- 172.21.15.89:0/2097825465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec13fa70 con 0x7f94ec140250 2024-02-10T00:04:37.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94e9d9b700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94ead9d700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 0x7f94ec146b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009e90 tx=0x7f94e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2741c2c3ffad4439 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94e959a700 1 -- 172.21.15.89:0/2097825465 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400e070 con 0x7f94ec140250 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94e959a700 1 -- 172.21.15.89:0/2097825465 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e400bcc0 con 0x7f94ec140250 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.475+0000 7f94e959a700 1 -- 172.21.15.89:0/2097825465 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4012680 con 0x7f94ec140250 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 -- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 msgr2=0x7f94ec146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 0x7f94ec146b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009e90 tx=0x7f94e4009780 comp rx=0 tx=0).stop 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 -- 172.21.15.89:0/2097825465 shutdown_connections 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec140250 0x7f94ec146b70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2097825465 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 -- 172.21.15.89:0/2097825465 >> 172.21.15.89:0/2097825465 conn(0x7f94ec06a910 msgr2=0x7f94ec0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 -- 172.21.15.89:0/2097825465 shutdown_connections 2024-02-10T00:04:37.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.476+0000 7f94f0db9700 1 -- 172.21.15.89:0/2097825465 wait complete. 2024-02-10T00:04:37.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 Processor -- start 2024-02-10T00:04:37.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 -- start start 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94ec140250 0x7f94ec14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0a6a90 con 0x7f94ec140250 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec13ba70 con 0x7f94ec0637d0 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94f0db9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec138d50 con 0x7f94ec0a5300 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55662/0 (socket says 172.21.15.89:55662) 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ead9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94ec140250 0x7f94ec14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 -- 172.21.15.89:0/2412600028 learned_addr learned my addr 172.21.15.89:0/2412600028 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94e9d9b700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 -- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 msgr2=0x7f94ec0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec0a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 -- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94ec140250 msgr2=0x7f94ec14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94ec140250 0x7f94ec14f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94ea59c700 1 -- 172.21.15.89:0/2412600028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009420 con 0x7f94ec0637d0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.477+0000 7f94e9d9b700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec0a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94ea59c700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00eba0 tx=0x7f94dc007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc013070 con 0x7f94ec0637d0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00e2e0 con 0x7f94ec0637d0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4009a20 con 0x7f94ec0637d0 2024-02-10T00:04:37.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0058a0 con 0x7f94ec0637d0 2024-02-10T00:04:37.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.478+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec0a7930 con 0x7f94ec0637d0 2024-02-10T00:04:37.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.479+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec13bbe0 con 0x7f94ec0637d0 2024-02-10T00:04:37.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.479+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f94dc005cd0 con 0x7f94ec0637d0 2024-02-10T00:04:37.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.479+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f94dc05ed30 con 0x7f94ec0637d0 2024-02-10T00:04:37.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.483+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f94ec13bbe0 con 0x7f94ec0637d0 2024-02-10T00:04:37.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.633+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94ec1406f0 con 0x7f94ec0637d0 2024-02-10T00:04:37.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.634+0000 7f94da7fc700 1 -- 172.21.15.89:0/2412600028 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94ec1406f0 con 0x7f94ec0637d0 2024-02-10T00:04:37.636 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 >> v1:172.21.15.89:6816/47970 conn(0x7f94cc046070 legacy=0x7f94cc048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 msgr2=0x7f94ec0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00eba0 tx=0x7f94dc007ca0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 shutdown_connections 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94ec140250 0x7f94ec14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94ec0637d0 0x7f94ec0a6140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 --2- 172.21.15.89:0/2412600028 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f94ec0a5300 0x7f94ec0a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 >> 172.21.15.89:0/2412600028 conn(0x7f94ec06a910 msgr2=0x7f94ec0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 shutdown_connections 2024-02-10T00:04:37.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.635+0000 7f94f0db9700 1 -- 172.21.15.89:0/2412600028 wait complete. 2024-02-10T00:04:37.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:04:37.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.763+0000 7fa47103c700 1 Processor -- start 2024-02-10T00:04:37.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.763+0000 7fa47103c700 1 -- start start 2024-02-10T00:04:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa47103c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 0x7fa46c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa47103c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa47103c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0a28c0 con 0x7fa46c06ce70 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa47103c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0a1130 con 0x7fa46c063740 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa47103c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c063b10 con 0x7fa46c06d260 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46ad9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 0x7fa46c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46a59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa46c06ce70 0x7fa46c141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33046/0 (socket says 172.21.15.89:33046) 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46a59c700 1 -- 172.21.15.89:0/35757186 learned_addr learned my addr 172.21.15.89:0/35757186 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 -- 172.21.15.89:0/35757186 >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 msgr2=0x7fa46c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 --2- 172.21.15.89:0/35757186 >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 0x7fa46c06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 -- 172.21.15.89:0/35757186 >> v1:172.21.15.89:6789/0 conn(0x7fa46c06ce70 legacy=0x7fa46c141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 -- 172.21.15.89:0/35757186 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c141ba0 con 0x7fa46c06d260 2024-02-10T00:04:37.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa469d9b700 1 -- 172.21.15.89:0/35757186 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110736049 0 0) 0x7fa46c0a28c0 con 0x7fa46c06ce70 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46ad9d700 1 --2- 172.21.15.89:0/35757186 >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 0x7fa46c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa46b59e700 1 --2- 172.21.15.89:0/35757186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c142550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa464009e60 tx=0x7fa464009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d59f2d78346e5bd server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa469d9b700 1 -- 172.21.15.89:0/35757186 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400e070 con 0x7fa46c06d260 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa469d9b700 1 -- 172.21.15.89:0/35757186 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400bb60 con 0x7fa46c06d260 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.764+0000 7fa469d9b700 1 -- 172.21.15.89:0/35757186 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464012430 con 0x7fa46c06d260 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 -- 172.21.15.89:0/35757186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 msgr2=0x7fa46c142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 --2- 172.21.15.89:0/35757186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c142550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa464009e60 tx=0x7fa464009780 comp rx=0 tx=0).stop 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 -- 172.21.15.89:0/35757186 shutdown_connections 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 --2- 172.21.15.89:0/35757186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c142550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 --2- 172.21.15.89:0/35757186 >> v2:172.21.15.89:3300/0 conn(0x7fa46c063740 0x7fa46c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 -- 172.21.15.89:0/35757186 >> 172.21.15.89:0/35757186 conn(0x7fa46c06a820 msgr2=0x7fa46c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 -- 172.21.15.89:0/35757186 shutdown_connections 2024-02-10T00:04:37.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.765+0000 7fa47103c700 1 -- 172.21.15.89:0/35757186 wait complete. 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.766+0000 7fa47103c700 1 Processor -- start 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.766+0000 7fa47103c700 1 -- start start 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.766+0000 7fa47103c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c06ce70 0x7fa46c09ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c09a440 con 0x7fa46c063740 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c099cf0 con 0x7fa46c06d260 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c14d730 con 0x7fa46c06ce70 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46a59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c06ce70 0x7fa46c09ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57694/0 (socket says 172.21.15.89:57694) 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 -- 172.21.15.89:0/3586482081 learned_addr learned my addr 172.21.15.89:0/3586482081 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:37.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46b59e700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 -- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c06ce70 msgr2=0x7fa46c09ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c06ce70 0x7fa46c09ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 -- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 msgr2=0x7fa46c099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 -- 172.21.15.89:0/3586482081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460009420 con 0x7fa46c063740 2024-02-10T00:04:37.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46b59e700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:37.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa46ad9d700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa46000ec80 tx=0x7fa4600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:37.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000c850 con 0x7fa46c063740 2024-02-10T00:04:37.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46000c9b0 con 0x7fa46c063740 2024-02-10T00:04:37.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464009a20 con 0x7fa46c063740 2024-02-10T00:04:37.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000cd30 con 0x7fa46c063740 2024-02-10T00:04:37.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.767+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c0add30 con 0x7fa46c063740 2024-02-10T00:04:37.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.768+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c04c710 con 0x7fa46c063740 2024-02-10T00:04:37.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.768+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa460013680 con 0x7fa46c063740 2024-02-10T00:04:37.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.769+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa46005b4b0 con 0x7fa46c063740 2024-02-10T00:04:37.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.772+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fa4600396a0 con 0x7fa46c063740 2024-02-10T00:04:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.950+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa46c09b2f0 con 0x7fa46c063740 2024-02-10T00:04:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.950+0000 7fa452ffd700 1 -- 172.21.15.89:0/3586482081 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3662 (secure 0 0 0) 0x7fa46c09b2f0 con 0x7fa46c063740 2024-02-10T00:04:37.952 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:37.952 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/3706839334","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":3706839334}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:54.474229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:04:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 >> v1:172.21.15.89:6816/47970 conn(0x7fa458046040 legacy=0x7fa4580484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 msgr2=0x7fa46c0ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa46000ec80 tx=0x7fa4600091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 shutdown_connections 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46c06d260 0x7fa46c099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa46c063740 0x7fa46c0ad150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 --2- 172.21.15.89:0/3586482081 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa46c06ce70 0x7fa46c09ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 >> 172.21.15.89:0/3586482081 conn(0x7fa46c06a820 msgr2=0x7fa46c140e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 shutdown_connections 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:37.952+0000 7fa47103c700 1 -- 172.21.15.89:0/3586482081 wait complete. 2024-02-10T00:04:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-02-10T00:04:37.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:38.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.078+0000 7f027e852700 1 Processor -- start 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.078+0000 7f027e852700 1 -- start start 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027e852700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f027813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027e852700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 0x7f02781458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027e852700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780a62d0 con 0x7f0278063e50 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027e852700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0278064220 con 0x7f027813bc00 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027e852700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02780a67f0 con 0x7f02780a6fd0 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f027813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f0277fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0278063e50 0x7f02780a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33050/0 (socket says 172.21.15.89:33050) 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f0277fff700 1 -- 172.21.15.89:0/2345776931 learned_addr learned my addr 172.21.15.89:0/2345776931 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027cdef700 1 --2- 172.21.15.89:0/2345776931 >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 0x7f02781458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f0276ffd700 1 -- 172.21.15.89:0/2345776931 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162891747 0 0) 0x7f02780a62d0 con 0x7f0278063e50 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f0276ffd700 1 -- 172.21.15.89:0/2345776931 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003570 con 0x7f0278063e50 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 -- 172.21.15.89:0/2345776931 >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 msgr2=0x7f02781458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 --2- 172.21.15.89:0/2345776931 >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 0x7f02781458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 -- 172.21.15.89:0/2345776931 >> v1:172.21.15.89:6789/0 conn(0x7f0278063e50 legacy=0x7f02780a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 -- 172.21.15.89:0/2345776931 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780a6030 con 0x7f02780a6fd0 2024-02-10T00:04:38.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f027cdef700 1 --2- 172.21.15.89:0/2345776931 >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 0x7f02781458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f02777fe700 1 --2- 172.21.15.89:0/2345776931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f027813b6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0260009910 tx=0x7f02600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85ca306f2372372 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.079+0000 7f0276ffd700 1 -- 172.21.15.89:0/2345776931 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011630 con 0x7f02780a6fd0 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f0276ffd700 1 -- 172.21.15.89:0/2345776931 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0260011790 con 0x7f02780a6fd0 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f0276ffd700 1 -- 172.21.15.89:0/2345776931 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011b30 con 0x7f02780a6fd0 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 -- 172.21.15.89:0/2345776931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 msgr2=0x7f027813b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 --2- 172.21.15.89:0/2345776931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f027813b6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0260009910 tx=0x7f02600091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 -- 172.21.15.89:0/2345776931 shutdown_connections 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 --2- 172.21.15.89:0/2345776931 >> v2:172.21.15.89:3300/0 conn(0x7f027813bc00 0x7f02781458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 --2- 172.21.15.89:0/2345776931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f027813b6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 -- 172.21.15.89:0/2345776931 >> 172.21.15.89:0/2345776931 conn(0x7f027806c7c0 msgr2=0x7f0278063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 -- 172.21.15.89:0/2345776931 shutdown_connections 2024-02-10T00:04:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.080+0000 7f027e852700 1 -- 172.21.15.89:0/2345776931 wait complete. 2024-02-10T00:04:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.081+0000 7f027e852700 1 Processor -- start 2024-02-10T00:04:38.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.081+0000 7f027e852700 1 -- start start 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f027813bc00 0x7f0278096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027809b180 con 0x7f0278063e50 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02780a3f10 con 0x7f02780a6fd0 2024-02-10T00:04:38.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027e852700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02780985b0 con 0x7f027813bc00 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f0277fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55710/0 (socket says 172.21.15.89:55710) 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f0277fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57706/0 (socket says 172.21.15.89:57706) 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 -- 172.21.15.89:0/455909276 learned_addr learned my addr 172.21.15.89:0/455909276 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f027cdef700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f027813bc00 0x7f0278096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 -- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f027813bc00 msgr2=0x7f0278096fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f027813bc00 0x7f0278096fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 -- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 msgr2=0x7f027809ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 -- 172.21.15.89:0/455909276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027000bc30 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f0277fff700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.082+0000 7f02777fe700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0260009f00 tx=0x7f0260017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260000d10 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0260011b10 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260025620 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0260009420 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278098ad0 con 0x7f02780a6fd0 2024-02-10T00:04:38.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.083+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0260025a50 con 0x7f02780a6fd0 2024-02-10T00:04:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.084+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02780637f0 con 0x7f02780a6fd0 2024-02-10T00:04:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.084+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f026005c7c0 con 0x7f02780a6fd0 2024-02-10T00:04:38.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.087+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0260007c20 con 0x7f02780a6fd0 2024-02-10T00:04:38.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.246+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027804c710 con 0x7f02780a6fd0 2024-02-10T00:04:38.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.247+0000 7f026ffff700 1 -- 172.21.15.89:0/455909276 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7f0260007c20 con 0x7f02780a6fd0 2024-02-10T00:04:38.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:38.250 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:34.130455+0000","last_up_change":"2024-02-09T23:58:13.556626+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 >> v1:172.21.15.89:6816/47970 conn(0x7f0258046070 legacy=0x7f0258048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 msgr2=0x7f0278096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0260009f00 tx=0x7f0260017000 comp rx=0 tx=0).stop 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 shutdown_connections 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f027813bc00 0x7f0278096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0278063e50 0x7f027809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 --2- 172.21.15.89:0/455909276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02780a6fd0 0x7f0278096a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 >> 172.21.15.89:0/455909276 conn(0x7f027806c7c0 msgr2=0x7f0278064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:38.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 shutdown_connections 2024-02-10T00:04:38.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.249+0000 7f027e852700 1 -- 172.21.15.89:0/455909276 wait complete. 2024-02-10T00:04:38.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:04:38.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.377+0000 7f9e88bb9700 1 Processor -- start 2024-02-10T00:04:38.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.377+0000 7f9e88bb9700 1 -- start start 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e88bb9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e88bb9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 0x7f9e841458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e88bb9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840a62d0 con 0x7f9e84063e50 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e88bb9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84064220 con 0x7f9e840a6fd0 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e88bb9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840a67f0 con 0x7f9e8413bc00 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e81d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 0x7f9e841458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e81d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55722/0 (socket says 172.21.15.89:55722) 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e81d9b700 1 -- 172.21.15.89:0/4195786539 learned_addr learned my addr 172.21.15.89:0/4195786539 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e8159a700 1 -- 172.21.15.89:0/4195786539 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389913498 0 0) 0x7f9e840a62d0 con 0x7f9e84063e50 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 -- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 msgr2=0x7f9e8413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 -- 172.21.15.89:0/4195786539 >> v1:172.21.15.89:6789/0 conn(0x7f9e84063e50 legacy=0x7f9e840a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 -- 172.21.15.89:0/4195786539 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840a6030 con 0x7f9e8413bc00 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e81d9b700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e82d9d700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 0x7f9e841458e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009e90 tx=0x7f9e7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57eef434b20b171e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e8159a700 1 -- 172.21.15.89:0/4195786539 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00e070 con 0x7f9e8413bc00 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e8159a700 1 -- 172.21.15.89:0/4195786539 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00bc30 con 0x7f9e8413bc00 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.378+0000 7f9e8159a700 1 -- 172.21.15.89:0/4195786539 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c012430 con 0x7f9e8413bc00 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 -- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 msgr2=0x7f9e841458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 0x7f9e841458e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009e90 tx=0x7f9e7c009780 comp rx=0 tx=0).stop 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 -- 172.21.15.89:0/4195786539 shutdown_connections 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e8413bc00 0x7f9e841458e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/4195786539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e8413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 -- 172.21.15.89:0/4195786539 >> 172.21.15.89:0/4195786539 conn(0x7f9e8406c7c0 msgr2=0x7f9e84063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 -- 172.21.15.89:0/4195786539 shutdown_connections 2024-02-10T00:04:38.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.379+0000 7f9e88bb9700 1 -- 172.21.15.89:0/4195786539 wait complete. 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.380+0000 7f9e88bb9700 1 Processor -- start 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.380+0000 7f9e88bb9700 1 -- start start 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 0x7f9e840ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 0x7f9e8414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84067fb0 con 0x7f9e8413bc00 2024-02-10T00:04:38.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84096f30 con 0x7f9e840a6fd0 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e88bb9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840971f0 con 0x7f9e84063e50 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e82d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 0x7f9e8414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55730/0 (socket says 172.21.15.89:55730) 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 -- 172.21.15.89:0/2997591644 learned_addr learned my addr 172.21.15.89:0/2997591644 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e8259c700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 0x7f9e840ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 -- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 msgr2=0x7f9e840ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 0x7f9e840ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 -- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 msgr2=0x7f9e8414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 0x7f9e8414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e81d9b700 1 -- 172.21.15.89:0/2997591644 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780094f0 con 0x7f9e840a6fd0 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e8259c700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 0x7f9e840ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.381+0000 7f9e82d9d700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 0x7f9e8414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:38.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e81d9b700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800ec50 tx=0x7f9e78009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800c850 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800c9b0 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c009a20 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800cd50 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.382+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e84096c80 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.383+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9e78013680 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.383+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8404c710 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.383+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f9e7805b260 con 0x7f9e840a6fd0 2024-02-10T00:04:38.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.386+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f9e780394b0 con 0x7f9e840a6fd0 2024-02-10T00:04:38.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.566+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e8413b1d0 con 0x7f9e840a6fd0 2024-02-10T00:04:38.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.566+0000 7f9e727fc700 1 -- 172.21.15.89:0/2997591644 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3662 (secure 0 0 0) 0x7f9e7803cca0 con 0x7f9e840a6fd0 2024-02-10T00:04:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:38.569 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6817/4184127150","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":4184127150}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/3706839334","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":3706839334}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:02:54.474229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4193":{"gid":4193,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6819/3416328937","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":3416328937}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 >> v1:172.21.15.89:6816/47970 conn(0x7f9e64046040 legacy=0x7f9e640484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 msgr2=0x7f9e84067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800ec50 tx=0x7f9e78009250 comp rx=0 tx=0).stop 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 shutdown_connections 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8413bc00 0x7f9e8414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9e84063e50 0x7f9e840ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 --2- 172.21.15.89:0/2997591644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e840a6fd0 0x7f9e84067a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:38.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 >> 172.21.15.89:0/2997591644 conn(0x7f9e8406c7c0 msgr2=0x7f9e8413c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:38.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 shutdown_connections 2024-02-10T00:04:38.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:38.568+0000 7f9e88bb9700 1 -- 172.21.15.89:0/2997591644 wait complete. 2024-02-10T00:04:38.571 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-02-10T00:04:38.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:02:54.474229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4193}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4193': {'gid': 4193, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6819/3416328937', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 3416328937}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:04:38.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-10T00:04:38.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-10T00:04:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.002+0000 7f2715101700 1 Processor -- start 2024-02-10T00:04:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.002+0000 7f2715101700 1 -- start start 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f271006ce70 0x7f2710141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 0x7f2710142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100a1130 con 0x7f271006ce70 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27100a28c0 con 0x7f271006d260 2024-02-10T00:04:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f2715101700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2710063b10 con 0x7f2710063740 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f271006ce70 0x7f2710141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 0x7f2710142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60308/0 (socket says 172.21.15.89:60308) 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270ed9d700 1 -- 172.21.15.89:0/333311283 learned_addr learned my addr 172.21.15.89:0/333311283 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 -- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 msgr2=0x7f271006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 -- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 msgr2=0x7f2710142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 0x7f2710142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 -- 172.21.15.89:0/333311283 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27101428c0 con 0x7f271006ce70 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270ed9d700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270f59e700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 0x7f2710142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.003+0000 7f270e59c700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006ce70 0x7f2710141e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27000098e0 tx=0x7f27000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bae2b5cc08a94ef server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f270dd9b700 1 -- 172.21.15.89:0/333311283 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700011630 con 0x7f271006ce70 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f270dd9b700 1 -- 172.21.15.89:0/333311283 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700011790 con 0x7f271006ce70 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f270dd9b700 1 -- 172.21.15.89:0/333311283 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700011b30 con 0x7f271006ce70 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 -- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006ce70 msgr2=0x7f2710141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006ce70 0x7f2710141e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27000098e0 tx=0x7f27000091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 -- 172.21.15.89:0/333311283 shutdown_connections 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f271006d260 0x7f2710142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2710063740 0x7f271006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 --2- 172.21.15.89:0/333311283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006ce70 0x7f2710141e40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 -- 172.21.15.89:0/333311283 >> 172.21.15.89:0/333311283 conn(0x7f271006a820 msgr2=0x7f27100b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 -- 172.21.15.89:0/333311283 shutdown_connections 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.004+0000 7f2715101700 1 -- 172.21.15.89:0/333311283 wait complete. 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.005+0000 7f2715101700 1 Processor -- start 2024-02-10T00:04:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.005+0000 7f2715101700 1 -- start start 2024-02-10T00:04:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 0x7f2710151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 0x7f2710151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710097060 con 0x7f271006d260 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2710098380 con 0x7f2710063740 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27100ac010 con 0x7f271006ce70 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55750/0 (socket says 172.21.15.89:55750) 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270e59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 0x7f2710151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 -- 172.21.15.89:0/1249850524 learned_addr learned my addr 172.21.15.89:0/1249850524 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270f59e700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 0x7f2710151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 -- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 msgr2=0x7f2710151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 0x7f2710151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 -- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 msgr2=0x7f2710151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 0x7f2710151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 -- 172.21.15.89:0/1249850524 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040094f0 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270e59c700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 0x7f2710151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270f59e700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 0x7f2710151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f270ed9d700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f270400ec50 tx=0x7f2704009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f26f6ffd700 1 -- 172.21.15.89:0/1249850524 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400c850 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f26f6ffd700 1 -- 172.21.15.89:0/1249850524 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400c9b0 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708009a20 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f26f6ffd700 1 -- 172.21.15.89:0/1249850524 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400cd30 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.006+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700009420 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.007+0000 7f26f6ffd700 1 -- 172.21.15.89:0/1249850524 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2704013680 con 0x7f2710063740 2024-02-10T00:04:39.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.008+0000 7f26f6ffd700 1 -- 172.21.15.89:0/1249850524 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f270405b8a0 con 0x7f2710063740 2024-02-10T00:04:39.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 Processor -- start 2024-02-10T00:04:39.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 -- start start 2024-02-10T00:04:39.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf61d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.010+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4be8c8e0 con 0x560f4bf52ff0 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f4be8a2a0 con 0x560f4bf61900 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x560f4be86090 con 0x560f4bf32660 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270e59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60316/0 (socket says 172.21.15.89:60316) 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 -- 172.21.15.89:0/4179025745 learned_addr learned my addr 172.21.15.89:0/4179025745 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270f59e700 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf61d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 -- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 msgr2=0x560f4bf61d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf61d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 -- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 msgr2=0x560f4bf53440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf53440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 -- 172.21.15.89:0/4179025745 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f4bd02040 con 0x560f4bf32660 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f270ed9d700 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f270403a450 tx=0x7f2704015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670887b725eee75 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f26effff700 1 -- 172.21.15.89:0/4179025745 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270403bb80 con 0x560f4bf32660 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f26effff700 1 -- 172.21.15.89:0/4179025745 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270405a500 con 0x560f4bf32660 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.011+0000 7f26effff700 1 -- 172.21.15.89:0/4179025745 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270405a670 con 0x560f4bf32660 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 msgr2=0x560f4bf62f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f270403a450 tx=0x7f2704015000 comp rx=0 tx=0).stop 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- 172.21.15.89:0/4179025745 shutdown_connections 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf61d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf62f70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 --2- 172.21.15.89:0/4179025745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf53440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- 172.21.15.89:0/4179025745 >> 172.21.15.89:0/4179025745 conn(0x560f4bf56370 msgr2=0x560f4bf36c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- 172.21.15.89:0/4179025745 shutdown_connections 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- 172.21.15.89:0/4179025745 wait complete. 2024-02-10T00:04:39.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.012+0000 7f271e417b80 1 -- start start 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 Processor -- start 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf51f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4be30d70 con 0x560f4bf52ff0 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f4be30a10 con 0x560f4bf61900 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x560f4bd7e290 con 0x560f4bf32660 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f271e417b80 10 client.0 _ll_register_callbacks cb 0x560f4be32e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f270f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60332/0 (socket says 172.21.15.89:60332) 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f270ed9d700 1 -- 172.21.15.89:0/3239718940 learned_addr learned my addr 172.21.15.89:0/3239718940 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.013+0000 7f270e59c700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf51f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 -- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 msgr2=0x560f4bf51a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 -- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 msgr2=0x560f4bf51f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf51f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 -- 172.21.15.89:0/3239718940 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700009420 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270ed9d700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270e59c700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf51f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f270f59e700 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf524d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2708014670 tx=0x7f270800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad616ea9f9cdba2d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.89:3301/0 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080166e0 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mon.1 v2:172.21.15.89:3301/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f270801a070 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f4bf2a050 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2708016a50 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 10 client.14380 fetch_fsmap learned FSMap version 15 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=3+}) v3 -- 0x560f4bcc4230 con 0x560f4bf61900 2024-02-10T00:04:39.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mon.1 v2:172.21.15.89:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f4bf2a050 con 0x560f4bf61900 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mon.1 v2:172.21.15.89:3301/0 5 ==== fsmap(e 15) v1 ==== 2458+0+0 (secure 0 0 0) 0x7f2708025020 con 0x560f4bf61900 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 10 client.14380 fetch_fsmap finished waiting for FSMap version 15 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 10 client.14380 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 20 client.14380 populate_metadata read hostname 'smithi089' 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 4 client.14380 mds_command: new command op to 4193 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.014+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f4be28690 con 0x560f4bf676a0 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f26ed7fa700 10 client.14380 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3239718940 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x560f4be28690 con 0x560f4bf676a0 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f26ed7fa700 10 client.14380 handle_command_reply: tid=0 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f271e417b80 1 client.14380 shutdown 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 msgr2=0x560f4bf524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f271e417b80 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf524d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2708014670 tx=0x7f270800b040 comp rx=0 tx=0).stop 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 shutdown_connections 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.015+0000 7f271e417b80 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf61900 0x560f4bf524d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f26ed7fa700 0 client.14380 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf51a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 1 --2- 172.21.15.89:0/3239718940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf52ff0 0x560f4bf51f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 >> 172.21.15.89:0/3239718940 conn(0x560f4bf56370 msgr2=0x560f4bf62e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 shutdown_connections 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 1 -- 172.21.15.89:0/3239718940 wait complete. 2024-02-10T00:04:39.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.016+0000 7f271e417b80 20 client.14380 trim_cache size 0 max 16384 2024-02-10T00:04:39.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.032+0000 7f271e417b80 1 Processor -- start 2024-02-10T00:04:39.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.032+0000 7f271e417b80 1 -- start start 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf2ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf36a80 con 0x560f4bf61900 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf539d0 con 0x560f4bf52ff0 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf695b0 con 0x560f4bf32660 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60338/0 (socket says 172.21.15.89:60338) 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf2ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 -- 172.21.15.89:0/3033938398 learned_addr learned my addr 172.21.15.89:0/3033938398 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270e59c700 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 -- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 msgr2=0x560f4bf61110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf61110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 -- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 msgr2=0x560f4bf2ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf2ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 -- 172.21.15.89:0/3033938398 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f4be53970 con 0x560f4bf32660 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270f59e700 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf2ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f270ed9d700 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f270403d910 tx=0x7f270403f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929654264c866889 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f26f4ff9700 1 -- 172.21.15.89:0/3033938398 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400ce90 con 0x560f4bf32660 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.033+0000 7f26f4ff9700 1 -- 172.21.15.89:0/3033938398 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704037dd0 con 0x560f4bf32660 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f26f4ff9700 1 -- 172.21.15.89:0/3033938398 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704039d20 con 0x560f4bf32660 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 -- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 msgr2=0x560f4bf2b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f270403d910 tx=0x7f270403f040 comp rx=0 tx=0).stop 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 -- 172.21.15.89:0/3033938398 shutdown_connections 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf2ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf2b2c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 --2- 172.21.15.89:0/3033938398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf61110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 -- 172.21.15.89:0/3033938398 >> 172.21.15.89:0/3033938398 conn(0x560f4bf56370 msgr2=0x560f4bf56740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 -- 172.21.15.89:0/3033938398 shutdown_connections 2024-02-10T00:04:39.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.034+0000 7f271e417b80 1 -- 172.21.15.89:0/3033938398 wait complete. 2024-02-10T00:04:39.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 -- start start 2024-02-10T00:04:39.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 Processor -- start 2024-02-10T00:04:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf51980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf51ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf9c350 con 0x560f4bf61900 2024-02-10T00:04:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf5d240 con 0x560f4bf52ff0 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x560f4bf35590 con 0x560f4bf32660 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f271e417b80 10 client.0 _ll_register_callbacks cb 0x560f4be32e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f270ed9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60346/0 (socket says 172.21.15.89:60346) 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f270f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf51ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f270ed9d700 1 -- 172.21.15.89:0/3020635733 learned_addr learned my addr 172.21.15.89:0/3020635733 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.035+0000 7f270e59c700 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf51980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 -- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 msgr2=0x560f4bf5c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 -- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 msgr2=0x560f4bf51980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf51980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 -- 172.21.15.89:0/3020635733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f4bcc4230 con 0x560f4bf61900 2024-02-10T00:04:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270ed9d700 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f270f59e700 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf51ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2708014640 tx=0x7f2708020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f02ef1cf7365d70 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708014d10 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2708014380 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f4be283b0 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f270801e840 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 10 client.14466 fetch_fsmap learned FSMap version 15 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=3+}) v3 -- 0x560f4bd02040 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f4be283b0 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 15) v1 ==== 2458+0+0 (secure 0 0 0) 0x7f270802e020 con 0x560f4bf61900 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 10 client.14466 fetch_fsmap finished waiting for FSMap version 15 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 10 client.14466 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 20 client.14466 populate_metadata read hostname 'smithi089' 2024-02-10T00:04:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 4 client.14466 mds_command: new command op to 4193 tid=0[{"prefix": "status"}] 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.036+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 --> v1:172.21.15.89:6819/3416328937 -- command(tid 0: {"prefix": "status"}) v1 -- 0x560f4bce7100 con 0x560f4bfc15e0 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f26ed7fa700 10 client.14466 ms_handle_connect on v1:172.21.15.89:6819/3416328937 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f26ed7fa700 1 -- 172.21.15.89:0/3020635733 <== mds.0 v1:172.21.15.89:6819/3416328937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 2026037322) 0x560f4bce7100 con 0x560f4bfc15e0 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f26ed7fa700 10 client.14466 handle_command_reply: tid=0 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 client.14466 shutdown 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 msgr2=0x560f4bf51ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf51ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2708014640 tx=0x7f2708020000 comp rx=0 tx=0).stop 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 shutdown_connections 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f4bf61900 0x560f4bf51ec0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x560f4bf32660 0x560f4bf5c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 --2- 172.21.15.89:0/3020635733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f4bf52ff0 0x560f4bf51980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f26ed7fa700 0 client.14466 ms_handle_reset on v1:172.21.15.89:6819/3416328937 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 >> 172.21.15.89:0/3020635733 conn(0x560f4bf56370 msgr2=0x560f4bf2b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 shutdown_connections 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 1 -- 172.21.15.89:0/3020635733 wait complete. 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.037+0000 7f271e417b80 20 client.14466 trim_cache size 0 max 16384 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4193, 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 371.73111068399999, 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 14, 2024-02-10T00:04:39.046 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 22, 2024-02-10T00:04:39.047 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 19, 2024-02-10T00:04:39.047 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 380.27735385599999 2024-02-10T00:04:39.047 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:04:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 >> v1:172.21.15.89:6816/47970 conn(0x7f26fc046040 legacy=0x7f26fc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 msgr2=0x7f27100979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f270400ec50 tx=0x7f2704009250 comp rx=0 tx=0).stop 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 shutdown_connections 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f271006d260 0x7f2710151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2710063740 0x7f27100979b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 --2- 172.21.15.89:0/1249850524 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f271006ce70 0x7f2710151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 >> 172.21.15.89:0/1249850524 conn(0x7f271006a820 msgr2=0x7f2710141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 shutdown_connections 2024-02-10T00:04:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.038+0000 7f2715101700 1 -- 172.21.15.89:0/1249850524 wait complete. 2024-02-10T00:04:39.051 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-02-10T00:04:39.193 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-10T00:04:39.193 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:39.226 INFO:tasks.ceph.osd.0:Stopped 2024-02-10T00:04:39.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 Processor -- start 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 -- start start 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48cc0a3d40 0x7f48cc13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0a6aa0 con 0x7f48cc0a4130 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0a1a60 con 0x7f48cc0a3d40 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d2458700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0a1d00 con 0x7f48cc0b55b0 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48cb7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48cc0a3d40 0x7f48cc13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d09f5700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f48cc0a4130 0x7f48cc0a5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33078/0 (socket says 172.21.15.89:33078) 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.381+0000 7f48d09f5700 1 -- 172.21.15.89:0/1536047781 learned_addr learned my addr 172.21.15.89:0/1536047781 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:39.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cb7fe700 1 -- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 msgr2=0x7f48cc0a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cb7fe700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cb7fe700 1 -- 172.21.15.89:0/1536047781 >> v1:172.21.15.89:6789/0 conn(0x7f48cc0a4130 legacy=0x7f48cc0a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cb7fe700 1 -- 172.21.15.89:0/1536047781 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0a2450 con 0x7f48cc0a3d40 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cbfff700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48cb7fe700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc13dad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c45a69970636595 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48caffd700 1 -- 172.21.15.89:0/1536047781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400b640 con 0x7f48cc0a3d40 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48caffd700 1 -- 172.21.15.89:0/1536047781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400b7a0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48caffd700 1 -- 172.21.15.89:0/1536047781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bb40 con 0x7f48cc0a3d40 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 -- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 msgr2=0x7f48cc13dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc13dad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 -- 172.21.15.89:0/1536047781 shutdown_connections 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 --2- 172.21.15.89:0/1536047781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc13dad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.382+0000 7f48d2458700 1 -- 172.21.15.89:0/1536047781 >> 172.21.15.89:0/1536047781 conn(0x7f48cc064050 msgr2=0x7f48cc0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:39.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.383+0000 7f48d2458700 1 -- 172.21.15.89:0/1536047781 shutdown_connections 2024-02-10T00:04:39.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.383+0000 7f48d2458700 1 -- 172.21.15.89:0/1536047781 wait complete. 2024-02-10T00:04:39.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.383+0000 7f48d2458700 1 Processor -- start 2024-02-10T00:04:39.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 -- start start 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 0x7f48cc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1521e0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1524a0 con 0x7f48cc0a4130 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d2458700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc141e60 con 0x7f48cc0b55b0 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48cb7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 0x7f48cc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48d09f5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57808/0 (socket says 172.21.15.89:57808) 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.384+0000 7f48cbfff700 1 -- 172.21.15.89:0/1533014528 learned_addr learned my addr 172.21.15.89:0/1533014528 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 -- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 msgr2=0x7f48cc0a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 -- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 msgr2=0x7f48cc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 0x7f48cc151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 -- 172.21.15.89:0/1533014528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0093c0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cb7fe700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 0x7f48cc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48d09f5700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48cbfff700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00ec80 tx=0x7f48bc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc005a00 con 0x7f48cc0a3d40 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc005b60 con 0x7f48cc0a3d40 2024-02-10T00:04:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4009420 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00c8e0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.385+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc151d50 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.386+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc151fa0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.386+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f48bc00cc50 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.386+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f48bc05b620 con 0x7f48cc0a3d40 2024-02-10T00:04:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.390+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f48cc151fa0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:39.555+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f48cc151fa0 con 0x7f48cc0a3d40 2024-02-10T00:04:39.558 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-02-10T00:04:39.556+0000 7f945cd46700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2024-02-10T00:04:40.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.187+0000 7f48c3fff700 1 -- 172.21.15.89:0/1533014528 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f48cc151fa0 con 0x7f48cc0a3d40 2024-02-10T00:04:40.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.192+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 >> v1:172.21.15.89:6816/47970 conn(0x7f48ac046040 legacy=0x7f48ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 msgr2=0x7f48cc141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00ec80 tx=0x7f48bc009120 comp rx=0 tx=0).stop 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 shutdown_connections 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f48cc0b55b0 0x7f48cc0a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48cc0a3d40 0x7f48cc141920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 --2- 172.21.15.89:0/1533014528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48cc0a4130 0x7f48cc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 >> 172.21.15.89:0/1533014528 conn(0x7f48cc064050 msgr2=0x7f48cc1398d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.193+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 shutdown_connections 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.194+0000 7f48d2458700 1 -- 172.21.15.89:0/1533014528 wait complete. 2024-02-10T00:04:40.206 INFO:teuthology.orchestra.run.smithi089.stderr:marked down osd.0. 2024-02-10T00:04:40.210 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-10T00:04:40.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-10T00:04:40.212 INFO:tasks.ceph.osd.0:Started 2024-02-10T00:04:40.212 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-10T00:04:40.213 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:40.254 INFO:tasks.ceph.osd.1:Stopped 2024-02-10T00:04:40.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2024-02-10T00:04:40.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.373+0000 7fb860da9700 1 Processor -- start 2024-02-10T00:04:40.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.373+0000 7fb860da9700 1 -- start start 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb860da9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 0x7fb85c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb860da9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 0x7fb85c141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb860da9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0a28c0 con 0x7fb85c06d260 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb860da9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0a1130 con 0x7fb85c06ce70 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb860da9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c063b10 con 0x7fb85c063740 2024-02-10T00:04:40.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 0x7fb85c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 0x7fb85c141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb85ad9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb85c06d260 0x7fb85c142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33092/0 (socket says 172.21.15.89:33092) 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb85ad9d700 1 -- 172.21.15.89:0/2241412262 learned_addr learned my addr 172.21.15.89:0/2241412262 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 -- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 msgr2=0x7fb85c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 0x7fb85c06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 -- 172.21.15.89:0/2241412262 >> v1:172.21.15.89:6789/0 conn(0x7fb85c06d260 legacy=0x7fb85c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 -- 172.21.15.89:0/2241412262 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c141ba0 con 0x7fb85c06ce70 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb85a59c700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 0x7fb85c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.374+0000 7fb859d9b700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 0x7fb85c141e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009910 tx=0x7fb84c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=141ac8bf84785c21 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb85959a700 1 -- 172.21.15.89:0/2241412262 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00b680 con 0x7fb85c06ce70 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb85959a700 1 -- 172.21.15.89:0/2241412262 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00b7e0 con 0x7fb85c06ce70 2024-02-10T00:04:40.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb85959a700 1 -- 172.21.15.89:0/2241412262 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00bba0 con 0x7fb85c06ce70 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 -- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 msgr2=0x7fb85c141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 0x7fb85c141e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009910 tx=0x7fb84c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 -- 172.21.15.89:0/2241412262 shutdown_connections 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c063740 0x7fb85c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 --2- 172.21.15.89:0/2241412262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06ce70 0x7fb85c141e40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 -- 172.21.15.89:0/2241412262 >> 172.21.15.89:0/2241412262 conn(0x7fb85c06a820 msgr2=0x7fb85c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 -- 172.21.15.89:0/2241412262 shutdown_connections 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.375+0000 7fb860da9700 1 -- 172.21.15.89:0/2241412262 wait complete. 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.376+0000 7fb860da9700 1 Processor -- start 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.376+0000 7fb860da9700 1 -- start start 2024-02-10T00:04:40.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 0x7fb85c098be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06d260 0x7fb85c0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c099120 con 0x7fb85c063740 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0ac570 con 0x7fb85c06d260 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0ac830 con 0x7fb85c06ce70 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 0x7fb85c098be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06d260 0x7fb85c0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60396/0 (socket says 172.21.15.89:60396) 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 -- 172.21.15.89:0/1861387940 learned_addr learned my addr 172.21.15.89:0/1861387940 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 -- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06d260 msgr2=0x7fb85c0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06d260 0x7fb85c0ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 -- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 msgr2=0x7fb85c098be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 0x7fb85c098be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 -- 172.21.15.89:0/1861387940 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850009420 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb85a59c700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 0x7fb85c098be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb859d9b700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb84c013000 tx=0x7fb84c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00bb60 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c000c90 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c01a660 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c009420 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.377+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c096a70 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.378+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c04c710 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.378+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fb84c01aa50 con 0x7fb85c06ce70 2024-02-10T00:04:40.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.378+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fb84c05cc40 con 0x7fb85c06ce70 2024-02-10T00:04:40.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.382+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fb84c006fe0 con 0x7fb85c06ce70 2024-02-10T00:04:40.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:40.550+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fb85c06d9e0 con 0x7fb85c06ce70 2024-02-10T00:04:40.552 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-02-10T00:04:40.550+0000 7f945cd46700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2024-02-10T00:04:40.805 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:40.803+0000 7fd5e0b30540 -1 Falling back to public interface 2024-02-10T00:04:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.190+0000 7fb84a7fc700 1 -- 172.21.15.89:0/1861387940 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7fb84c015030 con 0x7fb85c06ce70 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 >> v1:172.21.15.89:6816/47970 conn(0x7fb83c046040 legacy=0x7fb83c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 msgr2=0x7fb85c0acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb84c013000 tx=0x7fb84c017000 comp rx=0 tx=0).stop 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 shutdown_connections 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb85c06d260 0x7fb85c0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c063740 0x7fb85c098be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 --2- 172.21.15.89:0/1861387940 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb85c06ce70 0x7fb85c0acc80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 >> 172.21.15.89:0/1861387940 conn(0x7fb85c06a820 msgr2=0x7fb85c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:41.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 shutdown_connections 2024-02-10T00:04:41.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.196+0000 7fb860da9700 1 -- 172.21.15.89:0/1861387940 wait complete. 2024-02-10T00:04:41.201 INFO:teuthology.orchestra.run.smithi089.stderr:marked down osd.1. 2024-02-10T00:04:41.220 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-10T00:04:41.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-10T00:04:41.225 INFO:tasks.ceph.osd.1:Started 2024-02-10T00:04:41.225 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-10T00:04:41.225 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:41.273 INFO:tasks.ceph.osd.2:Stopped 2024-02-10T00:04:41.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2024-02-10T00:04:41.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.388+0000 7f2eb73ae700 1 Processor -- start 2024-02-10T00:04:41.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.388+0000 7f2eb73ae700 1 -- start start 2024-02-10T00:04:41.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 0x7f2eb013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 0x7f2eb00a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb006dbb0 con 0x7f2eb0063740 2024-02-10T00:04:41.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b1a10 con 0x7f2eb006f7c0 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb73ae700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb013f4e0 con 0x7f2eb013f060 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.389+0000 7f2eb514a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb594b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 0x7f2eb00a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 0x7f2eb013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb594b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 0x7f2eb00a26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60418/0 (socket says 172.21.15.89:60418) 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb514a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57830/0 (socket says 172.21.15.89:57830) 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb594b700 1 -- 172.21.15.89:0/2776829425 learned_addr learned my addr 172.21.15.89:0/2776829425 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 -- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 msgr2=0x7f2eb00a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 --2- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 0x7f2eb00a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 -- 172.21.15.89:0/2776829425 >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 msgr2=0x7f2eb006dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 --2- 172.21.15.89:0/2776829425 >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 -- 172.21.15.89:0/2776829425 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0063b10 con 0x7f2eb006f7c0 2024-02-10T00:04:41.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb514a700 1 --2- 172.21.15.89:0/2776829425 >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2eb4949700 1 --2- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 0x7f2eb013eb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101c57eea930c89e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2ea7fff700 1 -- 172.21.15.89:0/2776829425 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac011630 con 0x7f2eb006f7c0 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2ea7fff700 1 -- 172.21.15.89:0/2776829425 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac011790 con 0x7f2eb006f7c0 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.390+0000 7f2ea7fff700 1 -- 172.21.15.89:0/2776829425 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac011b30 con 0x7f2eb006f7c0 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 msgr2=0x7f2eb013eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 0x7f2eb013eb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2776829425 shutdown_connections 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb013f060 0x7f2eb00a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2776829425 >> v2:172.21.15.89:3300/0 conn(0x7f2eb0063740 0x7f2eb006dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2776829425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb006f7c0 0x7f2eb013eb20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2776829425 >> 172.21.15.89:0/2776829425 conn(0x7f2eb006a820 msgr2=0x7f2eb00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2776829425 shutdown_connections 2024-02-10T00:04:41.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.391+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2776829425 wait complete. 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.392+0000 7f2eb73ae700 1 Processor -- start 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.392+0000 7f2eb73ae700 1 -- start start 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 0x7f2eb013a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00998c0 con 0x7f2eb006f7c0 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00989c0 con 0x7f2eb013f060 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb73ae700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb014eb90 con 0x7f2eb0063740 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb4949700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb594b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 0x7f2eb013a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60428/0 (socket says 172.21.15.89:60428) 2024-02-10T00:04:41.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb4949700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57842/0 (socket says 172.21.15.89:57842) 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 -- 172.21.15.89:0/2198366181 learned_addr learned my addr 172.21.15.89:0/2198366181 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 -- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 msgr2=0x7f2eb013a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 0x7f2eb013a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 -- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 msgr2=0x7f2eb0139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 -- 172.21.15.89:0/2198366181 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009420 con 0x7f2eb0063740 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb594b700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 0x7f2eb013a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb4949700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.393+0000 7f2eb514a700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000ec80 tx=0x7f2ea00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.394+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000d930 con 0x7f2eb0063740 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.394+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000da90 con 0x7f2eb0063740 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.394+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac009420 con 0x7f2eb0063740 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.394+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000de10 con 0x7f2eb0063740 2024-02-10T00:04:41.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.394+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb014e850 con 0x7f2eb0063740 2024-02-10T00:04:41.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.395+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb004c710 con 0x7f2eb0063740 2024-02-10T00:04:41.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.395+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2ea0010650 con 0x7f2eb0063740 2024-02-10T00:04:41.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.395+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2ea0014070 con 0x7f2eb0063740 2024-02-10T00:04:41.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.399+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f2ea0039820 con 0x7f2eb0063740 2024-02-10T00:04:41.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:41.565+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f2eb00a0d20 con 0x7f2eb0063740 2024-02-10T00:04:41.568 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-02-10T00:04:41.566+0000 7f945cd46700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2024-02-10T00:04:41.809 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:41.807+0000 7fae809c5540 -1 Falling back to public interface 2024-02-10T00:04:42.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.192+0000 7f2ea57fa700 1 -- 172.21.15.89:0/2198366181 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f2ea003d010 con 0x7f2eb0063740 2024-02-10T00:04:42.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 >> v1:172.21.15.89:6816/47970 conn(0x7f2e94046070 legacy=0x7f2e94048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:42.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 msgr2=0x7f2eb014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000ec80 tx=0x7f2ea00091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 shutdown_connections 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eb013f060 0x7f2eb013a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2eb0063740 0x7f2eb014e310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 --2- 172.21.15.89:0/2198366181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb006f7c0 0x7f2eb0139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 >> 172.21.15.89:0/2198366181 conn(0x7f2eb006a820 msgr2=0x7f2eb00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 shutdown_connections 2024-02-10T00:04:42.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.196+0000 7f2eb73ae700 1 -- 172.21.15.89:0/2198366181 wait complete. 2024-02-10T00:04:42.203 INFO:teuthology.orchestra.run.smithi089.stderr:marked down osd.2. 2024-02-10T00:04:42.222 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-10T00:04:42.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-10T00:04:42.224 INFO:tasks.ceph.osd.2:Started 2024-02-10T00:04:42.224 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-10T00:04:42.224 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:42.270 INFO:tasks.ceph.osd.3:Stopped 2024-02-10T00:04:42.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2024-02-10T00:04:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.386+0000 7fc7301f9700 1 Processor -- start 2024-02-10T00:04:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 -- start start 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72806e2d0 con 0x7fc72806f630 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280b1c80 con 0x7fc7280b18b0 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.387+0000 7fc7301f9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc72806eb50 con 0x7fc72813a390 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72d794700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72df95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:60446/0 (socket says 172.21.15.89:60446) 2024-02-10T00:04:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72d794700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57852/0 (socket says 172.21.15.89:57852) 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 -- 172.21.15.89:0/2215956154 learned_addr learned my addr 172.21.15.89:0/2215956154 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72df95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55868/0 (socket says 172.21.15.89:55868) 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 -- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 msgr2=0x7fc72806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 -- 172.21.15.89:0/2215956154 >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 msgr2=0x7fc728139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 --2- 172.21.15.89:0/2215956154 >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 -- 172.21.15.89:0/2215956154 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72806edd0 con 0x7fc72813a390 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72d794700 1 --2- 172.21.15.89:0/2215956154 >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72df95700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72e796700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f20 tx=0x7fc720009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ad43788b9ce7c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72cf93700 1 -- 172.21.15.89:0/2215956154 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000e070 con 0x7fc72813a390 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72cf93700 1 -- 172.21.15.89:0/2215956154 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b970 con 0x7fc72813a390 2024-02-10T00:04:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.388+0000 7fc72cf93700 1 -- 172.21.15.89:0/2215956154 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200092e0 con 0x7fc72813a390 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 -- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 msgr2=0x7fc7280a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f20 tx=0x7fc720009840 comp rx=0 tx=0).stop 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 -- 172.21.15.89:0/2215956154 shutdown_connections 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc72813a390 0x7fc7280a1590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2215956154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7280b18b0 0x7fc72806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2215956154 >> v2:172.21.15.89:3300/0 conn(0x7fc72806f630 0x7fc728139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 -- 172.21.15.89:0/2215956154 >> 172.21.15.89:0/2215956154 conn(0x7fc72806a820 msgr2=0x7fc7280b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 -- 172.21.15.89:0/2215956154 shutdown_connections 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.389+0000 7fc7301f9700 1 -- 172.21.15.89:0/2215956154 wait complete. 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 Processor -- start 2024-02-10T00:04:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 -- start start 2024-02-10T00:04:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7280b18b0 0x7fc728151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72813a390 0x7fc7281519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a5aa0 con 0x7fc72806f630 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a5800 con 0x7fc72813a390 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc7301f9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a54f0 con 0x7fc7280b18b0 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc72df95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc72df95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57862/0 (socket says 172.21.15.89:57862) 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.390+0000 7fc72df95700 1 -- 172.21.15.89:0/2850872471 learned_addr learned my addr 172.21.15.89:0/2850872471 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72d794700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7280b18b0 0x7fc728151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72e796700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72813a390 0x7fc7281519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 -- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7280b18b0 msgr2=0x7fc728151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7280b18b0 0x7fc728151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 -- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72813a390 msgr2=0x7fc7281519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72813a390 0x7fc7281519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 -- 172.21.15.89:0/2850872471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009420 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc72df95700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc71800eaf0 tx=0x7fc71800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800c950 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71800cab0 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71800a5d0 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800ce50 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.391+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc720009ae0 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.392+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc7180113f0 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.392+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7280aed30 con 0x7fc72806f630 2024-02-10T00:04:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.392+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc718015030 con 0x7fc72806f630 2024-02-10T00:04:42.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.396+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fc7280aed30 con 0x7fc72806f630 2024-02-10T00:04:42.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:42.558+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fc7280aed30 con 0x7fc72806f630 2024-02-10T00:04:42.561 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-02-10T00:04:42.559+0000 7f945cd46700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2024-02-10T00:04:42.813 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:42.811+0000 7f1ed40a3540 -1 Falling back to public interface 2024-02-10T00:04:43.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.195+0000 7fc71dffb700 1 -- 172.21.15.89:0/2850872471 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc7280aed30 con 0x7fc72806f630 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 >> v1:172.21.15.89:6816/47970 conn(0x7fc70c046070 legacy=0x7fc70c048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 msgr2=0x7fc7280a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc71800eaf0 tx=0x7fc71800a330 comp rx=0 tx=0).stop 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 shutdown_connections 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72813a390 0x7fc7281519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72806f630 0x7fc7280a4fb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 --2- 172.21.15.89:0/2850872471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7280b18b0 0x7fc728151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.198+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 >> 172.21.15.89:0/2850872471 conn(0x7fc72806a820 msgr2=0x7fc728063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:43.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.199+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 shutdown_connections 2024-02-10T00:04:43.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.199+0000 7fc7301f9700 1 -- 172.21.15.89:0/2850872471 wait complete. 2024-02-10T00:04:43.202 INFO:teuthology.orchestra.run.smithi089.stderr:marked down osd.3. 2024-02-10T00:04:43.213 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-10T00:04:43.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-10T00:04:43.216 INFO:tasks.ceph.osd.3:Started 2024-02-10T00:04:43.216 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-10T00:04:43.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:43.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 Processor -- start 2024-02-10T00:04:43.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 -- start start 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 0x7f38301458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38300a62d0 con 0x7f38300a5660 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3830064220 con 0x7f3830063e50 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3837ce1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38300a67f0 con 0x7f38300a5a70 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f3835a7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:43.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.336+0000 7f383627e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 0x7f38301458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f383527c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f38300a5660 0x7f383013b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33114/0 (socket says 172.21.15.89:33114) 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55892/0 (socket says 172.21.15.89:55892) 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f383527c700 1 -- 172.21.15.89:0/3228977266 learned_addr learned my addr 172.21.15.89:0/3228977266 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 -- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 msgr2=0x7f38301458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 0x7f38301458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 -- 172.21.15.89:0/3228977266 >> v1:172.21.15.89:6789/0 conn(0x7f38300a5660 legacy=0x7f383013b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3834a7b700 1 -- 172.21.15.89:0/3228977266 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937239379 0 0) 0x7f38300a62d0 con 0x7f38300a5660 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 -- 172.21.15.89:0/3228977266 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300a7510 con 0x7f3830063e50 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f383627e700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 0x7f38301458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3835a7d700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f382c009910 tx=0x7f382c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21023d743018c4b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3834a7b700 1 -- 172.21.15.89:0/3228977266 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c00b680 con 0x7f3830063e50 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3834a7b700 1 -- 172.21.15.89:0/3228977266 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c00b7e0 con 0x7f3830063e50 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.337+0000 7f3834a7b700 1 -- 172.21.15.89:0/3228977266 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c00bba0 con 0x7f3830063e50 2024-02-10T00:04:43.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 -- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 msgr2=0x7f38300a6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f382c009910 tx=0x7f382c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 -- 172.21.15.89:0/3228977266 shutdown_connections 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3830063e50 0x7f38300a6fd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 --2- 172.21.15.89:0/3228977266 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f38300a5a70 0x7f38301458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 -- 172.21.15.89:0/3228977266 >> 172.21.15.89:0/3228977266 conn(0x7f383006c7c0 msgr2=0x7f3830063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 -- 172.21.15.89:0/3228977266 shutdown_connections 2024-02-10T00:04:43.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.338+0000 7f3837ce1700 1 -- 172.21.15.89:0/3228977266 wait complete. 2024-02-10T00:04:43.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 Processor -- start 2024-02-10T00:04:43.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 -- start start 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 0x7f38300b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 0x7f38300ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300ae5d0 con 0x7f38300a5660 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300ae890 con 0x7f38300a5a70 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3837ce1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38301495d0 con 0x7f3830063e50 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f383627e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f383527c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 0x7f38300ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f3835a7d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 0x7f38300b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f383627e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55896/0 (socket says 172.21.15.89:55896) 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.339+0000 7f383627e700 1 -- 172.21.15.89:0/364109170 learned_addr learned my addr 172.21.15.89:0/364109170 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 -- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 msgr2=0x7f38300b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 0x7f38300b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 -- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 msgr2=0x7f383013a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 -- 172.21.15.89:0/364109170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828009a20 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383627e700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3835a7d700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 0x7f38300b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f383527c700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 0x7f38300ac860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f383006a4c0 tx=0x7f3820007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000ce20 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820005b30 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c009420 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200070d0 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.340+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38300ae370 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.341+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3820007500 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.341+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383004c710 con 0x7f38300a5660 2024-02-10T00:04:43.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.341+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f382005a4b0 con 0x7f38300a5660 2024-02-10T00:04:43.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.345+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3820038700 con 0x7f38300a5660 2024-02-10T00:04:43.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.513+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38300a79c0 con 0x7f38300a5660 2024-02-10T00:04:43.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.514+0000 7f3825ffb700 1 -- 172.21.15.89:0/364109170 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11539 (secure 0 0 0) 0x7f3820017070 con 0x7f38300a5660 2024-02-10T00:04:43.516 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:43.516 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:43.188668+0000","last_up_change":"2024-02-10T00:04:43.188668+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:43.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 >> v1:172.21.15.89:6816/47970 conn(0x7f3814046040 legacy=0x7f38140484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 msgr2=0x7f38300ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:43.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 0x7f38300ac860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f383006a4c0 tx=0x7f3820007f30 comp rx=0 tx=0).stop 2024-02-10T00:04:43.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 shutdown_connections 2024-02-10T00:04:43.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38300a5a70 0x7f383013a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3830063e50 0x7f38300b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 --2- 172.21.15.89:0/364109170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38300a5660 0x7f38300ac860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 >> 172.21.15.89:0/364109170 conn(0x7f383006c7c0 msgr2=0x7f3830067970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 shutdown_connections 2024-02-10T00:04:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:43.517+0000 7f3837ce1700 1 -- 172.21.15.89:0/364109170 wait complete. 2024-02-10T00:04:43.802 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:43.799+0000 7fb3ad0e3540 -1 Falling back to public interface 2024-02-10T00:04:44.479 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.477+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2024-02-10T00:04:44.481 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.479+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.481 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.479+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.482 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.480+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.482 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.480+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.482 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.480+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.482 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.480+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.485 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.483+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.485 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.483+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.486 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.483+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.486 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.484+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.486 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.485+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.487 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.486+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.490 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.488+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.490 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.488+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.491 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.488+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.491 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.488+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.491 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.489+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.492 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.490+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.493 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.491+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:44.494 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:44.492+0000 7fd5e0b30540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.159 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.157+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2024-02-10T00:04:45.161 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.159+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.162 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.160+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.163 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.161+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.163 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.161+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.163 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.161+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.163 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.161+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.164 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.162+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.166 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.164+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.167 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.165+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.169 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.167+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.171 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.169+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.171 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.169+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:45.173 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:45.171+0000 7fae809c5540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.288 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:46.286+0000 7fd5e0b30540 -1 osd.0 22 log_to_monitors true 2024-02-10T00:04:46.302 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.300+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2024-02-10T00:04:46.304 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.302+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.306 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.304+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.308 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.307+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.317 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.316+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.319 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.317+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.321 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.319+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.322 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.321+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.323 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:46.321+0000 7f1ed40a3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:46.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:46.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.658+0000 7f83c66c4700 1 Processor -- start 2024-02-10T00:04:46.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.658+0000 7f83c66c4700 1 -- start start 2024-02-10T00:04:46.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c66c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 0x7f83c00a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:46.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c66c4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c66c4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00a3510 con 0x7f83c00a29e0 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c66c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00a4460 con 0x7f83c00b5220 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c66c4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00a1b70 con 0x7f83c00a2db0 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c4c61700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c4c61700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39342/0 (socket says 172.21.15.89:39342) 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bf7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f83c00a29e0 0x7f83c013e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46616/0 (socket says 172.21.15.89:46616) 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c4c61700 1 -- 172.21.15.89:0/4252079586 learned_addr learned my addr 172.21.15.89:0/4252079586 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 0x7f83c00a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 -- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 msgr2=0x7f83c0148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 -- 172.21.15.89:0/4252079586 >> v1:172.21.15.89:6789/0 conn(0x7f83c00a29e0 legacy=0x7f83c013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83beffd700 1 -- 172.21.15.89:0/4252079586 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045560450 0 0) 0x7f83c00a3510 con 0x7f83c00a29e0 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 -- 172.21.15.89:0/4252079586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00a1e10 con 0x7f83c00b5220 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83c4c61700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.659+0000 7f83bffff700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 0x7f83c00a3f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009910 tx=0x7f83b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=addd1223e23269f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83beffd700 1 -- 172.21.15.89:0/4252079586 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000b680 con 0x7f83c00b5220 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83beffd700 1 -- 172.21.15.89:0/4252079586 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000b7e0 con 0x7f83c00b5220 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83beffd700 1 -- 172.21.15.89:0/4252079586 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000bba0 con 0x7f83c00b5220 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 -- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 msgr2=0x7f83c00a3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 0x7f83c00a3f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009910 tx=0x7f83b00091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 -- 172.21.15.89:0/4252079586 shutdown_connections 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00b5220 0x7f83c00a3f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 --2- 172.21.15.89:0/4252079586 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 -- 172.21.15.89:0/4252079586 >> 172.21.15.89:0/4252079586 conn(0x7f83c0068710 msgr2=0x7f83c0064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:46.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 -- 172.21.15.89:0/4252079586 shutdown_connections 2024-02-10T00:04:46.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.660+0000 7f83c66c4700 1 -- 172.21.15.89:0/4252079586 wait complete. 2024-02-10T00:04:46.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.661+0000 7f83c66c4700 1 Processor -- start 2024-02-10T00:04:46.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 -- start start 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 0x7f83c00ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 0x7f83c0151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00a9b30 con 0x7f83c00b5220 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00accd0 con 0x7f83c00a29e0 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c66c4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00ade50 con 0x7f83c00a2db0 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83bffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 0x7f83c00ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:46.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39348/0 (socket says 172.21.15.89:39348) 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83bf7fe700 1 -- 172.21.15.89:0/1049622032 learned_addr learned my addr 172.21.15.89:0/1049622032 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.662+0000 7f83c4c61700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 0x7f83c0151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 -- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 msgr2=0x7f83c0151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 -- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 msgr2=0x7f83c0151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 0x7f83c0151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 -- 172.21.15.89:0/1049622032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009ae0 con 0x7f83c00a29e0 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bf7fe700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83c4c61700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 0x7f83c0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83bffff700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 0x7f83c00ac790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83b0016000 tx=0x7f83b0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000b950 con 0x7f83c00a29e0 2024-02-10T00:04:46.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000bab0 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b001a680 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0009420 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.663+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c00ae400 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.664+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c004c710 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.664+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f83b001aa30 con 0x7f83c00a29e0 2024-02-10T00:04:46.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.665+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f83b005cce0 con 0x7f83c00a29e0 2024-02-10T00:04:46.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.668+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f83b0005a00 con 0x7f83c00a29e0 2024-02-10T00:04:46.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.865+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c00a7170 con 0x7f83c00a29e0 2024-02-10T00:04:46.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.866+0000 7f83a7fff700 1 -- 172.21.15.89:0/1049622032 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11539 (secure 0 0 0) 0x7f83b0002d70 con 0x7f83c00a29e0 2024-02-10T00:04:46.868 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:46.869 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:43.188668+0000","last_up_change":"2024-02-10T00:04:43.188668+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":39986}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":39986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":39986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":39986}]},"public_addr":"172.21.15.89:6808/39986","cluster_addr":"172.21.15.89:6809/39986","heartbeat_back_addr":"172.21.15.89:6811/39986","heartbeat_front_addr":"172.21.15.89:6810/39986","state":["exists"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":39987}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":39987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":39987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":39987}]},"public_addr":"172.21.15.89:6812/39987","cluster_addr":"172.21.15.89:6813/39987","heartbeat_back_addr":"172.21.15.89:6815/39987","heartbeat_front_addr":"172.21.15.89:6814/39987","state":["exists"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:46.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.869+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 >> v1:172.21.15.89:6816/47970 conn(0x7f83ac046040 legacy=0x7f83ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.869+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 msgr2=0x7f83c00ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.869+0000 7f83c66c4700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 0x7f83c00ac790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83b0016000 tx=0x7f83b0017000 comp rx=0 tx=0).stop 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 shutdown_connections 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c00b5220 0x7f83c0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c00a29e0 0x7f83c00ac790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 --2- 172.21.15.89:0/1049622032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83c00a2db0 0x7f83c0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 >> 172.21.15.89:0/1049622032 conn(0x7f83c0068710 msgr2=0x7f83c00b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 shutdown_connections 2024-02-10T00:04:46.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:46.870+0000 7f83c66c4700 1 -- 172.21.15.89:0/1049622032 wait complete. 2024-02-10T00:04:47.156 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:47.154+0000 7fae809c5540 -1 osd.1 22 log_to_monitors true 2024-02-10T00:04:48.179 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.176+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2024-02-10T00:04:48.181 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.179+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.181 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.179+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.185 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.183+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.188 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.185+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.194 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.189+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.194 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.190+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.194 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.192+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.195 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.193+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.198 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.196+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.202 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.199+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.203 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.201+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.205 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.203+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.206 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.204+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.208 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.206+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.211 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.207+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.211 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.207+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.212 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:48.207+0000 7fb3ad0e3540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-02-10T00:04:48.443 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-02-10T00:04:48.441+0000 7fae703c1700 -1 osd.1 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T00:04:48.609 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:48.607+0000 7f1ed40a3540 -1 osd.2 24 log_to_monitors true 2024-02-10T00:04:48.641 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-02-10T00:04:48.639+0000 7fd5d052c700 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T00:04:49.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:50.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.034+0000 7fd23ee29700 1 Processor -- start 2024-02-10T00:04:50.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.034+0000 7fd23ee29700 1 -- start start 2024-02-10T00:04:50.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.034+0000 7fd23ee29700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd238063e50 0x7fd2380a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.034+0000 7fd23ee29700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a75d0 0x7fd238146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23ee29700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23813f6e0 con 0x7fd2380a9510 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23ee29700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2380a8920 con 0x7fd238063e50 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23ee29700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd238064220 con 0x7fd2380a75d0 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd238063e50 0x7fd2380a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd238063e50 0x7fd2380a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58272/0 (socket says 172.21.15.89:58272) 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 -- 172.21.15.89:0/192704766 learned_addr learned my addr 172.21.15.89:0/192704766 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23d3c6700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a75d0 0x7fd238146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 -- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a75d0 msgr2=0x7fd238146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a75d0 0x7fd238146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 -- 172.21.15.89:0/192704766 >> v1:172.21.15.89:6789/0 conn(0x7fd2380a9510 legacy=0x7fd2380afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 -- 172.21.15.89:0/192704766 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23813f910 con 0x7fd238063e50 2024-02-10T00:04:50.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.035+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd2380a7ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0099b0 tx=0x7fd22c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9826cb23d56431c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:50.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd2377fe700 1 -- 172.21.15.89:0/192704766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c009ea0 con 0x7fd238063e50 2024-02-10T00:04:50.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd2377fe700 1 -- 172.21.15.89:0/192704766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c00b760 con 0x7fd238063e50 2024-02-10T00:04:50.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd2377fe700 1 -- 172.21.15.89:0/192704766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00bb00 con 0x7fd238063e50 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 -- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 msgr2=0x7fd2380a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd2380a7ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0099b0 tx=0x7fd22c009250 comp rx=0 tx=0).stop 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 -- 172.21.15.89:0/192704766 shutdown_connections 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a75d0 0x7fd238146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 --2- 172.21.15.89:0/192704766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd2380a7ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 -- 172.21.15.89:0/192704766 >> 172.21.15.89:0/192704766 conn(0x7fd23806d8c0 msgr2=0x7fd238063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 -- 172.21.15.89:0/192704766 shutdown_connections 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.036+0000 7fd23ee29700 1 -- 172.21.15.89:0/192704766 wait complete. 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.037+0000 7fd23ee29700 1 Processor -- start 2024-02-10T00:04:50.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 -- start start 2024-02-10T00:04:50.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd23812f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 0x7fd2381515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 0x7fd238151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23812e400 con 0x7fd238063e50 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23812d450 con 0x7fd2380a9510 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23ee29700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd23812f970 con 0x7fd2380a75d0 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd237fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 0x7fd2381515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd237fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 0x7fd2381515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:39362/0 (socket says 172.21.15.89:39362) 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd237fff700 1 -- 172.21.15.89:0/576205412 learned_addr learned my addr 172.21.15.89:0/576205412 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23d3c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 0x7fd238151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.038+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd23812f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 -- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 msgr2=0x7fd2381515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 0x7fd2381515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 -- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 msgr2=0x7fd238151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 0x7fd238151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 -- 172.21.15.89:0/576205412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0094f0 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23d3c6700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 0x7fd238151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23cbc5700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd23812f430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd23806d730 tx=0x7fd22c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c01dba0 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c01dd20 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c01a6b0 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23812d6f0 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.039+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23813cdf0 con 0x7fd238063e50 2024-02-10T00:04:50.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.040+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23813cfe0 con 0x7fd238063e50 2024-02-10T00:04:50.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.041+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fd22c026430 con 0x7fd238063e50 2024-02-10T00:04:50.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.041+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fd22c05c4c0 con 0x7fd238063e50 2024-02-10T00:04:50.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.044+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd22c03e560 con 0x7fd238063e50 2024-02-10T00:04:50.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.254+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd23804c710 con 0x7fd238063e50 2024-02-10T00:04:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.255+0000 7fd234ff9700 1 -- 172.21.15.89:0/576205412 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+11553 (secure 0 0 0) 0x7fd22c03e0c0 con 0x7fd238063e50 2024-02-10T00:04:50.257 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:50.257 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":28,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:49.438248+0000","last_up_change":"2024-02-10T00:04:49.438248+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":16,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":39988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":39988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":39988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":39988}]},"public_addr":"172.21.15.89:6800/39988","cluster_addr":"172.21.15.89:6801/39988","heartbeat_back_addr":"172.21.15.89:6803/39988","heartbeat_front_addr":"172.21.15.89:6802/39988","state":["exists"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":39985}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":39985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":39985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":39985}]},"public_addr":"172.21.15.89:6804/39985","cluster_addr":"172.21.15.89:6805/39985","heartbeat_back_addr":"172.21.15.89:6807/39985","heartbeat_front_addr":"172.21.15.89:6806/39985","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.257+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 >> v1:172.21.15.89:6816/47970 conn(0x7fd21c046040 legacy=0x7fd21c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.257+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 msgr2=0x7fd23812f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.257+0000 7fd23ee29700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd23812f430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd23806d730 tx=0x7fd22c016000 comp rx=0 tx=0).stop 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 shutdown_connections 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2380a9510 0x7fd238151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238063e50 0x7fd23812f430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 --2- 172.21.15.89:0/576205412 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd2380a75d0 0x7fd2381515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 >> 172.21.15.89:0/576205412 conn(0x7fd23806d8c0 msgr2=0x7fd238063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 shutdown_connections 2024-02-10T00:04:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:50.258+0000 7fd23ee29700 1 -- 172.21.15.89:0/576205412 wait complete. 2024-02-10T00:04:50.429 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-02-10T00:04:50.427+0000 7f1ec3a9f700 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T00:04:50.909 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:50.907+0000 7fb3ad0e3540 -1 osd.3 25 log_to_monitors true 2024-02-10T00:04:52.328 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-02-10T00:04:52.326+0000 7fb39cadf700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T00:04:53.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:53.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 Processor -- start 2024-02-10T00:04:53.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 -- start start 2024-02-10T00:04:53.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 0x7f1b1406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 0x7f1b14142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b140a28c0 con 0x7f1b1406ce70 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b140a1130 con 0x7f1b1406d260 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.432+0000 7f1b1bbba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14063b10 con 0x7f1b14063740 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 0x7f1b1406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b1a157700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 0x7f1b14142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19155700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1b1406ce70 0x7f1b14141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46656/0 (socket says 172.21.15.89:46656) 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19155700 1 -- 172.21.15.89:0/1867409218 learned_addr learned my addr 172.21.15.89:0/1867409218 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:53.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 -- 172.21.15.89:0/1867409218 >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 msgr2=0x7f1b14142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 --2- 172.21.15.89:0/1867409218 >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 0x7f1b14142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 -- 172.21.15.89:0/1867409218 >> v1:172.21.15.89:6789/0 conn(0x7f1b1406ce70 legacy=0x7f1b14141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 -- 172.21.15.89:0/1867409218 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14141ba0 con 0x7f1b14063740 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b1a157700 1 --2- 172.21.15.89:0/1867409218 >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 0x7f1b14142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b19956700 1 --2- 172.21.15.89:0/1867409218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 0x7f1b1406e1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b100098e0 tx=0x7f1b100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b97d109a9f9f05 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b18954700 1 -- 172.21.15.89:0/1867409218 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000b640 con 0x7f1b14063740 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b18954700 1 -- 172.21.15.89:0/1867409218 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1000b7a0 con 0x7f1b14063740 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.433+0000 7f1b18954700 1 -- 172.21.15.89:0/1867409218 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000bb40 con 0x7f1b14063740 2024-02-10T00:04:53.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 -- 172.21.15.89:0/1867409218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 msgr2=0x7f1b1406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/1867409218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 0x7f1b1406e1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b100098e0 tx=0x7f1b100091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 -- 172.21.15.89:0/1867409218 shutdown_connections 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/1867409218 >> v2:172.21.15.89:3300/0 conn(0x7f1b1406d260 0x7f1b14142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/1867409218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b14063740 0x7f1b1406e1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 -- 172.21.15.89:0/1867409218 >> 172.21.15.89:0/1867409218 conn(0x7f1b1406a820 msgr2=0x7f1b140b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 -- 172.21.15.89:0/1867409218 shutdown_connections 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.434+0000 7f1b1bbba700 1 -- 172.21.15.89:0/1867409218 wait complete. 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 Processor -- start 2024-02-10T00:04:53.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 -- start start 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 0x7f1b1414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b1406ce70 0x7f1b141475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1414e6f0 con 0x7f1b14063740 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141456b0 con 0x7f1b1406d260 2024-02-10T00:04:53.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1bbba700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14144890 con 0x7f1b1406ce70 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1a157700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1a157700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47942/0 (socket says 172.21.15.89:47942) 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b1a157700 1 -- 172.21.15.89:0/2718510691 learned_addr learned my addr 172.21.15.89:0/2718510691 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b19956700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 0x7f1b1414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.435+0000 7f1b19155700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b1406ce70 0x7f1b141475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 -- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b1406ce70 msgr2=0x7f1b141475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b1406ce70 0x7f1b141475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 -- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 msgr2=0x7f1b1414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 0x7f1b1414eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 -- 172.21.15.89:0/2718510691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c009a20 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b19956700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 0x7f1b1414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1a157700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009f50 tx=0x7f1b0c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00cb50 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00f040 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b10009420 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c014480 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.436+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b14147b20 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.437+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1404c710 con 0x7f1b1406d260 2024-02-10T00:04:53.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.437+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1b0c003020 con 0x7f1b1406d260 2024-02-10T00:04:53.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.437+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f1b0c05baf0 con 0x7f1b1406d260 2024-02-10T00:04:53.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.441+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f1b0c039da0 con 0x7f1b1406d260 2024-02-10T00:04:53.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.595+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b1414e870 con 0x7f1b1406d260 2024-02-10T00:04:53.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.595+0000 7f1b09ffb700 1 -- 172.21.15.89:0/2718510691 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+11567 (secure 0 0 0) 0x7f1b1414e870 con 0x7f1b1406d260 2024-02-10T00:04:53.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:53.598 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":31,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:53.328682+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":29,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 >> v1:172.21.15.89:6816/47970 conn(0x7f1af8046040 legacy=0x7f1af80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 msgr2=0x7f1b14145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009f50 tx=0x7f1b0c00b040 comp rx=0 tx=0).stop 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 shutdown_connections 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b1406d260 0x7f1b14145bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b14063740 0x7f1b1414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 --2- 172.21.15.89:0/2718510691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b1406ce70 0x7f1b141475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 >> 172.21.15.89:0/2718510691 conn(0x7f1b1406a820 msgr2=0x7f1b1406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 shutdown_connections 2024-02-10T00:04:53.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:53.597+0000 7f1b1bbba700 1 -- 172.21.15.89:0/2718510691 wait complete. 2024-02-10T00:04:53.612 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-10T00:04:53.612 INFO:teuthology.run_tasks:Running task ceph.stop... 2024-02-10T00:04:53.625 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-10T00:04:53.625 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:53.633 INFO:tasks.ceph.mds.a:Stopped 2024-02-10T00:04:53.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-10T00:04:53.633 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:53.685 INFO:tasks.ceph.mds.b:Stopped 2024-02-10T00:04:53.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-10T00:04:53.685 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:04:53.736 INFO:tasks.ceph.mds.c:Stopped 2024-02-10T00:04:56.452 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2024-02-10T00:04:56.452 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-02-10T00:04:56.469 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-02-10T00:04:56.469 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-10T00:04:56.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-10T00:04:56.473 INFO:tasks.ceph.mds.a:Started 2024-02-10T00:04:56.473 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-02-10T00:04:56.473 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-10T00:04:56.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-10T00:04:56.475 INFO:tasks.ceph.mds.b:Started 2024-02-10T00:04:56.476 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-02-10T00:04:56.476 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-10T00:04:56.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-10T00:04:56.478 INFO:tasks.ceph.mds.c:Started 2024-02-10T00:04:56.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-10T00:04:56.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:04:56.557 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2024-02-10T00:04:56.560 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-02-10T00:04:56.562 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2024-02-10T00:04:56.565 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-02-10T00:04:56.563+0000 7f945cd46700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-10T00:04:56.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.635+0000 7faaf8e44700 1 Processor -- start 2024-02-10T00:04:56.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.635+0000 7faaf8e44700 1 -- start start 2024-02-10T00:04:56.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 0x7faaf4146160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf406d920 con 0x7faaf4145cc0 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf409f520 con 0x7faaf409ff70 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf8e44700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf406fe80 con 0x7faaf406f7a0 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 0x7faaf4146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47984/0 (socket says 172.21.15.89:47984) 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 -- 172.21.15.89:0/1477155217 learned_addr learned my addr 172.21.15.89:0/1477155217 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf1d9b700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 -- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 msgr2=0x7faaf40a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:56.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 -- 172.21.15.89:0/1477155217 >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 msgr2=0x7faaf4146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 --2- 172.21.15.89:0/1477155217 >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 0x7faaf4146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 -- 172.21.15.89:0/1477155217 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf406e120 con 0x7faaf409ff70 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf2d9d700 1 --2- 172.21.15.89:0/1477155217 >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 0x7faaf4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.636+0000 7faaf259c700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faae40099e0 tx=0x7faae4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213a0dcd4fd889a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf159a700 1 -- 172.21.15.89:0/1477155217 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400b640 con 0x7faaf409ff70 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf159a700 1 -- 172.21.15.89:0/1477155217 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400b7a0 con 0x7faaf409ff70 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf159a700 1 -- 172.21.15.89:0/1477155217 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400bb40 con 0x7faaf409ff70 2024-02-10T00:04:56.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 -- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 msgr2=0x7faaf4142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faae40099e0 tx=0x7faae4009250 comp rx=0 tx=0).stop 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 -- 172.21.15.89:0/1477155217 shutdown_connections 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 --2- 172.21.15.89:0/1477155217 >> v2:172.21.15.89:3300/0 conn(0x7faaf4145cc0 0x7faaf4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf409ff70 0x7faaf4142700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 --2- 172.21.15.89:0/1477155217 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 -- 172.21.15.89:0/1477155217 >> 172.21.15.89:0/1477155217 conn(0x7faaf4063580 msgr2=0x7faaf4063950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 -- 172.21.15.89:0/1477155217 shutdown_connections 2024-02-10T00:04:56.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.637+0000 7faaf8e44700 1 -- 172.21.15.89:0/1477155217 wait complete. 2024-02-10T00:04:56.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 Processor -- start 2024-02-10T00:04:56.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 -- start start 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf409ff70 0x7faaf40a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf4145cc0 0x7faaf40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40a5920 con 0x7faaf409ff70 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40a2540 con 0x7faaf4145cc0 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf8e44700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4155470 con 0x7faaf406f7a0 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf259c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf259c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46906/0 (socket says 172.21.15.89:46906) 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf259c700 1 -- 172.21.15.89:0/3418282085 learned_addr learned my addr 172.21.15.89:0/3418282085 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.639+0000 7faaf1d9b700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf409ff70 0x7faaf40a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf2d9d700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf4145cc0 0x7faaf40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 -- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf4145cc0 msgr2=0x7faaf40a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf4145cc0 0x7faaf40a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 -- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf409ff70 msgr2=0x7faaf40a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf409ff70 0x7faaf40a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 -- 172.21.15.89:0/3418282085 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec009a20 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf259c700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faaf409f660 tx=0x7faae4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4000d10 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400bb20 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae40094f0 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011690 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.640+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40a5190 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.641+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf40a47b0 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.642+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7faae4011a80 con 0x7faaf406f7a0 2024-02-10T00:04:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.642+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3883+0+0 (secure 0 0 0) 0x7faae405d3b0 con 0x7faaf406f7a0 2024-02-10T00:04:56.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.649+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7faae4002040 con 0x7faaf406f7a0 2024-02-10T00:04:56.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.811+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaf40a47b0 con 0x7faaf406f7a0 2024-02-10T00:04:56.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.812+0000 7faae27fc700 1 -- 172.21.15.89:0/3418282085 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+11632 (secure 0 0 0) 0x7faaf40a47b0 con 0x7faaf406f7a0 2024-02-10T00:04:56.814 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:56.815 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:04:56.569401+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:04:56.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 >> v1:172.21.15.89:6816/47970 conn(0x7faad4046040 legacy=0x7faad40484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:56.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 msgr2=0x7faaf40a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:56.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faaf409f660 tx=0x7faae4017000 comp rx=0 tx=0).stop 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 shutdown_connections 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaf4145cc0 0x7faaf40a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faaf406f7a0 0x7faaf40a2000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 --2- 172.21.15.89:0/3418282085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf409ff70 0x7faaf40a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 >> 172.21.15.89:0/3418282085 conn(0x7faaf4063580 msgr2=0x7faaf41415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 shutdown_connections 2024-02-10T00:04:56.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:56.814+0000 7faaf8e44700 1 -- 172.21.15.89:0/3418282085 wait complete. 2024-02-10T00:04:56.829 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-10T00:04:56.830 INFO:teuthology.run_tasks:Running task exec... 2024-02-10T00:04:56.847 INFO:teuthology.task.exec:Executing custom commands... 2024-02-10T00:04:56.847 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:04:56.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 Processor -- start 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 -- start start 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 0x7f3c2413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 0x7f3c2413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240aa7d0 con 0x7f3c240a6700 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2413e5a0 con 0x7f3c240a9150 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.013+0000 7f3c28fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240aaf10 con 0x7f3c240ab900 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2259c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3c240a6700 0x7f3c240aa0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34072/0 (socket says 172.21.15.89:34072) 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c22d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 0x7f3c2413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2259c700 1 -- 172.21.15.89:0/25798173 learned_addr learned my addr 172.21.15.89:0/25798173 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/25798173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 0x7f3c2413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 -- 172.21.15.89:0/25798173 >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 msgr2=0x7f3c2413ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/25798173 >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 0x7f3c2413ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 -- 172.21.15.89:0/25798173 >> v1:172.21.15.89:6789/0 conn(0x7f3c240a6700 legacy=0x7f3c240aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 -- 172.21.15.89:0/25798173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2413f4d0 con 0x7f3c240ab900 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2159a700 1 -- 172.21.15.89:0/25798173 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917215759 0 0) 0x7f3c14001110 con 0x7f3c240a6700 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c22d9d700 1 --2- 172.21.15.89:0/25798173 >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 0x7f3c2413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/25798173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 0x7f3c2413ea50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c180098e0 tx=0x7f3c180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd425002e435a7d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2159a700 1 -- 172.21.15.89:0/25798173 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800b640 con 0x7f3c240ab900 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2159a700 1 -- 172.21.15.89:0/25798173 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800b7a0 con 0x7f3c240ab900 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.014+0000 7f3c2159a700 1 -- 172.21.15.89:0/25798173 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800bb40 con 0x7f3c240ab900 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 -- 172.21.15.89:0/25798173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 msgr2=0x7f3c2413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/25798173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 0x7f3c2413ea50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c180098e0 tx=0x7f3c180091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 -- 172.21.15.89:0/25798173 shutdown_connections 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/25798173 >> v2:172.21.15.89:3300/0 conn(0x7f3c240a9150 0x7f3c2413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/25798173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240ab900 0x7f3c2413ea50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 -- 172.21.15.89:0/25798173 >> 172.21.15.89:0/25798173 conn(0x7f3c24069690 msgr2=0x7f3c2406a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 -- 172.21.15.89:0/25798173 shutdown_connections 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.015+0000 7f3c28fe0700 1 -- 172.21.15.89:0/25798173 wait complete. 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 Processor -- start 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 -- start start 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c240a6700 0x7f3c2413a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 0x7f3c24152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b4200 con 0x7f3c240a6700 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24139800 con 0x7f3c240a9150 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c28fe0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b4430 con 0x7f3c240ab900 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c21d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c21d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:47996/0 (socket says 172.21.15.89:47996) 2024-02-10T00:04:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c21d9b700 1 -- 172.21.15.89:0/3359923025 learned_addr learned my addr 172.21.15.89:0/3359923025 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.016+0000 7f3c22d9d700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 0x7f3c24152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c2259c700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c240a6700 0x7f3c2413a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 -- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 msgr2=0x7f3c24152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 0x7f3c24152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 -- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c240a6700 msgr2=0x7f3c2413a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c240a6700 0x7f3c2413a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 -- 172.21.15.89:0/3359923025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009a20 con 0x7f3c240a9150 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c22d9d700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 0x7f3c24152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c21d9b700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013000 tx=0x7f3c18017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18000d10 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800bb20 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18009420 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18011650 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.017+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24139210 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.018+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c24069170 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.019+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3c18011a00 con 0x7f3c240a9150 2024-02-10T00:04:57.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.019+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3c1805cc70 con 0x7f3c240a9150 2024-02-10T00:04:57.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.025+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3c1801d040 con 0x7f3c240a9150 2024-02-10T00:04:57.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.232+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3c24142710 con 0x7f3c240a9150 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.233+0000 7f3c127fc700 1 -- 172.21.15.89:0/3359923025 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+21154 (secure 0 0 0) 0x7f3c18029070 con 0x7f3c240a9150 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 35, 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-02-09T23:58:08.581759+0000", 2024-02-10T00:04:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-02-10T00:04:56.580519+0000", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-02-10T00:04:53.328682+0000", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-02-09T23:58:13.556626+0000", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5799936, 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 7, 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-10T00:04:57.236 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 4, 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "octopus", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "octopus", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-02-09T23:58:10.591178+0000", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-02-10T00:04:57.237 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-02-10T00:04:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "22", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-02-10T00:04:57.239 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T00:04:57.240 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-02-10T00:04:57.241 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {}, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_devicehealth": {} 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-02-10T00:04:57.242 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-02-09T23:58:17.594328+0000", 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-02-10T00:04:57.243 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.244 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "14", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-02-10T00:04:57.245 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-02-10T00:04:57.246 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-02-09T23:58:25.421289+0000", 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T00:04:57.248 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-02-10T00:04:57.250 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "17", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-02-10T00:04:57.251 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-02-10T00:04:57.252 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-02-10T00:04:57.253 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-02-09T23:58:26.291020+0000", 2024-02-10T00:04:57.254 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-02-10T00:04:57.255 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-10T00:04:57.256 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-02-10T00:04:57.257 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-02-10T00:04:57.258 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-02-10T00:04:57.259 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "54a6058f-90fd-4813-858e-89b0ab58a45e", 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 9, 2024-02-10T00:04:57.260 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 22, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 28, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 31, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 23, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6808", 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50544 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-02-10T00:04:57.261 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6809", 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50544 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6811", 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50544 2024-02-10T00:04:57.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6810", 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50544 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6808/50544", 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6809/50544", 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6811/50544", 2024-02-10T00:04:57.263 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6810/50544", 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "50a61229-5b79-4b67-bbef-f5070a3c0e79", 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 9, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 22, 2024-02-10T00:04:57.264 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 28, 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 31, 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 24, 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6800", 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50630 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6801", 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50630 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6803", 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50630 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6802", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50630 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6800/50630", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6801/50630", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6803/50630", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6802/50630", 2024-02-10T00:04:57.267 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "53f5509d-daa0-4134-b559-84fe4a2ad3cd", 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 9, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 24, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 29, 2024-02-10T00:04:57.268 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 31, 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 25, 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6804", 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50752 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.269 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6805", 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50752 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6807", 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50752 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6806", 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50752 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6804/50752", 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6805/50752", 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6807/50752", 2024-02-10T00:04:57.271 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6806/50752", 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "5bfa695e-8e0f-4f1e-b65c-219837f522fe", 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 9, 2024-02-10T00:04:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 25, 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 31, 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 31, 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 26, 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6812", 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50885 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.273 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6813", 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50885 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6815", 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50885 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:04:57.275 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6814", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 50885 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.89:6812/50885", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.89:6813/50885", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.89:6815/50885", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.89:6814/50885", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-02-09T23:58:12.497581+0000", 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 23 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-02-10T00:04:57.277 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-02-09T23:58:12.497926+0000", 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 24 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-02-09T23:58:12.256553+0000", 2024-02-10T00:04:57.278 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 25 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 3, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "2024-02-10T00:04:43.188668+0000", 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-02-09T23:58:12.448598+0000", 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-02-10T00:04:57.279 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": { 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "172.21.15.89:6819/3416328937": "2024-02-11T00:04:56.564529+0000", 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "172.21.15.89:6816/39389": "2024-02-11T00:04:30.116269+0000", 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "172.21.15.89:0/3978228942": "2024-02-11T00:04:30.116269+0000", 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "172.21.15.89:0/3039776512": "2024-02-11T00:04:30.116269+0000", 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "172.21.15.89:0/2640344124": "2024-02-11T00:04:30.116269+0000" 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-02-10T00:04:57.280 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-02-10T00:04:57.281 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-02-10T00:04:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-02-10T00:04:57.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.282 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 >> v1:172.21.15.89:6816/47970 conn(0x7f3c04046040 legacy=0x7f3c040484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 msgr2=0x7f3c24151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013000 tx=0x7f3c18017000 comp rx=0 tx=0).stop 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 shutdown_connections 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c240ab900 0x7f3c24152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c240a6700 0x7f3c2413a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 --2- 172.21.15.89:0/3359923025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c240a9150 0x7f3c24151b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 >> 172.21.15.89:0/3359923025 conn(0x7f3c24069690 msgr2=0x7f3c241381e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 shutdown_connections 2024-02-10T00:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.235+0000 7f3c28fe0700 1 -- 172.21.15.89:0/3359923025 wait complete. 2024-02-10T00:04:57.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2024-02-10T00:04:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.395+0000 7f56db646700 1 Processor -- start 2024-02-10T00:04:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.396+0000 7f56db646700 1 -- start start 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56d4064040 0x7f56d40a6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d413f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 0x7f56d406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40a6c40 con 0x7f56d4064040 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40a6e50 con 0x7f56d413eda0 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56db646700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4064410 con 0x7f56d406c560 2024-02-10T00:04:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d8be1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d413f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d8be1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d413f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48004/0 (socket says 172.21.15.89:48004) 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d8be1700 1 -- 172.21.15.89:0/2207165116 learned_addr learned my addr 172.21.15.89:0/2207165116 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 0x7f56d406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d93e2700 1 --2- 172.21.15.89:0/2207165116 >> v2:172.21.15.89:3300/0 conn(0x7f56d4064040 0x7f56d40a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 -- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 msgr2=0x7f56d413f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d413f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 -- 172.21.15.89:0/2207165116 >> v2:172.21.15.89:3300/0 conn(0x7f56d4064040 msgr2=0x7f56d40a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 --2- 172.21.15.89:0/2207165116 >> v2:172.21.15.89:3300/0 conn(0x7f56d4064040 0x7f56d40a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 -- 172.21.15.89:0/2207165116 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d413f6d0 con 0x7f56d406c560 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.397+0000 7f56d9be3700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 0x7f56d406c9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009e60 tx=0x7f56cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b05352a99b95dc server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.398+0000 7f56cbfff700 1 -- 172.21.15.89:0/2207165116 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00e070 con 0x7f56d406c560 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.398+0000 7f56cbfff700 1 -- 172.21.15.89:0/2207165116 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00bb40 con 0x7f56d406c560 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.398+0000 7f56cbfff700 1 -- 172.21.15.89:0/2207165116 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc012430 con 0x7f56d406c560 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.398+0000 7f56db646700 1 -- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 msgr2=0x7f56d406c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.398+0000 7f56db646700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 0x7f56d406c9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009e60 tx=0x7f56cc009780 comp rx=0 tx=0).stop 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 -- 172.21.15.89:0/2207165116 shutdown_connections 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d406c560 0x7f56d406c9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 --2- 172.21.15.89:0/2207165116 >> v2:172.21.15.89:3300/0 conn(0x7f56d4064040 0x7f56d40a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 --2- 172.21.15.89:0/2207165116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d413f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 -- 172.21.15.89:0/2207165116 >> 172.21.15.89:0/2207165116 conn(0x7f56d406b8d0 msgr2=0x7f56d4063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:57.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 -- 172.21.15.89:0/2207165116 shutdown_connections 2024-02-10T00:04:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.399+0000 7f56db646700 1 -- 172.21.15.89:0/2207165116 wait complete. 2024-02-10T00:04:57.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.400+0000 7f56db646700 1 Processor -- start 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.400+0000 7f56db646700 1 -- start start 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.400+0000 7f56db646700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 0x7f56d4151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.400+0000 7f56db646700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56d406c560 0x7f56d4151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56db646700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56db646700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40a4780 con 0x7f56d406c560 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56db646700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4098c80 con 0x7f56d413eda0 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56db646700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4098f40 con 0x7f56d4064040 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d9be3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 0x7f56d4151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d9be3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48008/0 (socket says 172.21.15.89:48008) 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d9be3700 1 -- 172.21.15.89:0/2890517126 learned_addr learned my addr 172.21.15.89:0/2890517126 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 -- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 msgr2=0x7f56d41520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 -- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56d406c560 msgr2=0x7f56d4151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56d406c560 0x7f56d4151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 -- 172.21.15.89:0/2890517126 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009a20 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d9be3700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56d93e2700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 0x7f56d4151670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56d000ea50 tx=0x7f56d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000c880 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000ca00 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40b1ac0 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.401+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000cdc0 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.402+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4144240 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.403+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f56d0013680 con 0x7f56d4064040 2024-02-10T00:04:57.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.403+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d406b0d0 con 0x7f56d4064040 2024-02-10T00:04:57.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.403+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f56d005b4d0 con 0x7f56d4064040 2024-02-10T00:04:57.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.407+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f56d00396f0 con 0x7f56d4064040 2024-02-10T00:04:57.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.634+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56d40af430 con 0x7f56d4064040 2024-02-10T00:04:57.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.634+0000 7f56c97fa700 1 -- 172.21.15.89:0/2890517126 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f56d003cee0 con 0x7f56d4064040 2024-02-10T00:04:57.637 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)": 3 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)": 2 2024-02-10T00:04:57.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)": 4 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)": 3 2024-02-10T00:04:57.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:04:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-02-10T00:04:57.641 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)": 12 2024-02-10T00:04:57.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:04:57.641 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:04:57.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 >> v1:172.21.15.89:6816/47970 conn(0x7f56b8046040 legacy=0x7f56b80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 msgr2=0x7f56d4151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 0x7f56d4151670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56d000ea50 tx=0x7f56d00091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 shutdown_connections 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56d413eda0 0x7f56d41520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f56d4064040 0x7f56d4151670 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 --2- 172.21.15.89:0/2890517126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56d406c560 0x7f56d4151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 >> 172.21.15.89:0/2890517126 conn(0x7f56d406b8d0 msgr2=0x7f56d41450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 shutdown_connections 2024-02-10T00:04:57.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.637+0000 7f56db646700 1 -- 172.21.15.89:0/2890517126 wait complete. 2024-02-10T00:04:57.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy' 2024-02-10T00:04:57.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.764+0000 7f93d682f700 1 Processor -- start 2024-02-10T00:04:57.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.764+0000 7f93d682f700 1 -- start start 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d682f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93d00a6940 0x7f93d013c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d682f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0139820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d682f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d013c790 con 0x7f93d013f850 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d682f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d006f800 con 0x7f93d00a6940 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d682f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d013c9f0 con 0x7f93d0139450 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cf7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d4dcc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f93d013f850 0x7f93d013fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34076/0 (socket says 172.21.15.89:34076) 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93d4dcc700 1 -- 172.21.15.89:0/167219951 learned_addr learned my addr 172.21.15.89:0/167219951 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 --2- 172.21.15.89:0/167219951 >> v2:172.21.15.89:3300/0 conn(0x7f93d00a6940 0x7f93d013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93ceffd700 1 -- 172.21.15.89:0/167219951 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060940744 0 0) 0x7f93d013c790 con 0x7f93d013f850 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93ceffd700 1 -- 172.21.15.89:0/167219951 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b8003570 con 0x7f93d013f850 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 -- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 msgr2=0x7f93d0139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 -- 172.21.15.89:0/167219951 >> v1:172.21.15.89:6789/0 conn(0x7f93d013f850 legacy=0x7f93d013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 -- 172.21.15.89:0/167219951 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d013cc90 con 0x7f93d00a6940 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cf7fe700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.765+0000 7f93cffff700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d013c250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb5c93a528786b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93ceffd700 1 -- 172.21.15.89:0/167219951 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0011630 con 0x7f93d00a6940 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93ceffd700 1 -- 172.21.15.89:0/167219951 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0011790 con 0x7f93d00a6940 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93ceffd700 1 -- 172.21.15.89:0/167219951 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0011b50 con 0x7f93d00a6940 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 -- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 msgr2=0x7f93d013c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d013c250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c00091a0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 -- 172.21.15.89:0/167219951 shutdown_connections 2024-02-10T00:04:57.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d013c250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 --2- 172.21.15.89:0/167219951 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 -- 172.21.15.89:0/167219951 >> 172.21.15.89:0/167219951 conn(0x7f93d0063770 msgr2=0x7f93d0063b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:57.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 -- 172.21.15.89:0/167219951 shutdown_connections 2024-02-10T00:04:57.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.766+0000 7f93d682f700 1 -- 172.21.15.89:0/167219951 wait complete. 2024-02-10T00:04:57.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.768+0000 7f93d682f700 1 Processor -- start 2024-02-10T00:04:57.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.768+0000 7f93d682f700 1 -- start start 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d0136c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0137580 con 0x7f93d00a6940 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0137780 con 0x7f93d013f850 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d682f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d013bf90 con 0x7f93d0139450 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48014/0 (socket says 172.21.15.89:48014) 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 -- 172.21.15.89:0/3476159358 learned_addr learned my addr 172.21.15.89:0/3476159358 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93cf7fe700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93cffff700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d0136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 -- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 msgr2=0x7f93d0135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 -- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 msgr2=0x7f93d0136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d0136c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 -- 172.21.15.89:0/3476159358 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009420 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.769+0000 7f93d4dcc700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93c8001460 tx=0x7f93c8001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.770+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800a870 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.770+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c800a9d0 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.770+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800ad50 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.770+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0009420 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.770+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d0138820 con 0x7f93d013f850 2024-02-10T00:04:57.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.771+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d006c1d0 con 0x7f93d013f850 2024-02-10T00:04:57.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.771+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f93c8007300 con 0x7f93d013f850 2024-02-10T00:04:57.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.771+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f93c805b430 con 0x7f93d013f850 2024-02-10T00:04:57.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.775+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f93c80396d0 con 0x7f93d013f850 2024-02-10T00:04:57.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:57.952+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f93d004bed0 con 0x7f93d013f850 2024-02-10T00:04:58.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.582+0000 7f93b7fff700 1 -- 172.21.15.89:0/3476159358 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0 v36) v1 ==== 92+0+0 (secure 0 0 0) 0x7f93c803cec0 con 0x7f93d013f850 2024-02-10T00:04:58.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 >> v1:172.21.15.89:6816/47970 conn(0x7f93bc046040 legacy=0x7f93bc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 msgr2=0x7f93d00a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93c8001460 tx=0x7f93c8001a40 comp rx=0 tx=0).stop 2024-02-10T00:04:58.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 shutdown_connections 2024-02-10T00:04:58.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93d013f850 0x7f93d00a3fd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d00a6940 0x7f93d0136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 --2- 172.21.15.89:0/3476159358 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93d0139450 0x7f93d0135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 >> 172.21.15.89:0/3476159358 conn(0x7f93d0063770 msgr2=0x7f93d00a4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:58.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 shutdown_connections 2024-02-10T00:04:58.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.589+0000 7f93d682f700 1 -- 172.21.15.89:0/3476159358 wait complete. 2024-02-10T00:04:58.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2024-02-10T00:04:58.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.719+0000 7f9c8a31d700 1 Processor -- start 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.719+0000 7f9c8a31d700 1 -- start start 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c8a31d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c8a31d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c8a31d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840aaf10 con 0x7f9c840a9150 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c8a31d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8413e5a0 con 0x7f9c840ab900 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c8a31d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8413e790 con 0x7f9c840a6700 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c837fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48022/0 (socket says 172.21.15.89:48022) 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c837fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44432/0 (socket says 172.21.15.89:44432) 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 -- 172.21.15.89:0/227856156 learned_addr learned my addr 172.21.15.89:0/227856156 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 -- 172.21.15.89:0/227856156 >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 msgr2=0x7f9c8413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:58.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 --2- 172.21.15.89:0/227856156 >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 -- 172.21.15.89:0/227856156 >> v1:172.21.15.89:6789/0 conn(0x7f9c840a9150 legacy=0x7f9c8413ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 -- 172.21.15.89:0/227856156 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840aa600 con 0x7f9c840a6700 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c837fe700 1 --2- 172.21.15.89:0/227856156 >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c83fff700 1 --2- 172.21.15.89:0/227856156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c740099b0 tx=0x7f9c74009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3814b4204e296fb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c82ffd700 1 -- 172.21.15.89:0/227856156 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74009ea0 con 0x7f9c840a6700 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.720+0000 7f9c82ffd700 1 -- 172.21.15.89:0/227856156 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b860 con 0x7f9c840a6700 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c82ffd700 1 -- 172.21.15.89:0/227856156 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400bc00 con 0x7f9c840a6700 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 -- 172.21.15.89:0/227856156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 msgr2=0x7f9c840aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/227856156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c740099b0 tx=0x7f9c74009250 comp rx=0 tx=0).stop 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 -- 172.21.15.89:0/227856156 shutdown_connections 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/227856156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840a6700 0x7f9c840aa0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/227856156 >> v2:172.21.15.89:3300/0 conn(0x7f9c840ab900 0x7f9c8413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 -- 172.21.15.89:0/227856156 >> 172.21.15.89:0/227856156 conn(0x7f9c84069690 msgr2=0x7f9c8406a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:58.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 -- 172.21.15.89:0/227856156 shutdown_connections 2024-02-10T00:04:58.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.721+0000 7f9c8a31d700 1 -- 172.21.15.89:0/227856156 wait complete. 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.722+0000 7f9c8a31d700 1 Processor -- start 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.723+0000 7f9c8a31d700 1 -- start start 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 0x7f9c840aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 0x7f9c8414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840ad230 con 0x7f9c840a6700 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840af490 con 0x7f9c840ab900 2024-02-10T00:04:58.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840ae770 con 0x7f9c840a9150 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c888ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 0x7f9c8414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44434/0 (socket says 172.21.15.89:44434) 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 -- 172.21.15.89:0/1267073869 learned_addr learned my addr 172.21.15.89:0/1267073869 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c837fe700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 0x7f9c840aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 -- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 msgr2=0x7f9c840aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 0x7f9c840aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 -- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 msgr2=0x7f9c8414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 0x7f9c8414ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 -- 172.21.15.89:0/1267073869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009420 con 0x7f9c840a6700 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c888ba700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 0x7f9c8414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c837fe700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 0x7f9c840aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c83fff700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c8413e8d0 tx=0x7f9c74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:58.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74000d10 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400bbe0 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74011670 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.724+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c740094f0 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.725+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c840b57e0 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.726+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9c74011aa0 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.726+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c840ae5b0 con 0x7f9c840a6700 2024-02-10T00:04:58.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.726+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9c7405c770 con 0x7f9c840a6700 2024-02-10T00:04:58.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.733+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f9c7402e520 con 0x7f9c840a6700 2024-02-10T00:04:58.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.892+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f9c840abe00 con 0x7f9c840a6700 2024-02-10T00:04:58.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.893+0000 7f9c6bfff700 1 -- 172.21.15.89:0/1267073869 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v36) v1 ==== 59+0+37 (secure 0 0 0) 0x7f9c74015080 con 0x7f9c840a6700 2024-02-10T00:04:58.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.894+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 >> v1:172.21.15.89:6816/47970 conn(0x7f9c70046040 legacy=0x7f9c700484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.894+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 msgr2=0x7f9c8414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:58.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.894+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c8413e8d0 tx=0x7f9c74017000 comp rx=0 tx=0).stop 2024-02-10T00:04:58.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 shutdown_connections 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c840ab900 0x7f9c8414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c840a6700 0x7f9c8414e3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 --2- 172.21.15.89:0/1267073869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9c840a9150 0x7f9c840aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 >> 172.21.15.89:0/1267073869 conn(0x7f9c84069690 msgr2=0x7f9c841380c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 shutdown_connections 2024-02-10T00:04:58.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:58.895+0000 7f9c8a31d700 1 -- 172.21.15.89:0/1267073869 wait complete. 2024-02-10T00:04:59.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.000+0000 7fb353fdc700 1 Processor -- start 2024-02-10T00:04:59.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.000+0000 7fb353fdc700 1 -- start start 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb353fdc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb353fdc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c146ec0 0x7fb34c1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb353fdc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c06f650 con 0x7fb34c142700 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb353fdc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c06a6e0 con 0x7fb34c146ec0 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb353fdc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c13e610 con 0x7fb34c0640d0 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46972/0 (socket says 172.21.15.89:46972) 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351577700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb34c142700 0x7fb34c13ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34092/0 (socket says 172.21.15.89:34092) 2024-02-10T00:04:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 -- 172.21.15.89:0/227476498 learned_addr learned my addr 172.21.15.89:0/227476498 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb352579700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c146ec0 0x7fb34c1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 -- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c146ec0 msgr2=0x7fb34c1492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c146ec0 0x7fb34c1492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 -- 172.21.15.89:0/227476498 >> v1:172.21.15.89:6789/0 conn(0x7fb34c142700 legacy=0x7fb34c13ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.001+0000 7fb351d78700 1 -- 172.21.15.89:0/227476498 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c13e8b0 con 0x7fb34c0640d0 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb351d78700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3480099e0 tx=0x7fb348009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c6d099d23980b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb350d76700 1 -- 172.21.15.89:0/227476498 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800b860 con 0x7fb34c0640d0 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb350d76700 1 -- 172.21.15.89:0/227476498 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800b9c0 con 0x7fb34c0640d0 2024-02-10T00:04:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb350d76700 1 -- 172.21.15.89:0/227476498 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800bd60 con 0x7fb34c0640d0 2024-02-10T00:04:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 -- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 msgr2=0x7fb34c1421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3480099e0 tx=0x7fb348009250 comp rx=0 tx=0).stop 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 -- 172.21.15.89:0/227476498 shutdown_connections 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c146ec0 0x7fb34c1492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 --2- 172.21.15.89:0/227476498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c0640d0 0x7fb34c1421c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.002+0000 7fb353fdc700 1 -- 172.21.15.89:0/227476498 >> 172.21.15.89:0/227476498 conn(0x7fb34c06ca40 msgr2=0x7fb34c063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.003+0000 7fb353fdc700 1 -- 172.21.15.89:0/227476498 shutdown_connections 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.003+0000 7fb353fdc700 1 -- 172.21.15.89:0/227476498 wait complete. 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.003+0000 7fb353fdc700 1 Processor -- start 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.003+0000 7fb353fdc700 1 -- start start 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c142700 0x7fb34c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c146ec0 0x7fb34c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:04:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c13d4a0 con 0x7fb34c0640d0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c1527b0 con 0x7fb34c142700 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb353fdc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c144f80 con 0x7fb34c146ec0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44438/0 (socket says 172.21.15.89:44438) 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 -- 172.21.15.89:0/751877766 learned_addr learned my addr 172.21.15.89:0/751877766 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb352579700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c146ec0 0x7fb34c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351577700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c142700 0x7fb34c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 -- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c146ec0 msgr2=0x7fb34c152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c146ec0 0x7fb34c152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 -- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c142700 msgr2=0x7fb34c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c142700 0x7fb34c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.004+0000 7fb351d78700 1 -- 172.21.15.89:0/751877766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480094f0 con 0x7fb34c0640d0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb351d78700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3480099b0 tx=0x7fb348017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:04:59.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348011d70 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34801a420 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34801a7e0 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c13dac0 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.005+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c143370 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.006+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c06c520 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.006+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fb34801ab90 con 0x7fb34c0640d0 2024-02-10T00:04:59.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.006+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fb34805ca70 con 0x7fb34c0640d0 2024-02-10T00:04:59.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.010+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fb34802ff80 con 0x7fb34c0640d0 2024-02-10T00:04:59.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:04:59.196+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fb34c04bed0 con 0x7fb34c0640d0 2024-02-10T00:05:00.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.181+0000 7fb341ffb700 1 -- 172.21.15.89:0/751877766 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v37) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb348015020 con 0x7fb34c0640d0 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 >> v1:172.21.15.89:6816/47970 conn(0x7fb330046040 legacy=0x7fb3300484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 msgr2=0x7fb34c143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3480099b0 tx=0x7fb348017000 comp rx=0 tx=0).stop 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 shutdown_connections 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb34c146ec0 0x7fb34c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb34c0640d0 0x7fb34c143910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 --2- 172.21.15.89:0/751877766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb34c142700 0x7fb34c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.184+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 >> 172.21.15.89:0/751877766 conn(0x7fb34c06ca40 msgr2=0x7fb34c0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.185+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 shutdown_connections 2024-02-10T00:05:00.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.185+0000 7fb353fdc700 1 -- 172.21.15.89:0/751877766 wait complete. 2024-02-10T00:05:00.189 INFO:teuthology.orchestra.run.smithi089.stderr:set pool 1 pg_autoscale_mode to off 2024-02-10T00:05:00.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.293+0000 7fd53238a700 1 Processor -- start 2024-02-10T00:05:00.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.293+0000 7fd53238a700 1 -- start start 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.294+0000 7fd53238a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 0x7fd52c13b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.294+0000 7fd53238a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c13bb30 0x7fd52c145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.294+0000 7fd53238a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c09ef30 con 0x7fd52c070ec0 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.294+0000 7fd53238a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09fd30 con 0x7fd52c13bb30 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.294+0000 7fd53238a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09eda0 con 0x7fd52c0a0be0 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 0x7fd52c13b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:00.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52bfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd52c070ec0 0x7fd52c09f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34104/0 (socket says 172.21.15.89:34104) 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52bfff700 1 -- 172.21.15.89:0/149142398 learned_addr learned my addr 172.21.15.89:0/149142398 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd530927700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c13bb30 0x7fd52c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 -- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c13bb30 msgr2=0x7fd52c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c13bb30 0x7fd52c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 -- 172.21.15.89:0/149142398 >> v1:172.21.15.89:6789/0 conn(0x7fd52c070ec0 legacy=0x7fd52c09f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 -- 172.21.15.89:0/149142398 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c13bfd0 con 0x7fd52c0a0be0 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.295+0000 7fd52b7fe700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 0x7fd52c13b5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd520009910 tx=0x7fd5200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b1540391427379 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd52affd700 1 -- 172.21.15.89:0/149142398 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520011630 con 0x7fd52c0a0be0 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd52affd700 1 -- 172.21.15.89:0/149142398 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520011790 con 0x7fd52c0a0be0 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd52affd700 1 -- 172.21.15.89:0/149142398 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520011b50 con 0x7fd52c0a0be0 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 -- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 msgr2=0x7fd52c13b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 0x7fd52c13b5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd520009910 tx=0x7fd5200091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 -- 172.21.15.89:0/149142398 shutdown_connections 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c13bb30 0x7fd52c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 --2- 172.21.15.89:0/149142398 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c0a0be0 0x7fd52c13b5f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 -- 172.21.15.89:0/149142398 >> 172.21.15.89:0/149142398 conn(0x7fd52c06a010 msgr2=0x7fd52c063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 -- 172.21.15.89:0/149142398 shutdown_connections 2024-02-10T00:05:00.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.296+0000 7fd53238a700 1 -- 172.21.15.89:0/149142398 wait complete. 2024-02-10T00:05:00.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.298+0000 7fd53238a700 1 Processor -- start 2024-02-10T00:05:00.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.298+0000 7fd53238a700 1 -- start start 2024-02-10T00:05:00.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:00.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 0x7fd52c06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c13bb30 0x7fd52c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09b9e0 con 0x7fd52c13bb30 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09bfa0 con 0x7fd52c0a0be0 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd53238a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09c240 con 0x7fd52c070ec0 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 0x7fd52c06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46994/0 (socket says 172.21.15.89:46994) 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 0x7fd52c06e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48064/0 (socket says 172.21.15.89:48064) 2024-02-10T00:05:00.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 -- 172.21.15.89:0/1966457797 learned_addr learned my addr 172.21.15.89:0/1966457797 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd530927700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c13bb30 0x7fd52c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 -- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 msgr2=0x7fd52c06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 0x7fd52c06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 -- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c13bb30 msgr2=0x7fd52c06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c13bb30 0x7fd52c06ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 -- 172.21.15.89:0/1966457797 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009420 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.299+0000 7fd52bfff700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c810 tx=0x7fd51c007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.300+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c005b30 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.300+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c005c90 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.300+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c09b700 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.300+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c007340 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.300+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c0a2170 con 0x7fd52c070ec0 2024-02-10T00:05:00.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.301+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fd51c01b400 con 0x7fd52c070ec0 2024-02-10T00:05:00.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.301+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c06a880 con 0x7fd52c070ec0 2024-02-10T00:05:00.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.301+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd51c05ac50 con 0x7fd52c070ec0 2024-02-10T00:05:00.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.305+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd51c039060 con 0x7fd52c070ec0 2024-02-10T00:05:00.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:00.471+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd52c04bed0 con 0x7fd52c070ec0 2024-02-10T00:05:01.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.182+0000 7fd513fff700 1 -- 172.21.15.89:0/1966457797 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd51c03c680 con 0x7fd52c070ec0 2024-02-10T00:05:01.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 >> v1:172.21.15.89:6816/47970 conn(0x7fd518046040 legacy=0x7fd5180484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 msgr2=0x7fd52c06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c810 tx=0x7fd51c007f30 comp rx=0 tx=0).stop 2024-02-10T00:05:01.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 shutdown_connections 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c13bb30 0x7fd52c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd52c070ec0 0x7fd52c06e480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 --2- 172.21.15.89:0/1966457797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd52c0a0be0 0x7fd52c06e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 >> 172.21.15.89:0/1966457797 conn(0x7fd52c06a010 msgr2=0x7fd52c13ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 shutdown_connections 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.185+0000 7fd53238a700 1 -- 172.21.15.89:0/1966457797 wait complete. 2024-02-10T00:05:01.190 INFO:teuthology.orchestra.run.smithi089.stderr:set pool 2 pg_autoscale_mode to off 2024-02-10T00:05:01.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.289+0000 7ff8caa1a700 1 Processor -- start 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.289+0000 7ff8caa1a700 1 -- start start 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8caa1a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8c4063e80 0x7ff8c413e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8caa1a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c4148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8caa1a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c4141c30 con 0x7ff8c41422e0 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8caa1a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c413f4a0 con 0x7ff8c4063e80 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8caa1a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c406d780 con 0x7ff8c4142730 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8c4063e80 0x7ff8c413e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c8fb7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c4148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8c4063e80 0x7ff8c413e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44452/0 (socket says 172.21.15.89:44452) 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c37fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff8c41422e0 0x7ff8c413ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34114/0 (socket says 172.21.15.89:34114) 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c8fb7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c4148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46996/0 (socket says 172.21.15.89:46996) 2024-02-10T00:05:01.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 -- 172.21.15.89:0/571157533 learned_addr learned my addr 172.21.15.89:0/571157533 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:01.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 -- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 msgr2=0x7ff8c4148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:01.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 --2- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c4148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 -- 172.21.15.89:0/571157533 >> v1:172.21.15.89:6789/0 conn(0x7ff8c41422e0 legacy=0x7ff8c413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c2ffd700 1 -- 172.21.15.89:0/571157533 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888856099 0 0) 0x7ff8c4141c30 con 0x7ff8c41422e0 2024-02-10T00:05:01.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 -- 172.21.15.89:0/571157533 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4141e90 con 0x7ff8c4063e80 2024-02-10T00:05:01.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.290+0000 7ff8c3fff700 1 --2- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c4063e80 0x7ff8c413e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40099b0 tx=0x7ff8b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58b355ad68e16c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8c2ffd700 1 -- 172.21.15.89:0/571157533 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4009ea0 con 0x7ff8c4063e80 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8c2ffd700 1 -- 172.21.15.89:0/571157533 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400b860 con 0x7ff8c4063e80 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8c2ffd700 1 -- 172.21.15.89:0/571157533 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400bc00 con 0x7ff8c4063e80 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 -- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c4063e80 msgr2=0x7ff8c413e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c4063e80 0x7ff8c413e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40099b0 tx=0x7ff8b4009250 comp rx=0 tx=0).stop 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 -- 172.21.15.89:0/571157533 shutdown_connections 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c4063e80 0x7ff8c413e5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/571157533 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c4148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 -- 172.21.15.89:0/571157533 >> 172.21.15.89:0/571157533 conn(0x7ff8c406ca40 msgr2=0x7ff8c4063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 -- 172.21.15.89:0/571157533 shutdown_connections 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.291+0000 7ff8caa1a700 1 -- 172.21.15.89:0/571157533 wait complete. 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.292+0000 7ff8caa1a700 1 Processor -- start 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.292+0000 7ff8caa1a700 1 -- start start 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 0x7ff8c40989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c409a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40af3e0 con 0x7ff8c41422e0 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c414e130 con 0x7ff8c4063e80 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8caa1a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c4098360 con 0x7ff8c4142730 2024-02-10T00:05:01.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44460/0 (socket says 172.21.15.89:44460) 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c37fe700 1 -- 172.21.15.89:0/2128113348 learned_addr learned my addr 172.21.15.89:0/2128113348 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c409a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c3fff700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 0x7ff8c40989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 -- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 msgr2=0x7ff8c40989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 0x7ff8c40989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 -- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 msgr2=0x7ff8c4099200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c8fb7700 1 -- 172.21.15.89:0/2128113348 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40094f0 con 0x7ff8c4142730 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c37fe700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.293+0000 7ff8c3fff700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 0x7ff8c40989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8c8fb7700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c409a330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e20 tx=0x7ff8bc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00cb50 con 0x7ff8c4142730 2024-02-10T00:05:01.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00f040 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c409a870 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc014480 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.294+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c414e460 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.295+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ff8bc0147f0 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.295+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c4099f80 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.295+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ff8bc05bed0 con 0x7ff8c4142730 2024-02-10T00:05:01.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.299+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ff8bc039fe0 con 0x7ff8c4142730 2024-02-10T00:05:01.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:01.478+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7ff8c406fec0 con 0x7ff8c4142730 2024-02-10T00:05:02.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.192+0000 7ff8abfff700 1 -- 172.21.15.89:0/2128113348 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v39) v1 ==== 164+0+0 (secure 0 0 0) 0x7ff8bc018030 con 0x7ff8c4142730 2024-02-10T00:05:02.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 >> v1:172.21.15.89:6816/47970 conn(0x7ff8b0046040 legacy=0x7ff8b00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 msgr2=0x7ff8c409a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c409a330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e20 tx=0x7ff8bc00b040 comp rx=0 tx=0).stop 2024-02-10T00:05:02.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 shutdown_connections 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff8c4142730 0x7ff8c409a330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c4063e80 0x7ff8c40989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 --2- 172.21.15.89:0/2128113348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c41422e0 0x7ff8c4099200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 >> 172.21.15.89:0/2128113348 conn(0x7ff8c406ca40 msgr2=0x7ff8c4141160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 shutdown_connections 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.196+0000 7ff8caa1a700 1 -- 172.21.15.89:0/2128113348 wait complete. 2024-02-10T00:05:02.200 INFO:teuthology.orchestra.run.smithi089.stderr:set pool 3 pg_autoscale_mode to off 2024-02-10T00:05:02.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 Processor -- start 2024-02-10T00:05:02.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 -- start start 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f861006e0e0 0x7f8610141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f8610149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861006a8a0 con 0x7f8610141c10 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861006e810 con 0x7f861006e0e0 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.308+0000 7f86154e1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f861006eab0 con 0x7f8610146f60 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f861006e0e0 0x7f8610141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860effd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8610141c10 0x7f8610069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34126/0 (socket says 172.21.15.89:34126) 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f8610149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:02.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f861006e0e0 0x7f8610141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44462/0 (socket says 172.21.15.89:44462) 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860effd700 1 -- 172.21.15.89:0/3879902607 learned_addr learned my addr 172.21.15.89:0/3879902607 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 -- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 msgr2=0x7f8610149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f8610149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 -- 172.21.15.89:0/3879902607 >> v1:172.21.15.89:6789/0 conn(0x7f8610141c10 legacy=0x7f8610069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 -- 172.21.15.89:0/3879902607 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861006e540 con 0x7f861006e0e0 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860dffb700 1 -- 172.21.15.89:0/3879902607 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201227386 0 0) 0x7f861006a8a0 con 0x7f8610141c10 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860f7fe700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f8610149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860e7fc700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861006e0e0 0x7f8610141fe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86040098e0 tx=0x7f86040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d816972f05e82eba server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860dffb700 1 -- 172.21.15.89:0/3879902607 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400b640 con 0x7f861006e0e0 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860dffb700 1 -- 172.21.15.89:0/3879902607 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400b7a0 con 0x7f861006e0e0 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.309+0000 7f860dffb700 1 -- 172.21.15.89:0/3879902607 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400bb60 con 0x7f861006e0e0 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 -- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861006e0e0 msgr2=0x7f8610141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861006e0e0 0x7f8610141fe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86040098e0 tx=0x7f86040091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 -- 172.21.15.89:0/3879902607 shutdown_connections 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f8610149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 --2- 172.21.15.89:0/3879902607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861006e0e0 0x7f8610141fe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 -- 172.21.15.89:0/3879902607 >> 172.21.15.89:0/3879902607 conn(0x7f861006c9d0 msgr2=0x7f8610063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 -- 172.21.15.89:0/3879902607 shutdown_connections 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.310+0000 7f86154e1700 1 -- 172.21.15.89:0/3879902607 wait complete. 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 Processor -- start 2024-02-10T00:05:02.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 -- start start 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 0x7f86100aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100ac680 con 0x7f8610141c10 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100acc90 con 0x7f861006e0e0 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.311+0000 7f86154e1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86100acf50 con 0x7f8610146f60 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48088/0 (socket says 172.21.15.89:48088) 2024-02-10T00:05:02.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47028/0 (socket says 172.21.15.89:47028) 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860e7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 0x7f86100aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 -- 172.21.15.89:0/209434188 learned_addr learned my addr 172.21.15.89:0/209434188 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 -- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 msgr2=0x7f861013b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 -- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 msgr2=0x7f86100aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 0x7f86100aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 -- 172.21.15.89:0/209434188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608009a20 con 0x7f861006e0e0 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860f7fe700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860e7fc700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 0x7f86100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f860effd700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f860000c810 tx=0x7f8600007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600005b30 con 0x7f861006e0e0 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600005cb0 con 0x7f861006e0e0 2024-02-10T00:05:02.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604009420 con 0x7f861006e0e0 2024-02-10T00:05:02.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600007320 con 0x7f861006e0e0 2024-02-10T00:05:02.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.312+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861013ec80 con 0x7f861006e0e0 2024-02-10T00:05:02.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.314+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100afbc0 con 0x7f861006e0e0 2024-02-10T00:05:02.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.314+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f860001b3b0 con 0x7f861006e0e0 2024-02-10T00:05:02.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.315+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f860005a9e0 con 0x7f861006e0e0 2024-02-10T00:05:02.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.318+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f8600038ce0 con 0x7f861006e0e0 2024-02-10T00:05:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:02.499+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f861006cdd0 con 0x7f861006e0e0 2024-02-10T00:05:03.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.195+0000 7f85f6ffd700 1 -- 172.21.15.89:0/209434188 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7f8600017020 con 0x7f861006e0e0 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 >> v1:172.21.15.89:6816/47970 conn(0x7f85fc046070 legacy=0x7f85fc048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 msgr2=0x7f86100adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f860000c810 tx=0x7f8600007d90 comp rx=0 tx=0).stop 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 shutdown_connections 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8610146f60 0x7f861013b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861006e0e0 0x7f86100adae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 --2- 172.21.15.89:0/209434188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8610141c10 0x7f86100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 >> 172.21.15.89:0/209434188 conn(0x7f861006c9d0 msgr2=0x7f8610146440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 shutdown_connections 2024-02-10T00:05:03.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.199+0000 7f86154e1700 1 -- 172.21.15.89:0/209434188 wait complete. 2024-02-10T00:05:03.203 INFO:teuthology.orchestra.run.smithi089.stderr:set pool 4 pg_autoscale_mode to off 2024-02-10T00:05:03.215 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-02-10T00:05:03.230 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-10T00:05:03.230 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-10T00:05:03.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-10T00:05:03.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.348+0000 7fe77f38b700 1 Processor -- start 2024-02-10T00:05:03.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.348+0000 7fe77f38b700 1 -- start start 2024-02-10T00:05:03.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77f38b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77f38b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 0x7fe778145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77f38b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7780b1a10 con 0x7fe778063740 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77f38b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77806dbb0 con 0x7fe77813f060 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77f38b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77813f500 con 0x7fe77806f7c0 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77c926700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d928700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 0x7fe778145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d127700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe778063740 0x7fe77806dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34130/0 (socket says 172.21.15.89:34130) 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d127700 1 -- 172.21.15.89:0/664135640 learned_addr learned my addr 172.21.15.89:0/664135640 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d928700 1 -- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 msgr2=0x7fe77813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d928700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77813eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d928700 1 -- 172.21.15.89:0/664135640 >> v1:172.21.15.89:6789/0 conn(0x7fe778063740 legacy=0x7fe77806dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe76ffff700 1 -- 172.21.15.89:0/664135640 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635399759 0 0) 0x7fe7780b1a10 con 0x7fe778063740 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77d928700 1 -- 172.21.15.89:0/664135640 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778063b10 con 0x7fe77813f060 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.349+0000 7fe77c926700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77d928700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 0x7fe778145960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e90 tx=0x7fe770009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a6e5b761cb47085 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe76ffff700 1 -- 172.21.15.89:0/664135640 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77000bc60 con 0x7fe77813f060 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe76ffff700 1 -- 172.21.15.89:0/664135640 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77000bdc0 con 0x7fe77813f060 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe76ffff700 1 -- 172.21.15.89:0/664135640 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700116b0 con 0x7fe77813f060 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 -- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 msgr2=0x7fe778145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 0x7fe778145960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e90 tx=0x7fe770009780 comp rx=0 tx=0).stop 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 -- 172.21.15.89:0/664135640 shutdown_connections 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77813f060 0x7fe778145960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 --2- 172.21.15.89:0/664135640 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 -- 172.21.15.89:0/664135640 >> 172.21.15.89:0/664135640 conn(0x7fe77806a820 msgr2=0x7fe7780b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 -- 172.21.15.89:0/664135640 shutdown_connections 2024-02-10T00:05:03.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.350+0000 7fe77f38b700 1 -- 172.21.15.89:0/664135640 wait complete. 2024-02-10T00:05:03.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.352+0000 7fe77f38b700 1 Processor -- start 2024-02-10T00:05:03.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.352+0000 7fe77f38b700 1 -- start start 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.352+0000 7fe77f38b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 0x7fe778098d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.352+0000 7fe77f38b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 0x7fe77814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77809a8f0 con 0x7fe77813f060 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe778099700 con 0x7fe778063740 2024-02-10T00:05:03.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7780999c0 con 0x7fe77806f7c0 2024-02-10T00:05:03.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77d127700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 0x7fe778098d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77d928700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 0x7fe77814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47044/0 (socket says 172.21.15.89:47044) 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77d127700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 0x7fe778098d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48108/0 (socket says 172.21.15.89:48108) 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 -- 172.21.15.89:0/1476075848 learned_addr learned my addr 172.21.15.89:0/1476075848 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 -- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 msgr2=0x7fe778098d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 0x7fe778098d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 -- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 msgr2=0x7fe77814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 0x7fe77814d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 -- 172.21.15.89:0/1476075848 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768009420 con 0x7fe77806f7c0 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77d928700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 0x7fe77814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77c926700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe76800ec50 tx=0x7fe7680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800c850 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800c9b0 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe770009a20 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800cd50 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.353+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77809a320 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.354+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7780b1e80 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.354+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe768013680 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.355+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe76805b420 con 0x7fe77806f7c0 2024-02-10T00:05:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.358+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fe768039640 con 0x7fe77806f7c0 2024-02-10T00:05:03.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.546+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe77804c710 con 0x7fe77806f7c0 2024-02-10T00:05:03.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.548+0000 7fe76d7fa700 1 -- 172.21.15.89:0/1476075848 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+105266 (secure 0 0 0) 0x7fe76803ce30 con 0x7fe77806f7c0 2024-02-10T00:05:03.552 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 >> v1:172.21.15.89:6816/47970 conn(0x7fe75c046070 legacy=0x7fe75c048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 msgr2=0x7fe77814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe76800ec50 tx=0x7fe7680091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 shutdown_connections 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77813f060 0x7fe77814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe778063740 0x7fe778098d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 --2- 172.21.15.89:0/1476075848 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe77806f7c0 0x7fe77814d0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 >> 172.21.15.89:0/1476075848 conn(0x7fe77806a820 msgr2=0x7fe7780b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 shutdown_connections 2024-02-10T00:05:03.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.550+0000 7fe77f38b700 1 -- 172.21.15.89:0/1476075848 wait complete. 2024-02-10T00:05:03.564 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":10,"active_gid":14098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6816","nonce":47970}]},"active_addr":"172.21.15.89:6816/47970","active_change":"2024-02-10T00:04:30.116441+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14101,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1870718962}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3112977894}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2565937983}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2992104056}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3550812814}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2620796327}]}]} 2024-02-10T00:05:03.566 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-10T00:05:03.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-10T00:05:03.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:03.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.680+0000 7f560509e700 1 Processor -- start 2024-02-10T00:05:03.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.680+0000 7f560509e700 1 -- start start 2024-02-10T00:05:03.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56000a9e00 con 0x7f5600063e50 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5600064220 con 0x7f560006ec60 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f560509e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560013e480 con 0x7f560006f0b0 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fe59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44496/0 (socket says 172.21.15.89:44496) 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fe59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48116/0 (socket says 172.21.15.89:48116) 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fed9d700 1 -- 172.21.15.89:0/2335695237 learned_addr learned my addr 172.21.15.89:0/2335695237 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:03.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47058/0 (socket says 172.21.15.89:47058) 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 -- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 msgr2=0x7f560013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 -- 172.21.15.89:0/2335695237 >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 msgr2=0x7f56000aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 --2- 172.21.15.89:0/2335695237 >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 -- 172.21.15.89:0/2335695237 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560006e560 con 0x7f560006f0b0 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fed9d700 1 --2- 172.21.15.89:0/2335695237 >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fe59c700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55ff59e700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009e60 tx=0x7f55f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c0e4d43cdae3b37 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fdd9b700 1 -- 172.21.15.89:0/2335695237 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800e070 con 0x7f560006f0b0 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fdd9b700 1 -- 172.21.15.89:0/2335695237 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800bb40 con 0x7f560006f0b0 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.681+0000 7f55fdd9b700 1 -- 172.21.15.89:0/2335695237 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8012430 con 0x7f560006f0b0 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 -- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 msgr2=0x7f560013ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009e60 tx=0x7f55f8009780 comp rx=0 tx=0).stop 2024-02-10T00:05:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 -- 172.21.15.89:0/2335695237 shutdown_connections 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560013ee70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 --2- 172.21.15.89:0/2335695237 >> v2:172.21.15.89:3300/0 conn(0x7f5600063e50 0x7f56000aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 --2- 172.21.15.89:0/2335695237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560006ec60 0x7f560013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 -- 172.21.15.89:0/2335695237 >> 172.21.15.89:0/2335695237 conn(0x7f560006c7c0 msgr2=0x7f5600063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 -- 172.21.15.89:0/2335695237 shutdown_connections 2024-02-10T00:05:03.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.682+0000 7f560509e700 1 -- 172.21.15.89:0/2335695237 wait complete. 2024-02-10T00:05:03.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.683+0000 7f560509e700 1 Processor -- start 2024-02-10T00:05:03.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.683+0000 7f560509e700 1 -- start start 2024-02-10T00:05:03.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 0x7f5600099260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 0x7f5600097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600098660 con 0x7f560006ec60 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5600098b90 con 0x7f5600063e50 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56000997a0 con 0x7f560006f0b0 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55fed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 0x7f5600099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55fe59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 0x7f5600097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55fed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 0x7f5600099260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48132/0 (socket says 172.21.15.89:48132) 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55fed9d700 1 -- 172.21.15.89:0/3798275076 learned_addr learned my addr 172.21.15.89:0/3798275076 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47064/0 (socket says 172.21.15.89:47064) 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 -- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 msgr2=0x7f5600099260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 0x7f5600099260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 -- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 msgr2=0x7f5600097de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 0x7f5600097de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 -- 172.21.15.89:0/3798275076 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40094f0 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55fe59c700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 0x7f5600097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55ff59e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55f8016000 tx=0x7f55f8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8027470 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f8027630 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0009420 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f80279f0 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.684+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f8009a20 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.685+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f55f8024070 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.685+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560004c710 con 0x7f560006f0b0 2024-02-10T00:05:03.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.685+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f55f805d880 con 0x7f560006f0b0 2024-02-10T00:05:03.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.689+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f55f801f940 con 0x7f560006f0b0 2024-02-10T00:05:03.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.843+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f560006f590 con 0x7f560006f0b0 2024-02-10T00:05:03.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.844+0000 7f55e6ffd700 1 -- 172.21.15.89:0/3798275076 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f55f801f940 con 0x7f560006f0b0 2024-02-10T00:05:03.846 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:03.846 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:03.183783+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 >> v1:172.21.15.89:6816/47970 conn(0x7f55ec046040 legacy=0x7f55ec0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 msgr2=0x7f560014dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55f8016000 tx=0x7f55f8019000 comp rx=0 tx=0).stop 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 shutdown_connections 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f560006f0b0 0x7f560014dcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5600063e50 0x7f5600099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 --2- 172.21.15.89:0/3798275076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560006ec60 0x7f5600097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.845+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 >> 172.21.15.89:0/3798275076 conn(0x7f560006c7c0 msgr2=0x7f56000b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.846+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 shutdown_connections 2024-02-10T00:05:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.846+0000 7f560509e700 1 -- 172.21.15.89:0/3798275076 wait complete. 2024-02-10T00:05:03.860 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-10T00:05:03.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:03.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.973+0000 7efda4961700 1 Processor -- start 2024-02-10T00:05:03.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.973+0000 7efda4961700 1 -- start start 2024-02-10T00:05:03.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efda4961700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efda4961700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efda01430e0 0x7efda01454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efda4961700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda006e2d0 con 0x7efda006f630 2024-02-10T00:05:03.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efda4961700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda00b1c80 con 0x7efda01430e0 2024-02-10T00:05:03.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efda4961700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda006eb50 con 0x7efda00b18b0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efda01430e0 0x7efda01454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9dd9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7efda006f630 0x7efda0139e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34134/0 (socket says 172.21.15.89:34134) 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9dd9b700 1 -- 172.21.15.89:0/372415258 learned_addr learned my addr 172.21.15.89:0/372415258 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efda01430e0 0x7efda01454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44514/0 (socket says 172.21.15.89:44514) 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 -- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 msgr2=0x7efda006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 -- 172.21.15.89:0/372415258 >> v1:172.21.15.89:6789/0 conn(0x7efda006f630 legacy=0x7efda0139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9ed9d700 1 -- 172.21.15.89:0/372415258 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda006edd0 con 0x7efda01430e0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9d59a700 1 -- 172.21.15.89:0/372415258 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139632814 0 0) 0x7efda006e2d0 con 0x7efda006f630 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.974+0000 7efd9e59c700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda01454c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd9800af70 tx=0x7efd9800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d7f7bdb635536 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efd9d59a700 1 -- 172.21.15.89:0/372415258 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800f070 con 0x7efda01430e0 2024-02-10T00:05:03.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efd9d59a700 1 -- 172.21.15.89:0/372415258 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800a2e0 con 0x7efda01430e0 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efd9d59a700 1 -- 172.21.15.89:0/372415258 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800cc70 con 0x7efda01430e0 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 -- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 msgr2=0x7efda01454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda01454c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd9800af70 tx=0x7efd9800a890 comp rx=0 tx=0).stop 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 -- 172.21.15.89:0/372415258 shutdown_connections 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda01454c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 --2- 172.21.15.89:0/372415258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 -- 172.21.15.89:0/372415258 >> 172.21.15.89:0/372415258 conn(0x7efda006a820 msgr2=0x7efda00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 -- 172.21.15.89:0/372415258 shutdown_connections 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.975+0000 7efda4961700 1 -- 172.21.15.89:0/372415258 wait complete. 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.976+0000 7efda4961700 1 Processor -- start 2024-02-10T00:05:03.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.976+0000 7efda4961700 1 -- start start 2024-02-10T00:05:03.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda0138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda0139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda0139770 con 0x7efda01430e0 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda00aa310 con 0x7efda00b18b0 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efda4961700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efda00aaa60 con 0x7efda006f630 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9e59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9e59c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47072/0 (socket says 172.21.15.89:47072) 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9e59c700 1 -- 172.21.15.89:0/1454612221 learned_addr learned my addr 172.21.15.89:0/1454612221 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda0139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9dd9b700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda0138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 -- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 msgr2=0x7efda01387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 -- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 msgr2=0x7efda0138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda0138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 -- 172.21.15.89:0/1454612221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94009420 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9e59c700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.977+0000 7efd9ed9d700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda0139230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd98016000 tx=0x7efd98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98009b60 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98009ce0 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9800ab30 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9801d690 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda00ae840 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7efd9801da40 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.978+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda004c710 con 0x7efda01430e0 2024-02-10T00:05:03.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.979+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7efd9805ce90 con 0x7efda01430e0 2024-02-10T00:05:03.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:03.982+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7efd98008de0 con 0x7efda01430e0 2024-02-10T00:05:04.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.134+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda006dbb0 con 0x7efda01430e0 2024-02-10T00:05:04.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.135+0000 7efd8e7fc700 1 -- 172.21.15.89:0/1454612221 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11631 (secure 0 0 0) 0x7efd9801dcf0 con 0x7efda01430e0 2024-02-10T00:05:04.137 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:04.137 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:03.183783+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.136+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 >> v1:172.21.15.89:6816/47970 conn(0x7efd80046040 legacy=0x7efd800484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.136+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 msgr2=0x7efda0139230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.136+0000 7efda4961700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda0139230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd98016000 tx=0x7efd98019000 comp rx=0 tx=0).stop 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.136+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 shutdown_connections 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.136+0000 7efda4961700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efda01430e0 0x7efda0139230 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.137+0000 7efda4961700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efda006f630 0x7efda01387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.137+0000 7efda4961700 1 --2- 172.21.15.89:0/1454612221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efda00b18b0 0x7efda0138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.137+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 >> 172.21.15.89:0/1454612221 conn(0x7efda006a820 msgr2=0x7efda013afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.137+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 shutdown_connections 2024-02-10T00:05:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.137+0000 7efda4961700 1 -- 172.21.15.89:0/1454612221 wait complete. 2024-02-10T00:05:04.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-10T00:05:04.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-10T00:05:04.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-10T00:05:04.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-10T00:05:04.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.290+0000 7f9f77755700 1 Processor -- start 2024-02-10T00:05:04.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.290+0000 7f9f77755700 1 -- start start 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f77755700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f700a3f20 0x7f9f7013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f77755700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f70148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f77755700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700a3510 con 0x7f9f700b5220 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f77755700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700a1b70 con 0x7f9f700a3f20 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f77755700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700a1e10 con 0x7f9f7013ef20 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f700a3f20 0x7f9f7013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f700a3f20 0x7f9f7013e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44542/0 (socket says 172.21.15.89:44542) 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f754f1700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9f700b5220 0x7f9f700a29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34150/0 (socket says 172.21.15.89:34150) 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 -- 172.21.15.89:0/1465773475 learned_addr learned my addr 172.21.15.89:0/1465773475 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f75cf2700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f70148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 -- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 msgr2=0x7f9f70148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f70148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 -- 172.21.15.89:0/1465773475 >> v1:172.21.15.89:6789/0 conn(0x7f9f700b5220 legacy=0x7f9f700a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 -- 172.21.15.89:0/1465773475 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700a1830 con 0x7f9f700a3f20 2024-02-10T00:05:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f67fff700 1 -- 172.21.15.89:0/1465773475 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125437761 0 0) 0x7f9f700a3510 con 0x7f9f700b5220 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.291+0000 7f9f74cf0700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f7013e9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f600099b0 tx=0x7f9f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2450c49553f1ba9e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f67fff700 1 -- 172.21.15.89:0/1465773475 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60009ea0 con 0x7f9f700a3f20 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f67fff700 1 -- 172.21.15.89:0/1465773475 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000b8f0 con 0x7f9f700a3f20 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f67fff700 1 -- 172.21.15.89:0/1465773475 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000bc90 con 0x7f9f700a3f20 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 -- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 msgr2=0x7f9f7013e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f7013e9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f600099b0 tx=0x7f9f60009250 comp rx=0 tx=0).stop 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 -- 172.21.15.89:0/1465773475 shutdown_connections 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f70148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 --2- 172.21.15.89:0/1465773475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f7013e9e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 -- 172.21.15.89:0/1465773475 >> 172.21.15.89:0/1465773475 conn(0x7f9f70068710 msgr2=0x7f9f70064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 -- 172.21.15.89:0/1465773475 shutdown_connections 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.292+0000 7f9f77755700 1 -- 172.21.15.89:0/1465773475 wait complete. 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.293+0000 7febe65d7700 1 Processor -- start 2024-02-10T00:05:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.293+0000 7febe65d7700 1 -- start start 2024-02-10T00:05:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7f9f77755700 1 Processor -- start 2024-02-10T00:05:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7f9f77755700 1 -- start start 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febe65d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febe65d7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 0x7febe00a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febe65d7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe0063b10 con 0x7febe00a5130 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febe65d7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe0139bb0 con 0x7febe013f6e0 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febe65d7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe00a2100 con 0x7febe0063740 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febdffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febdffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47082/0 (socket says 172.21.15.89:47082) 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febdffff700 1 -- 172.21.15.89:0/74493515 learned_addr learned my addr 172.21.15.89:0/74493515 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7febdf7fe700 1 --2- 172.21.15.89:0/74493515 >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 0x7febe00a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7f13d4865700 1 Processor -- start 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.294+0000 7f13d4865700 1 -- start start 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdffff700 1 -- 172.21.15.89:0/74493515 >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 msgr2=0x7febe00a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdffff700 1 --2- 172.21.15.89:0/74493515 >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 0x7febe00a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdeffd700 1 -- 172.21.15.89:0/74493515 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575632382 0 0) 0x7febe0063b10 con 0x7febe00a5130 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdffff700 1 -- 172.21.15.89:0/74493515 >> v1:172.21.15.89:6789/0 conn(0x7febe00a5130 legacy=0x7febe013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdffff700 1 -- 172.21.15.89:0/74493515 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe013fb70 con 0x7febe0063740 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f700ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f700b5220 0x7f9f7013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f7013d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700acce0 con 0x7f9f700a3f20 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700ae460 con 0x7f9f7013ef20 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f77755700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700acf00 con 0x7f9f700b5220 2024-02-10T00:05:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdf7fe700 1 --2- 172.21.15.89:0/74493515 >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 0x7febe00a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f75cf2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f7013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d006f630 0x7f13d0139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f75cf2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f7013d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48162/0 (socket says 172.21.15.89:48162) 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f75cf2700 1 -- 172.21.15.89:0/153025167 learned_addr learned my addr 172.21.15.89:0/153025167 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 --2- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f700ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13d013a390 0x7f13d00a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d006e2d0 con 0x7f13d013a390 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00b1c80 con 0x7f13d00b18b0 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13d4865700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d006eb50 con 0x7f13d006f630 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48178/0 (socket says 172.21.15.89:48178) 2024-02-10T00:05:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f13ce59c700 1 -- 172.21.15.89:0/3059100693 learned_addr learned my addr 172.21.15.89:0/3059100693 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7febdffff700 1 --2- 172.21.15.89:0/74493515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febd00099b0 tx=0x7febd0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d854a370581d3e69 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 -- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f700b5220 msgr2=0x7f9f7013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 --2- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9f700b5220 0x7f9f7013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 -- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 msgr2=0x7f9f7013d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 --2- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f7013ef20 0x7f9f7013d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.295+0000 7f9f754f1700 1 -- 172.21.15.89:0/153025167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600094f0 con 0x7f9f700a3f20 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ced9d700 1 --2- 172.21.15.89:0/3059100693 >> v2:172.21.15.89:3300/0 conn(0x7f13d013a390 0x7f13d00a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 -- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d006f630 msgr2=0x7f13d0139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 --2- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d006f630 0x7f13d0139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 -- 172.21.15.89:0/3059100693 >> v2:172.21.15.89:3300/0 conn(0x7f13d013a390 msgr2=0x7f13d00a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 --2- 172.21.15.89:0/3059100693 >> v2:172.21.15.89:3300/0 conn(0x7f13d013a390 0x7f13d00a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 -- 172.21.15.89:0/3059100693 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d006edd0 con 0x7f13d00b18b0 2024-02-10T00:05:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f754f1700 1 --2- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f700ac7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0011e0 tx=0x7f9f6c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7febdeffd700 1 -- 172.21.15.89:0/74493515 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0009ea0 con 0x7febe0063740 2024-02-10T00:05:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7febdeffd700 1 -- 172.21.15.89:0/74493515 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000b8f0 con 0x7febe0063740 2024-02-10T00:05:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7febdeffd700 1 -- 172.21.15.89:0/74493515 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000bc90 con 0x7febe0063740 2024-02-10T00:05:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13ce59c700 1 --2- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c00099b0 tx=0x7f13c0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd47f168875817a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c005a70 con 0x7f9f700a3f20 2024-02-10T00:05:04.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c005bf0 con 0x7f9f700a3f20 2024-02-10T00:05:04.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0070d0 con 0x7f9f700a3f20 2024-02-10T00:05:04.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f700aec90 con 0x7f9f700a3f20 2024-02-10T00:05:04.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f700ab790 con 0x7f9f700a3f20 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13cd59a700 1 -- 172.21.15.89:0/3059100693 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000b860 con 0x7f13d00b18b0 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13cd59a700 1 -- 172.21.15.89:0/3059100693 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000b9c0 con 0x7f13d00b18b0 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.296+0000 7f13cd59a700 1 -- 172.21.15.89:0/3059100693 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000bd60 con 0x7f13d00b18b0 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 -- 172.21.15.89:0/74493515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 msgr2=0x7febe00a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 --2- 172.21.15.89:0/74493515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febd00099b0 tx=0x7febd0009250 comp rx=0 tx=0).stop 2024-02-10T00:05:04.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7f13d4865700 1 -- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 msgr2=0x7f13d006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7f13d4865700 1 --2- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c00099b0 tx=0x7f13c0009250 comp rx=0 tx=0).stop 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 -- 172.21.15.89:0/74493515 shutdown_connections 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 --2- 172.21.15.89:0/74493515 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe00a3240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 --2- 172.21.15.89:0/74493515 >> v2:172.21.15.89:3300/0 conn(0x7febe013f6e0 0x7febe00a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 -- 172.21.15.89:0/74493515 >> 172.21.15.89:0/74493515 conn(0x7febe006a820 msgr2=0x7febe00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 -- 172.21.15.89:0/74493515 shutdown_connections 2024-02-10T00:05:04.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f7004c710 con 0x7f9f700a3f20 2024-02-10T00:05:04.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.297+0000 7febe65d7700 1 -- 172.21.15.89:0/74493515 wait complete. 2024-02-10T00:05:04.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.298+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9f6c007440 con 0x7f9f700a3f20 2024-02-10T00:05:04.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.298+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9f6c05ad80 con 0x7f9f700a3f20 2024-02-10T00:05:04.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.298+0000 7febe65d7700 1 Processor -- start 2024-02-10T00:05:04.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.298+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 --> v1:172.21.15.89:6800/50630 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f54052a10 con 0x7f9f5404ed50 2024-02-10T00:05:04.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.298+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f6c05b150 con 0x7f9f700a3f20 2024-02-10T00:05:04.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f13d4865700 1 -- 172.21.15.89:0/3059100693 shutdown_connections 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f13d4865700 1 --2- 172.21.15.89:0/3059100693 >> v2:172.21.15.89:3300/0 conn(0x7f13d013a390 0x7f13d00a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f13d4865700 1 --2- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d00b18b0 0x7f13d006cb90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f13d4865700 1 --2- 172.21.15.89:0/3059100693 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d006f630 0x7f13d0139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f13d4865700 1 -- 172.21.15.89:0/3059100693 >> 172.21.15.89:0/3059100693 conn(0x7f13d006a820 msgr2=0x7f13d00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 -- start start 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7febe00a5130 0x7febe00a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febe013f6e0 0x7febe00a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe00a0ae0 con 0x7febe013f6e0 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe006da60 con 0x7febe00a5130 2024-02-10T00:05:04.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe65d7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe006d7a0 con 0x7febe0063740 2024-02-10T00:05:04.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== osd.1 v1:172.21.15.89:6800/50630 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f9f54052a10 con 0x7f9f5404ed50 2024-02-10T00:05:04.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febdf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7febe00a5130 0x7febe00a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febdf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7febe00a5130 0x7febe00a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48194/0 (socket says 172.21.15.89:48194) 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febdf7fe700 1 -- 172.21.15.89:0/3441487805 learned_addr learned my addr 172.21.15.89:0/3441487805 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febe4b74700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febe013f6e0 0x7febe00a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.299+0000 7febdffff700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 -- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7febe00a5130 msgr2=0x7febe00a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7febe00a5130 0x7febe00a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 -- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febe013f6e0 msgr2=0x7febe00a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febe013f6e0 0x7febe00a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 -- 172.21.15.89:0/3441487805 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009420 con 0x7febe0063740 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febe4b74700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febe013f6e0 0x7febe00a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:04.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7f13d4865700 1 -- 172.21.15.89:0/3059100693 shutdown_connections 2024-02-10T00:05:04.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7febdffff700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe006cdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febe00a18f0 tx=0x7febd0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.300+0000 7f13d4865700 1 -- 172.21.15.89:0/3059100693 wait complete. 2024-02-10T00:05:04.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7faf8b038700 1 Processor -- start 2024-02-10T00:05:04.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7faf8b038700 1 -- start start 2024-02-10T00:05:04.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000ba60 con 0x7febe0063740 2024-02-10T00:05:04.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000bbc0 con 0x7febe0063740 2024-02-10T00:05:04.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0026680 con 0x7febe0063740 2024-02-10T00:05:04.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd00094f0 con 0x7febe0063740 2024-02-10T00:05:04.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7faf8b038700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf840a6f50 0x7faf840a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7faf8b038700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf8b038700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840a7320 con 0x7faf840a6500 2024-02-10T00:05:04.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf8b038700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840a7980 con 0x7faf840a6f50 2024-02-10T00:05:04.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf8b038700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8413c140 con 0x7faf8413c9b0 2024-02-10T00:05:04.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe0133290 con 0x7febe0063740 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf840a6f50 0x7faf840a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf840a6f50 0x7faf840a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44584/0 (socket says 172.21.15.89:44584) 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 -- 172.21.15.89:0/3749850212 learned_addr learned my addr 172.21.15.89:0/3749850212 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf83fff700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.301+0000 7f13d4865700 1 Processor -- start 2024-02-10T00:05:04.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7f13d4865700 1 -- start start 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 -- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 msgr2=0x7faf840a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 -- 172.21.15.89:0/3749850212 >> v1:172.21.15.89:6789/0 conn(0x7faf840a6500 legacy=0x7faf84067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febe004c710 con 0x7febe0063740 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.302+0000 7faf88dd4700 1 -- 172.21.15.89:0/3749850212 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8413c3e0 con 0x7faf840a6f50 2024-02-10T00:05:04.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7faf88dd4700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6f50 0x7faf840a8080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009f20 tx=0x7faf7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a691c14bbc0e3a5f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d006f630 0x7f13d0138410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d00b18b0 0x7f13d00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7febd0023030 con 0x7febe0063740 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7febd005c950 con 0x7febe0063740 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 --> v1:172.21.15.89:6808/50544 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febcc052c10 con 0x7febcc04ef50 2024-02-10T00:05:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7febd0061220 con 0x7febe0063740 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7faf837fe700 1 -- 172.21.15.89:0/3749850212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00e070 con 0x7faf840a6f50 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7faf837fe700 1 -- 172.21.15.89:0/3749850212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00ba40 con 0x7faf840a6f50 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7faf837fe700 1 -- 172.21.15.89:0/3749850212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0092e0 con 0x7faf840a6f50 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d013a390 0x7f13d00adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0127e40 con 0x7f13d00b18b0 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0138a90 con 0x7f13d006f630 2024-02-10T00:05:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13d4865700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0137ab0 con 0x7f13d013a390 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d006f630 0x7f13d0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d006f630 0x7f13d0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48200/0 (socket says 172.21.15.89:48200) 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13ce59c700 1 -- 172.21.15.89:0/957545207 learned_addr learned my addr 172.21.15.89:0/957545207 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13cdd9b700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d00b18b0 0x7f13d00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13ced9d700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d013a390 0x7f13d00adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13cdd9b700 1 -- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d013a390 msgr2=0x7f13d00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13cdd9b700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f13d013a390 0x7f13d00adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13cdd9b700 1 -- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d006f630 msgr2=0x7f13d0138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.303+0000 7f13cdd9b700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13d006f630 0x7f13d0138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13cdd9b700 1 -- 172.21.15.89:0/957545207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00094f0 con 0x7f13d00b18b0 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13cdd9b700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d00b18b0 0x7f13d00ada30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13d013ede0 tx=0x7f13c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 -- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6f50 msgr2=0x7faf840a8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6f50 0x7faf840a8080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009f20 tx=0x7faf7c009840 comp rx=0 tx=0).stop 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400f510 con 0x7f13d00b18b0 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 -- 172.21.15.89:0/3749850212 shutdown_connections 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6f50 0x7faf840a8080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 --2- 172.21.15.89:0/3749850212 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 -- 172.21.15.89:0/3749850212 >> 172.21.15.89:0/3749850212 conn(0x7faf8406c7c0 msgr2=0x7faf84063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400f670 con 0x7f13d00b18b0 2024-02-10T00:05:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400fa10 con 0x7f13d00b18b0 2024-02-10T00:05:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 -- 172.21.15.89:0/3749850212 shutdown_connections 2024-02-10T00:05:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d0138cf0 con 0x7f13d00b18b0 2024-02-10T00:05:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d01398f0 con 0x7f13d00b18b0 2024-02-10T00:05:04.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.304+0000 7faf8b038700 1 -- 172.21.15.89:0/3749850212 wait complete. 2024-02-10T00:05:04.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.305+0000 7faf8b038700 1 Processor -- start 2024-02-10T00:05:04.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.305+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13d0139610 con 0x7f13d00b18b0 2024-02-10T00:05:04.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f13c402e450 con 0x7f13d00b18b0 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 -- start start 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6500 0x7faf84152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 0x7faf840a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840a0a40 con 0x7faf840a6500 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840a9fa0 con 0x7faf840a6f50 2024-02-10T00:05:04.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf8b038700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf840a1c70 con 0x7faf8413c9b0 2024-02-10T00:05:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f13c405aca0 con 0x7f13d00b18b0 2024-02-10T00:05:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 --> v1:172.21.15.89:6812/50885 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13b0052a60 con 0x7f13b004eda0 2024-02-10T00:05:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13c405b070 con 0x7f13d00b18b0 2024-02-10T00:05:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf83fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 0x7faf840a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf83fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 0x7faf840a1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48210/0 (socket says 172.21.15.89:48210) 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.306+0000 7faf83fff700 1 -- 172.21.15.89:0/92125210 learned_addr learned my addr 172.21.15.89:0/92125210 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 -- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 msgr2=0x7faf840a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 --2- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7faf8413c9b0 0x7faf840a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 -- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6500 msgr2=0x7faf84152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 --2- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840a6500 0x7faf84152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 -- 172.21.15.89:0/92125210 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009ae0 con 0x7faf840a6f50 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf83fff700 1 --2- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 0x7faf840a1f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d860 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78009610 con 0x7faf840a6f50 2024-02-10T00:05:04.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== osd.3 v1:172.21.15.89:6812/50885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f13b0052a60 con 0x7f13b004eda0 2024-02-10T00:05:04.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78009770 con 0x7faf840a6f50 2024-02-10T00:05:04.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840a1960 con 0x7faf840a6f50 2024-02-10T00:05:04.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.307+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78009b30 con 0x7faf840a6f50 2024-02-10T00:05:04.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.308+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8413ad40 con 0x7faf840a6f50 2024-02-10T00:05:04.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.308+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf8404c710 con 0x7faf840a6f50 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.308+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7faf7801e460 con 0x7faf840a6f50 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.309+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7faf78064400 con 0x7faf840a6f50 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.309+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 --> v1:172.21.15.89:6804/50752 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf70052a90 con 0x7faf7004edd0 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.309+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf78064700 con 0x7faf840a6f50 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.310+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== osd.2 v1:172.21.15.89:6804/50752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7faf70052a90 con 0x7faf7004edd0 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.310+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== osd.0 v1:172.21.15.89:6808/50544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7febcc052c10 con 0x7febcc04ef50 2024-02-10T00:05:04.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 --> v1:172.21.15.89:6800/50630 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f700ab1c0 con 0x7f9f5404ed50 2024-02-10T00:05:04.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f657fa700 1 -- 172.21.15.89:0/153025167 <== osd.1 v1:172.21.15.89:6800/50630 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 851964294) 0x7f9f700ab1c0 con 0x7f9f5404ed50 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 >> v1:172.21.15.89:6800/50630 conn(0x7f9f5404ed50 legacy=0x7f9f540511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 >> v1:172.21.15.89:6816/47970 conn(0x7f9f54046040 legacy=0x7f9f540484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 msgr2=0x7f9f700ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.327+0000 7f9f77755700 1 --2- 172.21.15.89:0/153025167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f700a3f20 0x7f9f700ac7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0011e0 tx=0x7f9f6c007d30 comp rx=0 tx=0).stop 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.328+0000 7f9f75cf2700 1 -- 172.21.15.89:0/153025167 reap_dead start 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.328+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 shutdown_connections 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.328+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 >> 172.21.15.89:0/153025167 conn(0x7f9f70068710 msgr2=0x7f9f700b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.328+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 shutdown_connections 2024-02-10T00:05:04.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.328+0000 7f9f77755700 1 -- 172.21.15.89:0/153025167 wait complete. 2024-02-10T00:05:04.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.333+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 --> v1:172.21.15.89:6812/50885 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13d00ae6f0 con 0x7f13b004eda0 2024-02-10T00:05:04.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.333+0000 7f13be7fc700 1 -- 172.21.15.89:0/957545207 <== osd.3 v1:172.21.15.89:6812/50885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7f13d00ae6f0 con 0x7f13b004eda0 2024-02-10T00:05:04.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 >> v1:172.21.15.89:6812/50885 conn(0x7f13b004eda0 legacy=0x7f13b00511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 >> v1:172.21.15.89:6816/47970 conn(0x7f13b0046010 legacy=0x7f13b00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d00b18b0 msgr2=0x7f13d00ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 --2- 172.21.15.89:0/957545207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d00b18b0 0x7f13d00ada30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13d013ede0 tx=0x7f13c40091d0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13ced9d700 1 -- 172.21.15.89:0/957545207 reap_dead start 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 shutdown_connections 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 >> 172.21.15.89:0/957545207 conn(0x7f13d006a820 msgr2=0x7f13d013a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 shutdown_connections 2024-02-10T00:05:04.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.334+0000 7f13d4865700 1 -- 172.21.15.89:0/957545207 wait complete. 2024-02-10T00:05:04.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.336+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 --> v1:172.21.15.89:6804/50752 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf840a59d0 con 0x7faf7004edd0 2024-02-10T00:05:04.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf80ff9700 1 -- 172.21.15.89:0/92125210 <== osd.2 v1:172.21.15.89:6804/50752 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7faf840a59d0 con 0x7faf7004edd0 2024-02-10T00:05:04.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 >> v1:172.21.15.89:6804/50752 conn(0x7faf7004edd0 legacy=0x7faf70051220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 >> v1:172.21.15.89:6816/47970 conn(0x7faf70046040 legacy=0x7faf700484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 msgr2=0x7faf840a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 --2- 172.21.15.89:0/92125210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840a6f50 0x7faf840a1f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d860 tx=0x7faf78008040 comp rx=0 tx=0).stop 2024-02-10T00:05:04.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf895d5700 1 -- 172.21.15.89:0/92125210 reap_dead start 2024-02-10T00:05:04.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 shutdown_connections 2024-02-10T00:05:04.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.337+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 >> 172.21.15.89:0/92125210 conn(0x7faf8406c7c0 msgr2=0x7faf84067970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.338+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 shutdown_connections 2024-02-10T00:05:04.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.338+0000 7faf8b038700 1 -- 172.21.15.89:0/92125210 wait complete. 2024-02-10T00:05:04.343 INFO:teuthology.orchestra.run.smithi089.stdout:120259084293 2024-02-10T00:05:04.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:05:04.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.341+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 --> v1:172.21.15.89:6808/50544 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febe00a1bc0 con 0x7febcc04ef50 2024-02-10T00:05:04.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febc7fff700 1 -- 172.21.15.89:0/3441487805 <== osd.0 v1:172.21.15.89:6808/50544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 851964294) 0x7febe00a1bc0 con 0x7febcc04ef50 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 >> v1:172.21.15.89:6808/50544 conn(0x7febcc04ef50 legacy=0x7febcc0513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 >> v1:172.21.15.89:6816/47970 conn(0x7febcc0461c0 legacy=0x7febcc048670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 msgr2=0x7febe006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 --2- 172.21.15.89:0/3441487805 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7febe0063740 0x7febe006cdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febe00a18f0 tx=0x7febd0017000 comp rx=0 tx=0).stop 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe4b74700 1 -- 172.21.15.89:0/3441487805 reap_dead start 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 shutdown_connections 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 >> 172.21.15.89:0/3441487805 conn(0x7febe006a820 msgr2=0x7febe013c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 shutdown_connections 2024-02-10T00:05:04.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.342+0000 7febe65d7700 1 -- 172.21.15.89:0/3441487805 wait complete. 2024-02-10T00:05:04.351 INFO:teuthology.orchestra.run.smithi089.stdout:133143986180 2024-02-10T00:05:04.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:05:04.354 INFO:teuthology.orchestra.run.smithi089.stdout:124554051588 2024-02-10T00:05:04.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:05:04.360 INFO:teuthology.orchestra.run.smithi089.stdout:120259084293 2024-02-10T00:05:04.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:05:04.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.469+0000 7efffb651700 1 Processor -- start 2024-02-10T00:05:04.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 -- start start 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff40b1a10 con 0x7efff4063740 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff406dbb0 con 0x7efff413f060 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efffb651700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff413f500 con 0x7efff406f7c0 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.470+0000 7efff9bee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34510/0 (socket says 172.21.15.89:34510) 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff93ed700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7efff4063740 0x7efff406dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33688/0 (socket says 172.21.15.89:33688) 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 -- 172.21.15.89:0/1832371393 learned_addr learned my addr 172.21.15.89:0/1832371393 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff8bec700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 -- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 msgr2=0x7efff413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 -- 172.21.15.89:0/1832371393 >> v1:172.21.15.89:6789/0 conn(0x7efff4063740 legacy=0x7efff406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7effebfff700 1 -- 172.21.15.89:0/1832371393 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888429651 0 0) 0x7efff40b1a10 con 0x7efff4063740 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 -- 172.21.15.89:0/1832371393 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4063b10 con 0x7efff413f060 2024-02-10T00:05:04.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7efff9bee700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec00d1d0 tx=0x7effec00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ad37ebffb2b1a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7effebfff700 1 -- 172.21.15.89:0/1832371393 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec010070 con 0x7efff413f060 2024-02-10T00:05:04.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7effebfff700 1 -- 172.21.15.89:0/1832371393 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec00de70 con 0x7efff413f060 2024-02-10T00:05:04.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.471+0000 7effebfff700 1 -- 172.21.15.89:0/1832371393 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec00b2e0 con 0x7efff413f060 2024-02-10T00:05:04.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 -- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 msgr2=0x7efff4145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec00d1d0 tx=0x7effec00ba50 comp rx=0 tx=0).stop 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 -- 172.21.15.89:0/1832371393 shutdown_connections 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff413f060 0x7efff4145960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 --2- 172.21.15.89:0/1832371393 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 -- 172.21.15.89:0/1832371393 >> 172.21.15.89:0/1832371393 conn(0x7efff406a820 msgr2=0x7efff40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 -- 172.21.15.89:0/1832371393 shutdown_connections 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.472+0000 7efffb651700 1 -- 172.21.15.89:0/1832371393 wait complete. 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.473+0000 7efffb651700 1 Processor -- start 2024-02-10T00:05:04.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.473+0000 7efffb651700 1 -- start start 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff4063740 0x7efff409deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 0x7efff409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff409c830 con 0x7efff413f060 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff409ea00 con 0x7efff4063740 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efffb651700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff409ca60 con 0x7efff406f7c0 2024-02-10T00:05:04.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57900/0 (socket says 172.21.15.89:57900) 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 -- 172.21.15.89:0/2695295829 learned_addr learned my addr 172.21.15.89:0/2695295829 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff93ed700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff4063740 0x7efff409deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff9bee700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 0x7efff409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 -- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff4063740 msgr2=0x7efff409deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff4063740 0x7efff409deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 -- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 msgr2=0x7efff409ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 0x7efff409ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff8bec700 1 -- 172.21.15.89:0/2695295829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec00bcf0 con 0x7efff406f7c0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.474+0000 7efff9bee700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 0x7efff409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.475+0000 7efff8bec700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effe400ec50 tx=0x7effe40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.475+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400c850 con 0x7efff406f7c0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.475+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe400c9b0 con 0x7efff406f7c0 2024-02-10T00:05:04.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.475+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400cd70 con 0x7efff406f7c0 2024-02-10T00:05:04.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.476+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff40a33b0 con 0x7efff406f7c0 2024-02-10T00:05:04.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.476+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff40a2b20 con 0x7efff406f7c0 2024-02-10T00:05:04.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.477+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff409fb50 con 0x7efff406f7c0 2024-02-10T00:05:04.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.478+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7effe4013680 con 0x7efff406f7c0 2024-02-10T00:05:04.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.478+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7effe405b270 con 0x7efff406f7c0 2024-02-10T00:05:04.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.484+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7effe4039490 con 0x7efff406f7c0 2024-02-10T00:05:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.488+0000 7f7175b37700 1 Processor -- start 2024-02-10T00:05:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.488+0000 7f7175b37700 1 -- start start 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 0x7f71700a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71700a5660 0x7f717013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5a70 0x7f717013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71700a62d0 con 0x7f71700a5660 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7170064220 con 0x7f7170063e50 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f7175b37700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71700a67f0 con 0x7f71700a5a70 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71700a5660 0x7f717013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71700a5660 0x7f717013b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60446/0 (socket says 172.21.15.89:60446) 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 -- 172.21.15.89:0/286755453 learned_addr learned my addr 172.21.15.89:0/286755453 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716ffff700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5a70 0x7f717013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 -- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5a70 msgr2=0x7f717013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5a70 0x7f717013bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716f7fe700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 0x7f71700a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 -- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 msgr2=0x7f71700a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 0x7f71700a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 -- 172.21.15.89:0/286755453 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700a7510 con 0x7f71700a5660 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716f7fe700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 0x7f71700a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.489+0000 7f716effd700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71700a5660 0x7f717013b6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71640099b0 tx=0x7f7164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdfbc93562f7030 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f716e7fc700 1 -- 172.21.15.89:0/286755453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164009ea0 con 0x7f71700a5660 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f716e7fc700 1 -- 172.21.15.89:0/286755453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400b860 con 0x7f71700a5660 2024-02-10T00:05:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f716e7fc700 1 -- 172.21.15.89:0/286755453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400bc00 con 0x7f71700a5660 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 -- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71700a5660 msgr2=0x7f717013b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71700a5660 0x7f717013b6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71640099b0 tx=0x7f7164009250 comp rx=0 tx=0).stop 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 -- 172.21.15.89:0/286755453 shutdown_connections 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5a70 0x7f717013bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7170063e50 0x7f71700a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 --2- 172.21.15.89:0/286755453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71700a5660 0x7f717013b6c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.490+0000 7f7175b37700 1 -- 172.21.15.89:0/286755453 >> 172.21.15.89:0/286755453 conn(0x7f717006c7c0 msgr2=0x7f7170063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.491+0000 7f7175b37700 1 -- 172.21.15.89:0/286755453 shutdown_connections 2024-02-10T00:05:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.491+0000 7f7175b37700 1 -- 172.21.15.89:0/286755453 wait complete. 2024-02-10T00:05:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.492+0000 7f7175b37700 1 Processor -- start 2024-02-10T00:05:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.492+0000 7f7175b37700 1 -- start start 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5660 0x7f71701402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71700a5a70 0x7f7170140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7170140d40 con 0x7f7170063e50 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71700ae4d0 con 0x7f71700a5a70 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f7175b37700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7170141440 con 0x7f71700a5660 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60458/0 (socket says 172.21.15.89:60458) 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 -- 172.21.15.89:0/2027304166 learned_addr learned my addr 172.21.15.89:0/2027304166 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716effd700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5660 0x7f71701402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716ffff700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71700a5a70 0x7f7170140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 -- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5660 msgr2=0x7f71701402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5660 0x7f71701402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 -- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71700a5a70 msgr2=0x7f7170140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71700a5a70 0x7f7170140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 -- 172.21.15.89:0/2027304166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640094f0 con 0x7f7170063e50 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.493+0000 7f716f7fe700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f716000c850 tx=0x7f7160008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.494+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160011600 con 0x7f7170063e50 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.494+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717013fde0 con 0x7f7170063e50 2024-02-10T00:05:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.494+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7160011760 con 0x7f7170063e50 2024-02-10T00:05:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.494+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160011b00 con 0x7f7170063e50 2024-02-10T00:05:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.494+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71700ade30 con 0x7f7170063e50 2024-02-10T00:05:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.495+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f71600223a0 con 0x7f7170063e50 2024-02-10T00:05:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.495+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717004c710 con 0x7f7170063e50 2024-02-10T00:05:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.495+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f716005b590 con 0x7f7170063e50 2024-02-10T00:05:04.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.502+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f7160039640 con 0x7f7170063e50 2024-02-10T00:05:04.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.525+0000 7f784b4b7700 1 Processor -- start 2024-02-10T00:05:04.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.525+0000 7f784b4b7700 1 -- start start 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f784b4b7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78440b5220 0x7f78440a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f784b4b7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f7844148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f784b4b7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78440a3510 con 0x7f78440a29e0 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f784b4b7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78440a4460 con 0x7f78440b5220 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f784b4b7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78440a1b70 con 0x7f78440a2db0 2024-02-10T00:05:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78440b5220 0x7f78440a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78440b5220 0x7f78440a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60460/0 (socket says 172.21.15.89:60460) 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 -- 172.21.15.89:0/4234590544 learned_addr learned my addr 172.21.15.89:0/4234590544 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849a54700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f7844148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 -- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 msgr2=0x7f7844148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f7844148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 -- 172.21.15.89:0/4234590544 >> v1:172.21.15.89:6789/0 conn(0x7f78440a29e0 legacy=0x7f784413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849253700 1 -- 172.21.15.89:0/4234590544 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78440a1e10 con 0x7f78440b5220 2024-02-10T00:05:04.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.526+0000 7f7849a54700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f7844148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:04.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f7849253700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b5220 0x7f78440a3f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78400099b0 tx=0x7f7840009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d6435fd26c0211 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f783bfff700 1 -- 172.21.15.89:0/4234590544 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840009ea0 con 0x7f78440b5220 2024-02-10T00:05:04.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f783bfff700 1 -- 172.21.15.89:0/4234590544 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000b860 con 0x7f78440b5220 2024-02-10T00:05:04.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f783bfff700 1 -- 172.21.15.89:0/4234590544 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000bc00 con 0x7f78440b5220 2024-02-10T00:05:04.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f784b4b7700 1 -- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b5220 msgr2=0x7f78440a3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.527+0000 7f784b4b7700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b5220 0x7f78440a3f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78400099b0 tx=0x7f7840009250 comp rx=0 tx=0).stop 2024-02-10T00:05:04.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 -- 172.21.15.89:0/4234590544 shutdown_connections 2024-02-10T00:05:04.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b5220 0x7f78440a3f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 --2- 172.21.15.89:0/4234590544 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f7844148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 -- 172.21.15.89:0/4234590544 >> 172.21.15.89:0/4234590544 conn(0x7f7844068710 msgr2=0x7f7844064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 -- 172.21.15.89:0/4234590544 shutdown_connections 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.528+0000 7f784b4b7700 1 -- 172.21.15.89:0/4234590544 wait complete. 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.529+0000 7f784b4b7700 1 Processor -- start 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.529+0000 7f784b4b7700 1 -- start start 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 0x7f78440acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b5220 0x7f78441513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440a8ca0 con 0x7f78440a29e0 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440abdb0 con 0x7f78440b5220 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f784b4b7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78440ad450 con 0x7f78440a2db0 2024-02-10T00:05:04.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7849253700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 0x7f78440acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57938/0 (socket says 172.21.15.89:57938) 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 -- 172.21.15.89:0/3822077581 learned_addr learned my addr 172.21.15.89:0/3822077581 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7849a54700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b5220 0x7f78441513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 -- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b5220 msgr2=0x7f78441513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b5220 0x7f78441513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 -- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 msgr2=0x7f78440acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 0x7f78440acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7848a52700 1 -- 172.21.15.89:0/3822077581 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009a20 con 0x7f78440a2db0 2024-02-10T00:05:04.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.530+0000 7f7849253700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 0x7f78440acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:04.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f7848a52700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f783400c5c0 tx=0x7f783400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834011590 con 0x7f78440a2db0 2024-02-10T00:05:04.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7834011710 con 0x7f78440a2db0 2024-02-10T00:05:04.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78400094f0 con 0x7f78440a2db0 2024-02-10T00:05:04.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834011ad0 con 0x7f78440a2db0 2024-02-10T00:05:04.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.531+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78440ae2e0 con 0x7f78440a2db0 2024-02-10T00:05:04.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.532+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f783401b3b0 con 0x7f78440a2db0 2024-02-10T00:05:04.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.532+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f783405a660 con 0x7f78440a2db0 2024-02-10T00:05:04.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.533+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784404c710 con 0x7f78440a2db0 2024-02-10T00:05:04.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.538+0000 7f5e872e6700 1 Processor -- start 2024-02-10T00:05:04.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 -- start start 2024-02-10T00:05:04.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f7834017080 con 0x7f78440a2db0 2024-02-10T00:05:04.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e80063e50 0x7f5e800aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 0x7f5e80148c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e80064220 con 0x7f5e8006ec60 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800a9e00 con 0x7f5e80063e50 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e872e6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8013e480 con 0x7f5e8006f0e0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e85883700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 0x7f5e80148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.539+0000 7f5e84881700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5e8006ec60 0x7f5e8013e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33706/0 (socket says 172.21.15.89:33706) 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e84881700 1 -- 172.21.15.89:0/3653118984 learned_addr learned my addr 172.21.15.89:0/3653118984 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85082700 1 --2- 172.21.15.89:0/3653118984 >> v2:172.21.15.89:3300/0 conn(0x7f5e80063e50 0x7f5e800aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85883700 1 -- 172.21.15.89:0/3653118984 >> v2:172.21.15.89:3300/0 conn(0x7f5e80063e50 msgr2=0x7f5e800aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e77fff700 1 -- 172.21.15.89:0/3653118984 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055914907 0 0) 0x7f5e80064220 con 0x7f5e8006ec60 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85883700 1 --2- 172.21.15.89:0/3653118984 >> v2:172.21.15.89:3300/0 conn(0x7f5e80063e50 0x7f5e800aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85883700 1 -- 172.21.15.89:0/3653118984 >> v1:172.21.15.89:6789/0 conn(0x7f5e8006ec60 legacy=0x7f5e8013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85883700 1 -- 172.21.15.89:0/3653118984 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8006e560 con 0x7f5e8006f0e0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e85883700 1 --2- 172.21.15.89:0/3653118984 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 0x7f5e80148c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009e60 tx=0x7f5e78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd35dade4093ef17 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e77fff700 1 -- 172.21.15.89:0/3653118984 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800e070 con 0x7f5e8006f0e0 2024-02-10T00:05:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e77fff700 1 -- 172.21.15.89:0/3653118984 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800bbf0 con 0x7f5e8006f0e0 2024-02-10T00:05:04.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.540+0000 7f5e77fff700 1 -- 172.21.15.89:0/3653118984 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78012430 con 0x7f5e8006f0e0 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 -- 172.21.15.89:0/3653118984 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 msgr2=0x7f5e80148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3653118984 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 0x7f5e80148c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009e60 tx=0x7f5e78009780 comp rx=0 tx=0).stop 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 -- 172.21.15.89:0/3653118984 shutdown_connections 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3653118984 >> v2:172.21.15.89:3300/0 conn(0x7f5e80063e50 0x7f5e800aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3653118984 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006f0e0 0x7f5e80148c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 -- 172.21.15.89:0/3653118984 >> 172.21.15.89:0/3653118984 conn(0x7f5e8006c7c0 msgr2=0x7f5e80063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 -- 172.21.15.89:0/3653118984 shutdown_connections 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.541+0000 7f5e872e6700 1 -- 172.21.15.89:0/3653118984 wait complete. 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.543+0000 7f5e872e6700 1 Processor -- start 2024-02-10T00:05:04.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.543+0000 7f5e872e6700 1 -- start start 2024-02-10T00:05:04.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80063e50 0x7f5e80096e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e8006f0e0 0x7f5e80151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80099d30 con 0x7f5e80063e50 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80097740 con 0x7f5e8006f0e0 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e872e6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80097a00 con 0x7f5e8006ec60 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57954/0 (socket says 172.21.15.89:57954) 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 -- 172.21.15.89:0/3983256980 learned_addr learned my addr 172.21.15.89:0/3983256980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e85883700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e8006f0e0 0x7f5e80151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e85082700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80063e50 0x7f5e80096e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 -- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e8006f0e0 msgr2=0x7f5e80151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e8006f0e0 0x7f5e80151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 -- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80063e50 msgr2=0x7f5e80096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80063e50 0x7f5e80096e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.544+0000 7f5e84881700 1 -- 172.21.15.89:0/3983256980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78009a20 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e84881700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c7e0 tx=0x7f5e70007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005b30 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70005c90 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e80098a80 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700072e0 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.545+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e80098700 con 0x7f5e8006ec60 2024-02-10T00:05:04.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.546+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8004c710 con 0x7f5e8006ec60 2024-02-10T00:05:04.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.547+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5e7001b3b0 con 0x7f5e8006ec60 2024-02-10T00:05:04.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.547+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5e7005a6e0 con 0x7f5e8006ec60 2024-02-10T00:05:04.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.551+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f5e70038800 con 0x7f5e8006ec60 2024-02-10T00:05:04.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.657+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efff404c710 con 0x7efff406f7c0 2024-02-10T00:05:04.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.657+0000 7effe97fa700 1 -- 172.21.15.89:0/2695295829 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effe403cc80 con 0x7efff406f7c0 2024-02-10T00:05:04.660 INFO:teuthology.orchestra.run.smithi089.stdout:120259084292 2024-02-10T00:05:04.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 >> v1:172.21.15.89:6816/47970 conn(0x7effd8046070 legacy=0x7effd8048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 msgr2=0x7efff409ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effe400ec50 tx=0x7effe40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 shutdown_connections 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff413f060 0x7efff409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efff4063740 0x7efff409deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 --2- 172.21.15.89:0/2695295829 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efff406f7c0 0x7efff409ef00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 >> 172.21.15.89:0/2695295829 conn(0x7efff406a820 msgr2=0x7efff4139630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 shutdown_connections 2024-02-10T00:05:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.660+0000 7efffb651700 1 -- 172.21.15.89:0/2695295829 wait complete. 2024-02-10T00:05:04.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.1 2024-02-10T00:05:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.688+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71700b0910 con 0x7f7170063e50 2024-02-10T00:05:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.688+0000 7f71577fe700 1 -- 172.21.15.89:0/2027304166 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f716003ce30 con 0x7f7170063e50 2024-02-10T00:05:04.691 INFO:teuthology.orchestra.run.smithi089.stdout:133143986179 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 >> v1:172.21.15.89:6816/47970 conn(0x7f715c046040 legacy=0x7f715c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 msgr2=0x7f717014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f716000c850 tx=0x7f7160008040 comp rx=0 tx=0).stop 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 shutdown_connections 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71700a5a70 0x7f7170140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7170063e50 0x7f717014e820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 --2- 172.21.15.89:0/2027304166 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f71700a5660 0x7f71701402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 >> 172.21.15.89:0/2027304166 conn(0x7f717006c7c0 msgr2=0x7f717013e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 shutdown_connections 2024-02-10T00:05:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.690+0000 7f7175b37700 1 -- 172.21.15.89:0/2027304166 wait complete. 2024-02-10T00:05:04.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.3 2024-02-10T00:05:04.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.703+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f784413ff60 con 0x7f78440a2db0 2024-02-10T00:05:04.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.704+0000 7f78397fa700 1 -- 172.21.15.89:0/3822077581 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78340389f0 con 0x7f78440a2db0 2024-02-10T00:05:04.706 INFO:teuthology.orchestra.run.smithi089.stdout:120259084292 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 >> v1:172.21.15.89:6816/47970 conn(0x7f7828046040 legacy=0x7f78280484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 msgr2=0x7f78440ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f783400c5c0 tx=0x7f783400c8d0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 shutdown_connections 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b5220 0x7f78441513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440a29e0 0x7f78440acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 --2- 172.21.15.89:0/3822077581 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f78440a2db0 0x7f78440ab870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 >> 172.21.15.89:0/3822077581 conn(0x7f7844068710 msgr2=0x7f78441422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 shutdown_connections 2024-02-10T00:05:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.705+0000 7f784b4b7700 1 -- 172.21.15.89:0/3822077581 wait complete. 2024-02-10T00:05:04.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.0 2024-02-10T00:05:04.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.717+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e8013fc10 con 0x7f5e8006ec60 2024-02-10T00:05:04.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.717+0000 7f5e757fa700 1 -- 172.21.15.89:0/3983256980 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e70017030 con 0x7f5e8006ec60 2024-02-10T00:05:04.720 INFO:teuthology.orchestra.run.smithi089.stdout:124554051587 2024-02-10T00:05:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 >> v1:172.21.15.89:6816/47970 conn(0x7f5e640460c0 legacy=0x7f5e64048570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 msgr2=0x7f5e80151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c7e0 tx=0x7f5e70007df0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 shutdown_connections 2024-02-10T00:05:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e8006f0e0 0x7f5e80151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80063e50 0x7f5e80096e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 --2- 172.21.15.89:0/3983256980 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5e8006ec60 0x7f5e80151320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 >> 172.21.15.89:0/3983256980 conn(0x7f5e8006c7c0 msgr2=0x7f5e800af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 shutdown_connections 2024-02-10T00:05:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:04.719+0000 7f5e872e6700 1 -- 172.21.15.89:0/3983256980 wait complete. 2024-02-10T00:05:04.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.2 2024-02-10T00:05:05.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:05:05.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:05:05.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:05:05.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:05:05.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.826+0000 7f712ca96700 1 Processor -- start 2024-02-10T00:05:05.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.826+0000 7f712ca96700 1 -- start start 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.827+0000 7f712ca96700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71280aa290 0x7f712813e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.827+0000 7f712ca96700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f712813ee70 0x7f7128148c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.827+0000 7f712ca96700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7128064220 con 0x7f7128063e50 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.827+0000 7f712ca96700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280a9e00 con 0x7f71280aa290 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f712ca96700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712813f2f0 con 0x7f712813ee70 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f712659c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7128063e50 0x7f712806ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33722/0 (socket says 172.21.15.89:33722) 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71280aa290 0x7f712813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f712659c700 1 -- 172.21.15.89:0/1824486010 learned_addr learned my addr 172.21.15.89:0/1824486010 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7126d9d700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f712813ee70 0x7f7128148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 -- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f712813ee70 msgr2=0x7f7128148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f712813ee70 0x7f7128148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 -- 172.21.15.89:0/1824486010 >> v1:172.21.15.89:6789/0 conn(0x7f7128063e50 legacy=0x7f712806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 -- 172.21.15.89:0/1824486010 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712813e480 con 0x7f71280aa290 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.828+0000 7f7125d9b700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71280aa290 0x7f712813e930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711c0098e0 tx=0x7f711c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca356903c83043d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.829+0000 7f712559a700 1 -- 172.21.15.89:0/1824486010 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011630 con 0x7f71280aa290 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.829+0000 7f712559a700 1 -- 172.21.15.89:0/1824486010 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c011790 con 0x7f71280aa290 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.829+0000 7f712559a700 1 -- 172.21.15.89:0/1824486010 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011b30 con 0x7f71280aa290 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.829+0000 7f712ca96700 1 -- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71280aa290 msgr2=0x7f712813e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71280aa290 0x7f712813e930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711c0098e0 tx=0x7f711c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 -- 172.21.15.89:0/1824486010 shutdown_connections 2024-02-10T00:05:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f712813ee70 0x7f7128148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 --2- 172.21.15.89:0/1824486010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71280aa290 0x7f712813e930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 -- 172.21.15.89:0/1824486010 >> 172.21.15.89:0/1824486010 conn(0x7f712806c7c0 msgr2=0x7f7128063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 -- 172.21.15.89:0/1824486010 shutdown_connections 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.830+0000 7f712ca96700 1 -- 172.21.15.89:0/1824486010 wait complete. 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.831+0000 7f712ca96700 1 Processor -- start 2024-02-10T00:05:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.831+0000 7f712ca96700 1 -- start start 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 0x7f71280ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71280aa290 0x7f71281512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 0x7f71281517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280aec60 con 0x7f712813ee70 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280ac940 con 0x7f71280aa290 2024-02-10T00:05:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712ca96700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71280add10 con 0x7f7128063e50 2024-02-10T00:05:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 0x7f71280ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 0x7f71280ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57960/0 (socket says 172.21.15.89:57960) 2024-02-10T00:05:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f712659c700 1 -- 172.21.15.89:0/825517921 learned_addr learned my addr 172.21.15.89:0/825517921 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f7126d9d700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 0x7f71281517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.832+0000 7f7125d9b700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71280aa290 0x7f71281512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 -- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 msgr2=0x7f71280ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 0x7f71280ad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 -- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71280aa290 msgr2=0x7f71281512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71280aa290 0x7f71281512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 -- 172.21.15.89:0/825517921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c009420 con 0x7f712813ee70 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f7126d9d700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 0x7f71281517f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f712000ecc0 tx=0x7f712000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000c8c0 con 0x7f712813ee70 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000f040 con 0x7f712813ee70 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71280aaf00 con 0x7f712813ee70 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000cc70 con 0x7f712813ee70 2024-02-10T00:05:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.833+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712813c0a0 con 0x7f712813ee70 2024-02-10T00:05:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.835+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7120024600 con 0x7f712813ee70 2024-02-10T00:05:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.835+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280977e0 con 0x7f712813ee70 2024-02-10T00:05:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.835+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f712006c720 con 0x7f712813ee70 2024-02-10T00:05:05.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.842+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f712004a830 con 0x7f712813ee70 2024-02-10T00:05:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.855+0000 7f77ceddf700 1 Processor -- start 2024-02-10T00:05:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.855+0000 7f77ceddf700 1 -- start start 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ceddf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77c8063740 0x7f77c806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ceddf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 0x7f77c8145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ceddf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80b1a10 con 0x7f77c806f7c0 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ceddf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c806dbb0 con 0x7f77c8063740 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ceddf700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8063b10 con 0x7f77c813f230 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77c7fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f77c806f7c0 0x7f77c813eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33728/0 (socket says 172.21.15.89:33728) 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77c7fff700 1 -- 172.21.15.89:0/2883380191 learned_addr learned my addr 172.21.15.89:0/2883380191 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77ccb7b700 1 --2- 172.21.15.89:0/2883380191 >> v2:172.21.15.89:3300/0 conn(0x7f77c8063740 0x7f77c806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77cd37c700 1 --2- 172.21.15.89:0/2883380191 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 0x7f77c8145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77c77fe700 1 -- 172.21.15.89:0/2883380191 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262047107 0 0) 0x7f77c80b1a10 con 0x7f77c806f7c0 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77cd37c700 1 -- 172.21.15.89:0/2883380191 >> v2:172.21.15.89:3300/0 conn(0x7f77c8063740 msgr2=0x7f77c806dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77cd37c700 1 --2- 172.21.15.89:0/2883380191 >> v2:172.21.15.89:3300/0 conn(0x7f77c8063740 0x7f77c806dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77cd37c700 1 -- 172.21.15.89:0/2883380191 >> v1:172.21.15.89:6789/0 conn(0x7f77c806f7c0 legacy=0x7f77c813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.856+0000 7f77cd37c700 1 -- 172.21.15.89:0/2883380191 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c806e510 con 0x7f77c813f230 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77cd37c700 1 --2- 172.21.15.89:0/2883380191 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 0x7f77c8145960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e60 tx=0x7f77c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49eb8cd6e755a5d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77c77fe700 1 -- 172.21.15.89:0/2883380191 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000e070 con 0x7f77c813f230 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77c77fe700 1 -- 172.21.15.89:0/2883380191 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000bbf0 con 0x7f77c813f230 2024-02-10T00:05:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77c77fe700 1 -- 172.21.15.89:0/2883380191 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0012430 con 0x7f77c813f230 2024-02-10T00:05:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 -- 172.21.15.89:0/2883380191 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 msgr2=0x7f77c8145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 --2- 172.21.15.89:0/2883380191 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 0x7f77c8145960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e60 tx=0x7f77c0009780 comp rx=0 tx=0).stop 2024-02-10T00:05:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 -- 172.21.15.89:0/2883380191 shutdown_connections 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 --2- 172.21.15.89:0/2883380191 >> v2:172.21.15.89:3300/0 conn(0x7f77c8063740 0x7f77c806dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 --2- 172.21.15.89:0/2883380191 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c813f230 0x7f77c8145960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 -- 172.21.15.89:0/2883380191 >> 172.21.15.89:0/2883380191 conn(0x7f77c806a820 msgr2=0x7f77c80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 -- 172.21.15.89:0/2883380191 shutdown_connections 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.857+0000 7f77ceddf700 1 -- 172.21.15.89:0/2883380191 wait complete. 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.858+0000 7f77ceddf700 1 Processor -- start 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 -- start start 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77c8063740 0x7f77c809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c806f7c0 0x7f77c8137b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8140620 con 0x7f77c813f230 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c809d220 con 0x7f77c8063740 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77ceddf700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77c809e0a0 con 0x7f77c806f7c0 2024-02-10T00:05:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77cd37c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77c7fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c806f7c0 0x7f77c8137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77cd37c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60526/0 (socket says 172.21.15.89:60526) 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.859+0000 7f77cd37c700 1 -- 172.21.15.89:0/1926833177 learned_addr learned my addr 172.21.15.89:0/1926833177 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 -- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c806f7c0 msgr2=0x7f77c8137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c806f7c0 0x7f77c8137b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 -- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77c8063740 msgr2=0x7f77c809d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77c8063740 0x7f77c809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 -- 172.21.15.89:0/1926833177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009a20 con 0x7f77c813f230 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77cd37c700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b6c0 tx=0x7f77c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0012e00 con 0x7f77c813f230 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c001d630 con 0x7f77c813f230 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c001d9f0 con 0x7f77c813f230 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c809e340 con 0x7f77c813f230 2024-02-10T00:05:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.860+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c809f7c0 con 0x7f77c813f230 2024-02-10T00:05:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.861+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c804c710 con 0x7f77c813f230 2024-02-10T00:05:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.862+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f77c0024070 con 0x7f77c813f230 2024-02-10T00:05:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.862+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f77c005dc90 con 0x7f77c813f230 2024-02-10T00:05:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.865+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f77c0008e20 con 0x7f77c813f230 2024-02-10T00:05:05.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.875+0000 7f54d6332700 1 Processor -- start 2024-02-10T00:05:05.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.875+0000 7f54d6332700 1 -- start start 2024-02-10T00:05:05.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54d6332700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54d6332700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54d013f6e0 0x7f54d00a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54d6332700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d0063b10 con 0x7f54d00a5130 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54d6332700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d0139bb0 con 0x7f54d013f6e0 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54d6332700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00a2100 con 0x7f54d0063740 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57970/0 (socket says 172.21.15.89:57970) 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.876+0000 7f54cffff700 1 -- 172.21.15.89:0/3355062498 learned_addr learned my addr 172.21.15.89:0/3355062498 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54cffff700 1 -- 172.21.15.89:0/3355062498 >> v2:172.21.15.89:3300/0 conn(0x7f54d013f6e0 msgr2=0x7f54d00a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54cffff700 1 --2- 172.21.15.89:0/3355062498 >> v2:172.21.15.89:3300/0 conn(0x7f54d013f6e0 0x7f54d00a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54cffff700 1 -- 172.21.15.89:0/3355062498 >> v1:172.21.15.89:6789/0 conn(0x7f54d00a5130 legacy=0x7f54d013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54cffff700 1 -- 172.21.15.89:0/3355062498 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d013fb70 con 0x7f54d0063740 2024-02-10T00:05:05.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54cffff700 1 --2- 172.21.15.89:0/3355062498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54c00099b0 tx=0x7f54c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf6d9a106bb091f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54ceffd700 1 -- 172.21.15.89:0/3355062498 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000b8b0 con 0x7f54d0063740 2024-02-10T00:05:05.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54ceffd700 1 -- 172.21.15.89:0/3355062498 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c000ba10 con 0x7f54d0063740 2024-02-10T00:05:05.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.877+0000 7f54ceffd700 1 -- 172.21.15.89:0/3355062498 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000bdb0 con 0x7f54d0063740 2024-02-10T00:05:05.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 -- 172.21.15.89:0/3355062498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 msgr2=0x7f54d00a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 --2- 172.21.15.89:0/3355062498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54c00099b0 tx=0x7f54c0009250 comp rx=0 tx=0).stop 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 -- 172.21.15.89:0/3355062498 shutdown_connections 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 --2- 172.21.15.89:0/3355062498 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d0063740 0x7f54d00a3240 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 --2- 172.21.15.89:0/3355062498 >> v2:172.21.15.89:3300/0 conn(0x7f54d013f6e0 0x7f54d00a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 -- 172.21.15.89:0/3355062498 >> 172.21.15.89:0/3355062498 conn(0x7f54d006a820 msgr2=0x7f54d00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 -- 172.21.15.89:0/3355062498 shutdown_connections 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.878+0000 7f54d6332700 1 -- 172.21.15.89:0/3355062498 wait complete. 2024-02-10T00:05:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.879+0000 7f54d6332700 1 Processor -- start 2024-02-10T00:05:05.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.879+0000 7f54d6332700 1 -- start start 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d00a5130 0x7f54d0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 0x7f54d0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01444d0 con 0x7f54d0063740 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0143c70 con 0x7f54d013f6e0 2024-02-10T00:05:05.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54d6332700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0144c70 con 0x7f54d00a5130 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.880+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60550/0 (socket says 172.21.15.89:60550) 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 -- 172.21.15.89:0/3879063737 learned_addr learned my addr 172.21.15.89:0/3879063737 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cf7fe700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d00a5130 0x7f54d0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54d48cf700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 0x7f54d0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 -- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d00a5130 msgr2=0x7f54d0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d00a5130 0x7f54d0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 -- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 msgr2=0x7f54d0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 0x7f54d0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 -- 172.21.15.89:0/3879063737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00094f0 con 0x7f54d0063740 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54d48cf700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 0x7f54d0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:05:05.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.881+0000 7f54cffff700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009290 tx=0x7f54c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.882+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0026480 con 0x7f54d0063740 2024-02-10T00:05:05.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.882+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c001f070 con 0x7f54d0063740 2024-02-10T00:05:05.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.882+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0144f30 con 0x7f54d0063740 2024-02-10T00:05:05.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.882+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0026870 con 0x7f54d0063740 2024-02-10T00:05:05.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.882+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d0142290 con 0x7f54d0063740 2024-02-10T00:05:05.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.883+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d01424e0 con 0x7f54d0063740 2024-02-10T00:05:05.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.883+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f54c001a440 con 0x7f54d0063740 2024-02-10T00:05:05.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.884+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f54c0021070 con 0x7f54d0063740 2024-02-10T00:05:05.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.890+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f54d01424e0 con 0x7f54d0063740 2024-02-10T00:05:05.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.906+0000 7fcca81ab700 1 Processor -- start 2024-02-10T00:05:05.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.906+0000 7fcca81ab700 1 -- start start 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.906+0000 7fcca81ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0063740 0x7fcca006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.906+0000 7fcca81ab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca81ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00a28c0 con 0x7fcca006d260 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca81ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00a1130 con 0x7fcca0063740 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca81ab700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0063b10 con 0x7fcca006ce70 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca6748700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcca006d260 0x7fcca0142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33748/0 (socket says 172.21.15.89:33748) 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca6748700 1 -- 172.21.15.89:0/2592397320 learned_addr learned my addr 172.21.15.89:0/2592397320 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5f47700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0063740 0x7fcca006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca4f45700 1 -- 172.21.15.89:0/2592397320 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156509241 0 0) 0x7fcca00a28c0 con 0x7fcca006d260 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca4f45700 1 -- 172.21.15.89:0/2592397320 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8c003570 con 0x7fcca006d260 2024-02-10T00:05:05.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 -- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0063740 msgr2=0x7fcca006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0063740 0x7fcca006e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 -- 172.21.15.89:0/2592397320 >> v1:172.21.15.89:6789/0 conn(0x7fcca006d260 legacy=0x7fcca0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 -- 172.21.15.89:0/2592397320 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0141ba0 con 0x7fcca006ce70 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca5746700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0141e40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009910 tx=0x7fcc900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea6c3bb725e4a43 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.907+0000 7fcca4f45700 1 -- 172.21.15.89:0/2592397320 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011630 con 0x7fcca006ce70 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca4f45700 1 -- 172.21.15.89:0/2592397320 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90011790 con 0x7fcca006ce70 2024-02-10T00:05:05.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca4f45700 1 -- 172.21.15.89:0/2592397320 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011b30 con 0x7fcca006ce70 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 -- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 msgr2=0x7fcca0141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0141e40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009910 tx=0x7fcc900091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 -- 172.21.15.89:0/2592397320 shutdown_connections 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0063740 0x7fcca006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 --2- 172.21.15.89:0/2592397320 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0141e40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 -- 172.21.15.89:0/2592397320 >> 172.21.15.89:0/2592397320 conn(0x7fcca006a820 msgr2=0x7fcca00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 -- 172.21.15.89:0/2592397320 shutdown_connections 2024-02-10T00:05:05.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.908+0000 7fcca81ab700 1 -- 172.21.15.89:0/2592397320 wait complete. 2024-02-10T00:05:05.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.910+0000 7fcca81ab700 1 Processor -- start 2024-02-10T00:05:05.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.910+0000 7fcca81ab700 1 -- start start 2024-02-10T00:05:05.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 0x7fcca01513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca006d260 0x7fcca0146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:05.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0146f00 con 0x7fcca0063740 2024-02-10T00:05:05.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0145010 con 0x7fcca006d260 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca81ab700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca01452b0 con 0x7fcca006ce70 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5f47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 0x7fcca01513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57994/0 (socket says 172.21.15.89:57994) 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5f47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 0x7fcca01513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60564/0 (socket says 172.21.15.89:60564) 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 -- 172.21.15.89:0/1556775354 learned_addr learned my addr 172.21.15.89:0/1556775354 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca6748700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca006d260 0x7fcca0146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 -- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca006d260 msgr2=0x7fcca0146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca006d260 0x7fcca0146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 -- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 msgr2=0x7fcca01513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 0x7fcca01513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.911+0000 7fcca5746700 1 -- 172.21.15.89:0/1556775354 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009420 con 0x7fcca006ce70 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcca5746700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcca0063ca0 tx=0x7fcc90017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:05.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011900 con 0x7fcca006ce70 2024-02-10T00:05:05.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90011a80 con 0x7fcca006ce70 2024-02-10T00:05:05.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca0152280 con 0x7fcca006ce70 2024-02-10T00:05:05.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9001a680 con 0x7fcca006ce70 2024-02-10T00:05:05.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.912+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca0144620 con 0x7fcca006ce70 2024-02-10T00:05:05.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.913+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00a3ac0 con 0x7fcca006ce70 2024-02-10T00:05:05.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.913+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fcc9001aa70 con 0x7fcca006ce70 2024-02-10T00:05:05.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.914+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fcc9005cce0 con 0x7fcca006ce70 2024-02-10T00:05:05.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:05.921+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fcc900263f0 con 0x7fcca006ce70 2024-02-10T00:05:06.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.021+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f712804c710 con 0x7f712813ee70 2024-02-10T00:05:06.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.021+0000 7f71167fc700 1 -- 172.21.15.89:0/825517921 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f712004e020 con 0x7f712813ee70 2024-02-10T00:05:06.023 INFO:teuthology.orchestra.run.smithi089.stdout:120259084292 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 >> v1:172.21.15.89:6816/47970 conn(0x7f7108046040 legacy=0x7f71080484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 msgr2=0x7f71281517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 0x7f71281517f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f712000ecc0 tx=0x7f712000b040 comp rx=0 tx=0).stop 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 shutdown_connections 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712813ee70 0x7f71281517f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7128063e50 0x7f71280ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 --2- 172.21.15.89:0/825517921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71280aa290 0x7f71281512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.023+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 >> 172.21.15.89:0/825517921 conn(0x7f712806c7c0 msgr2=0x7f7128064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:06.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.024+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 shutdown_connections 2024-02-10T00:05:06.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.024+0000 7f712ca96700 1 -- 172.21.15.89:0/825517921 wait complete. 2024-02-10T00:05:06.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.031+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77c806fc80 con 0x7f77c813f230 2024-02-10T00:05:06.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.032+0000 7f77c4ff9700 1 -- 172.21.15.89:0/1926833177 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77c005a090 con 0x7f77c813f230 2024-02-10T00:05:06.034 INFO:teuthology.orchestra.run.smithi089.stdout:120259084292 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.033+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 >> v1:172.21.15.89:6816/47970 conn(0x7f77ac046040 legacy=0x7f77ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.033+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 msgr2=0x7f77c8138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.033+0000 7f77ceddf700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b6c0 tx=0x7f77c0019000 comp rx=0 tx=0).stop 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.033+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 shutdown_connections 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.033+0000 7f77ceddf700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77c813f230 0x7f77c8138040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.034+0000 7f77ceddf700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77c8063740 0x7f77c809d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.034+0000 7f77ceddf700 1 --2- 172.21.15.89:0/1926833177 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f77c806f7c0 0x7f77c8137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.034+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 >> 172.21.15.89:0/1926833177 conn(0x7f77c806a820 msgr2=0x7f77c80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.034+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 shutdown_connections 2024-02-10T00:05:06.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.034+0000 7f77ceddf700 1 -- 172.21.15.89:0/1926833177 wait complete. 2024-02-10T00:05:06.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.1 2024-02-10T00:05:06.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.0 2024-02-10T00:05:06.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.055+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54d01424e0 con 0x7f54d0063740 2024-02-10T00:05:06.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.056+0000 7f54b7fff700 1 -- 172.21.15.89:0/3879063737 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54d01424e0 con 0x7f54d0063740 2024-02-10T00:05:06.058 INFO:teuthology.orchestra.run.smithi089.stdout:133143986179 2024-02-10T00:05:06.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.057+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 >> v1:172.21.15.89:6816/47970 conn(0x7f54bc046040 legacy=0x7f54bc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.057+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 msgr2=0x7f54d00b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.057+0000 7f54d6332700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009290 tx=0x7f54c0016000 comp rx=0 tx=0).stop 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.057+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 shutdown_connections 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.057+0000 7f54d6332700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d013f6e0 0x7f54d0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.058+0000 7f54d6332700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0063740 0x7f54d00b0350 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.058+0000 7f54d6332700 1 --2- 172.21.15.89:0/3879063737 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f54d00a5130 0x7f54d0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.058+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 >> 172.21.15.89:0/3879063737 conn(0x7f54d006a820 msgr2=0x7f54d00680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.058+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 shutdown_connections 2024-02-10T00:05:06.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.058+0000 7f54d6332700 1 -- 172.21.15.89:0/3879063737 wait complete. 2024-02-10T00:05:06.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.3 2024-02-10T00:05:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.097+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcca00aeee0 con 0x7fcca006ce70 2024-02-10T00:05:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.097+0000 7fcc95ffb700 1 -- 172.21.15.89:0/1556775354 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc9001ad20 con 0x7fcca006ce70 2024-02-10T00:05:06.100 INFO:teuthology.orchestra.run.smithi089.stdout:124554051587 2024-02-10T00:05:06.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 >> v1:172.21.15.89:6816/47970 conn(0x7fcc84046040 legacy=0x7fcc840484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 msgr2=0x7fcca0151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:06.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcca0063ca0 tx=0x7fcc90017000 comp rx=0 tx=0).stop 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 shutdown_connections 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca006d260 0x7fcca0146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0063740 0x7fcca01513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 --2- 172.21.15.89:0/1556775354 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fcca006ce70 0x7fcca0151d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 >> 172.21.15.89:0/1556775354 conn(0x7fcca006a820 msgr2=0x7fcca00af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 shutdown_connections 2024-02-10T00:05:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:06.099+0000 7fcca81ab700 1 -- 172.21.15.89:0/1556775354 wait complete. 2024-02-10T00:05:06.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.2 2024-02-10T00:05:06.588 INFO:tasks.ceph.mds.c.smithi089.stderr:2024-02-10T00:05:06.586+0000 7f4808772700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-10T00:05:07.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-10T00:05:07.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-10T00:05:07.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-10T00:05:07.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 Processor -- start 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 -- start start 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006ca50 0x7feaf006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf006d360 0x7feaf0155f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf006ebb0 con 0x7feaf00a4e90 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00a5860 con 0x7feaf006d360 2024-02-10T00:05:07.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.180+0000 7feaf5905700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaf006ede0 con 0x7feaf006ca50 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.181+0000 7feaef7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf006d360 0x7feaf0155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.181+0000 7feaef7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf006d360 0x7feaf0155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60568/0 (socket says 172.21.15.89:60568) 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.181+0000 7feaef7fe700 1 -- 172.21.15.89:0/867005563 learned_addr learned my addr 172.21.15.89:0/867005563 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.181+0000 7feaedffb700 1 -- 172.21.15.89:0/867005563 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455594453 0 0) 0x7feaf006ebb0 con 0x7feaf00a4e90 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.216+0000 7f07347d7700 1 Processor -- start 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.216+0000 7f07347d7700 1 -- start start 2024-02-10T00:05:07.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f07347d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 0x7f072c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f07347d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f07347d7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c06ebb0 con 0x7f072c06d190 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f07347d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0a5860 con 0x7f072c06c880 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f07347d7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072c06ede0 con 0x7f072c0a4e90 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f0731d72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f0731d72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34606/0 (socket says 172.21.15.89:34606) 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f0731d72700 1 -- 172.21.15.89:0/2625427779 learned_addr learned my addr 172.21.15.89:0/2625427779 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.219+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379238156 0 0) 0x7f072c06ebb0 con 0x7f072c06d190 2024-02-10T00:05:07.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0718003550 con 0x7f072c06d190 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 Processor -- start 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 -- start start 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa6440a4e90 0x7fa64406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 0x7fa644155f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64406ebb0 con 0x7fa64406c880 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440a5860 con 0x7fa64406d360 2024-02-10T00:05:07.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaedffb700 1 -- 172.21.15.89:0/867005563 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead8003e00 con 0x7feaf00a4e90 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.221+0000 7fa649df6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406ede0 con 0x7fa6440a4e90 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.222+0000 7fa6437fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa6440a4e90 0x7fa64406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.222+0000 7fa643fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 0x7fa644155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.222+0000 7fa642ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa64406c880 0x7fa64406cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33778/0 (socket says 172.21.15.89:33778) 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.222+0000 7fa642ffd700 1 -- 172.21.15.89:0/1519805007 learned_addr learned my addr 172.21.15.89:0/1519805007 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.222+0000 7fa6427fc700 1 -- 172.21.15.89:0/1519805007 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480358545 0 0) 0x7fa64406ebb0 con 0x7fa64406c880 2024-02-10T00:05:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.217+0000 7f0732573700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 0x7f072c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.181+0000 7feaee7fc700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006ca50 0x7feaf006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaef7fe700 1 -- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006ca50 msgr2=0x7feaf006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaef7fe700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006ca50 0x7feaf006ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaef7fe700 1 -- 172.21.15.89:0/867005563 >> v1:172.21.15.89:6789/0 conn(0x7feaf00a4e90 legacy=0x7feaf006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaef7fe700 1 -- 172.21.15.89:0/867005563 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf006f080 con 0x7feaf006d360 2024-02-10T00:05:07.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7fa6427fc700 1 -- 172.21.15.89:0/1519805007 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa62c003550 con 0x7fa64406c880 2024-02-10T00:05:07.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7feaef7fe700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf006d360 0x7feaf0155f10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feae8009f20 tx=0x7feae8007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d567079f68bb37b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0732573700 1 -- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 msgr2=0x7f072c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0732573700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7fa643fff700 1 -- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa6440a4e90 msgr2=0x7fa64406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7fa643fff700 1 --2- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa6440a4e90 0x7fa64406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7fa643fff700 1 -- 172.21.15.89:0/1519805007 >> v1:172.21.15.89:6789/0 conn(0x7fa64406c880 legacy=0x7fa64406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7fa643fff700 1 -- 172.21.15.89:0/1519805007 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64406f080 con 0x7fa64406d360 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3621482405 0 0) 0x7f0718003550 con 0x7f072c06d190 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0732573700 1 -- 172.21.15.89:0/2625427779 >> v1:172.21.15.89:6789/0 conn(0x7f072c06d190 legacy=0x7f072c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0732573700 1 -- 172.21.15.89:0/2625427779 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c06f080 con 0x7f072c0a4e90 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.247+0000 7f0731d72700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7f0732573700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 0x7f072c06c340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0728009910 tx=0x7f07280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ee0e1cf20b51be server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7fa643fff700 1 --2- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 0x7fa644155f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c4c0 tx=0x7fa63c007760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521e4b82bd6737b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7feaedffb700 1 -- 172.21.15.89:0/867005563 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800bc10 con 0x7feaf006d360 2024-02-10T00:05:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7fa6427fc700 1 -- 172.21.15.89:0/1519805007 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00f070 con 0x7fa64406d360 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7feaedffb700 1 -- 172.21.15.89:0/867005563 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800bd70 con 0x7feaf006d360 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7feaedffb700 1 -- 172.21.15.89:0/867005563 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8007aa0 con 0x7feaf006d360 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240017f0 con 0x7f072c0a4e90 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0728011420 con 0x7f072c0a4e90 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7f0731571700 1 -- 172.21.15.89:0/2625427779 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280117c0 con 0x7f072c0a4e90 2024-02-10T00:05:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7fa6427fc700 1 -- 172.21.15.89:0/1519805007 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00a2e0 con 0x7fa64406d360 2024-02-10T00:05:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7fa6427fc700 1 -- 172.21.15.89:0/1519805007 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00a660 con 0x7fa64406d360 2024-02-10T00:05:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7feaf5905700 1 -- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf006d360 msgr2=0x7feaf0155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.248+0000 7feaf5905700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf006d360 0x7feaf0155f10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feae8009f20 tx=0x7feae8007510 comp rx=0 tx=0).stop 2024-02-10T00:05:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 -- 172.21.15.89:0/867005563 shutdown_connections 2024-02-10T00:05:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf006d360 0x7feaf0155f10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 --2- 172.21.15.89:0/867005563 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006ca50 0x7feaf006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 -- 172.21.15.89:0/867005563 >> 172.21.15.89:0/867005563 conn(0x7feaf006b6b0 msgr2=0x7feaf0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 -- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 msgr2=0x7f072c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 0x7f072c06c340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0728009910 tx=0x7f07280091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 -- 172.21.15.89:0/867005563 shutdown_connections 2024-02-10T00:05:07.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7feaf5905700 1 -- 172.21.15.89:0/867005563 wait complete. 2024-02-10T00:05:07.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 -- 172.21.15.89:0/2625427779 shutdown_connections 2024-02-10T00:05:07.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c0a4e90 0x7f072c06c340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 --2- 172.21.15.89:0/2625427779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c06c880 0x7f072c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 -- 172.21.15.89:0/2625427779 >> 172.21.15.89:0/2625427779 conn(0x7f072c06b6b0 msgr2=0x7f072c063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 -- 172.21.15.89:0/2625427779 shutdown_connections 2024-02-10T00:05:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7f07347d7700 1 -- 172.21.15.89:0/2625427779 wait complete. 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 -- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 msgr2=0x7fa644155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 --2- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 0x7fa644155f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c4c0 tx=0x7fa63c007760 comp rx=0 tx=0).stop 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 -- 172.21.15.89:0/1519805007 shutdown_connections 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 --2- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa64406d360 0x7fa644155f10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 --2- 172.21.15.89:0/1519805007 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa6440a4e90 0x7fa64406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 -- 172.21.15.89:0/1519805007 >> 172.21.15.89:0/1519805007 conn(0x7fa64406b6b0 msgr2=0x7fa644063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 -- 172.21.15.89:0/1519805007 shutdown_connections 2024-02-10T00:05:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.249+0000 7fa649df6700 1 -- 172.21.15.89:0/1519805007 wait complete. 2024-02-10T00:05:07.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 Processor -- start 2024-02-10T00:05:07.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7feaf5905700 1 Processor -- start 2024-02-10T00:05:07.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7fa649df6700 1 Processor -- start 2024-02-10T00:05:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7fa649df6700 1 -- start start 2024-02-10T00:05:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7feaf5905700 1 -- start start 2024-02-10T00:05:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 -- start start 2024-02-10T00:05:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f072c06d190 0x7f072c084960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c0a4e90 0x7f072c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0ad9b0 con 0x7f072c06d190 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0a8090 con 0x7f072c0a4e90 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.250+0000 7f07347d7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0a8350 con 0x7f072c06c880 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58034/0 (socket says 172.21.15.89:58034) 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 -- 172.21.15.89:0/729875684 learned_addr learned my addr 172.21.15.89:0/729875684 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0731d72700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f072c06d190 0x7f072c084960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 -- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c0a4e90 msgr2=0x7f072c15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c0a4e90 0x7f072c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 -- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f072c06d190 msgr2=0x7f072c084960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f072c06d190 0x7f072c084960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 -- 172.21.15.89:0/729875684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009e10 con 0x7f072c06c880 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 0x7fa6440a6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 0x7fa64414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 0x7fa644149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64414c1c0 con 0x7fa64406c880 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64414c460 con 0x7fa6440a4e90 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa649df6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64414b690 con 0x7fa64406d360 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa643fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 0x7fa644149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa643fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 0x7fa644149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34636/0 (socket says 172.21.15.89:34636) 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa643fff700 1 -- 172.21.15.89:0/4280072233 learned_addr learned my addr 172.21.15.89:0/4280072233 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf006ca50 0x7feaf014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006d360 0x7feaf0084420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00ad8c0 con 0x7feaf00a4e90 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00a6650 con 0x7feaf006ca50 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaf5905700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0149e40 con 0x7feaf006d360 2024-02-10T00:05:07.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f0732573700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07280030c0 tx=0x7f0728016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa642ffd700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 0x7fa64414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60596/0 (socket says 172.21.15.89:60596) 2024-02-10T00:05:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7feaef7fe700 1 -- 172.21.15.89:0/567559606 learned_addr learned my addr 172.21.15.89:0/567559606 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072801cbe0 con 0x7f072c06c880 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072801cd40 con 0x7f072c06c880 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0728009420 con 0x7f072c06c880 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072801a680 con 0x7f072c06c880 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa642ffd700 1 -- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 msgr2=0x7fa644149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa642ffd700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 0x7fa644149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa6437fe700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 0x7fa6440a6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.251+0000 7fa642ffd700 1 -- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 msgr2=0x7fa6440a6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa642ffd700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 0x7fa6440a6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa642ffd700 1 -- 172.21.15.89:0/4280072233 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c00c050 con 0x7fa64406d360 2024-02-10T00:05:07.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa6437fe700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 0x7fa6440a6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-10T00:05:07.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c14cbf0 con 0x7f072c06c880 2024-02-10T00:05:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa642ffd700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 0x7fa64414b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c580 tx=0x7fa638007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7feaef7fe700 1 -- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006d360 msgr2=0x7feaf0084420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-10T00:05:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7feaef7fe700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006d360 0x7feaf0084420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7feaef7fe700 1 -- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf006ca50 msgr2=0x7feaf014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7feaef7fe700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf006ca50 0x7feaf014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7feaef7fe700 1 -- 172.21.15.89:0/567559606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009ae0 con 0x7feaf00a4e90 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638005c00 con 0x7fa64406d360 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa638005d80 con 0x7fa64406d360 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638007320 con 0x7fa64406d360 2024-02-10T00:05:07.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64414fe70 con 0x7fa64406d360 2024-02-10T00:05:07.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.252+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64414bf60 con 0x7fa64406d360 2024-02-10T00:05:07.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.253+0000 7feaef7fe700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feaf00a59a0 tx=0x7feae801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.253+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c06ce90 con 0x7f072c06c880 2024-02-10T00:05:07.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.253+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f072801aa70 con 0x7f072c06c880 2024-02-10T00:05:07.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8010760 con 0x7feaf00a4e90 2024-02-10T00:05:07.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f072805cdd0 con 0x7f072c06c880 2024-02-10T00:05:07.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80108c0 con 0x7feaf00a4e90 2024-02-10T00:05:07.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8010c80 con 0x7feaf00a4e90 2024-02-10T00:05:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.253+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64406f410 con 0x7fa64406d360 2024-02-10T00:05:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.253+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa63801b3b0 con 0x7fa64406d360 2024-02-10T00:05:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa63805a770 con 0x7fa64406d360 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf014a100 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.254+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf014c060 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.255+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7feae8003040 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.255+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7feae800e070 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.256+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf004c710 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.260+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7feae8007e60 con 0x7feaf00a4e90 2024-02-10T00:05:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.260+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0728027c40 con 0x7f072c06c880 2024-02-10T00:05:07.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.261+0000 7fbecb4d5700 1 Processor -- start 2024-02-10T00:05:07.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.261+0000 7fbecb4d5700 1 -- start start 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec4139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbec413a390 0x7fbec40a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec406e2d0 con 0x7fbec413a390 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b1c80 con 0x7fbec406f630 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbecb4d5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbec406eb50 con 0x7fbec40b18b0 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58052/0 (socket says 172.21.15.89:58052) 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 -- 172.21.15.89:0/2318970430 learned_addr learned my addr 172.21.15.89:0/2318970430 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 -- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 msgr2=0x7fbec4139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 --2- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec4139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 -- 172.21.15.89:0/2318970430 >> v2:172.21.15.89:3300/0 conn(0x7fbec413a390 msgr2=0x7fbec40a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 --2- 172.21.15.89:0/2318970430 >> v2:172.21.15.89:3300/0 conn(0x7fbec413a390 0x7fbec40a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 -- 172.21.15.89:0/2318970430 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec406edd0 con 0x7fbec40b18b0 2024-02-10T00:05:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.262+0000 7fbec9271700 1 --2- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbec000bc40 tx=0x7fbec000b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b784be1d79aad676 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.264+0000 7fbebbfff700 1 -- 172.21.15.89:0/2318970430 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000db40 con 0x7fbec40b18b0 2024-02-10T00:05:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.264+0000 7fbebbfff700 1 -- 172.21.15.89:0/2318970430 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000dcc0 con 0x7fbec40b18b0 2024-02-10T00:05:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.264+0000 7fbebbfff700 1 -- 172.21.15.89:0/2318970430 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0017660 con 0x7fbec40b18b0 2024-02-10T00:05:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.264+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fa638038930 con 0x7fa64406d360 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 -- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 msgr2=0x7fbec406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbec000bc40 tx=0x7fbec000b4e0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 -- 172.21.15.89:0/2318970430 shutdown_connections 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/2318970430 >> v2:172.21.15.89:3300/0 conn(0x7fbec413a390 0x7fbec40a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec40b18b0 0x7fbec406cb90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/2318970430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec4139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.265+0000 7fbecb4d5700 1 -- 172.21.15.89:0/2318970430 >> 172.21.15.89:0/2318970430 conn(0x7fbec406a820 msgr2=0x7fbec40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.268+0000 7fbecb4d5700 1 -- 172.21.15.89:0/2318970430 shutdown_connections 2024-02-10T00:05:07.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.268+0000 7fbecb4d5700 1 -- 172.21.15.89:0/2318970430 wait complete. 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 Processor -- start 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 -- start start 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec40a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 0x7fbec414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40a8dd0 con 0x7fbec40b18b0 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40ae9c0 con 0x7fbec406f630 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbecb4d5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40a77d0 con 0x7fbec413a390 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.269+0000 7fbec8a70700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec8a70700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60606/0 (socket says 172.21.15.89:60606) 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec8a70700 1 -- 172.21.15.89:0/1404644972 learned_addr learned my addr 172.21.15.89:0/1404644972 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9a72700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 0x7fbec414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec40a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 -- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 msgr2=0x7fbec414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 0x7fbec414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 -- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 msgr2=0x7fbec40a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 -- 172.21.15.89:0/1404644972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec000b780 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9a72700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 0x7fbec414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec8a70700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.270+0000 7fbec9271700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec40a83d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbec0018000 tx=0x7fbec0019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.271+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0022610 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.271+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40a72d0 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.271+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0022790 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.271+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0022b50 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.271+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40a99e0 con 0x7fbec406f630 2024-02-10T00:05:07.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.272+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec404c710 con 0x7fbec406f630 2024-02-10T00:05:07.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.272+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbec0015070 con 0x7fbec406f630 2024-02-10T00:05:07.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.273+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fbec005fb50 con 0x7fbec406f630 2024-02-10T00:05:07.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.279+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fbec000eb10 con 0x7fbec406f630 2024-02-10T00:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.429+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feaf00a6300 con 0x7feaf00a4e90 2024-02-10T00:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.429+0000 7fead6ffd700 1 -- 172.21.15.89:0/567559606 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feae8007e60 con 0x7feaf00a4e90 2024-02-10T00:05:07.431 INFO:teuthology.orchestra.run.smithi089.stdout:120259084293 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 >> v1:172.21.15.89:6816/47970 conn(0x7feadc046040 legacy=0x7feadc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 msgr2=0x7feaf0084960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feaf00a59a0 tx=0x7feae801a000 comp rx=0 tx=0).stop 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 shutdown_connections 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf00a4e90 0x7feaf0084960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf006ca50 0x7feaf014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 --2- 172.21.15.89:0/567559606 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feaf006d360 0x7feaf0084420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 >> 172.21.15.89:0/567559606 conn(0x7feaf006b6b0 msgr2=0x7feaf0150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 shutdown_connections 2024-02-10T00:05:07.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.431+0000 7feaf5905700 1 -- 172.21.15.89:0/567559606 wait complete. 2024-02-10T00:05:07.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.442+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbec406dbb0 con 0x7fbec406f630 2024-02-10T00:05:07.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.443+0000 7fbeb97fa700 1 -- 172.21.15.89:0/1404644972 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbec0001340 con 0x7fbec406f630 2024-02-10T00:05:07.445 INFO:teuthology.orchestra.run.smithi089.stdout:124554051589 2024-02-10T00:05:07.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084293 for osd.1 2024-02-10T00:05:07.446 DEBUG:teuthology.parallel:result is None 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 >> v1:172.21.15.89:6816/47970 conn(0x7fbea8046040 legacy=0x7fbea80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 msgr2=0x7fbec40a83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec40a83d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbec0018000 tx=0x7fbec0019000 comp rx=0 tx=0).stop 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 shutdown_connections 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbec413a390 0x7fbec414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec406f630 0x7fbec40a83d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 --2- 172.21.15.89:0/1404644972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec40b18b0 0x7fbec40a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 >> 172.21.15.89:0/1404644972 conn(0x7fbec406a820 msgr2=0x7fbec40aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.445+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 shutdown_connections 2024-02-10T00:05:07.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.446+0000 7fbecb4d5700 1 -- 172.21.15.89:0/1404644972 wait complete. 2024-02-10T00:05:07.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051589 for osd.2 2024-02-10T00:05:07.464 DEBUG:teuthology.parallel:result is None 2024-02-10T00:05:07.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.465+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f072c0a45d0 con 0x7f072c06c880 2024-02-10T00:05:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.466+0000 7f07227fc700 1 -- 172.21.15.89:0/729875684 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f072805e070 con 0x7f072c06c880 2024-02-10T00:05:07.468 INFO:teuthology.orchestra.run.smithi089.stdout:120259084293 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.467+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 >> v1:172.21.15.89:6816/47970 conn(0x7f0710046110 legacy=0x7f07100485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.467+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 msgr2=0x7f072c084420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.467+0000 7f07347d7700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07280030c0 tx=0x7f0728016000 comp rx=0 tx=0).stop 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 shutdown_connections 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f072c0a4e90 0x7f072c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f072c06c880 0x7f072c084420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 --2- 172.21.15.89:0/729875684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f072c06d190 0x7f072c084960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 >> 172.21.15.89:0/729875684 conn(0x7f072c06b6b0 msgr2=0x7f072c14d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 shutdown_connections 2024-02-10T00:05:07.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.468+0000 7f07347d7700 1 -- 172.21.15.89:0/729875684 wait complete. 2024-02-10T00:05:07.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.476+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa64404c710 con 0x7fa64406d360 2024-02-10T00:05:07.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.477+0000 7fa62b7fe700 1 -- 172.21.15.89:0/4280072233 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa638017070 con 0x7fa64406d360 2024-02-10T00:05:07.479 INFO:teuthology.orchestra.run.smithi089.stdout:133143986180 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 >> v1:172.21.15.89:6816/47970 conn(0x7fa630046040 legacy=0x7fa6300484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 msgr2=0x7fa64414b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 0x7fa64414b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c580 tx=0x7fa638007d50 comp rx=0 tx=0).stop 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 shutdown_connections 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440a4e90 0x7fa644149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa64406c880 0x7fa6440a6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 --2- 172.21.15.89:0/4280072233 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa64406d360 0x7fa64414b150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 >> 172.21.15.89:0/4280072233 conn(0x7fa64406b6b0 msgr2=0x7fa6441502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.478+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 shutdown_connections 2024-02-10T00:05:07.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.479+0000 7fa649df6700 1 -- 172.21.15.89:0/4280072233 wait complete. 2024-02-10T00:05:07.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084293 for osd.0 2024-02-10T00:05:07.483 DEBUG:teuthology.parallel:result is None 2024-02-10T00:05:07.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986180 for osd.3 2024-02-10T00:05:07.493 DEBUG:teuthology.parallel:result is None 2024-02-10T00:05:07.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-10T00:05:07.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.646+0000 7fd59827e700 1 Processor -- start 2024-02-10T00:05:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.646+0000 7fd59827e700 1 -- start start 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59827e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59827e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59827e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59006e2d0 con 0x7fd59013a390 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59827e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900b1c80 con 0x7fd59006f630 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59827e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59006eb50 con 0x7fd5900b18b0 2024-02-10T00:05:07.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd595819700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd595819700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60620/0 (socket says 172.21.15.89:60620) 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34668/0 (socket says 172.21.15.89:34668) 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd595819700 1 -- 172.21.15.89:0/767355886 learned_addr learned my addr 172.21.15.89:0/767355886 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59681b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd59013a390 0x7fd5900a1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33780/0 (socket says 172.21.15.89:33780) 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 -- 172.21.15.89:0/767355886 >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 msgr2=0x7fd590139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 --2- 172.21.15.89:0/767355886 >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 -- 172.21.15.89:0/767355886 >> v1:172.21.15.89:6789/0 conn(0x7fd59013a390 legacy=0x7fd5900a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd595018700 1 -- 172.21.15.89:0/767355886 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787007601 0 0) 0x7fd59006e2d0 con 0x7fd59013a390 2024-02-10T00:05:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd59601a700 1 -- 172.21.15.89:0/767355886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59006edd0 con 0x7fd5900b18b0 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.647+0000 7fd595819700 1 --2- 172.21.15.89:0/767355886 >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59601a700 1 --2- 172.21.15.89:0/767355886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5800098e0 tx=0x7fd5800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aeefc08540efa4d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd595018700 1 -- 172.21.15.89:0/767355886 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000b640 con 0x7fd5900b18b0 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd595018700 1 -- 172.21.15.89:0/767355886 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000b7a0 con 0x7fd5900b18b0 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd595018700 1 -- 172.21.15.89:0/767355886 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000bb40 con 0x7fd5900b18b0 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 -- 172.21.15.89:0/767355886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 msgr2=0x7fd59006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 --2- 172.21.15.89:0/767355886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5800098e0 tx=0x7fd5800091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 -- 172.21.15.89:0/767355886 shutdown_connections 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 --2- 172.21.15.89:0/767355886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd59006cb90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 --2- 172.21.15.89:0/767355886 >> v2:172.21.15.89:3300/0 conn(0x7fd59006f630 0x7fd590139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 -- 172.21.15.89:0/767355886 >> 172.21.15.89:0/767355886 conn(0x7fd59006a820 msgr2=0x7fd5900b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 -- 172.21.15.89:0/767355886 shutdown_connections 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.648+0000 7fd59827e700 1 -- 172.21.15.89:0/767355886 wait complete. 2024-02-10T00:05:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.649+0000 7fd59827e700 1 Processor -- start 2024-02-10T00:05:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.649+0000 7fd59827e700 1 -- start start 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd59013a390 0x7fd590139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a5020 con 0x7fd59006f630 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a62a0 con 0x7fd5900b18b0 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a5e50 con 0x7fd59013a390 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd595819700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60636/0 (socket says 172.21.15.89:60636) 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59681b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd59013a390 0x7fd590139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 -- 172.21.15.89:0/3116273060 learned_addr learned my addr 172.21.15.89:0/3116273060 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd595819700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34676/0 (socket says 172.21.15.89:34676) 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 -- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd59013a390 msgr2=0x7fd590139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd59013a390 0x7fd590139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 -- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 msgr2=0x7fd590138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 -- 172.21.15.89:0/3116273060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0094f0 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd595819700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59601a700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5900b1df0 tx=0x7fd580017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000bb20 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580000c90 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580009420 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011650 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.650+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900a6800 con 0x7fd59006f630 2024-02-10T00:05:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.651+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fd580011a40 con 0x7fd59006f630 2024-02-10T00:05:07.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.651+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59004c710 con 0x7fd59006f630 2024-02-10T00:05:07.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.652+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd58005c920 con 0x7fd59006f630 2024-02-10T00:05:07.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.655+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd580007e70 con 0x7fd59006f630 2024-02-10T00:05:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.802+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd59006f410 con 0x7fd574046040 2024-02-10T00:05:07.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.810+0000 7fd5867fc700 1 -- 172.21.15.89:0/3116273060 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273476 (unknown 2965378022 0 3271278639) 0x7fd59006f410 con 0x7fd574046040 2024-02-10T00:05:07.815 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 >> v1:172.21.15.89:6816/47970 conn(0x7fd574046040 legacy=0x7fd5740484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 msgr2=0x7fd5901387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5900b1df0 tx=0x7fd580017000 comp rx=0 tx=0).stop 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 shutdown_connections 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd59013a390 0x7fd590139230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59006f630 0x7fd5901387b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 --2- 172.21.15.89:0/3116273060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5900b18b0 0x7fd590138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 >> 172.21.15.89:0/3116273060 conn(0x7fd59006a820 msgr2=0x7fd590146940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 shutdown_connections 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.812+0000 7fd59827e700 1 -- 172.21.15.89:0/3116273060 wait complete. 2024-02-10T00:05:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:07.826 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-10T00:05:06.139644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148183230,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6107,"num_read_kb":2952109,"num_write":65320,"num_write_kb":9046177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71749,"ondisk_log_size":71749,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537276,"kb_used_data":290844,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375950084,"statfs":{"total":386547056640,"available":384972886016,"internally_reserved":0,"allocated":297824256,"data_stored":296964938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":108139,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961501"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":918,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195422+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:02.195422+0000","last_peered":"2024-02-10T00:05:02.195422+0000","last_clean":"2024-02-10T00:05:02.195422+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:02.195422+0000","last_undegraded":"2024-02-10T00:05:02.195422+0000","last_fullsized":"2024-02-10T00:05:02.195422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":953,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195002+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:02.195002+0000","last_peered":"2024-02-10T00:05:02.195002+0000","last_clean":"2024-02-10T00:05:02.195002+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:02.195002+0000","last_undegraded":"2024-02-10T00:05:02.195002+0000","last_fullsized":"2024-02-10T00:05:02.195002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":907,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192178+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:00.192178+0000","last_peered":"2024-02-10T00:05:00.192178+0000","last_clean":"2024-02-10T00:05:00.192178+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:00.192178+0000","last_undegraded":"2024-02-10T00:05:00.192178+0000","last_fullsized":"2024-02-10T00:05:00.192178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":831,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192174+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:00.192174+0000","last_peered":"2024-02-10T00:05:00.192174+0000","last_clean":"2024-02-10T00:05:00.192174+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:00.192174+0000","last_undegraded":"2024-02-10T00:05:00.192174+0000","last_fullsized":"2024-02-10T00:05:00.192174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":831,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191780+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:00.191780+0000","last_peered":"2024-02-10T00:05:00.191780+0000","last_clean":"2024-02-10T00:05:00.191780+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:00.191780+0000","last_undegraded":"2024-02-10T00:05:00.191780+0000","last_fullsized":"2024-02-10T00:05:00.191780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":866,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193241+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:02.193241+0000","last_peered":"2024-02-10T00:05:02.193241+0000","last_clean":"2024-02-10T00:05:02.193241+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:02.193241+0000","last_undegraded":"2024-02-10T00:05:02.193241+0000","last_fullsized":"2024-02-10T00:05:02.193241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":924,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192799+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:02.192799+0000","last_peered":"2024-02-10T00:05:02.192799+0000","last_clean":"2024-02-10T00:05:02.192799+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:02.192799+0000","last_undegraded":"2024-02-10T00:05:02.192799+0000","last_fullsized":"2024-02-10T00:05:02.192799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":797,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192256+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:02.192256+0000","last_peered":"2024-02-10T00:05:02.192256+0000","last_clean":"2024-02-10T00:05:02.192256+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:02.192256+0000","last_undegraded":"2024-02-10T00:05:02.192256+0000","last_fullsized":"2024-02-10T00:05:02.192256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":925,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192504+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:00.192504+0000","last_peered":"2024-02-10T00:05:00.192504+0000","last_clean":"2024-02-10T00:05:00.192504+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:00.192504+0000","last_undegraded":"2024-02-10T00:05:00.192504+0000","last_fullsized":"2024-02-10T00:05:00.192504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193801+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:02.193801+0000","last_peered":"2024-02-10T00:05:02.193801+0000","last_clean":"2024-02-10T00:05:02.193801+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:02.193801+0000","last_undegraded":"2024-02-10T00:05:02.193801+0000","last_fullsized":"2024-02-10T00:05:02.193801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":844,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193504+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:02.193504+0000","last_peered":"2024-02-10T00:05:02.193504+0000","last_clean":"2024-02-10T00:05:02.193504+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:02.193504+0000","last_undegraded":"2024-02-10T00:05:02.193504+0000","last_fullsized":"2024-02-10T00:05:02.193504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":829,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195733+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:02.195733+0000","last_peered":"2024-02-10T00:05:02.195733+0000","last_clean":"2024-02-10T00:05:02.195733+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:02.195733+0000","last_undegraded":"2024-02-10T00:05:02.195733+0000","last_fullsized":"2024-02-10T00:05:02.195733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":963,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194816+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:02.194816+0000","last_peered":"2024-02-10T00:05:02.194816+0000","last_clean":"2024-02-10T00:05:02.194816+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:02.194816+0000","last_undegraded":"2024-02-10T00:05:02.194816+0000","last_fullsized":"2024-02-10T00:05:02.194816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":935,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192537+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:02.192537+0000","last_peered":"2024-02-10T00:05:02.192537+0000","last_clean":"2024-02-10T00:05:02.192537+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:02.192537+0000","last_undegraded":"2024-02-10T00:05:02.192537+0000","last_fullsized":"2024-02-10T00:05:02.192537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":983,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191627+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:00.191627+0000","last_peered":"2024-02-10T00:05:00.191627+0000","last_clean":"2024-02-10T00:05:00.191627+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:00.191627+0000","last_undegraded":"2024-02-10T00:05:00.191627+0000","last_fullsized":"2024-02-10T00:05:00.191627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":883,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193743+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:02.193743+0000","last_peered":"2024-02-10T00:05:02.193743+0000","last_clean":"2024-02-10T00:05:02.193743+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:02.193743+0000","last_undegraded":"2024-02-10T00:05:02.193743+0000","last_fullsized":"2024-02-10T00:05:02.193743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":980,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192589+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:00.192589+0000","last_peered":"2024-02-10T00:05:00.192589+0000","last_clean":"2024-02-10T00:05:00.192589+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:00.192589+0000","last_undegraded":"2024-02-10T00:05:00.192589+0000","last_fullsized":"2024-02-10T00:05:00.192589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":780,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192310+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:00.192310+0000","last_peered":"2024-02-10T00:05:00.192310+0000","last_clean":"2024-02-10T00:05:00.192310+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:00.192310+0000","last_undegraded":"2024-02-10T00:05:00.192310+0000","last_fullsized":"2024-02-10T00:05:00.192310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1012,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194849+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:02.194849+0000","last_peered":"2024-02-10T00:05:02.194849+0000","last_clean":"2024-02-10T00:05:02.194849+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:02.194849+0000","last_undegraded":"2024-02-10T00:05:02.194849+0000","last_fullsized":"2024-02-10T00:05:02.194849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":888,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193155+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:02.193155+0000","last_peered":"2024-02-10T00:05:02.193155+0000","last_clean":"2024-02-10T00:05:02.193155+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:02.193155+0000","last_undegraded":"2024-02-10T00:05:02.193155+0000","last_fullsized":"2024-02-10T00:05:02.193155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":953,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194633+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:02.194633+0000","last_peered":"2024-02-10T00:05:02.194633+0000","last_clean":"2024-02-10T00:05:02.194633+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:02.194633+0000","last_undegraded":"2024-02-10T00:05:02.194633+0000","last_fullsized":"2024-02-10T00:05:02.194633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":961,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191689+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:00.191689+0000","last_peered":"2024-02-10T00:05:00.191689+0000","last_clean":"2024-02-10T00:05:00.191689+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:00.191689+0000","last_undegraded":"2024-02-10T00:05:00.191689+0000","last_fullsized":"2024-02-10T00:05:00.191689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":960,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192400+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:02.192400+0000","last_peered":"2024-02-10T00:05:02.192400+0000","last_clean":"2024-02-10T00:05:02.192400+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:02.192400+0000","last_undegraded":"2024-02-10T00:05:02.192400+0000","last_fullsized":"2024-02-10T00:05:02.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":956,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192226+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:02.192226+0000","last_peered":"2024-02-10T00:05:02.192226+0000","last_clean":"2024-02-10T00:05:02.192226+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:02.192226+0000","last_undegraded":"2024-02-10T00:05:02.192226+0000","last_fullsized":"2024-02-10T00:05:02.192226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":977,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193141+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:02.193141+0000","last_peered":"2024-02-10T00:05:02.193141+0000","last_clean":"2024-02-10T00:05:02.193141+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:02.193141+0000","last_undegraded":"2024-02-10T00:05:02.193141+0000","last_fullsized":"2024-02-10T00:05:02.193141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":938,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193941+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:02.193941+0000","last_peered":"2024-02-10T00:05:02.193941+0000","last_clean":"2024-02-10T00:05:02.193941+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:02.193941+0000","last_undegraded":"2024-02-10T00:05:02.193941+0000","last_fullsized":"2024-02-10T00:05:02.193941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":889,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193536+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:02.193536+0000","last_peered":"2024-02-10T00:05:02.193536+0000","last_clean":"2024-02-10T00:05:02.193536+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:02.193536+0000","last_undegraded":"2024-02-10T00:05:02.193536+0000","last_fullsized":"2024-02-10T00:05:02.193536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1505,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192680+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:02.192680+0000","last_peered":"2024-02-10T00:05:02.192680+0000","last_clean":"2024-02-10T00:05:02.192680+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:02.192680+0000","last_undegraded":"2024-02-10T00:05:02.192680+0000","last_fullsized":"2024-02-10T00:05:02.192680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":871,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194043+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:02.194043+0000","last_peered":"2024-02-10T00:05:02.194043+0000","last_clean":"2024-02-10T00:05:02.194043+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:02.194043+0000","last_undegraded":"2024-02-10T00:05:02.194043+0000","last_fullsized":"2024-02-10T00:05:02.194043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":892,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194279+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:02.194279+0000","last_peered":"2024-02-10T00:05:02.194279+0000","last_clean":"2024-02-10T00:05:02.194279+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:02.194279+0000","last_undegraded":"2024-02-10T00:05:02.194279+0000","last_fullsized":"2024-02-10T00:05:02.194279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":893,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192451+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:00.192451+0000","last_peered":"2024-02-10T00:05:00.192451+0000","last_clean":"2024-02-10T00:05:00.192451+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:00.192451+0000","last_undegraded":"2024-02-10T00:05:00.192451+0000","last_fullsized":"2024-02-10T00:05:00.192451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194082+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:02.194082+0000","last_peered":"2024-02-10T00:05:02.194082+0000","last_clean":"2024-02-10T00:05:02.194082+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:02.194082+0000","last_undegraded":"2024-02-10T00:05:02.194082+0000","last_fullsized":"2024-02-10T00:05:02.194082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":904,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195372+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:02.195372+0000","last_peered":"2024-02-10T00:05:02.195372+0000","last_clean":"2024-02-10T00:05:02.195372+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:02.195372+0000","last_undegraded":"2024-02-10T00:05:02.195372+0000","last_fullsized":"2024-02-10T00:05:02.195372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'142","reported_seq":175,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192582+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:00.192582+0000","last_peered":"2024-02-10T00:05:00.192582+0000","last_clean":"2024-02-10T00:05:00.192582+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:00.192582+0000","last_undegraded":"2024-02-10T00:05:00.192582+0000","last_fullsized":"2024-02-10T00:05:00.192582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":938,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193989+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:02.193989+0000","last_peered":"2024-02-10T00:05:02.193989+0000","last_clean":"2024-02-10T00:05:02.193989+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:02.193989+0000","last_undegraded":"2024-02-10T00:05:02.193989+0000","last_fullsized":"2024-02-10T00:05:02.193989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1035,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194841+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:02.194841+0000","last_peered":"2024-02-10T00:05:02.194841+0000","last_clean":"2024-02-10T00:05:02.194841+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:02.194841+0000","last_undegraded":"2024-02-10T00:05:02.194841+0000","last_fullsized":"2024-02-10T00:05:02.194841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1061,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192723+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:02.192723+0000","last_peered":"2024-02-10T00:05:02.192723+0000","last_clean":"2024-02-10T00:05:02.192723+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:02.192723+0000","last_undegraded":"2024-02-10T00:05:02.192723+0000","last_fullsized":"2024-02-10T00:05:02.192723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'395","reported_seq":432,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192191+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:00.192191+0000","last_peered":"2024-02-10T00:05:00.192191+0000","last_clean":"2024-02-10T00:05:00.192191+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:00.192191+0000","last_undegraded":"2024-02-10T00:05:00.192191+0000","last_fullsized":"2024-02-10T00:05:00.192191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":295,"num_write_kb":4311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1022,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192814+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:02.192814+0000","last_peered":"2024-02-10T00:05:02.192814+0000","last_clean":"2024-02-10T00:05:02.192814+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:02.192814+0000","last_undegraded":"2024-02-10T00:05:02.192814+0000","last_fullsized":"2024-02-10T00:05:02.192814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'658","reported_seq":701,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198017+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:03.198017+0000","last_peered":"2024-02-10T00:05:03.198017+0000","last_clean":"2024-02-10T00:05:03.198017+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:03.198017+0000","last_undegraded":"2024-02-10T00:05:03.198017+0000","last_fullsized":"2024-02-10T00:05:03.198017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":6,"num_read_kb":12290,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":994,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194646+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:02.194646+0000","last_peered":"2024-02-10T00:05:02.194646+0000","last_clean":"2024-02-10T00:05:02.194646+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:02.194646+0000","last_undegraded":"2024-02-10T00:05:02.194646+0000","last_fullsized":"2024-02-10T00:05:02.194646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":433,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192451+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:02.192451+0000","last_peered":"2024-02-10T00:05:02.192451+0000","last_clean":"2024-02-10T00:05:02.192451+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:02.192451+0000","last_undegraded":"2024-02-10T00:05:02.192451+0000","last_fullsized":"2024-02-10T00:05:02.192451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":8193,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1093,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193066+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:02.193066+0000","last_peered":"2024-02-10T00:05:02.193066+0000","last_clean":"2024-02-10T00:05:02.193066+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:02.193066+0000","last_undegraded":"2024-02-10T00:05:02.193066+0000","last_fullsized":"2024-02-10T00:05:02.193066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":150,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191712+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:00.191712+0000","last_peered":"2024-02-10T00:05:00.191712+0000","last_clean":"2024-02-10T00:05:00.191712+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:00.191712+0000","last_undegraded":"2024-02-10T00:05:00.191712+0000","last_fullsized":"2024-02-10T00:05:00.191712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":959,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194118+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:02.194118+0000","last_peered":"2024-02-10T00:05:02.194118+0000","last_clean":"2024-02-10T00:05:02.194118+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:02.194118+0000","last_undegraded":"2024-02-10T00:05:02.194118+0000","last_fullsized":"2024-02-10T00:05:02.194118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'478","reported_seq":516,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192175+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:02.192175+0000","last_peered":"2024-02-10T00:05:02.192175+0000","last_clean":"2024-02-10T00:05:02.192175+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:02.192175+0000","last_undegraded":"2024-02-10T00:05:02.192175+0000","last_fullsized":"2024-02-10T00:05:02.192175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":935,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192532+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:00.192532+0000","last_peered":"2024-02-10T00:05:00.192532+0000","last_clean":"2024-02-10T00:05:00.192532+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:00.192532+0000","last_undegraded":"2024-02-10T00:05:00.192532+0000","last_fullsized":"2024-02-10T00:05:00.192532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":531,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192406+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:02.192406+0000","last_peered":"2024-02-10T00:05:02.192406+0000","last_clean":"2024-02-10T00:05:02.192406+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:02.192406+0000","last_undegraded":"2024-02-10T00:05:02.192406+0000","last_fullsized":"2024-02-10T00:05:02.192406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":854,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194945+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:02.194945+0000","last_peered":"2024-02-10T00:05:02.194945+0000","last_clean":"2024-02-10T00:05:02.194945+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:02.194945+0000","last_undegraded":"2024-02-10T00:05:02.194945+0000","last_fullsized":"2024-02-10T00:05:02.194945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":431,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192426+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:00.192426+0000","last_peered":"2024-02-10T00:05:00.192426+0000","last_clean":"2024-02-10T00:05:00.192426+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:00.192426+0000","last_undegraded":"2024-02-10T00:05:00.192426+0000","last_fullsized":"2024-02-10T00:05:00.192426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1077,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193823+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:02.193823+0000","last_peered":"2024-02-10T00:05:02.193823+0000","last_clean":"2024-02-10T00:05:02.193823+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:02.193823+0000","last_undegraded":"2024-02-10T00:05:02.193823+0000","last_fullsized":"2024-02-10T00:05:02.193823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":466,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195162+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:02.195162+0000","last_peered":"2024-02-10T00:05:02.195162+0000","last_clean":"2024-02-10T00:05:02.195162+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:02.195162+0000","last_undegraded":"2024-02-10T00:05:02.195162+0000","last_fullsized":"2024-02-10T00:05:02.195162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":973,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194451+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:02.194451+0000","last_peered":"2024-02-10T00:05:02.194451+0000","last_clean":"2024-02-10T00:05:02.194451+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:02.194451+0000","last_undegraded":"2024-02-10T00:05:02.194451+0000","last_fullsized":"2024-02-10T00:05:02.194451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":782,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193390+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:02.193390+0000","last_peered":"2024-02-10T00:05:02.193390+0000","last_clean":"2024-02-10T00:05:02.193390+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:02.193390+0000","last_undegraded":"2024-02-10T00:05:02.193390+0000","last_fullsized":"2024-02-10T00:05:02.193390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":896,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191242+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:02.191242+0000","last_peered":"2024-02-10T00:05:02.191242+0000","last_clean":"2024-02-10T00:05:02.191242+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:02.191242+0000","last_undegraded":"2024-02-10T00:05:02.191242+0000","last_fullsized":"2024-02-10T00:05:02.191242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":184,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192092+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:00.192092+0000","last_peered":"2024-02-10T00:05:00.192092+0000","last_clean":"2024-02-10T00:05:00.192092+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:00.192092+0000","last_undegraded":"2024-02-10T00:05:00.192092+0000","last_fullsized":"2024-02-10T00:05:00.192092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":924,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191871+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:00.191871+0000","last_peered":"2024-02-10T00:05:00.191871+0000","last_clean":"2024-02-10T00:05:00.191871+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:00.191871+0000","last_undegraded":"2024-02-10T00:05:00.191871+0000","last_fullsized":"2024-02-10T00:05:00.191871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'1165","reported_seq":1211,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192358+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:02.192358+0000","last_peered":"2024-02-10T00:05:02.192358+0000","last_clean":"2024-02-10T00:05:02.192358+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:02.192358+0000","last_undegraded":"2024-02-10T00:05:02.192358+0000","last_fullsized":"2024-02-10T00:05:02.192358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1025,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192150+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:00.192150+0000","last_peered":"2024-02-10T00:05:00.192150+0000","last_clean":"2024-02-10T00:05:00.192150+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:00.192150+0000","last_undegraded":"2024-02-10T00:05:00.192150+0000","last_fullsized":"2024-02-10T00:05:00.192150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":499,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192957+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:02.192957+0000","last_peered":"2024-02-10T00:05:02.192957+0000","last_clean":"2024-02-10T00:05:02.192957+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:02.192957+0000","last_undegraded":"2024-02-10T00:05:02.192957+0000","last_fullsized":"2024-02-10T00:05:02.192957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":879,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193775+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:02.193775+0000","last_peered":"2024-02-10T00:05:02.193775+0000","last_clean":"2024-02-10T00:05:02.193775+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:02.193775+0000","last_undegraded":"2024-02-10T00:05:02.193775+0000","last_fullsized":"2024-02-10T00:05:02.193775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'327","reported_seq":367,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199331+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:03.199331+0000","last_peered":"2024-02-10T00:05:03.199331+0000","last_clean":"2024-02-10T00:05:03.199331+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:03.199331+0000","last_undegraded":"2024-02-10T00:05:03.199331+0000","last_fullsized":"2024-02-10T00:05:03.199331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":225,"num_write_kb":5908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":877,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195323+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:02.195323+0000","last_peered":"2024-02-10T00:05:02.195323+0000","last_clean":"2024-02-10T00:05:02.195323+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:02.195323+0000","last_undegraded":"2024-02-10T00:05:02.195323+0000","last_fullsized":"2024-02-10T00:05:02.195323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1868,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193663+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:02.193663+0000","last_peered":"2024-02-10T00:05:02.193663+0000","last_clean":"2024-02-10T00:05:02.193663+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:02.193663+0000","last_undegraded":"2024-02-10T00:05:02.193663+0000","last_fullsized":"2024-02-10T00:05:02.193663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":913,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193548+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:02.193548+0000","last_peered":"2024-02-10T00:05:02.193548+0000","last_clean":"2024-02-10T00:05:02.193548+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:02.193548+0000","last_undegraded":"2024-02-10T00:05:02.193548+0000","last_fullsized":"2024-02-10T00:05:02.193548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193083+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:02.193083+0000","last_peered":"2024-02-10T00:05:02.193083+0000","last_clean":"2024-02-10T00:05:02.193083+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:02.193083+0000","last_undegraded":"2024-02-10T00:05:02.193083+0000","last_fullsized":"2024-02-10T00:05:02.193083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":261,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194753+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:02.194753+0000","last_peered":"2024-02-10T00:05:02.194753+0000","last_clean":"2024-02-10T00:05:02.194753+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:02.194753+0000","last_undegraded":"2024-02-10T00:05:02.194753+0000","last_fullsized":"2024-02-10T00:05:02.194753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":859,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192736+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:02.192736+0000","last_peered":"2024-02-10T00:05:02.192736+0000","last_clean":"2024-02-10T00:05:02.192736+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:02.192736+0000","last_undegraded":"2024-02-10T00:05:02.192736+0000","last_fullsized":"2024-02-10T00:05:02.192736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193032+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:02.193032+0000","last_peered":"2024-02-10T00:05:02.193032+0000","last_clean":"2024-02-10T00:05:02.193032+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:02.193032+0000","last_undegraded":"2024-02-10T00:05:02.193032+0000","last_fullsized":"2024-02-10T00:05:02.193032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":717,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614068+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:02.614068+0000","last_peered":"2024-02-10T00:05:02.614068+0000","last_clean":"2024-02-10T00:05:02.614068+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:02.614068+0000","last_undegraded":"2024-02-10T00:05:02.614068+0000","last_fullsized":"2024-02-10T00:05:02.614068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1014,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193014+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:02.193014+0000","last_peered":"2024-02-10T00:05:02.193014+0000","last_clean":"2024-02-10T00:05:02.193014+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:02.193014+0000","last_undegraded":"2024-02-10T00:05:02.193014+0000","last_fullsized":"2024-02-10T00:05:02.193014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191144+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:02.191144+0000","last_peered":"2024-02-10T00:05:02.191144+0000","last_clean":"2024-02-10T00:05:02.191144+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:02.191144+0000","last_undegraded":"2024-02-10T00:05:02.191144+0000","last_fullsized":"2024-02-10T00:05:02.191144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":829,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788839+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:02.788839+0000","last_peered":"2024-02-10T00:05:02.788839+0000","last_clean":"2024-02-10T00:05:02.788839+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:02.788839+0000","last_undegraded":"2024-02-10T00:05:02.788839+0000","last_fullsized":"2024-02-10T00:05:02.788839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":814,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193294+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:02.193294+0000","last_peered":"2024-02-10T00:05:02.193294+0000","last_clean":"2024-02-10T00:05:02.193294+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:02.193294+0000","last_undegraded":"2024-02-10T00:05:02.193294+0000","last_fullsized":"2024-02-10T00:05:02.193294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192270+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:02.192270+0000","last_peered":"2024-02-10T00:05:02.192270+0000","last_clean":"2024-02-10T00:05:02.192270+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:02.192270+0000","last_undegraded":"2024-02-10T00:05:02.192270+0000","last_fullsized":"2024-02-10T00:05:02.192270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192129+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:02.192129+0000","last_peered":"2024-02-10T00:05:02.192129+0000","last_clean":"2024-02-10T00:05:02.192129+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:02.192129+0000","last_undegraded":"2024-02-10T00:05:02.192129+0000","last_fullsized":"2024-02-10T00:05:02.192129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1440,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193389+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:02.193389+0000","last_peered":"2024-02-10T00:05:02.193389+0000","last_clean":"2024-02-10T00:05:02.193389+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:02.193389+0000","last_undegraded":"2024-02-10T00:05:02.193389+0000","last_fullsized":"2024-02-10T00:05:02.193389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193701+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:02.193701+0000","last_peered":"2024-02-10T00:05:02.193701+0000","last_clean":"2024-02-10T00:05:02.193701+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:02.193701+0000","last_undegraded":"2024-02-10T00:05:02.193701+0000","last_fullsized":"2024-02-10T00:05:02.193701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191726+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:02.191726+0000","last_peered":"2024-02-10T00:05:02.191726+0000","last_clean":"2024-02-10T00:05:02.191726+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:02.191726+0000","last_undegraded":"2024-02-10T00:05:02.191726+0000","last_fullsized":"2024-02-10T00:05:02.191726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'697","reported_seq":1018,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191542+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:00.191542+0000","last_peered":"2024-02-10T00:05:00.191542+0000","last_clean":"2024-02-10T00:05:00.191542+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:00.191542+0000","last_undegraded":"2024-02-10T00:05:00.191542+0000","last_fullsized":"2024-02-10T00:05:00.191542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":1714,"num_write":585,"num_write_kb":10068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":924,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192414+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:00.192414+0000","last_peered":"2024-02-10T00:05:00.192414+0000","last_clean":"2024-02-10T00:05:00.192414+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:00.192414+0000","last_undegraded":"2024-02-10T00:05:00.192414+0000","last_fullsized":"2024-02-10T00:05:00.192414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193841+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:02.193841+0000","last_peered":"2024-02-10T00:05:02.193841+0000","last_clean":"2024-02-10T00:05:02.193841+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:02.193841+0000","last_undegraded":"2024-02-10T00:05:02.193841+0000","last_fullsized":"2024-02-10T00:05:02.193841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1058,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788844+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:02.788844+0000","last_peered":"2024-02-10T00:05:02.788844+0000","last_clean":"2024-02-10T00:05:02.788844+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:02.788844+0000","last_undegraded":"2024-02-10T00:05:02.788844+0000","last_fullsized":"2024-02-10T00:05:02.788844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":983,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191915+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:00.191915+0000","last_peered":"2024-02-10T00:05:00.191915+0000","last_clean":"2024-02-10T00:05:00.191915+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:00.191915+0000","last_undegraded":"2024-02-10T00:05:00.191915+0000","last_fullsized":"2024-02-10T00:05:00.191915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":461,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788602+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:02.788602+0000","last_peered":"2024-02-10T00:05:02.788602+0000","last_clean":"2024-02-10T00:05:02.788602+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:02.788602+0000","last_undegraded":"2024-02-10T00:05:02.788602+0000","last_fullsized":"2024-02-10T00:05:02.788602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193978+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:02.193978+0000","last_peered":"2024-02-10T00:05:02.193978+0000","last_clean":"2024-02-10T00:05:02.193978+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:02.193978+0000","last_undegraded":"2024-02-10T00:05:02.193978+0000","last_fullsized":"2024-02-10T00:05:02.193978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":987,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193906+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:02.193906+0000","last_peered":"2024-02-10T00:05:02.193906+0000","last_clean":"2024-02-10T00:05:02.193906+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:02.193906+0000","last_undegraded":"2024-02-10T00:05:02.193906+0000","last_fullsized":"2024-02-10T00:05:02.193906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194854+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:02.194854+0000","last_peered":"2024-02-10T00:05:02.194854+0000","last_clean":"2024-02-10T00:05:02.194854+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:02.194854+0000","last_undegraded":"2024-02-10T00:05:02.194854+0000","last_fullsized":"2024-02-10T00:05:02.194854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'736","reported_seq":767,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.192494+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:00.192494+0000","last_peered":"2024-02-10T00:05:00.192494+0000","last_clean":"2024-02-10T00:05:00.192494+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:00.192494+0000","last_undegraded":"2024-02-10T00:05:00.192494+0000","last_fullsized":"2024-02-10T00:05:00.192494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":696,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":901,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191060+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:02.191060+0000","last_peered":"2024-02-10T00:05:02.191060+0000","last_clean":"2024-02-10T00:05:02.191060+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:02.191060+0000","last_undegraded":"2024-02-10T00:05:02.191060+0000","last_fullsized":"2024-02-10T00:05:02.191060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":165,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191962+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:00.191962+0000","last_peered":"2024-02-10T00:05:00.191962+0000","last_clean":"2024-02-10T00:05:00.191962+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:00.191962+0000","last_undegraded":"2024-02-10T00:05:00.191962+0000","last_fullsized":"2024-02-10T00:05:00.191962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":944,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.196071+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:02.196071+0000","last_peered":"2024-02-10T00:05:02.196071+0000","last_clean":"2024-02-10T00:05:02.196071+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:02.196071+0000","last_undegraded":"2024-02-10T00:05:02.196071+0000","last_fullsized":"2024-02-10T00:05:02.196071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":456,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192154+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:02.192154+0000","last_peered":"2024-02-10T00:05:02.192154+0000","last_clean":"2024-02-10T00:05:02.192154+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:02.192154+0000","last_undegraded":"2024-02-10T00:05:02.192154+0000","last_fullsized":"2024-02-10T00:05:02.192154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":898,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194744+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:02.194744+0000","last_peered":"2024-02-10T00:05:02.194744+0000","last_clean":"2024-02-10T00:05:02.194744+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:02.194744+0000","last_undegraded":"2024-02-10T00:05:02.194744+0000","last_fullsized":"2024-02-10T00:05:02.194744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'617","reported_seq":663,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193624+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:02.193624+0000","last_peered":"2024-02-10T00:05:02.193624+0000","last_clean":"2024-02-10T00:05:02.193624+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:02.193624+0000","last_undegraded":"2024-02-10T00:05:02.193624+0000","last_fullsized":"2024-02-10T00:05:02.193624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":892,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191162+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:02.191162+0000","last_peered":"2024-02-10T00:05:02.191162+0000","last_clean":"2024-02-10T00:05:02.191162+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:02.191162+0000","last_undegraded":"2024-02-10T00:05:02.191162+0000","last_fullsized":"2024-02-10T00:05:02.191162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":292,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194403+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:02.194403+0000","last_peered":"2024-02-10T00:05:02.194403+0000","last_clean":"2024-02-10T00:05:02.194403+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:02.194403+0000","last_undegraded":"2024-02-10T00:05:02.194403+0000","last_fullsized":"2024-02-10T00:05:02.194403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":949,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192477+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:02.192477+0000","last_peered":"2024-02-10T00:05:02.192477+0000","last_clean":"2024-02-10T00:05:02.192477+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:02.192477+0000","last_undegraded":"2024-02-10T00:05:02.192477+0000","last_fullsized":"2024-02-10T00:05:02.192477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":234,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614541+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:02.614541+0000","last_peered":"2024-02-10T00:05:02.614541+0000","last_clean":"2024-02-10T00:05:02.614541+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:02.614541+0000","last_undegraded":"2024-02-10T00:05:02.614541+0000","last_fullsized":"2024-02-10T00:05:02.614541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":987,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191372+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:02.191372+0000","last_peered":"2024-02-10T00:05:02.191372+0000","last_clean":"2024-02-10T00:05:02.191372+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:02.191372+0000","last_undegraded":"2024-02-10T00:05:02.191372+0000","last_fullsized":"2024-02-10T00:05:02.191372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":931,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192406+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:02.192406+0000","last_peered":"2024-02-10T00:05:02.192406+0000","last_clean":"2024-02-10T00:05:02.192406+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:02.192406+0000","last_undegraded":"2024-02-10T00:05:02.192406+0000","last_fullsized":"2024-02-10T00:05:02.192406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1058,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192597+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:02.192597+0000","last_peered":"2024-02-10T00:05:02.192597+0000","last_clean":"2024-02-10T00:05:02.192597+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:02.192597+0000","last_undegraded":"2024-02-10T00:05:02.192597+0000","last_fullsized":"2024-02-10T00:05:02.192597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":960,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-10T00:05:00.191787+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:00.191787+0000","last_peered":"2024-02-10T00:05:00.191787+0000","last_clean":"2024-02-10T00:05:00.191787+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:00.191787+0000","last_undegraded":"2024-02-10T00:05:00.191787+0000","last_fullsized":"2024-02-10T00:05:00.191787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":920,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192753+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:02.192753+0000","last_peered":"2024-02-10T00:05:02.192753+0000","last_clean":"2024-02-10T00:05:02.192753+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:02.192753+0000","last_undegraded":"2024-02-10T00:05:02.192753+0000","last_fullsized":"2024-02-10T00:05:02.192753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":788,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193229+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:02.193229+0000","last_peered":"2024-02-10T00:05:02.193229+0000","last_clean":"2024-02-10T00:05:02.193229+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:02.193229+0000","last_undegraded":"2024-02-10T00:05:02.193229+0000","last_fullsized":"2024-02-10T00:05:02.193229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147592862,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":645,"num_read_kb":144154,"num_write":16317,"num_write_kb":272932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295305216,"data_stored":295185724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19890,"ondisk_log_size":19890,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986180,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423692,"kb_used_data":97924,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948148,"statfs":{"total":96636764160,"available":96202903552,"internally_reserved":0,"allocated":100274176,"data_stored":100041236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365244,"kb_used_data":61236,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006596,"statfs":{"total":96636764160,"available":96262754304,"internally_reserved":0,"allocated":62705664,"data_stored":62495734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084293,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376800,"kb_used_data":72088,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995040,"statfs":{"total":96636764160,"available":96250920960,"internally_reserved":0,"allocated":73818112,"data_stored":73604669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":1,"up_from":28,"seq":120259084293,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371540,"kb_used_data":59596,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000300,"statfs":{"total":96636764160,"available":96256307200,"internally_reserved":0,"allocated":61026304,"data_stored":60823299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62369792,"data_stored":62344648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99938304,"data_stored":99890150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:07.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:07.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.981+0000 7f4fbf904700 1 Processor -- start 2024-02-10T00:05:07.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.981+0000 7f4fbf904700 1 -- start start 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbf904700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbf904700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 0x7f4fb813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbf904700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb80b1a10 con 0x7f4fb813f060 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbf904700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb806dbb0 con 0x7f4fb806f7c0 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbf904700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb813f500 con 0x7f4fb8063740 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbce9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 0x7f4fb813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbdea1700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4fb813f060 0x7f4fb80a26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33788/0 (socket says 172.21.15.89:33788) 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbdea1700 1 -- 172.21.15.89:0/2976330879 learned_addr learned my addr 172.21.15.89:0/2976330879 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 -- 172.21.15.89:0/2976330879 >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 msgr2=0x7f4fb813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 --2- 172.21.15.89:0/2976330879 >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 0x7f4fb813eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 -- 172.21.15.89:0/2976330879 >> v1:172.21.15.89:6789/0 conn(0x7f4fb813f060 legacy=0x7f4fb80a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4faffff700 1 -- 172.21.15.89:0/2976330879 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282776923 0 0) 0x7f4fb80b1a10 con 0x7f4fb813f060 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 -- 172.21.15.89:0/2976330879 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8063b10 con 0x7f4fb8063740 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbce9f700 1 --2- 172.21.15.89:0/2976330879 >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 0x7f4fb813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4fbd6a0700 1 --2- 172.21.15.89:0/2976330879 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb806dfd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80098e0 tx=0x7f4fa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8481e3ccc51fd22 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.982+0000 7f4faffff700 1 -- 172.21.15.89:0/2976330879 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800b6d0 con 0x7f4fb8063740 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4faffff700 1 -- 172.21.15.89:0/2976330879 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa800b830 con 0x7f4fb8063740 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4faffff700 1 -- 172.21.15.89:0/2976330879 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800bbd0 con 0x7f4fb8063740 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 -- 172.21.15.89:0/2976330879 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 msgr2=0x7f4fb806dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 --2- 172.21.15.89:0/2976330879 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb806dfd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80098e0 tx=0x7f4fa80091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 -- 172.21.15.89:0/2976330879 shutdown_connections 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 --2- 172.21.15.89:0/2976330879 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb806dfd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 --2- 172.21.15.89:0/2976330879 >> v2:172.21.15.89:3300/0 conn(0x7f4fb806f7c0 0x7f4fb813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 -- 172.21.15.89:0/2976330879 >> 172.21.15.89:0/2976330879 conn(0x7f4fb806a820 msgr2=0x7f4fb80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 -- 172.21.15.89:0/2976330879 shutdown_connections 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.983+0000 7f4fbf904700 1 -- 172.21.15.89:0/2976330879 wait complete. 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.984+0000 7f4fbf904700 1 Processor -- start 2024-02-10T00:05:07.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.984+0000 7f4fbf904700 1 -- start start 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 0x7f4fb814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fb813f060 0x7f4fb814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8099770 con 0x7f4fb806f7c0 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8098570 con 0x7f4fb813f060 2024-02-10T00:05:07.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbf904700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80aecd0 con 0x7f4fb8063740 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbd6a0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbd6a0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58090/0 (socket says 172.21.15.89:58090) 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbd6a0700 1 -- 172.21.15.89:0/3213890106 learned_addr learned my addr 172.21.15.89:0/3213890106 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 0x7f4fb814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbdea1700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fb813f060 0x7f4fb814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 -- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 msgr2=0x7f4fb8097ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 -- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fb813f060 msgr2=0x7f4fb814e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fb813f060 0x7f4fb814e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 -- 172.21.15.89:0/3213890106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4009420 con 0x7f4fb806f7c0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbd6a0700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.985+0000 7f4fbce9f700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 0x7f4fb814e310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4fb806ace0 tx=0x7f4fb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.986+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400c850 con 0x7f4fb806f7c0 2024-02-10T00:05:07.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.986+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400c9b0 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.986+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa8009420 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.986+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400cd70 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.986+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb8096b80 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.987+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f4fb4013680 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.987+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb804c710 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.987+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f4fb405b3a0 con 0x7f4fb806f7c0 2024-02-10T00:05:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:07.990+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f4fb40395c0 con 0x7f4fb806f7c0 2024-02-10T00:05:08.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.141+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb806d990 con 0x7f4f9c046040 2024-02-10T00:05:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.147+0000 7f4fad7fa700 1 -- 172.21.15.89:0/3213890106 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273504 (unknown 2965378022 0 1192700336) 0x7f4fb806d990 con 0x7f4f9c046040 2024-02-10T00:05:08.153 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 >> v1:172.21.15.89:6816/47970 conn(0x7f4f9c046040 legacy=0x7f4f9c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 msgr2=0x7f4fb814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 0x7f4fb814e310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4fb806ace0 tx=0x7f4fb40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 shutdown_connections 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fb813f060 0x7f4fb814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4fb8063740 0x7f4fb8097ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 --2- 172.21.15.89:0/3213890106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fb806f7c0 0x7f4fb814e310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 >> 172.21.15.89:0/3213890106 conn(0x7f4fb806a820 msgr2=0x7f4fb813c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 shutdown_connections 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.150+0000 7f4fbf904700 1 -- 172.21.15.89:0/3213890106 wait complete. 2024-02-10T00:05:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:08.164 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-02-10T00:05:08.140102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148183432,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6141,"num_read_kb":2952146,"num_write":65324,"num_write_kb":9046180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71761,"ondisk_log_size":71761,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537284,"kb_used_data":290852,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375950076,"statfs":{"total":386547056640,"available":384972877824,"internally_reserved":0,"allocated":297832448,"data_stored":296969878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":474,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":108176,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.959993"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":918,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195422+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:02.195422+0000","last_peered":"2024-02-10T00:05:02.195422+0000","last_clean":"2024-02-10T00:05:02.195422+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:02.195422+0000","last_undegraded":"2024-02-10T00:05:02.195422+0000","last_fullsized":"2024-02-10T00:05:02.195422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":953,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195002+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:02.195002+0000","last_peered":"2024-02-10T00:05:02.195002+0000","last_clean":"2024-02-10T00:05:02.195002+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:02.195002+0000","last_undegraded":"2024-02-10T00:05:02.195002+0000","last_fullsized":"2024-02-10T00:05:02.195002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":908,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614282+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:02.614282+0000","last_peered":"2024-02-10T00:05:02.614282+0000","last_clean":"2024-02-10T00:05:02.614282+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:02.614282+0000","last_undegraded":"2024-02-10T00:05:02.614282+0000","last_fullsized":"2024-02-10T00:05:02.614282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":832,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614220+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:02.614220+0000","last_peered":"2024-02-10T00:05:02.614220+0000","last_clean":"2024-02-10T00:05:02.614220+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:02.614220+0000","last_undegraded":"2024-02-10T00:05:02.614220+0000","last_fullsized":"2024-02-10T00:05:02.614220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":832,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613230+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:02.613230+0000","last_peered":"2024-02-10T00:05:02.613230+0000","last_clean":"2024-02-10T00:05:02.613230+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:02.613230+0000","last_undegraded":"2024-02-10T00:05:02.613230+0000","last_fullsized":"2024-02-10T00:05:02.613230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":866,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193241+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:02.193241+0000","last_peered":"2024-02-10T00:05:02.193241+0000","last_clean":"2024-02-10T00:05:02.193241+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:02.193241+0000","last_undegraded":"2024-02-10T00:05:02.193241+0000","last_fullsized":"2024-02-10T00:05:02.193241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":924,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192799+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:02.192799+0000","last_peered":"2024-02-10T00:05:02.192799+0000","last_clean":"2024-02-10T00:05:02.192799+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:02.192799+0000","last_undegraded":"2024-02-10T00:05:02.192799+0000","last_fullsized":"2024-02-10T00:05:02.192799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":797,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192256+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:02.192256+0000","last_peered":"2024-02-10T00:05:02.192256+0000","last_clean":"2024-02-10T00:05:02.192256+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:02.192256+0000","last_undegraded":"2024-02-10T00:05:02.192256+0000","last_fullsized":"2024-02-10T00:05:02.192256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":926,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613360+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:02.613360+0000","last_peered":"2024-02-10T00:05:02.613360+0000","last_clean":"2024-02-10T00:05:02.613360+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:02.613360+0000","last_undegraded":"2024-02-10T00:05:02.613360+0000","last_fullsized":"2024-02-10T00:05:02.613360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193801+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:02.193801+0000","last_peered":"2024-02-10T00:05:02.193801+0000","last_clean":"2024-02-10T00:05:02.193801+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:02.193801+0000","last_undegraded":"2024-02-10T00:05:02.193801+0000","last_fullsized":"2024-02-10T00:05:02.193801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":844,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193504+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:02.193504+0000","last_peered":"2024-02-10T00:05:02.193504+0000","last_clean":"2024-02-10T00:05:02.193504+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:02.193504+0000","last_undegraded":"2024-02-10T00:05:02.193504+0000","last_fullsized":"2024-02-10T00:05:02.193504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":829,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195733+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:02.195733+0000","last_peered":"2024-02-10T00:05:02.195733+0000","last_clean":"2024-02-10T00:05:02.195733+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:02.195733+0000","last_undegraded":"2024-02-10T00:05:02.195733+0000","last_fullsized":"2024-02-10T00:05:02.195733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":963,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194816+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:02.194816+0000","last_peered":"2024-02-10T00:05:02.194816+0000","last_clean":"2024-02-10T00:05:02.194816+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:02.194816+0000","last_undegraded":"2024-02-10T00:05:02.194816+0000","last_fullsized":"2024-02-10T00:05:02.194816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":935,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192537+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:02.192537+0000","last_peered":"2024-02-10T00:05:02.192537+0000","last_clean":"2024-02-10T00:05:02.192537+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:02.192537+0000","last_undegraded":"2024-02-10T00:05:02.192537+0000","last_fullsized":"2024-02-10T00:05:02.192537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":984,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613868+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:02.613868+0000","last_peered":"2024-02-10T00:05:02.613868+0000","last_clean":"2024-02-10T00:05:02.613868+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:02.613868+0000","last_undegraded":"2024-02-10T00:05:02.613868+0000","last_fullsized":"2024-02-10T00:05:02.613868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":883,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193743+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:02.193743+0000","last_peered":"2024-02-10T00:05:02.193743+0000","last_clean":"2024-02-10T00:05:02.193743+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:02.193743+0000","last_undegraded":"2024-02-10T00:05:02.193743+0000","last_fullsized":"2024-02-10T00:05:02.193743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":981,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613116+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:02.613116+0000","last_peered":"2024-02-10T00:05:02.613116+0000","last_clean":"2024-02-10T00:05:02.613116+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:02.613116+0000","last_undegraded":"2024-02-10T00:05:02.613116+0000","last_fullsized":"2024-02-10T00:05:02.613116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":781,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614269+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:02.614269+0000","last_peered":"2024-02-10T00:05:02.614269+0000","last_clean":"2024-02-10T00:05:02.614269+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:02.614269+0000","last_undegraded":"2024-02-10T00:05:02.614269+0000","last_fullsized":"2024-02-10T00:05:02.614269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1012,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194849+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:02.194849+0000","last_peered":"2024-02-10T00:05:02.194849+0000","last_clean":"2024-02-10T00:05:02.194849+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:02.194849+0000","last_undegraded":"2024-02-10T00:05:02.194849+0000","last_fullsized":"2024-02-10T00:05:02.194849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":888,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193155+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:02.193155+0000","last_peered":"2024-02-10T00:05:02.193155+0000","last_clean":"2024-02-10T00:05:02.193155+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:02.193155+0000","last_undegraded":"2024-02-10T00:05:02.193155+0000","last_fullsized":"2024-02-10T00:05:02.193155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":953,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194633+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:02.194633+0000","last_peered":"2024-02-10T00:05:02.194633+0000","last_clean":"2024-02-10T00:05:02.194633+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:02.194633+0000","last_undegraded":"2024-02-10T00:05:02.194633+0000","last_fullsized":"2024-02-10T00:05:02.194633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":962,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613680+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:02.613680+0000","last_peered":"2024-02-10T00:05:02.613680+0000","last_clean":"2024-02-10T00:05:02.613680+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:02.613680+0000","last_undegraded":"2024-02-10T00:05:02.613680+0000","last_fullsized":"2024-02-10T00:05:02.613680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":960,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192400+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:02.192400+0000","last_peered":"2024-02-10T00:05:02.192400+0000","last_clean":"2024-02-10T00:05:02.192400+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:02.192400+0000","last_undegraded":"2024-02-10T00:05:02.192400+0000","last_fullsized":"2024-02-10T00:05:02.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":956,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192226+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:02.192226+0000","last_peered":"2024-02-10T00:05:02.192226+0000","last_clean":"2024-02-10T00:05:02.192226+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:02.192226+0000","last_undegraded":"2024-02-10T00:05:02.192226+0000","last_fullsized":"2024-02-10T00:05:02.192226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":977,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193141+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:02.193141+0000","last_peered":"2024-02-10T00:05:02.193141+0000","last_clean":"2024-02-10T00:05:02.193141+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:02.193141+0000","last_undegraded":"2024-02-10T00:05:02.193141+0000","last_fullsized":"2024-02-10T00:05:02.193141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":938,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193941+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:02.193941+0000","last_peered":"2024-02-10T00:05:02.193941+0000","last_clean":"2024-02-10T00:05:02.193941+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:02.193941+0000","last_undegraded":"2024-02-10T00:05:02.193941+0000","last_fullsized":"2024-02-10T00:05:02.193941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":889,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193536+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:02.193536+0000","last_peered":"2024-02-10T00:05:02.193536+0000","last_clean":"2024-02-10T00:05:02.193536+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:02.193536+0000","last_undegraded":"2024-02-10T00:05:02.193536+0000","last_fullsized":"2024-02-10T00:05:02.193536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1505,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192680+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:02.192680+0000","last_peered":"2024-02-10T00:05:02.192680+0000","last_clean":"2024-02-10T00:05:02.192680+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:02.192680+0000","last_undegraded":"2024-02-10T00:05:02.192680+0000","last_fullsized":"2024-02-10T00:05:02.192680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":871,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194043+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:02.194043+0000","last_peered":"2024-02-10T00:05:02.194043+0000","last_clean":"2024-02-10T00:05:02.194043+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:02.194043+0000","last_undegraded":"2024-02-10T00:05:02.194043+0000","last_fullsized":"2024-02-10T00:05:02.194043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":892,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194279+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:02.194279+0000","last_peered":"2024-02-10T00:05:02.194279+0000","last_clean":"2024-02-10T00:05:02.194279+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:02.194279+0000","last_undegraded":"2024-02-10T00:05:02.194279+0000","last_fullsized":"2024-02-10T00:05:02.194279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":894,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614688+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:02.614688+0000","last_peered":"2024-02-10T00:05:02.614688+0000","last_clean":"2024-02-10T00:05:02.614688+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:02.614688+0000","last_undegraded":"2024-02-10T00:05:02.614688+0000","last_fullsized":"2024-02-10T00:05:02.614688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194082+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:02.194082+0000","last_peered":"2024-02-10T00:05:02.194082+0000","last_clean":"2024-02-10T00:05:02.194082+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:02.194082+0000","last_undegraded":"2024-02-10T00:05:02.194082+0000","last_fullsized":"2024-02-10T00:05:02.194082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":904,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195372+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:02.195372+0000","last_peered":"2024-02-10T00:05:02.195372+0000","last_clean":"2024-02-10T00:05:02.195372+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:02.195372+0000","last_undegraded":"2024-02-10T00:05:02.195372+0000","last_fullsized":"2024-02-10T00:05:02.195372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":177,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214164+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:05.214164+0000","last_peered":"2024-02-10T00:05:05.214164+0000","last_clean":"2024-02-10T00:05:05.214164+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:05.214164+0000","last_undegraded":"2024-02-10T00:05:05.214164+0000","last_fullsized":"2024-02-10T00:05:05.214164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":938,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193989+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:02.193989+0000","last_peered":"2024-02-10T00:05:02.193989+0000","last_clean":"2024-02-10T00:05:02.193989+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:02.193989+0000","last_undegraded":"2024-02-10T00:05:02.193989+0000","last_fullsized":"2024-02-10T00:05:02.193989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1035,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194841+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:02.194841+0000","last_peered":"2024-02-10T00:05:02.194841+0000","last_clean":"2024-02-10T00:05:02.194841+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:02.194841+0000","last_undegraded":"2024-02-10T00:05:02.194841+0000","last_fullsized":"2024-02-10T00:05:02.194841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1061,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192723+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:02.192723+0000","last_peered":"2024-02-10T00:05:02.192723+0000","last_clean":"2024-02-10T00:05:02.192723+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:02.192723+0000","last_undegraded":"2024-02-10T00:05:02.192723+0000","last_fullsized":"2024-02-10T00:05:02.192723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":436,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224923+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:05.224923+0000","last_peered":"2024-02-10T00:05:05.224923+0000","last_clean":"2024-02-10T00:05:05.224923+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:05.224923+0000","last_undegraded":"2024-02-10T00:05:05.224923+0000","last_fullsized":"2024-02-10T00:05:05.224923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1022,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192814+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:02.192814+0000","last_peered":"2024-02-10T00:05:02.192814+0000","last_clean":"2024-02-10T00:05:02.192814+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:02.192814+0000","last_undegraded":"2024-02-10T00:05:02.192814+0000","last_fullsized":"2024-02-10T00:05:02.192814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":703,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.221219+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:05.221219+0000","last_peered":"2024-02-10T00:05:05.221219+0000","last_clean":"2024-02-10T00:05:05.221219+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:05.221219+0000","last_undegraded":"2024-02-10T00:05:05.221219+0000","last_fullsized":"2024-02-10T00:05:05.221219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":994,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194646+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:02.194646+0000","last_peered":"2024-02-10T00:05:02.194646+0000","last_clean":"2024-02-10T00:05:02.194646+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:02.194646+0000","last_undegraded":"2024-02-10T00:05:02.194646+0000","last_fullsized":"2024-02-10T00:05:02.194646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":434,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197894+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:03.197894+0000","last_peered":"2024-02-10T00:05:03.197894+0000","last_clean":"2024-02-10T00:05:03.197894+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:03.197894+0000","last_undegraded":"2024-02-10T00:05:03.197894+0000","last_fullsized":"2024-02-10T00:05:03.197894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1093,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193066+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:02.193066+0000","last_peered":"2024-02-10T00:05:02.193066+0000","last_clean":"2024-02-10T00:05:02.193066+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:02.193066+0000","last_undegraded":"2024-02-10T00:05:02.193066+0000","last_fullsized":"2024-02-10T00:05:02.193066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.612786+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:02.612786+0000","last_peered":"2024-02-10T00:05:02.612786+0000","last_clean":"2024-02-10T00:05:02.612786+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:02.612786+0000","last_undegraded":"2024-02-10T00:05:02.612786+0000","last_fullsized":"2024-02-10T00:05:02.612786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":959,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194118+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:02.194118+0000","last_peered":"2024-02-10T00:05:02.194118+0000","last_clean":"2024-02-10T00:05:02.194118+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:02.194118+0000","last_undegraded":"2024-02-10T00:05:02.194118+0000","last_fullsized":"2024-02-10T00:05:02.194118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":517,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198479+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:03.198479+0000","last_peered":"2024-02-10T00:05:03.198479+0000","last_clean":"2024-02-10T00:05:03.198479+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:03.198479+0000","last_undegraded":"2024-02-10T00:05:03.198479+0000","last_fullsized":"2024-02-10T00:05:03.198479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":936,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.612988+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:02.612988+0000","last_peered":"2024-02-10T00:05:02.612988+0000","last_clean":"2024-02-10T00:05:02.612988+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:02.612988+0000","last_undegraded":"2024-02-10T00:05:02.612988+0000","last_fullsized":"2024-02-10T00:05:02.612988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":535,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.216698+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:05.216698+0000","last_peered":"2024-02-10T00:05:05.216698+0000","last_clean":"2024-02-10T00:05:05.216698+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:05.216698+0000","last_undegraded":"2024-02-10T00:05:05.216698+0000","last_fullsized":"2024-02-10T00:05:05.216698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":854,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194945+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:02.194945+0000","last_peered":"2024-02-10T00:05:02.194945+0000","last_clean":"2024-02-10T00:05:02.194945+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:02.194945+0000","last_undegraded":"2024-02-10T00:05:02.194945+0000","last_fullsized":"2024-02-10T00:05:02.194945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":432,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614410+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:02.614410+0000","last_peered":"2024-02-10T00:05:02.614410+0000","last_clean":"2024-02-10T00:05:02.614410+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:02.614410+0000","last_undegraded":"2024-02-10T00:05:02.614410+0000","last_fullsized":"2024-02-10T00:05:02.614410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1077,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193823+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:02.193823+0000","last_peered":"2024-02-10T00:05:02.193823+0000","last_clean":"2024-02-10T00:05:02.193823+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:02.193823+0000","last_undegraded":"2024-02-10T00:05:02.193823+0000","last_fullsized":"2024-02-10T00:05:02.193823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":466,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195162+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:02.195162+0000","last_peered":"2024-02-10T00:05:02.195162+0000","last_clean":"2024-02-10T00:05:02.195162+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:02.195162+0000","last_undegraded":"2024-02-10T00:05:02.195162+0000","last_fullsized":"2024-02-10T00:05:02.195162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":973,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194451+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:02.194451+0000","last_peered":"2024-02-10T00:05:02.194451+0000","last_clean":"2024-02-10T00:05:02.194451+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:02.194451+0000","last_undegraded":"2024-02-10T00:05:02.194451+0000","last_fullsized":"2024-02-10T00:05:02.194451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":782,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193390+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:02.193390+0000","last_peered":"2024-02-10T00:05:02.193390+0000","last_clean":"2024-02-10T00:05:02.193390+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:02.193390+0000","last_undegraded":"2024-02-10T00:05:02.193390+0000","last_fullsized":"2024-02-10T00:05:02.193390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":896,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191242+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:02.191242+0000","last_peered":"2024-02-10T00:05:02.191242+0000","last_clean":"2024-02-10T00:05:02.191242+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:02.191242+0000","last_undegraded":"2024-02-10T00:05:02.191242+0000","last_fullsized":"2024-02-10T00:05:02.191242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.612762+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:02.612762+0000","last_peered":"2024-02-10T00:05:02.612762+0000","last_clean":"2024-02-10T00:05:02.612762+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:02.612762+0000","last_undegraded":"2024-02-10T00:05:02.612762+0000","last_fullsized":"2024-02-10T00:05:02.612762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":925,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614034+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:02.614034+0000","last_peered":"2024-02-10T00:05:02.614034+0000","last_clean":"2024-02-10T00:05:02.614034+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:02.614034+0000","last_undegraded":"2024-02-10T00:05:02.614034+0000","last_fullsized":"2024-02-10T00:05:02.614034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1212,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197819+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:03.197819+0000","last_peered":"2024-02-10T00:05:03.197819+0000","last_clean":"2024-02-10T00:05:03.197819+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:03.197819+0000","last_undegraded":"2024-02-10T00:05:03.197819+0000","last_fullsized":"2024-02-10T00:05:03.197819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1026,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.612685+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:02.612685+0000","last_peered":"2024-02-10T00:05:02.612685+0000","last_clean":"2024-02-10T00:05:02.612685+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:02.612685+0000","last_undegraded":"2024-02-10T00:05:02.612685+0000","last_fullsized":"2024-02-10T00:05:02.612685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":499,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192957+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:02.192957+0000","last_peered":"2024-02-10T00:05:02.192957+0000","last_clean":"2024-02-10T00:05:02.192957+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:02.192957+0000","last_undegraded":"2024-02-10T00:05:02.192957+0000","last_fullsized":"2024-02-10T00:05:02.192957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":879,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193775+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:02.193775+0000","last_peered":"2024-02-10T00:05:02.193775+0000","last_clean":"2024-02-10T00:05:02.193775+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:02.193775+0000","last_undegraded":"2024-02-10T00:05:02.193775+0000","last_fullsized":"2024-02-10T00:05:02.193775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'327","reported_seq":367,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199331+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:03.199331+0000","last_peered":"2024-02-10T00:05:03.199331+0000","last_clean":"2024-02-10T00:05:03.199331+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:03.199331+0000","last_undegraded":"2024-02-10T00:05:03.199331+0000","last_fullsized":"2024-02-10T00:05:03.199331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":225,"num_write_kb":5908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":877,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.195323+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:02.195323+0000","last_peered":"2024-02-10T00:05:02.195323+0000","last_clean":"2024-02-10T00:05:02.195323+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:02.195323+0000","last_undegraded":"2024-02-10T00:05:02.195323+0000","last_fullsized":"2024-02-10T00:05:02.195323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1868,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193663+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:02.193663+0000","last_peered":"2024-02-10T00:05:02.193663+0000","last_clean":"2024-02-10T00:05:02.193663+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:02.193663+0000","last_undegraded":"2024-02-10T00:05:02.193663+0000","last_fullsized":"2024-02-10T00:05:02.193663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":913,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193548+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:02.193548+0000","last_peered":"2024-02-10T00:05:02.193548+0000","last_clean":"2024-02-10T00:05:02.193548+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:02.193548+0000","last_undegraded":"2024-02-10T00:05:02.193548+0000","last_fullsized":"2024-02-10T00:05:02.193548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193083+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:02.193083+0000","last_peered":"2024-02-10T00:05:02.193083+0000","last_clean":"2024-02-10T00:05:02.193083+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:02.193083+0000","last_undegraded":"2024-02-10T00:05:02.193083+0000","last_fullsized":"2024-02-10T00:05:02.193083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":261,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194753+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:02.194753+0000","last_peered":"2024-02-10T00:05:02.194753+0000","last_clean":"2024-02-10T00:05:02.194753+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:02.194753+0000","last_undegraded":"2024-02-10T00:05:02.194753+0000","last_fullsized":"2024-02-10T00:05:02.194753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":859,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192736+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:02.192736+0000","last_peered":"2024-02-10T00:05:02.192736+0000","last_clean":"2024-02-10T00:05:02.192736+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:02.192736+0000","last_undegraded":"2024-02-10T00:05:02.192736+0000","last_fullsized":"2024-02-10T00:05:02.192736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193032+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:02.193032+0000","last_peered":"2024-02-10T00:05:02.193032+0000","last_clean":"2024-02-10T00:05:02.193032+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:02.193032+0000","last_undegraded":"2024-02-10T00:05:02.193032+0000","last_fullsized":"2024-02-10T00:05:02.193032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":718,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788398+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:02.788398+0000","last_peered":"2024-02-10T00:05:02.788398+0000","last_clean":"2024-02-10T00:05:02.788398+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:02.788398+0000","last_undegraded":"2024-02-10T00:05:02.788398+0000","last_fullsized":"2024-02-10T00:05:02.788398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1014,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193014+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:02.193014+0000","last_peered":"2024-02-10T00:05:02.193014+0000","last_clean":"2024-02-10T00:05:02.193014+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:02.193014+0000","last_undegraded":"2024-02-10T00:05:02.193014+0000","last_fullsized":"2024-02-10T00:05:02.193014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191144+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:02.191144+0000","last_peered":"2024-02-10T00:05:02.191144+0000","last_clean":"2024-02-10T00:05:02.191144+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:02.191144+0000","last_undegraded":"2024-02-10T00:05:02.191144+0000","last_fullsized":"2024-02-10T00:05:02.191144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":829,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788839+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:02.788839+0000","last_peered":"2024-02-10T00:05:02.788839+0000","last_clean":"2024-02-10T00:05:02.788839+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:02.788839+0000","last_undegraded":"2024-02-10T00:05:02.788839+0000","last_fullsized":"2024-02-10T00:05:02.788839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":814,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193294+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:02.193294+0000","last_peered":"2024-02-10T00:05:02.193294+0000","last_clean":"2024-02-10T00:05:02.193294+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:02.193294+0000","last_undegraded":"2024-02-10T00:05:02.193294+0000","last_fullsized":"2024-02-10T00:05:02.193294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192270+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:02.192270+0000","last_peered":"2024-02-10T00:05:02.192270+0000","last_clean":"2024-02-10T00:05:02.192270+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:02.192270+0000","last_undegraded":"2024-02-10T00:05:02.192270+0000","last_fullsized":"2024-02-10T00:05:02.192270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192129+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:02.192129+0000","last_peered":"2024-02-10T00:05:02.192129+0000","last_clean":"2024-02-10T00:05:02.192129+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:02.192129+0000","last_undegraded":"2024-02-10T00:05:02.192129+0000","last_fullsized":"2024-02-10T00:05:02.192129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1440,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193389+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:02.193389+0000","last_peered":"2024-02-10T00:05:02.193389+0000","last_clean":"2024-02-10T00:05:02.193389+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:02.193389+0000","last_undegraded":"2024-02-10T00:05:02.193389+0000","last_fullsized":"2024-02-10T00:05:02.193389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193701+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:02.193701+0000","last_peered":"2024-02-10T00:05:02.193701+0000","last_clean":"2024-02-10T00:05:02.193701+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:02.193701+0000","last_undegraded":"2024-02-10T00:05:02.193701+0000","last_fullsized":"2024-02-10T00:05:02.193701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191726+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:02.191726+0000","last_peered":"2024-02-10T00:05:02.191726+0000","last_clean":"2024-02-10T00:05:02.191726+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:02.191726+0000","last_undegraded":"2024-02-10T00:05:02.191726+0000","last_fullsized":"2024-02-10T00:05:02.191726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1022,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.227609+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:05.227609+0000","last_peered":"2024-02-10T00:05:05.227609+0000","last_clean":"2024-02-10T00:05:05.227609+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:05.227609+0000","last_undegraded":"2024-02-10T00:05:05.227609+0000","last_fullsized":"2024-02-10T00:05:05.227609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":925,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614571+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:02.614571+0000","last_peered":"2024-02-10T00:05:02.614571+0000","last_clean":"2024-02-10T00:05:02.614571+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:02.614571+0000","last_undegraded":"2024-02-10T00:05:02.614571+0000","last_fullsized":"2024-02-10T00:05:02.614571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193841+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:02.193841+0000","last_peered":"2024-02-10T00:05:02.193841+0000","last_clean":"2024-02-10T00:05:02.193841+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:02.193841+0000","last_undegraded":"2024-02-10T00:05:02.193841+0000","last_fullsized":"2024-02-10T00:05:02.193841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1058,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.788844+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:02.788844+0000","last_peered":"2024-02-10T00:05:02.788844+0000","last_clean":"2024-02-10T00:05:02.788844+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:02.788844+0000","last_undegraded":"2024-02-10T00:05:02.788844+0000","last_fullsized":"2024-02-10T00:05:02.788844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":984,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.614148+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:02.614148+0000","last_peered":"2024-02-10T00:05:02.614148+0000","last_clean":"2024-02-10T00:05:02.614148+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:02.614148+0000","last_undegraded":"2024-02-10T00:05:02.614148+0000","last_fullsized":"2024-02-10T00:05:02.614148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":462,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199527+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:03.199527+0000","last_peered":"2024-02-10T00:05:03.199527+0000","last_clean":"2024-02-10T00:05:03.199527+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:03.199527+0000","last_undegraded":"2024-02-10T00:05:03.199527+0000","last_fullsized":"2024-02-10T00:05:03.199527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193978+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:02.193978+0000","last_peered":"2024-02-10T00:05:02.193978+0000","last_clean":"2024-02-10T00:05:02.193978+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:02.193978+0000","last_undegraded":"2024-02-10T00:05:02.193978+0000","last_fullsized":"2024-02-10T00:05:02.193978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":987,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193906+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:02.193906+0000","last_peered":"2024-02-10T00:05:02.193906+0000","last_clean":"2024-02-10T00:05:02.193906+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:02.193906+0000","last_undegraded":"2024-02-10T00:05:02.193906+0000","last_fullsized":"2024-02-10T00:05:02.193906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194854+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:02.194854+0000","last_peered":"2024-02-10T00:05:02.194854+0000","last_clean":"2024-02-10T00:05:02.194854+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:02.194854+0000","last_undegraded":"2024-02-10T00:05:02.194854+0000","last_fullsized":"2024-02-10T00:05:02.194854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":770,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.221930+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:05.221930+0000","last_peered":"2024-02-10T00:05:05.221930+0000","last_clean":"2024-02-10T00:05:05.221930+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:05.221930+0000","last_undegraded":"2024-02-10T00:05:05.221930+0000","last_fullsized":"2024-02-10T00:05:05.221930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":901,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191060+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:02.191060+0000","last_peered":"2024-02-10T00:05:02.191060+0000","last_clean":"2024-02-10T00:05:02.191060+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:02.191060+0000","last_undegraded":"2024-02-10T00:05:02.191060+0000","last_fullsized":"2024-02-10T00:05:02.191060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.613112+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:02.613112+0000","last_peered":"2024-02-10T00:05:02.613112+0000","last_clean":"2024-02-10T00:05:02.613112+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:02.613112+0000","last_undegraded":"2024-02-10T00:05:02.613112+0000","last_fullsized":"2024-02-10T00:05:02.613112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":944,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.196071+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:02.196071+0000","last_peered":"2024-02-10T00:05:02.196071+0000","last_clean":"2024-02-10T00:05:02.196071+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:02.196071+0000","last_undegraded":"2024-02-10T00:05:02.196071+0000","last_fullsized":"2024-02-10T00:05:02.196071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":457,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199148+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:03.199148+0000","last_peered":"2024-02-10T00:05:03.199148+0000","last_clean":"2024-02-10T00:05:03.199148+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:03.199148+0000","last_undegraded":"2024-02-10T00:05:03.199148+0000","last_fullsized":"2024-02-10T00:05:03.199148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":898,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194744+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:02.194744+0000","last_peered":"2024-02-10T00:05:02.194744+0000","last_clean":"2024-02-10T00:05:02.194744+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:02.194744+0000","last_undegraded":"2024-02-10T00:05:02.194744+0000","last_fullsized":"2024-02-10T00:05:02.194744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"40'619","reported_seq":666,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224624+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:05.224624+0000","last_peered":"2024-02-10T00:05:05.224624+0000","last_clean":"2024-02-10T00:05:05.224624+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:05.224624+0000","last_undegraded":"2024-02-10T00:05:05.224624+0000","last_fullsized":"2024-02-10T00:05:05.224624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":892,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191162+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:02.191162+0000","last_peered":"2024-02-10T00:05:02.191162+0000","last_clean":"2024-02-10T00:05:02.191162+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:02.191162+0000","last_undegraded":"2024-02-10T00:05:02.191162+0000","last_fullsized":"2024-02-10T00:05:02.191162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":292,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.194403+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:02.194403+0000","last_peered":"2024-02-10T00:05:02.194403+0000","last_clean":"2024-02-10T00:05:02.194403+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:02.194403+0000","last_undegraded":"2024-02-10T00:05:02.194403+0000","last_fullsized":"2024-02-10T00:05:02.194403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":949,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192477+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:02.192477+0000","last_peered":"2024-02-10T00:05:02.192477+0000","last_clean":"2024-02-10T00:05:02.192477+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:02.192477+0000","last_undegraded":"2024-02-10T00:05:02.192477+0000","last_fullsized":"2024-02-10T00:05:02.192477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213882+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:05.213882+0000","last_peered":"2024-02-10T00:05:05.213882+0000","last_clean":"2024-02-10T00:05:05.213882+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:05.213882+0000","last_undegraded":"2024-02-10T00:05:05.213882+0000","last_fullsized":"2024-02-10T00:05:05.213882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":987,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.191372+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:02.191372+0000","last_peered":"2024-02-10T00:05:02.191372+0000","last_clean":"2024-02-10T00:05:02.191372+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:02.191372+0000","last_undegraded":"2024-02-10T00:05:02.191372+0000","last_fullsized":"2024-02-10T00:05:02.191372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":931,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192406+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:02.192406+0000","last_peered":"2024-02-10T00:05:02.192406+0000","last_clean":"2024-02-10T00:05:02.192406+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:02.192406+0000","last_undegraded":"2024-02-10T00:05:02.192406+0000","last_fullsized":"2024-02-10T00:05:02.192406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1058,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192597+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:02.192597+0000","last_peered":"2024-02-10T00:05:02.192597+0000","last_clean":"2024-02-10T00:05:02.192597+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:02.192597+0000","last_undegraded":"2024-02-10T00:05:02.192597+0000","last_fullsized":"2024-02-10T00:05:02.192597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":961,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.612825+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:02.612825+0000","last_peered":"2024-02-10T00:05:02.612825+0000","last_clean":"2024-02-10T00:05:02.612825+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:02.612825+0000","last_undegraded":"2024-02-10T00:05:02.612825+0000","last_fullsized":"2024-02-10T00:05:02.612825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":920,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.192753+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:02.192753+0000","last_peered":"2024-02-10T00:05:02.192753+0000","last_clean":"2024-02-10T00:05:02.192753+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:02.192753+0000","last_undegraded":"2024-02-10T00:05:02.192753+0000","last_fullsized":"2024-02-10T00:05:02.192753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":788,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-10T00:05:02.193229+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:02.193229+0000","last_peered":"2024-02-10T00:05:02.193229+0000","last_clean":"2024-02-10T00:05:02.193229+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:02.193229+0000","last_undegraded":"2024-02-10T00:05:02.193229+0000","last_fullsized":"2024-02-10T00:05:02.193229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147593064,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":679,"num_read_kb":144191,"num_write":16321,"num_write_kb":272935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295305216,"data_stored":295185926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19902,"ondisk_log_size":19902,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986181,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423692,"kb_used_data":97924,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948148,"statfs":{"total":96636764160,"available":96202903552,"internally_reserved":0,"allocated":100274176,"data_stored":100041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365244,"kb_used_data":61236,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006596,"statfs":{"total":96636764160,"available":96262754304,"internally_reserved":0,"allocated":62705664,"data_stored":62495734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084294,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376808,"kb_used_data":72096,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995032,"statfs":{"total":96636764160,"available":96250912768,"internally_reserved":0,"allocated":73826304,"data_stored":73609337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":1,"up_from":28,"seq":120259084294,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371540,"kb_used_data":59596,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000300,"statfs":{"total":96636764160,"available":96256307200,"internally_reserved":0,"allocated":61026304,"data_stored":60823299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62369792,"data_stored":62344648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99938304,"data_stored":99890150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:08.169 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-10T00:05:08.170 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-10T00:05:08.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-10T00:05:08.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.320+0000 7f91386cc700 1 Processor -- start 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.320+0000 7f91386cc700 1 -- start start 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f91386cc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 0x7f91300a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f91386cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 0x7f91301469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f91386cc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913013c4c0 con 0x7f9130063580 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f91386cc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91300a3190 con 0x7f91300a5110 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f91386cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300a1590 con 0x7f91300a2470 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135c67700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 0x7f91300a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 0x7f91301469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135c67700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 0x7f91300a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60662/0 (socket says 172.21.15.89:60662) 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135c67700 1 -- 172.21.15.89:0/1731307242 learned_addr learned my addr 172.21.15.89:0/1731307242 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136468700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9130063580 0x7f913013c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33800/0 (socket says 172.21.15.89:33800) 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135466700 1 -- 172.21.15.89:0/1731307242 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225686743 0 0) 0x7f913013c4c0 con 0x7f9130063580 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135466700 1 -- 172.21.15.89:0/1731307242 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f911c003570 con 0x7f9130063580 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 -- 172.21.15.89:0/1731307242 >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 msgr2=0x7f91300a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 --2- 172.21.15.89:0/1731307242 >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 0x7f91300a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 -- 172.21.15.89:0/1731307242 >> v1:172.21.15.89:6789/0 conn(0x7f9130063580 legacy=0x7f913013c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 -- 172.21.15.89:0/1731307242 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913013ce90 con 0x7f91300a2470 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9136c69700 1 --2- 172.21.15.89:0/1731307242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 0x7f91301469c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9128009e60 tx=0x7f9128009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa685456a567a2c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135466700 1 -- 172.21.15.89:0/1731307242 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800e070 con 0x7f91300a2470 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.321+0000 7f9135466700 1 -- 172.21.15.89:0/1731307242 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912800bb40 con 0x7f91300a2470 2024-02-10T00:05:08.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f9135466700 1 -- 172.21.15.89:0/1731307242 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128012430 con 0x7f91300a2470 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 -- 172.21.15.89:0/1731307242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 msgr2=0x7f91301469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 --2- 172.21.15.89:0/1731307242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 0x7f91301469c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9128009e60 tx=0x7f9128009780 comp rx=0 tx=0).stop 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 -- 172.21.15.89:0/1731307242 shutdown_connections 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 --2- 172.21.15.89:0/1731307242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91300a2470 0x7f91301469c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 --2- 172.21.15.89:0/1731307242 >> v2:172.21.15.89:3300/0 conn(0x7f91300a5110 0x7f91300a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 -- 172.21.15.89:0/1731307242 >> 172.21.15.89:0/1731307242 conn(0x7f913006a560 msgr2=0x7f913006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 -- 172.21.15.89:0/1731307242 shutdown_connections 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.322+0000 7f91386cc700 1 -- 172.21.15.89:0/1731307242 wait complete. 2024-02-10T00:05:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.323+0000 7f91386cc700 1 Processor -- start 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.323+0000 7f91386cc700 1 -- start start 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f91300a2470 0x7f91300a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 0x7f913014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9130149200 con 0x7f91300a5110 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300a8ad0 con 0x7f9130063580 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f913014eae0 con 0x7f91300a2470 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9135c67700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f91300a2470 0x7f91300a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34712/0 (socket says 172.21.15.89:34712) 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136c69700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 0x7f913014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 -- 172.21.15.89:0/4077628469 learned_addr learned my addr 172.21.15.89:0/4077628469 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 -- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f91300a2470 msgr2=0x7f91300a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f91300a2470 0x7f91300a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 -- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 msgr2=0x7f913014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 0x7f913014ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 -- 172.21.15.89:0/4077628469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128009a20 con 0x7f9130063580 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136c69700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 0x7f913014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f9136468700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f912000c7f0 tx=0x7f9120007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120005c10 con 0x7f9130063580 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120005d90 con 0x7f9130063580 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91301402d0 con 0x7f9130063580 2024-02-10T00:05:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120007320 con 0x7f9130063580 2024-02-10T00:05:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.324+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91300a8640 con 0x7f9130063580 2024-02-10T00:05:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.325+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91300aa060 con 0x7f9130063580 2024-02-10T00:05:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.326+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f912001b3b0 con 0x7f9130063580 2024-02-10T00:05:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.326+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f912005a920 con 0x7f9130063580 2024-02-10T00:05:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.329+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f9120038ae0 con 0x7f9130063580 2024-02-10T00:05:08.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.509+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f91300a8860 con 0x7f9130063580 2024-02-10T00:05:08.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.509+0000 7f91267fc700 1 -- 172.21.15.89:0/4077628469 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9120017070 con 0x7f9130063580 2024-02-10T00:05:08.511 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:08.512 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 >> v1:172.21.15.89:6816/47970 conn(0x7f9114046040 legacy=0x7f91140484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 msgr2=0x7f91300a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f912000c7f0 tx=0x7f9120007e00 comp rx=0 tx=0).stop 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 shutdown_connections 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91300a5110 0x7f913014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9130063580 0x7f91300a98e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 --2- 172.21.15.89:0/4077628469 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f91300a2470 0x7f91300a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 >> 172.21.15.89:0/4077628469 conn(0x7f913006a560 msgr2=0x7f9130068200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 shutdown_connections 2024-02-10T00:05:08.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.511+0000 7f91386cc700 1 -- 172.21.15.89:0/4077628469 wait complete. 2024-02-10T00:05:08.530 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-10T00:05:08.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:08.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 Processor -- start 2024-02-10T00:05:08.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 -- start start 2024-02-10T00:05:08.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40a3510 con 0x7f95f40a29e0 2024-02-10T00:05:08.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40a4460 con 0x7f95f40a2db0 2024-02-10T00:05:08.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.645+0000 7f95f9450700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40a1b70 con 0x7f95f40b5220 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f37fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f37fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60684/0 (socket says 172.21.15.89:60684) 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34718/0 (socket says 172.21.15.89:34718) 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f37fe700 1 -- 172.21.15.89:0/3439466325 learned_addr learned my addr 172.21.15.89:0/3439466325 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f27fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f95f40a29e0 0x7f95f413e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33802/0 (socket says 172.21.15.89:33802) 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 -- 172.21.15.89:0/3439466325 >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 msgr2=0x7f95f4148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 --2- 172.21.15.89:0/3439466325 >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 -- 172.21.15.89:0/3439466325 >> v1:172.21.15.89:6789/0 conn(0x7f95f40a29e0 legacy=0x7f95f413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 -- 172.21.15.89:0/3439466325 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40a1e10 con 0x7f95f40b5220 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f1ffb700 1 -- 172.21.15.89:0/3439466325 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881156776 0 0) 0x7f95f40a3510 con 0x7f95f40a29e0 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f37fe700 1 --2- 172.21.15.89:0/3439466325 >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f2ffd700 1 --2- 172.21.15.89:0/3439466325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098e0 tx=0x7f95e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4161958d55bdab6b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f1ffb700 1 -- 172.21.15.89:0/3439466325 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800b640 con 0x7f95f40b5220 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f1ffb700 1 -- 172.21.15.89:0/3439466325 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800b7a0 con 0x7f95f40b5220 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.646+0000 7f95f1ffb700 1 -- 172.21.15.89:0/3439466325 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800bb40 con 0x7f95f40b5220 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 -- 172.21.15.89:0/3439466325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 msgr2=0x7f95f40a3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 --2- 172.21.15.89:0/3439466325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098e0 tx=0x7f95e80091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 -- 172.21.15.89:0/3439466325 shutdown_connections 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 --2- 172.21.15.89:0/3439466325 >> v2:172.21.15.89:3300/0 conn(0x7f95f40a2db0 0x7f95f4148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 --2- 172.21.15.89:0/3439466325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40b5220 0x7f95f40a3f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 -- 172.21.15.89:0/3439466325 >> 172.21.15.89:0/3439466325 conn(0x7f95f4068710 msgr2=0x7f95f4064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 -- 172.21.15.89:0/3439466325 shutdown_connections 2024-02-10T00:05:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.647+0000 7f95f9450700 1 -- 172.21.15.89:0/3439466325 wait complete. 2024-02-10T00:05:08.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 Processor -- start 2024-02-10T00:05:08.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 -- start start 2024-02-10T00:05:08.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f95f40a2db0 0x7f95f4151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 0x7f95f4151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f409ba30 con 0x7f95f40b5220 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f409b280 con 0x7f95f40a29e0 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.648+0000 7f95f9450700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f409aaa0 con 0x7f95f40a2db0 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 0x7f95f4151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34724/0 (socket says 172.21.15.89:34724) 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 -- 172.21.15.89:0/315594056 learned_addr learned my addr 172.21.15.89:0/315594056 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f27fc700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f95f40a2db0 0x7f95f4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 -- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f95f40a2db0 msgr2=0x7f95f4151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f95f40a2db0 0x7f95f4151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 -- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 msgr2=0x7f95f4151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 0x7f95f4151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 -- 172.21.15.89:0/315594056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009ae0 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f37fe700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 0x7f95f4151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f2ffd700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009f80 tx=0x7f95e8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800bb20 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8000c90 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011650 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e8009420 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.649+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f409a480 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.650+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f95e8011a40 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.650+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f409af40 con 0x7f95f40a29e0 2024-02-10T00:05:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.650+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f95e805ca40 con 0x7f95f40a29e0 2024-02-10T00:05:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.654+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f95e805ee60 con 0x7f95f40a29e0 2024-02-10T00:05:08.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.811+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f404c710 con 0x7f95f40a29e0 2024-02-10T00:05:08.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.811+0000 7f95daffd700 1 -- 172.21.15.89:0/315594056 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f95e805ee60 con 0x7f95f40a29e0 2024-02-10T00:05:08.814 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:08.814 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:03.183783+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:08.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 >> v1:172.21.15.89:6816/47970 conn(0x7f95e0046040 legacy=0x7f95e00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 msgr2=0x7f95f4151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009f80 tx=0x7f95e8017000 comp rx=0 tx=0).stop 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 shutdown_connections 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95f40b5220 0x7f95f4151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95f40a29e0 0x7f95f4151200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 --2- 172.21.15.89:0/315594056 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f95f40a2db0 0x7f95f4151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 >> 172.21.15.89:0/315594056 conn(0x7f95f4068710 msgr2=0x7f95f40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 shutdown_connections 2024-02-10T00:05:08.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.813+0000 7f95f9450700 1 -- 172.21.15.89:0/315594056 wait complete. 2024-02-10T00:05:08.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:05:08.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 Processor -- start 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 -- start start 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c06ed50 con 0x7fc60c06e980 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0aa290 con 0x7fc60c0b1f50 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.945+0000 7fc61241f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0aab40 con 0x7fc60c1471d0 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34732/0 (socket says 172.21.15.89:34732) 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60b7fe700 1 -- 172.21.15.89:0/147806662 learned_addr learned my addr 172.21.15.89:0/147806662 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58112/0 (socket says 172.21.15.89:58112) 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60bfff700 1 --1- 172.21.15.89:0/147806662 >> v1:172.21.15.89:6789/0 conn(0x7fc60c06e980 0x7fc60c067970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33806/0 (socket says 172.21.15.89:33806) 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 -- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 msgr2=0x7fc60c068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 -- 172.21.15.89:0/147806662 >> v1:172.21.15.89:6789/0 conn(0x7fc60c06e980 legacy=0x7fc60c067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60affd700 1 -- 172.21.15.89:0/147806662 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557910506 0 0) 0x7fc60c06ed50 con 0x7fc60c06e980 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 -- 172.21.15.89:0/147806662 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0aade0 con 0x7fc60c1471d0 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60b7fe700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc6109bc700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc604009e90 tx=0x7fc604009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c5588f595d0eed5 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60affd700 1 -- 172.21.15.89:0/147806662 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400e070 con 0x7fc60c1471d0 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60affd700 1 -- 172.21.15.89:0/147806662 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400bcc0 con 0x7fc60c1471d0 2024-02-10T00:05:08.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.946+0000 7fc60affd700 1 -- 172.21.15.89:0/147806662 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604012680 con 0x7fc60c1471d0 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 -- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 msgr2=0x7fc60c1495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc604009e90 tx=0x7fc604009780 comp rx=0 tx=0).stop 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 -- 172.21.15.89:0/147806662 shutdown_connections 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c1471d0 0x7fc60c1495b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 --2- 172.21.15.89:0/147806662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c0b1f50 0x7fc60c068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 -- 172.21.15.89:0/147806662 >> 172.21.15.89:0/147806662 conn(0x7fc60c06fd50 msgr2=0x7fc60c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 -- 172.21.15.89:0/147806662 shutdown_connections 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.947+0000 7fc61241f700 1 -- 172.21.15.89:0/147806662 wait complete. 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 Processor -- start 2024-02-10T00:05:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 -- start start 2024-02-10T00:05:08.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c06e980 0x7fc60c096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 0x7fc60c0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:08.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14bc70 con 0x7fc60c0b1f50 2024-02-10T00:05:08.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c151570 con 0x7fc60c1471d0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.948+0000 7fc61241f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c1463c0 con 0x7fc60c06e980 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 0x7fc60c0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34748/0 (socket says 172.21.15.89:34748) 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 0x7fc60c0acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60696/0 (socket says 172.21.15.89:60696) 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 -- 172.21.15.89:0/4143463274 learned_addr learned my addr 172.21.15.89:0/4143463274 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc60bfff700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c06e980 0x7fc60c096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 -- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c06e980 msgr2=0x7fc60c096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c06e980 0x7fc60c096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 -- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 msgr2=0x7fc60c0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 0x7fc60c0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 -- 172.21.15.89:0/4143463274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000094f0 con 0x7fc60c1471d0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc6109bc700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0aa420 tx=0x7fc604019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:08.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604012ea0 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400bed0 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604009a20 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60401d880 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.949+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c0ad070 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.950+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc604024070 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.950+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c0ad290 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.950+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc60405da50 con 0x7fc60c1471d0 2024-02-10T00:05:08.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:08.954+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fc60401fb10 con 0x7fc60c1471d0 2024-02-10T00:05:09.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.106+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc60c04c710 con 0x7fc60c1471d0 2024-02-10T00:05:09.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.106+0000 7fc5f3fff700 1 -- 172.21.15.89:0/4143463274 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc60402c020 con 0x7fc60c1471d0 2024-02-10T00:05:09.109 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:05:09.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 >> v1:172.21.15.89:6816/47970 conn(0x7fc5f80460c0 legacy=0x7fc5f8048570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 msgr2=0x7fc60c1517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0aa420 tx=0x7fc604019000 comp rx=0 tx=0).stop 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 shutdown_connections 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc60c1471d0 0x7fc60c1517a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc60c06e980 0x7fc60c096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 --2- 172.21.15.89:0/4143463274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc60c0b1f50 0x7fc60c0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 >> 172.21.15.89:0/4143463274 conn(0x7fc60c06fd50 msgr2=0x7fc60c143b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 shutdown_connections 2024-02-10T00:05:09.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.108+0000 7fc61241f700 1 -- 172.21.15.89:0/4143463274 wait complete. 2024-02-10T00:05:09.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:05:09.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 Processor -- start 2024-02-10T00:05:09.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 -- start start 2024-02-10T00:05:09.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 0x7f81a80a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 0x7f81a8148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80a40d0 con 0x7f81a80a4970 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80a4d40 con 0x7f81a80a2bc0 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81ad7c2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80a38d0 con 0x7f81a80b5540 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81a6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 0x7f81a80a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81a77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 0x7f81a8148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81a67fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f81a80a4970 0x7f81a813ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33810/0 (socket says 172.21.15.89:33810) 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.243+0000 7f81a67fc700 1 -- 172.21.15.89:0/1553637270 learned_addr learned my addr 172.21.15.89:0/1553637270 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a5ffb700 1 -- 172.21.15.89:0/1553637270 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571955788 0 0) 0x7f81a80a40d0 con 0x7f81a80a4970 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a6ffd700 1 -- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 msgr2=0x7f81a8148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a6ffd700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 0x7f81a8148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a6ffd700 1 -- 172.21.15.89:0/1553637270 >> v1:172.21.15.89:6789/0 conn(0x7f81a80a4970 legacy=0x7f81a813ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a6ffd700 1 -- 172.21.15.89:0/1553637270 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80a4390 con 0x7f81a80b5540 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a77fe700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 0x7f81a8148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a6ffd700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 0x7f81a80a1b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8198009910 tx=0x7f81980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e675046a8290cd server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a5ffb700 1 -- 172.21.15.89:0/1553637270 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800b680 con 0x7f81a80b5540 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a5ffb700 1 -- 172.21.15.89:0/1553637270 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800b7e0 con 0x7f81a80b5540 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.244+0000 7f81a5ffb700 1 -- 172.21.15.89:0/1553637270 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800bb80 con 0x7f81a80b5540 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 -- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 msgr2=0x7f81a80a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 0x7f81a80a1b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8198009910 tx=0x7f81980091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 -- 172.21.15.89:0/1553637270 shutdown_connections 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a2bc0 0x7f81a8148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/1553637270 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80b5540 0x7f81a80a1b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 -- 172.21.15.89:0/1553637270 >> 172.21.15.89:0/1553637270 conn(0x7f81a8064050 msgr2=0x7f81a80b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 -- 172.21.15.89:0/1553637270 shutdown_connections 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.245+0000 7f81ad7c2700 1 -- 172.21.15.89:0/1553637270 wait complete. 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 Processor -- start 2024-02-10T00:05:09.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 -- start start 2024-02-10T00:05:09.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a4970 0x7f81a80a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a80b5540 0x7f81a80a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80a9df0 con 0x7f81a80b5540 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80abfc0 con 0x7f81a80a4970 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81ad7c2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81a81524d0 con 0x7f81a80a2bc0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81a6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81a67fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a4970 0x7f81a80a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81a6ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58146/0 (socket says 172.21.15.89:58146) 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81a6ffd700 1 -- 172.21.15.89:0/3090078427 learned_addr learned my addr 172.21.15.89:0/3090078427 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.246+0000 7f81a77fe700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a80b5540 0x7f81a80a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 -- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a4970 msgr2=0x7f81a80a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a4970 0x7f81a80a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 -- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a80b5540 msgr2=0x7f81a80a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a80b5540 0x7f81a80a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 -- 172.21.15.89:0/3090078427 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0009a20 con 0x7f81a80a2bc0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81a6ffd700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8198009fb0 tx=0x7f8198017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198000d10 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800bb60 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8198009420 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819801a680 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.247+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a8142850 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.248+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f819801a9f0 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.248+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a80abe30 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.248+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f819805d040 con 0x7f81a80a2bc0 2024-02-10T00:05:09.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.252+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f8198085d30 con 0x7f81a80a2bc0 2024-02-10T00:05:09.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.401+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81a80b2ee0 con 0x7f81a80a2bc0 2024-02-10T00:05:09.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.401+0000 7f818effd700 1 -- 172.21.15.89:0/3090078427 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8198015030 con 0x7f81a80a2bc0 2024-02-10T00:05:09.404 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:05:09.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 >> v1:172.21.15.89:6816/47970 conn(0x7f8194046070 legacy=0x7f8194048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 msgr2=0x7f81a8151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8198009fb0 tx=0x7f8198017000 comp rx=0 tx=0).stop 2024-02-10T00:05:09.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 shutdown_connections 2024-02-10T00:05:09.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a80b5540 0x7f81a80a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f81a80a2bc0 0x7f81a8151ba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 --2- 172.21.15.89:0/3090078427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a80a4970 0x7f81a80a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 >> 172.21.15.89:0/3090078427 conn(0x7f81a8064050 msgr2=0x7f81a80b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 shutdown_connections 2024-02-10T00:05:09.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.403+0000 7f81ad7c2700 1 -- 172.21.15.89:0/3090078427 wait complete. 2024-02-10T00:05:09.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:05:09.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.534+0000 7fdc001a3700 1 Processor -- start 2024-02-10T00:05:09.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.534+0000 7fdc001a3700 1 -- start start 2024-02-10T00:05:09.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdc001a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 0x7fdbf806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdc001a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdc001a3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf813e970 con 0x7fdbf806cc00 2024-02-10T00:05:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdc001a3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf806e400 con 0x7fdbf8063580 2024-02-10T00:05:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdc001a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf813e660 con 0x7fdbf806d800 2024-02-10T00:05:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfdf3f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 0x7fdbf806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfe740700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdbf806cc00 0x7fdbf80a2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33816/0 (socket says 172.21.15.89:33816) 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfe740700 1 -- 172.21.15.89:0/2760058287 learned_addr learned my addr 172.21.15.89:0/2760058287 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2760058287 >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 msgr2=0x7fdbf806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 --2- 172.21.15.89:0/2760058287 >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 0x7fdbf806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2760058287 >> v1:172.21.15.89:6789/0 conn(0x7fdbf806cc00 legacy=0x7fdbf80a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2760058287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf806f730 con 0x7fdbf806d800 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfcf3d700 1 -- 172.21.15.89:0/2760058287 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723575165 0 0) 0x7fdbf813e970 con 0x7fdbf806cc00 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfdf3f700 1 --2- 172.21.15.89:0/2760058287 >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 0x7fdbf806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfd73e700 1 --2- 172.21.15.89:0/2760058287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf813ec30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009910 tx=0x7fdbe80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9e749047760d6a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfcf3d700 1 -- 172.21.15.89:0/2760058287 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800b640 con 0x7fdbf806d800 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfcf3d700 1 -- 172.21.15.89:0/2760058287 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe800b7a0 con 0x7fdbf806d800 2024-02-10T00:05:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.535+0000 7fdbfcf3d700 1 -- 172.21.15.89:0/2760058287 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800bb60 con 0x7fdbf806d800 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 -- 172.21.15.89:0/2760058287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 msgr2=0x7fdbf813ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2760058287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf813ec30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009910 tx=0x7fdbe80091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 -- 172.21.15.89:0/2760058287 shutdown_connections 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2760058287 >> v2:172.21.15.89:3300/0 conn(0x7fdbf8063580 0x7fdbf806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2760058287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf813ec30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 -- 172.21.15.89:0/2760058287 >> 172.21.15.89:0/2760058287 conn(0x7fdbf806a910 msgr2=0x7fdbf80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 -- 172.21.15.89:0/2760058287 shutdown_connections 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.536+0000 7fdc001a3700 1 -- 172.21.15.89:0/2760058287 wait complete. 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 Processor -- start 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 -- start start 2024-02-10T00:05:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 0x7fdbf80a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf809f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf809adc0 con 0x7fdbf806cc00 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80a2070 con 0x7fdbf806d800 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.537+0000 7fdc001a3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8099cd0 con 0x7fdbf8063580 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfdf3f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 0x7fdbf80a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfe740700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf809f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60730/0 (socket says 172.21.15.89:60730) 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2944373695 learned_addr learned my addr 172.21.15.89:0/2944373695 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfdf3f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 0x7fdbf80a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58162/0 (socket says 172.21.15.89:58162) 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 msgr2=0x7fdbf80a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 0x7fdbf80a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 msgr2=0x7fdbf809f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf809f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 -- 172.21.15.89:0/2944373695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009420 con 0x7fdbf806cc00 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfe740700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf809f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbfd73e700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8013000 tx=0x7fdbe8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe801f070 con 0x7fdbf806cc00 2024-02-10T00:05:09.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8000bc0 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800bb60 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe8009420 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.538+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf80994b0 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.539+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf80aea50 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.539+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdbe8023070 con 0x7fdbf806cc00 2024-02-10T00:05:09.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.540+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fdbe805c470 con 0x7fdbf806cc00 2024-02-10T00:05:09.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.543+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fdbe8005a00 con 0x7fdbf806cc00 2024-02-10T00:05:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.695+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbf804c710 con 0x7fdbf806cc00 2024-02-10T00:05:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.696+0000 7fdbedffb700 1 -- 172.21.15.89:0/2944373695 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbe802a070 con 0x7fdbf806cc00 2024-02-10T00:05:09.698 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:05:09.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 >> v1:172.21.15.89:6816/47970 conn(0x7fdbdc046070 legacy=0x7fdbdc048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 msgr2=0x7fdbf80a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8013000 tx=0x7fdbe8017000 comp rx=0 tx=0).stop 2024-02-10T00:05:09.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 shutdown_connections 2024-02-10T00:05:09.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf806d800 0x7fdbf809f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdbf8063580 0x7fdbf80a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 --2- 172.21.15.89:0/2944373695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf806cc00 0x7fdbf80a50b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 >> 172.21.15.89:0/2944373695 conn(0x7fdbf806a910 msgr2=0x7fdbf806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 shutdown_connections 2024-02-10T00:05:09.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.697+0000 7fdc001a3700 1 -- 172.21.15.89:0/2944373695 wait complete. 2024-02-10T00:05:09.712 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.829+0000 7fde22259700 1 Processor -- start 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.829+0000 7fde22259700 1 -- start start 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde22259700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde22259700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde22259700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0a1830 con 0x7fde1c0a5170 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde22259700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0a2e00 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde22259700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0a3310 con 0x7fde1c0b5520 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34780/0 (socket says 172.21.15.89:34780) 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 -- 172.21.15.89:0/3806860040 learned_addr learned my addr 172.21.15.89:0/3806860040 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1b7fe700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58174/0 (socket says 172.21.15.89:58174) 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 -- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 msgr2=0x7fde1c0a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 -- 172.21.15.89:0/3806860040 >> v1:172.21.15.89:6789/0 conn(0x7fde1c0a5170 legacy=0x7fde1c0a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1a7fc700 1 -- 172.21.15.89:0/3806860040 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559481672 0 0) 0x7fde1c0a1830 con 0x7fde1c0a5170 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 -- 172.21.15.89:0/3806860040 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0a6800 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1b7fe700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1bfff700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde14009f50 tx=0x7fde14009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba0c13bff5b5666 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1a7fc700 1 -- 172.21.15.89:0/3806860040 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400e070 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1a7fc700 1 -- 172.21.15.89:0/3806860040 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1400ba00 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.830+0000 7fde1a7fc700 1 -- 172.21.15.89:0/3806860040 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde140092e0 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 -- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 msgr2=0x7fde1c149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde14009f50 tx=0x7fde14009840 comp rx=0 tx=0).stop 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 -- 172.21.15.89:0/3806860040 shutdown_connections 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c149030 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 --2- 172.21.15.89:0/3806860040 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0b5520 0x7fde1c0a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 -- 172.21.15.89:0/3806860040 >> 172.21.15.89:0/3806860040 conn(0x7fde1c064050 msgr2=0x7fde1c0b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 -- 172.21.15.89:0/3806860040 shutdown_connections 2024-02-10T00:05:09.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.831+0000 7fde22259700 1 -- 172.21.15.89:0/3806860040 wait complete. 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.832+0000 7fde22259700 1 Processor -- start 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.832+0000 7fde22259700 1 -- start start 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c0aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde1c0b5520 0x7fde1c0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0ac4a0 con 0x7fde1c0b5520 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c13eef0 con 0x7fde1c0a5cd0 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0aca60 con 0x7fde1c0a5170 2024-02-10T00:05:09.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58176/0 (socket says 172.21.15.89:58176) 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 -- 172.21.15.89:0/1736844222 learned_addr learned my addr 172.21.15.89:0/1736844222 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1affd700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c0aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1bfff700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde1c0b5520 0x7fde1c0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 -- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 msgr2=0x7fde1c0aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c0aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 -- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde1c0b5520 msgr2=0x7fde1c0ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde1c0b5520 0x7fde1c0ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 -- 172.21.15.89:0/1736844222 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10009420 con 0x7fde1c0a5170 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1affd700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde1b7fe700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde1000ec80 tx=0x7fde100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000c850 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000c9b0 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde14009ae0 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000cd30 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.833+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c0a97e0 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.834+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c140db0 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.834+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fde10013680 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.835+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fde1005b700 con 0x7fde1c0a5170 2024-02-10T00:05:09.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.838+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fde100398c0 con 0x7fde1c0a5170 2024-02-10T00:05:09.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.990+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde1c04c710 con 0x7fde1c0a5170 2024-02-10T00:05:09.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.990+0000 7fde037fe700 1 -- 172.21.15.89:0/1736844222 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde1003d0b0 con 0x7fde1c0a5170 2024-02-10T00:05:09.992 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.991+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 >> v1:172.21.15.89:6816/47970 conn(0x7fde08046040 legacy=0x7fde080484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.991+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 msgr2=0x7fde1c13e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.991+0000 7fde22259700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde1000ec80 tx=0x7fde100091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.991+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 shutdown_connections 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.991+0000 7fde22259700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde1c0b5520 0x7fde1c0ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.992+0000 7fde22259700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fde1c0a5170 0x7fde1c13e8d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.992+0000 7fde22259700 1 --2- 172.21.15.89:0/1736844222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1c0a5cd0 0x7fde1c0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.992+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 >> 172.21.15.89:0/1736844222 conn(0x7fde1c064050 msgr2=0x7fde1c069290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:09.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.992+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 shutdown_connections 2024-02-10T00:05:09.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:09.992+0000 7fde22259700 1 -- 172.21.15.89:0/1736844222 wait complete. 2024-02-10T00:05:10.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:05:10.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.119+0000 7fbd77370700 1 Processor -- start 2024-02-10T00:05:10.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.119+0000 7fbd77370700 1 -- start start 2024-02-10T00:05:10.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd77370700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd700a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd77370700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd700a5130 0x7fbd700a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd77370700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd70063b10 con 0x7fbd70063740 2024-02-10T00:05:10.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd77370700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd70139bb0 con 0x7fbd700a5130 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd77370700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700a2100 con 0x7fbd7013f6e0 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd700a5130 0x7fbd700a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7490b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd700a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7510c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbd70063740 0x7fbd7013fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33828/0 (socket says 172.21.15.89:33828) 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd700a5130 0x7fbd700a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60746/0 (socket says 172.21.15.89:60746) 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 -- 172.21.15.89:0/2498407247 learned_addr learned my addr 172.21.15.89:0/2498407247 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 -- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 msgr2=0x7fbd700a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd700a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 -- 172.21.15.89:0/2498407247 >> v1:172.21.15.89:6789/0 conn(0x7fbd70063740 legacy=0x7fbd7013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 -- 172.21.15.89:0/2498407247 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7013fb70 con 0x7fbd700a5130 2024-02-10T00:05:10.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd67fff700 1 -- 172.21.15.89:0/2498407247 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448509786 0 0) 0x7fbd70063b10 con 0x7fbd70063740 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7490b700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd700a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd7590d700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a29a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009f20 tx=0x7fbd68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60925cb7cfc25ed8 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd67fff700 1 -- 172.21.15.89:0/2498407247 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800e070 con 0x7fbd700a5130 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd67fff700 1 -- 172.21.15.89:0/2498407247 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800ba60 con 0x7fbd700a5130 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.120+0000 7fbd67fff700 1 -- 172.21.15.89:0/2498407247 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680092e0 con 0x7fbd700a5130 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 -- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 msgr2=0x7fbd700a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a29a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009f20 tx=0x7fbd68009840 comp rx=0 tx=0).stop 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 -- 172.21.15.89:0/2498407247 shutdown_connections 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a29a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 --2- 172.21.15.89:0/2498407247 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd700a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 -- 172.21.15.89:0/2498407247 >> 172.21.15.89:0/2498407247 conn(0x7fbd7006a820 msgr2=0x7fbd700b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 -- 172.21.15.89:0/2498407247 shutdown_connections 2024-02-10T00:05:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.121+0000 7fbd77370700 1 -- 172.21.15.89:0/2498407247 wait complete. 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.122+0000 7fbd77370700 1 Processor -- start 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.122+0000 7fbd77370700 1 -- start start 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 0x7fbd700a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700a6270 con 0x7fbd700a5130 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd701420f0 con 0x7fbd70063740 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700a6ab0 con 0x7fbd7013f6e0 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7490b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7590d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 0x7fbd700a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7490b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60754/0 (socket says 172.21.15.89:60754) 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7590d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58196/0 (socket says 172.21.15.89:58196) 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7490b700 1 -- 172.21.15.89:0/569870117 learned_addr learned my addr 172.21.15.89:0/569870117 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 -- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 msgr2=0x7fbd7014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 -- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 msgr2=0x7fbd700a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 -- 172.21.15.89:0/569870117 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009420 con 0x7fbd70063740 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7590d700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7490b700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd7510c700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 0x7fbd700a7190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd600019b0 tx=0x7fbd60007dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60013070 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6000e300 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd68009ae0 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60007300 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.123+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700a67d0 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.124+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbd60004830 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.124+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7004c710 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.124+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fbd6005e970 con 0x7fbd70063740 2024-02-10T00:05:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.128+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fbd6003cb00 con 0x7fbd70063740 2024-02-10T00:05:10.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.311+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd700b1c10 con 0x7fbd70063740 2024-02-10T00:05:10.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.311+0000 7fbd657fa700 1 -- 172.21.15.89:0/569870117 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3664 (secure 0 0 0) 0x7fbd6001e030 con 0x7fbd70063740 2024-02-10T00:05:10.314 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:10.314 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/4191707170","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":4191707170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6817/78137582","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":78137582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:05:05.200334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14565},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14565":{"gid":14565,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6819/1779314041","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":1779314041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:05:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 >> v1:172.21.15.89:6816/47970 conn(0x7fbd54046040 legacy=0x7fbd540484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 msgr2=0x7fbd700a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 0x7fbd700a7190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd600019b0 tx=0x7fbd60007dc0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 shutdown_connections 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbd7013f6e0 0x7fbd7014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd70063740 0x7fbd700a7190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 --2- 172.21.15.89:0/569870117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd700a5130 0x7fbd700a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 >> 172.21.15.89:0/569870117 conn(0x7fbd7006a820 msgr2=0x7fbd700680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 shutdown_connections 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.313+0000 7fbd77370700 1 -- 172.21.15.89:0/569870117 wait complete. 2024-02-10T00:05:10.316 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-02-10T00:05:10.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:10.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.444+0000 7f0431de4700 1 Processor -- start 2024-02-10T00:05:10.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.444+0000 7f0431de4700 1 -- start start 2024-02-10T00:05:10.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f0431de4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f0431de4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f0431de4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c064220 con 0x7f042c06ec60 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f0431de4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c0a9e00 con 0x7f042c063e50 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f0431de4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042c13e480 con 0x7f042c06f0e0 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042affd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f042c06ec60 0x7f042c13e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33834/0 (socket says 172.21.15.89:33834) 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58210/0 (socket says 172.21.15.89:58210) 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60758/0 (socket says 172.21.15.89:60758) 2024-02-10T00:05:10.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042affd700 1 -- 172.21.15.89:0/3935783558 learned_addr learned my addr 172.21.15.89:0/3935783558 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 -- 172.21.15.89:0/3935783558 >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 msgr2=0x7f042c0aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 --2- 172.21.15.89:0/3935783558 >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 -- 172.21.15.89:0/3935783558 >> v1:172.21.15.89:6789/0 conn(0x7f042c06ec60 legacy=0x7f042c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 -- 172.21.15.89:0/3935783558 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c06e560 con 0x7f042c06f0e0 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042b7fe700 1 --2- 172.21.15.89:0/3935783558 >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.445+0000 7f042bfff700 1 --2- 172.21.15.89:0/3935783558 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0424009e60 tx=0x7f0424009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a92fef4e6f67553 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f042a7fc700 1 -- 172.21.15.89:0/3935783558 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400e070 con 0x7f042c06f0e0 2024-02-10T00:05:10.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f042a7fc700 1 -- 172.21.15.89:0/3935783558 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042400bbf0 con 0x7f042c06f0e0 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f042a7fc700 1 -- 172.21.15.89:0/3935783558 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424012430 con 0x7f042c06f0e0 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 -- 172.21.15.89:0/3935783558 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 msgr2=0x7f042c148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 --2- 172.21.15.89:0/3935783558 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0424009e60 tx=0x7f0424009780 comp rx=0 tx=0).stop 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 -- 172.21.15.89:0/3935783558 shutdown_connections 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 --2- 172.21.15.89:0/3935783558 >> v2:172.21.15.89:3300/0 conn(0x7f042c063e50 0x7f042c0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 --2- 172.21.15.89:0/3935783558 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c06f0e0 0x7f042c148c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 -- 172.21.15.89:0/3935783558 >> 172.21.15.89:0/3935783558 conn(0x7f042c06c7c0 msgr2=0x7f042c063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 -- 172.21.15.89:0/3935783558 shutdown_connections 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.446+0000 7f0431de4700 1 -- 172.21.15.89:0/3935783558 wait complete. 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.447+0000 7f0431de4700 1 Processor -- start 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.447+0000 7f0431de4700 1 -- start start 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c06ec60 0x7f042c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f042c06f0e0 0x7f042c1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c098840 con 0x7f042c06ec60 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c098b20 con 0x7f042c06f0e0 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f0431de4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042c097d20 con 0x7f042c063e50 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58212/0 (socket says 172.21.15.89:58212) 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 -- 172.21.15.89:0/4125946604 learned_addr learned my addr 172.21.15.89:0/4125946604 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:10.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042bfff700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f042c06f0e0 0x7f042c1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042affd700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c06ec60 0x7f042c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 -- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f042c06f0e0 msgr2=0x7f042c1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f042c06f0e0 0x7f042c1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 -- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c06ec60 msgr2=0x7f042c1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c06ec60 0x7f042c1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 -- 172.21.15.89:0/4125946604 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414009420 con 0x7f042c063e50 2024-02-10T00:05:10.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f042b7fe700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f041400ec80 tx=0x7f04140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400c850 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400c9b0 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.448+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400cd30 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.449+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424009a20 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.449+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c098220 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.449+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0414013680 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.450+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c096b30 con 0x7f042c063e50 2024-02-10T00:05:10.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.450+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f041405b5a0 con 0x7f042c063e50 2024-02-10T00:05:10.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.453+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f042c096b30 con 0x7f042c063e50 2024-02-10T00:05:10.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.606+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f042c096b30 con 0x7f042c063e50 2024-02-10T00:05:10.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.607+0000 7f04237fe700 1 -- 172.21.15.89:0/4125946604 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f042c096b30 con 0x7f042c063e50 2024-02-10T00:05:10.609 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:10.609 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:03.183783+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:10.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 >> v1:172.21.15.89:6816/47970 conn(0x7f040c046040 legacy=0x7f040c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 msgr2=0x7f042c0977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f041400ec80 tx=0x7f04140091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 shutdown_connections 2024-02-10T00:05:10.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f042c06f0e0 0x7f042c1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f042c063e50 0x7f042c0977e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 --2- 172.21.15.89:0/4125946604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c06ec60 0x7f042c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 >> 172.21.15.89:0/4125946604 conn(0x7f042c06c7c0 msgr2=0x7f042c068200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 shutdown_connections 2024-02-10T00:05:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.609+0000 7f0431de4700 1 -- 172.21.15.89:0/4125946604 wait complete. 2024-02-10T00:05:10.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:05:10.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 Processor -- start 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 -- start start 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d40a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4138940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d406c8d0 con 0x7f35d406c500 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40a5d50 con 0x7f35d40a5540 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35da578700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40a48d0 con 0x7f35d41384f0 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35d3fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f35d406c500 0x7f35d40a41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33838/0 (socket says 172.21.15.89:33838) 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35d3fff700 1 -- 172.21.15.89:0/2324153561 learned_addr learned my addr 172.21.15.89:0/2324153561 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35d8b15700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.739+0000 7f35d37fe700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d40a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d2ffd700 1 -- 172.21.15.89:0/2324153561 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703960517 0 0) 0x7f35d406c8d0 con 0x7f35d406c500 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d2ffd700 1 -- 172.21.15.89:0/2324153561 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc003570 con 0x7f35d406c500 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d8b15700 1 -- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 msgr2=0x7f35d40a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d8b15700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d40a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d8b15700 1 -- 172.21.15.89:0/2324153561 >> v1:172.21.15.89:6789/0 conn(0x7f35d406c500 legacy=0x7f35d40a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d8b15700 1 -- 172.21.15.89:0/2324153561 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40a2de0 con 0x7f35d41384f0 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d37fe700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d40a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d8b15700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4138940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e90 tx=0x7f35cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2651f9080621beeb server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d2ffd700 1 -- 172.21.15.89:0/2324153561 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00e070 con 0x7f35d41384f0 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d2ffd700 1 -- 172.21.15.89:0/2324153561 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc00bb80 con 0x7f35d41384f0 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.740+0000 7f35d2ffd700 1 -- 172.21.15.89:0/2324153561 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012430 con 0x7f35d41384f0 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 -- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 msgr2=0x7f35d4138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4138940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e90 tx=0x7f35cc009780 comp rx=0 tx=0).stop 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 -- 172.21.15.89:0/2324153561 shutdown_connections 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4138940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 --2- 172.21.15.89:0/2324153561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d40a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 -- 172.21.15.89:0/2324153561 >> 172.21.15.89:0/2324153561 conn(0x7f35d406b6b0 msgr2=0x7f35d4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 -- 172.21.15.89:0/2324153561 shutdown_connections 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 -- 172.21.15.89:0/2324153561 wait complete. 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.741+0000 7f35da578700 1 Processor -- start 2024-02-10T00:05:10.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 -- start start 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 0x7f35d40ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40ab580 con 0x7f35d406c500 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40acdc0 con 0x7f35d40a5540 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35da578700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40adbe0 con 0x7f35d41384f0 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35d8b15700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34812/0 (socket says 172.21.15.89:34812) 2024-02-10T00:05:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35d37fe700 1 -- 172.21.15.89:0/3820219151 learned_addr learned my addr 172.21.15.89:0/3820219151 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.742+0000 7f35d3fff700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 0x7f35d40ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 -- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 msgr2=0x7f35d4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 -- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 msgr2=0x7f35d40ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 0x7f35d40ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 -- 172.21.15.89:0/3820219151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8009420 con 0x7f35d40a5540 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d8b15700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d3fff700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 0x7f35d40ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35d37fe700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35c800ec80 tx=0x7f35c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800c9b0 con 0x7f35d40a5540 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c800cb10 con 0x7f35d40a5540 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800ce90 con 0x7f35d40a5540 2024-02-10T00:05:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc009a20 con 0x7f35d40a5540 2024-02-10T00:05:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.743+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40ab9b0 con 0x7f35d40a5540 2024-02-10T00:05:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.744+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d413c130 con 0x7f35d40a5540 2024-02-10T00:05:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.744+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f35c8013680 con 0x7f35d40a5540 2024-02-10T00:05:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.744+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f35c805b990 con 0x7f35d40a5540 2024-02-10T00:05:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.748+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f35c8039b50 con 0x7f35d40a5540 2024-02-10T00:05:10.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.899+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d404c710 con 0x7f35d40a5540 2024-02-10T00:05:10.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.900+0000 7f35bbfff700 1 -- 172.21.15.89:0/3820219151 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c803d340 con 0x7f35d40a5540 2024-02-10T00:05:10.902 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:05:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 >> v1:172.21.15.89:6816/47970 conn(0x7f35c0046040 legacy=0x7f35c00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 msgr2=0x7f35d4150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35c800ec80 tx=0x7f35c80091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 shutdown_connections 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f35d41384f0 0x7f35d4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d406c500 0x7f35d40ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 --2- 172.21.15.89:0/3820219151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d40a5540 0x7f35d4150ec0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.901+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 >> 172.21.15.89:0/3820219151 conn(0x7f35d406b6b0 msgr2=0x7f35d413a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.902+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 shutdown_connections 2024-02-10T00:05:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:10.902+0000 7f35da578700 1 -- 172.21.15.89:0/3820219151 wait complete. 2024-02-10T00:05:10.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:05:11.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 Processor -- start 2024-02-10T00:05:11.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 -- start start 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 0x7f34840b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f34841491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348406ed50 con 0x7f3484067970 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840aa290 con 0x7f348406e980 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348c5ea700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34840aab40 con 0x7f3484068450 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348a386700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 0x7f34840b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f3489b85700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3484067970 0x7f3484067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33846/0 (socket says 172.21.15.89:33846) 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.033+0000 7f348ab87700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f34841491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489b85700 1 -- 172.21.15.89:0/2649671424 learned_addr learned my addr 172.21.15.89:0/2649671424 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489384700 1 -- 172.21.15.89:0/2649671424 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094081541 0 0) 0x7f348406ed50 con 0x7f3484067970 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489384700 1 -- 172.21.15.89:0/2649671424 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003570 con 0x7f3484067970 2024-02-10T00:05:11.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348a386700 1 -- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 msgr2=0x7f34841491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348a386700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f34841491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348a386700 1 -- 172.21.15.89:0/2649671424 >> v1:172.21.15.89:6789/0 conn(0x7f3484067970 legacy=0x7f3484067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348a386700 1 -- 172.21.15.89:0/2649671424 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840aade0 con 0x7f348406e980 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348ab87700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f34841491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f348a386700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 0x7f34840b1f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3480009910 tx=0x7f34800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883a2d5ca609c984 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489384700 1 -- 172.21.15.89:0/2649671424 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000b690 con 0x7f348406e980 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489384700 1 -- 172.21.15.89:0/2649671424 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000b7f0 con 0x7f348406e980 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.034+0000 7f3489384700 1 -- 172.21.15.89:0/2649671424 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000bb90 con 0x7f348406e980 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 -- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 msgr2=0x7f34840b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 0x7f34840b1f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3480009910 tx=0x7f34800091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 -- 172.21.15.89:0/2649671424 shutdown_connections 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f348406e980 0x7f34840b1f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 --2- 172.21.15.89:0/2649671424 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f34841491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 -- 172.21.15.89:0/2649671424 >> 172.21.15.89:0/2649671424 conn(0x7f348406fd50 msgr2=0x7f348406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 -- 172.21.15.89:0/2649671424 shutdown_connections 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.035+0000 7f348c5ea700 1 -- 172.21.15.89:0/2649671424 wait complete. 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 Processor -- start 2024-02-10T00:05:11.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 -- start start 2024-02-10T00:05:11.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f3484144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f348406e980 0x7f3484144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348409f770 con 0x7f348406e980 2024-02-10T00:05:11.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348409ae50 con 0x7f3484067970 2024-02-10T00:05:11.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348c5ea700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f348409e430 con 0x7f3484068450 2024-02-10T00:05:11.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f3489b85700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f3484144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34830/0 (socket says 172.21.15.89:34830) 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 -- 172.21.15.89:0/3765086968 learned_addr learned my addr 172.21.15.89:0/3765086968 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348ab87700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f348406e980 0x7f3484144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 -- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 msgr2=0x7f3484144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f3484144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 -- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f348406e980 msgr2=0x7f3484144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f348406e980 0x7f3484144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.036+0000 7f348a386700 1 -- 172.21.15.89:0/3765086968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c009a20 con 0x7f3484067970 2024-02-10T00:05:11.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f3489b85700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f3484144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f348a386700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34800091e0 tx=0x7f3480017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000b960 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000bac0 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3480009420 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480025670 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.037+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3484144fa0 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.038+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348409f190 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.038+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3480023070 con 0x7f3484067970 2024-02-10T00:05:11.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.038+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f348005c4c0 con 0x7f3484067970 2024-02-10T00:05:11.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.041+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f348000af40 con 0x7f3484067970 2024-02-10T00:05:11.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.196+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f348404c710 con 0x7f3484067970 2024-02-10T00:05:11.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.197+0000 7f347a7fc700 1 -- 172.21.15.89:0/3765086968 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f348002f910 con 0x7f3484067970 2024-02-10T00:05:11.199 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.198+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 >> v1:172.21.15.89:6816/47970 conn(0x7f3468046040 legacy=0x7f34680484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.198+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 msgr2=0x7f348409db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.198+0000 7f348c5ea700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34800091e0 tx=0x7f3480017000 comp rx=0 tx=0).stop 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 shutdown_connections 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f348406e980 0x7f3484144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3484067970 0x7f348409db00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 --2- 172.21.15.89:0/3765086968 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3484068450 0x7f3484144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 >> 172.21.15.89:0/3765086968 conn(0x7f348406fd50 msgr2=0x7f34840ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 shutdown_connections 2024-02-10T00:05:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.199+0000 7f348c5ea700 1 -- 172.21.15.89:0/3765086968 wait complete. 2024-02-10T00:05:11.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.330+0000 7fdb7a0b4700 1 Processor -- start 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.330+0000 7fdb7a0b4700 1 -- start start 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb7a0b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb7413e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb7a0b4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb74137b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb7a0b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7406e600 con 0x7fdb74138070 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb7a0b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7406e400 con 0x7fdb740b19b0 2024-02-10T00:05:11.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb7a0b4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7413e9c0 con 0x7fdb7406eb00 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb72ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb74137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb7413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb73fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdb74138070 0x7fdb740a1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33852/0 (socket says 172.21.15.89:33852) 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb73fff700 1 -- 172.21.15.89:0/1158028628 learned_addr learned my addr 172.21.15.89:0/1158028628 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb727fc700 1 -- 172.21.15.89:0/1158028628 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380933729 0 0) 0x7fdb7406e600 con 0x7fdb74138070 2024-02-10T00:05:11.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb727fc700 1 -- 172.21.15.89:0/1158028628 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb60003570 con 0x7fdb74138070 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 -- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 msgr2=0x7fdb74137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb74137b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 -- 172.21.15.89:0/1158028628 >> v1:172.21.15.89:6789/0 conn(0x7fdb74138070 legacy=0x7fdb740a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 -- 172.21.15.89:0/1158028628 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7413ec80 con 0x7fdb740b19b0 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb72ffd700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb74137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb737fe700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb7413e100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009910 tx=0x7fdb5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50ecc7008e7c2ff server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb727fc700 1 -- 172.21.15.89:0/1158028628 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011630 con 0x7fdb740b19b0 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb727fc700 1 -- 172.21.15.89:0/1158028628 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c011790 con 0x7fdb740b19b0 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.331+0000 7fdb727fc700 1 -- 172.21.15.89:0/1158028628 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011b10 con 0x7fdb740b19b0 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 msgr2=0x7fdb7413e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb7413e100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009910 tx=0x7fdb5c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/1158028628 shutdown_connections 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb7413e100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/1158028628 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb74137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/1158028628 >> 172.21.15.89:0/1158028628 conn(0x7fdb7406a910 msgr2=0x7fdb740b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/1158028628 shutdown_connections 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.332+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/1158028628 wait complete. 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 Processor -- start 2024-02-10T00:05:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 -- start start 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb7414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb74138070 0x7fdb740a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740aa410 con 0x7fdb74138070 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740a9010 con 0x7fdb740b19b0 2024-02-10T00:05:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.333+0000 7fdb7a0b4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740a6f10 con 0x7fdb7406eb00 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb72ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb7414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb73fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb74138070 0x7fdb740a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb72ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34848/0 (socket says 172.21.15.89:34848) 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb72ffd700 1 -- 172.21.15.89:0/605107252 learned_addr learned my addr 172.21.15.89:0/605107252 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 -- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 msgr2=0x7fdb740aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 -- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb74138070 msgr2=0x7fdb740a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb74138070 0x7fdb740a92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 -- 172.21.15.89:0/605107252 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009420 con 0x7fdb7406eb00 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb72ffd700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb737fe700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb7414a5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c015000 tx=0x7fdb5c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011900 con 0x7fdb7406eb00 2024-02-10T00:05:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c011a60 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01c6a0 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c009420 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.334+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb740a84c0 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.335+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7414a3f0 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.335+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdb5c01ca10 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.335+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fdb5c05c870 con 0x7fdb7406eb00 2024-02-10T00:05:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.339+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fdb5c027cd0 con 0x7fdb7406eb00 2024-02-10T00:05:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.492+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb7404c740 con 0x7fdb7406eb00 2024-02-10T00:05:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.493+0000 7fdb6b7fe700 1 -- 172.21.15.89:0/605107252 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb5c021020 con 0x7fdb7406eb00 2024-02-10T00:05:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:05:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 >> v1:172.21.15.89:6816/47970 conn(0x7fdb54046040 legacy=0x7fdb540484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 msgr2=0x7fdb7414a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb7414a5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c015000 tx=0x7fdb5c016000 comp rx=0 tx=0).stop 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 shutdown_connections 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb74138070 0x7fdb740a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb7406eb00 0x7fdb7414a5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 --2- 172.21.15.89:0/605107252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb740b19b0 0x7fdb740aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 >> 172.21.15.89:0/605107252 conn(0x7fdb7406a910 msgr2=0x7fdb740b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 shutdown_connections 2024-02-10T00:05:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.494+0000 7fdb7a0b4700 1 -- 172.21.15.89:0/605107252 wait complete. 2024-02-10T00:05:11.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:05:11.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 Processor -- start 2024-02-10T00:05:11.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 -- start start 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 0x7f0ff41495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff406ed50 con 0x7f0ff406e980 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40aa290 con 0x7f0ff41471d0 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ffa9d4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40aab40 con 0x7f0ff40b1f50 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ff37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.935+0000 7f0ff3fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0ff406e980 0x7f0ff4067970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33860/0 (socket says 172.21.15.89:33860) 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff8f71700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 0x7f0ff41495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff3fff700 1 -- 172.21.15.89:0/2375150503 learned_addr learned my addr 172.21.15.89:0/2375150503 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff2ffd700 1 -- 172.21.15.89:0/2375150503 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216563905 0 0) 0x7f0ff406ed50 con 0x7f0ff406e980 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff2ffd700 1 -- 172.21.15.89:0/2375150503 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc003570 con 0x7f0ff406e980 2024-02-10T00:05:11.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff37fe700 1 -- 172.21.15.89:0/2375150503 >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 msgr2=0x7f0ff41495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff37fe700 1 --2- 172.21.15.89:0/2375150503 >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 0x7f0ff41495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff37fe700 1 -- 172.21.15.89:0/2375150503 >> v1:172.21.15.89:6789/0 conn(0x7f0ff406e980 legacy=0x7f0ff4067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff37fe700 1 -- 172.21.15.89:0/2375150503 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40aade0 con 0x7f0ff40b1f50 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff8f71700 1 --2- 172.21.15.89:0/2375150503 >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 0x7f0ff41495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff37fe700 1 --2- 172.21.15.89:0/2375150503 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4068080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40098e0 tx=0x7f0fe40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25d38eaa3162d9d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff2ffd700 1 -- 172.21.15.89:0/2375150503 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011630 con 0x7f0ff40b1f50 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff2ffd700 1 -- 172.21.15.89:0/2375150503 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4011790 con 0x7f0ff40b1f50 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.936+0000 7f0ff2ffd700 1 -- 172.21.15.89:0/2375150503 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011b30 con 0x7f0ff40b1f50 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/2375150503 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 msgr2=0x7f0ff4068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/2375150503 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4068080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40098e0 tx=0x7f0fe40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/2375150503 shutdown_connections 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/2375150503 >> v2:172.21.15.89:3300/0 conn(0x7f0ff41471d0 0x7f0ff41495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/2375150503 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4068080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/2375150503 >> 172.21.15.89:0/2375150503 conn(0x7f0ff406fd50 msgr2=0x7f0ff406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/2375150503 shutdown_connections 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.937+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/2375150503 wait complete. 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 Processor -- start 2024-02-10T00:05:11.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 -- start start 2024-02-10T00:05:11.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 0x7f0ff4145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:11.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4096fd0 con 0x7f0ff406e980 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4097270 con 0x7f0ff41471d0 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ffa9d4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4096c00 con 0x7f0ff40b1f50 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ff37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60836/0 (socket says 172.21.15.89:60836) 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ff3fff700 1 -- 172.21.15.89:0/3226670901 learned_addr learned my addr 172.21.15.89:0/3226670901 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.938+0000 7f0ff8f71700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 0x7f0ff4145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 -- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 msgr2=0x7f0ff4145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 0x7f0ff4145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 -- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 msgr2=0x7f0ff40ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 -- 172.21.15.89:0/3226670901 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec009a20 con 0x7f0ff40b1f50 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff3fff700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff8f71700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 0x7f0ff4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ff37fe700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4143250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4016000 tx=0x7f0fe4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011b10 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4000cc0 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4025620 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4009420 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.939+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff40a3a80 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.940+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0fe400b400 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.940+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff40a3c70 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.940+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0fe405c980 con 0x7f0ff40b1f50 2024-02-10T00:05:11.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:11.944+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0fe402e400 con 0x7f0ff40b1f50 2024-02-10T00:05:12.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.094+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ff404c710 con 0x7f0ff40b1f50 2024-02-10T00:05:12.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.095+0000 7f0fdbfff700 1 -- 172.21.15.89:0/3226670901 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fe4015020 con 0x7f0ff40b1f50 2024-02-10T00:05:12.097 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:05:12.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 >> v1:172.21.15.89:6816/47970 conn(0x7f0fe0046070 legacy=0x7f0fe0048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 msgr2=0x7f0ff4143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4143250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4016000 tx=0x7f0fe4017000 comp rx=0 tx=0).stop 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 shutdown_connections 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ff41471d0 0x7f0ff4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff406e980 0x7f0ff40ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 --2- 172.21.15.89:0/3226670901 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0ff40b1f50 0x7f0ff4143250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 >> 172.21.15.89:0/3226670901 conn(0x7f0ff406fd50 msgr2=0x7f0ff4140770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 shutdown_connections 2024-02-10T00:05:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.096+0000 7f0ffa9d4700 1 -- 172.21.15.89:0/3226670901 wait complete. 2024-02-10T00:05:12.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:05:12.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.225+0000 7f1b55e63700 1 Processor -- start 2024-02-10T00:05:12.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.225+0000 7f1b55e63700 1 -- start start 2024-02-10T00:05:12.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b55e63700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b500a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b55e63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9070 0x7f1b500afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b55e63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50064220 con 0x7f1b500a9440 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b55e63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500a80d0 con 0x7f1b500a9070 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b55e63700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5013f810 con 0x7f1b50063e50 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b500a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1b500a9440 0x7f1b5006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33862/0 (socket says 172.21.15.89:33862) 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4ffff700 1 -- 172.21.15.89:0/90513770 learned_addr learned my addr 172.21.15.89:0/90513770 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4effd700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9070 0x7f1b500afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4e7fc700 1 -- 172.21.15.89:0/90513770 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107730383 0 0) 0x7f1b50064220 con 0x7f1b500a9440 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 -- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9070 msgr2=0x7f1b500afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9070 0x7f1b500afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 -- 172.21.15.89:0/90513770 >> v1:172.21.15.89:6789/0 conn(0x7f1b500a9440 legacy=0x7f1b5006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 -- 172.21.15.89:0/90513770 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5013fab0 con 0x7f1b50063e50 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4f7fe700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b500a7b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009910 tx=0x7f1b400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4993166608fbfd8d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.226+0000 7f1b4e7fc700 1 -- 172.21.15.89:0/90513770 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000b710 con 0x7f1b50063e50 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b4e7fc700 1 -- 172.21.15.89:0/90513770 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000b870 con 0x7f1b50063e50 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b4e7fc700 1 -- 172.21.15.89:0/90513770 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000bc30 con 0x7f1b50063e50 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 -- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 msgr2=0x7f1b500a7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b500a7b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009910 tx=0x7f1b400091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 -- 172.21.15.89:0/90513770 shutdown_connections 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b500a7b90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 --2- 172.21.15.89:0/90513770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9070 0x7f1b500afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 -- 172.21.15.89:0/90513770 >> 172.21.15.89:0/90513770 conn(0x7f1b5006d8c0 msgr2=0x7f1b50063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 -- 172.21.15.89:0/90513770 shutdown_connections 2024-02-10T00:05:12.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.227+0000 7f1b55e63700 1 -- 172.21.15.89:0/90513770 wait complete. 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.228+0000 7f1b55e63700 1 Processor -- start 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.228+0000 7f1b55e63700 1 -- start start 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b50069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9440 0x7f1b50138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5006a7e0 con 0x7f1b500a9070 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5011ae10 con 0x7f1b500a9440 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b55e63700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5011b0d0 con 0x7f1b50063e50 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b50069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9440 0x7f1b50138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b50069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58304/0 (socket says 172.21.15.89:58304) 2024-02-10T00:05:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4f7fe700 1 -- 172.21.15.89:0/3839451473 learned_addr learned my addr 172.21.15.89:0/3839451473 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60842/0 (socket says 172.21.15.89:60842) 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 -- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 msgr2=0x7f1b50069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b50069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 -- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9440 msgr2=0x7f1b50138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9440 0x7f1b50138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 -- 172.21.15.89:0/3839451473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009420 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.229+0000 7f1b4effd700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400ea20 tx=0x7f1b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400ee60 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4400c7f0 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400cb90 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50139150 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5011ab90 con 0x7f1b500a9070 2024-02-10T00:05:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.230+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1b44013470 con 0x7f1b500a9070 2024-02-10T00:05:12.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.231+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5004c710 con 0x7f1b500a9070 2024-02-10T00:05:12.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.231+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f1b4405b3a0 con 0x7f1b500a9070 2024-02-10T00:05:12.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.234+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f1b44039560 con 0x7f1b500a9070 2024-02-10T00:05:12.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.415+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b500a6b00 con 0x7f1b500a9070 2024-02-10T00:05:12.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.415+0000 7f1b377fe700 1 -- 172.21.15.89:0/3839451473 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3664 (secure 0 0 0) 0x7f1b44021070 con 0x7f1b500a9070 2024-02-10T00:05:12.418 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:12.418 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/4191707170","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":4191707170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6817/78137582","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":78137582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:05:05.200334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14565},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14565":{"gid":14565,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6819/1779314041","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":1779314041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 >> v1:172.21.15.89:6816/47970 conn(0x7f1b3c046040 legacy=0x7f1b3c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 msgr2=0x7f1b501386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400ea20 tx=0x7f1b440091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 shutdown_connections 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b500a9440 0x7f1b50138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b50063e50 0x7f1b50069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 --2- 172.21.15.89:0/3839451473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b500a9070 0x7f1b501386d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 >> 172.21.15.89:0/3839451473 conn(0x7f1b5006d8c0 msgr2=0x7f1b500b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 shutdown_connections 2024-02-10T00:05:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.417+0000 7f1b55e63700 1 -- 172.21.15.89:0/3839451473 wait complete. 2024-02-10T00:05:12.421 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-02-10T00:05:12.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.545+0000 7f3c6dfb0700 1 Processor -- start 2024-02-10T00:05:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.545+0000 7f3c6dfb0700 1 -- start start 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c6dfb0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 0x7f3c680a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c6dfb0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 0x7f3c680a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c6dfb0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c68063b10 con 0x7f3c6813f6e0 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c6dfb0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68139bb0 con 0x7f3c680a5130 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c6dfb0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680a2100 con 0x7f3c68063740 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 0x7f3c680a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c66ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3c6813f6e0 0x7f3c6813fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33874/0 (socket says 172.21.15.89:33874) 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c66ffd700 1 -- 172.21.15.89:0/2386486866 learned_addr learned my addr 172.21.15.89:0/2386486866 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c677fe700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 0x7f3c680a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 -- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 msgr2=0x7f3c680a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 0x7f3c680a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c667fc700 1 -- 172.21.15.89:0/2386486866 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754427201 0 0) 0x7f3c68063b10 con 0x7f3c6813f6e0 2024-02-10T00:05:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 -- 172.21.15.89:0/2386486866 >> v1:172.21.15.89:6789/0 conn(0x7f3c6813f6e0 legacy=0x7f3c6813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 -- 172.21.15.89:0/2386486866 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6813fb70 con 0x7f3c680a5130 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c677fe700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 0x7f3c680a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c67fff700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 0x7f3c680a29a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009e90 tx=0x7f3c60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12381f29fc60e9c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c667fc700 1 -- 172.21.15.89:0/2386486866 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000e070 con 0x7f3c680a5130 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c667fc700 1 -- 172.21.15.89:0/2386486866 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6000bcc0 con 0x7f3c680a5130 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.546+0000 7f3c667fc700 1 -- 172.21.15.89:0/2386486866 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60012680 con 0x7f3c680a5130 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 msgr2=0x7f3c680a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 0x7f3c680a29a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009e90 tx=0x7f3c60009780 comp rx=0 tx=0).stop 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/2386486866 shutdown_connections 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c680a5130 0x7f3c680a29a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/2386486866 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c68063740 0x7f3c680a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/2386486866 >> 172.21.15.89:0/2386486866 conn(0x7f3c6806a820 msgr2=0x7f3c680b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/2386486866 shutdown_connections 2024-02-10T00:05:12.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.547+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/2386486866 wait complete. 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.548+0000 7f3c6dfb0700 1 Processor -- start 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.548+0000 7f3c6dfb0700 1 -- start start 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681446a0 con 0x7f3c6813f6e0 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68143480 con 0x7f3c68063740 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6806cb90 con 0x7f3c680a5130 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c67fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34910/0 (socket says 172.21.15.89:34910) 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c677fe700 1 -- 172.21.15.89:0/4273224054 learned_addr learned my addr 172.21.15.89:0/4273224054 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c67fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60848/0 (socket says 172.21.15.89:60848) 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58316/0 (socket says 172.21.15.89:58316) 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 -- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 msgr2=0x7f3c68142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 -- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 msgr2=0x7f3c68151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 -- 172.21.15.89:0/4273224054 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009420 con 0x7f3c680a5130 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c67fff700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c677fe700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c66ffd700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c58001b90 tx=0x7f3c58012870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58017070 con 0x7f3c680a5130 2024-02-10T00:05:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58005b30 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60009a20 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580120d0 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.549+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c68142ff0 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.550+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3c580124c0 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.550+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c68143240 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.551+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3c58063300 con 0x7f3c680a5130 2024-02-10T00:05:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.554+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3c68143240 con 0x7f3c680a5130 2024-02-10T00:05:12.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.707+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c68143240 con 0x7f3c680a5130 2024-02-10T00:05:12.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.708+0000 7f3c4f7fe700 1 -- 172.21.15.89:0/4273224054 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f3c68143240 con 0x7f3c680a5130 2024-02-10T00:05:12.711 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:12.711 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:03.183783+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 >> v1:172.21.15.89:6816/47970 conn(0x7f3c54046040 legacy=0x7f3c540484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 msgr2=0x7f3c68151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c58001b90 tx=0x7f3c58012870 comp rx=0 tx=0).stop 2024-02-10T00:05:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 shutdown_connections 2024-02-10T00:05:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c6813f6e0 0x7f3c68151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c68063740 0x7f3c68142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 --2- 172.21.15.89:0/4273224054 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3c680a5130 0x7f3c68151110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 >> 172.21.15.89:0/4273224054 conn(0x7f3c6806a820 msgr2=0x7f3c680680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 shutdown_connections 2024-02-10T00:05:12.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.710+0000 7f3c6dfb0700 1 -- 172.21.15.89:0/4273224054 wait complete. 2024-02-10T00:05:12.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:05:12.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.838+0000 7f3a3050e700 1 Processor -- start 2024-02-10T00:05:12.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.838+0000 7f3a3050e700 1 -- start start 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 0x7f3a28139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2806e2d0 con 0x7f3a2813a390 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280b1c80 con 0x7f3a2806f630 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a3050e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2806eb50 con 0x7f3a280b18b0 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2eaab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2daa9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 0x7f3a28139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2eaab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60860/0 (socket says 172.21.15.89:60860) 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58326/0 (socket says 172.21.15.89:58326) 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2eaab700 1 -- 172.21.15.89:0/2145108527 learned_addr learned my addr 172.21.15.89:0/2145108527 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 -- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 msgr2=0x7f3a28139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 0x7f3a28139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 -- 172.21.15.89:0/2145108527 >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 msgr2=0x7f3a280a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 --2- 172.21.15.89:0/2145108527 >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 -- 172.21.15.89:0/2145108527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2806edd0 con 0x7f3a280b18b0 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2daa9700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 0x7f3a28139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2eaab700 1 --2- 172.21.15.89:0/2145108527 >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2e2aa700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a180098e0 tx=0x7f3a180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3874c96e14d64101 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.839+0000 7f3a2d2a8700 1 -- 172.21.15.89:0/2145108527 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18011630 con 0x7f3a280b18b0 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a2d2a8700 1 -- 172.21.15.89:0/2145108527 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18011790 con 0x7f3a280b18b0 2024-02-10T00:05:12.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a2d2a8700 1 -- 172.21.15.89:0/2145108527 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18011b30 con 0x7f3a280b18b0 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 -- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 msgr2=0x7f3a2806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a180098e0 tx=0x7f3a180091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 -- 172.21.15.89:0/2145108527 shutdown_connections 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 --2- 172.21.15.89:0/2145108527 >> v2:172.21.15.89:3300/0 conn(0x7f3a2813a390 0x7f3a280a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a280b18b0 0x7f3a2806cb90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 --2- 172.21.15.89:0/2145108527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2806f630 0x7f3a28139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 -- 172.21.15.89:0/2145108527 >> 172.21.15.89:0/2145108527 conn(0x7f3a2806a820 msgr2=0x7f3a280b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 -- 172.21.15.89:0/2145108527 shutdown_connections 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.840+0000 7f3a3050e700 1 -- 172.21.15.89:0/2145108527 wait complete. 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.841+0000 7f3a3050e700 1 Processor -- start 2024-02-10T00:05:12.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.841+0000 7f3a3050e700 1 -- start start 2024-02-10T00:05:12.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 0x7f3a280a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a2813a390 0x7f3a280a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:12.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280acd20 con 0x7f3a2806f630 2024-02-10T00:05:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280acf20 con 0x7f3a280b18b0 2024-02-10T00:05:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2813e6f0 con 0x7f3a2813a390 2024-02-10T00:05:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2e2aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 0x7f3a280a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2eaab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a2813a390 0x7f3a280a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2e2aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60864/0 (socket says 172.21.15.89:60864) 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2e2aa700 1 -- 172.21.15.89:0/3050140111 learned_addr learned my addr 172.21.15.89:0/3050140111 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 -- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a2813a390 msgr2=0x7f3a280a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a2813a390 0x7f3a280a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 -- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 msgr2=0x7f3a280a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 -- 172.21.15.89:0/3050140111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24009420 con 0x7f3a280b18b0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2e2aa700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a2daa9700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 0x7f3a280a92f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b1ec0 tx=0x7f3a240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400c850 con 0x7f3a280b18b0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400c9b0 con 0x7f3a280b18b0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2000abf0 con 0x7f3a280b18b0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400cd50 con 0x7f3a280b18b0 2024-02-10T00:05:12.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.842+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a18009420 con 0x7f3a280b18b0 2024-02-10T00:05:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.843+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3a24013680 con 0x7f3a280b18b0 2024-02-10T00:05:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.843+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2804c710 con 0x7f3a280b18b0 2024-02-10T00:05:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.844+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3a2405b790 con 0x7f3a280b18b0 2024-02-10T00:05:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:12.847+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3a24039930 con 0x7f3a280b18b0 2024-02-10T00:05:13.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.027+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a2806dbb0 con 0x7f3a280b18b0 2024-02-10T00:05:13.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.028+0000 7f3a1e7fc700 1 -- 172.21.15.89:0/3050140111 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3664 (secure 0 0 0) 0x7f3a2403d120 con 0x7f3a280b18b0 2024-02-10T00:05:13.030 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:13.031 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/4191707170","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":4191707170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6817/78137582","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":78137582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:05:05.200334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14565},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14565":{"gid":14565,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6819/1779314041","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":1779314041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:05:13.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 >> v1:172.21.15.89:6816/47970 conn(0x7f3a0c046040 legacy=0x7f3a0c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 msgr2=0x7f3a280a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 0x7f3a280a92f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b1ec0 tx=0x7f3a240091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 shutdown_connections 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a2813a390 0x7f3a280a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2806f630 0x7f3a280a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 --2- 172.21.15.89:0/3050140111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a280b18b0 0x7f3a280a92f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 >> 172.21.15.89:0/3050140111 conn(0x7f3a2806a820 msgr2=0x7f3a280aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 shutdown_connections 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.030+0000 7f3a3050e700 1 -- 172.21.15.89:0/3050140111 wait complete. 2024-02-10T00:05:13.033 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-02-10T00:05:13.346 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-09T23:58:27.305555+0000', 'modified': '2024-02-10T00:05:05.200334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14565}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_14565': {'gid': 14565, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.89:6819/1779314041', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.89:6819', 'nonce': 1779314041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-02-10T00:05:13.346 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-10T00:05:13.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-10T00:05:13.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.464+0000 7f69c7af7700 1 Processor -- start 2024-02-10T00:05:13.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 -- start start 2024-02-10T00:05:13.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c0139bb0 con 0x7f69c00a5130 2024-02-10T00:05:13.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0063b10 con 0x7f69c013f6e0 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c7af7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00a2100 con 0x7f69c0063740 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c6094700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34930/0 (socket says 172.21.15.89:34930) 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c6094700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60876/0 (socket says 172.21.15.89:60876) 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58354/0 (socket says 172.21.15.89:58354) 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.465+0000 7f69c5092700 1 -- 172.21.15.89:0/935130227 learned_addr learned my addr 172.21.15.89:0/935130227 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 -- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 msgr2=0x7f69c00a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 -- 172.21.15.89:0/935130227 >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 msgr2=0x7f69c013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 --2- 172.21.15.89:0/935130227 >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 -- 172.21.15.89:0/935130227 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c013fb70 con 0x7f69c013f6e0 2024-02-10T00:05:13.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5893700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c6094700 1 --2- 172.21.15.89:0/935130227 >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c5092700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0099b0 tx=0x7f69bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14eb677e8239e49 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c4891700 1 -- 172.21.15.89:0/935130227 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00b710 con 0x7f69c013f6e0 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c4891700 1 -- 172.21.15.89:0/935130227 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc00b870 con 0x7f69c013f6e0 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c4891700 1 -- 172.21.15.89:0/935130227 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00bc10 con 0x7f69c013f6e0 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 -- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 msgr2=0x7f69c00a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0099b0 tx=0x7f69bc009250 comp rx=0 tx=0).stop 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 -- 172.21.15.89:0/935130227 shutdown_connections 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 --2- 172.21.15.89:0/935130227 >> v2:172.21.15.89:3300/0 conn(0x7f69c00a5130 0x7f69c013fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c0063740 0x7f69c00a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 --2- 172.21.15.89:0/935130227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c013f6e0 0x7f69c00a29a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.466+0000 7f69c7af7700 1 -- 172.21.15.89:0/935130227 >> 172.21.15.89:0/935130227 conn(0x7f69c006a820 msgr2=0x7f69c00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.467+0000 7f69c7af7700 1 -- 172.21.15.89:0/935130227 shutdown_connections 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.467+0000 7f69c7af7700 1 -- 172.21.15.89:0/935130227 wait complete. 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.467+0000 7f69c7af7700 1 Processor -- start 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.467+0000 7f69c7af7700 1 -- start start 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 0x7f69c014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 0x7f69c014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c009bd70 con 0x7f69c0063740 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c009bad0 con 0x7f69c00a5130 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c7af7700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69c009ce50 con 0x7f69c013f6e0 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 0x7f69c014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 0x7f69c014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60888/0 (socket says 172.21.15.89:60888) 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 0x7f69c014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58368/0 (socket says 172.21.15.89:58368) 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 0x7f69c014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34932/0 (socket says 172.21.15.89:34932) 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 -- 172.21.15.89:0/2278701319 learned_addr learned my addr 172.21.15.89:0/2278701319 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 -- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 msgr2=0x7f69c014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 0x7f69c014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 -- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 msgr2=0x7f69c014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 0x7f69c014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 -- 172.21.15.89:0/2278701319 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009420 con 0x7f69c0063740 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.468+0000 7f69c5893700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69b000ec80 tx=0x7f69b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.469+0000 7f69b5ffb700 1 -- 172.21.15.89:0/2278701319 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000c8f0 con 0x7f69c0063740 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.469+0000 7f69b5ffb700 1 -- 172.21.15.89:0/2278701319 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b000ca50 con 0x7f69c0063740 2024-02-10T00:05:13.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.469+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b8009a20 con 0x7f69c0063740 2024-02-10T00:05:13.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.469+0000 7f69b5ffb700 1 -- 172.21.15.89:0/2278701319 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000cdd0 con 0x7f69c0063740 2024-02-10T00:05:13.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.469+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc0094f0 con 0x7f69c0063740 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.470+0000 7f69b5ffb700 1 -- 172.21.15.89:0/2278701319 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f69b0013680 con 0x7f69c0063740 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.470+0000 7f69b5ffb700 1 -- 172.21.15.89:0/2278701319 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f69b005b480 con 0x7f69c0063740 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.472+0000 7f69d0e0db80 1 Processor -- start 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.472+0000 7f69d0e0db80 1 -- start start 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0edf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c0e188e0 con 0x5651c0edeff0 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c0e162a0 con 0x5651c0eed900 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5651c0e12090 con 0x5651c0ebe660 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0edf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58370/0 (socket says 172.21.15.89:58370) 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0edf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60894/0 (socket says 172.21.15.89:60894) 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 -- 172.21.15.89:0/4155269231 learned_addr learned my addr 172.21.15.89:0/4155269231 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c6094700 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 -- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 msgr2=0x5651c0eedd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eedd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 -- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 msgr2=0x5651c0edf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0edf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 -- 172.21.15.89:0/4155269231 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c0c8e040 con 0x5651c0ebe660 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.473+0000 7f69c5893700 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69b003a000 tx=0x7f69b0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dba6342b8af0be server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69aaffd700 1 -- 172.21.15.89:0/4155269231 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00390d0 con 0x5651c0ebe660 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69aaffd700 1 -- 172.21.15.89:0/4155269231 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b005a0b0 con 0x5651c0ebe660 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69aaffd700 1 -- 172.21.15.89:0/4155269231 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b005a220 con 0x5651c0ebe660 2024-02-10T00:05:13.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 -- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 msgr2=0x5651c0eeef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69b003a000 tx=0x7f69b0014000 comp rx=0 tx=0).stop 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 -- 172.21.15.89:0/4155269231 shutdown_connections 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0eeef70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/4155269231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0edf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 -- 172.21.15.89:0/4155269231 >> 172.21.15.89:0/4155269231 conn(0x5651c0ee2370 msgr2=0x5651c0ec2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 -- 172.21.15.89:0/4155269231 shutdown_connections 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.474+0000 7f69d0e0db80 1 -- 172.21.15.89:0/4155269231 wait complete. 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 -- start start 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 Processor -- start 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 0x5651c0ee5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 0x5651c0edda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c0dbcd70 con 0x5651c0ebe660 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c0dbca10 con 0x5651c0eed900 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.475+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5651c0d0a290 con 0x5651c0edeff0 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69d0e0db80 10 client.0 _ll_register_callbacks cb 0x5651c0dbee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34960/0 (socket says 172.21.15.89:34960) 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c6094700 1 -- 172.21.15.89:0/2162897855 learned_addr learned my addr 172.21.15.89:0/2162897855 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5092700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 0x5651c0edda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 0x5651c0ee5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 -- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 msgr2=0x5651c0edda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 0x5651c0edda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 -- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 msgr2=0x5651c0eddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 -- 172.21.15.89:0/2162897855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc0094f0 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5092700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 0x5651c0edda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c6094700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69c5893700 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 0x5651c0ee5370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69b003d4c0 tx=0x7f69b003d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14160619137ce47b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00390d0 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f69b00371f0 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651c0eb6050 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69b00373d0 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69d0e0db80 10 client.14895 fetch_fsmap learned FSMap version 21 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=3+}) v3 -- 0x5651c0c50230 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651c0eb6050 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 21) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f69b0037b50 con 0x5651c0ebe660 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.476+0000 7f69d0e0db80 10 client.14895 fetch_fsmap finished waiting for FSMap version 21 2024-02-10T00:05:13.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f69d0e0db80 10 client.14895 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f69d0e0db80 20 client.14895 populate_metadata read hostname 'smithi089' 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f69d0e0db80 4 client.14895 mds_command: new command op to 14565 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 --> v1:172.21.15.89:6819/1779314041 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651c0db4690 con 0x5651c0ef34d0 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f699ffff700 10 client.14895 ms_handle_connect on v1:172.21.15.89:6819/1779314041 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f699ffff700 1 -- 172.21.15.89:0/2162897855 <== mds.0 v1:172.21.15.89:6819/1779314041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (unknown 0 0 428609513) 0x5651c0db4690 con 0x5651c0ef34d0 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f699ffff700 10 client.14895 handle_command_reply: tid=0 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.477+0000 7f69d0e0db80 1 client.14895 shutdown 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 msgr2=0x5651c0ee5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 0x5651c0ee5370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69b003d4c0 tx=0x7f69b003d020 comp rx=0 tx=0).stop 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 shutdown_connections 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0eed900 0x5651c0eddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0ebe660 0x5651c0ee5370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f699ffff700 0 client.14895 ms_handle_reset on v1:172.21.15.89:6819/1779314041 2024-02-10T00:05:13.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2162897855 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0edeff0 0x5651c0edda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 >> 172.21.15.89:0/2162897855 conn(0x5651c0ee2370 msgr2=0x5651c0eeee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 shutdown_connections 2024-02-10T00:05:13.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2162897855 wait complete. 2024-02-10T00:05:13.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.478+0000 7f69d0e0db80 20 client.14895 trim_cache size 0 max 16384 2024-02-10T00:05:13.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.494+0000 7f69d0e0db80 1 Processor -- start 2024-02-10T00:05:13.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.494+0000 7f69d0e0db80 1 -- start start 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0edf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 0x5651c0eee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c0dbca10 con 0x5651c0eed900 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c0dbcd70 con 0x5651c0edeff0 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5651c0ef0910 con 0x5651c0ebe660 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 0x5651c0eee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0edf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:34968/0 (socket says 172.21.15.89:34968) 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 -- 172.21.15.89:0/623978680 learned_addr learned my addr 172.21.15.89:0/623978680 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 0x5651c0eee210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60912/0 (socket says 172.21.15.89:60912) 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 -- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 msgr2=0x5651c0edf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0edf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 -- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 msgr2=0x5651c0eee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 0x5651c0eee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.495+0000 7f69c5092700 1 -- 172.21.15.89:0/623978680 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c0ddf970 con 0x5651c0edeff0 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69c5092700 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69bc006fd0 tx=0x7f69bc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a677d0a76e7d774 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69ab7fe700 1 -- 172.21.15.89:0/623978680 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00bab0 con 0x5651c0edeff0 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69ab7fe700 1 -- 172.21.15.89:0/623978680 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc02a580 con 0x5651c0edeff0 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69ab7fe700 1 -- 172.21.15.89:0/623978680 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00bc10 con 0x5651c0edeff0 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 -- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 msgr2=0x5651c0eedcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69bc006fd0 tx=0x7f69bc014000 comp rx=0 tx=0).stop 2024-02-10T00:05:13.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 -- 172.21.15.89:0/623978680 shutdown_connections 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0eed900 0x5651c0eee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0ebe660 0x5651c0edf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/623978680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0edeff0 0x5651c0eedcd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 -- 172.21.15.89:0/623978680 >> 172.21.15.89:0/623978680 conn(0x5651c0ee2370 msgr2=0x5651c0eb72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 -- 172.21.15.89:0/623978680 shutdown_connections 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.496+0000 7f69d0e0db80 1 -- 172.21.15.89:0/623978680 wait complete. 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 -- start start 2024-02-10T00:05:13.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 Processor -- start 2024-02-10T00:05:13.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 0x5651c0ee5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 0x5651c0ebd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c0f27f10 con 0x5651c0edeff0 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c0ee9870 con 0x5651c0ebe660 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.497+0000 7f69d0e0db80 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x5651c0ef3200 con 0x5651c0eed900 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69d0e0db80 10 client.0 _ll_register_callbacks cb 0x5651c0dbee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5092700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60926/0 (socket says 172.21.15.89:60926) 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5893700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 0x5651c0ee5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5092700 1 -- 172.21.15.89:0/2218395485 learned_addr learned my addr 172.21.15.89:0/2218395485 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 0x5651c0ebd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 -- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 msgr2=0x5651c0ee5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 0x5651c0ee5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 -- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 msgr2=0x5651c0ebd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 -- 172.21.15.89:0/2218395485 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c013fb70 con 0x5651c0eed900 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5893700 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 0x5651c0ee5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c5092700 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69c6094700 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 0x5651c0ebd720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5651c0ef0030 tx=0x7f69b801b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b384badb4fff1b48 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f699ffff700 10 client.0 ms_handle_connect on v2:172.21.15.89:3302/0 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b801e050 con 0x5651c0eed900 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mon.2 v2:172.21.15.89:3302/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f69b8012e50 con 0x5651c0eed900 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69b005a0b0 con 0x5651c0eed900 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69b800e040 con 0x5651c0eed900 2024-02-10T00:05:13.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69d0e0db80 10 client.14687 fetch_fsmap learned FSMap version 21 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,fsmap=21,monmap=3+}) v3 -- 0x5651c0c3abe0 con 0x5651c0eed900 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.498+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mon.2 v2:172.21.15.89:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b005a0b0 con 0x5651c0eed900 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mon.2 v2:172.21.15.89:3302/0 5 ==== fsmap(e 21) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f69b802b3a0 con 0x5651c0eed900 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 10 client.14687 fetch_fsmap finished waiting for FSMap version 21 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 10 client.14687 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 20 client.14687 populate_metadata read hostname 'smithi089' 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 4 client.14687 mds_command: new command op to 14565 tid=0[{"prefix": "status"}] 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 --> v1:172.21.15.89:6819/1779314041 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651c0db43b0 con 0x5651c0f4d370 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f699ffff700 10 client.14687 ms_handle_connect on v1:172.21.15.89:6819/1779314041 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f699ffff700 1 -- 172.21.15.89:0/2218395485 <== mds.0 v1:172.21.15.89:6819/1779314041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 2378837310) 0x5651c0db43b0 con 0x5651c0f4d370 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f699ffff700 10 client.14687 handle_command_reply: tid=0 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 client.14687 shutdown 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 msgr2=0x5651c0ebd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 0x5651c0ebd720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5651c0ef0030 tx=0x7f69b801b040 comp rx=0 tx=0).stop 2024-02-10T00:05:13.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 shutdown_connections 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x5651c0eed900 0x5651c0ebd720 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5651c0ebe660 0x5651c0ee5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 --2- 172.21.15.89:0/2218395485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651c0edeff0 0x5651c0ebd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f699ffff700 0 client.14687 ms_handle_reset on v1:172.21.15.89:6819/1779314041 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 >> 172.21.15.89:0/2218395485 conn(0x5651c0ee2370 msgr2=0x5651c0eb72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 shutdown_connections 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.499+0000 7f69d0e0db80 1 -- 172.21.15.89:0/2218395485 wait complete. 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69d0e0db80 20 client.14687 trim_cache size 0 max 16384 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:13.508 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "951e35aa-74af-44e4-b74f-b1f2d00d0504", 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 14565, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 16.923495405000001, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 21, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 40, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 40, 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 16.93844112 2024-02-10T00:05:13.509 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 >> v1:172.21.15.89:6816/47970 conn(0x7f69a4046040 legacy=0x7f69a40484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 msgr2=0x7f69c009b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69b000ec80 tx=0x7f69b00091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 shutdown_connections 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f69c013f6e0 0x7f69c014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69c0063740 0x7f69c009b1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 --2- 172.21.15.89:0/2278701319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69c00a5130 0x7f69c014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 >> 172.21.15.89:0/2278701319 conn(0x7f69c006a820 msgr2=0x7f69c006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 shutdown_connections 2024-02-10T00:05:13.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.500+0000 7f69c7af7700 1 -- 172.21.15.89:0/2278701319 wait complete. 2024-02-10T00:05:13.514 INFO:teuthology.run_tasks:Running task print... 2024-02-10T00:05:13.525 INFO:teuthology.task.print:**** done ceph.restart 2024-02-10T00:05:13.525 INFO:teuthology.run_tasks:Running task exec... 2024-02-10T00:05:13.537 INFO:teuthology.task.exec:Executing custom commands... 2024-02-10T00:05:13.537 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:05:13.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump --format=json-pretty' 2024-02-10T00:05:13.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.649+0000 7fb296d26700 1 Processor -- start 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.649+0000 7fb296d26700 1 -- start start 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb296d26700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb296d26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb296d26700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29006f460 con 0x7fb2901426c0 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb296d26700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900af090 con 0x7fb2900640d0 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb296d26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29013e850 con 0x7fb290141ac0 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb294ac2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb294ac2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60938/0 (socket says 172.21.15.89:60938) 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb28ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb2901426c0 0x7fb29013eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33890/0 (socket says 172.21.15.89:33890) 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:35000/0 (socket says 172.21.15.89:35000) 2024-02-10T00:05:13.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb294ac2700 1 -- 172.21.15.89:0/4175410872 learned_addr learned my addr 172.21.15.89:0/4175410872 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 -- 172.21.15.89:0/4175410872 >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 msgr2=0x7fb290142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 --2- 172.21.15.89:0/4175410872 >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 -- 172.21.15.89:0/4175410872 >> v1:172.21.15.89:6789/0 conn(0x7fb2901426c0 legacy=0x7fb29013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 -- 172.21.15.89:0/4175410872 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29006d500 con 0x7fb290141ac0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb28f7fe700 1 -- 172.21.15.89:0/4175410872 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513549388 0 0) 0x7fb29006f460 con 0x7fb2901426c0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb294ac2700 1 --2- 172.21.15.89:0/4175410872 >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb2952c3700 1 --2- 172.21.15.89:0/4175410872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb288009e90 tx=0x7fb288009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28fa49d3ec21809d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb28f7fe700 1 -- 172.21.15.89:0/4175410872 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800e070 con 0x7fb290141ac0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb28f7fe700 1 -- 172.21.15.89:0/4175410872 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800bbf0 con 0x7fb290141ac0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.650+0000 7fb28f7fe700 1 -- 172.21.15.89:0/4175410872 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288012430 con 0x7fb290141ac0 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 -- 172.21.15.89:0/4175410872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 msgr2=0x7fb290148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 --2- 172.21.15.89:0/4175410872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb288009e90 tx=0x7fb288009780 comp rx=0 tx=0).stop 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 -- 172.21.15.89:0/4175410872 shutdown_connections 2024-02-10T00:05:13.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 --2- 172.21.15.89:0/4175410872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb290148e60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 --2- 172.21.15.89:0/4175410872 >> v2:172.21.15.89:3300/0 conn(0x7fb2900640d0 0x7fb290142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 -- 172.21.15.89:0/4175410872 >> 172.21.15.89:0/4175410872 conn(0x7fb29006b8d0 msgr2=0x7fb290063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 -- 172.21.15.89:0/4175410872 shutdown_connections 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.651+0000 7fb296d26700 1 -- 172.21.15.89:0/4175410872 wait complete. 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.652+0000 7fb296d26700 1 Processor -- start 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.652+0000 7fb296d26700 1 -- start start 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb2900aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2901426c0 0x7fb2900aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900adad0 con 0x7fb2901426c0 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900add90 con 0x7fb290141ac0 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900ae380 con 0x7fb2900640d0 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58398/0 (socket says 172.21.15.89:58398) 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 -- 172.21.15.89:0/2025011930 learned_addr learned my addr 172.21.15.89:0/2025011930 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb28ffff700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb2900aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb2952c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2901426c0 0x7fb2900aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 -- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 msgr2=0x7fb2900aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb2900aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 -- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2901426c0 msgr2=0x7fb2900aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2901426c0 0x7fb2900aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 -- 172.21.15.89:0/2025011930 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840094f0 con 0x7fb2900640d0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb294ac2700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ec50 tx=0x7fb284009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400c8e0 con 0x7fb2900640d0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400ca40 con 0x7fb2900640d0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb288009a20 con 0x7fb2900640d0 2024-02-10T00:05:13.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400cdc0 con 0x7fb2900640d0 2024-02-10T00:05:13.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.653+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2900ad750 con 0x7fb2900640d0 2024-02-10T00:05:13.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.654+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fb284013680 con 0x7fb2900640d0 2024-02-10T00:05:13.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.654+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2900980c0 con 0x7fb2900640d0 2024-02-10T00:05:13.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.655+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fb28405b840 con 0x7fb2900640d0 2024-02-10T00:05:13.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.658+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fb284039c10 con 0x7fb2900640d0 2024-02-10T00:05:13.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.834+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs dump", "format": "json-pretty"} v 0) v1 -- 0x7fb29013e520 con 0x7fb2900640d0 2024-02-10T00:05:13.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.835+0000 7fb28cff9700 1 -- 172.21.15.89:0/2025011930 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json-pretty"}]=0 dumped fsmap epoch 21 v21) v1 ==== 101+0+7627 (secure 0 0 0) 0x7fb28403d1f0 con 0x7fb2900640d0 2024-02-10T00:05:13.837 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 21, 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "default_fscid": 1, 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": { 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": {}, 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "ro_compat": {}, 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "incompat": { 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_1": "base v0.20", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_2": "client writeable ranges", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_3": "default file layouts on dirs", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_4": "dir inode in separate object", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_5": "mds uses versioned encoding", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_6": "dirfrag is stored in omap", 2024-02-10T00:05:13.838 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_8": "no anchor table", 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_9": "file layout v2", 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_10": "snaprealm v2" 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_flags": { 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "enable_multiple": false, 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "ever_enabled_multiple": true 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "standbys": [ 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "gid": 14435, 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "b", 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "rank": -1, 2024-02-10T00:05:13.839 INFO:teuthology.orchestra.run.smithi089.stdout: "incarnation": 0, 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:standby", 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "state_seq": 1, 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818/4191707170", 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addrs": { 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6818", 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4191707170 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.840 INFO:teuthology.orchestra.run.smithi089.stdout: "join_fscid": -1, 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "export_targets": [], 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 0, 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": { 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": {}, 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "ro_compat": {}, 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "incompat": { 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_1": "base v0.20", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_2": "client writeable ranges", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_3": "default file layouts on dirs", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_4": "dir inode in separate object", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_5": "mds uses versioned encoding", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_6": "dirfrag is stored in omap", 2024-02-10T00:05:13.841 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_7": "mds uses inline data", 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_8": "no anchor table", 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_9": "file layout v2", 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_10": "snaprealm v2" 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 16 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "gid": 14559, 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "a", 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "rank": -1, 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "incarnation": 0, 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:standby", 2024-02-10T00:05:13.842 INFO:teuthology.orchestra.run.smithi089.stdout: "state_seq": 1, 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817/78137582", 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "addrs": { 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6817", 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 78137582 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "join_fscid": -1, 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "export_targets": [], 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:05:13.843 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 0, 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": { 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": {}, 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "ro_compat": {}, 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "incompat": { 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_1": "base v0.20", 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_2": "client writeable ranges", 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_3": "default file layouts on dirs", 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_4": "dir inode in separate object", 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_5": "mds uses versioned encoding", 2024-02-10T00:05:13.844 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_6": "dirfrag is stored in omap", 2024-02-10T00:05:13.847 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_7": "mds uses inline data", 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_8": "no anchor table", 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_9": "file layout v2", 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_10": "snaprealm v2" 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 18 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "filesystems": [ 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap": { 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 21, 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 18, 2024-02-10T00:05:13.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_state": { 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "joinable": true, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_snaps": true, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_multimds_snaps": true, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_standby_replay": false 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "ever_allowed_features": 0, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "explicitly_allowed_features": 0, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-02-09T23:58:27.305555+0000", 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-02-10T00:05:05.200334+0000", 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tableserver": 0, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "root": 0, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "session_timeout": 60, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "session_autoclose": 300, 2024-02-10T00:05:13.849 INFO:teuthology.orchestra.run.smithi089.stdout: "required_client_features": {}, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "max_file_size": 1099511627776, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "last_failure": 0, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "last_failure_osd_epoch": 33, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": { 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": {}, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "ro_compat": {}, 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "incompat": { 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_1": "base v0.20", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_2": "client writeable ranges", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_3": "default file layouts on dirs", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_4": "dir inode in separate object", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_5": "mds uses versioned encoding", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_6": "dirfrag is stored in omap", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_7": "mds uses inline data", 2024-02-10T00:05:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_8": "no anchor table", 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_9": "file layout v2", 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_10": "snaprealm v2" 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "max_mds": 1, 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "in": [ 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: 0 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "up": { 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_0": 14565 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "failed": [], 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "damaged": [], 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: "stopped": [ 2024-02-10T00:05:13.851 INFO:teuthology.orchestra.run.smithi089.stdout: 1 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "info": { 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "gid_14565": { 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "gid": 14565, 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "c", 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "rank": 0, 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "incarnation": 17, 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "state_seq": 5, 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819/1779314041", 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addrs": { 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-02-10T00:05:13.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:6819", 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1779314041 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "join_fscid": -1, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "export_targets": [], 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540138320759226367, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 0, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": { 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "compat": {}, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "ro_compat": {}, 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "incompat": { 2024-02-10T00:05:13.853 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_1": "base v0.20", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_2": "client writeable ranges", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_3": "default file layouts on dirs", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_4": "dir inode in separate object", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_5": "mds uses versioned encoding", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_6": "dirfrag is stored in omap", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_7": "mds uses inline data", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_8": "no anchor table", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_9": "file layout v2", 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "feature_10": "snaprealm v2" 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: "data_pools": [ 2024-02-10T00:05:13.854 INFO:teuthology.orchestra.run.smithi089.stdout: 4 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata_pool": 3, 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": true, 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "balancer": "", 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "standby_count_wanted": 0 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 1 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-02-10T00:05:13.855 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 >> v1:172.21.15.89:6816/47970 conn(0x7fb274046070 legacy=0x7fb274048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 msgr2=0x7fb2900ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ec50 tx=0x7fb284009250 comp rx=0 tx=0).stop 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 shutdown_connections 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2901426c0 0x7fb2900aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb2900640d0 0x7fb2900ad210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 --2- 172.21.15.89:0/2025011930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb290141ac0 0x7fb2900aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 >> 172.21.15.89:0/2025011930 conn(0x7fb29006b8d0 msgr2=0x7fb29006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 shutdown_connections 2024-02-10T00:05:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.837+0000 7fb296d26700 1 -- 172.21.15.89:0/2025011930 wait complete. 2024-02-10T00:05:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-02-10T00:05:13.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs required_client_features cephfs add metric_collect' 2024-02-10T00:05:13.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.972+0000 7f11e54e0700 1 Processor -- start 2024-02-10T00:05:13.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.972+0000 7f11e54e0700 1 -- start start 2024-02-10T00:05:13.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11e54e0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 0x7f11e013af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11e54e0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11e54e0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e006d370 con 0x7f11e006bf40 2024-02-10T00:05:13.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11e54e0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e006e1b0 con 0x7f11e00a3e80 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11e54e0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11e013ab10 con 0x7f11e013b480 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11de7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 0x7f11e013af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58408/0 (socket says 172.21.15.89:58408) 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11deffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f11e006bf40 0x7f11e006daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33906/0 (socket says 172.21.15.89:33906) 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 -- 172.21.15.89:0/3413640140 learned_addr learned my addr 172.21.15.89:0/3413640140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 -- 172.21.15.89:0/3413640140 >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 msgr2=0x7f11e013af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 --2- 172.21.15.89:0/3413640140 >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 0x7f11e013af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 -- 172.21.15.89:0/3413640140 >> v1:172.21.15.89:6789/0 conn(0x7f11e006bf40 legacy=0x7f11e006daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 -- 172.21.15.89:0/3413640140 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e006fc30 con 0x7f11e013b480 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11ddffb700 1 -- 172.21.15.89:0/3413640140 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840653354 0 0) 0x7f11e006d370 con 0x7f11e006bf40 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11de7fc700 1 --2- 172.21.15.89:0/3413640140 >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 0x7f11e013af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11df7fe700 1 --2- 172.21.15.89:0/3413640140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009f20 tx=0x7f11d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa3546f676c25c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.973+0000 7f11ddffb700 1 -- 172.21.15.89:0/3413640140 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800e070 con 0x7f11e013b480 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11ddffb700 1 -- 172.21.15.89:0/3413640140 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800ba60 con 0x7f11e013b480 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11ddffb700 1 -- 172.21.15.89:0/3413640140 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80092e0 con 0x7f11e013b480 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 -- 172.21.15.89:0/3413640140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 msgr2=0x7f11e01450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 --2- 172.21.15.89:0/3413640140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009f20 tx=0x7f11d8009840 comp rx=0 tx=0).stop 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 -- 172.21.15.89:0/3413640140 shutdown_connections 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 --2- 172.21.15.89:0/3413640140 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e01450c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 --2- 172.21.15.89:0/3413640140 >> v2:172.21.15.89:3300/0 conn(0x7f11e00a3e80 0x7f11e013af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 -- 172.21.15.89:0/3413640140 >> 172.21.15.89:0/3413640140 conn(0x7f11e006b060 msgr2=0x7f11e0063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 -- 172.21.15.89:0/3413640140 shutdown_connections 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.974+0000 7f11e54e0700 1 -- 172.21.15.89:0/3413640140 wait complete. 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.975+0000 7f11e54e0700 1 Processor -- start 2024-02-10T00:05:13.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.975+0000 7f11e54e0700 1 -- start start 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11e006bf40 0x7f11e009bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11e00a3e80 0x7f11e014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00995b0 con 0x7f11e006bf40 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e009c6e0 con 0x7f11e00a3e80 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00997e0 con 0x7f11e013b480 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:58410/0 (socket says 172.21.15.89:58410) 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 -- 172.21.15.89:0/1525759545 learned_addr learned my addr 172.21.15.89:0/1525759545 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11de7fc700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11e00a3e80 0x7f11e014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11deffd700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11e006bf40 0x7f11e009bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 -- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11e00a3e80 msgr2=0x7f11e014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11e00a3e80 0x7f11e014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 -- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11e006bf40 msgr2=0x7f11e009bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11e006bf40 0x7f11e009bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 -- 172.21.15.89:0/1525759545 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d000b6d0 con 0x7f11e013b480 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11df7fe700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11e006b8f0 tx=0x7f11d8018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80032f0 con 0x7f11e013b480 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8008ce0 con 0x7f11e013b480 2024-02-10T00:05:13.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d801d630 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d8009ae0 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.976+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e009c230 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.977+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f11d8003040 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.977+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e006b460 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.978+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f11d805ce70 con 0x7f11e013b480 2024-02-10T00:05:13.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:13.981+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f11d8028b60 con 0x7f11e013b480 2024-02-10T00:05:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.162+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"} v 0) v1 -- 0x7f11e009af20 con 0x7f11e013b480 2024-02-10T00:05:14.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.230+0000 7f11c6ffd700 1 -- 172.21.15.89:0/1525759545 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"}]=0 added feature 'metric_collect' to required_client_features v22) v1 ==== 195+0+0 (secure 0 0 0) 0x7f11d8028990 con 0x7f11e013b480 2024-02-10T00:05:14.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 >> v1:172.21.15.89:6816/47970 conn(0x7f11cc046040 legacy=0x7f11cc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:14.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 msgr2=0x7f11e014d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:14.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11e006b8f0 tx=0x7f11d8018000 comp rx=0 tx=0).stop 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 shutdown_connections 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f11e013b480 0x7f11e014d6b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11e006bf40 0x7f11e009bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 --2- 172.21.15.89:0/1525759545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11e00a3e80 0x7f11e014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 >> 172.21.15.89:0/1525759545 conn(0x7f11e006b060 msgr2=0x7f11e0070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 shutdown_connections 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:14.232+0000 7f11e54e0700 1 -- 172.21.15.89:0/1525759545 wait complete. 2024-02-10T00:05:14.235 INFO:teuthology.orchestra.run.smithi089.stderr:added feature 'metric_collect' to required_client_features 2024-02-10T00:05:14.246 INFO:teuthology.run_tasks:Running task sleep... 2024-02-10T00:05:14.284 INFO:teuthology.task.sleep:Sleeping for 5 seconds 2024-02-10T00:05:15.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:2024-02-10T00:05:15.251+0000 7ff5537fe700 -1 client.4686 I was blacklisted at osd epoch 41 2024-02-10T00:05:15.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-02-10T00:05:15.250+0000 7ff7e37fe700 -1 client.4520 I was blacklisted at osd epoch 41 2024-02-10T00:05:19.285 INFO:teuthology.run_tasks:Running task fs.clients_evicted... 2024-02-10T00:05:19.299 INFO:tasks.fs:clients is {'client.0': True, 'client.1': True} 2024-02-10T00:05:19.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:19.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 Processor -- start 2024-02-10T00:05:19.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 -- start start 2024-02-10T00:05:19.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3430063740 0x7f343006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34300a1130 con 0x7f3430063740 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300a28c0 con 0x7f343006ce70 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3436f97700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3430063b10 con 0x7f343006d260 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3435534700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f342ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.426+0000 7f3434d33700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3430063740 0x7f343006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3435534700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45578/0 (socket says 172.21.15.89:45578) 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f342ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32854/0 (socket says 172.21.15.89:32854) 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3435534700 1 -- 172.21.15.89:0/1189509505 learned_addr learned my addr 172.21.15.89:0/1189509505 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3430063740 0x7f343006e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58472/0 (socket says 172.21.15.89:58472) 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 -- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 msgr2=0x7f3430142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 -- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 msgr2=0x7f3430141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:19.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 -- 172.21.15.89:0/1189509505 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34301428c0 con 0x7f3430063740 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3435534700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f342ffff700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f3434d33700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f343006e1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f34240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2f8d42b909348b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f342f7fe700 1 -- 172.21.15.89:0/1189509505 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424011630 con 0x7f3430063740 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f342f7fe700 1 -- 172.21.15.89:0/1189509505 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424011790 con 0x7f3430063740 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.427+0000 7f342f7fe700 1 -- 172.21.15.89:0/1189509505 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424011b30 con 0x7f3430063740 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 -- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 msgr2=0x7f343006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f343006e1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f34240091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 -- 172.21.15.89:0/1189509505 shutdown_connections 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006d260 0x7f3430142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f343006e1c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 --2- 172.21.15.89:0/1189509505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006ce70 0x7f3430141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 -- 172.21.15.89:0/1189509505 >> 172.21.15.89:0/1189509505 conn(0x7f343006a820 msgr2=0x7f34300b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 -- 172.21.15.89:0/1189509505 shutdown_connections 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.428+0000 7f3436f97700 1 -- 172.21.15.89:0/1189509505 wait complete. 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 Processor -- start 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 -- start start 2024-02-10T00:05:19.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 0x7f34300b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006d260 0x7f343014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300a9600 con 0x7f3430063740 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300a9af0 con 0x7f343006d260 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3436f97700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34300aa750 con 0x7f343006ce70 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3434d33700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f342ffff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 0x7f34300b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3434d33700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58482/0 (socket says 172.21.15.89:58482) 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3434d33700 1 -- 172.21.15.89:0/431869658 learned_addr learned my addr 172.21.15.89:0/431869658 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:19.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.429+0000 7f3435534700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006d260 0x7f343014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 -- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006d260 msgr2=0x7f343014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006d260 0x7f343014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 -- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 msgr2=0x7f34300aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 -- 172.21.15.89:0/431869658 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009420 con 0x7f343006ce70 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f3434d33700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342ffff700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 0x7f34300b06c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f341c00ec80 tx=0x7f341c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00c850 con 0x7f343006ce70 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00c9b0 con 0x7f343006ce70 2024-02-10T00:05:19.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3428009ae0 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00cd70 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.430+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3424009420 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.431+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f341c013680 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.431+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343004c710 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.431+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f341c05b420 con 0x7f343006ce70 2024-02-10T00:05:19.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.435+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f341c0395e0 con 0x7f343006ce70 2024-02-10T00:05:19.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.589+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34300a3150 con 0x7f343006ce70 2024-02-10T00:05:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.590+0000 7f342cff9700 1 -- 172.21.15.89:0/431869658 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f341c03cdd0 con 0x7f343006ce70 2024-02-10T00:05:19.593 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:19.594 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:19.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 >> v1:172.21.15.89:6816/47970 conn(0x7f3414046070 legacy=0x7f3414048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 msgr2=0x7f34300b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 0x7f34300b06c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f341c00ec80 tx=0x7f341c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 shutdown_connections 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343006d260 0x7f343014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3430063740 0x7f34300aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 --2- 172.21.15.89:0/431869658 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f343006ce70 0x7f34300b06c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 >> 172.21.15.89:0/431869658 conn(0x7f343006a820 msgr2=0x7f34300a1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:19.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 shutdown_connections 2024-02-10T00:05:19.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.592+0000 7f3436f97700 1 -- 172.21.15.89:0/431869658 wait complete. 2024-02-10T00:05:19.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:05:19.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:05:19.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 Processor -- start 2024-02-10T00:05:19.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 -- start start 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 0x7ffb8806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 0x7ffb880a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8806f3e0 con 0x7ffb880a1b40 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8806f680 con 0x7ffb88063580 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8f2e2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8806d860 con 0x7ffb8806cd20 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8c87d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 0x7ffb880a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8d87f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ffb880a1b40 0x7ffb881488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57848/0 (socket says 172.21.15.89:57848) 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.724+0000 7ffb8d87f700 1 -- 172.21.15.89:0/17161504 learned_addr learned my addr 172.21.15.89:0/17161504 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8d07e700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 0x7ffb8806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8c87d700 1 -- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 msgr2=0x7ffb8806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8c87d700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 0x7ffb8806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb7ffff700 1 -- 172.21.15.89:0/17161504 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912215251 0 0) 0x7ffb8806f3e0 con 0x7ffb880a1b40 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8c87d700 1 -- 172.21.15.89:0/17161504 >> v1:172.21.15.89:6789/0 conn(0x7ffb880a1b40 legacy=0x7ffb881488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8c87d700 1 -- 172.21.15.89:0/17161504 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8806ec50 con 0x7ffb8806cd20 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8d07e700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 0x7ffb8806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb8c87d700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 0x7ffb880a1600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009910 tx=0x7ffb780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cb23ea761ccc0c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb7ffff700 1 -- 172.21.15.89:0/17161504 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800b680 con 0x7ffb8806cd20 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb7ffff700 1 -- 172.21.15.89:0/17161504 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800b7e0 con 0x7ffb8806cd20 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.725+0000 7ffb7ffff700 1 -- 172.21.15.89:0/17161504 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800bba0 con 0x7ffb8806cd20 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 msgr2=0x7ffb880a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 0x7ffb880a1600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009910 tx=0x7ffb780091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/17161504 shutdown_connections 2024-02-10T00:05:19.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb88063580 0x7ffb8806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/17161504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb8806cd20 0x7ffb880a1600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/17161504 >> 172.21.15.89:0/17161504 conn(0x7ffb8806a910 msgr2=0x7ffb880b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/17161504 shutdown_connections 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.726+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/17161504 wait complete. 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 Processor -- start 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 -- start start 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 0x7ffb88098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 0x7ffb88099c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:19.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88099750 con 0x7ffb880a1b40 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8814eb30 con 0x7ffb8806cd20 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8f2e2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8809a6f0 con 0x7ffb88063580 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8d87f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8c87d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 0x7ffb88099c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8d07e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 0x7ffb88098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8c87d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 0x7ffb88099c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32878/0 (socket says 172.21.15.89:32878) 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8d87f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58486/0 (socket says 172.21.15.89:58486) 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.727+0000 7ffb8c87d700 1 -- 172.21.15.89:0/7872752 learned_addr learned my addr 172.21.15.89:0/7872752 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 -- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 msgr2=0x7ffb88099c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 0x7ffb88099c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 -- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 msgr2=0x7ffb8814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 -- 172.21.15.89:0/7872752 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84009420 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d87f700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8d07e700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 0x7ffb88098a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400ec80 tx=0x7ffb840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400c850 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8400c9b0 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400cd70 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78009420 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.728+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8809a190 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.729+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8804c710 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.729+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ffb84013680 con 0x7ffb88063580 2024-02-10T00:05:19.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.729+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7ffb8405b4d0 con 0x7ffb88063580 2024-02-10T00:05:19.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.733+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ffb84039630 con 0x7ffb88063580 2024-02-10T00:05:19.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.885+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb880a2ac0 con 0x7ffb88063580 2024-02-10T00:05:19.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.886+0000 7ffb7d7fa700 1 -- 172.21.15.89:0/7872752 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb8403ce20 con 0x7ffb88063580 2024-02-10T00:05:19.888 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 >> v1:172.21.15.89:6816/47970 conn(0x7ffb6c046040 legacy=0x7ffb6c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 msgr2=0x7ffb88098a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 0x7ffb88098a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400ec80 tx=0x7ffb840091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 shutdown_connections 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb880a1b40 0x7ffb8814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ffb88063580 0x7ffb88098a60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 --2- 172.21.15.89:0/7872752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8806cd20 0x7ffb88099c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 >> 172.21.15.89:0/7872752 conn(0x7ffb8806a910 msgr2=0x7ffb88143b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 shutdown_connections 2024-02-10T00:05:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:19.887+0000 7ffb8f2e2700 1 -- 172.21.15.89:0/7872752 wait complete. 2024-02-10T00:05:19.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:05:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.017+0000 7fdb05a97700 1 Processor -- start 2024-02-10T00:05:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.017+0000 7fdb05a97700 1 -- start start 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdb05a97700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb00067b30 0x7fdb000aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdb05a97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 0x7fdb0006f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdb05a97700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb00067f00 con 0x7fdb0006ed20 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdb05a97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000a9ea0 con 0x7fdb001425f0 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdb05a97700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000aa870 con 0x7fdb00067b30 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 0x7fdb0006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafeffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdb0006ed20 0x7fdb00141ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57852/0 (socket says 172.21.15.89:57852) 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafeffd700 1 -- 172.21.15.89:0/3128832651 learned_addr learned my addr 172.21.15.89:0/3128832651 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdaff7fe700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb00067b30 0x7fdb000aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 -- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb00067b30 msgr2=0x7fdb000aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb00067b30 0x7fdb000aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafe7fc700 1 -- 172.21.15.89:0/3128832651 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71624674 0 0) 0x7fdb00067f00 con 0x7fdb0006ed20 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 -- 172.21.15.89:0/3128832651 >> v1:172.21.15.89:6789/0 conn(0x7fdb0006ed20 legacy=0x7fdb00141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 -- 172.21.15.89:0/3128832651 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00141a90 con 0x7fdb001425f0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.018+0000 7fdafffff700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 0x7fdb0006f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009e90 tx=0x7fdaf8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f249194974fb43 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdafe7fc700 1 -- 172.21.15.89:0/3128832651 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800e070 con 0x7fdb001425f0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdafe7fc700 1 -- 172.21.15.89:0/3128832651 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800bcc0 con 0x7fdb001425f0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdafe7fc700 1 -- 172.21.15.89:0/3128832651 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8012680 con 0x7fdb001425f0 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 -- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 msgr2=0x7fdb0006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 0x7fdb0006f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009e90 tx=0x7fdaf8009780 comp rx=0 tx=0).stop 2024-02-10T00:05:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 -- 172.21.15.89:0/3128832651 shutdown_connections 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb001425f0 0x7fdb0006f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 --2- 172.21.15.89:0/3128832651 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb00067b30 0x7fdb000aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 -- 172.21.15.89:0/3128832651 >> 172.21.15.89:0/3128832651 conn(0x7fdb0006c7c0 msgr2=0x7fdb00063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 -- 172.21.15.89:0/3128832651 shutdown_connections 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.019+0000 7fdb05a97700 1 -- 172.21.15.89:0/3128832651 wait complete. 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.020+0000 7fdb05a97700 1 Processor -- start 2024-02-10T00:05:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.020+0000 7fdb05a97700 1 -- start start 2024-02-10T00:05:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 0x7fdb0013d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 0x7fdb0013da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00098980 con 0x7fdb00067b30 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000a3ce0 con 0x7fdb00099080 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000ac490 con 0x7fdb0006ed20 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdafeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 0x7fdb0013d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58494/0 (socket says 172.21.15.89:58494) 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdafffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 0x7fdb0013da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 -- 172.21.15.89:0/614032339 learned_addr learned my addr 172.21.15.89:0/614032339 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdafeffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 0x7fdb0013d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45630/0 (socket says 172.21.15.89:45630) 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 -- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 msgr2=0x7fdb0013d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 0x7fdb0013d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 -- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 msgr2=0x7fdb0013da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 0x7fdb0013da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 -- 172.21.15.89:0/614032339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009a20 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdafffff700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 0x7fdb0013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdaff7fe700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400ec80 tx=0x7fdaf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400c850 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400c9b0 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb000ac730 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400cd50 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.021+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb000ae060 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.022+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdaf4013680 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.022+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb000aed10 con 0x7fdb00067b30 2024-02-10T00:05:20.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.023+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fdaf405b510 con 0x7fdb00067b30 2024-02-10T00:05:20.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.026+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fdaf40396d0 con 0x7fdb00067b30 2024-02-10T00:05:20.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.178+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb0004c710 con 0x7fdb00067b30 2024-02-10T00:05:20.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.179+0000 7fdae77fe700 1 -- 172.21.15.89:0/614032339 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdaf403cec0 con 0x7fdb00067b30 2024-02-10T00:05:20.181 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 >> v1:172.21.15.89:6816/47970 conn(0x7fdaec046040 legacy=0x7fdaec0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 msgr2=0x7fdb00097ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400ec80 tx=0x7fdaf40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 shutdown_connections 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb00099080 0x7fdb0013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb00067b30 0x7fdb00097ac0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 --2- 172.21.15.89:0/614032339 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdb0006ed20 0x7fdb0013d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 >> 172.21.15.89:0/614032339 conn(0x7fdb0006c7c0 msgr2=0x7fdb0013f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 shutdown_connections 2024-02-10T00:05:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.180+0000 7fdb05a97700 1 -- 172.21.15.89:0/614032339 wait complete. 2024-02-10T00:05:20.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:05:20.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 Processor -- start 2024-02-10T00:05:20.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 -- start start 2024-02-10T00:05:20.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 0x7f66b006e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 0x7f66b01498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b006f3e0 con 0x7f66b006cd20 2024-02-10T00:05:20.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b006f680 con 0x7f66b00a1d10 2024-02-10T00:05:20.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b6ec0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66b006d860 con 0x7f66b0063580 2024-02-10T00:05:20.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b4c5c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 0x7f66b006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66b545d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 0x7f66b01498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66affff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f66b006cd20 0x7f66b00a1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57862/0 (socket says 172.21.15.89:57862) 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.313+0000 7f66affff700 1 -- 172.21.15.89:0/4129069370 learned_addr learned my addr 172.21.15.89:0/4129069370 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66af7fe700 1 -- 172.21.15.89:0/4129069370 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312976020 0 0) 0x7f66b006f3e0 con 0x7f66b006cd20 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b4c5c700 1 -- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 msgr2=0x7f66b01498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:20.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b4c5c700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 0x7f66b01498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b4c5c700 1 -- 172.21.15.89:0/4129069370 >> v1:172.21.15.89:6789/0 conn(0x7f66b006cd20 legacy=0x7f66b00a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b4c5c700 1 -- 172.21.15.89:0/4129069370 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b006ec50 con 0x7f66b0063580 2024-02-10T00:05:20.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b545d700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 0x7f66b01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b4c5c700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 0x7f66b006e040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009910 tx=0x7f66a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe76fbbe7165261 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66af7fe700 1 -- 172.21.15.89:0/4129069370 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400b680 con 0x7f66b0063580 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66af7fe700 1 -- 172.21.15.89:0/4129069370 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400b7e0 con 0x7f66b0063580 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66af7fe700 1 -- 172.21.15.89:0/4129069370 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400bba0 con 0x7f66b0063580 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b6ec0700 1 -- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 msgr2=0x7f66b006e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.314+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 0x7f66b006e040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009910 tx=0x7f66a40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 -- 172.21.15.89:0/4129069370 shutdown_connections 2024-02-10T00:05:20.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b00a1d10 0x7f66b01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/4129069370 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b0063580 0x7f66b006e040 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 -- 172.21.15.89:0/4129069370 >> 172.21.15.89:0/4129069370 conn(0x7f66b006a910 msgr2=0x7f66b00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 -- 172.21.15.89:0/4129069370 shutdown_connections 2024-02-10T00:05:20.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 -- 172.21.15.89:0/4129069370 wait complete. 2024-02-10T00:05:20.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.315+0000 7f66b6ec0700 1 Processor -- start 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 -- start start 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b0063580 0x7f66b0099430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b00a1d10 0x7f66b013f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0099c00 con 0x7f66b00a1d10 2024-02-10T00:05:20.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b013f6b0 con 0x7f66b0063580 2024-02-10T00:05:20.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b6ec0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00988b0 con 0x7f66b006cd20 2024-02-10T00:05:20.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66affff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66affff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45638/0 (socket says 172.21.15.89:45638) 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b545d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b00a1d10 0x7f66b013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66affff700 1 -- 172.21.15.89:0/2519604397 learned_addr learned my addr 172.21.15.89:0/2519604397 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.316+0000 7f66b4c5c700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b0063580 0x7f66b0099430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 -- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b0063580 msgr2=0x7f66b0099430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b0063580 0x7f66b0099430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 -- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b00a1d10 msgr2=0x7f66b013f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b00a1d10 0x7f66b013f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 -- 172.21.15.89:0/2519604397 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8009a20 con 0x7f66b006cd20 2024-02-10T00:05:20.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66affff700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c7e0 tx=0x7f669c007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c005c00 con 0x7f66b006cd20 2024-02-10T00:05:20.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c005d80 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a4009420 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c007320 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.317+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b00a09e0 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.318+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b0099150 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.318+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f669c01b3b0 con 0x7f66b006cd20 2024-02-10T00:05:20.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.318+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f669c05a690 con 0x7f66b006cd20 2024-02-10T00:05:20.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.322+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f669c0388b0 con 0x7f66b006cd20 2024-02-10T00:05:20.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.474+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66b00a0b70 con 0x7f66b006cd20 2024-02-10T00:05:20.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.475+0000 7f66acff9700 1 -- 172.21.15.89:0/2519604397 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f669c017020 con 0x7f66b006cd20 2024-02-10T00:05:20.477 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 >> v1:172.21.15.89:6816/47970 conn(0x7f6694046040 legacy=0x7f66940484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 msgr2=0x7f66b013ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c7e0 tx=0x7f669c007d70 comp rx=0 tx=0).stop 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 shutdown_connections 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b00a1d10 0x7f66b013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66b0063580 0x7f66b0099430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 --2- 172.21.15.89:0/2519604397 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f66b006cd20 0x7f66b013ec30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.476+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 >> 172.21.15.89:0/2519604397 conn(0x7f66b006a910 msgr2=0x7f66b006df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.477+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 shutdown_connections 2024-02-10T00:05:20.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.477+0000 7f66b6ec0700 1 -- 172.21.15.89:0/2519604397 wait complete. 2024-02-10T00:05:20.490 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 Processor -- start 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 -- start start 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc0c06ced0 0x7efc0c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c063bc0 con 0x7efc0c0637f0 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c0a16a0 con 0x7efc0c06ced0 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc1193c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06e9e0 con 0x7efc0c0a1940 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc0a7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc0c06ced0 0x7efc0c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc0b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc0affd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7efc0c0637f0 0x7efc0c06e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57864/0 (socket says 172.21.15.89:57864) 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc0affd700 1 -- 172.21.15.89:0/4079839127 learned_addr learned my addr 172.21.15.89:0/4079839127 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.608+0000 7efc0b7fe700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45652/0 (socket says 172.21.15.89:45652) 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0a7fc700 1 -- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 msgr2=0x7efc0c0a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0a7fc700 1 -- 172.21.15.89:0/4079839127 >> v1:172.21.15.89:6789/0 conn(0x7efc0c0637f0 legacy=0x7efc0c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0a7fc700 1 -- 172.21.15.89:0/4079839127 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c06daf0 con 0x7efc0c06ced0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0b7fe700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c06d2d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dd18600164e106 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc09ffb700 1 -- 172.21.15.89:0/4079839127 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00b640 con 0x7efc0c06ced0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc09ffb700 1 -- 172.21.15.89:0/4079839127 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc00b7a0 con 0x7efc0c06ced0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc09ffb700 1 -- 172.21.15.89:0/4079839127 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00bb40 con 0x7efc0c06ced0 2024-02-10T00:05:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 -- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 msgr2=0x7efc0c06d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c06d2d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 -- 172.21.15.89:0/4079839127 shutdown_connections 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0a1940 0x7efc0c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 --2- 172.21.15.89:0/4079839127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c06d2d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 -- 172.21.15.89:0/4079839127 >> 172.21.15.89:0/4079839127 conn(0x7efc0c069f40 msgr2=0x7efc0c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 -- 172.21.15.89:0/4079839127 shutdown_connections 2024-02-10T00:05:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.609+0000 7efc1193c700 1 -- 172.21.15.89:0/4079839127 wait complete. 2024-02-10T00:05:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.610+0000 7efc1193c700 1 Processor -- start 2024-02-10T00:05:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 -- start start 2024-02-10T00:05:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc0c0a1940 0x7efc0c1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c146620 con 0x7efc0c06ced0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c145ae0 con 0x7efc0c0a1940 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc1193c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c145da0 con 0x7efc0c0637f0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45656/0 (socket says 172.21.15.89:45656) 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0affd700 1 -- 172.21.15.89:0/1656785418 learned_addr learned my addr 172.21.15.89:0/1656785418 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0b7fe700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc0c0a1940 0x7efc0c1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 -- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 msgr2=0x7efc0c145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 -- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc0c0a1940 msgr2=0x7efc0c1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc0c0a1940 0x7efc0c1432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0a7fc700 1 -- 172.21.15.89:0/1656785418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04009a20 con 0x7efc0c06ced0 2024-02-10T00:05:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.611+0000 7efc0affd700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efc0a7fc700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c142d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efbfc016000 tx=0x7efbfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc01bcf0 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc01be70 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc009420 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011650 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.612+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c144a20 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.613+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c04c710 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.613+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7efbfc011a00 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.613+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7efbfc05c620 con 0x7efc0c06ced0 2024-02-10T00:05:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.617+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7efbfc03e270 con 0x7efc0c06ced0 2024-02-10T00:05:20.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.768+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc0c0a2300 con 0x7efc0c06ced0 2024-02-10T00:05:20.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.769+0000 7efbf2ffd700 1 -- 172.21.15.89:0/1656785418 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7efbfc015020 con 0x7efc0c06ced0 2024-02-10T00:05:20.771 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.770+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 >> v1:172.21.15.89:6816/47970 conn(0x7efbf8046070 legacy=0x7efbf8048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.770+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 msgr2=0x7efc0c142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.770+0000 7efc1193c700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c142d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efbfc016000 tx=0x7efbfc017000 comp rx=0 tx=0).stop 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.770+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 shutdown_connections 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.770+0000 7efc1193c700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc0c0a1940 0x7efc0c1432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.771+0000 7efc1193c700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7efc0c0637f0 0x7efc0c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.771+0000 7efc1193c700 1 --2- 172.21.15.89:0/1656785418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc0c06ced0 0x7efc0c142d60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.771+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 >> 172.21.15.89:0/1656785418 conn(0x7efc0c069f40 msgr2=0x7efc0c06ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.771+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 shutdown_connections 2024-02-10T00:05:20.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.771+0000 7efc1193c700 1 -- 172.21.15.89:0/1656785418 wait complete. 2024-02-10T00:05:20.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-10T00:05:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.897+0000 7fe5caaf0700 1 Processor -- start 2024-02-10T00:05:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 -- start start 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 0x7fe5c40a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c406e2d0 con 0x7fe5c413a390 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40b1c80 con 0x7fe5c406f630 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5caaf0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c406eb50 con 0x7fe5c40b18b0 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c888c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c908d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 0x7fe5c40a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c888c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45664/0 (socket says 172.21.15.89:45664) 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c888c700 1 -- 172.21.15.89:0/957342049 learned_addr learned my addr 172.21.15.89:0/957342049 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:20.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.898+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32926/0 (socket says 172.21.15.89:32926) 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 -- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 msgr2=0x7fe5c4139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 -- 172.21.15.89:0/957342049 >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 msgr2=0x7fe5c40a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 --2- 172.21.15.89:0/957342049 >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 0x7fe5c40a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 -- 172.21.15.89:0/957342049 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c406edd0 con 0x7fe5c40b18b0 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c908d700 1 --2- 172.21.15.89:0/957342049 >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 0x7fe5c40a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c3fff700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c888c700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80099b0 tx=0x7fe5b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5569a9b3c2a113e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c37fe700 1 -- 172.21.15.89:0/957342049 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800b680 con 0x7fe5c40b18b0 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c37fe700 1 -- 172.21.15.89:0/957342049 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800b7e0 con 0x7fe5c40b18b0 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5c37fe700 1 -- 172.21.15.89:0/957342049 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800bb80 con 0x7fe5c40b18b0 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 -- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 msgr2=0x7fe5c406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80099b0 tx=0x7fe5b8009250 comp rx=0 tx=0).stop 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 -- 172.21.15.89:0/957342049 shutdown_connections 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/957342049 >> v2:172.21.15.89:3300/0 conn(0x7fe5c413a390 0x7fe5c40a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c406cb90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/957342049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c4139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.899+0000 7fe5caaf0700 1 -- 172.21.15.89:0/957342049 >> 172.21.15.89:0/957342049 conn(0x7fe5c406a820 msgr2=0x7fe5c40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.900+0000 7fe5caaf0700 1 -- 172.21.15.89:0/957342049 shutdown_connections 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.900+0000 7fe5caaf0700 1 -- 172.21.15.89:0/957342049 wait complete. 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.900+0000 7fe5caaf0700 1 Processor -- start 2024-02-10T00:05:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 -- start start 2024-02-10T00:05:20.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c40a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 0x7fe5c40a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:20.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a9560 con 0x7fe5c413a390 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a8840 con 0x7fe5c406f630 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5caaf0700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a9770 con 0x7fe5c40b18b0 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c908d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 0x7fe5c40a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c40a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32934/0 (socket says 172.21.15.89:32934) 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 -- 172.21.15.89:0/1640041846 learned_addr learned my addr 172.21.15.89:0/1640041846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c908d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 0x7fe5c40a4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58556/0 (socket says 172.21.15.89:58556) 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c40a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45672/0 (socket says 172.21.15.89:45672) 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 -- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 msgr2=0x7fe5c40a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c40a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 -- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 msgr2=0x7fe5c40a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 0x7fe5c40a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:20.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.901+0000 7fe5c888c700 1 -- 172.21.15.89:0/1640041846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009420 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5c888c700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009290 tx=0x7fe5b8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801e160 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b801e2c0 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc009a20 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801a450 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.902+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80094f0 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.903+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c404c710 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.903+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe5b801a840 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.903+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fe5b805c8e0 con 0x7fe5c406f630 2024-02-10T00:05:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:20.906+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fe5b8028450 con 0x7fe5c406f630 2024-02-10T00:05:21.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.087+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5c406f410 con 0x7fe5c406f630 2024-02-10T00:05:21.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.087+0000 7fe5c0ff9700 1 -- 172.21.15.89:0/1640041846 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3693 (secure 0 0 0) 0x7fe5b8023030 con 0x7fe5c406f630 2024-02-10T00:05:21.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:21.090 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6818/4191707170","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6818","nonce":4191707170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6817/78137582","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6817","nonce":78137582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-09T23:58:27.305555+0000","modified":"2024-02-10T00:05:14.225945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14565},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14565":{"gid":14565,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6819/1779314041","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6819","nonce":1779314041}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-02-10T00:05:21.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 >> v1:172.21.15.89:6816/47970 conn(0x7fe5a8046040 legacy=0x7fe5a80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:21.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 msgr2=0x7fe5c40a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:21.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009290 tx=0x7fe5b8017000 comp rx=0 tx=0).stop 2024-02-10T00:05:21.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 shutdown_connections 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c413a390 0x7fe5c40a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5c406f630 0x7fe5c40a9020 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 --2- 172.21.15.89:0/1640041846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fe5c40b18b0 0x7fe5c40a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 >> 172.21.15.89:0/1640041846 conn(0x7fe5c406a820 msgr2=0x7fe5c40aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 shutdown_connections 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:21.089+0000 7fe5caaf0700 1 -- 172.21.15.89:0/1640041846 wait complete. 2024-02-10T00:05:21.092 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2024-02-10T00:05:21.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-02-10T00:05:21.239 INFO:teuthology.orchestra.run.smithi089.stdout:[{"id":14209,"entity":{"name":{"type":"client","num":14209},"addr":{"type":"v1","addr":"172.21.15.89:0","nonce":3550812814}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":18.442596198,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.95918077589687278,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.14209 v1:172.21.15.89:0/3550812814","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"72ce7c1d1d5a2a1807db94c08aa742a26968c21f","ceph_version":"ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)","entity_id":"y","hostname":"smithi089","pid":"47970","root":"/"}},{"id":14220,"entity":{"name":{"type":"client","num":14220},"addr":{"type":"v1","addr":"172.21.15.89:0","nonce":2620796327}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":18.442596198,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.95918077589687278,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.14220 v1:172.21.15.89:0/2620796327","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"72ce7c1d1d5a2a1807db94c08aa742a26968c21f","ceph_version":"ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)","entity_id":"y","hostname":"smithi089","pid":"47970","root":"/"}}] 2024-02-10T00:05:21.240 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "72ce7c1d1d5a2a1807db94c08aa742a26968c21f", "ceph_version": "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "y", "hostname": "smithi089", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "47970", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.89:0", "nonce": 3550812814, "type": "v1" }, "name": { "num": 14209, "type": "client" } }, "id": 14209, "inst": "client.14209 v1:172.21.15.89:0/3550812814", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9591807758968728 }, "state": "open", "uptime": 18.442596198 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "72ce7c1d1d5a2a1807db94c08aa742a26968c21f", "ceph_version": "ceph version 17.2.7-505-g72ce7c1d (72ce7c1d1d5a2a1807db94c08aa742a26968c21f) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "y", "hostname": "smithi089", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "47970", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.89:0", "nonce": 2620796327, "type": "v1" }, "name": { "num": 14220, "type": "client" } }, "id": 14220, "inst": "client.14220 v1:172.21.15.89:0/2620796327", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9591807758968728 }, "state": "open", "uptime": 18.442596198 } ] 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-02-10T00:05:21.241 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.0")) 2024-02-10T00:05:21.242 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-02-10T00:05:21.337 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.0.37214.asok 2024-02-10T00:05:21.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-10T00:05:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-10T00:05:21.347 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37214.asok 2024-02-10T00:05:21.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:21.347 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37214.asok mds_sessions 2024-02-10T00:05:21.486 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-02-10T00:05:21.486 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4686, 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4686 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3331993086 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4686 v1:172.21.15.164:0/3331993086", 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "v1:172.21.15.164:0/3331993086", 2024-02-10T00:05:21.487 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions": [], 2024-02-10T00:05:21.488 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 22 2024-02-10T00:05:21.488 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-02-10T00:05:21.496 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.497 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-02-10T00:05:21.498 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-02-10T00:05:21.592 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.37237.asok 2024-02-10T00:05:21.595 INFO:teuthology.orchestra.run.smithi183.stderr:2024-02-10T00:05:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-10T00:05:21.602 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37237.asok 2024-02-10T00:05:21.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:21.602 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37237.asok mds_sessions 2024-02-10T00:05:21.741 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-02-10T00:05:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4520, 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4520 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "172.21.15.183:0", 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 432961506 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4520 v1:172.21.15.183:0/432961506", 2024-02-10T00:05:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "v1:172.21.15.183:0/432961506", 2024-02-10T00:05:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions": [], 2024-02-10T00:05:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "mdsmap_epoch": 22 2024-02-10T00:05:21.743 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-02-10T00:05:21.750 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-02-10T00:05:21.750 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-02-10T00:05:21.750 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-02-10T00:05:21.750 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-02-10T00:05:21.750 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-02-10T00:05:21.751 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.0")) 2024-02-10T00:05:21.752 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-02-10T00:05:21.835 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.0.37214.asok 2024-02-10T00:05:21.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-10T00:05:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-10T00:05:21.845 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37214.asok 2024-02-10T00:05:21.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:21.845 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37214.asok mds_sessions 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4686, 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-02-10T00:05:21.985 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4686 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3331993086 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-02-10T00:05:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4686 v1:172.21.15.164:0/3331993086", 2024-02-10T00:05:21.987 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "v1:172.21.15.164:0/3331993086", 2024-02-10T00:05:21.987 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions": [], 2024-02-10T00:05:21.987 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 22 2024-02-10T00:05:21.987 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-02-10T00:05:21.994 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-02-10T00:05:21.994 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-02-10T00:05:21.994 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-02-10T00:05:21.995 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-02-10T00:05:21.996 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-02-10T00:05:21.997 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-02-10T00:05:21.997 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-10T00:05:21.997 DEBUG:teuthology.orchestra.run.smithi183:> 2024-02-10T00:05:21.997 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-02-10T00:05:21.997 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-02-10T00:05:22.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.37237.asok 2024-02-10T00:05:22.087 INFO:teuthology.orchestra.run.smithi183.stderr:2024-02-10T00:05:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-10T00:05:22.094 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37237.asok 2024-02-10T00:05:22.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:22.094 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37237.asok mds_sessions 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4520, 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4520 2024-02-10T00:05:22.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "172.21.15.183:0", 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 432961506 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4520 v1:172.21.15.183:0/432961506", 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "v1:172.21.15.183:0/432961506", 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions": [], 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout: "mdsmap_epoch": 22 2024-02-10T00:05:22.233 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-02-10T00:05:22.240 INFO:tasks.fs:confirming client client.0 is blocklisted 2024-02-10T00:05:22.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.366+0000 7f343fc66700 1 Processor -- start 2024-02-10T00:05:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 -- start start 2024-02-10T00:05:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3438063c90 0x7f3438069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34380a72d0 0x7f343806a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3438145d10 con 0x7f34380afde0 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343806ff80 con 0x7f34380a72d0 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.367+0000 7f343fc66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438145f40 con 0x7f3438063c90 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34380a72d0 0x7f343806a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34380a72d0 0x7f343806a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58558/0 (socket says 172.21.15.89:58558) 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 -- 172.21.15.89:0/1442829154 learned_addr learned my addr 172.21.15.89:0/1442829154 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343da02700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3438063c90 0x7f3438069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 -- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3438063c90 msgr2=0x7f3438069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3438063c90 0x7f3438069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 -- 172.21.15.89:0/1442829154 >> v1:172.21.15.89:6789/0 conn(0x7f34380afde0 legacy=0x7f343806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343ca00700 1 -- 172.21.15.89:0/1442829154 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449396489 0 0) 0x7f3438145d10 con 0x7f34380afde0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 -- 172.21.15.89:0/1442829154 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438146200 con 0x7f34380a72d0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343d201700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f343806a330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34340099b0 tx=0x7f3434009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ef48606b37b640 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343ca00700 1 -- 172.21.15.89:0/1442829154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434009ea0 con 0x7f34380a72d0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343ca00700 1 -- 172.21.15.89:0/1442829154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400b860 con 0x7f34380a72d0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.368+0000 7f343ca00700 1 -- 172.21.15.89:0/1442829154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400bc00 con 0x7f34380a72d0 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 -- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 msgr2=0x7f343806a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f343806a330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34340099b0 tx=0x7f3434009250 comp rx=0 tx=0).stop 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 -- 172.21.15.89:0/1442829154 shutdown_connections 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3438063c90 0x7f3438069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 --2- 172.21.15.89:0/1442829154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f343806a330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 -- 172.21.15.89:0/1442829154 >> 172.21.15.89:0/1442829154 conn(0x7f343806d8c0 msgr2=0x7f3438063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 -- 172.21.15.89:0/1442829154 shutdown_connections 2024-02-10T00:05:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.369+0000 7f343fc66700 1 -- 172.21.15.89:0/1442829154 wait complete. 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.370+0000 7f343fc66700 1 Processor -- start 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.370+0000 7f343fc66700 1 -- start start 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f34380b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 0x7f34380b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380a92a0 con 0x7f34380a72d0 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380a9560 con 0x7f34380afde0 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343fc66700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34380af950 con 0x7f3438063c90 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343e203700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 0x7f34380b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45680/0 (socket says 172.21.15.89:45680) 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 -- 172.21.15.89:0/2629602307 learned_addr learned my addr 172.21.15.89:0/2629602307 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343d201700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f34380b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 -- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 msgr2=0x7f34380b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 0x7f34380b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 -- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 msgr2=0x7f34380b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f34380b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 -- 172.21.15.89:0/2629602307 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340094f0 con 0x7f3438063c90 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343e203700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 0x7f34380b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343d201700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f34380b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.371+0000 7f343da02700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f342800ec80 tx=0x7f34280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.372+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800c850 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.372+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342800c9b0 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.372+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800cd50 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.372+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34380ab030 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.372+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343813edf0 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.373+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34380afc20 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.373+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3428013680 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.373+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f342805b480 con 0x7f3438063c90 2024-02-10T00:05:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.377+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3428039640 con 0x7f3438063c90 2024-02-10T00:05:22.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.535+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343804c710 con 0x7f3438063c90 2024-02-10T00:05:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.536+0000 7f342dffb700 1 -- 172.21.15.89:0/2629602307 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f342803ce30 con 0x7f3438063c90 2024-02-10T00:05:22.538 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:22.538 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 >> v1:172.21.15.89:6816/47970 conn(0x7f341c046070 legacy=0x7f341c048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 msgr2=0x7f34380a8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f342800ec80 tx=0x7f34280091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 shutdown_connections 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34380afde0 0x7f34380b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.537+0000 7f343fc66700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3438063c90 0x7f34380a8be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.538+0000 7f343fc66700 1 --2- 172.21.15.89:0/2629602307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34380a72d0 0x7f34380b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.538+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 >> 172.21.15.89:0/2629602307 conn(0x7f343806d8c0 msgr2=0x7f3438142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.538+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 shutdown_connections 2024-02-10T00:05:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.538+0000 7f343fc66700 1 -- 172.21.15.89:0/2629602307 wait complete. 2024-02-10T00:05:22.552 INFO:tasks.fs:confirming client client.1 is blocklisted 2024-02-10T00:05:22.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:22.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.666+0000 7fb6cfa42700 1 Processor -- start 2024-02-10T00:05:22.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 -- start start 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c8063740 0x7fb6c806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c80a1130 con 0x7fb6c806d260 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80a28c0 con 0x7fb6c8063740 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cfa42700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8063b10 con 0x7fb6c806ce70 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cdfdf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45696/0 (socket says 172.21.15.89:45696) 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3767469049 learned_addr learned my addr 172.21.15.89:0/3767469049 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:22.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cdfdf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58570/0 (socket says 172.21.15.89:58570) 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6cd7de700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c8063740 0x7fb6c806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c8063740 msgr2=0x7fb6c806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c8063740 0x7fb6c806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3767469049 >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 msgr2=0x7fb6c8142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.667+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3767469049 >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3767469049 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c81428c0 con 0x7fb6c806ce70 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cdfdf700 1 --2- 172.21.15.89:0/3767469049 >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40099b0 tx=0x7fb6c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64333f2c302575be server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6bffff700 1 -- 172.21.15.89:0/3767469049 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400b680 con 0x7fb6c806ce70 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6bffff700 1 -- 172.21.15.89:0/3767469049 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400b7e0 con 0x7fb6c806ce70 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6bffff700 1 -- 172.21.15.89:0/3767469049 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400bb80 con 0x7fb6c806ce70 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 msgr2=0x7fb6c8141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40099b0 tx=0x7fb6c4009250 comp rx=0 tx=0).stop 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3767469049 shutdown_connections 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3767469049 >> v2:172.21.15.89:3300/0 conn(0x7fb6c806d260 0x7fb6c8142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c8063740 0x7fb6c806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3767469049 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806ce70 0x7fb6c8141e40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.668+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3767469049 >> 172.21.15.89:0/3767469049 conn(0x7fb6c806a820 msgr2=0x7fb6c80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.669+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3767469049 shutdown_connections 2024-02-10T00:05:22.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.669+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3767469049 wait complete. 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.669+0000 7fb6cfa42700 1 Processor -- start 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.669+0000 7fb6cfa42700 1 -- start start 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 0x7fb6c809a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806d260 0x7fb6c8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:22.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8099540 con 0x7fb6c8063740 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80985a0 con 0x7fb6c806ce70 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cfa42700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80a0bc0 con 0x7fb6c806d260 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cd7de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 0x7fb6c809a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cdfdf700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806d260 0x7fb6c8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32970/0 (socket says 172.21.15.89:32970) 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3451090280 learned_addr learned my addr 172.21.15.89:0/3451090280 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6cd7de700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 0x7fb6c809a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58578/0 (socket says 172.21.15.89:58578) 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806d260 msgr2=0x7fb6c8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806d260 0x7fb6c8151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 msgr2=0x7fb6c809a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 0x7fb6c809a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.670+0000 7fb6ccfdd700 1 -- 172.21.15.89:0/3451090280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009a20 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6ccfdd700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40099b0 tx=0x7fb6c4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400b950 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400bab0 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c40094f0 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c401a660 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.671+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c8099720 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.672+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fb6c401aa90 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.672+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c804c710 con 0x7fb6c806ce70 2024-02-10T00:05:22.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.672+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fb6c405cd00 con 0x7fb6c806ce70 2024-02-10T00:05:22.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.676+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fb6c402fff0 con 0x7fb6c806ce70 2024-02-10T00:05:22.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.830+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6c80b0110 con 0x7fb6c806ce70 2024-02-10T00:05:22.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.830+0000 7fb6bd7fa700 1 -- 172.21.15.89:0/3451090280 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7fb6c4015070 con 0x7fb6c806ce70 2024-02-10T00:05:22.833 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:22.833 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 >> v1:172.21.15.89:6816/47970 conn(0x7fb6ac046040 legacy=0x7fb6ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 msgr2=0x7fb6c8097ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40099b0 tx=0x7fb6c4017000 comp rx=0 tx=0).stop 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 shutdown_connections 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb6c806d260 0x7fb6c8151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6c8063740 0x7fb6c809a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 --2- 172.21.15.89:0/3451090280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6c806ce70 0x7fb6c8097ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 >> 172.21.15.89:0/3451090280 conn(0x7fb6c806a820 msgr2=0x7fb6c8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 shutdown_connections 2024-02-10T00:05:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:22.832+0000 7fb6cfa42700 1 -- 172.21.15.89:0/3451090280 wait complete. 2024-02-10T00:05:22.849 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-02-10T00:05:22.977 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2024-02-10T00:05:22.992 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-02-10T00:05:23.011 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-02-10T00:05:23.024 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-02-10T00:05:23.042 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-10T00:05:23.082 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-10T00:05:23.082 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-10T00:05:23.082 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-10T00:05:23.105 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-10T00:05:23.105 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-10T00:05:23.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:23.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.285+0000 7f2fcff2b700 1 Processor -- start 2024-02-10T00:05:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.285+0000 7f2fcff2b700 1 -- start start 2024-02-10T00:05:23.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcff2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcff2b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fc80a5a70 0x7f2fc81458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcff2b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80a62d0 con 0x7f2fc80a5660 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcff2b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc8064220 con 0x7f2fc80a5a70 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcff2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80a67f0 con 0x7f2fc8063e50 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcdcc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fc80a5a70 0x7f2fc81458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcdcc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32972/0 (socket says 172.21.15.89:32972) 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fc80a5a70 0x7f2fc81458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58590/0 (socket says 172.21.15.89:58590) 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcdcc7700 1 -- 172.21.15.89:0/2326395588 learned_addr learned my addr 172.21.15.89:0/2326395588 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcd4c6700 1 --1- 172.21.15.89:0/2326395588 >> v1:172.21.15.89:6789/0 conn(0x7f2fc80a5660 0x7f2fc813b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57882/0 (socket says 172.21.15.89:57882) 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 -- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 msgr2=0x7f2fc80a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 -- 172.21.15.89:0/2326395588 >> v1:172.21.15.89:6789/0 conn(0x7f2fc80a5660 legacy=0x7f2fc813b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 -- 172.21.15.89:0/2326395588 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80a7510 con 0x7f2fc80a5a70 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fcdcc7700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.286+0000 7f2fce4c8700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5a70 0x7f2fc81458e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009e90 tx=0x7f2fc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4f8c07e3a8fe31 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcccc5700 1 -- 172.21.15.89:0/2326395588 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000e070 con 0x7f2fc80a5a70 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcccc5700 1 -- 172.21.15.89:0/2326395588 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000bbf0 con 0x7f2fc80a5a70 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcccc5700 1 -- 172.21.15.89:0/2326395588 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0012430 con 0x7f2fc80a5a70 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5a70 msgr2=0x7f2fc81458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5a70 0x7f2fc81458e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009e90 tx=0x7f2fc0009780 comp rx=0 tx=0).stop 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2326395588 shutdown_connections 2024-02-10T00:05:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5a70 0x7f2fc81458e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2326395588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2326395588 >> 172.21.15.89:0/2326395588 conn(0x7f2fc806c7c0 msgr2=0x7f2fc8063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2326395588 shutdown_connections 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.287+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2326395588 wait complete. 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.288+0000 7f2fcff2b700 1 Processor -- start 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.288+0000 7f2fcff2b700 1 -- start start 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 0x7f2fc814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fc80a5a70 0x7f2fc814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80ab930 con 0x7f2fc80a5660 2024-02-10T00:05:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80a9ea0 con 0x7f2fc8063e50 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80ac060 con 0x7f2fc80a5a70 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32974/0 (socket says 172.21.15.89:32974) 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 -- 172.21.15.89:0/2722559488 learned_addr learned my addr 172.21.15.89:0/2722559488 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcd4c6700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 0x7f2fc814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fce4c8700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fc80a5a70 0x7f2fc814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 -- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fc80a5a70 msgr2=0x7f2fc814d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fc80a5a70 0x7f2fc814d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 -- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 msgr2=0x7f2fc814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 0x7f2fc814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 -- 172.21.15.89:0/2722559488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094f0 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcd4c6700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 0x7f2fc814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcdcc7700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ec50 tx=0x7f2fb8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800c850 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800c9b0 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0009a20 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.289+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800cd30 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.290+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc80ac4a0 con 0x7f2fc8063e50 2024-02-10T00:05:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.291+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80ac1a0 con 0x7f2fc8063e50 2024-02-10T00:05:23.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.291+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2fb8013680 con 0x7f2fc8063e50 2024-02-10T00:05:23.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.291+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f2fb805b840 con 0x7f2fc8063e50 2024-02-10T00:05:23.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.294+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f2fb8039b70 con 0x7f2fc8063e50 2024-02-10T00:05:23.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.449+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc804c710 con 0x7f2fc8063e50 2024-02-10T00:05:23.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.450+0000 7f2fbdffb700 1 -- 172.21.15.89:0/2722559488 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f2fb803d190 con 0x7f2fc8063e50 2024-02-10T00:05:23.452 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:23.452 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.451+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 >> v1:172.21.15.89:6816/47970 conn(0x7f2fac046040 legacy=0x7f2fac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 msgr2=0x7f2fc80a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ec50 tx=0x7f2fb8009250 comp rx=0 tx=0).stop 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 shutdown_connections 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fc80a5a70 0x7f2fc814d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc8063e50 0x7f2fc80a9960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 --2- 172.21.15.89:0/2722559488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc80a5660 0x7f2fc814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 >> 172.21.15.89:0/2722559488 conn(0x7f2fc806c7c0 msgr2=0x7f2fc80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:23.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 shutdown_connections 2024-02-10T00:05:23.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.452+0000 7f2fcff2b700 1 -- 172.21.15.89:0/2722559488 wait complete. 2024-02-10T00:05:23.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:05:23.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:05:23.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.585+0000 7f43641c8700 1 Processor -- start 2024-02-10T00:05:23.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.585+0000 7f43641c8700 1 -- start start 2024-02-10T00:05:23.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f43641c8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 0x7f435c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f43641c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 0x7f435c1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f43641c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c06f3e0 con 0x7f435c06cd20 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f43641c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c06f680 con 0x7f435c0a1d10 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f43641c8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435c06d860 con 0x7f435c063580 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4361f64700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 0x7f435c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 0x7f435c1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4361763700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f435c06cd20 0x7f435c0a1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57892/0 (socket says 172.21.15.89:57892) 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4361763700 1 -- 172.21.15.89:0/741497438 learned_addr learned my addr 172.21.15.89:0/741497438 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 -- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 msgr2=0x7f435c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 0x7f435c06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4360f62700 1 -- 172.21.15.89:0/741497438 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875573240 0 0) 0x7f435c06f3e0 con 0x7f435c06cd20 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 -- 172.21.15.89:0/741497438 >> v1:172.21.15.89:6789/0 conn(0x7f435c06cd20 legacy=0x7f435c0a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 -- 172.21.15.89:0/741497438 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c06ec50 con 0x7f435c0a1d10 2024-02-10T00:05:23.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4361f64700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 0x7f435c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4362765700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 0x7f435c1498c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e90 tx=0x7f4354009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467ab50c2a1ec85c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4360f62700 1 -- 172.21.15.89:0/741497438 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400e070 con 0x7f435c0a1d10 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4360f62700 1 -- 172.21.15.89:0/741497438 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400bc30 con 0x7f435c0a1d10 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.586+0000 7f4360f62700 1 -- 172.21.15.89:0/741497438 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354012430 con 0x7f435c0a1d10 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 -- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 msgr2=0x7f435c1498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 0x7f435c1498c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e90 tx=0x7f4354009780 comp rx=0 tx=0).stop 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 -- 172.21.15.89:0/741497438 shutdown_connections 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c0a1d10 0x7f435c1498c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 --2- 172.21.15.89:0/741497438 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c063580 0x7f435c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 -- 172.21.15.89:0/741497438 >> 172.21.15.89:0/741497438 conn(0x7f435c06a910 msgr2=0x7f435c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 -- 172.21.15.89:0/741497438 shutdown_connections 2024-02-10T00:05:23.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.587+0000 7f43641c8700 1 -- 172.21.15.89:0/741497438 wait complete. 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 Processor -- start 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 -- start start 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 0x7f435c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c0a1d10 0x7f435c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c097f70 con 0x7f435c063580 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c09b770 con 0x7f435c06cd20 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f43641c8700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435c09c930 con 0x7f435c0a1d10 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f4361f64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f4361763700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 0x7f435c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f4361f64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58602/0 (socket says 172.21.15.89:58602) 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f4361f64700 1 -- 172.21.15.89:0/3798372584 learned_addr learned my addr 172.21.15.89:0/3798372584 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.588+0000 7f4362765700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c0a1d10 0x7f435c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 -- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c0a1d10 msgr2=0x7f435c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c0a1d10 0x7f435c151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 -- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 msgr2=0x7f435c09ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 -- 172.21.15.89:0/3798372584 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358009420 con 0x7f435c06cd20 2024-02-10T00:05:23.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361f64700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4361763700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 0x7f435c151240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f434c0011e0 tx=0x7f434c007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c005b30 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c005cb0 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c007320 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4354009a20 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.589+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c09d600 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.590+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f434c012400 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.590+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c0aea40 con 0x7f435c06cd20 2024-02-10T00:05:23.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.591+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f434c05a5b0 con 0x7f435c06cd20 2024-02-10T00:05:23.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.594+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f434c038710 con 0x7f435c06cd20 2024-02-10T00:05:23.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.747+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f435c04c710 con 0x7f435c06cd20 2024-02-10T00:05:23.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.747+0000 7f4351ffb700 1 -- 172.21.15.89:0/3798372584 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f434c017030 con 0x7f435c06cd20 2024-02-10T00:05:23.749 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:05:23.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 >> v1:172.21.15.89:6816/47970 conn(0x7f4340046040 legacy=0x7f43400484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 msgr2=0x7f435c151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 0x7f435c151240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f434c0011e0 tx=0x7f434c007d10 comp rx=0 tx=0).stop 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 shutdown_connections 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f435c0a1d10 0x7f435c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f435c063580 0x7f435c09ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 --2- 172.21.15.89:0/3798372584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f435c06cd20 0x7f435c151240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 >> 172.21.15.89:0/3798372584 conn(0x7f435c06a910 msgr2=0x7f435c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 shutdown_connections 2024-02-10T00:05:23.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.749+0000 7f43641c8700 1 -- 172.21.15.89:0/3798372584 wait complete. 2024-02-10T00:05:23.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:05:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.880+0000 7ff09a99f700 1 Processor -- start 2024-02-10T00:05:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.880+0000 7ff09a99f700 1 -- start start 2024-02-10T00:05:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff09a99f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff09a99f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff09a99f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09406f3e0 con 0x7ff0940a1b40 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff09a99f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406f680 con 0x7ff094063580 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff09a99f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406d860 con 0x7ff09406cd20 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff093fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45744/0 (socket says 172.21.15.89:45744) 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff093fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:32988/0 (socket says 172.21.15.89:32988) 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 -- 172.21.15.89:0/1990703768 learned_addr learned my addr 172.21.15.89:0/1990703768 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff098f3c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff0940a1b40 0x7ff0941488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57904/0 (socket says 172.21.15.89:57904) 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff092ffd700 1 -- 172.21.15.89:0/1990703768 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352480201 0 0) 0x7ff09406f3e0 con 0x7ff0940a1b40 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff092ffd700 1 -- 172.21.15.89:0/1990703768 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c003570 con 0x7ff0940a1b40 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 -- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 msgr2=0x7ff09406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 -- 172.21.15.89:0/1990703768 >> v1:172.21.15.89:6789/0 conn(0x7ff0940a1b40 legacy=0x7ff0941488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff0937fe700 1 -- 172.21.15.89:0/1990703768 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09406ec50 con 0x7ff09406cd20 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.881+0000 7ff093fff700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff0937fe700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0840099e0 tx=0x7ff084009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a6c1cacd62504c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff092ffd700 1 -- 172.21.15.89:0/1990703768 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400b680 con 0x7ff09406cd20 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff092ffd700 1 -- 172.21.15.89:0/1990703768 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400b7e0 con 0x7ff09406cd20 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff092ffd700 1 -- 172.21.15.89:0/1990703768 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400bb80 con 0x7ff09406cd20 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 -- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 msgr2=0x7ff0940a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0840099e0 tx=0x7ff084009250 comp rx=0 tx=0).stop 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 -- 172.21.15.89:0/1990703768 shutdown_connections 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff09406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1990703768 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff0940a1600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 -- 172.21.15.89:0/1990703768 >> 172.21.15.89:0/1990703768 conn(0x7ff09406a910 msgr2=0x7ff0940b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:23.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 -- 172.21.15.89:0/1990703768 shutdown_connections 2024-02-10T00:05:23.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.882+0000 7ff09a99f700 1 -- 172.21.15.89:0/1990703768 wait complete. 2024-02-10T00:05:23.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.883+0000 7ff09a99f700 1 Processor -- start 2024-02-10T00:05:23.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.883+0000 7ff09a99f700 1 -- start start 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff094097ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0940a1b40 0x7ff0941510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940aad00 con 0x7ff0940a1b40 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094098500 con 0x7ff094063580 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff09a99f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff094097140 con 0x7ff09406cd20 2024-02-10T00:05:23.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff098f3c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0940a1b40 0x7ff0941510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45750/0 (socket says 172.21.15.89:45750) 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 -- 172.21.15.89:0/1408069527 learned_addr learned my addr 172.21.15.89:0/1408069527 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff093fff700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff094097ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 -- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 msgr2=0x7ff094097ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff094097ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 -- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0940a1b40 msgr2=0x7ff0941510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0940a1b40 0x7ff0941510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 -- 172.21.15.89:0/1408069527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009420 con 0x7ff09406cd20 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.884+0000 7ff0937fe700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff084009290 tx=0x7ff084017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084002f90 con 0x7ff09406cd20 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400b950 con 0x7ff09406cd20 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840094f0 con 0x7ff09406cd20 2024-02-10T00:05:23.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08401a430 con 0x7ff09406cd20 2024-02-10T00:05:23.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0940a0a90 con 0x7ff09406cd20 2024-02-10T00:05:23.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09404c710 con 0x7ff09406cd20 2024-02-10T00:05:23.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.885+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ff08401a7e0 con 0x7ff09406cd20 2024-02-10T00:05:23.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.886+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7ff08405cc90 con 0x7ff09406cd20 2024-02-10T00:05:23.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:23.889+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ff084002d70 con 0x7ff09406cd20 2024-02-10T00:05:24.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.042+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0940a2ac0 con 0x7ff09406cd20 2024-02-10T00:05:24.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.042+0000 7ff07bfff700 1 -- 172.21.15.89:0/1408069527 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff08402f3f0 con 0x7ff09406cd20 2024-02-10T00:05:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 >> v1:172.21.15.89:6816/47970 conn(0x7ff080046040 legacy=0x7ff0800484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 msgr2=0x7ff094096c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff084009290 tx=0x7ff084017000 comp rx=0 tx=0).stop 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 shutdown_connections 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0940a1b40 0x7ff0941510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff094063580 0x7ff094097ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 --2- 172.21.15.89:0/1408069527 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff09406cd20 0x7ff094096c00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 >> 172.21.15.89:0/1408069527 conn(0x7ff09406a910 msgr2=0x7ff094143b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 shutdown_connections 2024-02-10T00:05:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.044+0000 7ff09a99f700 1 -- 172.21.15.89:0/1408069527 wait complete. 2024-02-10T00:05:24.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 Processor -- start 2024-02-10T00:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 -- start start 2024-02-10T00:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a53e0 0x7fd9b413edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b40b2410 con 0x7fd9b406d430 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40a7050 con 0x7fd9b40a53e0 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b9b90700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40a57b0 con 0x7fd9b40b2040 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b2ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a53e0 0x7fd9b413edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b2ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a53e0 0x7fd9b413edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58624/0 (socket says 172.21.15.89:58624) 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b3fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd9b406d430 0x7fd9b406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57914/0 (socket says 172.21.15.89:57914) 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b37fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45762/0 (socket says 172.21.15.89:45762) 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.175+0000 7fd9b2ffd700 1 -- 172.21.15.89:0/1437509971 learned_addr learned my addr 172.21.15.89:0/1437509971 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b2ffd700 1 -- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 msgr2=0x7fd9b40a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b2ffd700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b2ffd700 1 -- 172.21.15.89:0/1437509971 >> v1:172.21.15.89:6789/0 conn(0x7fd9b406d430 legacy=0x7fd9b406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b2ffd700 1 -- 172.21.15.89:0/1437509971 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b413e750 con 0x7fd9b40a53e0 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b27fc700 1 -- 172.21.15.89:0/1437509971 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358383534 0 0) 0x7fd9b40b2410 con 0x7fd9b406d430 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b37fe700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b2ffd700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a53e0 0x7fd9b413edd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40099b0 tx=0x7fd9a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bfc3d656a6bc02 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b27fc700 1 -- 172.21.15.89:0/1437509971 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4009ea0 con 0x7fd9b40a53e0 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b27fc700 1 -- 172.21.15.89:0/1437509971 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400b8f0 con 0x7fd9b40a53e0 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b27fc700 1 -- 172.21.15.89:0/1437509971 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400bc90 con 0x7fd9b40a53e0 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 -- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a53e0 msgr2=0x7fd9b413edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a53e0 0x7fd9b413edd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40099b0 tx=0x7fd9a4009250 comp rx=0 tx=0).stop 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 -- 172.21.15.89:0/1437509971 shutdown_connections 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/1437509971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a53e0 0x7fd9b413edd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.176+0000 7fd9b9b90700 1 -- 172.21.15.89:0/1437509971 >> 172.21.15.89:0/1437509971 conn(0x7fd9b406fd50 msgr2=0x7fd9b406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.177+0000 7fd9b9b90700 1 -- 172.21.15.89:0/1437509971 shutdown_connections 2024-02-10T00:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.177+0000 7fd9b9b90700 1 -- 172.21.15.89:0/1437509971 wait complete. 2024-02-10T00:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 Processor -- start 2024-02-10T00:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 -- start start 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 0x7fd9b414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40aebc0 con 0x7fd9b406d430 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b4097e00 con 0x7fd9b40a53e0 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b9b90700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40ad620 con 0x7fd9b40b2040 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 0x7fd9b414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 0x7fd9b414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:33004/0 (socket says 172.21.15.89:33004) 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58636/0 (socket says 172.21.15.89:58636) 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b3fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:45774/0 (socket says 172.21.15.89:45774) 2024-02-10T00:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.178+0000 7fd9b2ffd700 1 -- 172.21.15.89:0/2710974634 learned_addr learned my addr 172.21.15.89:0/2710974634 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 -- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 msgr2=0x7fd9b414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 0x7fd9b414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 -- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 msgr2=0x7fd9b40978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 -- 172.21.15.89:0/2710974634 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8009420 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b37fe700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b3fff700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00cc90 tx=0x7fd9ac001a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac005df0 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00a6a0 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40094f0 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00aa60 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.179+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b4096a70 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.180+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b4097210 con 0x7fd9b40b2040 2024-02-10T00:05:24.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.180+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fd9ac0070f0 con 0x7fd9b40b2040 2024-02-10T00:05:24.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.180+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fd9ac05b190 con 0x7fd9b40b2040 2024-02-10T00:05:24.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.184+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd9ac039370 con 0x7fd9b40b2040 2024-02-10T00:05:24.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.337+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9b40ae530 con 0x7fd9b40b2040 2024-02-10T00:05:24.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.337+0000 7fd99b7fe700 1 -- 172.21.15.89:0/2710974634 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9ac03cb60 con 0x7fd9b40b2040 2024-02-10T00:05:24.339 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 >> v1:172.21.15.89:6816/47970 conn(0x7fd9a0046040 legacy=0x7fd9a00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 msgr2=0x7fd9b40aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00cc90 tx=0x7fd9ac001a60 comp rx=0 tx=0).stop 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 shutdown_connections 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd9b40b2040 0x7fd9b40aee40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b406d430 0x7fd9b40978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 --2- 172.21.15.89:0/2710974634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b40a53e0 0x7fd9b414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 >> 172.21.15.89:0/2710974634 conn(0x7fd9b406fd50 msgr2=0x7fd9b413eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 shutdown_connections 2024-02-10T00:05:24.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.339+0000 7fd9b9b90700 1 -- 172.21.15.89:0/2710974634 wait complete. 2024-02-10T00:05:24.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:05:24.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.471+0000 7fecc7dce700 1 Processor -- start 2024-02-10T00:05:24.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.471+0000 7fecc7dce700 1 -- start start 2024-02-10T00:05:24.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc7dce700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc0068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc7dce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc01495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc7dce700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc006ed50 con 0x7fecc006e980 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc7dce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00aa290 con 0x7fecc01471d0 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc7dce700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00aab40 con 0x7fecc00b1f50 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc0068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc636b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc01495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5b6a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fecc006e980 0x7fecc0067970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51660/0 (socket says 172.21.15.89:51660) 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5b6a700 1 -- 172.21.15.89:0/4184003027 learned_addr learned my addr 172.21.15.89:0/4184003027 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc4b68700 1 -- 172.21.15.89:0/4184003027 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823191390 0 0) 0x7fecc006ed50 con 0x7fecc006e980 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 -- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 msgr2=0x7fecc01495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc01495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 -- 172.21.15.89:0/4184003027 >> v1:172.21.15.89:6789/0 conn(0x7fecc006e980 legacy=0x7fecc0067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 -- 172.21.15.89:0/4184003027 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00aade0 con 0x7fecc00b1f50 2024-02-10T00:05:24.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc636b700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc01495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc5369700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc0068080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009910 tx=0x7fecbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c695c6c50c05a022 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc4b68700 1 -- 172.21.15.89:0/4184003027 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00b710 con 0x7fecc00b1f50 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc4b68700 1 -- 172.21.15.89:0/4184003027 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00b870 con 0x7fecc00b1f50 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.472+0000 7fecc4b68700 1 -- 172.21.15.89:0/4184003027 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00bc30 con 0x7fecc00b1f50 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 -- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 msgr2=0x7fecc0068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc0068080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009910 tx=0x7fecbc0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 -- 172.21.15.89:0/4184003027 shutdown_connections 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc01495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 --2- 172.21.15.89:0/4184003027 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc0068080 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 -- 172.21.15.89:0/4184003027 >> 172.21.15.89:0/4184003027 conn(0x7fecc006fd50 msgr2=0x7fecc006c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 -- 172.21.15.89:0/4184003027 shutdown_connections 2024-02-10T00:05:24.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.473+0000 7fecc7dce700 1 -- 172.21.15.89:0/4184003027 wait complete. 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 Processor -- start 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 -- start start 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc01518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc0142520 con 0x7fecc006e980 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00984b0 con 0x7fecc01471d0 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc7dce700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00a3b40 con 0x7fecc00b1f50 2024-02-10T00:05:24.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.474+0000 7fecc5b6a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60150/0 (socket says 172.21.15.89:60150) 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 -- 172.21.15.89:0/2769336947 learned_addr learned my addr 172.21.15.89:0/2769336947 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5369700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc01518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc636b700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 -- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 msgr2=0x7fecc01518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc01518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 -- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 msgr2=0x7fecc0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc0151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 -- 172.21.15.89:0/2769336947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8009a20 con 0x7fecc006e980 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc5b6a700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c810 tx=0x7fecb0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0005c00 con 0x7fecc006e980 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0005d60 con 0x7fecc006e980 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc009420 con 0x7fecc006e980 2024-02-10T00:05:24.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007320 con 0x7fecc006e980 2024-02-10T00:05:24.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.475+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc00ac400 con 0x7fecc006e980 2024-02-10T00:05:24.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.476+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fecb001b3b0 con 0x7fecc006e980 2024-02-10T00:05:24.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.476+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc00ad160 con 0x7fecc006e980 2024-02-10T00:05:24.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.476+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fecb005a6e0 con 0x7fecc006e980 2024-02-10T00:05:24.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.480+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fecb0038900 con 0x7fecc006e980 2024-02-10T00:05:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.631+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecc004c710 con 0x7fecc006e980 2024-02-10T00:05:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.631+0000 7fecb5ffb700 1 -- 172.21.15.89:0/2769336947 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecb0017070 con 0x7fecc006e980 2024-02-10T00:05:24.634 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 >> v1:172.21.15.89:6816/47970 conn(0x7feca4046040 legacy=0x7feca40484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 msgr2=0x7fecc0097dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c810 tx=0x7fecb0007d90 comp rx=0 tx=0).stop 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 shutdown_connections 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc01471d0 0x7fecc0151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc006e980 0x7fecc0097dd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 --2- 172.21.15.89:0/2769336947 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fecc00b1f50 0x7fecc01518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 >> 172.21.15.89:0/2769336947 conn(0x7fecc006fd50 msgr2=0x7fecc0143e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 shutdown_connections 2024-02-10T00:05:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.633+0000 7fecc7dce700 1 -- 172.21.15.89:0/2769336947 wait complete. 2024-02-10T00:05:24.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-10T00:05:24.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.761+0000 7fa17b55c700 1 Processor -- start 2024-02-10T00:05:24.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 -- start start 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740a62d0 con 0x7fa1740a5a70 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa174064220 con 0x7fa1740a5660 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa17b55c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740a67f0 con 0x7fa174063e50 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa178af7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa1792f8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa178af7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60156/0 (socket says 172.21.15.89:60156) 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa179af9700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa1740a5a70 0x7fa17406d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51674/0 (socket says 172.21.15.89:51674) 2024-02-10T00:05:24.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa1792f8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57182/0 (socket says 172.21.15.89:57182) 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa179af9700 1 -- 172.21.15.89:0/4083371280 learned_addr learned my addr 172.21.15.89:0/4083371280 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.762+0000 7fa1792f8700 1 -- 172.21.15.89:0/4083371280 >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 msgr2=0x7fa17413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa1792f8700 1 --2- 172.21.15.89:0/4083371280 >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa1792f8700 1 -- 172.21.15.89:0/4083371280 >> v1:172.21.15.89:6789/0 conn(0x7fa1740a5a70 legacy=0x7fa17406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa1792f8700 1 -- 172.21.15.89:0/4083371280 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740a7510 con 0x7fa174063e50 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa16bfff700 1 -- 172.21.15.89:0/4083371280 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401660682 0 0) 0x7fa1740a62d0 con 0x7fa1740a5a70 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa178af7700 1 --2- 172.21.15.89:0/4083371280 >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa1792f8700 1 --2- 172.21.15.89:0/4083371280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa164009910 tx=0x7fa1640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3f84764125ffe4 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa16bfff700 1 -- 172.21.15.89:0/4083371280 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400b640 con 0x7fa174063e50 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa16bfff700 1 -- 172.21.15.89:0/4083371280 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16400b7a0 con 0x7fa174063e50 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa16bfff700 1 -- 172.21.15.89:0/4083371280 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400bb60 con 0x7fa174063e50 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 -- 172.21.15.89:0/4083371280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 msgr2=0x7fa1740a6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 --2- 172.21.15.89:0/4083371280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa164009910 tx=0x7fa1640091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 -- 172.21.15.89:0/4083371280 shutdown_connections 2024-02-10T00:05:24.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 --2- 172.21.15.89:0/4083371280 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa174063e50 0x7fa1740a6fd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 --2- 172.21.15.89:0/4083371280 >> v2:172.21.15.89:3300/0 conn(0x7fa1740a5660 0x7fa17413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 -- 172.21.15.89:0/4083371280 >> 172.21.15.89:0/4083371280 conn(0x7fa17406c7c0 msgr2=0x7fa174063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 -- 172.21.15.89:0/4083371280 shutdown_connections 2024-02-10T00:05:24.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.763+0000 7fa17b55c700 1 -- 172.21.15.89:0/4083371280 wait complete. 2024-02-10T00:05:24.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.764+0000 7fa17b55c700 1 Processor -- start 2024-02-10T00:05:24.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.764+0000 7fa17b55c700 1 -- start start 2024-02-10T00:05:24.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa174063e50 0x7fa1740ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740ad220 con 0x7fa1740a5660 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740ae140 con 0x7fa174063e50 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa17b55c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740ae420 con 0x7fa1740a5a70 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa179af9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60164/0 (socket says 172.21.15.89:60164) 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 -- 172.21.15.89:0/3385851754 learned_addr learned my addr 172.21.15.89:0/3385851754 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa179af9700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57194/0 (socket says 172.21.15.89:57194) 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa1792f8700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa174063e50 0x7fa1740ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 -- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 msgr2=0x7fa17414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 -- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa174063e50 msgr2=0x7fa1740ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa174063e50 0x7fa1740ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa178af7700 1 -- 172.21.15.89:0/3385851754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170009420 con 0x7fa1740a5660 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.765+0000 7fa179af9700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa178af7700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ec50 tx=0x7fa1700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000c850 con 0x7fa1740a5660 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17000c9b0 con 0x7fa1740a5660 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa164009420 con 0x7fa1740a5660 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000cd50 con 0x7fa1740a5660 2024-02-10T00:05:24.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.766+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174096a70 con 0x7fa1740a5660 2024-02-10T00:05:24.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.767+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1740ac570 con 0x7fa1740a5660 2024-02-10T00:05:24.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.767+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa170013680 con 0x7fa1740a5660 2024-02-10T00:05:24.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.767+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fa17005b490 con 0x7fa1740a5660 2024-02-10T00:05:24.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.771+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fa1740ac570 con 0x7fa1740a5660 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.935+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1740ac570 con 0x7fa1740a5660 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.936+0000 7fa1697fa700 1 -- 172.21.15.89:0/3385851754 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 7 entries v41) v1 ==== 80+0+408 (secure 0 0 0) 0x7fa1740ac570 con 0x7fa1740a5660 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2640344124 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3039776512 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3978228942 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.183:0/432961506 2024-02-10T01:05:14.231601+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.164:0/3331993086 2024-02-10T01:05:14.231318+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6816/39389 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:24.938 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6819/3416328937 2024-02-11T00:04:56.564529+0000 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 >> v1:172.21.15.89:6816/47970 conn(0x7fa158046040 legacy=0x7fa1580484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 msgr2=0x7fa1740ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ec50 tx=0x7fa1700091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 shutdown_connections 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fa1740a5a70 0x7fa17414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa174063e50 0x7fa1740ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 --2- 172.21.15.89:0/3385851754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1740a5660 0x7fa1740ac850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 >> 172.21.15.89:0/3385851754 conn(0x7fa17406c7c0 msgr2=0x7fa17413c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 shutdown_connections 2024-02-10T00:05:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:24.937+0000 7fa17b55c700 1 -- 172.21.15.89:0/3385851754 wait complete. 2024-02-10T00:05:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:listed 7 entries 2024-02-10T00:05:24.951 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2024-02-10T00:05:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:24.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-02-10T00:05:24.984 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[37214]: fuse finished with error 0 and tester_r 0 2024-02-10T00:05:25.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-02-10T00:05:25.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:25.006 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-10T00:05:25.088 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-10T00:05:25.088 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-10T00:05:25.112 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-02-10T00:05:25.112 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-10T00:05:25.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.289+0000 7feecc4d5700 1 Processor -- start 2024-02-10T00:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.289+0000 7feecc4d5700 1 -- start start 2024-02-10T00:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecc4d5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecc4d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec413bc00 0x7feec41458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecc4d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40a62d0 con 0x7feec4063e50 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecc4d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4064220 con 0x7feec413bc00 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecc4d5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec40a67f0 con 0x7feec40a6fd0 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feec9a70700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecaa72700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec413bc00 0x7feec41458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecaa72700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec413bc00 0x7feec41458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60178/0 (socket says 172.21.15.89:60178) 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feec9a70700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57210/0 (socket says 172.21.15.89:57210) 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feecaa72700 1 -- 172.21.15.89:0/663668836 learned_addr learned my addr 172.21.15.89:0/663668836 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.290+0000 7feeca271700 1 --1- 172.21.15.89:0/663668836 >> v1:172.21.15.89:6789/0 conn(0x7feec4063e50 0x7feec40a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51676/0 (socket says 172.21.15.89:51676) 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecaa72700 1 -- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 msgr2=0x7feec413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecaa72700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecaa72700 1 -- 172.21.15.89:0/663668836 >> v1:172.21.15.89:6789/0 conn(0x7feec4063e50 legacy=0x7feec40a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecaa72700 1 -- 172.21.15.89:0/663668836 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40a6030 con 0x7feec413bc00 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feec926f700 1 -- 172.21.15.89:0/663668836 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209058015 0 0) 0x7feec40a62d0 con 0x7feec4063e50 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feec9a70700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecaa72700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec41458e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d1d0 tx=0x7feebc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb3fc9fa64da7d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feec926f700 1 -- 172.21.15.89:0/663668836 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc010070 con 0x7feec413bc00 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feec926f700 1 -- 172.21.15.89:0/663668836 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00de00 con 0x7feec413bc00 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feec926f700 1 -- 172.21.15.89:0/663668836 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00b320 con 0x7feec413bc00 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 -- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 msgr2=0x7feec41458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec41458e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d1d0 tx=0x7feebc00ba50 comp rx=0 tx=0).stop 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 -- 172.21.15.89:0/663668836 shutdown_connections 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec41458e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 --2- 172.21.15.89:0/663668836 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec40a6fd0 0x7feec413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.291+0000 7feecc4d5700 1 -- 172.21.15.89:0/663668836 >> 172.21.15.89:0/663668836 conn(0x7feec406c7c0 msgr2=0x7feec4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.292+0000 7feecc4d5700 1 -- 172.21.15.89:0/663668836 shutdown_connections 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.292+0000 7feecc4d5700 1 -- 172.21.15.89:0/663668836 wait complete. 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.292+0000 7feecc4d5700 1 Processor -- start 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.292+0000 7feecc4d5700 1 -- start start 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 0x7feec40adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec4149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40ad200 con 0x7feec413bc00 2024-02-10T00:05:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec41472d0 con 0x7feec40a6fd0 2024-02-10T00:05:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecc4d5700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec40ad760 con 0x7feec4063e50 2024-02-10T00:05:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feeca271700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feeca271700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57212/0 (socket says 172.21.15.89:57212) 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feec9a70700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 0x7feec40adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feeca271700 1 -- 172.21.15.89:0/2888202571 learned_addr learned my addr 172.21.15.89:0/2888202571 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec4149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 -- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 msgr2=0x7feec40accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 -- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 msgr2=0x7feec40adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 0x7feec40adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 -- 172.21.15.89:0/2888202571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009420 con 0x7feec413bc00 2024-02-10T00:05:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feec9a70700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 0x7feec40adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feeca271700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.293+0000 7feecaa72700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec4149bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feec406e660 tx=0x7feebc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.294+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00ac90 con 0x7feec413bc00 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.294+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00adf0 con 0x7feec413bc00 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.294+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc00bcf0 con 0x7feec413bc00 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.294+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0276b0 con 0x7feec413bc00 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.294+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40ae480 con 0x7feec413bc00 2024-02-10T00:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.295+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec40adb50 con 0x7feec413bc00 2024-02-10T00:05:25.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.295+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7feebc003040 con 0x7feec413bc00 2024-02-10T00:05:25.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.295+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7feebc05e8e0 con 0x7feec413bc00 2024-02-10T00:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.298+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7feebc02ab50 con 0x7feec413bc00 2024-02-10T00:05:25.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.452+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feec404c710 con 0x7feec413bc00 2024-02-10T00:05:25.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.453+0000 7feeba7fc700 1 -- 172.21.15.89:0/2888202571 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7feebc02ab50 con 0x7feec413bc00 2024-02-10T00:05:25.455 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:25.455 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 >> v1:172.21.15.89:6816/47970 conn(0x7feea8046040 legacy=0x7feea80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 msgr2=0x7feec4149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec4149bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feec406e660 tx=0x7feebc01a000 comp rx=0 tx=0).stop 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 shutdown_connections 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec413bc00 0x7feec4149bd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7feec4063e50 0x7feec40accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.454+0000 7feecc4d5700 1 --2- 172.21.15.89:0/2888202571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40a6fd0 0x7feec40adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.455+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 >> 172.21.15.89:0/2888202571 conn(0x7feec406c7c0 msgr2=0x7feec4064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.455+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 shutdown_connections 2024-02-10T00:05:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.455+0000 7feecc4d5700 1 -- 172.21.15.89:0/2888202571 wait complete. 2024-02-10T00:05:25.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-09T23:58:10.591178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-02-09T23:58:17.594328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-09T23:58:25.421289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-02-09T23:58:26.291020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-10T00:05:25.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-10T00:05:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.585+0000 7f50074b1700 1 Processor -- start 2024-02-10T00:05:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.585+0000 7f50074b1700 1 -- start start 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f50074b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f50074b1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 0x7f5000145440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f50074b1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500006e600 con 0x7f50000b19b0 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f50074b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500006e400 con 0x7f500006eb00 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f50074b1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500013e9c0 con 0x7f5000138070 2024-02-10T00:05:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5004a4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f500524d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f50000b19b0 0x7f500013e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51686/0 (socket says 172.21.15.89:51686) 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5004a4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37728/0 (socket says 172.21.15.89:37728) 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f500524d700 1 -- 172.21.15.89:0/3884272381 learned_addr learned my addr 172.21.15.89:0/3884272381 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 0x7f5000145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f4ff7fff700 1 -- 172.21.15.89:0/3884272381 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661542293 0 0) 0x7f500006e600 con 0x7f50000b19b0 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 -- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 msgr2=0x7f5000137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 -- 172.21.15.89:0/3884272381 >> v1:172.21.15.89:6789/0 conn(0x7f50000b19b0 legacy=0x7f500013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 -- 172.21.15.89:0/3884272381 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500013ec80 con 0x7f5000138070 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5004a4c700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.586+0000 7f5005a4e700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 0x7f5000145440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e90 tx=0x7f4ff8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b526e68d4546580 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f4ff7fff700 1 -- 172.21.15.89:0/3884272381 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800e070 con 0x7f5000138070 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f4ff7fff700 1 -- 172.21.15.89:0/3884272381 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800bc30 con 0x7f5000138070 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f4ff7fff700 1 -- 172.21.15.89:0/3884272381 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8012430 con 0x7f5000138070 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 -- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 msgr2=0x7f5000145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 0x7f5000145440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e90 tx=0x7f4ff8009780 comp rx=0 tx=0).stop 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 -- 172.21.15.89:0/3884272381 shutdown_connections 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5000138070 0x7f5000145440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 --2- 172.21.15.89:0/3884272381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500006eb00 0x7f5000137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 -- 172.21.15.89:0/3884272381 >> 172.21.15.89:0/3884272381 conn(0x7f500006a910 msgr2=0x7f50000b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 -- 172.21.15.89:0/3884272381 shutdown_connections 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.587+0000 7f50074b1700 1 -- 172.21.15.89:0/3884272381 wait complete. 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.588+0000 7f50074b1700 1 Processor -- start 2024-02-10T00:05:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.588+0000 7f50074b1700 1 -- start start 2024-02-10T00:05:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 0x7f500009ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5000138070 0x7f5000098060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500009c6d0 con 0x7f5000138070 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500009a400 con 0x7f50000b19b0 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f50074b1700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500009c3b0 con 0x7f500006eb00 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f5004a4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 0x7f500009ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57234/0 (socket says 172.21.15.89:57234) 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 -- 172.21.15.89:0/1978517937 learned_addr learned my addr 172.21.15.89:0/1978517937 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f5005a4e700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5000138070 0x7f5000098060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 -- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 msgr2=0x7f500009ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 0x7f500009ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 -- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5000138070 msgr2=0x7f5000098060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5000138070 0x7f5000098060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 -- 172.21.15.89:0/1978517937 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc00b6d0 con 0x7f500006eb00 2024-02-10T00:05:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f5004a4c700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 0x7f500009ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f500524d700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c810 tx=0x7f4ff0007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0005c00 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.589+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0005d60 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.590+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0007320 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.590+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff8009a20 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.590+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500009d6b0 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.591+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500004c710 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.591+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f4ff001b3b0 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.591+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f4ff005ab60 con 0x7f500006eb00 2024-02-10T00:05:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.594+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f4ff0038ca0 con 0x7f500006eb00 2024-02-10T00:05:25.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.745+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f500006f4f0 con 0x7f500006eb00 2024-02-10T00:05:25.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.746+0000 7f4ff57fa700 1 -- 172.21.15.89:0/1978517937 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ff0017020 con 0x7f500006eb00 2024-02-10T00:05:25.749 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.747+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 >> v1:172.21.15.89:6816/47970 conn(0x7f4fe40460c0 legacy=0x7f4fe4048570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.747+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 msgr2=0x7f500009d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.747+0000 7f50074b1700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c810 tx=0x7f4ff0007d90 comp rx=0 tx=0).stop 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 shutdown_connections 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5000138070 0x7f5000098060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f500006eb00 0x7f500009d170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 --2- 172.21.15.89:0/1978517937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50000b19b0 0x7f500009ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 >> 172.21.15.89:0/1978517937 conn(0x7f500006a910 msgr2=0x7f5000063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:25.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 shutdown_connections 2024-02-10T00:05:25.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.748+0000 7f50074b1700 1 -- 172.21.15.89:0/1978517937 wait complete. 2024-02-10T00:05:25.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-02-10T00:05:25.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.877+0000 7f28555f3700 1 Processor -- start 2024-02-10T00:05:25.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.877+0000 7f28555f3700 1 -- start start 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f28555f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 0x7f285006e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f28555f3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 0x7f28500a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f28555f3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285006f3e0 con 0x7f28500a1b40 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f28555f3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285006f680 con 0x7f285006cd20 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f28555f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285006d860 con 0x7f2850063580 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284e7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 0x7f28500a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 0x7f285006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f28500a1b40 0x7f28501488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51702/0 (socket says 172.21.15.89:51702) 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284f7fe700 1 -- 172.21.15.89:0/3596699702 learned_addr learned my addr 172.21.15.89:0/3596699702 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284effd700 1 -- 172.21.15.89:0/3596699702 >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 msgr2=0x7f28500a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:25.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284effd700 1 --2- 172.21.15.89:0/3596699702 >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 0x7f28500a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284effd700 1 -- 172.21.15.89:0/3596699702 >> v1:172.21.15.89:6789/0 conn(0x7f28500a1b40 legacy=0x7f28501488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284effd700 1 -- 172.21.15.89:0/3596699702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285006ec50 con 0x7f2850063580 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284dffb700 1 -- 172.21.15.89:0/3596699702 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160706290 0 0) 0x7f285006f3e0 con 0x7f28500a1b40 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.878+0000 7f284e7fc700 1 --2- 172.21.15.89:0/3596699702 >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 0x7f28500a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f284effd700 1 --2- 172.21.15.89:0/3596699702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 0x7f285006e040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28440098e0 tx=0x7f28440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99444f9e42b9fff server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f284dffb700 1 -- 172.21.15.89:0/3596699702 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400b640 con 0x7f2850063580 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f284dffb700 1 -- 172.21.15.89:0/3596699702 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400b7a0 con 0x7f2850063580 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f284dffb700 1 -- 172.21.15.89:0/3596699702 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400bb40 con 0x7f2850063580 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 -- 172.21.15.89:0/3596699702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 msgr2=0x7f285006e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 --2- 172.21.15.89:0/3596699702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 0x7f285006e040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28440098e0 tx=0x7f28440091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 -- 172.21.15.89:0/3596699702 shutdown_connections 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 --2- 172.21.15.89:0/3596699702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2850063580 0x7f285006e040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 --2- 172.21.15.89:0/3596699702 >> v2:172.21.15.89:3300/0 conn(0x7f285006cd20 0x7f28500a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 -- 172.21.15.89:0/3596699702 >> 172.21.15.89:0/3596699702 conn(0x7f285006a910 msgr2=0x7f28500b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:25.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 -- 172.21.15.89:0/3596699702 shutdown_connections 2024-02-10T00:05:25.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.879+0000 7f28555f3700 1 -- 172.21.15.89:0/3596699702 wait complete. 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.880+0000 7f28555f3700 1 Processor -- start 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.880+0000 7f28555f3700 1 -- start start 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2850063580 0x7f2850096f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 0x7f285013f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285013f6b0 con 0x7f285006cd20 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2850098720 con 0x7f28500a1b40 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f28555f3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2850096ab0 con 0x7f2850063580 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 0x7f285013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60226/0 (socket says 172.21.15.89:60226) 2024-02-10T00:05:25.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 -- 172.21.15.89:0/3808722004 learned_addr learned my addr 172.21.15.89:0/3808722004 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284effd700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2850063580 0x7f2850096f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 -- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2850063580 msgr2=0x7f2850096f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2850063580 0x7f2850096f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 -- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 msgr2=0x7f285013f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 0x7f285013f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 -- 172.21.15.89:0/3808722004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009420 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284f7fe700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 0x7f285013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.881+0000 7f284e7fc700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f284000ec50 tx=0x7f28400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.882+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000c8e0 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.882+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000ca40 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.882+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000cde0 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.882+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844009420 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.882+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28500ac720 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.883+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2840013680 con 0x7f285006cd20 2024-02-10T00:05:25.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.883+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285004c710 con 0x7f285006cd20 2024-02-10T00:05:25.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.883+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f284005b590 con 0x7f285006cd20 2024-02-10T00:05:25.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:25.887+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f28400398c0 con 0x7f285006cd20 2024-02-10T00:05:26.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.039+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28500a08f0 con 0x7f285006cd20 2024-02-10T00:05:26.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.040+0000 7f2836ffd700 1 -- 172.21.15.89:0/3808722004 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f284003cee0 con 0x7f285006cd20 2024-02-10T00:05:26.042 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 >> v1:172.21.15.89:6816/47970 conn(0x7f283c046070 legacy=0x7f283c048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 msgr2=0x7f285013ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f284000ec50 tx=0x7f28400091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 shutdown_connections 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28500a1b40 0x7f285013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2850063580 0x7f2850096f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 --2- 172.21.15.89:0/3808722004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285006cd20 0x7f285013ec30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 >> 172.21.15.89:0/3808722004 conn(0x7f285006a910 msgr2=0x7f2850144410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 shutdown_connections 2024-02-10T00:05:26.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.041+0000 7f28555f3700 1 -- 172.21.15.89:0/3808722004 wait complete. 2024-02-10T00:05:26.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-10T00:05:26.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.173+0000 7f9b4244e700 1 Processor -- start 2024-02-10T00:05:26.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.173+0000 7f9b4244e700 1 -- start start 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b4244e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 0x7f9b3c0a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b4244e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c13fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b4244e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c13fc00 con 0x7f9b3c13f770 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b4244e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0a1f70 con 0x7f9b3c063580 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b4244e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0a52c0 con 0x7f9b3c063950 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b409eb700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9b3c13f770 0x7f9b3c06ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51706/0 (socket says 172.21.15.89:51706) 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b409eb700 1 -- 172.21.15.89:0/3822997333 learned_addr learned my addr 172.21.15.89:0/3822997333 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3822997333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c13fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3bfff700 1 --2- 172.21.15.89:0/3822997333 >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 0x7f9b3c0a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3822997333 >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 msgr2=0x7f9b3c0a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:26.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3822997333 >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 0x7f9b3c0a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3822997333 >> v1:172.21.15.89:6789/0 conn(0x7f9b3c13f770 legacy=0x7f9b3c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3822997333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0a5430 con 0x7f9b3c063950 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.174+0000 7f9b3bfff700 1 --2- 172.21.15.89:0/3822997333 >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 0x7f9b3c0a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3822997333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c13fea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b300098e0 tx=0x7f9b300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f97bace3673c364e server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b3affd700 1 -- 172.21.15.89:0/3822997333 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000b640 con 0x7f9b3c063950 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b3affd700 1 -- 172.21.15.89:0/3822997333 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000b7a0 con 0x7f9b3c063950 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b3affd700 1 -- 172.21.15.89:0/3822997333 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000bb40 con 0x7f9b3c063950 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 -- 172.21.15.89:0/3822997333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 msgr2=0x7f9b3c13fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3822997333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c13fea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b300098e0 tx=0x7f9b300091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 -- 172.21.15.89:0/3822997333 shutdown_connections 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3822997333 >> v2:172.21.15.89:3300/0 conn(0x7f9b3c063580 0x7f9b3c0a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3822997333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c13fea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 -- 172.21.15.89:0/3822997333 >> 172.21.15.89:0/3822997333 conn(0x7f9b3c06a910 msgr2=0x7f9b3c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.175+0000 7f9b4244e700 1 -- 172.21.15.89:0/3822997333 shutdown_connections 2024-02-10T00:05:26.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.176+0000 7f9b4244e700 1 -- 172.21.15.89:0/3822997333 wait complete. 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.176+0000 7f9b4244e700 1 Processor -- start 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 -- start start 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 0x7f9b3c0ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b3c13f770 0x7f9b3c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0aa7e0 con 0x7f9b3c13f770 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0aacd0 con 0x7f9b3c063950 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b4244e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0aaf50 con 0x7f9b3c063580 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 0x7f9b3c0ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b409eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b3c13f770 0x7f9b3c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 0x7f9b3c0ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57248/0 (socket says 172.21.15.89:57248) 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3bfff700 1 -- 172.21.15.89:0/3237063504 learned_addr learned my addr 172.21.15.89:0/3237063504 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 msgr2=0x7f9b3c0ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 0x7f9b3c0ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b3c13f770 msgr2=0x7f9b3c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b3c13f770 0x7f9b3c06d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.177+0000 7f9b3b7fe700 1 -- 172.21.15.89:0/3237063504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009420 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b3b7fe700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c06cc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b30016000 tx=0x7f9b30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3001bc40 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3001bdc0 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011670 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b30009420 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.178+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c0aea20 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.179+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9b30011a20 con 0x7f9b3c063950 2024-02-10T00:05:26.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.179+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c04c710 con 0x7f9b3c063950 2024-02-10T00:05:26.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.179+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f9b3005c6c0 con 0x7f9b3c063950 2024-02-10T00:05:26.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.183+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f9b30015070 con 0x7f9b3c063950 2024-02-10T00:05:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.339+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b3c0b12b0 con 0x7f9b3c063950 2024-02-10T00:05:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.339+0000 7f9b23fff700 1 -- 172.21.15.89:0/3237063504 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b30029030 con 0x7f9b3c063950 2024-02-10T00:05:26.342 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2024-02-10T00:05:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 >> v1:172.21.15.89:6816/47970 conn(0x7f9b28046040 legacy=0x7f9b280484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 msgr2=0x7f9b3c06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c06cc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b30016000 tx=0x7f9b30017000 comp rx=0 tx=0).stop 2024-02-10T00:05:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 shutdown_connections 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b3c13f770 0x7f9b3c06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9b3c063580 0x7f9b3c0ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 --2- 172.21.15.89:0/3237063504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b3c063950 0x7f9b3c06cc00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 >> 172.21.15.89:0/3237063504 conn(0x7f9b3c06a910 msgr2=0x7f9b3c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 shutdown_connections 2024-02-10T00:05:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.341+0000 7f9b4244e700 1 -- 172.21.15.89:0/3237063504 wait complete. 2024-02-10T00:05:26.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-10T00:05:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.475+0000 7f7ec12af700 1 Processor -- start 2024-02-10T00:05:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.475+0000 7f7ec12af700 1 -- start start 2024-02-10T00:05:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ec12af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 0x7f7ebc0a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ec12af700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ec12af700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc0a40d0 con 0x7f7ebc0a4970 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ec12af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0a4d40 con 0x7f7ebc0b5540 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ec12af700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0a38d0 con 0x7f7ebc0a2bc0 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 0x7f7ebc0a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebb7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eba7fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7ebc0a4970 0x7f7ebc13ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51722/0 (socket says 172.21.15.89:51722) 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eba7fc700 1 -- 172.21.15.89:0/2736955889 learned_addr learned my addr 172.21.15.89:0/2736955889 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 -- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 msgr2=0x7f7ebc148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eb9ffb700 1 -- 172.21.15.89:0/2736955889 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379617739 0 0) 0x7f7ebc0a40d0 con 0x7f7ebc0a4970 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 -- 172.21.15.89:0/2736955889 >> v1:172.21.15.89:6789/0 conn(0x7f7ebc0a4970 legacy=0x7f7ebc13ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 -- 172.21.15.89:0/2736955889 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0a4390 con 0x7f7ebc0b5540 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebb7fe700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7ebaffd700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 0x7f7ebc0a1b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009940 tx=0x7f7eb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cf50850423061f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eb9ffb700 1 -- 172.21.15.89:0/2736955889 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000b670 con 0x7f7ebc0b5540 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eb9ffb700 1 -- 172.21.15.89:0/2736955889 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb000b7d0 con 0x7f7ebc0b5540 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.476+0000 7f7eb9ffb700 1 -- 172.21.15.89:0/2736955889 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000bb90 con 0x7f7ebc0b5540 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 -- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 msgr2=0x7f7ebc0a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 0x7f7ebc0a1b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009940 tx=0x7f7eb00091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 -- 172.21.15.89:0/2736955889 shutdown_connections 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0b5540 0x7f7ebc0a1b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 --2- 172.21.15.89:0/2736955889 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 -- 172.21.15.89:0/2736955889 >> 172.21.15.89:0/2736955889 conn(0x7f7ebc064050 msgr2=0x7f7ebc0b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 -- 172.21.15.89:0/2736955889 shutdown_connections 2024-02-10T00:05:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.477+0000 7f7ec12af700 1 -- 172.21.15.89:0/2736955889 wait complete. 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 Processor -- start 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 -- start start 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 0x7f7ebc151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.478+0000 7f7ec12af700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0a9bb0 con 0x7f7ebc0b5540 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ec12af700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0ac260 con 0x7f7ebc0a4970 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ec12af700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0b24f0 con 0x7f7ebc0a2bc0 2024-02-10T00:05:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebaffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebaffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57260/0 (socket says 172.21.15.89:57260) 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebaffd700 1 -- 172.21.15.89:0/950812011 learned_addr learned my addr 172.21.15.89:0/950812011 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37802/0 (socket says 172.21.15.89:37802) 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebb7fe700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 0x7f7ebc151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 -- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 msgr2=0x7f7ebc0a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 -- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 msgr2=0x7f7ebc151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 0x7f7ebc151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 -- 172.21.15.89:0/950812011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009a20 con 0x7f7ebc0a4970 2024-02-10T00:05:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebaffd700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ebb7fe700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 0x7f7ebc151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7eba7fc700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0011e0 tx=0x7f7eac007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac005b30 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac005cb0 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0009420 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac007320 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.479+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc0a89e0 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.480+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7eac012400 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.480+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc0a6620 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.480+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f7eac05a530 con 0x7f7ebc0a4970 2024-02-10T00:05:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.484+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f7eac038750 con 0x7f7ebc0a4970 2024-02-10T00:05:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.636+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ebc04c710 con 0x7f7ebc0a4970 2024-02-10T00:05:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.636+0000 7f7ea2ffd700 1 -- 172.21.15.89:0/950812011 <== mon.1 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7eac017030 con 0x7f7ebc0a4970 2024-02-10T00:05:26.640 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 >> v1:172.21.15.89:6816/47970 conn(0x7f7ea8046040 legacy=0x7f7ea80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 msgr2=0x7f7ebc151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0011e0 tx=0x7f7eac007d10 comp rx=0 tx=0).stop 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 shutdown_connections 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ebc0b5540 0x7f7ebc151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f7ebc0a2bc0 0x7f7ebc0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 --2- 172.21.15.89:0/950812011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ebc0a4970 0x7f7ebc151a80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 >> 172.21.15.89:0/950812011 conn(0x7f7ebc064050 msgr2=0x7f7ebc0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 shutdown_connections 2024-02-10T00:05:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.638+0000 7f7ec12af700 1 -- 172.21.15.89:0/950812011 wait complete. 2024-02-10T00:05:26.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-10T00:05:26.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.766+0000 7f1b3fd4c700 1 Processor -- start 2024-02-10T00:05:26.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.766+0000 7f1b3fd4c700 1 -- start start 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806ce70 0x7f1b38141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b38142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380a1130 con 0x7f1b3806ce70 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380a28c0 con 0x7f1b38063740 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3fd4c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38063b10 con 0x7f1b3806d260 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3dae8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806ce70 0x7f1b38141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3e2e9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b38142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806ce70 0x7f1b38141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60262/0 (socket says 172.21.15.89:60262) 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3dae8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37810/0 (socket says 172.21.15.89:37810) 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3e2e9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b38142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57274/0 (socket says 172.21.15.89:57274) 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/1676702555 learned_addr learned my addr 172.21.15.89:0/1676702555 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 msgr2=0x7f1b38142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b38142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 msgr2=0x7f1b3806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/1676702555 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b381428c0 con 0x7f1b3806ce70 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.767+0000 7f1b3dae8700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38141e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd978cf3db1ec76 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3cae6700 1 -- 172.21.15.89:0/1676702555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400b680 con 0x7f1b3806ce70 2024-02-10T00:05:26.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3cae6700 1 -- 172.21.15.89:0/1676702555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400b7e0 con 0x7f1b3806ce70 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3cae6700 1 -- 172.21.15.89:0/1676702555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400bb80 con 0x7f1b3806ce70 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 msgr2=0x7f1b38141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38141e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34009250 comp rx=0 tx=0).stop 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/1676702555 shutdown_connections 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b38142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/1676702555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38141e40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/1676702555 >> 172.21.15.89:0/1676702555 conn(0x7f1b3806a820 msgr2=0x7f1b380b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/1676702555 shutdown_connections 2024-02-10T00:05:26.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.768+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/1676702555 wait complete. 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.769+0000 7f1b3fd4c700 1 Processor -- start 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.769+0000 7f1b3fd4c700 1 -- start start 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3809ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b381511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38150fb0 con 0x7f1b3806ce70 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3814b6e0 con 0x7f1b38063740 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3fd4c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3809a840 con 0x7f1b3806d260 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60266/0 (socket says 172.21.15.89:60266) 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/3997762755 learned_addr learned my addr 172.21.15.89:0/3997762755 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:26.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3dae8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3809ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3e2e9700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b381511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 msgr2=0x7f1b381511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b381511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 msgr2=0x7f1b3809ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3809ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 -- 172.21.15.89:0/3997762755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009420 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3dae8700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3809ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.770+0000 7f1b3d2e7700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009290 tx=0x7f1b34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.771+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34002f90 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.771+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400b950 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.771+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b340094f0 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.771+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3401a430 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.771+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38099c80 con 0x7f1b3806ce70 2024-02-10T00:05:26.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.772+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1b3401a840 con 0x7f1b3806ce70 2024-02-10T00:05:26.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.772+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38099590 con 0x7f1b3806ce70 2024-02-10T00:05:26.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.772+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f1b3405cd30 con 0x7f1b3806ce70 2024-02-10T00:05:26.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.776+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f1b3402fff0 con 0x7f1b3806ce70 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.945+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b3804c710 con 0x7f1b3806ce70 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.946+0000 7f1b2dffb700 1 -- 172.21.15.89:0/3997762755 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 7 entries v41) v1 ==== 80+0+408 (secure 0 0 0) 0x7f1b34015030 con 0x7f1b3806ce70 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2640344124 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3039776512 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3978228942 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:26.948 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.183:0/432961506 2024-02-10T01:05:14.231601+0000 2024-02-10T00:05:26.949 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.164:0/3331993086 2024-02-10T01:05:14.231318+0000 2024-02-10T00:05:26.949 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6816/39389 2024-02-11T00:04:30.116269+0000 2024-02-10T00:05:26.949 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6819/3416328937 2024-02-11T00:04:56.564529+0000 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 >> v1:172.21.15.89:6816/47970 conn(0x7f1b1c046040 legacy=0x7f1b1c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 msgr2=0x7f1b38099740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009290 tx=0x7f1b34017000 comp rx=0 tx=0).stop 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 shutdown_connections 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f1b3806d260 0x7f1b381511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b38063740 0x7f1b3809ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 --2- 172.21.15.89:0/3997762755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806ce70 0x7f1b38099740 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 >> 172.21.15.89:0/3997762755 conn(0x7f1b3806a820 msgr2=0x7f1b380a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 shutdown_connections 2024-02-10T00:05:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:26.948+0000 7f1b3fd4c700 1 -- 172.21.15.89:0/3997762755 wait complete. 2024-02-10T00:05:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:listed 7 entries 2024-02-10T00:05:26.961 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.1 2024-02-10T00:05:26.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:26.962 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.1 2024-02-10T00:05:26.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[37237]: fuse finished with error 0 and tester_r 0 2024-02-10T00:05:27.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-02-10T00:05:27.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.001 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-10T00:05:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.078 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-02-10T00:05:27.170 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-10T00:05:27.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.170 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-10T00:05:27.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.258 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2024-02-10T00:05:27.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.365 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-02-10T00:05:27.389 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-10T00:05:27.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-10T00:05:27.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-10T00:05:27.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-02-10T00:05:27.575 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-10T00:05:27.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-10T00:05:27.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:27.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.762+0000 7f3a4e85a700 1 Processor -- start 2024-02-10T00:05:27.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.762+0000 7f3a4e85a700 1 -- start start 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4e85a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4e85a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4e85a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480a6aa0 con 0x7f3a480a3d40 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4e85a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480a1a60 con 0x7f3a480b55b0 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4e85a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480a1d00 con 0x7f3a480a4130 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4cdf7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4cdf7700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57302/0 (socket says 172.21.15.89:57302) 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37832/0 (socket says 172.21.15.89:37832) 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4cdf7700 1 -- 172.21.15.89:0/398045262 learned_addr learned my addr 172.21.15.89:0/398045262 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a477fe700 1 --1- 172.21.15.89:0/398045262 >> v1:172.21.15.89:6789/0 conn(0x7f3a480a3d40 0x7f3a4813dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51732/0 (socket says 172.21.15.89:51732) 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a46ffd700 1 -- 172.21.15.89:0/398045262 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441280735 0 0) 0x7f3a480a6aa0 con 0x7f3a480a3d40 2024-02-10T00:05:27.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 -- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 msgr2=0x7f3a48148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 -- 172.21.15.89:0/398045262 >> v1:172.21.15.89:6789/0 conn(0x7f3a480a3d40 legacy=0x7f3a4813dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 -- 172.21.15.89:0/398045262 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a480a2450 con 0x7f3a480b55b0 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a4cdf7700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a47fff700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009900 tx=0x7f3a38009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30167f5469a9c08d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a46ffd700 1 -- 172.21.15.89:0/398045262 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38005c10 con 0x7f3a480b55b0 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a46ffd700 1 -- 172.21.15.89:0/398045262 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38005d70 con 0x7f3a480b55b0 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.763+0000 7f3a46ffd700 1 -- 172.21.15.89:0/398045262 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38006240 con 0x7f3a480b55b0 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 -- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 msgr2=0x7f3a480a29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009900 tx=0x7f3a38009120 comp rx=0 tx=0).stop 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 -- 172.21.15.89:0/398045262 shutdown_connections 2024-02-10T00:05:27.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480b55b0 0x7f3a480a29c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/398045262 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a48148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 -- 172.21.15.89:0/398045262 >> 172.21.15.89:0/398045262 conn(0x7f3a48064050 msgr2=0x7f3a480b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:27.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 -- 172.21.15.89:0/398045262 shutdown_connections 2024-02-10T00:05:27.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.764+0000 7f3a4e85a700 1 -- 172.21.15.89:0/398045262 wait complete. 2024-02-10T00:05:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.765+0000 7f3a4e85a700 1 Processor -- start 2024-02-10T00:05:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.765+0000 7f3a4e85a700 1 -- start start 2024-02-10T00:05:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.765+0000 7f3a4e85a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 0x7f3a480a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 0x7f3a48151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481421a0 con 0x7f3a480b55b0 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481407a0 con 0x7f3a480a3d40 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480a8e60 con 0x7f3a480a4130 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a477fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4cdf7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 0x7f3a48151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 0x7f3a480a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a477fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57314/0 (socket says 172.21.15.89:57314) 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4cdf7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 0x7f3a48151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60278/0 (socket says 172.21.15.89:60278) 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a477fe700 1 -- 172.21.15.89:0/4159475935 learned_addr learned my addr 172.21.15.89:0/4159475935 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 -- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 msgr2=0x7f3a480a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 -- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 msgr2=0x7f3a48151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 0x7f3a48151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 -- 172.21.15.89:0/4159475935 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40009ae0 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a477fe700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a47fff700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 0x7f3a480a9a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a38015000 tx=0x7f3a38016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800b750 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800b8f0 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800bcb0 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a380093c0 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.766+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a480a8b50 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.767+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3a3801a630 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.767+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4813b770 con 0x7f3a480a3d40 2024-02-10T00:05:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.767+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f3a3805c530 con 0x7f3a480a3d40 2024-02-10T00:05:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.771+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3a3800be10 con 0x7f3a480a3d40 2024-02-10T00:05:27.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.919+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a4804c710 con 0x7f3a34046040 2024-02-10T00:05:27.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.926+0000 7f3a2ffff700 1 -- 172.21.15.89:0/4159475935 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273448 (unknown 2965378022 0 3629741987) 0x7f3a4804c710 con 0x7f3a34046040 2024-02-10T00:05:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:27.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 >> v1:172.21.15.89:6816/47970 conn(0x7f3a34046040 legacy=0x7f3a340484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 msgr2=0x7f3a480a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:27.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 0x7f3a480a9a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a38015000 tx=0x7f3a38016000 comp rx=0 tx=0).stop 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 shutdown_connections 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a480b55b0 0x7f3a48151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a480a3d40 0x7f3a480a9a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 --2- 172.21.15.89:0/4159475935 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3a480a4130 0x7f3a480a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 >> 172.21.15.89:0/4159475935 conn(0x7f3a48064050 msgr2=0x7f3a4813e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 shutdown_connections 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:27.929+0000 7f3a4e85a700 1 -- 172.21.15.89:0/4159475935 wait complete. 2024-02-10T00:05:27.935 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:27.943 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-02-10T00:05:26.144114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227097,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65350,"num_write_kb":9046232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71787,"ondisk_log_size":71787,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537396,"kb_used_data":290964,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375949964,"statfs":{"total":386547056640,"available":384972763136,"internally_reserved":0,"allocated":297947136,"data_stored":297074670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.906752"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195716+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:03.195716+0000","last_peered":"2024-02-10T00:05:03.195716+0000","last_clean":"2024-02-10T00:05:03.195716+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:03.195716+0000","last_undegraded":"2024-02-10T00:05:03.195716+0000","last_fullsized":"2024-02-10T00:05:03.195716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197351+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:03.197351+0000","last_peered":"2024-02-10T00:05:03.197351+0000","last_clean":"2024-02-10T00:05:03.197351+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:03.197351+0000","last_undegraded":"2024-02-10T00:05:03.197351+0000","last_fullsized":"2024-02-10T00:05:03.197351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":909,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213630+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:05.213630+0000","last_peered":"2024-02-10T00:05:05.213630+0000","last_clean":"2024-02-10T00:05:05.213630+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:05.213630+0000","last_undegraded":"2024-02-10T00:05:05.213630+0000","last_fullsized":"2024-02-10T00:05:05.213630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213695+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:05.213695+0000","last_peered":"2024-02-10T00:05:05.213695+0000","last_clean":"2024-02-10T00:05:05.213695+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:05.213695+0000","last_undegraded":"2024-02-10T00:05:05.213695+0000","last_fullsized":"2024-02-10T00:05:05.213695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213378+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:05.213378+0000","last_peered":"2024-02-10T00:05:05.213378+0000","last_clean":"2024-02-10T00:05:05.213378+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:05.213378+0000","last_undegraded":"2024-02-10T00:05:05.213378+0000","last_fullsized":"2024-02-10T00:05:05.213378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":867,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197512+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:03.197512+0000","last_peered":"2024-02-10T00:05:03.197512+0000","last_clean":"2024-02-10T00:05:03.197512+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:03.197512+0000","last_undegraded":"2024-02-10T00:05:03.197512+0000","last_fullsized":"2024-02-10T00:05:03.197512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199254+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:03.199254+0000","last_peered":"2024-02-10T00:05:03.199254+0000","last_clean":"2024-02-10T00:05:03.199254+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:03.199254+0000","last_undegraded":"2024-02-10T00:05:03.199254+0000","last_fullsized":"2024-02-10T00:05:03.199254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":798,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196252+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:03.196252+0000","last_peered":"2024-02-10T00:05:03.196252+0000","last_clean":"2024-02-10T00:05:03.196252+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:03.196252+0000","last_undegraded":"2024-02-10T00:05:03.196252+0000","last_fullsized":"2024-02-10T00:05:03.196252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":927,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213994+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:05.213994+0000","last_peered":"2024-02-10T00:05:05.213994+0000","last_clean":"2024-02-10T00:05:05.213994+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:05.213994+0000","last_undegraded":"2024-02-10T00:05:05.213994+0000","last_fullsized":"2024-02-10T00:05:05.213994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197889+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:03.197889+0000","last_peered":"2024-02-10T00:05:03.197889+0000","last_clean":"2024-02-10T00:05:03.197889+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:03.197889+0000","last_undegraded":"2024-02-10T00:05:03.197889+0000","last_fullsized":"2024-02-10T00:05:03.197889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":845,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197279+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:03.197279+0000","last_peered":"2024-02-10T00:05:03.197279+0000","last_clean":"2024-02-10T00:05:03.197279+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:03.197279+0000","last_undegraded":"2024-02-10T00:05:03.197279+0000","last_fullsized":"2024-02-10T00:05:03.197279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196527+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:03.196527+0000","last_peered":"2024-02-10T00:05:03.196527+0000","last_clean":"2024-02-10T00:05:03.196527+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:03.196527+0000","last_undegraded":"2024-02-10T00:05:03.196527+0000","last_fullsized":"2024-02-10T00:05:03.196527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":964,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198230+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:03.198230+0000","last_peered":"2024-02-10T00:05:03.198230+0000","last_clean":"2024-02-10T00:05:03.198230+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:03.198230+0000","last_undegraded":"2024-02-10T00:05:03.198230+0000","last_fullsized":"2024-02-10T00:05:03.198230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":936,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195642+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:03.195642+0000","last_peered":"2024-02-10T00:05:03.195642+0000","last_clean":"2024-02-10T00:05:03.195642+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:03.195642+0000","last_undegraded":"2024-02-10T00:05:03.195642+0000","last_fullsized":"2024-02-10T00:05:03.195642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213324+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:05.213324+0000","last_peered":"2024-02-10T00:05:05.213324+0000","last_clean":"2024-02-10T00:05:05.213324+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:05.213324+0000","last_undegraded":"2024-02-10T00:05:05.213324+0000","last_fullsized":"2024-02-10T00:05:05.213324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197103+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:03.197103+0000","last_peered":"2024-02-10T00:05:03.197103+0000","last_clean":"2024-02-10T00:05:03.197103+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:03.197103+0000","last_undegraded":"2024-02-10T00:05:03.197103+0000","last_fullsized":"2024-02-10T00:05:03.197103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":982,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214235+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:05.214235+0000","last_peered":"2024-02-10T00:05:05.214235+0000","last_clean":"2024-02-10T00:05:05.214235+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:05.214235+0000","last_undegraded":"2024-02-10T00:05:05.214235+0000","last_fullsized":"2024-02-10T00:05:05.214235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":782,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213633+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:05.213633+0000","last_peered":"2024-02-10T00:05:05.213633+0000","last_clean":"2024-02-10T00:05:05.213633+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:05.213633+0000","last_undegraded":"2024-02-10T00:05:05.213633+0000","last_fullsized":"2024-02-10T00:05:05.213633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1013,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197053+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:03.197053+0000","last_peered":"2024-02-10T00:05:03.197053+0000","last_clean":"2024-02-10T00:05:03.197053+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:03.197053+0000","last_undegraded":"2024-02-10T00:05:03.197053+0000","last_fullsized":"2024-02-10T00:05:03.197053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":889,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199354+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:03.199354+0000","last_peered":"2024-02-10T00:05:03.199354+0000","last_clean":"2024-02-10T00:05:03.199354+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:03.199354+0000","last_undegraded":"2024-02-10T00:05:03.199354+0000","last_fullsized":"2024-02-10T00:05:03.199354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196764+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:03.196764+0000","last_peered":"2024-02-10T00:05:03.196764+0000","last_clean":"2024-02-10T00:05:03.196764+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:03.196764+0000","last_undegraded":"2024-02-10T00:05:03.196764+0000","last_fullsized":"2024-02-10T00:05:03.196764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":963,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213262+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:05.213262+0000","last_peered":"2024-02-10T00:05:05.213262+0000","last_clean":"2024-02-10T00:05:05.213262+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:05.213262+0000","last_undegraded":"2024-02-10T00:05:05.213262+0000","last_fullsized":"2024-02-10T00:05:05.213262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198737+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:03.198737+0000","last_peered":"2024-02-10T00:05:03.198737+0000","last_clean":"2024-02-10T00:05:03.198737+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:03.198737+0000","last_undegraded":"2024-02-10T00:05:03.198737+0000","last_fullsized":"2024-02-10T00:05:03.198737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":957,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196109+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:03.196109+0000","last_peered":"2024-02-10T00:05:03.196109+0000","last_clean":"2024-02-10T00:05:03.196109+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:03.196109+0000","last_undegraded":"2024-02-10T00:05:03.196109+0000","last_fullsized":"2024-02-10T00:05:03.196109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":978,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198463+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:03.198463+0000","last_peered":"2024-02-10T00:05:03.198463+0000","last_clean":"2024-02-10T00:05:03.198463+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:03.198463+0000","last_undegraded":"2024-02-10T00:05:03.198463+0000","last_fullsized":"2024-02-10T00:05:03.198463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198261+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:03.198261+0000","last_peered":"2024-02-10T00:05:03.198261+0000","last_clean":"2024-02-10T00:05:03.198261+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:03.198261+0000","last_undegraded":"2024-02-10T00:05:03.198261+0000","last_fullsized":"2024-02-10T00:05:03.198261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198656+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:03.198656+0000","last_peered":"2024-02-10T00:05:03.198656+0000","last_clean":"2024-02-10T00:05:03.198656+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:03.198656+0000","last_undegraded":"2024-02-10T00:05:03.198656+0000","last_fullsized":"2024-02-10T00:05:03.198656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1506,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196257+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:03.196257+0000","last_peered":"2024-02-10T00:05:03.196257+0000","last_clean":"2024-02-10T00:05:03.196257+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:03.196257+0000","last_undegraded":"2024-02-10T00:05:03.196257+0000","last_fullsized":"2024-02-10T00:05:03.196257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":872,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199077+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:03.199077+0000","last_peered":"2024-02-10T00:05:03.199077+0000","last_clean":"2024-02-10T00:05:03.199077+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:03.199077+0000","last_undegraded":"2024-02-10T00:05:03.199077+0000","last_fullsized":"2024-02-10T00:05:03.199077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195557+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:03.195557+0000","last_peered":"2024-02-10T00:05:03.195557+0000","last_clean":"2024-02-10T00:05:03.195557+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:03.195557+0000","last_undegraded":"2024-02-10T00:05:03.195557+0000","last_fullsized":"2024-02-10T00:05:03.195557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213874+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:05.213874+0000","last_peered":"2024-02-10T00:05:05.213874+0000","last_clean":"2024-02-10T00:05:05.213874+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:05.213874+0000","last_undegraded":"2024-02-10T00:05:05.213874+0000","last_fullsized":"2024-02-10T00:05:05.213874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197314+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:03.197314+0000","last_peered":"2024-02-10T00:05:03.197314+0000","last_clean":"2024-02-10T00:05:03.197314+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:03.197314+0000","last_undegraded":"2024-02-10T00:05:03.197314+0000","last_fullsized":"2024-02-10T00:05:03.197314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":905,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199608+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:03.199608+0000","last_peered":"2024-02-10T00:05:03.199608+0000","last_clean":"2024-02-10T00:05:03.199608+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:03.199608+0000","last_undegraded":"2024-02-10T00:05:03.199608+0000","last_fullsized":"2024-02-10T00:05:03.199608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224740+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:05.224740+0000","last_peered":"2024-02-10T00:05:05.224740+0000","last_clean":"2024-02-10T00:05:05.224740+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:05.224740+0000","last_undegraded":"2024-02-10T00:05:05.224740+0000","last_fullsized":"2024-02-10T00:05:05.224740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197256+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:03.197256+0000","last_peered":"2024-02-10T00:05:03.197256+0000","last_clean":"2024-02-10T00:05:03.197256+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:03.197256+0000","last_undegraded":"2024-02-10T00:05:03.197256+0000","last_fullsized":"2024-02-10T00:05:03.197256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197162+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:03.197162+0000","last_peered":"2024-02-10T00:05:03.197162+0000","last_clean":"2024-02-10T00:05:03.197162+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:03.197162+0000","last_undegraded":"2024-02-10T00:05:03.197162+0000","last_fullsized":"2024-02-10T00:05:03.197162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1062,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199166+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:03.199166+0000","last_peered":"2024-02-10T00:05:03.199166+0000","last_clean":"2024-02-10T00:05:03.199166+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:03.199166+0000","last_undegraded":"2024-02-10T00:05:03.199166+0000","last_fullsized":"2024-02-10T00:05:03.199166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":437,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.233703+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:05.233703+0000","last_peered":"2024-02-10T00:05:05.233703+0000","last_clean":"2024-02-10T00:05:05.233703+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:05.233703+0000","last_undegraded":"2024-02-10T00:05:05.233703+0000","last_fullsized":"2024-02-10T00:05:05.233703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196962+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:03.196962+0000","last_peered":"2024-02-10T00:05:03.196962+0000","last_clean":"2024-02-10T00:05:03.196962+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:03.196962+0000","last_undegraded":"2024-02-10T00:05:03.196962+0000","last_fullsized":"2024-02-10T00:05:03.196962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":704,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222215+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:05.222215+0000","last_peered":"2024-02-10T00:05:05.222215+0000","last_clean":"2024-02-10T00:05:05.222215+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:05.222215+0000","last_undegraded":"2024-02-10T00:05:05.222215+0000","last_fullsized":"2024-02-10T00:05:05.222215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":995,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198125+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:03.198125+0000","last_peered":"2024-02-10T00:05:03.198125+0000","last_clean":"2024-02-10T00:05:03.198125+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:03.198125+0000","last_undegraded":"2024-02-10T00:05:03.198125+0000","last_fullsized":"2024-02-10T00:05:03.198125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":435,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.208215+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:05.208215+0000","last_peered":"2024-02-10T00:05:05.208215+0000","last_clean":"2024-02-10T00:05:05.208215+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:05.208215+0000","last_undegraded":"2024-02-10T00:05:05.208215+0000","last_fullsized":"2024-02-10T00:05:05.208215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1094,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198114+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:03.198114+0000","last_peered":"2024-02-10T00:05:03.198114+0000","last_clean":"2024-02-10T00:05:03.198114+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:03.198114+0000","last_undegraded":"2024-02-10T00:05:03.198114+0000","last_fullsized":"2024-02-10T00:05:03.198114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213248+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:05.213248+0000","last_peered":"2024-02-10T00:05:05.213248+0000","last_clean":"2024-02-10T00:05:05.213248+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:05.213248+0000","last_undegraded":"2024-02-10T00:05:05.213248+0000","last_fullsized":"2024-02-10T00:05:05.213248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":960,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199079+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:03.199079+0000","last_peered":"2024-02-10T00:05:03.199079+0000","last_clean":"2024-02-10T00:05:03.199079+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:03.199079+0000","last_undegraded":"2024-02-10T00:05:03.199079+0000","last_fullsized":"2024-02-10T00:05:03.199079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":518,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230882+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:05.230882+0000","last_peered":"2024-02-10T00:05:05.230882+0000","last_clean":"2024-02-10T00:05:05.230882+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:05.230882+0000","last_undegraded":"2024-02-10T00:05:05.230882+0000","last_fullsized":"2024-02-10T00:05:05.230882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213962+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:05.213962+0000","last_peered":"2024-02-10T00:05:05.213962+0000","last_clean":"2024-02-10T00:05:05.213962+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:05.213962+0000","last_undegraded":"2024-02-10T00:05:05.213962+0000","last_fullsized":"2024-02-10T00:05:05.213962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":536,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.217503+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:05.217503+0000","last_peered":"2024-02-10T00:05:05.217503+0000","last_clean":"2024-02-10T00:05:05.217503+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:05.217503+0000","last_undegraded":"2024-02-10T00:05:05.217503+0000","last_fullsized":"2024-02-10T00:05:05.217503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":855,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199156+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:03.199156+0000","last_peered":"2024-02-10T00:05:03.199156+0000","last_clean":"2024-02-10T00:05:03.199156+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:03.199156+0000","last_undegraded":"2024-02-10T00:05:03.199156+0000","last_fullsized":"2024-02-10T00:05:03.199156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213861+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:05.213861+0000","last_peered":"2024-02-10T00:05:05.213861+0000","last_clean":"2024-02-10T00:05:05.213861+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:05.213861+0000","last_undegraded":"2024-02-10T00:05:05.213861+0000","last_fullsized":"2024-02-10T00:05:05.213861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1078,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197133+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:03.197133+0000","last_peered":"2024-02-10T00:05:03.197133+0000","last_clean":"2024-02-10T00:05:03.197133+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:03.197133+0000","last_undegraded":"2024-02-10T00:05:03.197133+0000","last_fullsized":"2024-02-10T00:05:03.197133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":468,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222743+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:05.222743+0000","last_peered":"2024-02-10T00:05:05.222743+0000","last_clean":"2024-02-10T00:05:05.222743+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:05.222743+0000","last_undegraded":"2024-02-10T00:05:05.222743+0000","last_fullsized":"2024-02-10T00:05:05.222743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":974,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195850+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:03.195850+0000","last_peered":"2024-02-10T00:05:03.195850+0000","last_clean":"2024-02-10T00:05:03.195850+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:03.195850+0000","last_undegraded":"2024-02-10T00:05:03.195850+0000","last_fullsized":"2024-02-10T00:05:03.195850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":783,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198480+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:03.198480+0000","last_peered":"2024-02-10T00:05:03.198480+0000","last_clean":"2024-02-10T00:05:03.198480+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:03.198480+0000","last_undegraded":"2024-02-10T00:05:03.198480+0000","last_fullsized":"2024-02-10T00:05:03.198480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196254+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:03.196254+0000","last_peered":"2024-02-10T00:05:03.196254+0000","last_clean":"2024-02-10T00:05:03.196254+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:03.196254+0000","last_undegraded":"2024-02-10T00:05:03.196254+0000","last_fullsized":"2024-02-10T00:05:03.196254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213560+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:05.213560+0000","last_peered":"2024-02-10T00:05:05.213560+0000","last_clean":"2024-02-10T00:05:05.213560+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:05.213560+0000","last_undegraded":"2024-02-10T00:05:05.213560+0000","last_fullsized":"2024-02-10T00:05:05.213560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213529+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:05.213529+0000","last_peered":"2024-02-10T00:05:05.213529+0000","last_clean":"2024-02-10T00:05:05.213529+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:05.213529+0000","last_undegraded":"2024-02-10T00:05:05.213529+0000","last_fullsized":"2024-02-10T00:05:05.213529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1213,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224660+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:05.224660+0000","last_peered":"2024-02-10T00:05:05.224660+0000","last_clean":"2024-02-10T00:05:05.224660+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:05.224660+0000","last_undegraded":"2024-02-10T00:05:05.224660+0000","last_fullsized":"2024-02-10T00:05:05.224660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1027,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213572+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:05.213572+0000","last_peered":"2024-02-10T00:05:05.213572+0000","last_clean":"2024-02-10T00:05:05.213572+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:05.213572+0000","last_undegraded":"2024-02-10T00:05:05.213572+0000","last_fullsized":"2024-02-10T00:05:05.213572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197323+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:03.197323+0000","last_peered":"2024-02-10T00:05:03.197323+0000","last_clean":"2024-02-10T00:05:03.197323+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:03.197323+0000","last_undegraded":"2024-02-10T00:05:03.197323+0000","last_fullsized":"2024-02-10T00:05:03.197323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":880,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'353","reported_seq":394,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-10T00:05:15.247571+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:15.247571+0000","last_peered":"2024-02-10T00:05:15.247571+0000","last_clean":"2024-02-10T00:05:15.247571+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:15.247571+0000","last_undegraded":"2024-02-10T00:05:15.247571+0000","last_fullsized":"2024-02-10T00:05:15.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719545,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":251,"num_write_kb":5960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":878,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197681+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:03.197681+0000","last_peered":"2024-02-10T00:05:03.197681+0000","last_clean":"2024-02-10T00:05:03.197681+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:03.197681+0000","last_undegraded":"2024-02-10T00:05:03.197681+0000","last_fullsized":"2024-02-10T00:05:03.197681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196786+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:03.196786+0000","last_peered":"2024-02-10T00:05:03.196786+0000","last_clean":"2024-02-10T00:05:03.196786+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:03.196786+0000","last_undegraded":"2024-02-10T00:05:03.196786+0000","last_fullsized":"2024-02-10T00:05:03.196786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":914,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198975+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:03.198975+0000","last_peered":"2024-02-10T00:05:03.198975+0000","last_clean":"2024-02-10T00:05:03.198975+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:03.198975+0000","last_undegraded":"2024-02-10T00:05:03.198975+0000","last_fullsized":"2024-02-10T00:05:03.198975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199278+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:03.199278+0000","last_peered":"2024-02-10T00:05:03.199278+0000","last_clean":"2024-02-10T00:05:03.199278+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:03.199278+0000","last_undegraded":"2024-02-10T00:05:03.199278+0000","last_fullsized":"2024-02-10T00:05:03.199278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":262,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196947+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:03.196947+0000","last_peered":"2024-02-10T00:05:03.196947+0000","last_clean":"2024-02-10T00:05:03.196947+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:03.196947+0000","last_undegraded":"2024-02-10T00:05:03.196947+0000","last_fullsized":"2024-02-10T00:05:03.196947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":860,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196827+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:03.196827+0000","last_peered":"2024-02-10T00:05:03.196827+0000","last_clean":"2024-02-10T00:05:03.196827+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:03.196827+0000","last_undegraded":"2024-02-10T00:05:03.196827+0000","last_fullsized":"2024-02-10T00:05:03.196827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197380+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:03.197380+0000","last_peered":"2024-02-10T00:05:03.197380+0000","last_clean":"2024-02-10T00:05:03.197380+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:03.197380+0000","last_undegraded":"2024-02-10T00:05:03.197380+0000","last_fullsized":"2024-02-10T00:05:03.197380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":719,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213409+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:05.213409+0000","last_peered":"2024-02-10T00:05:05.213409+0000","last_clean":"2024-02-10T00:05:05.213409+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:05.213409+0000","last_undegraded":"2024-02-10T00:05:05.213409+0000","last_fullsized":"2024-02-10T00:05:05.213409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1015,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199256+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:03.199256+0000","last_peered":"2024-02-10T00:05:03.199256+0000","last_clean":"2024-02-10T00:05:03.199256+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:03.199256+0000","last_undegraded":"2024-02-10T00:05:03.199256+0000","last_fullsized":"2024-02-10T00:05:03.199256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196045+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:03.196045+0000","last_peered":"2024-02-10T00:05:03.196045+0000","last_clean":"2024-02-10T00:05:03.196045+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:03.196045+0000","last_undegraded":"2024-02-10T00:05:03.196045+0000","last_fullsized":"2024-02-10T00:05:03.196045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196536+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:03.196536+0000","last_peered":"2024-02-10T00:05:03.196536+0000","last_clean":"2024-02-10T00:05:03.196536+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:03.196536+0000","last_undegraded":"2024-02-10T00:05:03.196536+0000","last_fullsized":"2024-02-10T00:05:03.196536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":815,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198647+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:03.198647+0000","last_peered":"2024-02-10T00:05:03.198647+0000","last_clean":"2024-02-10T00:05:03.198647+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:03.198647+0000","last_undegraded":"2024-02-10T00:05:03.198647+0000","last_fullsized":"2024-02-10T00:05:03.198647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197767+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:03.197767+0000","last_peered":"2024-02-10T00:05:03.197767+0000","last_clean":"2024-02-10T00:05:03.197767+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:03.197767+0000","last_undegraded":"2024-02-10T00:05:03.197767+0000","last_fullsized":"2024-02-10T00:05:03.197767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195981+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:03.195981+0000","last_peered":"2024-02-10T00:05:03.195981+0000","last_clean":"2024-02-10T00:05:03.195981+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:03.195981+0000","last_undegraded":"2024-02-10T00:05:03.195981+0000","last_fullsized":"2024-02-10T00:05:03.195981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1441,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197598+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:03.197598+0000","last_peered":"2024-02-10T00:05:03.197598+0000","last_clean":"2024-02-10T00:05:03.197598+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:03.197598+0000","last_undegraded":"2024-02-10T00:05:03.197598+0000","last_fullsized":"2024-02-10T00:05:03.197598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198776+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:03.198776+0000","last_peered":"2024-02-10T00:05:03.198776+0000","last_clean":"2024-02-10T00:05:03.198776+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:03.198776+0000","last_undegraded":"2024-02-10T00:05:03.198776+0000","last_fullsized":"2024-02-10T00:05:03.198776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196689+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:03.196689+0000","last_peered":"2024-02-10T00:05:03.196689+0000","last_clean":"2024-02-10T00:05:03.196689+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:03.196689+0000","last_undegraded":"2024-02-10T00:05:03.196689+0000","last_fullsized":"2024-02-10T00:05:03.196689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.227876+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:05.227876+0000","last_peered":"2024-02-10T00:05:05.227876+0000","last_clean":"2024-02-10T00:05:05.227876+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:05.227876+0000","last_undegraded":"2024-02-10T00:05:05.227876+0000","last_fullsized":"2024-02-10T00:05:05.227876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213802+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:05.213802+0000","last_peered":"2024-02-10T00:05:05.213802+0000","last_clean":"2024-02-10T00:05:05.213802+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:05.213802+0000","last_undegraded":"2024-02-10T00:05:05.213802+0000","last_fullsized":"2024-02-10T00:05:05.213802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199443+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:03.199443+0000","last_peered":"2024-02-10T00:05:03.199443+0000","last_clean":"2024-02-10T00:05:03.199443+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:03.199443+0000","last_undegraded":"2024-02-10T00:05:03.199443+0000","last_fullsized":"2024-02-10T00:05:03.199443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213538+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:05.213538+0000","last_peered":"2024-02-10T00:05:05.213538+0000","last_clean":"2024-02-10T00:05:05.213538+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:05.213538+0000","last_undegraded":"2024-02-10T00:05:05.213538+0000","last_fullsized":"2024-02-10T00:05:05.213538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":463,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.223415+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:05.223415+0000","last_peered":"2024-02-10T00:05:05.223415+0000","last_clean":"2024-02-10T00:05:05.223415+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:05.223415+0000","last_undegraded":"2024-02-10T00:05:05.223415+0000","last_fullsized":"2024-02-10T00:05:05.223415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198344+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:03.198344+0000","last_peered":"2024-02-10T00:05:03.198344+0000","last_clean":"2024-02-10T00:05:03.198344+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:03.198344+0000","last_undegraded":"2024-02-10T00:05:03.198344+0000","last_fullsized":"2024-02-10T00:05:03.198344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197213+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:03.197213+0000","last_peered":"2024-02-10T00:05:03.197213+0000","last_clean":"2024-02-10T00:05:03.197213+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:03.197213+0000","last_undegraded":"2024-02-10T00:05:03.197213+0000","last_fullsized":"2024-02-10T00:05:03.197213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199060+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:03.199060+0000","last_peered":"2024-02-10T00:05:03.199060+0000","last_clean":"2024-02-10T00:05:03.199060+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:03.199060+0000","last_undegraded":"2024-02-10T00:05:03.199060+0000","last_fullsized":"2024-02-10T00:05:03.199060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":771,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:06.580430+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:06.580430+0000","last_peered":"2024-02-10T00:05:06.580430+0000","last_clean":"2024-02-10T00:05:06.580430+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:06.580430+0000","last_undegraded":"2024-02-10T00:05:06.580430+0000","last_fullsized":"2024-02-10T00:05:06.580430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":902,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195971+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:03.195971+0000","last_peered":"2024-02-10T00:05:03.195971+0000","last_clean":"2024-02-10T00:05:03.195971+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:03.195971+0000","last_undegraded":"2024-02-10T00:05:03.195971+0000","last_fullsized":"2024-02-10T00:05:03.195971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213667+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:05.213667+0000","last_peered":"2024-02-10T00:05:05.213667+0000","last_clean":"2024-02-10T00:05:05.213667+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:05.213667+0000","last_undegraded":"2024-02-10T00:05:05.213667+0000","last_fullsized":"2024-02-10T00:05:05.213667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":945,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196837+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:03.196837+0000","last_peered":"2024-02-10T00:05:03.196837+0000","last_clean":"2024-02-10T00:05:03.196837+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:03.196837+0000","last_undegraded":"2024-02-10T00:05:03.196837+0000","last_fullsized":"2024-02-10T00:05:03.196837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":458,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222066+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:05.222066+0000","last_peered":"2024-02-10T00:05:05.222066+0000","last_clean":"2024-02-10T00:05:05.222066+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:05.222066+0000","last_undegraded":"2024-02-10T00:05:05.222066+0000","last_fullsized":"2024-02-10T00:05:05.222066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":899,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198335+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:03.198335+0000","last_peered":"2024-02-10T00:05:03.198335+0000","last_clean":"2024-02-10T00:05:03.198335+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:03.198335+0000","last_undegraded":"2024-02-10T00:05:03.198335+0000","last_fullsized":"2024-02-10T00:05:03.198335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"40'619","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230416+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:05.230416+0000","last_peered":"2024-02-10T00:05:05.230416+0000","last_clean":"2024-02-10T00:05:05.230416+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:05.230416+0000","last_undegraded":"2024-02-10T00:05:05.230416+0000","last_fullsized":"2024-02-10T00:05:05.230416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196160+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:03.196160+0000","last_peered":"2024-02-10T00:05:03.196160+0000","last_clean":"2024-02-10T00:05:03.196160+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:03.196160+0000","last_undegraded":"2024-02-10T00:05:03.196160+0000","last_fullsized":"2024-02-10T00:05:03.196160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":293,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198820+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:03.198820+0000","last_peered":"2024-02-10T00:05:03.198820+0000","last_clean":"2024-02-10T00:05:03.198820+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:03.198820+0000","last_undegraded":"2024-02-10T00:05:03.198820+0000","last_fullsized":"2024-02-10T00:05:03.198820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198835+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:03.198835+0000","last_peered":"2024-02-10T00:05:03.198835+0000","last_clean":"2024-02-10T00:05:03.198835+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:03.198835+0000","last_undegraded":"2024-02-10T00:05:03.198835+0000","last_fullsized":"2024-02-10T00:05:03.198835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":237,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214149+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:05.214149+0000","last_peered":"2024-02-10T00:05:05.214149+0000","last_clean":"2024-02-10T00:05:05.214149+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:05.214149+0000","last_undegraded":"2024-02-10T00:05:05.214149+0000","last_fullsized":"2024-02-10T00:05:05.214149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195846+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:03.195846+0000","last_peered":"2024-02-10T00:05:03.195846+0000","last_clean":"2024-02-10T00:05:03.195846+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:03.195846+0000","last_undegraded":"2024-02-10T00:05:03.195846+0000","last_fullsized":"2024-02-10T00:05:03.195846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":932,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196490+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:03.196490+0000","last_peered":"2024-02-10T00:05:03.196490+0000","last_clean":"2024-02-10T00:05:03.196490+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:03.196490+0000","last_undegraded":"2024-02-10T00:05:03.196490+0000","last_fullsized":"2024-02-10T00:05:03.196490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198995+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:03.198995+0000","last_peered":"2024-02-10T00:05:03.198995+0000","last_clean":"2024-02-10T00:05:03.198995+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:03.198995+0000","last_undegraded":"2024-02-10T00:05:03.198995+0000","last_fullsized":"2024-02-10T00:05:03.198995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":962,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213340+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:05.213340+0000","last_peered":"2024-02-10T00:05:05.213340+0000","last_clean":"2024-02-10T00:05:05.213340+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:05.213340+0000","last_undegraded":"2024-02-10T00:05:05.213340+0000","last_fullsized":"2024-02-10T00:05:05.213340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":921,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198250+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:03.198250+0000","last_peered":"2024-02-10T00:05:03.198250+0000","last_clean":"2024-02-10T00:05:03.198250+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:03.198250+0000","last_undegraded":"2024-02-10T00:05:03.198250+0000","last_fullsized":"2024-02-10T00:05:03.198250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":789,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199382+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:03.199382+0000","last_peered":"2024-02-10T00:05:03.199382+0000","last_clean":"2024-02-10T00:05:03.199382+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:03.199382+0000","last_undegraded":"2024-02-10T00:05:03.199382+0000","last_fullsized":"2024-02-10T00:05:03.199382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147636729,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16347,"num_write_kb":272987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19928,"ondisk_log_size":19928,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423740,"kb_used_data":97972,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948100,"statfs":{"total":96636764160,"available":96202854400,"internally_reserved":0,"allocated":100323328,"data_stored":100089420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":2,"up_from":29,"seq":124554051593,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365292,"kb_used_data":61284,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006548,"statfs":{"total":96636764160,"available":96262705152,"internally_reserved":0,"allocated":62754816,"data_stored":62544120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084297,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376816,"kb_used_data":72104,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995024,"statfs":{"total":96636764160,"available":96250904576,"internally_reserved":0,"allocated":73834496,"data_stored":73613584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084297,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371548,"kb_used_data":59604,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000292,"statfs":{"total":96636764160,"available":96256299008,"internally_reserved":0,"allocated":61034496,"data_stored":60827546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99933815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:27.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:28.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.096+0000 7f979633f700 1 Processor -- start 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.096+0000 7f979633f700 1 -- start start 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f979633f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 0x7f97900a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f979633f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 0x7f97900a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f979633f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9790063b10 con 0x7f9790063740 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f979633f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790139bb0 con 0x7f979013f6e0 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f979633f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97900a2100 con 0x7f97900a5130 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 0x7f97900a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 0x7f97900a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f978ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9790063740 0x7f979013fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51738/0 (socket says 172.21.15.89:51738) 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f978ffff700 1 -- 172.21.15.89:0/3443566510 learned_addr learned my addr 172.21.15.89:0/3443566510 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f978effd700 1 -- 172.21.15.89:0/3443566510 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476486505 0 0) 0x7f9790063b10 con 0x7f9790063740 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 -- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 msgr2=0x7f97900a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 0x7f97900a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 -- 172.21.15.89:0/3443566510 >> v1:172.21.15.89:6789/0 conn(0x7f9790063740 legacy=0x7f979013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 -- 172.21.15.89:0/3443566510 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979013fb70 con 0x7f97900a5130 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f978f7fe700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 0x7f97900a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.097+0000 7f97948dc700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 0x7f97900a29a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9788009e90 tx=0x7f9788009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be4a19d8ecaae4a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f978effd700 1 -- 172.21.15.89:0/3443566510 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800e070 con 0x7f97900a5130 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f978effd700 1 -- 172.21.15.89:0/3443566510 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800bcc0 con 0x7f97900a5130 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f978effd700 1 -- 172.21.15.89:0/3443566510 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788012660 con 0x7f97900a5130 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 -- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 msgr2=0x7f97900a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 0x7f97900a29a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9788009e90 tx=0x7f9788009780 comp rx=0 tx=0).stop 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 -- 172.21.15.89:0/3443566510 shutdown_connections 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f97900a5130 0x7f97900a29a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 --2- 172.21.15.89:0/3443566510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979013f6e0 0x7f97900a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 -- 172.21.15.89:0/3443566510 >> 172.21.15.89:0/3443566510 conn(0x7f979006a820 msgr2=0x7f97900b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 -- 172.21.15.89:0/3443566510 shutdown_connections 2024-02-10T00:05:28.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.098+0000 7f979633f700 1 -- 172.21.15.89:0/3443566510 wait complete. 2024-02-10T00:05:28.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.099+0000 7f979633f700 1 Processor -- start 2024-02-10T00:05:28.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.099+0000 7f979633f700 1 -- start start 2024-02-10T00:05:28.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 0x7f9790144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 0x7f979014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9790145510 con 0x7f97900a5130 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900a67e0 con 0x7f9790063740 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97900a71f0 con 0x7f979013f6e0 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 0x7f9790144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37866/0 (socket says 172.21.15.89:37866) 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978ffff700 1 -- 172.21.15.89:0/2049765159 learned_addr learned my addr 172.21.15.89:0/2049765159 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f97948dc700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 0x7f979014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 -- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 msgr2=0x7f979014f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 0x7f979014f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 -- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 msgr2=0x7f97900a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 -- 172.21.15.89:0/2049765159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009420 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978ffff700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f97948dc700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 0x7f979014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f978f7fe700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 0x7f9790144880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f978000ea30 tx=0x7f97800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000ee70 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000c850 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9788009a20 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.100+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000cbf0 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.101+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97900ae640 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.101+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979004c710 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.102+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9780013470 con 0x7f97900a5130 2024-02-10T00:05:28.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.102+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f978005bbd0 con 0x7f97900a5130 2024-02-10T00:05:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.105+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f9780039d10 con 0x7f97900a5130 2024-02-10T00:05:28.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.256+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9790140520 con 0x7f977c0460c0 2024-02-10T00:05:28.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.263+0000 7f9777fff700 1 -- 172.21.15.89:0/2049765159 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273448 (unknown 2965378022 0 2924309598) 0x7f9790140520 con 0x7f977c0460c0 2024-02-10T00:05:28.268 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:28.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 >> v1:172.21.15.89:6816/47970 conn(0x7f977c0460c0 legacy=0x7f977c048570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 msgr2=0x7f9790144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 0x7f9790144880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f978000ea30 tx=0x7f97800091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 shutdown_connections 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f979013f6e0 0x7f979014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9790063740 0x7f97900a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 --2- 172.21.15.89:0/2049765159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97900a5130 0x7f9790144880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 >> 172.21.15.89:0/2049765159 conn(0x7f979006a820 msgr2=0x7f9790139f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 shutdown_connections 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.265+0000 7f979633f700 1 -- 172.21.15.89:0/2049765159 wait complete. 2024-02-10T00:05:28.271 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:28.281 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-02-10T00:05:28.144500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227097,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65350,"num_write_kb":9046232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71787,"ondisk_log_size":71787,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537396,"kb_used_data":290964,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375949964,"statfs":{"total":386547056640,"available":384972763136,"internally_reserved":0,"allocated":297947136,"data_stored":297074670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002768"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195716+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:03.195716+0000","last_peered":"2024-02-10T00:05:03.195716+0000","last_clean":"2024-02-10T00:05:03.195716+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:03.195716+0000","last_undegraded":"2024-02-10T00:05:03.195716+0000","last_fullsized":"2024-02-10T00:05:03.195716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197351+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:03.197351+0000","last_peered":"2024-02-10T00:05:03.197351+0000","last_clean":"2024-02-10T00:05:03.197351+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:03.197351+0000","last_undegraded":"2024-02-10T00:05:03.197351+0000","last_fullsized":"2024-02-10T00:05:03.197351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":909,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213630+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:05.213630+0000","last_peered":"2024-02-10T00:05:05.213630+0000","last_clean":"2024-02-10T00:05:05.213630+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:05.213630+0000","last_undegraded":"2024-02-10T00:05:05.213630+0000","last_fullsized":"2024-02-10T00:05:05.213630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213695+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:05.213695+0000","last_peered":"2024-02-10T00:05:05.213695+0000","last_clean":"2024-02-10T00:05:05.213695+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:05.213695+0000","last_undegraded":"2024-02-10T00:05:05.213695+0000","last_fullsized":"2024-02-10T00:05:05.213695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213378+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:05.213378+0000","last_peered":"2024-02-10T00:05:05.213378+0000","last_clean":"2024-02-10T00:05:05.213378+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:05.213378+0000","last_undegraded":"2024-02-10T00:05:05.213378+0000","last_fullsized":"2024-02-10T00:05:05.213378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":867,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197512+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:03.197512+0000","last_peered":"2024-02-10T00:05:03.197512+0000","last_clean":"2024-02-10T00:05:03.197512+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:03.197512+0000","last_undegraded":"2024-02-10T00:05:03.197512+0000","last_fullsized":"2024-02-10T00:05:03.197512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199254+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:03.199254+0000","last_peered":"2024-02-10T00:05:03.199254+0000","last_clean":"2024-02-10T00:05:03.199254+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:03.199254+0000","last_undegraded":"2024-02-10T00:05:03.199254+0000","last_fullsized":"2024-02-10T00:05:03.199254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":798,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196252+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:03.196252+0000","last_peered":"2024-02-10T00:05:03.196252+0000","last_clean":"2024-02-10T00:05:03.196252+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:03.196252+0000","last_undegraded":"2024-02-10T00:05:03.196252+0000","last_fullsized":"2024-02-10T00:05:03.196252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":927,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213994+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:05.213994+0000","last_peered":"2024-02-10T00:05:05.213994+0000","last_clean":"2024-02-10T00:05:05.213994+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:05.213994+0000","last_undegraded":"2024-02-10T00:05:05.213994+0000","last_fullsized":"2024-02-10T00:05:05.213994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197889+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:03.197889+0000","last_peered":"2024-02-10T00:05:03.197889+0000","last_clean":"2024-02-10T00:05:03.197889+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:03.197889+0000","last_undegraded":"2024-02-10T00:05:03.197889+0000","last_fullsized":"2024-02-10T00:05:03.197889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":845,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197279+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:03.197279+0000","last_peered":"2024-02-10T00:05:03.197279+0000","last_clean":"2024-02-10T00:05:03.197279+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:03.197279+0000","last_undegraded":"2024-02-10T00:05:03.197279+0000","last_fullsized":"2024-02-10T00:05:03.197279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196527+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:03.196527+0000","last_peered":"2024-02-10T00:05:03.196527+0000","last_clean":"2024-02-10T00:05:03.196527+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:03.196527+0000","last_undegraded":"2024-02-10T00:05:03.196527+0000","last_fullsized":"2024-02-10T00:05:03.196527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":964,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198230+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:03.198230+0000","last_peered":"2024-02-10T00:05:03.198230+0000","last_clean":"2024-02-10T00:05:03.198230+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:03.198230+0000","last_undegraded":"2024-02-10T00:05:03.198230+0000","last_fullsized":"2024-02-10T00:05:03.198230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":936,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195642+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:03.195642+0000","last_peered":"2024-02-10T00:05:03.195642+0000","last_clean":"2024-02-10T00:05:03.195642+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:03.195642+0000","last_undegraded":"2024-02-10T00:05:03.195642+0000","last_fullsized":"2024-02-10T00:05:03.195642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213324+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:05.213324+0000","last_peered":"2024-02-10T00:05:05.213324+0000","last_clean":"2024-02-10T00:05:05.213324+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:05.213324+0000","last_undegraded":"2024-02-10T00:05:05.213324+0000","last_fullsized":"2024-02-10T00:05:05.213324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197103+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:03.197103+0000","last_peered":"2024-02-10T00:05:03.197103+0000","last_clean":"2024-02-10T00:05:03.197103+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:03.197103+0000","last_undegraded":"2024-02-10T00:05:03.197103+0000","last_fullsized":"2024-02-10T00:05:03.197103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":982,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214235+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:05.214235+0000","last_peered":"2024-02-10T00:05:05.214235+0000","last_clean":"2024-02-10T00:05:05.214235+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:05.214235+0000","last_undegraded":"2024-02-10T00:05:05.214235+0000","last_fullsized":"2024-02-10T00:05:05.214235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":782,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213633+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:05.213633+0000","last_peered":"2024-02-10T00:05:05.213633+0000","last_clean":"2024-02-10T00:05:05.213633+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:05.213633+0000","last_undegraded":"2024-02-10T00:05:05.213633+0000","last_fullsized":"2024-02-10T00:05:05.213633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1013,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197053+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:03.197053+0000","last_peered":"2024-02-10T00:05:03.197053+0000","last_clean":"2024-02-10T00:05:03.197053+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:03.197053+0000","last_undegraded":"2024-02-10T00:05:03.197053+0000","last_fullsized":"2024-02-10T00:05:03.197053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":889,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199354+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:03.199354+0000","last_peered":"2024-02-10T00:05:03.199354+0000","last_clean":"2024-02-10T00:05:03.199354+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:03.199354+0000","last_undegraded":"2024-02-10T00:05:03.199354+0000","last_fullsized":"2024-02-10T00:05:03.199354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196764+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:03.196764+0000","last_peered":"2024-02-10T00:05:03.196764+0000","last_clean":"2024-02-10T00:05:03.196764+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:03.196764+0000","last_undegraded":"2024-02-10T00:05:03.196764+0000","last_fullsized":"2024-02-10T00:05:03.196764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":963,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213262+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:05.213262+0000","last_peered":"2024-02-10T00:05:05.213262+0000","last_clean":"2024-02-10T00:05:05.213262+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:05.213262+0000","last_undegraded":"2024-02-10T00:05:05.213262+0000","last_fullsized":"2024-02-10T00:05:05.213262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198737+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:03.198737+0000","last_peered":"2024-02-10T00:05:03.198737+0000","last_clean":"2024-02-10T00:05:03.198737+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:03.198737+0000","last_undegraded":"2024-02-10T00:05:03.198737+0000","last_fullsized":"2024-02-10T00:05:03.198737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":957,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196109+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:03.196109+0000","last_peered":"2024-02-10T00:05:03.196109+0000","last_clean":"2024-02-10T00:05:03.196109+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:03.196109+0000","last_undegraded":"2024-02-10T00:05:03.196109+0000","last_fullsized":"2024-02-10T00:05:03.196109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":978,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198463+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:03.198463+0000","last_peered":"2024-02-10T00:05:03.198463+0000","last_clean":"2024-02-10T00:05:03.198463+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:03.198463+0000","last_undegraded":"2024-02-10T00:05:03.198463+0000","last_fullsized":"2024-02-10T00:05:03.198463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198261+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:03.198261+0000","last_peered":"2024-02-10T00:05:03.198261+0000","last_clean":"2024-02-10T00:05:03.198261+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:03.198261+0000","last_undegraded":"2024-02-10T00:05:03.198261+0000","last_fullsized":"2024-02-10T00:05:03.198261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198656+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:03.198656+0000","last_peered":"2024-02-10T00:05:03.198656+0000","last_clean":"2024-02-10T00:05:03.198656+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:03.198656+0000","last_undegraded":"2024-02-10T00:05:03.198656+0000","last_fullsized":"2024-02-10T00:05:03.198656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1506,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196257+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:03.196257+0000","last_peered":"2024-02-10T00:05:03.196257+0000","last_clean":"2024-02-10T00:05:03.196257+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:03.196257+0000","last_undegraded":"2024-02-10T00:05:03.196257+0000","last_fullsized":"2024-02-10T00:05:03.196257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":872,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199077+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:03.199077+0000","last_peered":"2024-02-10T00:05:03.199077+0000","last_clean":"2024-02-10T00:05:03.199077+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:03.199077+0000","last_undegraded":"2024-02-10T00:05:03.199077+0000","last_fullsized":"2024-02-10T00:05:03.199077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195557+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:03.195557+0000","last_peered":"2024-02-10T00:05:03.195557+0000","last_clean":"2024-02-10T00:05:03.195557+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:03.195557+0000","last_undegraded":"2024-02-10T00:05:03.195557+0000","last_fullsized":"2024-02-10T00:05:03.195557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213874+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:05.213874+0000","last_peered":"2024-02-10T00:05:05.213874+0000","last_clean":"2024-02-10T00:05:05.213874+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:05.213874+0000","last_undegraded":"2024-02-10T00:05:05.213874+0000","last_fullsized":"2024-02-10T00:05:05.213874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197314+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:03.197314+0000","last_peered":"2024-02-10T00:05:03.197314+0000","last_clean":"2024-02-10T00:05:03.197314+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:03.197314+0000","last_undegraded":"2024-02-10T00:05:03.197314+0000","last_fullsized":"2024-02-10T00:05:03.197314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":905,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199608+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:03.199608+0000","last_peered":"2024-02-10T00:05:03.199608+0000","last_clean":"2024-02-10T00:05:03.199608+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:03.199608+0000","last_undegraded":"2024-02-10T00:05:03.199608+0000","last_fullsized":"2024-02-10T00:05:03.199608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224740+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:05.224740+0000","last_peered":"2024-02-10T00:05:05.224740+0000","last_clean":"2024-02-10T00:05:05.224740+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:05.224740+0000","last_undegraded":"2024-02-10T00:05:05.224740+0000","last_fullsized":"2024-02-10T00:05:05.224740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197256+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:03.197256+0000","last_peered":"2024-02-10T00:05:03.197256+0000","last_clean":"2024-02-10T00:05:03.197256+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:03.197256+0000","last_undegraded":"2024-02-10T00:05:03.197256+0000","last_fullsized":"2024-02-10T00:05:03.197256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197162+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:03.197162+0000","last_peered":"2024-02-10T00:05:03.197162+0000","last_clean":"2024-02-10T00:05:03.197162+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:03.197162+0000","last_undegraded":"2024-02-10T00:05:03.197162+0000","last_fullsized":"2024-02-10T00:05:03.197162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1062,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199166+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:03.199166+0000","last_peered":"2024-02-10T00:05:03.199166+0000","last_clean":"2024-02-10T00:05:03.199166+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:03.199166+0000","last_undegraded":"2024-02-10T00:05:03.199166+0000","last_fullsized":"2024-02-10T00:05:03.199166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":437,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.233703+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:05.233703+0000","last_peered":"2024-02-10T00:05:05.233703+0000","last_clean":"2024-02-10T00:05:05.233703+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:05.233703+0000","last_undegraded":"2024-02-10T00:05:05.233703+0000","last_fullsized":"2024-02-10T00:05:05.233703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196962+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:03.196962+0000","last_peered":"2024-02-10T00:05:03.196962+0000","last_clean":"2024-02-10T00:05:03.196962+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:03.196962+0000","last_undegraded":"2024-02-10T00:05:03.196962+0000","last_fullsized":"2024-02-10T00:05:03.196962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":704,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222215+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:05.222215+0000","last_peered":"2024-02-10T00:05:05.222215+0000","last_clean":"2024-02-10T00:05:05.222215+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:05.222215+0000","last_undegraded":"2024-02-10T00:05:05.222215+0000","last_fullsized":"2024-02-10T00:05:05.222215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":995,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198125+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:03.198125+0000","last_peered":"2024-02-10T00:05:03.198125+0000","last_clean":"2024-02-10T00:05:03.198125+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:03.198125+0000","last_undegraded":"2024-02-10T00:05:03.198125+0000","last_fullsized":"2024-02-10T00:05:03.198125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":435,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.208215+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:05.208215+0000","last_peered":"2024-02-10T00:05:05.208215+0000","last_clean":"2024-02-10T00:05:05.208215+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:05.208215+0000","last_undegraded":"2024-02-10T00:05:05.208215+0000","last_fullsized":"2024-02-10T00:05:05.208215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1094,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198114+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:03.198114+0000","last_peered":"2024-02-10T00:05:03.198114+0000","last_clean":"2024-02-10T00:05:03.198114+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:03.198114+0000","last_undegraded":"2024-02-10T00:05:03.198114+0000","last_fullsized":"2024-02-10T00:05:03.198114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213248+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:05.213248+0000","last_peered":"2024-02-10T00:05:05.213248+0000","last_clean":"2024-02-10T00:05:05.213248+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:05.213248+0000","last_undegraded":"2024-02-10T00:05:05.213248+0000","last_fullsized":"2024-02-10T00:05:05.213248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":960,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199079+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:03.199079+0000","last_peered":"2024-02-10T00:05:03.199079+0000","last_clean":"2024-02-10T00:05:03.199079+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:03.199079+0000","last_undegraded":"2024-02-10T00:05:03.199079+0000","last_fullsized":"2024-02-10T00:05:03.199079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":518,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230882+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:05.230882+0000","last_peered":"2024-02-10T00:05:05.230882+0000","last_clean":"2024-02-10T00:05:05.230882+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:05.230882+0000","last_undegraded":"2024-02-10T00:05:05.230882+0000","last_fullsized":"2024-02-10T00:05:05.230882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213962+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:05.213962+0000","last_peered":"2024-02-10T00:05:05.213962+0000","last_clean":"2024-02-10T00:05:05.213962+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:05.213962+0000","last_undegraded":"2024-02-10T00:05:05.213962+0000","last_fullsized":"2024-02-10T00:05:05.213962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":536,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.217503+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:05.217503+0000","last_peered":"2024-02-10T00:05:05.217503+0000","last_clean":"2024-02-10T00:05:05.217503+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:05.217503+0000","last_undegraded":"2024-02-10T00:05:05.217503+0000","last_fullsized":"2024-02-10T00:05:05.217503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":855,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199156+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:03.199156+0000","last_peered":"2024-02-10T00:05:03.199156+0000","last_clean":"2024-02-10T00:05:03.199156+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:03.199156+0000","last_undegraded":"2024-02-10T00:05:03.199156+0000","last_fullsized":"2024-02-10T00:05:03.199156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213861+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:05.213861+0000","last_peered":"2024-02-10T00:05:05.213861+0000","last_clean":"2024-02-10T00:05:05.213861+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:05.213861+0000","last_undegraded":"2024-02-10T00:05:05.213861+0000","last_fullsized":"2024-02-10T00:05:05.213861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1078,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197133+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:03.197133+0000","last_peered":"2024-02-10T00:05:03.197133+0000","last_clean":"2024-02-10T00:05:03.197133+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:03.197133+0000","last_undegraded":"2024-02-10T00:05:03.197133+0000","last_fullsized":"2024-02-10T00:05:03.197133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":468,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222743+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:05.222743+0000","last_peered":"2024-02-10T00:05:05.222743+0000","last_clean":"2024-02-10T00:05:05.222743+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:05.222743+0000","last_undegraded":"2024-02-10T00:05:05.222743+0000","last_fullsized":"2024-02-10T00:05:05.222743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":974,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195850+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:03.195850+0000","last_peered":"2024-02-10T00:05:03.195850+0000","last_clean":"2024-02-10T00:05:03.195850+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:03.195850+0000","last_undegraded":"2024-02-10T00:05:03.195850+0000","last_fullsized":"2024-02-10T00:05:03.195850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":783,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198480+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:03.198480+0000","last_peered":"2024-02-10T00:05:03.198480+0000","last_clean":"2024-02-10T00:05:03.198480+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:03.198480+0000","last_undegraded":"2024-02-10T00:05:03.198480+0000","last_fullsized":"2024-02-10T00:05:03.198480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196254+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:03.196254+0000","last_peered":"2024-02-10T00:05:03.196254+0000","last_clean":"2024-02-10T00:05:03.196254+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:03.196254+0000","last_undegraded":"2024-02-10T00:05:03.196254+0000","last_fullsized":"2024-02-10T00:05:03.196254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213560+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:05.213560+0000","last_peered":"2024-02-10T00:05:05.213560+0000","last_clean":"2024-02-10T00:05:05.213560+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:05.213560+0000","last_undegraded":"2024-02-10T00:05:05.213560+0000","last_fullsized":"2024-02-10T00:05:05.213560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213529+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:05.213529+0000","last_peered":"2024-02-10T00:05:05.213529+0000","last_clean":"2024-02-10T00:05:05.213529+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:05.213529+0000","last_undegraded":"2024-02-10T00:05:05.213529+0000","last_fullsized":"2024-02-10T00:05:05.213529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1213,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224660+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:05.224660+0000","last_peered":"2024-02-10T00:05:05.224660+0000","last_clean":"2024-02-10T00:05:05.224660+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:05.224660+0000","last_undegraded":"2024-02-10T00:05:05.224660+0000","last_fullsized":"2024-02-10T00:05:05.224660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1027,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213572+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:05.213572+0000","last_peered":"2024-02-10T00:05:05.213572+0000","last_clean":"2024-02-10T00:05:05.213572+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:05.213572+0000","last_undegraded":"2024-02-10T00:05:05.213572+0000","last_fullsized":"2024-02-10T00:05:05.213572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197323+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:03.197323+0000","last_peered":"2024-02-10T00:05:03.197323+0000","last_clean":"2024-02-10T00:05:03.197323+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:03.197323+0000","last_undegraded":"2024-02-10T00:05:03.197323+0000","last_fullsized":"2024-02-10T00:05:03.197323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":880,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'353","reported_seq":394,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-10T00:05:15.247571+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:15.247571+0000","last_peered":"2024-02-10T00:05:15.247571+0000","last_clean":"2024-02-10T00:05:15.247571+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:15.247571+0000","last_undegraded":"2024-02-10T00:05:15.247571+0000","last_fullsized":"2024-02-10T00:05:15.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719545,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":251,"num_write_kb":5960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":878,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197681+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:03.197681+0000","last_peered":"2024-02-10T00:05:03.197681+0000","last_clean":"2024-02-10T00:05:03.197681+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:03.197681+0000","last_undegraded":"2024-02-10T00:05:03.197681+0000","last_fullsized":"2024-02-10T00:05:03.197681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196786+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:03.196786+0000","last_peered":"2024-02-10T00:05:03.196786+0000","last_clean":"2024-02-10T00:05:03.196786+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:03.196786+0000","last_undegraded":"2024-02-10T00:05:03.196786+0000","last_fullsized":"2024-02-10T00:05:03.196786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":914,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198975+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:03.198975+0000","last_peered":"2024-02-10T00:05:03.198975+0000","last_clean":"2024-02-10T00:05:03.198975+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:03.198975+0000","last_undegraded":"2024-02-10T00:05:03.198975+0000","last_fullsized":"2024-02-10T00:05:03.198975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199278+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:03.199278+0000","last_peered":"2024-02-10T00:05:03.199278+0000","last_clean":"2024-02-10T00:05:03.199278+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:03.199278+0000","last_undegraded":"2024-02-10T00:05:03.199278+0000","last_fullsized":"2024-02-10T00:05:03.199278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":262,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196947+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:03.196947+0000","last_peered":"2024-02-10T00:05:03.196947+0000","last_clean":"2024-02-10T00:05:03.196947+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:03.196947+0000","last_undegraded":"2024-02-10T00:05:03.196947+0000","last_fullsized":"2024-02-10T00:05:03.196947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":860,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196827+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:03.196827+0000","last_peered":"2024-02-10T00:05:03.196827+0000","last_clean":"2024-02-10T00:05:03.196827+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:03.196827+0000","last_undegraded":"2024-02-10T00:05:03.196827+0000","last_fullsized":"2024-02-10T00:05:03.196827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197380+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:03.197380+0000","last_peered":"2024-02-10T00:05:03.197380+0000","last_clean":"2024-02-10T00:05:03.197380+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:03.197380+0000","last_undegraded":"2024-02-10T00:05:03.197380+0000","last_fullsized":"2024-02-10T00:05:03.197380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":719,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213409+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:05.213409+0000","last_peered":"2024-02-10T00:05:05.213409+0000","last_clean":"2024-02-10T00:05:05.213409+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:05.213409+0000","last_undegraded":"2024-02-10T00:05:05.213409+0000","last_fullsized":"2024-02-10T00:05:05.213409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1015,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199256+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:03.199256+0000","last_peered":"2024-02-10T00:05:03.199256+0000","last_clean":"2024-02-10T00:05:03.199256+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:03.199256+0000","last_undegraded":"2024-02-10T00:05:03.199256+0000","last_fullsized":"2024-02-10T00:05:03.199256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196045+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:03.196045+0000","last_peered":"2024-02-10T00:05:03.196045+0000","last_clean":"2024-02-10T00:05:03.196045+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:03.196045+0000","last_undegraded":"2024-02-10T00:05:03.196045+0000","last_fullsized":"2024-02-10T00:05:03.196045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196536+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:03.196536+0000","last_peered":"2024-02-10T00:05:03.196536+0000","last_clean":"2024-02-10T00:05:03.196536+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:03.196536+0000","last_undegraded":"2024-02-10T00:05:03.196536+0000","last_fullsized":"2024-02-10T00:05:03.196536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":815,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198647+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:03.198647+0000","last_peered":"2024-02-10T00:05:03.198647+0000","last_clean":"2024-02-10T00:05:03.198647+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:03.198647+0000","last_undegraded":"2024-02-10T00:05:03.198647+0000","last_fullsized":"2024-02-10T00:05:03.198647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197767+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:03.197767+0000","last_peered":"2024-02-10T00:05:03.197767+0000","last_clean":"2024-02-10T00:05:03.197767+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:03.197767+0000","last_undegraded":"2024-02-10T00:05:03.197767+0000","last_fullsized":"2024-02-10T00:05:03.197767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195981+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:03.195981+0000","last_peered":"2024-02-10T00:05:03.195981+0000","last_clean":"2024-02-10T00:05:03.195981+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:03.195981+0000","last_undegraded":"2024-02-10T00:05:03.195981+0000","last_fullsized":"2024-02-10T00:05:03.195981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1441,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197598+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:03.197598+0000","last_peered":"2024-02-10T00:05:03.197598+0000","last_clean":"2024-02-10T00:05:03.197598+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:03.197598+0000","last_undegraded":"2024-02-10T00:05:03.197598+0000","last_fullsized":"2024-02-10T00:05:03.197598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198776+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:03.198776+0000","last_peered":"2024-02-10T00:05:03.198776+0000","last_clean":"2024-02-10T00:05:03.198776+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:03.198776+0000","last_undegraded":"2024-02-10T00:05:03.198776+0000","last_fullsized":"2024-02-10T00:05:03.198776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196689+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:03.196689+0000","last_peered":"2024-02-10T00:05:03.196689+0000","last_clean":"2024-02-10T00:05:03.196689+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:03.196689+0000","last_undegraded":"2024-02-10T00:05:03.196689+0000","last_fullsized":"2024-02-10T00:05:03.196689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.227876+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:05.227876+0000","last_peered":"2024-02-10T00:05:05.227876+0000","last_clean":"2024-02-10T00:05:05.227876+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:05.227876+0000","last_undegraded":"2024-02-10T00:05:05.227876+0000","last_fullsized":"2024-02-10T00:05:05.227876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213802+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:05.213802+0000","last_peered":"2024-02-10T00:05:05.213802+0000","last_clean":"2024-02-10T00:05:05.213802+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:05.213802+0000","last_undegraded":"2024-02-10T00:05:05.213802+0000","last_fullsized":"2024-02-10T00:05:05.213802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199443+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:03.199443+0000","last_peered":"2024-02-10T00:05:03.199443+0000","last_clean":"2024-02-10T00:05:03.199443+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:03.199443+0000","last_undegraded":"2024-02-10T00:05:03.199443+0000","last_fullsized":"2024-02-10T00:05:03.199443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213538+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:05.213538+0000","last_peered":"2024-02-10T00:05:05.213538+0000","last_clean":"2024-02-10T00:05:05.213538+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:05.213538+0000","last_undegraded":"2024-02-10T00:05:05.213538+0000","last_fullsized":"2024-02-10T00:05:05.213538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":463,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.223415+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:05.223415+0000","last_peered":"2024-02-10T00:05:05.223415+0000","last_clean":"2024-02-10T00:05:05.223415+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:05.223415+0000","last_undegraded":"2024-02-10T00:05:05.223415+0000","last_fullsized":"2024-02-10T00:05:05.223415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198344+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:03.198344+0000","last_peered":"2024-02-10T00:05:03.198344+0000","last_clean":"2024-02-10T00:05:03.198344+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:03.198344+0000","last_undegraded":"2024-02-10T00:05:03.198344+0000","last_fullsized":"2024-02-10T00:05:03.198344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197213+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:03.197213+0000","last_peered":"2024-02-10T00:05:03.197213+0000","last_clean":"2024-02-10T00:05:03.197213+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:03.197213+0000","last_undegraded":"2024-02-10T00:05:03.197213+0000","last_fullsized":"2024-02-10T00:05:03.197213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199060+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:03.199060+0000","last_peered":"2024-02-10T00:05:03.199060+0000","last_clean":"2024-02-10T00:05:03.199060+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:03.199060+0000","last_undegraded":"2024-02-10T00:05:03.199060+0000","last_fullsized":"2024-02-10T00:05:03.199060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":771,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:06.580430+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:06.580430+0000","last_peered":"2024-02-10T00:05:06.580430+0000","last_clean":"2024-02-10T00:05:06.580430+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:06.580430+0000","last_undegraded":"2024-02-10T00:05:06.580430+0000","last_fullsized":"2024-02-10T00:05:06.580430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":902,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195971+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:03.195971+0000","last_peered":"2024-02-10T00:05:03.195971+0000","last_clean":"2024-02-10T00:05:03.195971+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:03.195971+0000","last_undegraded":"2024-02-10T00:05:03.195971+0000","last_fullsized":"2024-02-10T00:05:03.195971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213667+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:05.213667+0000","last_peered":"2024-02-10T00:05:05.213667+0000","last_clean":"2024-02-10T00:05:05.213667+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:05.213667+0000","last_undegraded":"2024-02-10T00:05:05.213667+0000","last_fullsized":"2024-02-10T00:05:05.213667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":945,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196837+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:03.196837+0000","last_peered":"2024-02-10T00:05:03.196837+0000","last_clean":"2024-02-10T00:05:03.196837+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:03.196837+0000","last_undegraded":"2024-02-10T00:05:03.196837+0000","last_fullsized":"2024-02-10T00:05:03.196837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":458,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222066+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:05.222066+0000","last_peered":"2024-02-10T00:05:05.222066+0000","last_clean":"2024-02-10T00:05:05.222066+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:05.222066+0000","last_undegraded":"2024-02-10T00:05:05.222066+0000","last_fullsized":"2024-02-10T00:05:05.222066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":899,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198335+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:03.198335+0000","last_peered":"2024-02-10T00:05:03.198335+0000","last_clean":"2024-02-10T00:05:03.198335+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:03.198335+0000","last_undegraded":"2024-02-10T00:05:03.198335+0000","last_fullsized":"2024-02-10T00:05:03.198335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"40'619","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230416+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:05.230416+0000","last_peered":"2024-02-10T00:05:05.230416+0000","last_clean":"2024-02-10T00:05:05.230416+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:05.230416+0000","last_undegraded":"2024-02-10T00:05:05.230416+0000","last_fullsized":"2024-02-10T00:05:05.230416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196160+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:03.196160+0000","last_peered":"2024-02-10T00:05:03.196160+0000","last_clean":"2024-02-10T00:05:03.196160+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:03.196160+0000","last_undegraded":"2024-02-10T00:05:03.196160+0000","last_fullsized":"2024-02-10T00:05:03.196160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":293,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198820+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:03.198820+0000","last_peered":"2024-02-10T00:05:03.198820+0000","last_clean":"2024-02-10T00:05:03.198820+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:03.198820+0000","last_undegraded":"2024-02-10T00:05:03.198820+0000","last_fullsized":"2024-02-10T00:05:03.198820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198835+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:03.198835+0000","last_peered":"2024-02-10T00:05:03.198835+0000","last_clean":"2024-02-10T00:05:03.198835+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:03.198835+0000","last_undegraded":"2024-02-10T00:05:03.198835+0000","last_fullsized":"2024-02-10T00:05:03.198835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":237,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214149+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:05.214149+0000","last_peered":"2024-02-10T00:05:05.214149+0000","last_clean":"2024-02-10T00:05:05.214149+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:05.214149+0000","last_undegraded":"2024-02-10T00:05:05.214149+0000","last_fullsized":"2024-02-10T00:05:05.214149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195846+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:03.195846+0000","last_peered":"2024-02-10T00:05:03.195846+0000","last_clean":"2024-02-10T00:05:03.195846+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:03.195846+0000","last_undegraded":"2024-02-10T00:05:03.195846+0000","last_fullsized":"2024-02-10T00:05:03.195846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":932,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196490+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:03.196490+0000","last_peered":"2024-02-10T00:05:03.196490+0000","last_clean":"2024-02-10T00:05:03.196490+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:03.196490+0000","last_undegraded":"2024-02-10T00:05:03.196490+0000","last_fullsized":"2024-02-10T00:05:03.196490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198995+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:03.198995+0000","last_peered":"2024-02-10T00:05:03.198995+0000","last_clean":"2024-02-10T00:05:03.198995+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:03.198995+0000","last_undegraded":"2024-02-10T00:05:03.198995+0000","last_fullsized":"2024-02-10T00:05:03.198995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":962,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213340+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:05.213340+0000","last_peered":"2024-02-10T00:05:05.213340+0000","last_clean":"2024-02-10T00:05:05.213340+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:05.213340+0000","last_undegraded":"2024-02-10T00:05:05.213340+0000","last_fullsized":"2024-02-10T00:05:05.213340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":921,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198250+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:03.198250+0000","last_peered":"2024-02-10T00:05:03.198250+0000","last_clean":"2024-02-10T00:05:03.198250+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:03.198250+0000","last_undegraded":"2024-02-10T00:05:03.198250+0000","last_fullsized":"2024-02-10T00:05:03.198250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":789,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199382+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:03.199382+0000","last_peered":"2024-02-10T00:05:03.199382+0000","last_clean":"2024-02-10T00:05:03.199382+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:03.199382+0000","last_undegraded":"2024-02-10T00:05:03.199382+0000","last_fullsized":"2024-02-10T00:05:03.199382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147636729,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16347,"num_write_kb":272987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19928,"ondisk_log_size":19928,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423740,"kb_used_data":97972,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948100,"statfs":{"total":96636764160,"available":96202854400,"internally_reserved":0,"allocated":100323328,"data_stored":100089420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]}]},{"osd":2,"up_from":29,"seq":124554051593,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365292,"kb_used_data":61284,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006548,"statfs":{"total":96636764160,"available":96262705152,"internally_reserved":0,"allocated":62754816,"data_stored":62544120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376816,"kb_used_data":72104,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995024,"statfs":{"total":96636764160,"available":96250904576,"internally_reserved":0,"allocated":73834496,"data_stored":73613584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]}]},{"osd":1,"up_from":28,"seq":120259084298,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371548,"kb_used_data":59604,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000292,"statfs":{"total":96636764160,"available":96256299008,"internally_reserved":0,"allocated":61034496,"data_stored":60827546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99933815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:28.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-10T00:05:28.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.435+0000 7f2770bba700 1 Processor -- start 2024-02-10T00:05:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.435+0000 7f2770bba700 1 -- start start 2024-02-10T00:05:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2770bba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2770bba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2770bba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c063b10 con 0x7f276c13f6e0 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2770bba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c139bb0 con 0x7f276c063740 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2770bba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0a2100 con 0x7f276c0a5130 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f276a59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f276ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2769d9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f276c13f6e0 0x7f276c13fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51754/0 (socket says 172.21.15.89:51754) 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f2769d9b700 1 -- 172.21.15.89:0/506700987 learned_addr learned my addr 172.21.15.89:0/506700987 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f276a59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60310/0 (socket says 172.21.15.89:60310) 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.436+0000 7f276ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37880/0 (socket says 172.21.15.89:37880) 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276ad9d700 1 -- 172.21.15.89:0/506700987 >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 msgr2=0x7f276c0a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276ad9d700 1 --2- 172.21.15.89:0/506700987 >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276ad9d700 1 -- 172.21.15.89:0/506700987 >> v1:172.21.15.89:6789/0 conn(0x7f276c13f6e0 legacy=0x7f276c13fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276959a700 1 -- 172.21.15.89:0/506700987 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423762373 0 0) 0x7f276c063b10 con 0x7f276c13f6e0 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276ad9d700 1 -- 172.21.15.89:0/506700987 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c13fb70 con 0x7f276c0a5130 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276a59c700 1 --2- 172.21.15.89:0/506700987 >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276ad9d700 1 --2- 172.21.15.89:0/506700987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2764009e90 tx=0x7f2764009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee276382ff52934a server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276959a700 1 -- 172.21.15.89:0/506700987 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400e070 con 0x7f276c0a5130 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276959a700 1 -- 172.21.15.89:0/506700987 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276400bc80 con 0x7f276c0a5130 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f276959a700 1 -- 172.21.15.89:0/506700987 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764012430 con 0x7f276c0a5130 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f2770bba700 1 -- 172.21.15.89:0/506700987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 msgr2=0x7f276c0a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.437+0000 7f2770bba700 1 --2- 172.21.15.89:0/506700987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2764009e90 tx=0x7f2764009780 comp rx=0 tx=0).stop 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 -- 172.21.15.89:0/506700987 shutdown_connections 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 --2- 172.21.15.89:0/506700987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c0a29a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 --2- 172.21.15.89:0/506700987 >> v2:172.21.15.89:3300/0 conn(0x7f276c063740 0x7f276c0a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 -- 172.21.15.89:0/506700987 >> 172.21.15.89:0/506700987 conn(0x7f276c06a820 msgr2=0x7f276c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 -- 172.21.15.89:0/506700987 shutdown_connections 2024-02-10T00:05:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 -- 172.21.15.89:0/506700987 wait complete. 2024-02-10T00:05:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 Processor -- start 2024-02-10T00:05:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.438+0000 7f2770bba700 1 -- start start 2024-02-10T00:05:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f276c13f6e0 0x7f276c14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0a6ab0 con 0x7f276c063740 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c144a60 con 0x7f276c0a5130 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2770bba700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276c142070 con 0x7f276c13f6e0 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f2769d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276ad9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f276c13f6e0 0x7f276c14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60322/0 (socket says 172.21.15.89:60322) 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 -- 172.21.15.89:0/3780966514 learned_addr learned my addr 172.21.15.89:0/3780966514 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 -- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f276c13f6e0 msgr2=0x7f276c14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f276c13f6e0 0x7f276c14f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 -- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 msgr2=0x7f276c14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 -- 172.21.15.89:0/3780966514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760009420 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.439+0000 7f276a59c700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f276000ec80 tx=0x7f27600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.440+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000c920 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.440+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276000ca80 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.440+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2764009a20 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.440+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000ce00 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.440+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c0a67d0 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.441+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c04c710 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.441+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2760013680 con 0x7f276c063740 2024-02-10T00:05:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.441+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f276005b5f0 con 0x7f276c063740 2024-02-10T00:05:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.445+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f2760039750 con 0x7f276c063740 2024-02-10T00:05:28.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.594+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f276c13a760 con 0x7f274c046040 2024-02-10T00:05:28.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.600+0000 7f275a7fc700 1 -- 172.21.15.89:0/3780966514 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273448 (unknown 2965378022 0 2924309598) 0x7f276c13a760 con 0x7f274c046040 2024-02-10T00:05:28.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 >> v1:172.21.15.89:6816/47970 conn(0x7f274c046040 legacy=0x7f274c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 msgr2=0x7f276c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f276000ec80 tx=0x7f27600091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 shutdown_connections 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f276c13f6e0 0x7f276c14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f276c063740 0x7f276c0a6fb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 --2- 172.21.15.89:0/3780966514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f276c0a5130 0x7f276c14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 >> 172.21.15.89:0/3780966514 conn(0x7f276c06a820 msgr2=0x7f276c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 shutdown_connections 2024-02-10T00:05:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.603+0000 7f2770bba700 1 -- 172.21.15.89:0/3780966514 wait complete. 2024-02-10T00:05:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:28.617 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-02-10T00:05:28.144500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227097,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65350,"num_write_kb":9046232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71787,"ondisk_log_size":71787,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537396,"kb_used_data":290964,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375949964,"statfs":{"total":386547056640,"available":384972763136,"internally_reserved":0,"allocated":297947136,"data_stored":297074670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002768"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195716+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:03.195716+0000","last_peered":"2024-02-10T00:05:03.195716+0000","last_clean":"2024-02-10T00:05:03.195716+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:03.195716+0000","last_undegraded":"2024-02-10T00:05:03.195716+0000","last_fullsized":"2024-02-10T00:05:03.195716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197351+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:03.197351+0000","last_peered":"2024-02-10T00:05:03.197351+0000","last_clean":"2024-02-10T00:05:03.197351+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:03.197351+0000","last_undegraded":"2024-02-10T00:05:03.197351+0000","last_fullsized":"2024-02-10T00:05:03.197351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":909,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213630+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:05.213630+0000","last_peered":"2024-02-10T00:05:05.213630+0000","last_clean":"2024-02-10T00:05:05.213630+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:05.213630+0000","last_undegraded":"2024-02-10T00:05:05.213630+0000","last_fullsized":"2024-02-10T00:05:05.213630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213695+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:05.213695+0000","last_peered":"2024-02-10T00:05:05.213695+0000","last_clean":"2024-02-10T00:05:05.213695+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:05.213695+0000","last_undegraded":"2024-02-10T00:05:05.213695+0000","last_fullsized":"2024-02-10T00:05:05.213695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213378+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:05.213378+0000","last_peered":"2024-02-10T00:05:05.213378+0000","last_clean":"2024-02-10T00:05:05.213378+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:05.213378+0000","last_undegraded":"2024-02-10T00:05:05.213378+0000","last_fullsized":"2024-02-10T00:05:05.213378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":867,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197512+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:03.197512+0000","last_peered":"2024-02-10T00:05:03.197512+0000","last_clean":"2024-02-10T00:05:03.197512+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:03.197512+0000","last_undegraded":"2024-02-10T00:05:03.197512+0000","last_fullsized":"2024-02-10T00:05:03.197512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199254+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:03.199254+0000","last_peered":"2024-02-10T00:05:03.199254+0000","last_clean":"2024-02-10T00:05:03.199254+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:03.199254+0000","last_undegraded":"2024-02-10T00:05:03.199254+0000","last_fullsized":"2024-02-10T00:05:03.199254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":798,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196252+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:03.196252+0000","last_peered":"2024-02-10T00:05:03.196252+0000","last_clean":"2024-02-10T00:05:03.196252+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:03.196252+0000","last_undegraded":"2024-02-10T00:05:03.196252+0000","last_fullsized":"2024-02-10T00:05:03.196252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":927,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213994+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:05.213994+0000","last_peered":"2024-02-10T00:05:05.213994+0000","last_clean":"2024-02-10T00:05:05.213994+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:05.213994+0000","last_undegraded":"2024-02-10T00:05:05.213994+0000","last_fullsized":"2024-02-10T00:05:05.213994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197889+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:03.197889+0000","last_peered":"2024-02-10T00:05:03.197889+0000","last_clean":"2024-02-10T00:05:03.197889+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:03.197889+0000","last_undegraded":"2024-02-10T00:05:03.197889+0000","last_fullsized":"2024-02-10T00:05:03.197889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":845,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197279+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:03.197279+0000","last_peered":"2024-02-10T00:05:03.197279+0000","last_clean":"2024-02-10T00:05:03.197279+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:03.197279+0000","last_undegraded":"2024-02-10T00:05:03.197279+0000","last_fullsized":"2024-02-10T00:05:03.197279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196527+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:03.196527+0000","last_peered":"2024-02-10T00:05:03.196527+0000","last_clean":"2024-02-10T00:05:03.196527+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:03.196527+0000","last_undegraded":"2024-02-10T00:05:03.196527+0000","last_fullsized":"2024-02-10T00:05:03.196527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":964,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198230+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:03.198230+0000","last_peered":"2024-02-10T00:05:03.198230+0000","last_clean":"2024-02-10T00:05:03.198230+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:03.198230+0000","last_undegraded":"2024-02-10T00:05:03.198230+0000","last_fullsized":"2024-02-10T00:05:03.198230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":936,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195642+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:03.195642+0000","last_peered":"2024-02-10T00:05:03.195642+0000","last_clean":"2024-02-10T00:05:03.195642+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:03.195642+0000","last_undegraded":"2024-02-10T00:05:03.195642+0000","last_fullsized":"2024-02-10T00:05:03.195642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213324+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:05.213324+0000","last_peered":"2024-02-10T00:05:05.213324+0000","last_clean":"2024-02-10T00:05:05.213324+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:05.213324+0000","last_undegraded":"2024-02-10T00:05:05.213324+0000","last_fullsized":"2024-02-10T00:05:05.213324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197103+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:03.197103+0000","last_peered":"2024-02-10T00:05:03.197103+0000","last_clean":"2024-02-10T00:05:03.197103+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:03.197103+0000","last_undegraded":"2024-02-10T00:05:03.197103+0000","last_fullsized":"2024-02-10T00:05:03.197103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":982,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214235+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:05.214235+0000","last_peered":"2024-02-10T00:05:05.214235+0000","last_clean":"2024-02-10T00:05:05.214235+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:05.214235+0000","last_undegraded":"2024-02-10T00:05:05.214235+0000","last_fullsized":"2024-02-10T00:05:05.214235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":782,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213633+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:05.213633+0000","last_peered":"2024-02-10T00:05:05.213633+0000","last_clean":"2024-02-10T00:05:05.213633+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:05.213633+0000","last_undegraded":"2024-02-10T00:05:05.213633+0000","last_fullsized":"2024-02-10T00:05:05.213633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1013,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197053+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:03.197053+0000","last_peered":"2024-02-10T00:05:03.197053+0000","last_clean":"2024-02-10T00:05:03.197053+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:03.197053+0000","last_undegraded":"2024-02-10T00:05:03.197053+0000","last_fullsized":"2024-02-10T00:05:03.197053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":889,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199354+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:03.199354+0000","last_peered":"2024-02-10T00:05:03.199354+0000","last_clean":"2024-02-10T00:05:03.199354+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:03.199354+0000","last_undegraded":"2024-02-10T00:05:03.199354+0000","last_fullsized":"2024-02-10T00:05:03.199354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196764+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:03.196764+0000","last_peered":"2024-02-10T00:05:03.196764+0000","last_clean":"2024-02-10T00:05:03.196764+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:03.196764+0000","last_undegraded":"2024-02-10T00:05:03.196764+0000","last_fullsized":"2024-02-10T00:05:03.196764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":963,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213262+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:05.213262+0000","last_peered":"2024-02-10T00:05:05.213262+0000","last_clean":"2024-02-10T00:05:05.213262+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:05.213262+0000","last_undegraded":"2024-02-10T00:05:05.213262+0000","last_fullsized":"2024-02-10T00:05:05.213262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198737+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:03.198737+0000","last_peered":"2024-02-10T00:05:03.198737+0000","last_clean":"2024-02-10T00:05:03.198737+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:03.198737+0000","last_undegraded":"2024-02-10T00:05:03.198737+0000","last_fullsized":"2024-02-10T00:05:03.198737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":957,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196109+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:03.196109+0000","last_peered":"2024-02-10T00:05:03.196109+0000","last_clean":"2024-02-10T00:05:03.196109+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:03.196109+0000","last_undegraded":"2024-02-10T00:05:03.196109+0000","last_fullsized":"2024-02-10T00:05:03.196109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":978,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198463+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:03.198463+0000","last_peered":"2024-02-10T00:05:03.198463+0000","last_clean":"2024-02-10T00:05:03.198463+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:03.198463+0000","last_undegraded":"2024-02-10T00:05:03.198463+0000","last_fullsized":"2024-02-10T00:05:03.198463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198261+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:03.198261+0000","last_peered":"2024-02-10T00:05:03.198261+0000","last_clean":"2024-02-10T00:05:03.198261+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:03.198261+0000","last_undegraded":"2024-02-10T00:05:03.198261+0000","last_fullsized":"2024-02-10T00:05:03.198261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198656+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:03.198656+0000","last_peered":"2024-02-10T00:05:03.198656+0000","last_clean":"2024-02-10T00:05:03.198656+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:03.198656+0000","last_undegraded":"2024-02-10T00:05:03.198656+0000","last_fullsized":"2024-02-10T00:05:03.198656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1506,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196257+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:03.196257+0000","last_peered":"2024-02-10T00:05:03.196257+0000","last_clean":"2024-02-10T00:05:03.196257+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:03.196257+0000","last_undegraded":"2024-02-10T00:05:03.196257+0000","last_fullsized":"2024-02-10T00:05:03.196257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":872,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199077+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:03.199077+0000","last_peered":"2024-02-10T00:05:03.199077+0000","last_clean":"2024-02-10T00:05:03.199077+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:03.199077+0000","last_undegraded":"2024-02-10T00:05:03.199077+0000","last_fullsized":"2024-02-10T00:05:03.199077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195557+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:03.195557+0000","last_peered":"2024-02-10T00:05:03.195557+0000","last_clean":"2024-02-10T00:05:03.195557+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:03.195557+0000","last_undegraded":"2024-02-10T00:05:03.195557+0000","last_fullsized":"2024-02-10T00:05:03.195557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213874+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:05.213874+0000","last_peered":"2024-02-10T00:05:05.213874+0000","last_clean":"2024-02-10T00:05:05.213874+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:05.213874+0000","last_undegraded":"2024-02-10T00:05:05.213874+0000","last_fullsized":"2024-02-10T00:05:05.213874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197314+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:03.197314+0000","last_peered":"2024-02-10T00:05:03.197314+0000","last_clean":"2024-02-10T00:05:03.197314+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:03.197314+0000","last_undegraded":"2024-02-10T00:05:03.197314+0000","last_fullsized":"2024-02-10T00:05:03.197314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":905,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199608+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:03.199608+0000","last_peered":"2024-02-10T00:05:03.199608+0000","last_clean":"2024-02-10T00:05:03.199608+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:03.199608+0000","last_undegraded":"2024-02-10T00:05:03.199608+0000","last_fullsized":"2024-02-10T00:05:03.199608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224740+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:05.224740+0000","last_peered":"2024-02-10T00:05:05.224740+0000","last_clean":"2024-02-10T00:05:05.224740+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:05.224740+0000","last_undegraded":"2024-02-10T00:05:05.224740+0000","last_fullsized":"2024-02-10T00:05:05.224740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197256+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:03.197256+0000","last_peered":"2024-02-10T00:05:03.197256+0000","last_clean":"2024-02-10T00:05:03.197256+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:03.197256+0000","last_undegraded":"2024-02-10T00:05:03.197256+0000","last_fullsized":"2024-02-10T00:05:03.197256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197162+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:03.197162+0000","last_peered":"2024-02-10T00:05:03.197162+0000","last_clean":"2024-02-10T00:05:03.197162+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:03.197162+0000","last_undegraded":"2024-02-10T00:05:03.197162+0000","last_fullsized":"2024-02-10T00:05:03.197162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1062,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199166+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:03.199166+0000","last_peered":"2024-02-10T00:05:03.199166+0000","last_clean":"2024-02-10T00:05:03.199166+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:03.199166+0000","last_undegraded":"2024-02-10T00:05:03.199166+0000","last_fullsized":"2024-02-10T00:05:03.199166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":437,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.233703+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:05.233703+0000","last_peered":"2024-02-10T00:05:05.233703+0000","last_clean":"2024-02-10T00:05:05.233703+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:05.233703+0000","last_undegraded":"2024-02-10T00:05:05.233703+0000","last_fullsized":"2024-02-10T00:05:05.233703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196962+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:03.196962+0000","last_peered":"2024-02-10T00:05:03.196962+0000","last_clean":"2024-02-10T00:05:03.196962+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:03.196962+0000","last_undegraded":"2024-02-10T00:05:03.196962+0000","last_fullsized":"2024-02-10T00:05:03.196962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":704,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222215+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:05.222215+0000","last_peered":"2024-02-10T00:05:05.222215+0000","last_clean":"2024-02-10T00:05:05.222215+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:05.222215+0000","last_undegraded":"2024-02-10T00:05:05.222215+0000","last_fullsized":"2024-02-10T00:05:05.222215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":995,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198125+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:03.198125+0000","last_peered":"2024-02-10T00:05:03.198125+0000","last_clean":"2024-02-10T00:05:03.198125+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:03.198125+0000","last_undegraded":"2024-02-10T00:05:03.198125+0000","last_fullsized":"2024-02-10T00:05:03.198125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":435,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.208215+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:05.208215+0000","last_peered":"2024-02-10T00:05:05.208215+0000","last_clean":"2024-02-10T00:05:05.208215+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:05.208215+0000","last_undegraded":"2024-02-10T00:05:05.208215+0000","last_fullsized":"2024-02-10T00:05:05.208215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1094,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198114+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:03.198114+0000","last_peered":"2024-02-10T00:05:03.198114+0000","last_clean":"2024-02-10T00:05:03.198114+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:03.198114+0000","last_undegraded":"2024-02-10T00:05:03.198114+0000","last_fullsized":"2024-02-10T00:05:03.198114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213248+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:05.213248+0000","last_peered":"2024-02-10T00:05:05.213248+0000","last_clean":"2024-02-10T00:05:05.213248+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:05.213248+0000","last_undegraded":"2024-02-10T00:05:05.213248+0000","last_fullsized":"2024-02-10T00:05:05.213248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":960,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199079+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:03.199079+0000","last_peered":"2024-02-10T00:05:03.199079+0000","last_clean":"2024-02-10T00:05:03.199079+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:03.199079+0000","last_undegraded":"2024-02-10T00:05:03.199079+0000","last_fullsized":"2024-02-10T00:05:03.199079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":518,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230882+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:05.230882+0000","last_peered":"2024-02-10T00:05:05.230882+0000","last_clean":"2024-02-10T00:05:05.230882+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:05.230882+0000","last_undegraded":"2024-02-10T00:05:05.230882+0000","last_fullsized":"2024-02-10T00:05:05.230882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213962+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:05.213962+0000","last_peered":"2024-02-10T00:05:05.213962+0000","last_clean":"2024-02-10T00:05:05.213962+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:05.213962+0000","last_undegraded":"2024-02-10T00:05:05.213962+0000","last_fullsized":"2024-02-10T00:05:05.213962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":536,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.217503+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:05.217503+0000","last_peered":"2024-02-10T00:05:05.217503+0000","last_clean":"2024-02-10T00:05:05.217503+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:05.217503+0000","last_undegraded":"2024-02-10T00:05:05.217503+0000","last_fullsized":"2024-02-10T00:05:05.217503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":855,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199156+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:03.199156+0000","last_peered":"2024-02-10T00:05:03.199156+0000","last_clean":"2024-02-10T00:05:03.199156+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:03.199156+0000","last_undegraded":"2024-02-10T00:05:03.199156+0000","last_fullsized":"2024-02-10T00:05:03.199156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213861+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:05.213861+0000","last_peered":"2024-02-10T00:05:05.213861+0000","last_clean":"2024-02-10T00:05:05.213861+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:05.213861+0000","last_undegraded":"2024-02-10T00:05:05.213861+0000","last_fullsized":"2024-02-10T00:05:05.213861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1078,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197133+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:03.197133+0000","last_peered":"2024-02-10T00:05:03.197133+0000","last_clean":"2024-02-10T00:05:03.197133+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:03.197133+0000","last_undegraded":"2024-02-10T00:05:03.197133+0000","last_fullsized":"2024-02-10T00:05:03.197133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":468,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222743+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:05.222743+0000","last_peered":"2024-02-10T00:05:05.222743+0000","last_clean":"2024-02-10T00:05:05.222743+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:05.222743+0000","last_undegraded":"2024-02-10T00:05:05.222743+0000","last_fullsized":"2024-02-10T00:05:05.222743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":974,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195850+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:03.195850+0000","last_peered":"2024-02-10T00:05:03.195850+0000","last_clean":"2024-02-10T00:05:03.195850+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:03.195850+0000","last_undegraded":"2024-02-10T00:05:03.195850+0000","last_fullsized":"2024-02-10T00:05:03.195850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":783,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198480+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:03.198480+0000","last_peered":"2024-02-10T00:05:03.198480+0000","last_clean":"2024-02-10T00:05:03.198480+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:03.198480+0000","last_undegraded":"2024-02-10T00:05:03.198480+0000","last_fullsized":"2024-02-10T00:05:03.198480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196254+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:03.196254+0000","last_peered":"2024-02-10T00:05:03.196254+0000","last_clean":"2024-02-10T00:05:03.196254+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:03.196254+0000","last_undegraded":"2024-02-10T00:05:03.196254+0000","last_fullsized":"2024-02-10T00:05:03.196254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213560+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:05.213560+0000","last_peered":"2024-02-10T00:05:05.213560+0000","last_clean":"2024-02-10T00:05:05.213560+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:05.213560+0000","last_undegraded":"2024-02-10T00:05:05.213560+0000","last_fullsized":"2024-02-10T00:05:05.213560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213529+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:05.213529+0000","last_peered":"2024-02-10T00:05:05.213529+0000","last_clean":"2024-02-10T00:05:05.213529+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:05.213529+0000","last_undegraded":"2024-02-10T00:05:05.213529+0000","last_fullsized":"2024-02-10T00:05:05.213529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1213,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224660+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:05.224660+0000","last_peered":"2024-02-10T00:05:05.224660+0000","last_clean":"2024-02-10T00:05:05.224660+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:05.224660+0000","last_undegraded":"2024-02-10T00:05:05.224660+0000","last_fullsized":"2024-02-10T00:05:05.224660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1027,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213572+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:05.213572+0000","last_peered":"2024-02-10T00:05:05.213572+0000","last_clean":"2024-02-10T00:05:05.213572+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:05.213572+0000","last_undegraded":"2024-02-10T00:05:05.213572+0000","last_fullsized":"2024-02-10T00:05:05.213572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197323+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:03.197323+0000","last_peered":"2024-02-10T00:05:03.197323+0000","last_clean":"2024-02-10T00:05:03.197323+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:03.197323+0000","last_undegraded":"2024-02-10T00:05:03.197323+0000","last_fullsized":"2024-02-10T00:05:03.197323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":880,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'353","reported_seq":394,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-10T00:05:15.247571+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:15.247571+0000","last_peered":"2024-02-10T00:05:15.247571+0000","last_clean":"2024-02-10T00:05:15.247571+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:15.247571+0000","last_undegraded":"2024-02-10T00:05:15.247571+0000","last_fullsized":"2024-02-10T00:05:15.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719545,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":251,"num_write_kb":5960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":878,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197681+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:03.197681+0000","last_peered":"2024-02-10T00:05:03.197681+0000","last_clean":"2024-02-10T00:05:03.197681+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:03.197681+0000","last_undegraded":"2024-02-10T00:05:03.197681+0000","last_fullsized":"2024-02-10T00:05:03.197681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196786+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:03.196786+0000","last_peered":"2024-02-10T00:05:03.196786+0000","last_clean":"2024-02-10T00:05:03.196786+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:03.196786+0000","last_undegraded":"2024-02-10T00:05:03.196786+0000","last_fullsized":"2024-02-10T00:05:03.196786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":914,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198975+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:03.198975+0000","last_peered":"2024-02-10T00:05:03.198975+0000","last_clean":"2024-02-10T00:05:03.198975+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:03.198975+0000","last_undegraded":"2024-02-10T00:05:03.198975+0000","last_fullsized":"2024-02-10T00:05:03.198975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199278+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:03.199278+0000","last_peered":"2024-02-10T00:05:03.199278+0000","last_clean":"2024-02-10T00:05:03.199278+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:03.199278+0000","last_undegraded":"2024-02-10T00:05:03.199278+0000","last_fullsized":"2024-02-10T00:05:03.199278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":262,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196947+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:03.196947+0000","last_peered":"2024-02-10T00:05:03.196947+0000","last_clean":"2024-02-10T00:05:03.196947+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:03.196947+0000","last_undegraded":"2024-02-10T00:05:03.196947+0000","last_fullsized":"2024-02-10T00:05:03.196947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":860,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196827+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:03.196827+0000","last_peered":"2024-02-10T00:05:03.196827+0000","last_clean":"2024-02-10T00:05:03.196827+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:03.196827+0000","last_undegraded":"2024-02-10T00:05:03.196827+0000","last_fullsized":"2024-02-10T00:05:03.196827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197380+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:03.197380+0000","last_peered":"2024-02-10T00:05:03.197380+0000","last_clean":"2024-02-10T00:05:03.197380+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:03.197380+0000","last_undegraded":"2024-02-10T00:05:03.197380+0000","last_fullsized":"2024-02-10T00:05:03.197380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":719,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213409+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:05.213409+0000","last_peered":"2024-02-10T00:05:05.213409+0000","last_clean":"2024-02-10T00:05:05.213409+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:05.213409+0000","last_undegraded":"2024-02-10T00:05:05.213409+0000","last_fullsized":"2024-02-10T00:05:05.213409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1015,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199256+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:03.199256+0000","last_peered":"2024-02-10T00:05:03.199256+0000","last_clean":"2024-02-10T00:05:03.199256+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:03.199256+0000","last_undegraded":"2024-02-10T00:05:03.199256+0000","last_fullsized":"2024-02-10T00:05:03.199256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196045+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:03.196045+0000","last_peered":"2024-02-10T00:05:03.196045+0000","last_clean":"2024-02-10T00:05:03.196045+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:03.196045+0000","last_undegraded":"2024-02-10T00:05:03.196045+0000","last_fullsized":"2024-02-10T00:05:03.196045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196536+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:03.196536+0000","last_peered":"2024-02-10T00:05:03.196536+0000","last_clean":"2024-02-10T00:05:03.196536+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:03.196536+0000","last_undegraded":"2024-02-10T00:05:03.196536+0000","last_fullsized":"2024-02-10T00:05:03.196536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":815,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198647+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:03.198647+0000","last_peered":"2024-02-10T00:05:03.198647+0000","last_clean":"2024-02-10T00:05:03.198647+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:03.198647+0000","last_undegraded":"2024-02-10T00:05:03.198647+0000","last_fullsized":"2024-02-10T00:05:03.198647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197767+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:03.197767+0000","last_peered":"2024-02-10T00:05:03.197767+0000","last_clean":"2024-02-10T00:05:03.197767+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:03.197767+0000","last_undegraded":"2024-02-10T00:05:03.197767+0000","last_fullsized":"2024-02-10T00:05:03.197767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195981+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:03.195981+0000","last_peered":"2024-02-10T00:05:03.195981+0000","last_clean":"2024-02-10T00:05:03.195981+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:03.195981+0000","last_undegraded":"2024-02-10T00:05:03.195981+0000","last_fullsized":"2024-02-10T00:05:03.195981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1441,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197598+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:03.197598+0000","last_peered":"2024-02-10T00:05:03.197598+0000","last_clean":"2024-02-10T00:05:03.197598+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:03.197598+0000","last_undegraded":"2024-02-10T00:05:03.197598+0000","last_fullsized":"2024-02-10T00:05:03.197598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198776+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:03.198776+0000","last_peered":"2024-02-10T00:05:03.198776+0000","last_clean":"2024-02-10T00:05:03.198776+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:03.198776+0000","last_undegraded":"2024-02-10T00:05:03.198776+0000","last_fullsized":"2024-02-10T00:05:03.198776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196689+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:03.196689+0000","last_peered":"2024-02-10T00:05:03.196689+0000","last_clean":"2024-02-10T00:05:03.196689+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:03.196689+0000","last_undegraded":"2024-02-10T00:05:03.196689+0000","last_fullsized":"2024-02-10T00:05:03.196689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.227876+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:05.227876+0000","last_peered":"2024-02-10T00:05:05.227876+0000","last_clean":"2024-02-10T00:05:05.227876+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:05.227876+0000","last_undegraded":"2024-02-10T00:05:05.227876+0000","last_fullsized":"2024-02-10T00:05:05.227876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213802+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:05.213802+0000","last_peered":"2024-02-10T00:05:05.213802+0000","last_clean":"2024-02-10T00:05:05.213802+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:05.213802+0000","last_undegraded":"2024-02-10T00:05:05.213802+0000","last_fullsized":"2024-02-10T00:05:05.213802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199443+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:03.199443+0000","last_peered":"2024-02-10T00:05:03.199443+0000","last_clean":"2024-02-10T00:05:03.199443+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:03.199443+0000","last_undegraded":"2024-02-10T00:05:03.199443+0000","last_fullsized":"2024-02-10T00:05:03.199443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213538+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:05.213538+0000","last_peered":"2024-02-10T00:05:05.213538+0000","last_clean":"2024-02-10T00:05:05.213538+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:05.213538+0000","last_undegraded":"2024-02-10T00:05:05.213538+0000","last_fullsized":"2024-02-10T00:05:05.213538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":463,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.223415+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:05.223415+0000","last_peered":"2024-02-10T00:05:05.223415+0000","last_clean":"2024-02-10T00:05:05.223415+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:05.223415+0000","last_undegraded":"2024-02-10T00:05:05.223415+0000","last_fullsized":"2024-02-10T00:05:05.223415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198344+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:03.198344+0000","last_peered":"2024-02-10T00:05:03.198344+0000","last_clean":"2024-02-10T00:05:03.198344+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:03.198344+0000","last_undegraded":"2024-02-10T00:05:03.198344+0000","last_fullsized":"2024-02-10T00:05:03.198344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197213+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:03.197213+0000","last_peered":"2024-02-10T00:05:03.197213+0000","last_clean":"2024-02-10T00:05:03.197213+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:03.197213+0000","last_undegraded":"2024-02-10T00:05:03.197213+0000","last_fullsized":"2024-02-10T00:05:03.197213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199060+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:03.199060+0000","last_peered":"2024-02-10T00:05:03.199060+0000","last_clean":"2024-02-10T00:05:03.199060+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:03.199060+0000","last_undegraded":"2024-02-10T00:05:03.199060+0000","last_fullsized":"2024-02-10T00:05:03.199060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":771,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:06.580430+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:06.580430+0000","last_peered":"2024-02-10T00:05:06.580430+0000","last_clean":"2024-02-10T00:05:06.580430+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:06.580430+0000","last_undegraded":"2024-02-10T00:05:06.580430+0000","last_fullsized":"2024-02-10T00:05:06.580430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":902,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195971+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:03.195971+0000","last_peered":"2024-02-10T00:05:03.195971+0000","last_clean":"2024-02-10T00:05:03.195971+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:03.195971+0000","last_undegraded":"2024-02-10T00:05:03.195971+0000","last_fullsized":"2024-02-10T00:05:03.195971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213667+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:05.213667+0000","last_peered":"2024-02-10T00:05:05.213667+0000","last_clean":"2024-02-10T00:05:05.213667+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:05.213667+0000","last_undegraded":"2024-02-10T00:05:05.213667+0000","last_fullsized":"2024-02-10T00:05:05.213667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":945,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196837+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:03.196837+0000","last_peered":"2024-02-10T00:05:03.196837+0000","last_clean":"2024-02-10T00:05:03.196837+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:03.196837+0000","last_undegraded":"2024-02-10T00:05:03.196837+0000","last_fullsized":"2024-02-10T00:05:03.196837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":458,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222066+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:05.222066+0000","last_peered":"2024-02-10T00:05:05.222066+0000","last_clean":"2024-02-10T00:05:05.222066+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:05.222066+0000","last_undegraded":"2024-02-10T00:05:05.222066+0000","last_fullsized":"2024-02-10T00:05:05.222066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":899,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198335+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:03.198335+0000","last_peered":"2024-02-10T00:05:03.198335+0000","last_clean":"2024-02-10T00:05:03.198335+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:03.198335+0000","last_undegraded":"2024-02-10T00:05:03.198335+0000","last_fullsized":"2024-02-10T00:05:03.198335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"40'619","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230416+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:05.230416+0000","last_peered":"2024-02-10T00:05:05.230416+0000","last_clean":"2024-02-10T00:05:05.230416+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:05.230416+0000","last_undegraded":"2024-02-10T00:05:05.230416+0000","last_fullsized":"2024-02-10T00:05:05.230416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196160+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:03.196160+0000","last_peered":"2024-02-10T00:05:03.196160+0000","last_clean":"2024-02-10T00:05:03.196160+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:03.196160+0000","last_undegraded":"2024-02-10T00:05:03.196160+0000","last_fullsized":"2024-02-10T00:05:03.196160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":293,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198820+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:03.198820+0000","last_peered":"2024-02-10T00:05:03.198820+0000","last_clean":"2024-02-10T00:05:03.198820+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:03.198820+0000","last_undegraded":"2024-02-10T00:05:03.198820+0000","last_fullsized":"2024-02-10T00:05:03.198820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198835+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:03.198835+0000","last_peered":"2024-02-10T00:05:03.198835+0000","last_clean":"2024-02-10T00:05:03.198835+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:03.198835+0000","last_undegraded":"2024-02-10T00:05:03.198835+0000","last_fullsized":"2024-02-10T00:05:03.198835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":237,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214149+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:05.214149+0000","last_peered":"2024-02-10T00:05:05.214149+0000","last_clean":"2024-02-10T00:05:05.214149+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:05.214149+0000","last_undegraded":"2024-02-10T00:05:05.214149+0000","last_fullsized":"2024-02-10T00:05:05.214149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195846+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:03.195846+0000","last_peered":"2024-02-10T00:05:03.195846+0000","last_clean":"2024-02-10T00:05:03.195846+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:03.195846+0000","last_undegraded":"2024-02-10T00:05:03.195846+0000","last_fullsized":"2024-02-10T00:05:03.195846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":932,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196490+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:03.196490+0000","last_peered":"2024-02-10T00:05:03.196490+0000","last_clean":"2024-02-10T00:05:03.196490+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:03.196490+0000","last_undegraded":"2024-02-10T00:05:03.196490+0000","last_fullsized":"2024-02-10T00:05:03.196490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198995+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:03.198995+0000","last_peered":"2024-02-10T00:05:03.198995+0000","last_clean":"2024-02-10T00:05:03.198995+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:03.198995+0000","last_undegraded":"2024-02-10T00:05:03.198995+0000","last_fullsized":"2024-02-10T00:05:03.198995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":962,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213340+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:05.213340+0000","last_peered":"2024-02-10T00:05:05.213340+0000","last_clean":"2024-02-10T00:05:05.213340+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:05.213340+0000","last_undegraded":"2024-02-10T00:05:05.213340+0000","last_fullsized":"2024-02-10T00:05:05.213340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":921,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198250+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:03.198250+0000","last_peered":"2024-02-10T00:05:03.198250+0000","last_clean":"2024-02-10T00:05:03.198250+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:03.198250+0000","last_undegraded":"2024-02-10T00:05:03.198250+0000","last_fullsized":"2024-02-10T00:05:03.198250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":789,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199382+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:03.199382+0000","last_peered":"2024-02-10T00:05:03.199382+0000","last_clean":"2024-02-10T00:05:03.199382+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:03.199382+0000","last_undegraded":"2024-02-10T00:05:03.199382+0000","last_fullsized":"2024-02-10T00:05:03.199382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147636729,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16347,"num_write_kb":272987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19928,"ondisk_log_size":19928,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423740,"kb_used_data":97972,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948100,"statfs":{"total":96636764160,"available":96202854400,"internally_reserved":0,"allocated":100323328,"data_stored":100089420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]}]},{"osd":2,"up_from":29,"seq":124554051593,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365292,"kb_used_data":61284,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006548,"statfs":{"total":96636764160,"available":96262705152,"internally_reserved":0,"allocated":62754816,"data_stored":62544120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376816,"kb_used_data":72104,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995024,"statfs":{"total":96636764160,"available":96250904576,"internally_reserved":0,"allocated":73834496,"data_stored":73613584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]}]},{"osd":1,"up_from":28,"seq":120259084298,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371548,"kb_used_data":59604,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000292,"statfs":{"total":96636764160,"available":96256299008,"internally_reserved":0,"allocated":61034496,"data_stored":60827546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99933815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:28.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-10T00:05:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.771+0000 7f2fac67a700 1 Processor -- start 2024-02-10T00:05:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.771+0000 7f2fac67a700 1 -- start start 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa40aab20 con 0x7f2fa406e550 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa406ff80 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fac67a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4141a50 con 0x7f2fa4063c90 2024-02-10T00:05:28.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faa416700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faac17700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37892/0 (socket says 172.21.15.89:37892) 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faac17700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60332/0 (socket says 172.21.15.89:60332) 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 -- 172.21.15.89:0/884062556 learned_addr learned my addr 172.21.15.89:0/884062556 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faa416700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57358/0 (socket says 172.21.15.89:57358) 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 -- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 msgr2=0x7f2fa406a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 -- 172.21.15.89:0/884062556 >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 msgr2=0x7f2fa406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/884062556 >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2fa9c15700 1 -- 172.21.15.89:0/884062556 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4141cf0 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faa416700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.772+0000 7f2faac17700 1 --2- 172.21.15.89:0/884062556 >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00099b0 tx=0x7f2fa0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd4e8b3d2a022c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fa9414700 1 -- 172.21.15.89:0/884062556 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000b680 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fa9414700 1 -- 172.21.15.89:0/884062556 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000b7e0 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fa9414700 1 -- 172.21.15.89:0/884062556 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000bb80 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 -- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 msgr2=0x7f2fa4142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00099b0 tx=0x7f2fa0009250 comp rx=0 tx=0).stop 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 -- 172.21.15.89:0/884062556 shutdown_connections 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 --2- 172.21.15.89:0/884062556 >> v2:172.21.15.89:3300/0 conn(0x7f2fa406e550 0x7f2fa406e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa4063c90 0x7f2fa406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 --2- 172.21.15.89:0/884062556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa40ab6d0 0x7f2fa4142120 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 -- 172.21.15.89:0/884062556 >> 172.21.15.89:0/884062556 conn(0x7f2fa406d8c0 msgr2=0x7f2fa4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 -- 172.21.15.89:0/884062556 shutdown_connections 2024-02-10T00:05:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.773+0000 7f2fac67a700 1 -- 172.21.15.89:0/884062556 wait complete. 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.774+0000 7f2fac67a700 1 Processor -- start 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.774+0000 7f2fac67a700 1 -- start start 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa4063c90 0x7f2fa40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 0x7f2fa41518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:28.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40af360 con 0x7f2fa40ab6d0 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4150fe0 con 0x7f2fa4063c90 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fac67a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40b20a0 con 0x7f2fa406e550 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57364/0 (socket says 172.21.15.89:57364) 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 -- 172.21.15.89:0/2578955684 learned_addr learned my addr 172.21.15.89:0/2578955684 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2faac17700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 0x7f2fa41518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2faa416700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa4063c90 0x7f2fa40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 -- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa4063c90 msgr2=0x7f2fa40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa4063c90 0x7f2fa40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 -- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 msgr2=0x7f2fa41518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 0x7f2fa41518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 -- 172.21.15.89:0/2578955684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94009420 con 0x7f2fa406e550 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2faac17700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 0x7f2fa41518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.775+0000 7f2fa9c15700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009290 tx=0x7f2fa0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:28.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0000d10 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000bb60 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c009a20 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa001a6c0 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa00094f0 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.776+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2fa001aa30 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.777+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa404c710 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.777+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f2fa005c990 con 0x7f2fa406e550 2024-02-10T00:05:28.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.780+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f2fa0024950 con 0x7f2fa406e550 2024-02-10T00:05:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.933+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fa4069130 con 0x7f2fa406e550 2024-02-10T00:05:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.934+0000 7f2f9a7fc700 1 -- 172.21.15.89:0/2578955684 <== mon.2 v2:172.21.15.89:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f2fa00243f0 con 0x7f2fa406e550 2024-02-10T00:05:28.936 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:28.936 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"951e35aa-74af-44e4-b74f-b1f2d00d0504","created":"2024-02-09T23:58:08.581759+0000","modified":"2024-02-10T00:05:15.229597+0000","last_up_change":"2024-02-10T00:04:53.328682+0000","last_in_change":"2024-02-09T23:58:13.556626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T23:58:10.591178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T23:58:17.594328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-02-09T23:58:25.421289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-02-09T23:58:26.291020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54a6058f-90fd-4813-858e-89b0ab58a45e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6808","nonce":50544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6809","nonce":50544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6811","nonce":50544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6810","nonce":50544}]},"public_addr":"172.21.15.89:6808/50544","cluster_addr":"172.21.15.89:6809/50544","heartbeat_back_addr":"172.21.15.89:6811/50544","heartbeat_front_addr":"172.21.15.89:6810/50544","state":["exists","up"]},{"osd":1,"uuid":"50a61229-5b79-4b67-bbef-f5070a3c0e79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6800","nonce":50630}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6801","nonce":50630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6803","nonce":50630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6802","nonce":50630}]},"public_addr":"172.21.15.89:6800/50630","cluster_addr":"172.21.15.89:6801/50630","heartbeat_back_addr":"172.21.15.89:6803/50630","heartbeat_front_addr":"172.21.15.89:6802/50630","state":["exists","up"]},{"osd":2,"uuid":"53f5509d-daa0-4134-b559-84fe4a2ad3cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":29,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6804","nonce":50752}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6805","nonce":50752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6807","nonce":50752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6806","nonce":50752}]},"public_addr":"172.21.15.89:6804/50752","cluster_addr":"172.21.15.89:6805/50752","heartbeat_back_addr":"172.21.15.89:6807/50752","heartbeat_front_addr":"172.21.15.89:6806/50752","state":["exists","up"]},{"osd":3,"uuid":"5bfa695e-8e0f-4f1e-b65c-219837f522fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6812","nonce":50885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6813","nonce":50885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6815","nonce":50885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.89:6814","nonce":50885}]},"public_addr":"172.21.15.89:6812/50885","cluster_addr":"172.21.15.89:6813/50885","heartbeat_back_addr":"172.21.15.89:6815/50885","heartbeat_front_addr":"172.21.15.89:6814/50885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497581+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.497926+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.256553+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-02-10T00:04:43.188668+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T23:58:12.448598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2640344124":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3039776512":"2024-02-11T00:04:30.116269+0000","172.21.15.89:0/3978228942":"2024-02-11T00:04:30.116269+0000","172.21.15.183:0/432961506":"2024-02-10T01:05:14.231601+0000","172.21.15.164:0/3331993086":"2024-02-10T01:05:14.231318+0000","172.21.15.89:6816/39389":"2024-02-11T00:04:30.116269+0000","172.21.15.89:6819/3416328937":"2024-02-11T00:04:56.564529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-10T00:05:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 >> v1:172.21.15.89:6816/47970 conn(0x7f2f88046040 legacy=0x7f2f880484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 msgr2=0x7f2fa4151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009290 tx=0x7f2fa0017000 comp rx=0 tx=0).stop 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 shutdown_connections 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa40ab6d0 0x7f2fa41518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fa4063c90 0x7f2fa40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 --2- 172.21.15.89:0/2578955684 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f2fa406e550 0x7f2fa4151360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 >> 172.21.15.89:0/2578955684 conn(0x7f2fa406d8c0 msgr2=0x7f2fa406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 shutdown_connections 2024-02-10T00:05:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:28.936+0000 7f2fac67a700 1 -- 172.21.15.89:0/2578955684 wait complete. 2024-02-10T00:05:29.951 INFO:tasks.ceph:Scrubbing osd.0 2024-02-10T00:05:29.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-10T00:05:30.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 Processor -- start 2024-02-10T00:05:30.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 -- start start 2024-02-10T00:05:30.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 0x7fdf2806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf2813b8b0 0x7fdf280ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2806a910 con 0x7fdf280ab7f0 2024-02-10T00:05:30.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf28141900 con 0x7fdf2813b8b0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.079+0000 7fdf2cb63700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28141ba0 con 0x7fdf28063c90 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2659c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 0x7fdf2806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf2813b8b0 0x7fdf280ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf26d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdf280ab7f0 0x7fdf2806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51764/0 (socket says 172.21.15.89:51764) 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf26d9d700 1 -- 172.21.15.89:0/3944120471 learned_addr learned my addr 172.21.15.89:0/3944120471 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 -- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 msgr2=0x7fdf2806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 0x7fdf2806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 -- 172.21.15.89:0/3944120471 >> v1:172.21.15.89:6789/0 conn(0x7fdf280ab7f0 legacy=0x7fdf2806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 -- 172.21.15.89:0/3944120471 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28141e40 con 0x7fdf2813b8b0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2559a700 1 -- 172.21.15.89:0/3944120471 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385432914 0 0) 0x7fdf2806a910 con 0x7fdf280ab7f0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2659c700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 0x7fdf2806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf25d9b700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf2813b8b0 0x7fdf280ab2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0098e0 tx=0x7fdf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366eebe97ec96921 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2559a700 1 -- 172.21.15.89:0/3944120471 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00b6d0 con 0x7fdf2813b8b0 2024-02-10T00:05:30.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2559a700 1 -- 172.21.15.89:0/3944120471 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00b830 con 0x7fdf2813b8b0 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.080+0000 7fdf2559a700 1 -- 172.21.15.89:0/3944120471 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00bbd0 con 0x7fdf2813b8b0 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 -- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf2813b8b0 msgr2=0x7fdf280ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf2813b8b0 0x7fdf280ab2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0098e0 tx=0x7fdf1c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 -- 172.21.15.89:0/3944120471 shutdown_connections 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf28063c90 0x7fdf2806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 --2- 172.21.15.89:0/3944120471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf2813b8b0 0x7fdf280ab2b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 -- 172.21.15.89:0/3944120471 >> 172.21.15.89:0/3944120471 conn(0x7fdf2806d8c0 msgr2=0x7fdf28063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 -- 172.21.15.89:0/3944120471 shutdown_connections 2024-02-10T00:05:30.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.081+0000 7fdf2cb63700 1 -- 172.21.15.89:0/3944120471 wait complete. 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 Processor -- start 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 -- start start 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 0x7fdf28151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 0x7fdf280ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 0x7fdf280ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28151ba0 con 0x7fdf280ab7f0 2024-02-10T00:05:30.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280adad0 con 0x7fdf28063c90 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2cb63700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28151e00 con 0x7fdf2813b8b0 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf25d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 0x7fdf280ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 0x7fdf28151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf26d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 0x7fdf280ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf25d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 0x7fdf280ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60360/0 (socket says 172.21.15.89:60360) 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf26d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 0x7fdf280ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57388/0 (socket says 172.21.15.89:57388) 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf2659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 0x7fdf28151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37920/0 (socket says 172.21.15.89:37920) 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.082+0000 7fdf25d9b700 1 -- 172.21.15.89:0/1344503073 learned_addr learned my addr 172.21.15.89:0/1344503073 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 -- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 msgr2=0x7fdf280ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 0x7fdf280ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 -- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 msgr2=0x7fdf28151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 0x7fdf28151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 -- 172.21.15.89:0/1344503073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18009420 con 0x7fdf280ab7f0 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf26d9d700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fdf2813b8b0 0x7fdf280ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf2659c700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf28063c90 0x7fdf28151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf25d9b700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 0x7fdf280ae010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0093f0 tx=0x7fdf1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00bbb0 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c011420 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c009420 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0117c0 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.083+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf280ad530 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.084+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf2804c710 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.084+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdf1c011bf0 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.084+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fdf1c05c920 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.084+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 --> v1:172.21.15.89:6808/50544 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf08052b30 con 0x7fdf0804ee70 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.084+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1c061240 con 0x7fdf280ab7f0 2024-02-10T00:05:30.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.085+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== osd.0 v1:172.21.15.89:6808/50544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fdf08052b30 con 0x7fdf0804ee70 2024-02-10T00:05:30.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 --> v1:172.21.15.89:6808/50544 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf280b0ac0 con 0x7fdf0804ee70 2024-02-10T00:05:30.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf167fc700 1 -- 172.21.15.89:0/1344503073 <== osd.0 v1:172.21.15.89:6808/50544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7fdf280b0ac0 con 0x7fdf0804ee70 2024-02-10T00:05:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:30.101 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-10T00:05:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 >> v1:172.21.15.89:6808/50544 conn(0x7fdf0804ee70 legacy=0x7fdf080512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 >> v1:172.21.15.89:6816/47970 conn(0x7fdf08046040 legacy=0x7fdf080484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 msgr2=0x7fdf280ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 --2- 172.21.15.89:0/1344503073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf280ab7f0 0x7fdf280ae010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0093f0 tx=0x7fdf1c017000 comp rx=0 tx=0).stop 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf26d9d700 1 -- 172.21.15.89:0/1344503073 reap_dead start 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 shutdown_connections 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 >> 172.21.15.89:0/1344503073 conn(0x7fdf2806d8c0 msgr2=0x7fdf2806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 shutdown_connections 2024-02-10T00:05:30.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.099+0000 7fdf2cb63700 1 -- 172.21.15.89:0/1344503073 wait complete. 2024-02-10T00:05:30.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-10T00:05:30.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.230+0000 7ff856780700 1 Processor -- start 2024-02-10T00:05:30.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.230+0000 7ff856780700 1 -- start start 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff856780700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff856780700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff856780700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff850064220 con 0x7ff85006f0b0 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff856780700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500a9e00 con 0x7ff850063e50 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff856780700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff85013e480 con 0x7ff85006ec60 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff854d1d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff85006f0b0 0x7ff850067970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51778/0 (socket says 172.21.15.89:51778) 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57398/0 (socket says 172.21.15.89:57398) 2024-02-10T00:05:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37930/0 (socket says 172.21.15.89:37930) 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff854d1d700 1 -- 172.21.15.89:0/1933343876 learned_addr learned my addr 172.21.15.89:0/1933343876 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 -- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 msgr2=0x7ff85013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84effd700 1 -- 172.21.15.89:0/1933343876 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581804068 0 0) 0x7ff850064220 con 0x7ff85006f0b0 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 -- 172.21.15.89:0/1933343876 >> v1:172.21.15.89:6789/0 conn(0x7ff85006f0b0 legacy=0x7ff850067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 -- 172.21.15.89:0/1933343876 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85006e560 con 0x7ff850063e50 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84f7fe700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.231+0000 7ff84ffff700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff844009910 tx=0x7ff8440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d839f9eb2ba92edc server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff84effd700 1 -- 172.21.15.89:0/1933343876 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400b710 con 0x7ff850063e50 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff84effd700 1 -- 172.21.15.89:0/1933343876 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400b870 con 0x7ff850063e50 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff84effd700 1 -- 172.21.15.89:0/1933343876 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400bc30 con 0x7ff850063e50 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 -- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 msgr2=0x7ff8500aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff844009910 tx=0x7ff8440091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 -- 172.21.15.89:0/1933343876 shutdown_connections 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff850063e50 0x7ff8500aa290 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 --2- 172.21.15.89:0/1933343876 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff85013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 -- 172.21.15.89:0/1933343876 >> 172.21.15.89:0/1933343876 conn(0x7ff85006c7c0 msgr2=0x7ff850063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 -- 172.21.15.89:0/1933343876 shutdown_connections 2024-02-10T00:05:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.232+0000 7ff856780700 1 -- 172.21.15.89:0/1933343876 wait complete. 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.233+0000 7ff856780700 1 Processor -- start 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 -- start start 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff850097c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff85006f0b0 0x7ff850151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500985e0 con 0x7ff850063e50 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500ad4f0 con 0x7ff85006f0b0 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff856780700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff850099290 con 0x7ff85006ec60 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.234+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84f7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff850097c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60370/0 (socket says 172.21.15.89:60370) 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff854d1d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff85006f0b0 0x7ff850151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 -- 172.21.15.89:0/3876513869 learned_addr learned my addr 172.21.15.89:0/3876513869 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 -- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 msgr2=0x7ff850097c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff850097c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 -- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff85006f0b0 msgr2=0x7ff850151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff85006f0b0 0x7ff850151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 -- 172.21.15.89:0/3876513869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009420 con 0x7ff850063e50 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84f7fe700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff850097c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff84ffff700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b1970 tx=0x7ff844017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400bbf0 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844000c90 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844009420 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84401a660 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.235+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850098150 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.236+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85004c710 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.236+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ff84401a9d0 con 0x7ff850063e50 2024-02-10T00:05:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.236+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3969+0+0 (secure 0 0 0) 0x7ff84405ce80 con 0x7ff850063e50 2024-02-10T00:05:30.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.240+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ff844006fe0 con 0x7ff850063e50 2024-02-10T00:05:30.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.402+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff850144a40 con 0x7ff83c046070 2024-02-10T00:05:30.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.402+0000 7ff837fff700 1 -- 172.21.15.89:0/3876513869 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7ff850144a40 con 0x7ff83c046070 2024-02-10T00:05:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 >> v1:172.21.15.89:6816/47970 conn(0x7ff83c046070 legacy=0x7ff83c048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 msgr2=0x7ff85009a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b1970 tx=0x7ff844017000 comp rx=0 tx=0).stop 2024-02-10T00:05:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 shutdown_connections 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff85006f0b0 0x7ff850151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff850063e50 0x7ff85009a060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 --2- 172.21.15.89:0/3876513869 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff85006ec60 0x7ff850097c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 >> 172.21.15.89:0/3876513869 conn(0x7ff85006c7c0 msgr2=0x7ff850064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 shutdown_connections 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.404+0000 7ff856780700 1 -- 172.21.15.89:0/3876513869 wait complete. 2024-02-10T00:05:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-02-10T00:05:30.418 INFO:tasks.ceph:Scrubbing osd.1 2024-02-10T00:05:30.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-10T00:05:30.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.537+0000 7f8fe83ec700 1 Processor -- start 2024-02-10T00:05:30.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.537+0000 7f8fe83ec700 1 -- start start 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe83ec700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 0x7f8fe00aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe83ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 0x7f8fe0141e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe83ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe0067f00 con 0x7f8fe006f120 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe83ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00687f0 con 0x7f8fe006ecf0 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe83ec700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe006f650 con 0x7f8fe0067b30 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe5987700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 0x7f8fe0141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 0x7f8fe00aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6989700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8fe006f120 0x7f8fe013e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51780/0 (socket says 172.21.15.89:51780) 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6989700 1 -- 172.21.15.89:0/3799160827 learned_addr learned my addr 172.21.15.89:0/3799160827 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe5186700 1 -- 172.21.15.89:0/3799160827 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000525132 0 0) 0x7f8fe0067f00 con 0x7f8fe006f120 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 -- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 msgr2=0x7f8fe0141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 0x7f8fe0141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 -- 172.21.15.89:0/3799160827 >> v1:172.21.15.89:6789/0 conn(0x7f8fe006f120 legacy=0x7f8fe013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 -- 172.21.15.89:0/3799160827 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0141990 con 0x7f8fe0067b30 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe5987700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 0x7f8fe0141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.538+0000 7f8fe6188700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 0x7f8fe00aa310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009910 tx=0x7f8fd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6482af5f6d85fdcd server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe5186700 1 -- 172.21.15.89:0/3799160827 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000b6b0 con 0x7f8fe0067b30 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe5186700 1 -- 172.21.15.89:0/3799160827 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000b810 con 0x7f8fe0067b30 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe5186700 1 -- 172.21.15.89:0/3799160827 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000bbd0 con 0x7f8fe0067b30 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 msgr2=0x7f8fe00aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 0x7f8fe00aa310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009910 tx=0x7f8fd00091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3799160827 shutdown_connections 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe0067b30 0x7f8fe00aa310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 --2- 172.21.15.89:0/3799160827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006ecf0 0x7f8fe0141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3799160827 >> 172.21.15.89:0/3799160827 conn(0x7f8fe006c7c0 msgr2=0x7f8fe0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3799160827 shutdown_connections 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.539+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3799160827 wait complete. 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.540+0000 7f8fe83ec700 1 Processor -- start 2024-02-10T00:05:30.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.540+0000 7f8fe83ec700 1 -- start start 2024-02-10T00:05:30.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 0x7f8fe0098c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe006ecf0 0x7f8fe00978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006f120 0x7f8fe0151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00ad2d0 con 0x7f8fe0067b30 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0098280 con 0x7f8fe006f120 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0142660 con 0x7f8fe006ecf0 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 0x7f8fe0098c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 0x7f8fe0098c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60384/0 (socket says 172.21.15.89:60384) 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 -- 172.21.15.89:0/3626713401 learned_addr learned my addr 172.21.15.89:0/3626713401 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe5987700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe006ecf0 0x7f8fe00978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6989700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006f120 0x7f8fe0151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 -- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe006ecf0 msgr2=0x7f8fe00978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe006ecf0 0x7f8fe00978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 -- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006f120 msgr2=0x7f8fe0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fe006f120 0x7f8fe0151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 -- 172.21.15.89:0/3626713401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009420 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe5987700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f8fe006ecf0 0x7f8fe00978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe6188700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 0x7f8fe0098c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009fb0 tx=0x7f8fd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000bb90 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0000c90 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd0009420 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd001a680 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.541+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe0097df0 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.542+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f8fd001aa30 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.542+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8fe0098070 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.543+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f8fd005d050 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.543+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 --> v1:172.21.15.89:6800/50630 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fc4052fb0 con 0x7f8fc404f2b0 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.543+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd005f690 con 0x7f8fe0067b30 2024-02-10T00:05:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.543+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== osd.1 v1:172.21.15.89:6800/50630 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f8fc4052fb0 con 0x7f8fc404f2b0 2024-02-10T00:05:30.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.557+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 --> v1:172.21.15.89:6800/50630 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8fe009a440 con 0x7f8fc404f2b0 2024-02-10T00:05:30.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.557+0000 7f8fd67fc700 1 -- 172.21.15.89:0/3626713401 <== osd.1 v1:172.21.15.89:6800/50630 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f8fe009a440 con 0x7f8fc404f2b0 2024-02-10T00:05:30.559 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:30.560 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-10T00:05:30.560 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:30.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.557+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 >> v1:172.21.15.89:6800/50630 conn(0x7f8fc404f2b0 legacy=0x7f8fc4051740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 >> v1:172.21.15.89:6816/47970 conn(0x7f8fc4046040 legacy=0x7f8fc40484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 msgr2=0x7f8fe0098c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 --2- 172.21.15.89:0/3626713401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe0067b30 0x7f8fe0098c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009fb0 tx=0x7f8fd0017000 comp rx=0 tx=0).stop 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe6989700 1 -- 172.21.15.89:0/3626713401 reap_dead start 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 shutdown_connections 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 >> 172.21.15.89:0/3626713401 conn(0x7f8fe006c7c0 msgr2=0x7f8fe00af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 shutdown_connections 2024-02-10T00:05:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.558+0000 7f8fe83ec700 1 -- 172.21.15.89:0/3626713401 wait complete. 2024-02-10T00:05:30.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.685+0000 7fbe5160e700 1 Processor -- start 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 -- start start 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbe4c06f110 0x7fbe4c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c06ff80 con 0x7fbe4c06f110 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c141a00 con 0x7fbe4c06ece0 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe5160e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0641a0 con 0x7fbe4c06fbb0 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbe4c06f110 0x7fbe4c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4a7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbe4c06f110 0x7fbe4c1424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60386/0 (socket says 172.21.15.89:60386) 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4b7fe700 1 -- 172.21.15.89:0/3205587741 learned_addr learned my addr 172.21.15.89:0/3205587741 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4a7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37974/0 (socket says 172.21.15.89:37974) 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c0aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57442/0 (socket says 172.21.15.89:57442) 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4b7fe700 1 -- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 msgr2=0x7fbe4c0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.686+0000 7fbe4b7fe700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe4b7fe700 1 -- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 msgr2=0x7fbe4c141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe4b7fe700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe4b7fe700 1 -- 172.21.15.89:0/3205587741 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c06f6b0 con 0x7fbe4c06f110 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe4a7fc700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe4b7fe700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1424a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009f20 tx=0x7fbe44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c68c696b3eac692 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe49ffb700 1 -- 172.21.15.89:0/3205587741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400e070 con 0x7fbe4c06f110 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe49ffb700 1 -- 172.21.15.89:0/3205587741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400b970 con 0x7fbe4c06f110 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe49ffb700 1 -- 172.21.15.89:0/3205587741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440092e0 con 0x7fbe4c06f110 2024-02-10T00:05:30.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 -- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 msgr2=0x7fbe4c1424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1424a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009f20 tx=0x7fbe44009840 comp rx=0 tx=0).stop 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 -- 172.21.15.89:0/3205587741 shutdown_connections 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1424a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c0aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 --2- 172.21.15.89:0/3205587741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 -- 172.21.15.89:0/3205587741 >> 172.21.15.89:0/3205587741 conn(0x7fbe4c06c7c0 msgr2=0x7fbe4c063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 -- 172.21.15.89:0/3205587741 shutdown_connections 2024-02-10T00:05:30.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.687+0000 7fbe5160e700 1 -- 172.21.15.89:0/3205587741 wait complete. 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.688+0000 7fbe5160e700 1 Processor -- start 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.688+0000 7fbe5160e700 1 -- start start 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0ade90 con 0x7fbe4c06f110 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c098b90 con 0x7fbe4c06ece0 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe5160e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c099770 con 0x7fbe4c06fbb0 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37982/0 (socket says 172.21.15.89:37982) 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4affd700 1 -- 172.21.15.89:0/1135318543 learned_addr learned my addr 172.21.15.89:0/1135318543 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 -- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 msgr2=0x7fbe4c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 -- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 msgr2=0x7fbe4c096f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 -- 172.21.15.89:0/1135318543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009420 con 0x7fbe4c06f110 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4b7fe700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4affd700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.689+0000 7fbe4a7fc700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1511c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00ec50 tx=0x7fbe3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.690+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00c850 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.690+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00c9b0 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.690+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe44009ae0 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.690+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00cd70 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.690+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c0ae5a0 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.691+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbe3c013680 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.691+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c04c710 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.691+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4230+0+0 (secure 0 0 0) 0x7fbe3c05b570 con 0x7fbe4c06f110 2024-02-10T00:05:30.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.694+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fbe3c039630 con 0x7fbe4c06f110 2024-02-10T00:05:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.847+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe4c13ef50 con 0x7fbe38046040 2024-02-10T00:05:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.847+0000 7fbe32ffd700 1 -- 172.21.15.89:0/1135318543 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7fbe4c13ef50 con 0x7fbe38046040 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 >> v1:172.21.15.89:6816/47970 conn(0x7fbe38046040 legacy=0x7fbe380484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 msgr2=0x7fbe4c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1511c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00ec50 tx=0x7fbe3c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 shutdown_connections 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fbe4c06fbb0 0x7fbe4c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe4c06ece0 0x7fbe4c096f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 --2- 172.21.15.89:0/1135318543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe4c06f110 0x7fbe4c1511c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 >> 172.21.15.89:0/1135318543 conn(0x7fbe4c06c7c0 msgr2=0x7fbe4c0aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 shutdown_connections 2024-02-10T00:05:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.849+0000 7fbe5160e700 1 -- 172.21.15.89:0/1135318543 wait complete. 2024-02-10T00:05:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-02-10T00:05:30.863 INFO:tasks.ceph:Scrubbing osd.2 2024-02-10T00:05:30.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-10T00:05:30.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 Processor -- start 2024-02-10T00:05:30.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 -- start start 2024-02-10T00:05:30.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 0x7f4428139e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442806e2d0 con 0x7f442813a390 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.981+0000 7f442eae2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44280b1c80 con 0x7f44280b18b0 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442eae2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f442806eb50 con 0x7f442806f630 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442c87e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442c87e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60422/0 (socket says 172.21.15.89:60422) 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 0x7f4428139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442d07f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f442813a390 0x7f44280a1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51784/0 (socket says 172.21.15.89:51784) 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442c87e700 1 -- 172.21.15.89:0/4048647678 learned_addr learned my addr 172.21.15.89:0/4048647678 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 -- 172.21.15.89:0/4048647678 >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 msgr2=0x7f442806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 --2- 172.21.15.89:0/4048647678 >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 -- 172.21.15.89:0/4048647678 >> v1:172.21.15.89:6789/0 conn(0x7f442813a390 legacy=0x7f44280a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 -- 172.21.15.89:0/4048647678 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442806edd0 con 0x7f442806f630 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f44277fe700 1 -- 172.21.15.89:0/4048647678 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038936806 0 0) 0x7f442806e2d0 con 0x7f442813a390 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f442c87e700 1 --2- 172.21.15.89:0/4048647678 >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f4427fff700 1 --2- 172.21.15.89:0/4048647678 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 0x7f4428139e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44140098e0 tx=0x7f44140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55534885c830e6db server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f44277fe700 1 -- 172.21.15.89:0/4048647678 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400b640 con 0x7f442806f630 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f44277fe700 1 -- 172.21.15.89:0/4048647678 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400b7a0 con 0x7f442806f630 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.982+0000 7f44277fe700 1 -- 172.21.15.89:0/4048647678 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400bb40 con 0x7f442806f630 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 -- 172.21.15.89:0/4048647678 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 msgr2=0x7f4428139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 --2- 172.21.15.89:0/4048647678 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 0x7f4428139e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44140098e0 tx=0x7f44140091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 -- 172.21.15.89:0/4048647678 shutdown_connections 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 --2- 172.21.15.89:0/4048647678 >> v2:172.21.15.89:3300/0 conn(0x7f44280b18b0 0x7f442806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 --2- 172.21.15.89:0/4048647678 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f442806f630 0x7f4428139e50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 -- 172.21.15.89:0/4048647678 >> 172.21.15.89:0/4048647678 conn(0x7f442806a820 msgr2=0x7f44280b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 -- 172.21.15.89:0/4048647678 shutdown_connections 2024-02-10T00:05:30.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.983+0000 7f442eae2700 1 -- 172.21.15.89:0/4048647678 wait complete. 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 Processor -- start 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 -- start start 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 0x7f44280aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f44280b18b0 0x7f44280a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442813a390 0x7f44280a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280a80e0 con 0x7f442806f630 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280ae160 con 0x7f442813a390 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442eae2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44280a73a0 con 0x7f44280b18b0 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.984+0000 7f442c87e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 0x7f44280aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 0x7f44280aae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60434/0 (socket says 172.21.15.89:60434) 2024-02-10T00:05:30.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 -- 172.21.15.89:0/4128638615 learned_addr learned my addr 172.21.15.89:0/4128638615 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442d07f700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442813a390 0x7f44280a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f4427fff700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f44280b18b0 0x7f44280a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 -- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f44280b18b0 msgr2=0x7f44280a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f44280b18b0 0x7f44280a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 -- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442813a390 msgr2=0x7f44280a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442813a390 0x7f44280a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 -- 172.21.15.89:0/4128638615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c00a690 con 0x7f442806f630 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442d07f700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f442813a390 0x7f44280a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442c87e700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 0x7f44280aae30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f441c00fc00 tx=0x7f441c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00da30 con 0x7f442806f630 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c00db90 con 0x7f442806f630 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4414009420 con 0x7f442806f630 2024-02-10T00:05:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c01b480 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.985+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44280a8780 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.986+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f442804c710 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.986+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f441c012460 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.986+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f441c016070 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.986+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 --> v1:172.21.15.89:6804/50752 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f440c052fb0 con 0x7f440c04f2b0 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.986+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441c05f470 con 0x7f442806f630 2024-02-10T00:05:30.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:30.987+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== osd.2 v1:172.21.15.89:6804/50752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f440c052fb0 con 0x7f440c04f2b0 2024-02-10T00:05:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 --> v1:172.21.15.89:6804/50752 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f442806dbb0 con 0x7f440c04f2b0 2024-02-10T00:05:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f4424ff9700 1 -- 172.21.15.89:0/4128638615 <== osd.2 v1:172.21.15.89:6804/50752 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f442806dbb0 con 0x7f440c04f2b0 2024-02-10T00:05:31.003 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:31.003 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-10T00:05:31.003 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 >> v1:172.21.15.89:6804/50752 conn(0x7f440c04f2b0 legacy=0x7f440c051740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 >> v1:172.21.15.89:6816/47970 conn(0x7f440c046040 legacy=0x7f440c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 msgr2=0x7f44280aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 --2- 172.21.15.89:0/4128638615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442806f630 0x7f44280aae30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f441c00fc00 tx=0x7f441c00a3f0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442d07f700 1 -- 172.21.15.89:0/4128638615 reap_dead start 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 shutdown_connections 2024-02-10T00:05:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 >> 172.21.15.89:0/4128638615 conn(0x7f442806a820 msgr2=0x7f4428064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 shutdown_connections 2024-02-10T00:05:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.001+0000 7f442eae2700 1 -- 172.21.15.89:0/4128638615 wait complete. 2024-02-10T00:05:31.015 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-10T00:05:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.129+0000 7f89d657b700 1 Processor -- start 2024-02-10T00:05:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.129+0000 7f89d657b700 1 -- start start 2024-02-10T00:05:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d657b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d657b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d657b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00b1a10 con 0x7f89d0063740 2024-02-10T00:05:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d657b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d006dbb0 con 0x7f89d013f060 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d657b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d013f500 con 0x7f89d006f7c0 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d4b18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f89d0063740 0x7f89d006dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51792/0 (socket says 172.21.15.89:51792) 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57474/0 (socket says 172.21.15.89:57474) 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d4b18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:37998/0 (socket says 172.21.15.89:37998) 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 -- 172.21.15.89:0/996954691 learned_addr learned my addr 172.21.15.89:0/996954691 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 -- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 msgr2=0x7f89d0145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 -- 172.21.15.89:0/996954691 >> v1:172.21.15.89:6789/0 conn(0x7f89d0063740 legacy=0x7f89d006dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 -- 172.21.15.89:0/996954691 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0063b10 con 0x7f89d006f7c0 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89ceffd700 1 -- 172.21.15.89:0/996954691 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340580620 0 0) 0x7f89d00b1a10 con 0x7f89d0063740 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89d4b18700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89cf7fe700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f89c00099e0 tx=0x7f89c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23934672259f5abe server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89ceffd700 1 -- 172.21.15.89:0/996954691 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000b890 con 0x7f89d006f7c0 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89ceffd700 1 -- 172.21.15.89:0/996954691 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000b9f0 con 0x7f89d006f7c0 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.130+0000 7f89ceffd700 1 -- 172.21.15.89:0/996954691 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000bd90 con 0x7f89d006f7c0 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 -- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 msgr2=0x7f89d013eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f89c00099e0 tx=0x7f89c0009250 comp rx=0 tx=0).stop 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 -- 172.21.15.89:0/996954691 shutdown_connections 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d013f060 0x7f89d0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 --2- 172.21.15.89:0/996954691 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d006f7c0 0x7f89d013eb20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 -- 172.21.15.89:0/996954691 >> 172.21.15.89:0/996954691 conn(0x7f89d006a820 msgr2=0x7f89d00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 -- 172.21.15.89:0/996954691 shutdown_connections 2024-02-10T00:05:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.131+0000 7f89d657b700 1 -- 172.21.15.89:0/996954691 wait complete. 2024-02-10T00:05:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.132+0000 7f89d657b700 1 Processor -- start 2024-02-10T00:05:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.132+0000 7f89d657b700 1 -- start start 2024-02-10T00:05:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d006f7c0 0x7f89d0099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d013f060 0x7f89d0098650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d014dfa0 con 0x7f89d0063740 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01382f0 con 0x7f89d006f7c0 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d657b700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0098140 con 0x7f89d013f060 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89cffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89cffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60436/0 (socket says 172.21.15.89:60436) 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89cffff700 1 -- 172.21.15.89:0/4189421857 learned_addr learned my addr 172.21.15.89:0/4189421857 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89d4b18700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d013f060 0x7f89d0098650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.133+0000 7f89cf7fe700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d006f7c0 0x7f89d0099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 -- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d013f060 msgr2=0x7f89d0098650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d013f060 0x7f89d0098650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 -- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d006f7c0 msgr2=0x7f89d0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d006f7c0 0x7f89d0099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 -- 172.21.15.89:0/4189421857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8009a20 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89cffff700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ea20 tx=0x7f89c4007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40070f0 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4007270 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c00094f0 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4007630 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.134+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d0098b90 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.135+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f89c4004c50 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.135+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0098360 con 0x7f89d0063740 2024-02-10T00:05:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.135+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f89c405d8e0 con 0x7f89d0063740 2024-02-10T00:05:31.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.139+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f89c403b9d0 con 0x7f89d0063740 2024-02-10T00:05:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.302+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f89d009a210 con 0x7f89bc046040 2024-02-10T00:05:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.302+0000 7f89b7fff700 1 -- 172.21.15.89:0/4189421857 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f89c0006c50 con 0x7f89bc046040 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 >> v1:172.21.15.89:6816/47970 conn(0x7f89bc046040 legacy=0x7f89bc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 msgr2=0x7f89d0137db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ea20 tx=0x7f89c4007e20 comp rx=0 tx=0).stop 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 shutdown_connections 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f89d013f060 0x7f89d0098650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d0063740 0x7f89d0137db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 --2- 172.21.15.89:0/4189421857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d006f7c0 0x7f89d0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 >> 172.21.15.89:0/4189421857 conn(0x7f89d006a820 msgr2=0x7f89d0064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 shutdown_connections 2024-02-10T00:05:31.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.304+0000 7f89d657b700 1 -- 172.21.15.89:0/4189421857 wait complete. 2024-02-10T00:05:31.307 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-02-10T00:05:31.318 INFO:tasks.ceph:Scrubbing osd.3 2024-02-10T00:05:31.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.436+0000 7f5aea0f9700 1 Processor -- start 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.436+0000 7f5aea0f9700 1 -- start start 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5aea0f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 0x7f5ae406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5aea0f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae4145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5aea0f9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40a7570 con 0x7f5ae40a71a0 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5aea0f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406d990 con 0x7f5ae4143970 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5aea0f9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406db80 con 0x7f5ae406fcf0 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae2ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 0x7f5ae406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae37fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5ae40a71a0 0x7f5ae406e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51806/0 (socket says 172.21.15.89:51806) 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae4145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae37fe700 1 -- 172.21.15.89:0/1855513437 learned_addr learned my addr 172.21.15.89:0/1855513437 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae2ffd700 1 -- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 msgr2=0x7f5ae4145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae2ffd700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae4145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae27fc700 1 -- 172.21.15.89:0/1855513437 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214838721 0 0) 0x7f5ae40a7570 con 0x7f5ae40a71a0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae2ffd700 1 -- 172.21.15.89:0/1855513437 >> v1:172.21.15.89:6789/0 conn(0x7f5ae40a71a0 legacy=0x7f5ae406e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae2ffd700 1 -- 172.21.15.89:0/1855513437 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae406de20 con 0x7f5ae406fcf0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.437+0000 7f5ae3fff700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae4145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5ae2ffd700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 0x7f5ae406d450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009910 tx=0x7f5ad40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b93aede8b326a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5ae27fc700 1 -- 172.21.15.89:0/1855513437 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4011630 con 0x7f5ae406fcf0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5ae27fc700 1 -- 172.21.15.89:0/1855513437 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4011790 con 0x7f5ae406fcf0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5ae27fc700 1 -- 172.21.15.89:0/1855513437 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4011b50 con 0x7f5ae406fcf0 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 msgr2=0x7f5ae406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 0x7f5ae406d450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009910 tx=0x7f5ad40091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1855513437 shutdown_connections 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae4145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 --2- 172.21.15.89:0/1855513437 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae406fcf0 0x7f5ae406d450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1855513437 >> 172.21.15.89:0/1855513437 conn(0x7f5ae406c7c0 msgr2=0x7f5ae4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1855513437 shutdown_connections 2024-02-10T00:05:31.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.438+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1855513437 wait complete. 2024-02-10T00:05:31.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.439+0000 7f5aea0f9700 1 Processor -- start 2024-02-10T00:05:31.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.439+0000 7f5aea0f9700 1 -- start start 2024-02-10T00:05:31.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae406fcf0 0x7f5ae40ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae40a71a0 0x7f5ae413b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae413b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40ad970 con 0x7f5ae406fcf0 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40aa5c0 con 0x7f5ae4143970 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5aea0f9700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40adc50 con 0x7f5ae40a71a0 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae2ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae40a71a0 0x7f5ae413b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae413b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae2ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae40a71a0 0x7f5ae413b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57512/0 (socket says 172.21.15.89:57512) 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae2ffd700 1 -- 172.21.15.89:0/1863943985 learned_addr learned my addr 172.21.15.89:0/1863943985 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae37fe700 1 --2- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae406fcf0 0x7f5ae40ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 -- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae40a71a0 msgr2=0x7f5ae413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 --2- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f5ae40a71a0 0x7f5ae413b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 -- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae406fcf0 msgr2=0x7f5ae40ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 --2- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae406fcf0 0x7f5ae40ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 -- 172.21.15.89:0/1863943985 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc009a20 con 0x7f5ae4143970 2024-02-10T00:05:31.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.440+0000 7f5ae3fff700 1 --2- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae413b700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ae406a5c0 tx=0x7f5adc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00ca70 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc00f040 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad4009420 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00ce40 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae40aaf90 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.441+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ae404c710 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.442+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5adc014690 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.442+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4459+0+0 (secure 0 0 0) 0x7f5adc05c040 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.442+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 --> v1:172.21.15.89:6812/50885 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad00532a0 con 0x7f5ad004f5a0 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.442+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5adc05e680 con 0x7f5ae4143970 2024-02-10T00:05:31.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.443+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== osd.3 v1:172.21.15.89:6812/50885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f5ad00532a0 con 0x7f5ad004f5a0 2024-02-10T00:05:31.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.456+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 --> v1:172.21.15.89:6812/50885 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ae406f890 con 0x7f5ad004f5a0 2024-02-10T00:05:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5acb7fe700 1 -- 172.21.15.89:0/1863943985 <== osd.3 v1:172.21.15.89:6812/50885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f5ae406f890 con 0x7f5ad004f5a0 2024-02-10T00:05:31.459 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-02-10T00:05:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-10T00:05:31.459 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-02-10T00:05:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 >> v1:172.21.15.89:6812/50885 conn(0x7f5ad004f5a0 legacy=0x7f5ad0051a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 >> v1:172.21.15.89:6816/47970 conn(0x7f5ad0046040 legacy=0x7f5ad00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 msgr2=0x7f5ae413b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 --2- 172.21.15.89:0/1863943985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ae4143970 0x7f5ae413b700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ae406a5c0 tx=0x7f5adc00b040 comp rx=0 tx=0).stop 2024-02-10T00:05:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5ae3fff700 1 -- 172.21.15.89:0/1863943985 reap_dead start 2024-02-10T00:05:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 shutdown_connections 2024-02-10T00:05:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 >> 172.21.15.89:0/1863943985 conn(0x7f5ae406c7c0 msgr2=0x7f5ae4064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 shutdown_connections 2024-02-10T00:05:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.457+0000 7f5aea0f9700 1 -- 172.21.15.89:0/1863943985 wait complete. 2024-02-10T00:05:31.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.585+0000 7ff6a90e4700 1 Processor -- start 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.585+0000 7ff6a90e4700 1 -- start start 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a40aab20 con 0x7ff6a4063c90 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a406ff80 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a90e4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4141a50 con 0x7ff6a406e550 2024-02-10T00:05:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a359e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:38028/0 (socket says 172.21.15.89:38028) 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60456/0 (socket says 172.21.15.89:60456) 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 -- 172.21.15.89:0/1216905133 learned_addr learned my addr 172.21.15.89:0/1216905133 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 -- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 msgr2=0x7ff6a406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a406e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 -- 172.21.15.89:0/1216905133 >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 msgr2=0x7ff6a406a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 --2- 172.21.15.89:0/1216905133 >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 -- 172.21.15.89:0/1216905133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4141cf0 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a2d9d700 1 --2- 172.21.15.89:0/1216905133 >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a359e700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a406e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.586+0000 7ff6a259c700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6940099e0 tx=0x7ff694009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98da4c30e419817f server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a1d9b700 1 -- 172.21.15.89:0/1216905133 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400b640 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a1d9b700 1 -- 172.21.15.89:0/1216905133 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400b7a0 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a1d9b700 1 -- 172.21.15.89:0/1216905133 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400bb40 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 -- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 msgr2=0x7ff6a4142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6940099e0 tx=0x7ff694009250 comp rx=0 tx=0).stop 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 -- 172.21.15.89:0/1216905133 shutdown_connections 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a406e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/1216905133 >> v2:172.21.15.89:3300/0 conn(0x7ff6a4063c90 0x7ff6a406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/1216905133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4142120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 -- 172.21.15.89:0/1216905133 >> 172.21.15.89:0/1216905133 conn(0x7ff6a406d8c0 msgr2=0x7ff6a4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 -- 172.21.15.89:0/1216905133 shutdown_connections 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.587+0000 7ff6a90e4700 1 -- 172.21.15.89:0/1216905133 wait complete. 2024-02-10T00:05:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.588+0000 7ff6a90e4700 1 Processor -- start 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.588+0000 7ff6a90e4700 1 -- start start 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40adc20 con 0x7ff6a4063c90 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a411b070 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a90e4700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40aea00 con 0x7ff6a406e550 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a2d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a2d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60462/0 (socket says 172.21.15.89:60462) 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a2d9d700 1 -- 172.21.15.89:0/2889760168 learned_addr learned my addr 172.21.15.89:0/2889760168 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a259c700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 -- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 msgr2=0x7ff6a41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 -- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 msgr2=0x7ff6a411ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 -- 172.21.15.89:0/2889760168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698009420 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a2d9d700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff6a359e700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4151900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009f10 tx=0x7ff69c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00cb70 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.589+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00f040 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.590+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c009a20 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.590+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c014480 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.590+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940094f0 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.590+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ff69c003020 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.591+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a404c710 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.591+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4459+0+0 (secure 0 0 0) 0x7ff69c05bd40 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.594+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ff69c039c10 con 0x7ff6a40ab6d0 2024-02-10T00:05:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.747+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a4140db0 con 0x7ff690046070 2024-02-10T00:05:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.747+0000 7ff68affd700 1 -- 172.21.15.89:0/2889760168 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7ff6a4140db0 con 0x7ff690046070 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 >> v1:172.21.15.89:6816/47970 conn(0x7ff690046070 legacy=0x7ff690048520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 msgr2=0x7ff6a4151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4151900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009f10 tx=0x7ff69c00b040 comp rx=0 tx=0).stop 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 shutdown_connections 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6a40ab6d0 0x7ff6a4151900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4063c90 0x7ff6a411ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 --2- 172.21.15.89:0/2889760168 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff6a406e550 0x7ff6a41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 >> 172.21.15.89:0/2889760168 conn(0x7ff6a406d8c0 msgr2=0x7ff6a4063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 shutdown_connections 2024-02-10T00:05:31.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.749+0000 7ff6a90e4700 1 -- 172.21.15.89:0/2889760168 wait complete. 2024-02-10T00:05:31.752 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2024-02-10T00:05:31.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:31.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.876+0000 7fabd5887700 1 Processor -- start 2024-02-10T00:05:31.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.876+0000 7fabd5887700 1 -- start start 2024-02-10T00:05:31.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabd5887700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabd5887700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabd5887700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00a62d0 con 0x7fabd0063e50 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabd5887700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd0064220 con 0x7fabd013bc00 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabd5887700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00a67f0 con 0x7fabd00a6fd0 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabcf7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabcf7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60476/0 (socket says 172.21.15.89:60476) 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57552/0 (socket says 172.21.15.89:57552) 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabceffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fabd0063e50 0x7fabd00a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51818/0 (socket says 172.21.15.89:51818) 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabcf7fe700 1 -- 172.21.15.89:0/354295834 learned_addr learned my addr 172.21.15.89:0/354295834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 -- 172.21.15.89:0/354295834 >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 msgr2=0x7fabd01458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:31.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 --2- 172.21.15.89:0/354295834 >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 -- 172.21.15.89:0/354295834 >> v1:172.21.15.89:6789/0 conn(0x7fabd0063e50 legacy=0x7fabd00a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 -- 172.21.15.89:0/354295834 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00a6030 con 0x7fabd00a6fd0 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabcf7fe700 1 --2- 172.21.15.89:0/354295834 >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.877+0000 7fabce7fc700 1 --2- 172.21.15.89:0/354295834 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009910 tx=0x7fabc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b73b7d366862483 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabcdffb700 1 -- 172.21.15.89:0/354295834 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000b640 con 0x7fabd00a6fd0 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabcdffb700 1 -- 172.21.15.89:0/354295834 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000b7a0 con 0x7fabd00a6fd0 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabcdffb700 1 -- 172.21.15.89:0/354295834 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000bb60 con 0x7fabd00a6fd0 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 -- 172.21.15.89:0/354295834 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 msgr2=0x7fabd013b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 --2- 172.21.15.89:0/354295834 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009910 tx=0x7fabc00091a0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 -- 172.21.15.89:0/354295834 shutdown_connections 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 --2- 172.21.15.89:0/354295834 >> v2:172.21.15.89:3300/0 conn(0x7fabd013bc00 0x7fabd01458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 --2- 172.21.15.89:0/354295834 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd00a6fd0 0x7fabd013b6c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 -- 172.21.15.89:0/354295834 >> 172.21.15.89:0/354295834 conn(0x7fabd006c7c0 msgr2=0x7fabd0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:31.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 -- 172.21.15.89:0/354295834 shutdown_connections 2024-02-10T00:05:31.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.878+0000 7fabd5887700 1 -- 172.21.15.89:0/354295834 wait complete. 2024-02-10T00:05:31.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.879+0000 7fabd5887700 1 Processor -- start 2024-02-10T00:05:31.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.879+0000 7fabd5887700 1 -- start start 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd013bc00 0x7fabd014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00ad1a0 con 0x7fabd00a6fd0 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00ac4d0 con 0x7fabd013bc00 2024-02-10T00:05:31.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00ac690 con 0x7fabd0063e50 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:57560/0 (socket says 172.21.15.89:57560) 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabcf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd013bc00 0x7fabd014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 -- 172.21.15.89:0/2246960860 learned_addr learned my addr 172.21.15.89:0/2246960860 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabce7fc700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60488/0 (socket says 172.21.15.89:60488) 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 -- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd013bc00 msgr2=0x7fabd014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd013bc00 0x7fabd014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 -- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 msgr2=0x7fabd014cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:31.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 -- 172.21.15.89:0/2246960860 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc800bcf0 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabce7fc700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabceffd700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c7c0 tx=0x7fabc4007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4005a70 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4005bd0 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0009420 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40070d0 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.880+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0097780 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.881+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fabc4007480 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.881+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd0097970 con 0x7fabd0063e50 2024-02-10T00:05:31.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.882+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4459+0+0 (secure 0 0 0) 0x7fabc405a890 con 0x7fabd0063e50 2024-02-10T00:05:31.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:31.885+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fabc4038870 con 0x7fabd0063e50 2024-02-10T00:05:32.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.036+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabd004c740 con 0x7fabbc046040 2024-02-10T00:05:32.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.042+0000 7fabb6ffd700 1 -- 172.21.15.89:0/2246960860 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273431 (unknown 2965378022 0 3424906498) 0x7fabd004c740 con 0x7fabbc046040 2024-02-10T00:05:32.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 >> v1:172.21.15.89:6816/47970 conn(0x7fabbc046040 legacy=0x7fabbc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 msgr2=0x7fabd014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c7c0 tx=0x7fabc4007f70 comp rx=0 tx=0).stop 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 shutdown_connections 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd013bc00 0x7fabd014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fabd0063e50 0x7fabd014a050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:32.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 --2- 172.21.15.89:0/2246960860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00a6fd0 0x7fabd014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 >> 172.21.15.89:0/2246960860 conn(0x7fabd006c7c0 msgr2=0x7fabd0064970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 shutdown_connections 2024-02-10T00:05:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:32.045+0000 7fabd5887700 1 -- 172.21.15.89:0/2246960860 wait complete. 2024-02-10T00:05:32.054 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:32.059 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-10T00:05:31.175343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227097,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65350,"num_write_kb":9046232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71787,"ondisk_log_size":71787,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537396,"kb_used_data":290964,"kb_used_omap":840,"kb_used_meta":1245559,"kb_avail":375949964,"statfs":{"total":386547056640,"available":384972763136,"internally_reserved":0,"allocated":297947136,"data_stored":297074670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275452923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.032137"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195716+0000","last_change":"2024-02-10T00:04:54.406284+0000","last_active":"2024-02-10T00:05:03.195716+0000","last_peered":"2024-02-10T00:05:03.195716+0000","last_clean":"2024-02-10T00:05:03.195716+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:03.195716+0000","last_undegraded":"2024-02-10T00:05:03.195716+0000","last_fullsized":"2024-02-10T00:05:03.195716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:29:37.413651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197351+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:03.197351+0000","last_peered":"2024-02-10T00:05:03.197351+0000","last_clean":"2024-02-10T00:05:03.197351+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:03.197351+0000","last_undegraded":"2024-02-10T00:05:03.197351+0000","last_fullsized":"2024-02-10T00:05:03.197351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:08:04.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":909,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213630+0000","last_change":"2024-02-10T00:04:50.489100+0000","last_active":"2024-02-10T00:05:05.213630+0000","last_peered":"2024-02-10T00:05:05.213630+0000","last_clean":"2024-02-10T00:05:05.213630+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:05.213630+0000","last_undegraded":"2024-02-10T00:05:05.213630+0000","last_fullsized":"2024-02-10T00:05:05.213630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:42:56.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213695+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:05.213695+0000","last_peered":"2024-02-10T00:05:05.213695+0000","last_clean":"2024-02-10T00:05:05.213695+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:05.213695+0000","last_undegraded":"2024-02-10T00:05:05.213695+0000","last_fullsized":"2024-02-10T00:05:05.213695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:04.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":833,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213378+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:05.213378+0000","last_peered":"2024-02-10T00:05:05.213378+0000","last_clean":"2024-02-10T00:05:05.213378+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:05.213378+0000","last_undegraded":"2024-02-10T00:05:05.213378+0000","last_fullsized":"2024-02-10T00:05:05.213378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:42.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":867,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197512+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:03.197512+0000","last_peered":"2024-02-10T00:05:03.197512+0000","last_clean":"2024-02-10T00:05:03.197512+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:03.197512+0000","last_undegraded":"2024-02-10T00:05:03.197512+0000","last_fullsized":"2024-02-10T00:05:03.197512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:38:03.439834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199254+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:03.199254+0000","last_peered":"2024-02-10T00:05:03.199254+0000","last_clean":"2024-02-10T00:05:03.199254+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:03.199254+0000","last_undegraded":"2024-02-10T00:05:03.199254+0000","last_fullsized":"2024-02-10T00:05:03.199254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:04:44.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":798,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196252+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:03.196252+0000","last_peered":"2024-02-10T00:05:03.196252+0000","last_clean":"2024-02-10T00:05:03.196252+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:03.196252+0000","last_undegraded":"2024-02-10T00:05:03.196252+0000","last_fullsized":"2024-02-10T00:05:03.196252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:19.954991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":927,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213994+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:05.213994+0000","last_peered":"2024-02-10T00:05:05.213994+0000","last_clean":"2024-02-10T00:05:05.213994+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:05.213994+0000","last_undegraded":"2024-02-10T00:05:05.213994+0000","last_fullsized":"2024-02-10T00:05:05.213994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:59:08.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197889+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:03.197889+0000","last_peered":"2024-02-10T00:05:03.197889+0000","last_clean":"2024-02-10T00:05:03.197889+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:03.197889+0000","last_undegraded":"2024-02-10T00:05:03.197889+0000","last_fullsized":"2024-02-10T00:05:03.197889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:55:07.193680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":845,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197279+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:03.197279+0000","last_peered":"2024-02-10T00:05:03.197279+0000","last_clean":"2024-02-10T00:05:03.197279+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:03.197279+0000","last_undegraded":"2024-02-10T00:05:03.197279+0000","last_fullsized":"2024-02-10T00:05:03.197279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:02.340330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196527+0000","last_change":"2024-02-10T00:04:54.380501+0000","last_active":"2024-02-10T00:05:03.196527+0000","last_peered":"2024-02-10T00:05:03.196527+0000","last_clean":"2024-02-10T00:05:03.196527+0000","last_became_active":"2024-02-10T00:04:54.364324+0000","last_became_peered":"2024-02-10T00:04:54.364324+0000","last_unstale":"2024-02-10T00:05:03.196527+0000","last_undegraded":"2024-02-10T00:05:03.196527+0000","last_fullsized":"2024-02-10T00:05:03.196527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:14:51.073967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":964,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198230+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:03.198230+0000","last_peered":"2024-02-10T00:05:03.198230+0000","last_clean":"2024-02-10T00:05:03.198230+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:03.198230+0000","last_undegraded":"2024-02-10T00:05:03.198230+0000","last_fullsized":"2024-02-10T00:05:03.198230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:39:53.391652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":936,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195642+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:03.195642+0000","last_peered":"2024-02-10T00:05:03.195642+0000","last_clean":"2024-02-10T00:05:03.195642+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:03.195642+0000","last_undegraded":"2024-02-10T00:05:03.195642+0000","last_fullsized":"2024-02-10T00:05:03.195642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:08.045466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213324+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:05.213324+0000","last_peered":"2024-02-10T00:05:05.213324+0000","last_clean":"2024-02-10T00:05:05.213324+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:05.213324+0000","last_undegraded":"2024-02-10T00:05:05.213324+0000","last_fullsized":"2024-02-10T00:05:05.213324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:56:07.718772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197103+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:03.197103+0000","last_peered":"2024-02-10T00:05:03.197103+0000","last_clean":"2024-02-10T00:05:03.197103+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:03.197103+0000","last_undegraded":"2024-02-10T00:05:03.197103+0000","last_fullsized":"2024-02-10T00:05:03.197103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:36.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":982,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214235+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:05.214235+0000","last_peered":"2024-02-10T00:05:05.214235+0000","last_clean":"2024-02-10T00:05:05.214235+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:05.214235+0000","last_undegraded":"2024-02-10T00:05:05.214235+0000","last_fullsized":"2024-02-10T00:05:05.214235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":782,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213633+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:05.213633+0000","last_peered":"2024-02-10T00:05:05.213633+0000","last_clean":"2024-02-10T00:05:05.213633+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:05.213633+0000","last_undegraded":"2024-02-10T00:05:05.213633+0000","last_fullsized":"2024-02-10T00:05:05.213633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:16:36.498643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1013,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197053+0000","last_change":"2024-02-10T00:04:54.408042+0000","last_active":"2024-02-10T00:05:03.197053+0000","last_peered":"2024-02-10T00:05:03.197053+0000","last_clean":"2024-02-10T00:05:03.197053+0000","last_became_active":"2024-02-10T00:04:54.401540+0000","last_became_peered":"2024-02-10T00:04:54.401540+0000","last_unstale":"2024-02-10T00:05:03.197053+0000","last_undegraded":"2024-02-10T00:05:03.197053+0000","last_fullsized":"2024-02-10T00:05:03.197053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:56:38.390818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":889,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199354+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:03.199354+0000","last_peered":"2024-02-10T00:05:03.199354+0000","last_clean":"2024-02-10T00:05:03.199354+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:03.199354+0000","last_undegraded":"2024-02-10T00:05:03.199354+0000","last_fullsized":"2024-02-10T00:05:03.199354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:47.929868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":954,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196764+0000","last_change":"2024-02-10T00:04:54.388983+0000","last_active":"2024-02-10T00:05:03.196764+0000","last_peered":"2024-02-10T00:05:03.196764+0000","last_clean":"2024-02-10T00:05:03.196764+0000","last_became_active":"2024-02-10T00:04:54.352207+0000","last_became_peered":"2024-02-10T00:04:54.352207+0000","last_unstale":"2024-02-10T00:05:03.196764+0000","last_undegraded":"2024-02-10T00:05:03.196764+0000","last_fullsized":"2024-02-10T00:05:03.196764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:33:59.100535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":963,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213262+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:05.213262+0000","last_peered":"2024-02-10T00:05:05.213262+0000","last_clean":"2024-02-10T00:05:05.213262+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:05.213262+0000","last_undegraded":"2024-02-10T00:05:05.213262+0000","last_fullsized":"2024-02-10T00:05:05.213262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:45.051629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198737+0000","last_change":"2024-02-10T00:04:54.407242+0000","last_active":"2024-02-10T00:05:03.198737+0000","last_peered":"2024-02-10T00:05:03.198737+0000","last_clean":"2024-02-10T00:05:03.198737+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:03.198737+0000","last_undegraded":"2024-02-10T00:05:03.198737+0000","last_fullsized":"2024-02-10T00:05:03.198737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:00:42.674416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":957,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196109+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:03.196109+0000","last_peered":"2024-02-10T00:05:03.196109+0000","last_clean":"2024-02-10T00:05:03.196109+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:03.196109+0000","last_undegraded":"2024-02-10T00:05:03.196109+0000","last_fullsized":"2024-02-10T00:05:03.196109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:03:57.501787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":978,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198463+0000","last_change":"2024-02-10T00:04:54.397965+0000","last_active":"2024-02-10T00:05:03.198463+0000","last_peered":"2024-02-10T00:05:03.198463+0000","last_clean":"2024-02-10T00:05:03.198463+0000","last_became_active":"2024-02-10T00:04:54.372467+0000","last_became_peered":"2024-02-10T00:04:54.372467+0000","last_unstale":"2024-02-10T00:05:03.198463+0000","last_undegraded":"2024-02-10T00:05:03.198463+0000","last_fullsized":"2024-02-10T00:05:03.198463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:51:52.893500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198261+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:03.198261+0000","last_peered":"2024-02-10T00:05:03.198261+0000","last_clean":"2024-02-10T00:05:03.198261+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:03.198261+0000","last_undegraded":"2024-02-10T00:05:03.198261+0000","last_fullsized":"2024-02-10T00:05:03.198261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:42.228812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198656+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:03.198656+0000","last_peered":"2024-02-10T00:05:03.198656+0000","last_clean":"2024-02-10T00:05:03.198656+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:03.198656+0000","last_undegraded":"2024-02-10T00:05:03.198656+0000","last_fullsized":"2024-02-10T00:05:03.198656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:40:16.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1506,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196257+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:03.196257+0000","last_peered":"2024-02-10T00:05:03.196257+0000","last_clean":"2024-02-10T00:05:03.196257+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:03.196257+0000","last_undegraded":"2024-02-10T00:05:03.196257+0000","last_fullsized":"2024-02-10T00:05:03.196257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:11:04.581014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":872,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199077+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:03.199077+0000","last_peered":"2024-02-10T00:05:03.199077+0000","last_clean":"2024-02-10T00:05:03.199077+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:03.199077+0000","last_undegraded":"2024-02-10T00:05:03.199077+0000","last_fullsized":"2024-02-10T00:05:03.199077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:06.232912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195557+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:03.195557+0000","last_peered":"2024-02-10T00:05:03.195557+0000","last_clean":"2024-02-10T00:05:03.195557+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:03.195557+0000","last_undegraded":"2024-02-10T00:05:03.195557+0000","last_fullsized":"2024-02-10T00:05:03.195557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:51:48.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213874+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:05.213874+0000","last_peered":"2024-02-10T00:05:05.213874+0000","last_clean":"2024-02-10T00:05:05.213874+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:05.213874+0000","last_undegraded":"2024-02-10T00:05:05.213874+0000","last_fullsized":"2024-02-10T00:05:05.213874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:00:12.276362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197314+0000","last_change":"2024-02-10T00:04:54.399185+0000","last_active":"2024-02-10T00:05:03.197314+0000","last_peered":"2024-02-10T00:05:03.197314+0000","last_clean":"2024-02-10T00:05:03.197314+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:03.197314+0000","last_undegraded":"2024-02-10T00:05:03.197314+0000","last_fullsized":"2024-02-10T00:05:03.197314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:51:18.506100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":905,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199608+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:03.199608+0000","last_peered":"2024-02-10T00:05:03.199608+0000","last_clean":"2024-02-10T00:05:03.199608+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:03.199608+0000","last_undegraded":"2024-02-10T00:05:03.199608+0000","last_fullsized":"2024-02-10T00:05:03.199608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:11:07.759450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224740+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:05.224740+0000","last_peered":"2024-02-10T00:05:05.224740+0000","last_clean":"2024-02-10T00:05:05.224740+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:05.224740+0000","last_undegraded":"2024-02-10T00:05:05.224740+0000","last_fullsized":"2024-02-10T00:05:05.224740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:03:26.924286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":939,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197256+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:03.197256+0000","last_peered":"2024-02-10T00:05:03.197256+0000","last_clean":"2024-02-10T00:05:03.197256+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:03.197256+0000","last_undegraded":"2024-02-10T00:05:03.197256+0000","last_fullsized":"2024-02-10T00:05:03.197256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:24:57.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'996","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197162+0000","last_change":"2024-02-10T00:04:54.355031+0000","last_active":"2024-02-10T00:05:03.197162+0000","last_peered":"2024-02-10T00:05:03.197162+0000","last_clean":"2024-02-10T00:05:03.197162+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:03.197162+0000","last_undegraded":"2024-02-10T00:05:03.197162+0000","last_fullsized":"2024-02-10T00:05:03.197162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:07:05.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1062,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199166+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:03.199166+0000","last_peered":"2024-02-10T00:05:03.199166+0000","last_clean":"2024-02-10T00:05:03.199166+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:03.199166+0000","last_undegraded":"2024-02-10T00:05:03.199166+0000","last_fullsized":"2024-02-10T00:05:03.199166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:22:41.307122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":437,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.233703+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:05.233703+0000","last_peered":"2024-02-10T00:05:05.233703+0000","last_clean":"2024-02-10T00:05:05.233703+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:05.233703+0000","last_undegraded":"2024-02-10T00:05:05.233703+0000","last_fullsized":"2024-02-10T00:05:05.233703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:20:18.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196962+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:03.196962+0000","last_peered":"2024-02-10T00:05:03.196962+0000","last_clean":"2024-02-10T00:05:03.196962+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:03.196962+0000","last_undegraded":"2024-02-10T00:05:03.196962+0000","last_fullsized":"2024-02-10T00:05:03.196962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:49:41.654900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":704,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222215+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:05.222215+0000","last_peered":"2024-02-10T00:05:05.222215+0000","last_clean":"2024-02-10T00:05:05.222215+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:05.222215+0000","last_undegraded":"2024-02-10T00:05:05.222215+0000","last_fullsized":"2024-02-10T00:05:05.222215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:10.964768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":995,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198125+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:03.198125+0000","last_peered":"2024-02-10T00:05:03.198125+0000","last_clean":"2024-02-10T00:05:03.198125+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:03.198125+0000","last_undegraded":"2024-02-10T00:05:03.198125+0000","last_fullsized":"2024-02-10T00:05:03.198125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:57.974230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":435,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.208215+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:05.208215+0000","last_peered":"2024-02-10T00:05:05.208215+0000","last_clean":"2024-02-10T00:05:05.208215+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:05.208215+0000","last_undegraded":"2024-02-10T00:05:05.208215+0000","last_fullsized":"2024-02-10T00:05:05.208215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:57:13.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1094,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198114+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:03.198114+0000","last_peered":"2024-02-10T00:05:03.198114+0000","last_clean":"2024-02-10T00:05:03.198114+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:03.198114+0000","last_undegraded":"2024-02-10T00:05:03.198114+0000","last_fullsized":"2024-02-10T00:05:03.198114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:09.600796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213248+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:05.213248+0000","last_peered":"2024-02-10T00:05:05.213248+0000","last_clean":"2024-02-10T00:05:05.213248+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:05.213248+0000","last_undegraded":"2024-02-10T00:05:05.213248+0000","last_fullsized":"2024-02-10T00:05:05.213248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:44:32.516312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":960,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199079+0000","last_change":"2024-02-10T00:04:54.401944+0000","last_active":"2024-02-10T00:05:03.199079+0000","last_peered":"2024-02-10T00:05:03.199079+0000","last_clean":"2024-02-10T00:05:03.199079+0000","last_became_active":"2024-02-10T00:04:54.385627+0000","last_became_peered":"2024-02-10T00:04:54.385627+0000","last_unstale":"2024-02-10T00:05:03.199079+0000","last_undegraded":"2024-02-10T00:05:03.199079+0000","last_fullsized":"2024-02-10T00:05:03.199079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:12:31.356916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":518,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230882+0000","last_change":"2024-02-10T00:04:54.407982+0000","last_active":"2024-02-10T00:05:05.230882+0000","last_peered":"2024-02-10T00:05:05.230882+0000","last_clean":"2024-02-10T00:05:05.230882+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:05.230882+0000","last_undegraded":"2024-02-10T00:05:05.230882+0000","last_fullsized":"2024-02-10T00:05:05.230882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:56:45.594673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213962+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:05.213962+0000","last_peered":"2024-02-10T00:05:05.213962+0000","last_clean":"2024-02-10T00:05:05.213962+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:05.213962+0000","last_undegraded":"2024-02-10T00:05:05.213962+0000","last_fullsized":"2024-02-10T00:05:05.213962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:41:52.243460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":536,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.217503+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:05.217503+0000","last_peered":"2024-02-10T00:05:05.217503+0000","last_clean":"2024-02-10T00:05:05.217503+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:05.217503+0000","last_undegraded":"2024-02-10T00:05:05.217503+0000","last_fullsized":"2024-02-10T00:05:05.217503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:22.435065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":855,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199156+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:03.199156+0000","last_peered":"2024-02-10T00:05:03.199156+0000","last_clean":"2024-02-10T00:05:03.199156+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:03.199156+0000","last_undegraded":"2024-02-10T00:05:03.199156+0000","last_fullsized":"2024-02-10T00:05:03.199156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:41:18.975213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'399","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213861+0000","last_change":"2024-02-10T00:04:50.479007+0000","last_active":"2024-02-10T00:05:05.213861+0000","last_peered":"2024-02-10T00:05:05.213861+0000","last_clean":"2024-02-10T00:05:05.213861+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:05.213861+0000","last_undegraded":"2024-02-10T00:05:05.213861+0000","last_fullsized":"2024-02-10T00:05:05.213861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:48:44.791006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1078,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197133+0000","last_change":"2024-02-10T00:04:54.398504+0000","last_active":"2024-02-10T00:05:03.197133+0000","last_peered":"2024-02-10T00:05:03.197133+0000","last_clean":"2024-02-10T00:05:03.197133+0000","last_became_active":"2024-02-10T00:04:54.374080+0000","last_became_peered":"2024-02-10T00:04:54.374080+0000","last_unstale":"2024-02-10T00:05:03.197133+0000","last_undegraded":"2024-02-10T00:05:03.197133+0000","last_fullsized":"2024-02-10T00:05:03.197133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:13:41.155185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":468,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222743+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:05.222743+0000","last_peered":"2024-02-10T00:05:05.222743+0000","last_clean":"2024-02-10T00:05:05.222743+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:05.222743+0000","last_undegraded":"2024-02-10T00:05:05.222743+0000","last_fullsized":"2024-02-10T00:05:05.222743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:18.009883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":974,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195850+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:03.195850+0000","last_peered":"2024-02-10T00:05:03.195850+0000","last_clean":"2024-02-10T00:05:03.195850+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:03.195850+0000","last_undegraded":"2024-02-10T00:05:03.195850+0000","last_fullsized":"2024-02-10T00:05:03.195850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:03:11.127934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":783,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198480+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:03.198480+0000","last_peered":"2024-02-10T00:05:03.198480+0000","last_clean":"2024-02-10T00:05:03.198480+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:03.198480+0000","last_undegraded":"2024-02-10T00:05:03.198480+0000","last_fullsized":"2024-02-10T00:05:03.198480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:49:07.917966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196254+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:03.196254+0000","last_peered":"2024-02-10T00:05:03.196254+0000","last_clean":"2024-02-10T00:05:03.196254+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:03.196254+0000","last_undegraded":"2024-02-10T00:05:03.196254+0000","last_fullsized":"2024-02-10T00:05:03.196254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:13:29.112123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213560+0000","last_change":"2024-02-10T00:04:54.348980+0000","last_active":"2024-02-10T00:05:05.213560+0000","last_peered":"2024-02-10T00:05:05.213560+0000","last_clean":"2024-02-10T00:05:05.213560+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:05.213560+0000","last_undegraded":"2024-02-10T00:05:05.213560+0000","last_fullsized":"2024-02-10T00:05:05.213560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:42.975676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213529+0000","last_change":"2024-02-10T00:04:50.484581+0000","last_active":"2024-02-10T00:05:05.213529+0000","last_peered":"2024-02-10T00:05:05.213529+0000","last_clean":"2024-02-10T00:05:05.213529+0000","last_became_active":"2024-02-10T00:04:50.468665+0000","last_became_peered":"2024-02-10T00:04:50.468665+0000","last_unstale":"2024-02-10T00:05:05.213529+0000","last_undegraded":"2024-02-10T00:05:05.213529+0000","last_fullsized":"2024-02-10T00:05:05.213529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:15:04.057880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1213,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.224660+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:05.224660+0000","last_peered":"2024-02-10T00:05:05.224660+0000","last_clean":"2024-02-10T00:05:05.224660+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:05.224660+0000","last_undegraded":"2024-02-10T00:05:05.224660+0000","last_fullsized":"2024-02-10T00:05:05.224660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:54:41.058929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1027,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213572+0000","last_change":"2024-02-10T00:04:54.371784+0000","last_active":"2024-02-10T00:05:05.213572+0000","last_peered":"2024-02-10T00:05:05.213572+0000","last_clean":"2024-02-10T00:05:05.213572+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:05.213572+0000","last_undegraded":"2024-02-10T00:05:05.213572+0000","last_fullsized":"2024-02-10T00:05:05.213572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:40:23.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'459","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197323+0000","last_change":"2024-02-10T00:04:54.352204+0000","last_active":"2024-02-10T00:05:03.197323+0000","last_peered":"2024-02-10T00:05:03.197323+0000","last_clean":"2024-02-10T00:05:03.197323+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:03.197323+0000","last_undegraded":"2024-02-10T00:05:03.197323+0000","last_fullsized":"2024-02-10T00:05:03.197323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:01:07.477523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":880,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.400594+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:02:03.201673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'353","reported_seq":394,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-10T00:05:15.247571+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:15.247571+0000","last_peered":"2024-02-10T00:05:15.247571+0000","last_clean":"2024-02-10T00:05:15.247571+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:15.247571+0000","last_undegraded":"2024-02-10T00:05:15.247571+0000","last_fullsized":"2024-02-10T00:05:15.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:16.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719545,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":251,"num_write_kb":5960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":878,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197681+0000","last_change":"2024-02-10T00:04:54.379393+0000","last_active":"2024-02-10T00:05:03.197681+0000","last_peered":"2024-02-10T00:05:03.197681+0000","last_clean":"2024-02-10T00:05:03.197681+0000","last_became_active":"2024-02-10T00:04:54.364205+0000","last_became_peered":"2024-02-10T00:04:54.364205+0000","last_unstale":"2024-02-10T00:05:03.197681+0000","last_undegraded":"2024-02-10T00:05:03.197681+0000","last_fullsized":"2024-02-10T00:05:03.197681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:58:06.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1828","reported_seq":1869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196786+0000","last_change":"2024-02-10T00:04:54.398991+0000","last_active":"2024-02-10T00:05:03.196786+0000","last_peered":"2024-02-10T00:05:03.196786+0000","last_clean":"2024-02-10T00:05:03.196786+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:03.196786+0000","last_undegraded":"2024-02-10T00:05:03.196786+0000","last_fullsized":"2024-02-10T00:05:03.196786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:14:04.951339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":914,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198975+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:03.198975+0000","last_peered":"2024-02-10T00:05:03.198975+0000","last_clean":"2024-02-10T00:05:03.198975+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:03.198975+0000","last_undegraded":"2024-02-10T00:05:03.198975+0000","last_fullsized":"2024-02-10T00:05:03.198975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:21:54.777363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199278+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:03.199278+0000","last_peered":"2024-02-10T00:05:03.199278+0000","last_clean":"2024-02-10T00:05:03.199278+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:03.199278+0000","last_undegraded":"2024-02-10T00:05:03.199278+0000","last_fullsized":"2024-02-10T00:05:03.199278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:42:16.345006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'222","reported_seq":262,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196947+0000","last_change":"2024-02-10T00:04:54.401888+0000","last_active":"2024-02-10T00:05:03.196947+0000","last_peered":"2024-02-10T00:05:03.196947+0000","last_clean":"2024-02-10T00:05:03.196947+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:03.196947+0000","last_undegraded":"2024-02-10T00:05:03.196947+0000","last_fullsized":"2024-02-10T00:05:03.196947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:46:43.259331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":860,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196827+0000","last_change":"2024-02-10T00:04:54.396972+0000","last_active":"2024-02-10T00:05:03.196827+0000","last_peered":"2024-02-10T00:05:03.196827+0000","last_clean":"2024-02-10T00:05:03.196827+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:03.196827+0000","last_undegraded":"2024-02-10T00:05:03.196827+0000","last_fullsized":"2024-02-10T00:05:03.196827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:39:30.039039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197380+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:03.197380+0000","last_peered":"2024-02-10T00:05:03.197380+0000","last_clean":"2024-02-10T00:05:03.197380+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:03.197380+0000","last_undegraded":"2024-02-10T00:05:03.197380+0000","last_fullsized":"2024-02-10T00:05:03.197380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:53:08.663128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'682","reported_seq":719,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213409+0000","last_change":"2024-02-10T00:04:51.519268+0000","last_active":"2024-02-10T00:05:05.213409+0000","last_peered":"2024-02-10T00:05:05.213409+0000","last_clean":"2024-02-10T00:05:05.213409+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:05.213409+0000","last_undegraded":"2024-02-10T00:05:05.213409+0000","last_fullsized":"2024-02-10T00:05:05.213409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:04:43.689733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1015,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199256+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:03.199256+0000","last_peered":"2024-02-10T00:05:03.199256+0000","last_clean":"2024-02-10T00:05:03.199256+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:03.199256+0000","last_undegraded":"2024-02-10T00:05:03.199256+0000","last_fullsized":"2024-02-10T00:05:03.199256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:29:43.211839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196045+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:03.196045+0000","last_peered":"2024-02-10T00:05:03.196045+0000","last_clean":"2024-02-10T00:05:03.196045+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:03.196045+0000","last_undegraded":"2024-02-10T00:05:03.196045+0000","last_fullsized":"2024-02-10T00:05:03.196045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:35:19.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":830,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196536+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:03.196536+0000","last_peered":"2024-02-10T00:05:03.196536+0000","last_clean":"2024-02-10T00:05:03.196536+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:03.196536+0000","last_undegraded":"2024-02-10T00:05:03.196536+0000","last_fullsized":"2024-02-10T00:05:03.196536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:05:25.016620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":815,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198647+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:03.198647+0000","last_peered":"2024-02-10T00:05:03.198647+0000","last_clean":"2024-02-10T00:05:03.198647+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:03.198647+0000","last_undegraded":"2024-02-10T00:05:03.198647+0000","last_fullsized":"2024-02-10T00:05:03.198647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:18:55.262512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197767+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:03.197767+0000","last_peered":"2024-02-10T00:05:03.197767+0000","last_clean":"2024-02-10T00:05:03.197767+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:03.197767+0000","last_undegraded":"2024-02-10T00:05:03.197767+0000","last_fullsized":"2024-02-10T00:05:03.197767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:12:50.812857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195981+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:03.195981+0000","last_peered":"2024-02-10T00:05:03.195981+0000","last_clean":"2024-02-10T00:05:03.195981+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:03.195981+0000","last_undegraded":"2024-02-10T00:05:03.195981+0000","last_fullsized":"2024-02-10T00:05:03.195981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:13:28.527691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1441,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197598+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:03.197598+0000","last_peered":"2024-02-10T00:05:03.197598+0000","last_clean":"2024-02-10T00:05:03.197598+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:03.197598+0000","last_undegraded":"2024-02-10T00:05:03.197598+0000","last_fullsized":"2024-02-10T00:05:03.197598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:49:26.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":900,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198776+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:03.198776+0000","last_peered":"2024-02-10T00:05:03.198776+0000","last_clean":"2024-02-10T00:05:03.198776+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:03.198776+0000","last_undegraded":"2024-02-10T00:05:03.198776+0000","last_fullsized":"2024-02-10T00:05:03.198776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:16:40.923688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196689+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:03.196689+0000","last_peered":"2024-02-10T00:05:03.196689+0000","last_clean":"2024-02-10T00:05:03.196689+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:03.196689+0000","last_undegraded":"2024-02-10T00:05:03.196689+0000","last_fullsized":"2024-02-10T00:05:03.196689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:45:02.093822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1023,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.227876+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:05.227876+0000","last_peered":"2024-02-10T00:05:05.227876+0000","last_clean":"2024-02-10T00:05:05.227876+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:05.227876+0000","last_undegraded":"2024-02-10T00:05:05.227876+0000","last_fullsized":"2024-02-10T00:05:05.227876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:28:03.424876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":926,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213802+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:05.213802+0000","last_peered":"2024-02-10T00:05:05.213802+0000","last_clean":"2024-02-10T00:05:05.213802+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:05.213802+0000","last_undegraded":"2024-02-10T00:05:05.213802+0000","last_fullsized":"2024-02-10T00:05:05.213802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:59:58.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198859+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:03.198859+0000","last_peered":"2024-02-10T00:05:03.198859+0000","last_clean":"2024-02-10T00:05:03.198859+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:03.198859+0000","last_undegraded":"2024-02-10T00:05:03.198859+0000","last_fullsized":"2024-02-10T00:05:03.198859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:16:06.941008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199443+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:03.199443+0000","last_peered":"2024-02-10T00:05:03.199443+0000","last_clean":"2024-02-10T00:05:03.199443+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:03.199443+0000","last_undegraded":"2024-02-10T00:05:03.199443+0000","last_fullsized":"2024-02-10T00:05:03.199443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:06.116558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":985,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213538+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:05.213538+0000","last_peered":"2024-02-10T00:05:05.213538+0000","last_clean":"2024-02-10T00:05:05.213538+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:05.213538+0000","last_undegraded":"2024-02-10T00:05:05.213538+0000","last_fullsized":"2024-02-10T00:05:05.213538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:05:03.058606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":463,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.223415+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:05.223415+0000","last_peered":"2024-02-10T00:05:05.223415+0000","last_clean":"2024-02-10T00:05:05.223415+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:05.223415+0000","last_undegraded":"2024-02-10T00:05:05.223415+0000","last_fullsized":"2024-02-10T00:05:05.223415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:38:05.706326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198344+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:03.198344+0000","last_peered":"2024-02-10T00:05:03.198344+0000","last_clean":"2024-02-10T00:05:03.198344+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:03.198344+0000","last_undegraded":"2024-02-10T00:05:03.198344+0000","last_fullsized":"2024-02-10T00:05:03.198344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:37:58.744476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.197213+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:03.197213+0000","last_peered":"2024-02-10T00:05:03.197213+0000","last_clean":"2024-02-10T00:05:03.197213+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:03.197213+0000","last_undegraded":"2024-02-10T00:05:03.197213+0000","last_fullsized":"2024-02-10T00:05:03.197213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:24.539066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199060+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:03.199060+0000","last_peered":"2024-02-10T00:05:03.199060+0000","last_clean":"2024-02-10T00:05:03.199060+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:03.199060+0000","last_undegraded":"2024-02-10T00:05:03.199060+0000","last_fullsized":"2024-02-10T00:05:03.199060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:00:31.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":771,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:06.580430+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:06.580430+0000","last_peered":"2024-02-10T00:05:06.580430+0000","last_clean":"2024-02-10T00:05:06.580430+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:06.580430+0000","last_undegraded":"2024-02-10T00:05:06.580430+0000","last_fullsized":"2024-02-10T00:05:06.580430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:17:33.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":902,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195971+0000","last_change":"2024-02-10T00:04:54.383274+0000","last_active":"2024-02-10T00:05:03.195971+0000","last_peered":"2024-02-10T00:05:03.195971+0000","last_clean":"2024-02-10T00:05:03.195971+0000","last_became_active":"2024-02-10T00:04:54.352274+0000","last_became_peered":"2024-02-10T00:04:54.352274+0000","last_unstale":"2024-02-10T00:05:03.195971+0000","last_undegraded":"2024-02-10T00:05:03.195971+0000","last_fullsized":"2024-02-10T00:05:03.195971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:20:57.190482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213667+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:05.213667+0000","last_peered":"2024-02-10T00:05:05.213667+0000","last_clean":"2024-02-10T00:05:05.213667+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:05.213667+0000","last_undegraded":"2024-02-10T00:05:05.213667+0000","last_fullsized":"2024-02-10T00:05:05.213667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:28:01.338854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":945,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196837+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:03.196837+0000","last_peered":"2024-02-10T00:05:03.196837+0000","last_clean":"2024-02-10T00:05:03.196837+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:03.196837+0000","last_undegraded":"2024-02-10T00:05:03.196837+0000","last_fullsized":"2024-02-10T00:05:03.196837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:35:51.750514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":458,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.222066+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:05.222066+0000","last_peered":"2024-02-10T00:05:05.222066+0000","last_clean":"2024-02-10T00:05:05.222066+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:05.222066+0000","last_undegraded":"2024-02-10T00:05:05.222066+0000","last_fullsized":"2024-02-10T00:05:05.222066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:57:41.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":899,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198335+0000","last_change":"2024-02-10T00:04:54.386106+0000","last_active":"2024-02-10T00:05:03.198335+0000","last_peered":"2024-02-10T00:05:03.198335+0000","last_clean":"2024-02-10T00:05:03.198335+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:03.198335+0000","last_undegraded":"2024-02-10T00:05:03.198335+0000","last_fullsized":"2024-02-10T00:05:03.198335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:49:55.541353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"40'619","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.230416+0000","last_change":"2024-02-10T00:04:54.402321+0000","last_active":"2024-02-10T00:05:05.230416+0000","last_peered":"2024-02-10T00:05:05.230416+0000","last_clean":"2024-02-10T00:05:05.230416+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:05.230416+0000","last_undegraded":"2024-02-10T00:05:05.230416+0000","last_fullsized":"2024-02-10T00:05:05.230416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:34:10.482982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196160+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:03.196160+0000","last_peered":"2024-02-10T00:05:03.196160+0000","last_clean":"2024-02-10T00:05:03.196160+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:03.196160+0000","last_undegraded":"2024-02-10T00:05:03.196160+0000","last_fullsized":"2024-02-10T00:05:03.196160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:07:08.085136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":293,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198820+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:03.198820+0000","last_peered":"2024-02-10T00:05:03.198820+0000","last_clean":"2024-02-10T00:05:03.198820+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:03.198820+0000","last_undegraded":"2024-02-10T00:05:03.198820+0000","last_fullsized":"2024-02-10T00:05:03.198820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:20:12.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198835+0000","last_change":"2024-02-10T00:04:54.412886+0000","last_active":"2024-02-10T00:05:03.198835+0000","last_peered":"2024-02-10T00:05:03.198835+0000","last_clean":"2024-02-10T00:05:03.198835+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:03.198835+0000","last_undegraded":"2024-02-10T00:05:03.198835+0000","last_fullsized":"2024-02-10T00:05:03.198835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:24:01.875747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":237,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.214149+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:05.214149+0000","last_peered":"2024-02-10T00:05:05.214149+0000","last_clean":"2024-02-10T00:05:05.214149+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:05.214149+0000","last_undegraded":"2024-02-10T00:05:05.214149+0000","last_fullsized":"2024-02-10T00:05:05.214149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:34:30.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":988,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.195846+0000","last_change":"2024-02-10T00:04:51.492803+0000","last_active":"2024-02-10T00:05:03.195846+0000","last_peered":"2024-02-10T00:05:03.195846+0000","last_clean":"2024-02-10T00:05:03.195846+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:03.195846+0000","last_undegraded":"2024-02-10T00:05:03.195846+0000","last_fullsized":"2024-02-10T00:05:03.195846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:56:20.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":932,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.196490+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:03.196490+0000","last_peered":"2024-02-10T00:05:03.196490+0000","last_clean":"2024-02-10T00:05:03.196490+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:03.196490+0000","last_undegraded":"2024-02-10T00:05:03.196490+0000","last_fullsized":"2024-02-10T00:05:03.196490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:07:01.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198995+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:03.198995+0000","last_peered":"2024-02-10T00:05:03.198995+0000","last_clean":"2024-02-10T00:05:03.198995+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:03.198995+0000","last_undegraded":"2024-02-10T00:05:03.198995+0000","last_fullsized":"2024-02-10T00:05:03.198995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:50:13.643672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":962,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:05.213340+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:05.213340+0000","last_peered":"2024-02-10T00:05:05.213340+0000","last_clean":"2024-02-10T00:05:05.213340+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:05.213340+0000","last_undegraded":"2024-02-10T00:05:05.213340+0000","last_fullsized":"2024-02-10T00:05:05.213340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:38:08.098290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":921,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.198250+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:03.198250+0000","last_peered":"2024-02-10T00:05:03.198250+0000","last_clean":"2024-02-10T00:05:03.198250+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:03.198250+0000","last_undegraded":"2024-02-10T00:05:03.198250+0000","last_fullsized":"2024-02-10T00:05:03.198250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:04:31.911501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":789,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-10T00:05:03.199382+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:03.199382+0000","last_peered":"2024-02-10T00:05:03.199382+0000","last_clean":"2024-02-10T00:05:03.199382+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:03.199382+0000","last_undegraded":"2024-02-10T00:05:03.199382+0000","last_fullsized":"2024-02-10T00:05:03.199382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:10:20.813332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147636729,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16347,"num_write_kb":272987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19928,"ondisk_log_size":19928,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423740,"kb_used_data":97972,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948100,"statfs":{"total":96636764160,"available":96202854400,"internally_reserved":0,"allocated":100323328,"data_stored":100089420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]}]},{"osd":2,"up_from":29,"seq":124554051594,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365292,"kb_used_data":61284,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006548,"statfs":{"total":96636764160,"available":96262705152,"internally_reserved":0,"allocated":62754816,"data_stored":62544120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376816,"kb_used_data":72104,"kb_used_omap":258,"kb_used_meta":304445,"kb_avail":93995024,"statfs":{"total":96636764160,"available":96250904576,"internally_reserved":0,"allocated":73834496,"data_stored":73613584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":311752618},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]}]},{"osd":1,"up_from":28,"seq":120259084298,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371548,"kb_used_data":59604,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000292,"statfs":{"total":96636764160,"available":96256299008,"internally_reserved":0,"allocated":61034496,"data_stored":60827546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99933815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:32.067 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.068 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.069 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.070 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.071 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.071 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.071 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.071 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.072 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.073 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.074 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.075 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.076 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-09T23:58:11.548870+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.077 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.078 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.079 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.080 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.080 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.080 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.080 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.080 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:32.081 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:05:52.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:05:52.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.210+0000 7f0dbf65a700 1 Processor -- start 2024-02-10T00:05:52.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 -- start start 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 0x7f0db80a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80a6aa0 con 0x7f0db80a4130 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a1a60 con 0x7f0db80a3d40 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbf65a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a1d00 con 0x7f0db80b55b0 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbd3f6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 0x7f0db80a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:52.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbcbf5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbdbf7700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0db80a4130 0x7f0db80a5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60932/0 (socket says 172.21.15.89:60932) 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.211+0000 7f0dbdbf7700 1 -- 172.21.15.89:0/3251302336 learned_addr learned my addr 172.21.15.89:0/3251302336 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0daffff700 1 -- 172.21.15.89:0/3251302336 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603764500 0 0) 0x7f0db80a6aa0 con 0x7f0db80a4130 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 msgr2=0x7f0db813dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbd3f6700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db813dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/3251302336 >> v1:172.21.15.89:6789/0 conn(0x7f0db80a4130 legacy=0x7f0db80a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/3251302336 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80a2450 con 0x7f0db80b55b0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbcbf5700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db813dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbd3f6700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 0x7f0db80a29c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009900 tx=0x7f0da8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa34c0e3520d064 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0daffff700 1 -- 172.21.15.89:0/3251302336 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8005c10 con 0x7f0db80b55b0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0daffff700 1 -- 172.21.15.89:0/3251302336 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8005d70 con 0x7f0db80b55b0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0daffff700 1 -- 172.21.15.89:0/3251302336 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8006260 con 0x7f0db80b55b0 2024-02-10T00:05:52.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbf65a700 1 -- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 msgr2=0x7f0db80a29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.212+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 0x7f0db80a29c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009900 tx=0x7f0da8009120 comp rx=0 tx=0).stop 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 -- 172.21.15.89:0/3251302336 shutdown_connections 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80b55b0 0x7f0db80a29c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/3251302336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db813dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 -- 172.21.15.89:0/3251302336 >> 172.21.15.89:0/3251302336 conn(0x7f0db8064050 msgr2=0x7f0db80b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 -- 172.21.15.89:0/3251302336 shutdown_connections 2024-02-10T00:05:52.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 -- 172.21.15.89:0/3251302336 wait complete. 2024-02-10T00:05:52.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.213+0000 7f0dbf65a700 1 Processor -- start 2024-02-10T00:05:52.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 -- start start 2024-02-10T00:05:52.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 0x7f0db8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 0x7f0db8141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a8aa0 con 0x7f0db80b55b0 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a8d60 con 0x7f0db80a3d40 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbf65a700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80b4b30 con 0x7f0db80a4130 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbd3f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbdbf7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 0x7f0db8141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbcbf5700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 0x7f0db8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbd3f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42412/0 (socket says 172.21.15.89:42412) 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbdbf7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 0x7f0db8141220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36590/0 (socket says 172.21.15.89:36590) 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.214+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/1793332752 learned_addr learned my addr 172.21.15.89:0/1793332752 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 msgr2=0x7f0db8140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 0x7f0db8140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 msgr2=0x7f0db8141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 0x7f0db8141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 -- 172.21.15.89:0/1793332752 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4009420 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbcbf5700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 0x7f0db8140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbd3f6700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0db80a1e40 tx=0x7f0da8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800b750 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80093c0 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da800b8b0 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800bc50 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.215+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80a8610 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.216+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0da801a630 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.216+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db813ecd0 con 0x7f0db80a3d40 2024-02-10T00:05:52.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.216+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f0da805c980 con 0x7f0db80a3d40 2024-02-10T00:05:52.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.220+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f0da80281f0 con 0x7f0db80a3d40 2024-02-10T00:05:52.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.368+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0db80a8890 con 0x7f0d9c046040 2024-02-10T00:05:52.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.374+0000 7f0dad7fa700 1 -- 172.21.15.89:0/1793332752 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270807 (unknown 2965378022 0 1347329370) 0x7f0db80a8890 con 0x7f0d9c046040 2024-02-10T00:05:52.380 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:05:52.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 >> v1:172.21.15.89:6816/47970 conn(0x7f0d9c046040 legacy=0x7f0d9c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 msgr2=0x7f0db81407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:05:52.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0db80a1e40 tx=0x7f0da8016000 comp rx=0 tx=0).stop 2024-02-10T00:05:52.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 shutdown_connections 2024-02-10T00:05:52.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80b55b0 0x7f0db8141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80a3d40 0x7f0db81407a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 --2- 172.21.15.89:0/1793332752 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f0db80a4130 0x7f0db8140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 >> 172.21.15.89:0/1793332752 conn(0x7f0db8064050 msgr2=0x7f0db813b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 shutdown_connections 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:05:52.377+0000 7f0dbf65a700 1 -- 172.21.15.89:0/1793332752 wait complete. 2024-02-10T00:05:52.383 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:05:52.390 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-02-10T00:05:52.149627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227097,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65350,"num_write_kb":9046232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71803,"ondisk_log_size":71803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1566452,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1274231,"kb_avail":375920908,"statfs":{"total":386547056640,"available":384943009792,"internally_reserved":0,"allocated":298340352,"data_stored":297222246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1304813051},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":963,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194384+0000","last_change":"2024-02-10T00:04:51.505595+0000","last_active":"2024-02-10T00:05:37.194384+0000","last_peered":"2024-02-10T00:05:37.194384+0000","last_clean":"2024-02-10T00:05:37.194384+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:05:37.194384+0000","last_undegraded":"2024-02-10T00:05:37.194384+0000","last_fullsized":"2024-02-10T00:05:37.194384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":842,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195119+0000","last_change":"2024-02-10T00:04:50.484308+0000","last_active":"2024-02-10T00:05:37.195119+0000","last_peered":"2024-02-10T00:05:37.195119+0000","last_clean":"2024-02-10T00:05:37.195119+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:05:37.195119+0000","last_undegraded":"2024-02-10T00:05:37.195119+0000","last_fullsized":"2024-02-10T00:05:37.195119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":842,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193219+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:37.193219+0000","last_peered":"2024-02-10T00:05:37.193219+0000","last_clean":"2024-02-10T00:05:37.193219+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:37.193219+0000","last_undegraded":"2024-02-10T00:05:37.193219+0000","last_fullsized":"2024-02-10T00:05:37.193219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":876,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191271+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:37.191271+0000","last_peered":"2024-02-10T00:05:37.191271+0000","last_clean":"2024-02-10T00:05:37.191271+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:37.191271+0000","last_undegraded":"2024-02-10T00:05:37.191271+0000","last_fullsized":"2024-02-10T00:05:37.191271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192496+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:37.192496+0000","last_peered":"2024-02-10T00:05:37.192496+0000","last_clean":"2024-02-10T00:05:37.192496+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:37.192496+0000","last_undegraded":"2024-02-10T00:05:37.192496+0000","last_fullsized":"2024-02-10T00:05:37.192496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":807,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189282+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:37.189282+0000","last_peered":"2024-02-10T00:05:37.189282+0000","last_clean":"2024-02-10T00:05:37.189282+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:37.189282+0000","last_undegraded":"2024-02-10T00:05:37.189282+0000","last_fullsized":"2024-02-10T00:05:37.189282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":936,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194417+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:37.194417+0000","last_peered":"2024-02-10T00:05:37.194417+0000","last_clean":"2024-02-10T00:05:37.194417+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:37.194417+0000","last_undegraded":"2024-02-10T00:05:37.194417+0000","last_fullsized":"2024-02-10T00:05:37.194417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":909,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189556+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:37.189556+0000","last_peered":"2024-02-10T00:05:37.189556+0000","last_clean":"2024-02-10T00:05:37.189556+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:37.189556+0000","last_undegraded":"2024-02-10T00:05:37.189556+0000","last_fullsized":"2024-02-10T00:05:37.189556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":854,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190948+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:37.190948+0000","last_peered":"2024-02-10T00:05:37.190948+0000","last_clean":"2024-02-10T00:05:37.190948+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:37.190948+0000","last_undegraded":"2024-02-10T00:05:37.190948+0000","last_fullsized":"2024-02-10T00:05:37.190948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1521,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195132+0000","last_change":"2024-02-10T00:05:36.195115+0000","last_active":"2024-02-10T00:05:37.195132+0000","last_peered":"2024-02-10T00:05:37.195132+0000","last_clean":"2024-02-10T00:05:37.195132+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:05:37.195132+0000","last_undegraded":"2024-02-10T00:05:37.195132+0000","last_fullsized":"2024-02-10T00:05:37.195132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":973,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195692+0000","last_change":"2024-02-10T00:04:54.378739+0000","last_active":"2024-02-10T00:05:37.195692+0000","last_peered":"2024-02-10T00:05:37.195692+0000","last_clean":"2024-02-10T00:05:37.195692+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:37.195692+0000","last_undegraded":"2024-02-10T00:05:37.195692+0000","last_fullsized":"2024-02-10T00:05:37.195692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":945,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190189+0000","last_change":"2024-02-10T00:04:51.505442+0000","last_active":"2024-02-10T00:05:37.190189+0000","last_peered":"2024-02-10T00:05:37.190189+0000","last_clean":"2024-02-10T00:05:37.190189+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:37.190189+0000","last_undegraded":"2024-02-10T00:05:37.190189+0000","last_fullsized":"2024-02-10T00:05:37.190189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":994,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193158+0000","last_change":"2024-02-10T00:04:50.486194+0000","last_active":"2024-02-10T00:05:37.193158+0000","last_peered":"2024-02-10T00:05:37.193158+0000","last_clean":"2024-02-10T00:05:37.193158+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:37.193158+0000","last_undegraded":"2024-02-10T00:05:37.193158+0000","last_fullsized":"2024-02-10T00:05:37.193158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190904+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:37.190904+0000","last_peered":"2024-02-10T00:05:37.190904+0000","last_clean":"2024-02-10T00:05:37.190904+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:37.190904+0000","last_undegraded":"2024-02-10T00:05:37.190904+0000","last_fullsized":"2024-02-10T00:05:37.190904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":991,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194665+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:37.194665+0000","last_peered":"2024-02-10T00:05:37.194665+0000","last_clean":"2024-02-10T00:05:37.194665+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:37.194665+0000","last_undegraded":"2024-02-10T00:05:37.194665+0000","last_fullsized":"2024-02-10T00:05:37.194665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":791,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193371+0000","last_change":"2024-02-10T00:04:51.498772+0000","last_active":"2024-02-10T00:05:37.193371+0000","last_peered":"2024-02-10T00:05:37.193371+0000","last_clean":"2024-02-10T00:05:37.193371+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:37.193371+0000","last_undegraded":"2024-02-10T00:05:37.193371+0000","last_fullsized":"2024-02-10T00:05:37.193371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":898,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189751+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:37.189751+0000","last_peered":"2024-02-10T00:05:37.189751+0000","last_clean":"2024-02-10T00:05:37.189751+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:37.189751+0000","last_undegraded":"2024-02-10T00:05:37.189751+0000","last_fullsized":"2024-02-10T00:05:37.189751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":972,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192855+0000","last_change":"2024-02-10T00:04:50.485035+0000","last_active":"2024-02-10T00:05:37.192855+0000","last_peered":"2024-02-10T00:05:37.192855+0000","last_clean":"2024-02-10T00:05:37.192855+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:05:37.192855+0000","last_undegraded":"2024-02-10T00:05:37.192855+0000","last_fullsized":"2024-02-10T00:05:37.192855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":973,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191268+0000","last_change":"2024-02-10T00:05:35.175131+0000","last_active":"2024-02-10T00:05:37.191268+0000","last_peered":"2024-02-10T00:05:37.191268+0000","last_clean":"2024-02-10T00:05:37.191268+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:37.191268+0000","last_undegraded":"2024-02-10T00:05:37.191268+0000","last_fullsized":"2024-02-10T00:05:37.191268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":966,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189141+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:37.189141+0000","last_peered":"2024-02-10T00:05:37.189141+0000","last_clean":"2024-02-10T00:05:37.189141+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:37.189141+0000","last_undegraded":"2024-02-10T00:05:37.189141+0000","last_fullsized":"2024-02-10T00:05:37.189141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":948,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191672+0000","last_change":"2024-02-10T00:04:51.503664+0000","last_active":"2024-02-10T00:05:37.191672+0000","last_peered":"2024-02-10T00:05:37.191672+0000","last_clean":"2024-02-10T00:05:37.191672+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:05:37.191672+0000","last_undegraded":"2024-02-10T00:05:37.191672+0000","last_fullsized":"2024-02-10T00:05:37.191672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191245+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:37.191245+0000","last_peered":"2024-02-10T00:05:37.191245+0000","last_clean":"2024-02-10T00:05:37.191245+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:37.191245+0000","last_undegraded":"2024-02-10T00:05:37.191245+0000","last_fullsized":"2024-02-10T00:05:37.191245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1515,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190362+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:37.190362+0000","last_peered":"2024-02-10T00:05:37.190362+0000","last_clean":"2024-02-10T00:05:37.190362+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:37.190362+0000","last_undegraded":"2024-02-10T00:05:37.190362+0000","last_fullsized":"2024-02-10T00:05:37.190362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":881,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192151+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:37.192151+0000","last_peered":"2024-02-10T00:05:37.192151+0000","last_clean":"2024-02-10T00:05:37.192151+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:37.192151+0000","last_undegraded":"2024-02-10T00:05:37.192151+0000","last_fullsized":"2024-02-10T00:05:37.192151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'553","reported_seq":902,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189896+0000","last_change":"2024-02-10T00:04:54.364301+0000","last_active":"2024-02-10T00:05:37.189896+0000","last_peered":"2024-02-10T00:05:37.189896+0000","last_clean":"2024-02-10T00:05:37.189896+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:05:37.189896+0000","last_undegraded":"2024-02-10T00:05:37.189896+0000","last_fullsized":"2024-02-10T00:05:37.189896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193776+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:37.193776+0000","last_peered":"2024-02-10T00:05:37.193776+0000","last_clean":"2024-02-10T00:05:37.193776+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:37.193776+0000","last_undegraded":"2024-02-10T00:05:37.193776+0000","last_fullsized":"2024-02-10T00:05:37.193776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1172,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191140+0000","last_change":"2024-02-10T00:05:34.141776+0000","last_active":"2024-02-10T00:05:37.191140+0000","last_peered":"2024-02-10T00:05:37.191140+0000","last_clean":"2024-02-10T00:05:37.191140+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:37.191140+0000","last_undegraded":"2024-02-10T00:05:37.191140+0000","last_fullsized":"2024-02-10T00:05:37.191140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":914,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192493+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:37.192493+0000","last_peered":"2024-02-10T00:05:37.192493+0000","last_clean":"2024-02-10T00:05:37.192493+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:37.192493+0000","last_undegraded":"2024-02-10T00:05:37.192493+0000","last_fullsized":"2024-02-10T00:05:37.192493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":187,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194578+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:37.194578+0000","last_peered":"2024-02-10T00:05:37.194578+0000","last_clean":"2024-02-10T00:05:37.194578+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:37.194578+0000","last_undegraded":"2024-02-10T00:05:37.194578+0000","last_fullsized":"2024-02-10T00:05:37.194578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":948,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191139+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:37.191139+0000","last_peered":"2024-02-10T00:05:37.191139+0000","last_clean":"2024-02-10T00:05:37.191139+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:37.191139+0000","last_undegraded":"2024-02-10T00:05:37.191139+0000","last_fullsized":"2024-02-10T00:05:37.191139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1071,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192400+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:37.192400+0000","last_peered":"2024-02-10T00:05:37.192400+0000","last_clean":"2024-02-10T00:05:37.192400+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:37.192400+0000","last_undegraded":"2024-02-10T00:05:37.192400+0000","last_fullsized":"2024-02-10T00:05:37.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'397","reported_seq":446,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193432+0000","last_change":"2024-02-10T00:04:54.347828+0000","last_active":"2024-02-10T00:05:37.193432+0000","last_peered":"2024-02-10T00:05:37.193432+0000","last_clean":"2024-02-10T00:05:37.193432+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:37.193432+0000","last_undegraded":"2024-02-10T00:05:37.193432+0000","last_fullsized":"2024-02-10T00:05:37.193432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1032,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190625+0000","last_change":"2024-02-10T00:04:54.396785+0000","last_active":"2024-02-10T00:05:37.190625+0000","last_peered":"2024-02-10T00:05:37.190625+0000","last_clean":"2024-02-10T00:05:37.190625+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:37.190625+0000","last_undegraded":"2024-02-10T00:05:37.190625+0000","last_fullsized":"2024-02-10T00:05:37.190625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'659","reported_seq":713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191483+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:37.191483+0000","last_peered":"2024-02-10T00:05:37.191483+0000","last_clean":"2024-02-10T00:05:37.191483+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:37.191483+0000","last_undegraded":"2024-02-10T00:05:37.191483+0000","last_fullsized":"2024-02-10T00:05:37.191483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":561,"num_write_kb":12587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1004,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195749+0000","last_change":"2024-02-10T00:04:54.378993+0000","last_active":"2024-02-10T00:05:37.195749+0000","last_peered":"2024-02-10T00:05:37.195749+0000","last_clean":"2024-02-10T00:05:37.195749+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:37.195749+0000","last_undegraded":"2024-02-10T00:05:37.195749+0000","last_fullsized":"2024-02-10T00:05:37.195749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'387","reported_seq":444,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191404+0000","last_change":"2024-02-10T00:04:54.370970+0000","last_active":"2024-02-10T00:05:37.191404+0000","last_peered":"2024-02-10T00:05:37.191404+0000","last_clean":"2024-02-10T00:05:37.191404+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:37.191404+0000","last_undegraded":"2024-02-10T00:05:37.191404+0000","last_fullsized":"2024-02-10T00:05:37.191404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1103,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191574+0000","last_change":"2024-02-10T00:04:54.385825+0000","last_active":"2024-02-10T00:05:37.191574+0000","last_peered":"2024-02-10T00:05:37.191574+0000","last_clean":"2024-02-10T00:05:37.191574+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:05:37.191574+0000","last_undegraded":"2024-02-10T00:05:37.191574+0000","last_fullsized":"2024-02-10T00:05:37.191574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'115","reported_seq":161,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192983+0000","last_change":"2024-02-10T00:04:54.350056+0000","last_active":"2024-02-10T00:05:37.192983+0000","last_peered":"2024-02-10T00:05:37.192983+0000","last_clean":"2024-02-10T00:05:37.192983+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:05:37.192983+0000","last_undegraded":"2024-02-10T00:05:37.192983+0000","last_fullsized":"2024-02-10T00:05:37.192983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":946,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193983+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:37.193983+0000","last_peered":"2024-02-10T00:05:37.193983+0000","last_clean":"2024-02-10T00:05:37.193983+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:37.193983+0000","last_undegraded":"2024-02-10T00:05:37.193983+0000","last_fullsized":"2024-02-10T00:05:37.193983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":545,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190190+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:37.190190+0000","last_peered":"2024-02-10T00:05:37.190190+0000","last_clean":"2024-02-10T00:05:37.190190+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:37.190190+0000","last_undegraded":"2024-02-10T00:05:37.190190+0000","last_fullsized":"2024-02-10T00:05:37.190190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":864,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191676+0000","last_change":"2024-02-10T00:04:54.410410+0000","last_active":"2024-02-10T00:05:37.191676+0000","last_peered":"2024-02-10T00:05:37.191676+0000","last_clean":"2024-02-10T00:05:37.191676+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:37.191676+0000","last_undegraded":"2024-02-10T00:05:37.191676+0000","last_fullsized":"2024-02-10T00:05:37.191676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'424","reported_seq":477,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194549+0000","last_change":"2024-02-10T00:04:51.490483+0000","last_active":"2024-02-10T00:05:37.194549+0000","last_peered":"2024-02-10T00:05:37.194549+0000","last_clean":"2024-02-10T00:05:37.194549+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:05:37.194549+0000","last_undegraded":"2024-02-10T00:05:37.194549+0000","last_fullsized":"2024-02-10T00:05:37.194549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":983,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190745+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:37.190745+0000","last_peered":"2024-02-10T00:05:37.190745+0000","last_clean":"2024-02-10T00:05:37.190745+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:37.190745+0000","last_undegraded":"2024-02-10T00:05:37.190745+0000","last_fullsized":"2024-02-10T00:05:37.190745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":792,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191043+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:37.191043+0000","last_peered":"2024-02-10T00:05:37.191043+0000","last_clean":"2024-02-10T00:05:37.191043+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:37.191043+0000","last_undegraded":"2024-02-10T00:05:37.191043+0000","last_fullsized":"2024-02-10T00:05:37.191043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":906,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194848+0000","last_change":"2024-02-10T00:04:54.379712+0000","last_active":"2024-02-10T00:05:37.194848+0000","last_peered":"2024-02-10T00:05:37.194848+0000","last_clean":"2024-02-10T00:05:37.194848+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:37.194848+0000","last_undegraded":"2024-02-10T00:05:37.194848+0000","last_fullsized":"2024-02-10T00:05:37.194848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.204726+0000","last_change":"2024-02-10T00:05:37.204037+0000","last_active":"2024-02-10T00:05:37.204726+0000","last_peered":"2024-02-10T00:05:37.204726+0000","last_clean":"2024-02-10T00:05:37.204726+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:37.204726+0000","last_undegraded":"2024-02-10T00:05:37.204726+0000","last_fullsized":"2024-02-10T00:05:37.204726+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"40'1166","reported_seq":1222,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191296+0000","last_change":"2024-02-10T00:04:54.370785+0000","last_active":"2024-02-10T00:05:37.191296+0000","last_peered":"2024-02-10T00:05:37.191296+0000","last_clean":"2024-02-10T00:05:37.191296+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:05:37.191296+0000","last_undegraded":"2024-02-10T00:05:37.191296+0000","last_fullsized":"2024-02-10T00:05:37.191296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'353","reported_seq":403,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192596+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:05:37.192596+0000","last_peered":"2024-02-10T00:05:37.192596+0000","last_clean":"2024-02-10T00:05:37.192596+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:05:37.192596+0000","last_undegraded":"2024-02-10T00:05:37.192596+0000","last_fullsized":"2024-02-10T00:05:37.192596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719545,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":251,"num_write_kb":5960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1589,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194741+0000","last_change":"2024-02-10T00:05:35.324914+0000","last_active":"2024-02-10T00:05:37.194741+0000","last_peered":"2024-02-10T00:05:37.194741+0000","last_clean":"2024-02-10T00:05:37.194741+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:05:37.194741+0000","last_undegraded":"2024-02-10T00:05:37.194741+0000","last_fullsized":"2024-02-10T00:05:37.194741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":923,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192076+0000","last_change":"2024-02-10T00:04:54.398137+0000","last_active":"2024-02-10T00:05:37.192076+0000","last_peered":"2024-02-10T00:05:37.192076+0000","last_clean":"2024-02-10T00:05:37.192076+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:05:37.192076+0000","last_undegraded":"2024-02-10T00:05:37.192076+0000","last_fullsized":"2024-02-10T00:05:37.192076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189644+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:37.189644+0000","last_peered":"2024-02-10T00:05:37.189644+0000","last_clean":"2024-02-10T00:05:37.189644+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:37.189644+0000","last_undegraded":"2024-02-10T00:05:37.189644+0000","last_fullsized":"2024-02-10T00:05:37.189644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190907+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:37.190907+0000","last_peered":"2024-02-10T00:05:37.190907+0000","last_clean":"2024-02-10T00:05:37.190907+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:37.190907+0000","last_undegraded":"2024-02-10T00:05:37.190907+0000","last_fullsized":"2024-02-10T00:05:37.190907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1024,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189554+0000","last_change":"2024-02-10T00:04:51.514389+0000","last_active":"2024-02-10T00:05:37.189554+0000","last_peered":"2024-02-10T00:05:37.189554+0000","last_clean":"2024-02-10T00:05:37.189554+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:05:37.189554+0000","last_undegraded":"2024-02-10T00:05:37.189554+0000","last_fullsized":"2024-02-10T00:05:37.189554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194569+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:37.194569+0000","last_peered":"2024-02-10T00:05:37.194569+0000","last_clean":"2024-02-10T00:05:37.194569+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:37.194569+0000","last_undegraded":"2024-02-10T00:05:37.194569+0000","last_fullsized":"2024-02-10T00:05:37.194569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":839,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189775+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:37.189775+0000","last_peered":"2024-02-10T00:05:37.189775+0000","last_clean":"2024-02-10T00:05:37.189775+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:37.189775+0000","last_undegraded":"2024-02-10T00:05:37.189775+0000","last_fullsized":"2024-02-10T00:05:37.189775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":824,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191782+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:37.191782+0000","last_peered":"2024-02-10T00:05:37.191782+0000","last_clean":"2024-02-10T00:05:37.191782+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:37.191782+0000","last_undegraded":"2024-02-10T00:05:37.191782+0000","last_fullsized":"2024-02-10T00:05:37.191782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191171+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:37.191171+0000","last_peered":"2024-02-10T00:05:37.191171+0000","last_clean":"2024-02-10T00:05:37.191171+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:37.191171+0000","last_undegraded":"2024-02-10T00:05:37.191171+0000","last_fullsized":"2024-02-10T00:05:37.191171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189141+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:37.189141+0000","last_peered":"2024-02-10T00:05:37.189141+0000","last_clean":"2024-02-10T00:05:37.189141+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:37.189141+0000","last_undegraded":"2024-02-10T00:05:37.189141+0000","last_fullsized":"2024-02-10T00:05:37.189141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1450,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191506+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:37.191506+0000","last_peered":"2024-02-10T00:05:37.191506+0000","last_clean":"2024-02-10T00:05:37.191506+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:37.191506+0000","last_undegraded":"2024-02-10T00:05:37.191506+0000","last_fullsized":"2024-02-10T00:05:37.191506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":909,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191425+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:37.191425+0000","last_peered":"2024-02-10T00:05:37.191425+0000","last_clean":"2024-02-10T00:05:37.191425+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:37.191425+0000","last_undegraded":"2024-02-10T00:05:37.191425+0000","last_fullsized":"2024-02-10T00:05:37.191425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190664+0000","last_change":"2024-02-10T00:04:54.398672+0000","last_active":"2024-02-10T00:05:37.190664+0000","last_peered":"2024-02-10T00:05:37.190664+0000","last_clean":"2024-02-10T00:05:37.190664+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:05:37.190664+0000","last_undegraded":"2024-02-10T00:05:37.190664+0000","last_fullsized":"2024-02-10T00:05:37.190664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1032,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192807+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:37.192807+0000","last_peered":"2024-02-10T00:05:37.192807+0000","last_clean":"2024-02-10T00:05:37.192807+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:37.192807+0000","last_undegraded":"2024-02-10T00:05:37.192807+0000","last_fullsized":"2024-02-10T00:05:37.192807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":935,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193676+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:37.193676+0000","last_peered":"2024-02-10T00:05:37.193676+0000","last_clean":"2024-02-10T00:05:37.193676+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:37.193676+0000","last_undegraded":"2024-02-10T00:05:37.193676+0000","last_fullsized":"2024-02-10T00:05:37.193676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191600+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:37.191600+0000","last_peered":"2024-02-10T00:05:37.191600+0000","last_clean":"2024-02-10T00:05:37.191600+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:37.191600+0000","last_undegraded":"2024-02-10T00:05:37.191600+0000","last_fullsized":"2024-02-10T00:05:37.191600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189951+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:37.189951+0000","last_peered":"2024-02-10T00:05:37.189951+0000","last_clean":"2024-02-10T00:05:37.189951+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:37.189951+0000","last_undegraded":"2024-02-10T00:05:37.189951+0000","last_fullsized":"2024-02-10T00:05:37.189951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":994,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193330+0000","last_change":"2024-02-10T00:04:51.519237+0000","last_active":"2024-02-10T00:05:37.193330+0000","last_peered":"2024-02-10T00:05:37.193330+0000","last_clean":"2024-02-10T00:05:37.193330+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:37.193330+0000","last_undegraded":"2024-02-10T00:05:37.193330+0000","last_fullsized":"2024-02-10T00:05:37.193330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":472,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192046+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:37.192046+0000","last_peered":"2024-02-10T00:05:37.192046+0000","last_clean":"2024-02-10T00:05:37.192046+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:37.192046+0000","last_undegraded":"2024-02-10T00:05:37.192046+0000","last_fullsized":"2024-02-10T00:05:37.192046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191760+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:37.191760+0000","last_peered":"2024-02-10T00:05:37.191760+0000","last_clean":"2024-02-10T00:05:37.191760+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:37.191760+0000","last_undegraded":"2024-02-10T00:05:37.191760+0000","last_fullsized":"2024-02-10T00:05:37.191760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":997,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191032+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:37.191032+0000","last_peered":"2024-02-10T00:05:37.191032+0000","last_clean":"2024-02-10T00:05:37.191032+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:37.191032+0000","last_undegraded":"2024-02-10T00:05:37.191032+0000","last_fullsized":"2024-02-10T00:05:37.191032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191827+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:37.191827+0000","last_peered":"2024-02-10T00:05:37.191827+0000","last_clean":"2024-02-10T00:05:37.191827+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:37.191827+0000","last_undegraded":"2024-02-10T00:05:37.191827+0000","last_fullsized":"2024-02-10T00:05:37.191827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":780,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193868+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:37.193868+0000","last_peered":"2024-02-10T00:05:37.193868+0000","last_clean":"2024-02-10T00:05:37.193868+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:37.193868+0000","last_undegraded":"2024-02-10T00:05:37.193868+0000","last_fullsized":"2024-02-10T00:05:37.193868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1649,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194484+0000","last_change":"2024-02-10T00:05:35.325336+0000","last_active":"2024-02-10T00:05:37.194484+0000","last_peered":"2024-02-10T00:05:37.194484+0000","last_clean":"2024-02-10T00:05:37.194484+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:05:37.194484+0000","last_undegraded":"2024-02-10T00:05:37.194484+0000","last_fullsized":"2024-02-10T00:05:37.194484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":176,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193469+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:37.193469+0000","last_peered":"2024-02-10T00:05:37.193469+0000","last_clean":"2024-02-10T00:05:37.193469+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:37.193469+0000","last_undegraded":"2024-02-10T00:05:37.193469+0000","last_fullsized":"2024-02-10T00:05:37.193469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":954,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195358+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:37.195358+0000","last_peered":"2024-02-10T00:05:37.195358+0000","last_clean":"2024-02-10T00:05:37.195358+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:37.195358+0000","last_undegraded":"2024-02-10T00:05:37.195358+0000","last_fullsized":"2024-02-10T00:05:37.195358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":467,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189377+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:37.189377+0000","last_peered":"2024-02-10T00:05:37.189377+0000","last_clean":"2024-02-10T00:05:37.189377+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:37.189377+0000","last_undegraded":"2024-02-10T00:05:37.189377+0000","last_fullsized":"2024-02-10T00:05:37.189377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":902,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194777+0000","last_change":"2024-02-10T00:04:54.377414+0000","last_active":"2024-02-10T00:05:37.194777+0000","last_peered":"2024-02-10T00:05:37.194777+0000","last_clean":"2024-02-10T00:05:37.194777+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:37.194777+0000","last_undegraded":"2024-02-10T00:05:37.194777+0000","last_fullsized":"2024-02-10T00:05:37.194777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'253","reported_seq":302,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191502+0000","last_change":"2024-02-10T00:04:54.373220+0000","last_active":"2024-02-10T00:05:37.191502+0000","last_peered":"2024-02-10T00:05:37.191502+0000","last_clean":"2024-02-10T00:05:37.191502+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:05:37.191502+0000","last_undegraded":"2024-02-10T00:05:37.191502+0000","last_fullsized":"2024-02-10T00:05:37.191502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":246,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193711+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:37.193711+0000","last_peered":"2024-02-10T00:05:37.193711+0000","last_clean":"2024-02-10T00:05:37.193711+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:37.193711+0000","last_undegraded":"2024-02-10T00:05:37.193711+0000","last_fullsized":"2024-02-10T00:05:37.193711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":941,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189670+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:37.189670+0000","last_peered":"2024-02-10T00:05:37.189670+0000","last_clean":"2024-02-10T00:05:37.189670+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:37.189670+0000","last_undegraded":"2024-02-10T00:05:37.189670+0000","last_fullsized":"2024-02-10T00:05:37.189670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192301+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:37.192301+0000","last_peered":"2024-02-10T00:05:37.192301+0000","last_clean":"2024-02-10T00:05:37.192301+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:37.192301+0000","last_undegraded":"2024-02-10T00:05:37.192301+0000","last_fullsized":"2024-02-10T00:05:37.192301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":971,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193292+0000","last_change":"2024-02-10T00:04:54.375786+0000","last_active":"2024-02-10T00:05:37.193292+0000","last_peered":"2024-02-10T00:05:37.193292+0000","last_clean":"2024-02-10T00:05:37.193292+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:37.193292+0000","last_undegraded":"2024-02-10T00:05:37.193292+0000","last_fullsized":"2024-02-10T00:05:37.193292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":930,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192445+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:37.192445+0000","last_peered":"2024-02-10T00:05:37.192445+0000","last_clean":"2024-02-10T00:05:37.192445+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:37.192445+0000","last_undegraded":"2024-02-10T00:05:37.192445+0000","last_fullsized":"2024-02-10T00:05:37.192445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":798,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189851+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:37.189851+0000","last_peered":"2024-02-10T00:05:37.189851+0000","last_clean":"2024-02-10T00:05:37.189851+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:37.189851+0000","last_undegraded":"2024-02-10T00:05:37.189851+0000","last_fullsized":"2024-02-10T00:05:37.189851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147636729,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16347,"num_write_kb":272987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19944,"ondisk_log_size":19944,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986190,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423836,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948004,"statfs":{"total":96636764160,"available":96202756096,"internally_reserved":0,"allocated":100421632,"data_stored":100126314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]},{"osd":2,"up_from":29,"seq":124554051598,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381772,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":320372,"kb_avail":93990068,"statfs":{"total":96636764160,"available":96245829632,"internally_reserved":0,"allocated":62853120,"data_stored":62581014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":328061870},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":0,"up_from":28,"seq":120259084302,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084302,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371644,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":311531,"kb_avail":94000196,"statfs":{"total":96636764160,"available":96256200704,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":319007780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99933815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:05:52.395 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.396 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.397 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.398 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.399 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.400 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.401 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-09T23:58:11.548870+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.402 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.403 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.404 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.405 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.405 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.405 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:05:52.405 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:06:12.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:06:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.535+0000 7f305cf7e700 1 Processor -- start 2024-02-10T00:06:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.535+0000 7f305cf7e700 1 -- start start 2024-02-10T00:06:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305cf7e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 0x7f30580a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305cf7e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f305813f6e0 0x7f30580a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305cf7e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3058063b10 con 0x7f30580a5130 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305cf7e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3058139bb0 con 0x7f305813f6e0 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305cf7e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580a2100 con 0x7f3058063740 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 0x7f30580a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f305813f6e0 0x7f30580a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f305813f6e0 0x7f30580a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38886/0 (socket says 172.21.15.89:38886) 2024-02-10T00:06:12.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 0x7f30580a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36338/0 (socket says 172.21.15.89:36338) 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 -- 172.21.15.89:0/2931573696 learned_addr learned my addr 172.21.15.89:0/2931573696 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3056d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f30580a5130 0x7f305813fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45718/0 (socket says 172.21.15.89:45718) 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 -- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 msgr2=0x7f30580a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 --2- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 0x7f30580a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 -- 172.21.15.89:0/2931573696 >> v1:172.21.15.89:6789/0 conn(0x7f30580a5130 legacy=0x7f305813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305559a700 1 -- 172.21.15.89:0/2931573696 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359413526 0 0) 0x7f3058063b10 con 0x7f30580a5130 2024-02-10T00:06:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 -- 172.21.15.89:0/2931573696 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305813fb70 con 0x7f305813f6e0 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f3055d9b700 1 --2- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305813f6e0 0x7f30580a29a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f30480099b0 tx=0x7f3048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f1c01a95317033 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305559a700 1 -- 172.21.15.89:0/2931573696 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048009ea0 con 0x7f305813f6e0 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305559a700 1 -- 172.21.15.89:0/2931573696 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800b8f0 con 0x7f305813f6e0 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.536+0000 7f305559a700 1 -- 172.21.15.89:0/2931573696 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800bc90 con 0x7f305813f6e0 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 -- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305813f6e0 msgr2=0x7f30580a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305813f6e0 0x7f30580a29a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f30480099b0 tx=0x7f3048009250 comp rx=0 tx=0).stop 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 -- 172.21.15.89:0/2931573696 shutdown_connections 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058063740 0x7f30580a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2931573696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305813f6e0 0x7f30580a29a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 -- 172.21.15.89:0/2931573696 >> 172.21.15.89:0/2931573696 conn(0x7f305806a820 msgr2=0x7f30580b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 -- 172.21.15.89:0/2931573696 shutdown_connections 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.537+0000 7f305cf7e700 1 -- 172.21.15.89:0/2931573696 wait complete. 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 Processor -- start 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 -- start start 2024-02-10T00:06:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3058063740 0x7f305806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:12.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:12.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f305813f6e0 0x7f305806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:12.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.538+0000 7f305cf7e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305806e150 con 0x7f3058063740 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f305cf7e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3058143c80 con 0x7f30580a5130 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f305cf7e700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3058143440 con 0x7f305813f6e0 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:36344/0 (socket says 172.21.15.89:36344) 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 -- 172.21.15.89:0/2275735279 learned_addr learned my addr 172.21.15.89:0/2275735279 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3056d9d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f305813f6e0 0x7f305806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:12.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f305659c700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3058063740 0x7f305806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 -- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f305813f6e0 msgr2=0x7f305806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f305813f6e0 0x7f305806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 -- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3058063740 msgr2=0x7f305806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3058063740 0x7f305806dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 -- 172.21.15.89:0/2275735279 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480094f0 con 0x7f30580a5130 2024-02-10T00:06:12.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f3055d9b700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3048006fd0 tx=0x7f3048017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048000d10 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800bc70 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304801a680 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30581436e0 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.539+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058143130 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.540+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580a0c10 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.541+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f304801aa30 con 0x7f30580a5130 2024-02-10T00:06:12.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.541+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f304805ce60 con 0x7f30580a5130 2024-02-10T00:06:12.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.544+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3048002eb0 con 0x7f30580a5130 2024-02-10T00:06:12.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.694+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3058140520 con 0x7f3038045f50 2024-02-10T00:06:12.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.701+0000 7f30467fc700 1 -- 172.21.15.89:0/2275735279 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277381 (unknown 2965378022 0 3668002471) 0x7f3058140520 con 0x7f3038045f50 2024-02-10T00:06:12.709 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:06:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 >> v1:172.21.15.89:6816/47970 conn(0x7f3038045f50 legacy=0x7f3038048400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 msgr2=0x7f30581446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3048006fd0 tx=0x7f3048017000 comp rx=0 tx=0).stop 2024-02-10T00:06:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 shutdown_connections 2024-02-10T00:06:12.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f305813f6e0 0x7f305806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3058063740 0x7f305806dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 --2- 172.21.15.89:0/2275735279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30580a5130 0x7f30581446b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 >> 172.21.15.89:0/2275735279 conn(0x7f305806a820 msgr2=0x7f30580680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 shutdown_connections 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:12.704+0000 7f305cf7e700 1 -- 172.21.15.89:0/2275735279 wait complete. 2024-02-10T00:06:12.714 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:06:12.718 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-02-10T00:06:12.154997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71826,"ondisk_log_size":71826,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1554164,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1261943,"kb_avail":375933196,"statfs":{"total":386547056640,"available":384955592704,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1292230139},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":842,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193219+0000","last_change":"2024-02-10T00:04:54.370408+0000","last_active":"2024-02-10T00:05:37.193219+0000","last_peered":"2024-02-10T00:05:37.193219+0000","last_clean":"2024-02-10T00:05:37.193219+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:05:37.193219+0000","last_undegraded":"2024-02-10T00:05:37.193219+0000","last_fullsized":"2024-02-10T00:05:37.193219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":876,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191271+0000","last_change":"2024-02-10T00:04:54.398255+0000","last_active":"2024-02-10T00:05:37.191271+0000","last_peered":"2024-02-10T00:05:37.191271+0000","last_clean":"2024-02-10T00:05:37.191271+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:05:37.191271+0000","last_undegraded":"2024-02-10T00:05:37.191271+0000","last_fullsized":"2024-02-10T00:05:37.191271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192496+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:37.192496+0000","last_peered":"2024-02-10T00:05:37.192496+0000","last_clean":"2024-02-10T00:05:37.192496+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:37.192496+0000","last_undegraded":"2024-02-10T00:05:37.192496+0000","last_fullsized":"2024-02-10T00:05:37.192496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":807,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189282+0000","last_change":"2024-02-10T00:04:50.482814+0000","last_active":"2024-02-10T00:05:37.189282+0000","last_peered":"2024-02-10T00:05:37.189282+0000","last_clean":"2024-02-10T00:05:37.189282+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:05:37.189282+0000","last_undegraded":"2024-02-10T00:05:37.189282+0000","last_fullsized":"2024-02-10T00:05:37.189282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":936,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194417+0000","last_change":"2024-02-10T00:04:54.372094+0000","last_active":"2024-02-10T00:05:37.194417+0000","last_peered":"2024-02-10T00:05:37.194417+0000","last_clean":"2024-02-10T00:05:37.194417+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:05:37.194417+0000","last_undegraded":"2024-02-10T00:05:37.194417+0000","last_fullsized":"2024-02-10T00:05:37.194417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":909,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189556+0000","last_change":"2024-02-10T00:04:50.484806+0000","last_active":"2024-02-10T00:05:37.189556+0000","last_peered":"2024-02-10T00:05:37.189556+0000","last_clean":"2024-02-10T00:05:37.189556+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:05:37.189556+0000","last_undegraded":"2024-02-10T00:05:37.189556+0000","last_fullsized":"2024-02-10T00:05:37.189556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":854,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190948+0000","last_change":"2024-02-10T00:04:50.482611+0000","last_active":"2024-02-10T00:05:37.190948+0000","last_peered":"2024-02-10T00:05:37.190948+0000","last_clean":"2024-02-10T00:05:37.190948+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:05:37.190948+0000","last_undegraded":"2024-02-10T00:05:37.190948+0000","last_fullsized":"2024-02-10T00:05:37.190948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1521,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195132+0000","last_change":"2024-02-10T00:05:36.195115+0000","last_active":"2024-02-10T00:05:37.195132+0000","last_peered":"2024-02-10T00:05:37.195132+0000","last_clean":"2024-02-10T00:05:37.195132+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:05:37.195132+0000","last_undegraded":"2024-02-10T00:05:37.195132+0000","last_fullsized":"2024-02-10T00:05:37.195132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190904+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:37.190904+0000","last_peered":"2024-02-10T00:05:37.190904+0000","last_clean":"2024-02-10T00:05:37.190904+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:37.190904+0000","last_undegraded":"2024-02-10T00:05:37.190904+0000","last_fullsized":"2024-02-10T00:05:37.190904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":991,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194665+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:37.194665+0000","last_peered":"2024-02-10T00:05:37.194665+0000","last_clean":"2024-02-10T00:05:37.194665+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:37.194665+0000","last_undegraded":"2024-02-10T00:05:37.194665+0000","last_fullsized":"2024-02-10T00:05:37.194665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":898,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189751+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:37.189751+0000","last_peered":"2024-02-10T00:05:37.189751+0000","last_clean":"2024-02-10T00:05:37.189751+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:37.189751+0000","last_undegraded":"2024-02-10T00:05:37.189751+0000","last_fullsized":"2024-02-10T00:05:37.189751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":973,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191268+0000","last_change":"2024-02-10T00:05:35.175131+0000","last_active":"2024-02-10T00:05:37.191268+0000","last_peered":"2024-02-10T00:05:37.191268+0000","last_clean":"2024-02-10T00:05:37.191268+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:37.191268+0000","last_undegraded":"2024-02-10T00:05:37.191268+0000","last_fullsized":"2024-02-10T00:05:37.191268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":966,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189141+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:37.189141+0000","last_peered":"2024-02-10T00:05:37.189141+0000","last_clean":"2024-02-10T00:05:37.189141+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:37.189141+0000","last_undegraded":"2024-02-10T00:05:37.189141+0000","last_fullsized":"2024-02-10T00:05:37.189141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191245+0000","last_change":"2024-02-10T00:04:54.410825+0000","last_active":"2024-02-10T00:05:37.191245+0000","last_peered":"2024-02-10T00:05:37.191245+0000","last_clean":"2024-02-10T00:05:37.191245+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:05:37.191245+0000","last_undegraded":"2024-02-10T00:05:37.191245+0000","last_fullsized":"2024-02-10T00:05:37.191245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1515,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190362+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:37.190362+0000","last_peered":"2024-02-10T00:05:37.190362+0000","last_clean":"2024-02-10T00:05:37.190362+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:37.190362+0000","last_undegraded":"2024-02-10T00:05:37.190362+0000","last_fullsized":"2024-02-10T00:05:37.190362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":881,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192151+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:37.192151+0000","last_peered":"2024-02-10T00:05:37.192151+0000","last_clean":"2024-02-10T00:05:37.192151+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:37.192151+0000","last_undegraded":"2024-02-10T00:05:37.192151+0000","last_fullsized":"2024-02-10T00:05:37.192151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193776+0000","last_change":"2024-02-10T00:04:50.486736+0000","last_active":"2024-02-10T00:05:37.193776+0000","last_peered":"2024-02-10T00:05:37.193776+0000","last_clean":"2024-02-10T00:05:37.193776+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:05:37.193776+0000","last_undegraded":"2024-02-10T00:05:37.193776+0000","last_fullsized":"2024-02-10T00:05:37.193776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1172,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191140+0000","last_change":"2024-02-10T00:05:34.141776+0000","last_active":"2024-02-10T00:05:37.191140+0000","last_peered":"2024-02-10T00:05:37.191140+0000","last_clean":"2024-02-10T00:05:37.191140+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:37.191140+0000","last_undegraded":"2024-02-10T00:05:37.191140+0000","last_fullsized":"2024-02-10T00:05:37.191140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":914,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192493+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:37.192493+0000","last_peered":"2024-02-10T00:05:37.192493+0000","last_clean":"2024-02-10T00:05:37.192493+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:37.192493+0000","last_undegraded":"2024-02-10T00:05:37.192493+0000","last_fullsized":"2024-02-10T00:05:37.192493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":187,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194578+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:37.194578+0000","last_peered":"2024-02-10T00:05:37.194578+0000","last_clean":"2024-02-10T00:05:37.194578+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:37.194578+0000","last_undegraded":"2024-02-10T00:05:37.194578+0000","last_fullsized":"2024-02-10T00:05:37.194578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":948,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191139+0000","last_change":"2024-02-10T00:04:54.397936+0000","last_active":"2024-02-10T00:05:37.191139+0000","last_peered":"2024-02-10T00:05:37.191139+0000","last_clean":"2024-02-10T00:05:37.191139+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:05:37.191139+0000","last_undegraded":"2024-02-10T00:05:37.191139+0000","last_fullsized":"2024-02-10T00:05:37.191139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1071,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192400+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:37.192400+0000","last_peered":"2024-02-10T00:05:37.192400+0000","last_clean":"2024-02-10T00:05:37.192400+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:37.192400+0000","last_undegraded":"2024-02-10T00:05:37.192400+0000","last_fullsized":"2024-02-10T00:05:37.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'660","reported_seq":714,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.192621+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:38.192621+0000","last_peered":"2024-02-10T00:05:38.192621+0000","last_clean":"2024-02-10T00:05:38.192621+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:38.192621+0000","last_undegraded":"2024-02-10T00:05:38.192621+0000","last_fullsized":"2024-02-10T00:05:38.192621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":946,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193983+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:37.193983+0000","last_peered":"2024-02-10T00:05:37.193983+0000","last_clean":"2024-02-10T00:05:37.193983+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:37.193983+0000","last_undegraded":"2024-02-10T00:05:37.193983+0000","last_fullsized":"2024-02-10T00:05:37.193983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'494","reported_seq":545,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190190+0000","last_change":"2024-02-10T00:04:50.475161+0000","last_active":"2024-02-10T00:05:37.190190+0000","last_peered":"2024-02-10T00:05:37.190190+0000","last_clean":"2024-02-10T00:05:37.190190+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:05:37.190190+0000","last_undegraded":"2024-02-10T00:05:37.190190+0000","last_fullsized":"2024-02-10T00:05:37.190190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":983,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190745+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:37.190745+0000","last_peered":"2024-02-10T00:05:37.190745+0000","last_clean":"2024-02-10T00:05:37.190745+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:37.190745+0000","last_undegraded":"2024-02-10T00:05:37.190745+0000","last_fullsized":"2024-02-10T00:05:37.190745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'741","reported_seq":792,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191043+0000","last_change":"2024-02-10T00:04:54.400860+0000","last_active":"2024-02-10T00:05:37.191043+0000","last_peered":"2024-02-10T00:05:37.191043+0000","last_clean":"2024-02-10T00:05:37.191043+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:05:37.191043+0000","last_undegraded":"2024-02-10T00:05:37.191043+0000","last_fullsized":"2024-02-10T00:05:37.191043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'355","reported_seq":405,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:00.185906+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:06:00.185906+0000","last_peered":"2024-02-10T00:06:00.185906+0000","last_clean":"2024-02-10T00:06:00.185906+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:06:00.185906+0000","last_undegraded":"2024-02-10T00:06:00.185906+0000","last_fullsized":"2024-02-10T00:06:00.185906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1589,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194741+0000","last_change":"2024-02-10T00:05:35.324914+0000","last_active":"2024-02-10T00:05:37.194741+0000","last_peered":"2024-02-10T00:05:37.194741+0000","last_clean":"2024-02-10T00:05:37.194741+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:05:37.194741+0000","last_undegraded":"2024-02-10T00:05:37.194741+0000","last_fullsized":"2024-02-10T00:05:37.194741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189644+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:37.189644+0000","last_peered":"2024-02-10T00:05:37.189644+0000","last_clean":"2024-02-10T00:05:37.189644+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:37.189644+0000","last_undegraded":"2024-02-10T00:05:37.189644+0000","last_fullsized":"2024-02-10T00:05:37.189644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190907+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:37.190907+0000","last_peered":"2024-02-10T00:05:37.190907+0000","last_clean":"2024-02-10T00:05:37.190907+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:37.190907+0000","last_undegraded":"2024-02-10T00:05:37.190907+0000","last_fullsized":"2024-02-10T00:05:37.190907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194569+0000","last_change":"2024-02-10T00:04:54.357762+0000","last_active":"2024-02-10T00:05:37.194569+0000","last_peered":"2024-02-10T00:05:37.194569+0000","last_clean":"2024-02-10T00:05:37.194569+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:05:37.194569+0000","last_undegraded":"2024-02-10T00:05:37.194569+0000","last_fullsized":"2024-02-10T00:05:37.194569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":839,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189775+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:37.189775+0000","last_peered":"2024-02-10T00:05:37.189775+0000","last_clean":"2024-02-10T00:05:37.189775+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:37.189775+0000","last_undegraded":"2024-02-10T00:05:37.189775+0000","last_fullsized":"2024-02-10T00:05:37.189775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":824,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191782+0000","last_change":"2024-02-10T00:04:50.477727+0000","last_active":"2024-02-10T00:05:37.191782+0000","last_peered":"2024-02-10T00:05:37.191782+0000","last_clean":"2024-02-10T00:05:37.191782+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:05:37.191782+0000","last_undegraded":"2024-02-10T00:05:37.191782+0000","last_fullsized":"2024-02-10T00:05:37.191782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191171+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:37.191171+0000","last_peered":"2024-02-10T00:05:37.191171+0000","last_clean":"2024-02-10T00:05:37.191171+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:37.191171+0000","last_undegraded":"2024-02-10T00:05:37.191171+0000","last_fullsized":"2024-02-10T00:05:37.191171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189141+0000","last_change":"2024-02-10T00:04:50.475360+0000","last_active":"2024-02-10T00:05:37.189141+0000","last_peered":"2024-02-10T00:05:37.189141+0000","last_clean":"2024-02-10T00:05:37.189141+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:05:37.189141+0000","last_undegraded":"2024-02-10T00:05:37.189141+0000","last_fullsized":"2024-02-10T00:05:37.189141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:11.548870+0000","last_clean_scrub_stamp":"2024-02-09T23:58:11.548870+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1400","reported_seq":1450,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191506+0000","last_change":"2024-02-10T00:04:54.397482+0000","last_active":"2024-02-10T00:05:37.191506+0000","last_peered":"2024-02-10T00:05:37.191506+0000","last_clean":"2024-02-10T00:05:37.191506+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:05:37.191506+0000","last_undegraded":"2024-02-10T00:05:37.191506+0000","last_fullsized":"2024-02-10T00:05:37.191506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":909,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191425+0000","last_change":"2024-02-10T00:04:54.402136+0000","last_active":"2024-02-10T00:05:37.191425+0000","last_peered":"2024-02-10T00:05:37.191425+0000","last_clean":"2024-02-10T00:05:37.191425+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:05:37.191425+0000","last_undegraded":"2024-02-10T00:05:37.191425+0000","last_fullsized":"2024-02-10T00:05:37.191425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"40'699","reported_seq":1032,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192807+0000","last_change":"2024-02-10T00:04:51.489649+0000","last_active":"2024-02-10T00:05:37.192807+0000","last_peered":"2024-02-10T00:05:37.192807+0000","last_clean":"2024-02-10T00:05:37.192807+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:05:37.192807+0000","last_undegraded":"2024-02-10T00:05:37.192807+0000","last_fullsized":"2024-02-10T00:05:37.192807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":935,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193676+0000","last_change":"2024-02-10T00:04:50.487080+0000","last_active":"2024-02-10T00:05:37.193676+0000","last_peered":"2024-02-10T00:05:37.193676+0000","last_clean":"2024-02-10T00:05:37.193676+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:05:37.193676+0000","last_undegraded":"2024-02-10T00:05:37.193676+0000","last_fullsized":"2024-02-10T00:05:37.193676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191600+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:37.191600+0000","last_peered":"2024-02-10T00:05:37.191600+0000","last_clean":"2024-02-10T00:05:37.191600+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:37.191600+0000","last_undegraded":"2024-02-10T00:05:37.191600+0000","last_fullsized":"2024-02-10T00:05:37.191600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189951+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:37.189951+0000","last_peered":"2024-02-10T00:05:37.189951+0000","last_clean":"2024-02-10T00:05:37.189951+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:37.189951+0000","last_undegraded":"2024-02-10T00:05:37.189951+0000","last_fullsized":"2024-02-10T00:05:37.189951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":472,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192046+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:37.192046+0000","last_peered":"2024-02-10T00:05:37.192046+0000","last_clean":"2024-02-10T00:05:37.192046+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:37.192046+0000","last_undegraded":"2024-02-10T00:05:37.192046+0000","last_fullsized":"2024-02-10T00:05:37.192046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191760+0000","last_change":"2024-02-10T00:04:50.473981+0000","last_active":"2024-02-10T00:05:37.191760+0000","last_peered":"2024-02-10T00:05:37.191760+0000","last_clean":"2024-02-10T00:05:37.191760+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:05:37.191760+0000","last_undegraded":"2024-02-10T00:05:37.191760+0000","last_fullsized":"2024-02-10T00:05:37.191760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":997,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191032+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:37.191032+0000","last_peered":"2024-02-10T00:05:37.191032+0000","last_clean":"2024-02-10T00:05:37.191032+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:37.191032+0000","last_undegraded":"2024-02-10T00:05:37.191032+0000","last_fullsized":"2024-02-10T00:05:37.191032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191827+0000","last_change":"2024-02-10T00:04:54.361008+0000","last_active":"2024-02-10T00:05:37.191827+0000","last_peered":"2024-02-10T00:05:37.191827+0000","last_clean":"2024-02-10T00:05:37.191827+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:05:37.191827+0000","last_undegraded":"2024-02-10T00:05:37.191827+0000","last_fullsized":"2024-02-10T00:05:37.191827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":780,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193868+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:37.193868+0000","last_peered":"2024-02-10T00:05:37.193868+0000","last_clean":"2024-02-10T00:05:37.193868+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:37.193868+0000","last_undegraded":"2024-02-10T00:05:37.193868+0000","last_fullsized":"2024-02-10T00:05:37.193868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1649,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194484+0000","last_change":"2024-02-10T00:05:35.325336+0000","last_active":"2024-02-10T00:05:37.194484+0000","last_peered":"2024-02-10T00:05:37.194484+0000","last_clean":"2024-02-10T00:05:37.194484+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:05:37.194484+0000","last_undegraded":"2024-02-10T00:05:37.194484+0000","last_fullsized":"2024-02-10T00:05:37.194484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":176,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193469+0000","last_change":"2024-02-10T00:04:54.349021+0000","last_active":"2024-02-10T00:05:37.193469+0000","last_peered":"2024-02-10T00:05:37.193469+0000","last_clean":"2024-02-10T00:05:37.193469+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:05:37.193469+0000","last_undegraded":"2024-02-10T00:05:37.193469+0000","last_fullsized":"2024-02-10T00:05:37.193469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":954,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195358+0000","last_change":"2024-02-10T00:04:51.506997+0000","last_active":"2024-02-10T00:05:37.195358+0000","last_peered":"2024-02-10T00:05:37.195358+0000","last_clean":"2024-02-10T00:05:37.195358+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:05:37.195358+0000","last_undegraded":"2024-02-10T00:05:37.195358+0000","last_fullsized":"2024-02-10T00:05:37.195358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'421","reported_seq":467,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189377+0000","last_change":"2024-02-10T00:04:50.472063+0000","last_active":"2024-02-10T00:05:37.189377+0000","last_peered":"2024-02-10T00:05:37.189377+0000","last_clean":"2024-02-10T00:05:37.189377+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:05:37.189377+0000","last_undegraded":"2024-02-10T00:05:37.189377+0000","last_fullsized":"2024-02-10T00:05:37.189377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"39'202","reported_seq":246,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193711+0000","last_change":"2024-02-10T00:04:50.478724+0000","last_active":"2024-02-10T00:05:37.193711+0000","last_peered":"2024-02-10T00:05:37.193711+0000","last_clean":"2024-02-10T00:05:37.193711+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:05:37.193711+0000","last_undegraded":"2024-02-10T00:05:37.193711+0000","last_fullsized":"2024-02-10T00:05:37.193711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":941,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189670+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:37.189670+0000","last_peered":"2024-02-10T00:05:37.189670+0000","last_clean":"2024-02-10T00:05:37.189670+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:37.189670+0000","last_undegraded":"2024-02-10T00:05:37.189670+0000","last_fullsized":"2024-02-10T00:05:37.189670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192301+0000","last_change":"2024-02-10T00:04:54.407572+0000","last_active":"2024-02-10T00:05:37.192301+0000","last_peered":"2024-02-10T00:05:37.192301+0000","last_clean":"2024-02-10T00:05:37.192301+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:05:37.192301+0000","last_undegraded":"2024-02-10T00:05:37.192301+0000","last_fullsized":"2024-02-10T00:05:37.192301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":930,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192445+0000","last_change":"2024-02-10T00:04:54.389272+0000","last_active":"2024-02-10T00:05:37.192445+0000","last_peered":"2024-02-10T00:05:37.192445+0000","last_clean":"2024-02-10T00:05:37.192445+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:05:37.192445+0000","last_undegraded":"2024-02-10T00:05:37.192445+0000","last_fullsized":"2024-02-10T00:05:37.192445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":798,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189851+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:37.189851+0000","last_peered":"2024-02-10T00:05:37.189851+0000","last_clean":"2024-02-10T00:05:37.189851+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:37.189851+0000","last_undegraded":"2024-02-10T00:05:37.189851+0000","last_fullsized":"2024-02-10T00:05:37.189851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19967,"ondisk_log_size":19967,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986194,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423836,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948004,"statfs":{"total":96636764160,"available":96202756096,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.41299999999999998}]}]},{"osd":2,"up_from":29,"seq":124554051602,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.37}]},{"osd":3,"last update":"Sat Feb 10 00:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.48799999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084306,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.248},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:05:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:05:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.38400000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084306,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.309}]},{"osd":2,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:06:12.734 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.735 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.735 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.735 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.735 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.735 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.736 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.736 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.736 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.736 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.737 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.737 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.738 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.738 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.738 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.738 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.739 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.740 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.740 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.740 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.740 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.741 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.741 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.741 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.741 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.741 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.742 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.742 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.742 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.742 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-09T23:58:11.548870+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.743 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.744 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.744 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.744 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.744 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.744 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.745 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.746 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.746 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.746 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.746 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.747 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.747 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.747 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:12.747 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:06:32.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:06:32.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.877+0000 7f3d37eab700 1 Processor -- start 2024-02-10T00:06:32.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.877+0000 7f3d37eab700 1 -- start start 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d37eab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 0x7f3d301439c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d37eab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 0x7f3d30145f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d37eab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3006c8d0 con 0x7f3d3006c500 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d37eab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300a6bc0 con 0x7f3d300a64e0 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d37eab700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300a5880 con 0x7f3d300a41a0 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d36448700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 0x7f3d30145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35c47700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3d3006c500 0x7f3d301384d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41370/0 (socket says 172.21.15.89:41370) 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35c47700 1 -- 172.21.15.89:0/248407649 learned_addr learned my addr 172.21.15.89:0/248407649 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 0x7f3d301439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 -- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 msgr2=0x7f3d30145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d34c45700 1 -- 172.21.15.89:0/248407649 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404308163 0 0) 0x7f3d3006c8d0 con 0x7f3d3006c500 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 0x7f3d30145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 -- 172.21.15.89:0/248407649 >> v1:172.21.15.89:6789/0 conn(0x7f3d3006c500 legacy=0x7f3d301384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 -- 172.21.15.89:0/248407649 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300a6060 con 0x7f3d300a41a0 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d36448700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 0x7f3d30145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d35446700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 0x7f3d301439c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009910 tx=0x7f3d200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a5b5b36de4bb9d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d34c45700 1 -- 172.21.15.89:0/248407649 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000b680 con 0x7f3d300a41a0 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d34c45700 1 -- 172.21.15.89:0/248407649 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000b7e0 con 0x7f3d300a41a0 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.878+0000 7f3d34c45700 1 -- 172.21.15.89:0/248407649 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000bba0 con 0x7f3d300a41a0 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 -- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 msgr2=0x7f3d301439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 0x7f3d301439c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009910 tx=0x7f3d200091a0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 -- 172.21.15.89:0/248407649 shutdown_connections 2024-02-10T00:06:32.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a64e0 0x7f3d30145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 --2- 172.21.15.89:0/248407649 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a41a0 0x7f3d301439c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 -- 172.21.15.89:0/248407649 >> 172.21.15.89:0/248407649 conn(0x7f3d30063580 msgr2=0x7f3d30063950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 -- 172.21.15.89:0/248407649 shutdown_connections 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.879+0000 7f3d37eab700 1 -- 172.21.15.89:0/248407649 wait complete. 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.880+0000 7f3d37eab700 1 Processor -- start 2024-02-10T00:06:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.880+0000 7f3d37eab700 1 -- start start 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.880+0000 7f3d37eab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.880+0000 7f3d37eab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 0x7f3d300ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d37eab700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 0x7f3d3014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d37eab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300aee20 con 0x7f3d3006c500 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d37eab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300af0c0 con 0x7f3d300a41a0 2024-02-10T00:06:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d37eab700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d301379e0 con 0x7f3d300a64e0 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35c47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d36448700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 0x7f3d3014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35c47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34304/0 (socket says 172.21.15.89:34304) 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 0x7f3d300ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35c47700 1 -- 172.21.15.89:0/4037976035 learned_addr learned my addr 172.21.15.89:0/4037976035 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 -- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 msgr2=0x7f3d3014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 0x7f3d3014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 -- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 msgr2=0x7f3d300a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 -- 172.21.15.89:0/4037976035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28009a20 con 0x7f3d300a41a0 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35c47700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d36448700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 0x7f3d3014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:06:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d35446700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 0x7f3d300ae4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d20016000 tx=0x7f3d20017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000bb60 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20000c90 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d20009420 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.881+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2001a660 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.882+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300b1360 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.882+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3013c5b0 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.883+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f3d2001a9d0 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.883+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f3d2005cdc0 con 0x7f3d300a41a0 2024-02-10T00:06:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:32.886+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f3d20005a00 con 0x7f3d300a41a0 2024-02-10T00:06:33.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.034+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d3004c710 con 0x7f3d14045f20 2024-02-10T00:06:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.041+0000 7f3d25ffb700 1 -- 172.21.15.89:0/4037976035 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279094 (unknown 2965378022 0 4186069473) 0x7f3d3004c710 con 0x7f3d14045f20 2024-02-10T00:06:33.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 >> v1:172.21.15.89:6816/47970 conn(0x7f3d14045f20 legacy=0x7f3d140483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 msgr2=0x7f3d300ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 0x7f3d300ae4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d20016000 tx=0x7f3d20017000 comp rx=0 tx=0).stop 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 shutdown_connections 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f3d300a64e0 0x7f3d3014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3006c500 0x7f3d300a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 --2- 172.21.15.89:0/4037976035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d300a41a0 0x7f3d300ae4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 >> 172.21.15.89:0/4037976035 conn(0x7f3d30063580 msgr2=0x7f3d301382a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:33.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 shutdown_connections 2024-02-10T00:06:33.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:33.044+0000 7f3d37eab700 1 -- 172.21.15.89:0/4037976035 wait complete. 2024-02-10T00:06:33.053 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:06:33.059 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-02-10T00:06:32.160077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71847,"ondisk_log_size":71847,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1554164,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1261943,"kb_avail":375933196,"statfs":{"total":386547056640,"available":384955592704,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1292230139},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002615"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192496+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:37.192496+0000","last_peered":"2024-02-10T00:05:37.192496+0000","last_clean":"2024-02-10T00:05:37.192496+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:37.192496+0000","last_undegraded":"2024-02-10T00:05:37.192496+0000","last_fullsized":"2024-02-10T00:05:37.192496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190904+0000","last_change":"2024-02-10T00:04:54.411438+0000","last_active":"2024-02-10T00:05:37.190904+0000","last_peered":"2024-02-10T00:05:37.190904+0000","last_clean":"2024-02-10T00:05:37.190904+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:05:37.190904+0000","last_undegraded":"2024-02-10T00:05:37.190904+0000","last_fullsized":"2024-02-10T00:05:37.190904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":991,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194665+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:37.194665+0000","last_peered":"2024-02-10T00:05:37.194665+0000","last_clean":"2024-02-10T00:05:37.194665+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:37.194665+0000","last_undegraded":"2024-02-10T00:05:37.194665+0000","last_fullsized":"2024-02-10T00:05:37.194665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":898,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189751+0000","last_change":"2024-02-10T00:04:54.393788+0000","last_active":"2024-02-10T00:05:37.189751+0000","last_peered":"2024-02-10T00:05:37.189751+0000","last_clean":"2024-02-10T00:05:37.189751+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:05:37.189751+0000","last_undegraded":"2024-02-10T00:05:37.189751+0000","last_fullsized":"2024-02-10T00:05:37.189751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":973,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191268+0000","last_change":"2024-02-10T00:05:35.175131+0000","last_active":"2024-02-10T00:05:37.191268+0000","last_peered":"2024-02-10T00:05:37.191268+0000","last_clean":"2024-02-10T00:05:37.191268+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:37.191268+0000","last_undegraded":"2024-02-10T00:05:37.191268+0000","last_fullsized":"2024-02-10T00:05:37.191268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":966,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189141+0000","last_change":"2024-02-10T00:04:54.399037+0000","last_active":"2024-02-10T00:05:37.189141+0000","last_peered":"2024-02-10T00:05:37.189141+0000","last_clean":"2024-02-10T00:05:37.189141+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:05:37.189141+0000","last_undegraded":"2024-02-10T00:05:37.189141+0000","last_fullsized":"2024-02-10T00:05:37.189141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1467","reported_seq":1515,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190362+0000","last_change":"2024-02-10T00:04:51.505187+0000","last_active":"2024-02-10T00:05:37.190362+0000","last_peered":"2024-02-10T00:05:37.190362+0000","last_clean":"2024-02-10T00:05:37.190362+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:05:37.190362+0000","last_undegraded":"2024-02-10T00:05:37.190362+0000","last_fullsized":"2024-02-10T00:05:37.190362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":881,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192151+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:37.192151+0000","last_peered":"2024-02-10T00:05:37.192151+0000","last_clean":"2024-02-10T00:05:37.192151+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:37.192151+0000","last_undegraded":"2024-02-10T00:05:37.192151+0000","last_fullsized":"2024-02-10T00:05:37.192151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1172,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191140+0000","last_change":"2024-02-10T00:05:34.141776+0000","last_active":"2024-02-10T00:05:37.191140+0000","last_peered":"2024-02-10T00:05:37.191140+0000","last_clean":"2024-02-10T00:05:37.191140+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:37.191140+0000","last_undegraded":"2024-02-10T00:05:37.191140+0000","last_fullsized":"2024-02-10T00:05:37.191140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":914,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192493+0000","last_change":"2024-02-10T00:04:54.390029+0000","last_active":"2024-02-10T00:05:37.192493+0000","last_peered":"2024-02-10T00:05:37.192493+0000","last_clean":"2024-02-10T00:05:37.192493+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:05:37.192493+0000","last_undegraded":"2024-02-10T00:05:37.192493+0000","last_fullsized":"2024-02-10T00:05:37.192493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'143","reported_seq":187,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194578+0000","last_change":"2024-02-10T00:04:54.358799+0000","last_active":"2024-02-10T00:05:37.194578+0000","last_peered":"2024-02-10T00:05:37.194578+0000","last_clean":"2024-02-10T00:05:37.194578+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:05:37.194578+0000","last_undegraded":"2024-02-10T00:05:37.194578+0000","last_fullsized":"2024-02-10T00:05:37.194578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1071,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192400+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:37.192400+0000","last_peered":"2024-02-10T00:05:37.192400+0000","last_clean":"2024-02-10T00:05:37.192400+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:37.192400+0000","last_undegraded":"2024-02-10T00:05:37.192400+0000","last_fullsized":"2024-02-10T00:05:37.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'660","reported_seq":714,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.192621+0000","last_change":"2024-02-10T00:04:54.385871+0000","last_active":"2024-02-10T00:05:38.192621+0000","last_peered":"2024-02-10T00:05:38.192621+0000","last_clean":"2024-02-10T00:05:38.192621+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:05:38.192621+0000","last_undegraded":"2024-02-10T00:05:38.192621+0000","last_fullsized":"2024-02-10T00:05:38.192621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":946,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193983+0000","last_change":"2024-02-10T00:04:54.371871+0000","last_active":"2024-02-10T00:05:37.193983+0000","last_peered":"2024-02-10T00:05:37.193983+0000","last_clean":"2024-02-10T00:05:37.193983+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:05:37.193983+0000","last_undegraded":"2024-02-10T00:05:37.193983+0000","last_fullsized":"2024-02-10T00:05:37.193983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":983,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190745+0000","last_change":"2024-02-10T00:04:54.387122+0000","last_active":"2024-02-10T00:05:37.190745+0000","last_peered":"2024-02-10T00:05:37.190745+0000","last_clean":"2024-02-10T00:05:37.190745+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:05:37.190745+0000","last_undegraded":"2024-02-10T00:05:37.190745+0000","last_fullsized":"2024-02-10T00:05:37.190745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'355","reported_seq":405,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:00.185906+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:06:00.185906+0000","last_peered":"2024-02-10T00:06:00.185906+0000","last_clean":"2024-02-10T00:06:00.185906+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:06:00.185906+0000","last_undegraded":"2024-02-10T00:06:00.185906+0000","last_fullsized":"2024-02-10T00:06:00.185906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189644+0000","last_change":"2024-02-10T00:04:50.470596+0000","last_active":"2024-02-10T00:05:37.189644+0000","last_peered":"2024-02-10T00:05:37.189644+0000","last_clean":"2024-02-10T00:05:37.189644+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:05:37.189644+0000","last_undegraded":"2024-02-10T00:05:37.189644+0000","last_fullsized":"2024-02-10T00:05:37.189644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.190907+0000","last_change":"2024-02-10T00:04:54.362059+0000","last_active":"2024-02-10T00:05:37.190907+0000","last_peered":"2024-02-10T00:05:37.190907+0000","last_clean":"2024-02-10T00:05:37.190907+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:05:37.190907+0000","last_undegraded":"2024-02-10T00:05:37.190907+0000","last_fullsized":"2024-02-10T00:05:37.190907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'793","reported_seq":839,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189775+0000","last_change":"2024-02-10T00:04:51.498830+0000","last_active":"2024-02-10T00:05:37.189775+0000","last_peered":"2024-02-10T00:05:37.189775+0000","last_clean":"2024-02-10T00:05:37.189775+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:05:37.189775+0000","last_undegraded":"2024-02-10T00:05:37.189775+0000","last_fullsized":"2024-02-10T00:05:37.189775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191171+0000","last_change":"2024-02-10T00:04:54.389460+0000","last_active":"2024-02-10T00:05:37.191171+0000","last_peered":"2024-02-10T00:05:37.191171+0000","last_clean":"2024-02-10T00:05:37.191171+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:05:37.191171+0000","last_undegraded":"2024-02-10T00:05:37.191171+0000","last_fullsized":"2024-02-10T00:05:37.191171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191600+0000","last_change":"2024-02-10T00:04:54.349222+0000","last_active":"2024-02-10T00:05:37.191600+0000","last_peered":"2024-02-10T00:05:37.191600+0000","last_clean":"2024-02-10T00:05:37.191600+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:05:37.191600+0000","last_undegraded":"2024-02-10T00:05:37.191600+0000","last_fullsized":"2024-02-10T00:05:37.191600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:17.644518+0000","last_clean_scrub_stamp":"2024-02-09T23:58:17.644518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189951+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:37.189951+0000","last_peered":"2024-02-10T00:05:37.189951+0000","last_clean":"2024-02-10T00:05:37.189951+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:37.189951+0000","last_undegraded":"2024-02-10T00:05:37.189951+0000","last_fullsized":"2024-02-10T00:05:37.189951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"39'422","reported_seq":472,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192046+0000","last_change":"2024-02-10T00:04:54.354692+0000","last_active":"2024-02-10T00:05:37.192046+0000","last_peered":"2024-02-10T00:05:37.192046+0000","last_clean":"2024-02-10T00:05:37.192046+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:05:37.192046+0000","last_undegraded":"2024-02-10T00:05:37.192046+0000","last_fullsized":"2024-02-10T00:05:37.192046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":997,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191032+0000","last_change":"2024-02-10T00:04:54.398399+0000","last_active":"2024-02-10T00:05:37.191032+0000","last_peered":"2024-02-10T00:05:37.191032+0000","last_clean":"2024-02-10T00:05:37.191032+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:05:37.191032+0000","last_undegraded":"2024-02-10T00:05:37.191032+0000","last_fullsized":"2024-02-10T00:05:37.191032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"40'738","reported_seq":780,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.193868+0000","last_change":"2024-02-10T00:04:50.472318+0000","last_active":"2024-02-10T00:05:37.193868+0000","last_peered":"2024-02-10T00:05:37.193868+0000","last_clean":"2024-02-10T00:05:37.193868+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:05:37.193868+0000","last_undegraded":"2024-02-10T00:05:37.193868+0000","last_fullsized":"2024-02-10T00:05:37.193868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":941,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189670+0000","last_change":"2024-02-10T00:04:51.506290+0000","last_active":"2024-02-10T00:05:37.189670+0000","last_peered":"2024-02-10T00:05:37.189670+0000","last_clean":"2024-02-10T00:05:37.189670+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:05:37.189670+0000","last_undegraded":"2024-02-10T00:05:37.189670+0000","last_fullsized":"2024-02-10T00:05:37.189670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":798,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189851+0000","last_change":"2024-02-10T00:04:51.514617+0000","last_active":"2024-02-10T00:05:37.189851+0000","last_peered":"2024-02-10T00:05:37.189851+0000","last_clean":"2024-02-10T00:05:37.189851+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:05:37.189851+0000","last_undegraded":"2024-02-10T00:05:37.189851+0000","last_fullsized":"2024-02-10T00:05:37.189851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":19986,"ondisk_log_size":19986,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986198,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423836,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":325593,"kb_avail":93948004,"statfs":{"total":96636764160,"available":96202756096,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":333407871},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.5},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.437}]},{"osd":2,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.53400000000000003}]}]},{"osd":2,"up_from":29,"seq":124554051606,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Feb 10 00:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.39000000000000001}]}]},{"osd":0,"up_from":28,"seq":120259084310,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30499999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:05:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Feb 10 00:05:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.34300000000000003}]}]},{"osd":1,"up_from":28,"seq":120259084310,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.312},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:06:33.065 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.065 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.065 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.065 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.065 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.066 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.067 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-09T23:58:17.644518+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.068 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.069 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.069 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.069 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.069 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:33.069 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:06:53.071 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 Processor -- start 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 -- start start 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11580a6fd0 0x7f115813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 0x7f11581458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11580a62d0 con 0x7f1158063e50 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1158064220 con 0x7f11580a6fd0 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115ea10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580a67f0 con 0x7f115813bc00 2024-02-10T00:06:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f11577fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11580a6fd0 0x7f115813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f115cfad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 0x7f11581458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11580a6fd0 0x7f115813b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52616/0 (socket says 172.21.15.89:52616) 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 -- 172.21.15.89:0/3645062086 learned_addr learned my addr 172.21.15.89:0/3645062086 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.199+0000 7f1157fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1158063e50 0x7f11580a5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45604/0 (socket says 172.21.15.89:45604) 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 -- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 msgr2=0x7f11581458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 0x7f11581458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 -- 172.21.15.89:0/3645062086 >> v1:172.21.15.89:6789/0 conn(0x7f1158063e50 legacy=0x7f11580a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 -- 172.21.15.89:0/3645062086 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580a6030 con 0x7f11580a6fd0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f1156ffd700 1 -- 172.21.15.89:0/3645062086 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384856425 0 0) 0x7f11580a62d0 con 0x7f1158063e50 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f115cfad700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 0x7f11581458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f11577fe700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11580a6fd0 0x7f115813b6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f114c0099b0 tx=0x7f114c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baca83a59fff50b server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f1156ffd700 1 -- 172.21.15.89:0/3645062086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c009ea0 con 0x7f11580a6fd0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f1156ffd700 1 -- 172.21.15.89:0/3645062086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00b860 con 0x7f11580a6fd0 2024-02-10T00:06:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.200+0000 7f1156ffd700 1 -- 172.21.15.89:0/3645062086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00bc00 con 0x7f11580a6fd0 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 -- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11580a6fd0 msgr2=0x7f115813b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11580a6fd0 0x7f115813b6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f114c0099b0 tx=0x7f114c009250 comp rx=0 tx=0).stop 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 -- 172.21.15.89:0/3645062086 shutdown_connections 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f115813bc00 0x7f11581458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 --2- 172.21.15.89:0/3645062086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11580a6fd0 0x7f115813b6c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 -- 172.21.15.89:0/3645062086 >> 172.21.15.89:0/3645062086 conn(0x7f115806c7c0 msgr2=0x7f1158063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 -- 172.21.15.89:0/3645062086 shutdown_connections 2024-02-10T00:06:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.201+0000 7f115ea10700 1 -- 172.21.15.89:0/3645062086 wait complete. 2024-02-10T00:06:53.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 Processor -- start 2024-02-10T00:06:53.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 -- start start 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 0x7f115814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f115813bc00 0x7f115814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580adf30 con 0x7f1158063e50 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580acbf0 con 0x7f11580a6fd0 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f115ea10700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11580aaee0 con 0x7f115813bc00 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.202+0000 7f1157fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f11577fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 0x7f115814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52632/0 (socket says 172.21.15.89:52632) 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 -- 172.21.15.89:0/2913870514 learned_addr learned my addr 172.21.15.89:0/2913870514 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f115cfad700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f115813bc00 0x7f115814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 -- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f115813bc00 msgr2=0x7f115814a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f115813bc00 0x7f115814a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 -- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 msgr2=0x7f115814a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 0x7f115814a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 -- 172.21.15.89:0/2913870514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009a20 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f11577fe700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 0x7f115814a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f1157fff700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f114800c810 tx=0x7f1148007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148005b40 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148005cc0 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c0094f0 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148007320 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.203+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11580acdb0 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.204+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11580ab5a0 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.204+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f114801b3b0 con 0x7f1158063e50 2024-02-10T00:06:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.204+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f114805a5f0 con 0x7f1158063e50 2024-02-10T00:06:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.208+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f1148038890 con 0x7f1158063e50 2024-02-10T00:06:53.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.358+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f115804c710 con 0x7f1144045f20 2024-02-10T00:06:53.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.365+0000 7f113ffff700 1 -- 172.21.15.89:0/2913870514 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280202 (unknown 2965378022 0 1127846135) 0x7f115804c710 con 0x7f1144045f20 2024-02-10T00:06:53.371 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:06:53.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.367+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 >> v1:172.21.15.89:6816/47970 conn(0x7f1144045f20 legacy=0x7f11440483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 msgr2=0x7f11580ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:06:53.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f114800c810 tx=0x7f1148007d90 comp rx=0 tx=0).stop 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 shutdown_connections 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f115813bc00 0x7f115814a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158063e50 0x7f11580ac220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 --2- 172.21.15.89:0/2913870514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11580a6fd0 0x7f115814a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 >> 172.21.15.89:0/2913870514 conn(0x7f115806c7c0 msgr2=0x7f1158067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 shutdown_connections 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:06:53.368+0000 7f115ea10700 1 -- 172.21.15.89:0/2913870514 wait complete. 2024-02-10T00:06:53.375 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:06:53.381 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-02-10T00:06:52.165450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71864,"ondisk_log_size":71864,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003061"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192496+0000","last_change":"2024-02-10T00:04:54.408383+0000","last_active":"2024-02-10T00:05:37.192496+0000","last_peered":"2024-02-10T00:05:37.192496+0000","last_clean":"2024-02-10T00:05:37.192496+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:05:37.192496+0000","last_undegraded":"2024-02-10T00:05:37.192496+0000","last_fullsized":"2024-02-10T00:05:37.192496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":991,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194665+0000","last_change":"2024-02-10T00:04:54.403007+0000","last_active":"2024-02-10T00:05:37.194665+0000","last_peered":"2024-02-10T00:05:37.194665+0000","last_clean":"2024-02-10T00:05:37.194665+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:05:37.194665+0000","last_undegraded":"2024-02-10T00:05:37.194665+0000","last_fullsized":"2024-02-10T00:05:37.194665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":973,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191268+0000","last_change":"2024-02-10T00:05:35.175131+0000","last_active":"2024-02-10T00:05:37.191268+0000","last_peered":"2024-02-10T00:05:37.191268+0000","last_clean":"2024-02-10T00:05:37.191268+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:05:37.191268+0000","last_undegraded":"2024-02-10T00:05:37.191268+0000","last_fullsized":"2024-02-10T00:05:37.191268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":881,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192151+0000","last_change":"2024-02-10T00:04:54.400193+0000","last_active":"2024-02-10T00:05:37.192151+0000","last_peered":"2024-02-10T00:05:37.192151+0000","last_clean":"2024-02-10T00:05:37.192151+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:05:37.192151+0000","last_undegraded":"2024-02-10T00:05:37.192151+0000","last_fullsized":"2024-02-10T00:05:37.192151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1114","reported_seq":1172,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191140+0000","last_change":"2024-02-10T00:05:34.141776+0000","last_active":"2024-02-10T00:05:37.191140+0000","last_peered":"2024-02-10T00:05:37.191140+0000","last_clean":"2024-02-10T00:05:37.191140+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:05:37.191140+0000","last_undegraded":"2024-02-10T00:05:37.191140+0000","last_fullsized":"2024-02-10T00:05:37.191140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1071,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.192400+0000","last_change":"2024-02-10T00:04:54.407791+0000","last_active":"2024-02-10T00:05:37.192400+0000","last_peered":"2024-02-10T00:05:37.192400+0000","last_clean":"2024-02-10T00:05:37.192400+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:05:37.192400+0000","last_undegraded":"2024-02-10T00:05:37.192400+0000","last_fullsized":"2024-02-10T00:05:37.192400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'355","reported_seq":405,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:00.185906+0000","last_change":"2024-02-10T00:04:54.412855+0000","last_active":"2024-02-10T00:06:00.185906+0000","last_peered":"2024-02-10T00:06:00.185906+0000","last_clean":"2024-02-10T00:06:00.185906+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:06:00.185906+0000","last_undegraded":"2024-02-10T00:06:00.185906+0000","last_fullsized":"2024-02-10T00:06:00.185906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.189951+0000","last_change":"2024-02-10T00:04:51.515011+0000","last_active":"2024-02-10T00:05:37.189951+0000","last_peered":"2024-02-10T00:05:37.189951+0000","last_clean":"2024-02-10T00:05:37.189951+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:05:37.189951+0000","last_undegraded":"2024-02-10T00:05:37.189951+0000","last_fullsized":"2024-02-10T00:05:37.189951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:25.996854+0000","last_clean_scrub_stamp":"2024-02-09T23:58:25.996854+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20003,"ondisk_log_size":20003,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986202,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.309},{"interface":"front","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:05:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.374},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34200000000000003}]}]},{"osd":2,"up_from":29,"seq":124554051610,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Feb 10 00:05:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:05:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.441}]}]},{"osd":0,"up_from":28,"seq":120259084314,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.505}]},{"osd":2,"last update":"Sat Feb 10 00:05:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:05:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.48499999999999999}]}]},{"osd":1,"up_from":28,"seq":120259084314,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Feb 10 00:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:06:53.387 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.387 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.387 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.388 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.388 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.388 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.388 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.388 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.389 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.389 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.389 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-09T23:58:25.996854+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=25, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:06:53.389 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:07:13.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:07:13.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.519+0000 7ff491977700 1 Processor -- start 2024-02-10T00:07:13.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.519+0000 7ff491977700 1 -- start start 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff491977700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff491977700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff48c0a4210 0x7ff48c13e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff491977700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0a4cd0 con 0x7ff48c06fd20 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff491977700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c0a5cb0 con 0x7ff48c0a4210 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff491977700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c06e0f0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48affd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:13.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48a7fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff48c06fd20 0x7ff48c06cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42506/0 (socket says 172.21.15.89:42506) 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff48c0a4210 0x7ff48c13e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48a7fc700 1 -- 172.21.15.89:0/3343975841 learned_addr learned my addr 172.21.15.89:0/3343975841 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 -- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 msgr2=0x7ff48c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c13e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 -- 172.21.15.89:0/3343975841 >> v1:172.21.15.89:6789/0 conn(0x7ff48c06fd20 legacy=0x7ff48c06cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 -- 172.21.15.89:0/3343975841 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0a49f0 con 0x7ff48c0a4210 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff489ffb700 1 -- 172.21.15.89:0/3343975841 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533637308 0 0) 0x7ff48c0a4cd0 con 0x7ff48c06fd20 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48affd700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff48b7fe700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c13e8e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d0d0 tx=0x7ff48400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1dbb3d616b6774 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff489ffb700 1 -- 172.21.15.89:0/3343975841 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484010070 con 0x7ff48c0a4210 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff489ffb700 1 -- 172.21.15.89:0/3343975841 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48400b2e0 con 0x7ff48c0a4210 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.520+0000 7ff489ffb700 1 -- 172.21.15.89:0/3343975841 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400dd80 con 0x7ff48c0a4210 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 -- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 msgr2=0x7ff48c13e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c13e8e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d0d0 tx=0x7ff48400b990 comp rx=0 tx=0).stop 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 -- 172.21.15.89:0/3343975841 shutdown_connections 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c13e8e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 --2- 172.21.15.89:0/3343975841 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 -- 172.21.15.89:0/3343975841 >> 172.21.15.89:0/3343975841 conn(0x7ff48c063580 msgr2=0x7ff48c063950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 -- 172.21.15.89:0/3343975841 shutdown_connections 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.521+0000 7ff491977700 1 -- 172.21.15.89:0/3343975841 wait complete. 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.522+0000 7ff491977700 1 Processor -- start 2024-02-10T00:07:13.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.522+0000 7ff491977700 1 -- start start 2024-02-10T00:07:13.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 0x7ff48c098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:13.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:13.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c14da70 con 0x7ff48c0a4210 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c099270 con 0x7ff48c06fd20 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff491977700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0994a0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48a7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 0x7ff48c098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48a7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37210/0 (socket says 172.21.15.89:37210) 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48a7fc700 1 -- 172.21.15.89:0/943934297 learned_addr learned my addr 172.21.15.89:0/943934297 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:46146/0 (socket says 172.21.15.89:46146) 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48affd700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 0x7ff48c098580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42900/0 (socket says 172.21.15.89:42900) 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 -- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 msgr2=0x7ff48c098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 0x7ff48c098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 -- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 msgr2=0x7ff48c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 -- 172.21.15.89:0/943934297 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009420 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff48b7fe700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff484017000 tx=0x7ff48401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.523+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400deb0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.524+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4840092a0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.524+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48400bc30 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.524+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48401e690 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.524+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c098ac0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.524+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7ff484003040 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.525+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7ff48405cfe0 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.525+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c097540 con 0x7ff48c0a58e0 2024-02-10T00:07:13.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.529+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7ff48c097540 con 0x7ff48c0a58e0 2024-02-10T00:07:13.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.678+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff48c097540 con 0x7ff478045f20 2024-02-10T00:07:13.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.685+0000 7ff472ffd700 1 -- 172.21.15.89:0/943934297 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280846 (unknown 2965378022 0 4215909424) 0x7ff48c097540 con 0x7ff478045f20 2024-02-10T00:07:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:07:13.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 >> v1:172.21.15.89:6816/47970 conn(0x7ff478045f20 legacy=0x7ff4780483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 msgr2=0x7ff48c14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:13.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff484017000 tx=0x7ff48401a000 comp rx=0 tx=0).stop 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 shutdown_connections 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7ff48c0a58e0 0x7ff48c14df20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48c06fd20 0x7ff48c098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 --2- 172.21.15.89:0/943934297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff48c0a4210 0x7ff48c099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 >> 172.21.15.89:0/943934297 conn(0x7ff48c063580 msgr2=0x7ff48c0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 shutdown_connections 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:13.688+0000 7ff491977700 1 -- 172.21.15.89:0/943934297 wait complete. 2024-02-10T00:07:13.694 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:07:13.701 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-02-10T00:07:12.170684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003221"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986206,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.504,"15min":0.504},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.32900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.51100000000000001}]}]},{"osd":2,"up_from":29,"seq":124554051614,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.309,"15min":0.30399999999999999},"min":{"1min":0.251,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.28599999999999998,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34100000000000003},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.308,"5min":0.222,"15min":0.222},"max":{"1min":0.505,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:06:55 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.374,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35299999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084318,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45000000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52000000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.48899999999999999,"5min":0.497,"15min":0.497},"last":0.34899999999999998}]}]},{"osd":1,"up_from":28,"seq":120259084318,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.317,"15min":0.312},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44800000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.318,"15min":0.309},"min":{"1min":0.28399999999999997,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.32400000000000001},"min":{"1min":0.26800000000000002,"5min":0.187,"15min":0.187},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.316,"5min":0.219,"15min":0.219},"max":{"1min":0.504,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.497}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.35299999999999998},"min":{"1min":0.31,"5min":0.224,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.38},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:07:13.708 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:13.709 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:13.709 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:13.710 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:07:33.712 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:07:33.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 Processor -- start 2024-02-10T00:07:33.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 -- start start 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd530063740 0x7fd53006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd53006ce70 0x7fd530141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300a28c0 con 0x7fd53006d260 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300a1130 con 0x7fd530063740 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.838+0000 7fd53762d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd530063b10 con 0x7fd53006ce70 2024-02-10T00:07:33.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd534bc8700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd53006ce70 0x7fd530141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd530063740 0x7fd53006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd535bca700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd53006d260 0x7fd530142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39768/0 (socket says 172.21.15.89:39768) 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd535bca700 1 -- 172.21.15.89:0/283452119 learned_addr learned my addr 172.21.15.89:0/283452119 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 -- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd53006ce70 msgr2=0x7fd530141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 --2- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd53006ce70 0x7fd530141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 -- 172.21.15.89:0/283452119 >> v1:172.21.15.89:6789/0 conn(0x7fd53006d260 legacy=0x7fd530142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 -- 172.21.15.89:0/283452119 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530141ba0 con 0x7fd530063740 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd5353c9700 1 --2- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd530063740 0x7fd53006e1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0098e0 tx=0x7fd52c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6068810ad83f57ab server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd527fff700 1 -- 172.21.15.89:0/283452119 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00b640 con 0x7fd530063740 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd527fff700 1 -- 172.21.15.89:0/283452119 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00b7a0 con 0x7fd530063740 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.839+0000 7fd527fff700 1 -- 172.21.15.89:0/283452119 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00bb40 con 0x7fd530063740 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 -- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd530063740 msgr2=0x7fd53006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 --2- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd530063740 0x7fd53006e1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0098e0 tx=0x7fd52c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 -- 172.21.15.89:0/283452119 shutdown_connections 2024-02-10T00:07:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 --2- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd530063740 0x7fd53006e1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 --2- 172.21.15.89:0/283452119 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd53006ce70 0x7fd530141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 -- 172.21.15.89:0/283452119 >> 172.21.15.89:0/283452119 conn(0x7fd53006a820 msgr2=0x7fd5300b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 -- 172.21.15.89:0/283452119 shutdown_connections 2024-02-10T00:07:33.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.840+0000 7fd53762d700 1 -- 172.21.15.89:0/283452119 wait complete. 2024-02-10T00:07:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.841+0000 7fd53762d700 1 Processor -- start 2024-02-10T00:07:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.841+0000 7fd53762d700 1 -- start start 2024-02-10T00:07:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 0x7fd53013e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:33.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd53006d260 0x7fd530151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53013eb70 con 0x7fd53006ce70 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300b0570 con 0x7fd53006d260 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd53013df60 con 0x7fd530063740 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39062/0 (socket says 172.21.15.89:39062) 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 -- 172.21.15.89:0/1988211849 learned_addr learned my addr 172.21.15.89:0/1988211849 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd535bca700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd53006d260 0x7fd530151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd5353c9700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 0x7fd53013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 -- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 msgr2=0x7fd53013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 0x7fd53013e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 -- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd53006d260 msgr2=0x7fd530151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd53006d260 0x7fd530151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:33.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 -- 172.21.15.89:0/1988211849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009420 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd5353c9700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 0x7fd53013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd534bc8700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ec80 tx=0x7fd5200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000c850 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52000c9b0 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53013bbf0 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000cd50 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.842+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd530147a00 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.843+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fd520013680 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.843+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53013f8f0 con 0x7fd53006ce70 2024-02-10T00:07:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.844+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7fd52005b3f0 con 0x7fd53006ce70 2024-02-10T00:07:33.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.847+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fd520039630 con 0x7fd53006ce70 2024-02-10T00:07:33.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:33.995+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd53004c710 con 0x7fd514045f20 2024-02-10T00:07:34.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.002+0000 7fd5257fa700 1 -- 172.21.15.89:0/1988211849 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280845 (unknown 2965378022 0 1352835777) 0x7fd53004c710 con 0x7fd514045f20 2024-02-10T00:07:34.008 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 >> v1:172.21.15.89:6816/47970 conn(0x7fd514045f20 legacy=0x7fd5140483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 msgr2=0x7fd5301510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ec80 tx=0x7fd5200091a0 comp rx=0 tx=0).stop 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 shutdown_connections 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd53006d260 0x7fd530151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fd530063740 0x7fd53013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 --2- 172.21.15.89:0/1988211849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd53006ce70 0x7fd5301510e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 >> 172.21.15.89:0/1988211849 conn(0x7fd53006a820 msgr2=0x7fd53006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 shutdown_connections 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:34.005+0000 7fd53762d700 1 -- 172.21.15.89:0/1988211849 wait complete. 2024-02-10T00:07:34.011 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:07:34.018 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-02-10T00:07:32.175548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002914"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986210,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.504,"15min":0.504},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.32900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36699999999999999}]}]},{"osd":2,"up_from":29,"seq":124554051618,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.309,"15min":0.30399999999999999},"min":{"1min":0.251,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.28599999999999998,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34100000000000003},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.308,"5min":0.222,"15min":0.222},"max":{"1min":0.505,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Sat Feb 10 00:06:55 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.374,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40400000000000003}]}]},{"osd":0,"up_from":28,"seq":120259084322,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45000000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.432},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52000000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.48899999999999999,"5min":0.497,"15min":0.497},"last":0.38300000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084322,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.317,"15min":0.312},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44800000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.318,"15min":0.309},"min":{"1min":0.28399999999999997,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.32400000000000001},"min":{"1min":0.26800000000000002,"5min":0.187,"15min":0.187},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.316,"5min":0.219,"15min":0.219},"max":{"1min":0.504,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.35299999999999998},"min":{"1min":0.31,"5min":0.224,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.38},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.38},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:07:34.025 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:34.025 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:34.025 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:34.026 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:07:54.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:07:54.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.154+0000 7f939b07c700 1 Processor -- start 2024-02-10T00:07:54.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.154+0000 7f939b07c700 1 -- start start 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f939b07c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 0x7f939413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f939b07c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f939b07c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9394064220 con 0x7f9394063e50 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f939b07c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939413f7c0 con 0x7f9394140410 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f939b07c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939413fa80 con 0x7f93940a80c0 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9399619700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 0x7f939413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9398e18700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9394063e50 0x7f93940a6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45940/0 (socket says 172.21.15.89:45940) 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9399619700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58362/0 (socket says 172.21.15.89:58362) 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9399619700 1 -- 172.21.15.89:0/2245609597 learned_addr learned my addr 172.21.15.89:0/2245609597 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 -- 172.21.15.89:0/2245609597 >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 msgr2=0x7f9394146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:07:54.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 --2- 172.21.15.89:0/2245609597 >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 -- 172.21.15.89:0/2245609597 >> v1:172.21.15.89:6789/0 conn(0x7f9394063e50 legacy=0x7f93940a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 -- 172.21.15.89:0/2245609597 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940a6820 con 0x7f93940a80c0 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f93937fe700 1 -- 172.21.15.89:0/2245609597 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724781214 0 0) 0x7f9394064220 con 0x7f9394063e50 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9399619700 1 --2- 172.21.15.89:0/2245609597 >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f9393fff700 1 --2- 172.21.15.89:0/2245609597 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 0x7f939413fed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93800098e0 tx=0x7f93800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6405b68bd64418d server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f93937fe700 1 -- 172.21.15.89:0/2245609597 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000b6d0 con 0x7f93940a80c0 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f93937fe700 1 -- 172.21.15.89:0/2245609597 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938000b830 con 0x7f93940a80c0 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.155+0000 7f93937fe700 1 -- 172.21.15.89:0/2245609597 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000bbd0 con 0x7f93940a80c0 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 -- 172.21.15.89:0/2245609597 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 msgr2=0x7f939413fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 --2- 172.21.15.89:0/2245609597 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 0x7f939413fed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93800098e0 tx=0x7f93800091a0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 -- 172.21.15.89:0/2245609597 shutdown_connections 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 --2- 172.21.15.89:0/2245609597 >> v2:172.21.15.89:3300/0 conn(0x7f9394140410 0x7f9394146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 --2- 172.21.15.89:0/2245609597 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f93940a80c0 0x7f939413fed0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 -- 172.21.15.89:0/2245609597 >> 172.21.15.89:0/2245609597 conn(0x7f939406c7c0 msgr2=0x7f9394063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:54.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 -- 172.21.15.89:0/2245609597 shutdown_connections 2024-02-10T00:07:54.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.156+0000 7f939b07c700 1 -- 172.21.15.89:0/2245609597 wait complete. 2024-02-10T00:07:54.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.157+0000 7f939b07c700 1 Processor -- start 2024-02-10T00:07:54.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 -- start start 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 0x7f93940a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940ae270 con 0x7f9394140410 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940adab0 con 0x7f93940a80c0 2024-02-10T00:07:54.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f939b07c700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939414f4c0 con 0x7f9394063e50 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9398e18700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9399619700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9398e18700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:50586/0 (socket says 172.21.15.89:50586) 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9399619700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58376/0 (socket says 172.21.15.89:58376) 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9398e18700 1 -- 172.21.15.89:0/3337690130 learned_addr learned my addr 172.21.15.89:0/3337690130 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.158+0000 7f9393fff700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 0x7f93940a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 -- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 msgr2=0x7f93940ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 -- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 msgr2=0x7f93940a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 0x7f93940a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 -- 172.21.15.89:0/3337690130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c009ae0 con 0x7f9394140410 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9398e18700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:07:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9393fff700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 0x7f93940a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9399619700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f938c009e40 tx=0x7f938c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c018070 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00f040 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9380009420 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00cac0 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.159+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93940aecf0 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.160+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f938c003020 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.160+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939404c710 con 0x7f9394140410 2024-02-10T00:07:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.160+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f938c05aef0 con 0x7f9394140410 2024-02-10T00:07:54.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.164+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f938c038db0 con 0x7f9394140410 2024-02-10T00:07:54.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.314+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93940ae3b0 con 0x7f9378045f20 2024-02-10T00:07:54.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.321+0000 7f9390ff9700 1 -- 172.21.15.89:0/3337690130 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280845 (unknown 2965378022 0 95459274) 0x7f9388001810 con 0x7f9378045f20 2024-02-10T00:07:54.327 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:07:54.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 >> v1:172.21.15.89:6816/47970 conn(0x7f9378045f20 legacy=0x7f93780483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 msgr2=0x7f93940a92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f938c009e40 tx=0x7f938c00b040 comp rx=0 tx=0).stop 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 shutdown_connections 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9394140410 0x7f93940a92b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f9394063e50 0x7f93940ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 --2- 172.21.15.89:0/3337690130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93940a80c0 0x7f93940a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 >> 172.21.15.89:0/3337690130 conn(0x7f939406c7c0 msgr2=0x7f93940b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 shutdown_connections 2024-02-10T00:07:54.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:07:54.324+0000 7f939b07c700 1 -- 172.21.15.89:0/3337690130 wait complete. 2024-02-10T00:07:54.331 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:07:54.337 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-02-10T00:07:54.181214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002712"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986214,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.314},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45300000000000001,"5min":0.504,"15min":0.504},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:07:00 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.32900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53400000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33600000000000002}]}]},{"osd":2,"up_from":29,"seq":124554051622,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.309,"15min":0.30399999999999999},"min":{"1min":0.251,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.318},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.28599999999999998,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29899999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34100000000000003},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.308,"5min":0.222,"15min":0.222},"max":{"1min":0.505,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:06:55 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.38},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.374,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084327,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:06:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45000000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.34000000000000002,"15min":0.33000000000000002},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52000000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.48899999999999999,"5min":0.497,"15min":0.497},"last":0.44400000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084327,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.317,"15min":0.312},"min":{"1min":0.26200000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44800000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.318,"15min":0.309},"min":{"1min":0.28399999999999997,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Feb 10 00:06:53 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.32400000000000001},"min":{"1min":0.26800000000000002,"5min":0.187,"15min":0.187},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.316,"5min":0.219,"15min":0.219},"max":{"1min":0.504,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:06:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.35299999999999998},"min":{"1min":0.31,"5min":0.224,"15min":0.224},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.38},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:07:54.343 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:54.343 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:54.344 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:07:54.344 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:08:14.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:08:14.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.476+0000 7f8876b52700 1 Processor -- start 2024-02-10T00:08:14.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.476+0000 7f8876b52700 1 -- start start 2024-02-10T00:08:14.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f8876b52700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 0x7f88700a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f8876b52700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88700a5130 0x7f88700a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f8876b52700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870063b10 con 0x7f8870063740 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f8876b52700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870139bb0 con 0x7f88700a5130 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f8876b52700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700a2100 con 0x7f887013f6e0 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f886ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 0x7f88700a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88748ee700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8870063740 0x7f887013fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37482/0 (socket says 172.21.15.89:37482) 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88748ee700 1 -- 172.21.15.89:0/2908306449 learned_addr learned my addr 172.21.15.89:0/2908306449 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88700a5130 0x7f88700a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 -- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 msgr2=0x7f88700a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 0x7f88700a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 -- 172.21.15.89:0/2908306449 >> v1:172.21.15.89:6789/0 conn(0x7f8870063740 legacy=0x7f887013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 -- 172.21.15.89:0/2908306449 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887013fb70 con 0x7f88700a5130 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f886f7fe700 1 -- 172.21.15.89:0/2908306449 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742045432 0 0) 0x7f8870063b10 con 0x7f8870063740 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f886ffff700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 0x7f88700a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f88750ef700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88700a5130 0x7f88700a29a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8868009e60 tx=0x7f8868009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871d5a6693c0eb44 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.477+0000 7f886f7fe700 1 -- 172.21.15.89:0/2908306449 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800e070 con 0x7f88700a5130 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f886f7fe700 1 -- 172.21.15.89:0/2908306449 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800bbf0 con 0x7f88700a5130 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f886f7fe700 1 -- 172.21.15.89:0/2908306449 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868012430 con 0x7f88700a5130 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 -- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88700a5130 msgr2=0x7f88700a29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88700a5130 0x7f88700a29a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8868009e60 tx=0x7f8868009780 comp rx=0 tx=0).stop 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 -- 172.21.15.89:0/2908306449 shutdown_connections 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88700a5130 0x7f88700a29a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 --2- 172.21.15.89:0/2908306449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f887013f6e0 0x7f88700a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 -- 172.21.15.89:0/2908306449 >> 172.21.15.89:0/2908306449 conn(0x7f887006a820 msgr2=0x7f88700b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:14.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 -- 172.21.15.89:0/2908306449 shutdown_connections 2024-02-10T00:08:14.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.478+0000 7f8876b52700 1 -- 172.21.15.89:0/2908306449 wait complete. 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.479+0000 7f8876b52700 1 Processor -- start 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.479+0000 7f8876b52700 1 -- start start 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 0x7f88700a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f887013f6e0 0x7f887014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870141ca0 con 0x7f8870063740 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700a6520 con 0x7f88700a5130 2024-02-10T00:08:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88700a7190 con 0x7f887013f6e0 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f88748ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 0x7f88700a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f88748ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 0x7f88700a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38626/0 (socket says 172.21.15.89:38626) 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f88748ee700 1 -- 172.21.15.89:0/320620846 learned_addr learned my addr 172.21.15.89:0/320620846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:48230/0 (socket says 172.21.15.89:48230) 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f88750ef700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f887013f6e0 0x7f887014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 -- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f887013f6e0 msgr2=0x7f887014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f887013f6e0 0x7f887014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 -- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 msgr2=0x7f88700a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 0x7f88700a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 -- 172.21.15.89:0/320620846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009420 con 0x7f88700a5130 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886ffff700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f885c00ea30 tx=0x7f885c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:14.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00ee70 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00c850 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868009a20 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.480+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00cbf0 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.481+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870144cd0 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.481+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f885c013470 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.481+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887004c710 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.482+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f885c05b320 con 0x7f88700a5130 2024-02-10T00:08:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.485+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f885c039500 con 0x7f88700a5130 2024-02-10T00:08:14.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.633+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8870144f50 con 0x7f8854045f50 2024-02-10T00:08:14.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.641+0000 7f886cff9700 1 -- 172.21.15.89:0/320620846 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280816 (unknown 2965378022 0 948052794) 0x7f8870144f50 con 0x7f8854045f50 2024-02-10T00:08:14.646 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 >> v1:172.21.15.89:6816/47970 conn(0x7f8854045f50 legacy=0x7f8854048400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 msgr2=0x7f8870144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f885c00ea30 tx=0x7f885c0091a0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 shutdown_connections 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f887013f6e0 0x7f887014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8870063740 0x7f88700a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 --2- 172.21.15.89:0/320620846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88700a5130 0x7f8870144790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:14.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 >> 172.21.15.89:0/320620846 conn(0x7f887006a820 msgr2=0x7f88700680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:14.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 shutdown_connections 2024-02-10T00:08:14.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:14.643+0000 7f8876b52700 1 -- 172.21.15.89:0/320620846 wait complete. 2024-02-10T00:08:14.650 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:08:14.657 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-02-10T00:08:14.186239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986218,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.39700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33700000000000002,"15min":0.32900000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41499999999999998,"5min":0.5,"15min":0.5},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.48299999999999998,"5min":0.504,"15min":0.504},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.317},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38}]}]},{"osd":2,"up_from":29,"seq":124554051626,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.438,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.47799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29299999999999998}]},{"osd":1,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.498,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.316}]},{"osd":3,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.35999999999999999},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.51700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33900000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084331,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.25,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.32300000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45500000000000002,"5min":0.505,"15min":0.505},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27900000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.45100000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Feb 10 00:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.31,"5min":0.25,"15min":0.25},"max":{"1min":0.47899999999999998,"5min":0.497,"15min":0.497},"last":0.374}]}]},{"osd":1,"up_from":28,"seq":120259084331,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.312},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.311},"min":{"1min":0.24299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34100000000000003,"15min":0.32600000000000001},"min":{"1min":0.25700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.34200000000000003},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.497,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Feb 10 00:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51100000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:08:14.663 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:14.663 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:14.663 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:14.664 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:08:34.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.792+0000 7fb7753b2700 1 Processor -- start 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 -- start start 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb77013e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7700ab6b0 0x7fb77013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77013e400 con 0x7fb770063c90 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77013e6a0 con 0x7fb7700ab6b0 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb7753b2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb77006ff40 con 0x7fb770069370 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb76e7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb77013e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb76f7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7700ab6b0 0x7fb77013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:34.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb76effd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb770063c90 0x7fb77006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37154/0 (socket says 172.21.15.89:37154) 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.793+0000 7fb76effd700 1 -- 172.21.15.89:0/3947832086 learned_addr learned my addr 172.21.15.89:0/3947832086 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76f7fe700 1 -- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 msgr2=0x7fb77013e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76f7fe700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb77013e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76f7fe700 1 -- 172.21.15.89:0/3947832086 >> v1:172.21.15.89:6789/0 conn(0x7fb770063c90 legacy=0x7fb77006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76f7fe700 1 -- 172.21.15.89:0/3947832086 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77006a8b0 con 0x7fb7700ab6b0 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76dffb700 1 -- 172.21.15.89:0/3947832086 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586752042 0 0) 0x7fb77013e400 con 0x7fb770063c90 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76e7fc700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb77013e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76f7fe700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb77013ee90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e60 tx=0x7fb768009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7581c524df66ac79 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76dffb700 1 -- 172.21.15.89:0/3947832086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800e070 con 0x7fb7700ab6b0 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76dffb700 1 -- 172.21.15.89:0/3947832086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76800bb60 con 0x7fb7700ab6b0 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb76dffb700 1 -- 172.21.15.89:0/3947832086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768012430 con 0x7fb7700ab6b0 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 -- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 msgr2=0x7fb77013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb77013ee90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e60 tx=0x7fb768009780 comp rx=0 tx=0).stop 2024-02-10T00:08:34.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 -- 172.21.15.89:0/3947832086 shutdown_connections 2024-02-10T00:08:34.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb77013ee90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 --2- 172.21.15.89:0/3947832086 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb77013e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 -- 172.21.15.89:0/3947832086 >> 172.21.15.89:0/3947832086 conn(0x7fb77006d8c0 msgr2=0x7fb770063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:34.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.794+0000 7fb7753b2700 1 -- 172.21.15.89:0/3947832086 shutdown_connections 2024-02-10T00:08:34.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.795+0000 7fb7753b2700 1 -- 172.21.15.89:0/3947832086 wait complete. 2024-02-10T00:08:34.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 Processor -- start 2024-02-10T00:08:34.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 -- start start 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 0x7fb770151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb7700adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7701446a0 con 0x7fb7700ab6b0 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb770151dc0 con 0x7fb770063c90 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb7753b2700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb770145360 con 0x7fb770069370 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb76e7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb76effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 0x7fb770151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb76e7fc700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:40756/0 (socket says 172.21.15.89:40756) 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb76f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb7700adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.796+0000 7fb76e7fc700 1 -- 172.21.15.89:0/4856715 learned_addr learned my addr 172.21.15.89:0/4856715 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 -- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 msgr2=0x7fb770151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 0x7fb770151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 -- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 msgr2=0x7fb7700adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb7700adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 -- 172.21.15.89:0/4856715 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009420 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76f7fe700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb7700adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76effd700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 0x7fb770151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb76e7fc700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb76000ec80 tx=0x7fb7600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76000c920 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76000ca80 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb768009a20 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76000ce00 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.797+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb770143690 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.798+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77004c710 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.798+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fb760013680 con 0x7fb770069370 2024-02-10T00:08:34.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.798+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7fb76005b8a0 con 0x7fb770069370 2024-02-10T00:08:34.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.802+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7fb760039a80 con 0x7fb770069370 2024-02-10T00:08:34.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.950+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb770064060 con 0x7fb75c045f20 2024-02-10T00:08:34.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.957+0000 7fb756ffd700 1 -- 172.21.15.89:0/4856715 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280860 (unknown 2965378022 0 3221350817) 0x7fb770064060 con 0x7fb75c045f20 2024-02-10T00:08:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 >> v1:172.21.15.89:6816/47970 conn(0x7fb75c045f20 legacy=0x7fb75c0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 msgr2=0x7fb770151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb76000ec80 tx=0x7fb7600091a0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 shutdown_connections 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7700ab6b0 0x7fb7700adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb770063c90 0x7fb770151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 --2- 172.21.15.89:0/4856715 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fb770069370 0x7fb770151880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 >> 172.21.15.89:0/4856715 conn(0x7fb77006d8c0 msgr2=0x7fb77013e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:34.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 shutdown_connections 2024-02-10T00:08:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:34.960+0000 7fb7753b2700 1 -- 172.21.15.89:0/4856715 wait complete. 2024-02-10T00:08:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:08:34.974 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-02-10T00:08:34.191619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003019"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986222,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.39700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33700000000000002,"15min":0.32900000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41499999999999998,"5min":0.5,"15min":0.5},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.48299999999999998,"5min":0.504,"15min":0.504},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39400000000000002}]}]},{"osd":2,"up_from":29,"seq":124554051630,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.438,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.47799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.498,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.35999999999999999},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.51700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.45800000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084335,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.25,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.32300000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45500000000000002,"5min":0.505,"15min":0.505},"last":0.379}]},{"osd":2,"last update":"Sat Feb 10 00:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27900000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.45100000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.311},{"interface":"front","average":{"1min":0.378,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.31,"5min":0.25,"15min":0.25},"max":{"1min":0.47899999999999998,"5min":0.497,"15min":0.497},"last":0.34100000000000003}]}]},{"osd":1,"up_from":28,"seq":120259084335,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.312},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.311},"min":{"1min":0.24299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34100000000000003,"15min":0.32600000000000001},"min":{"1min":0.25700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.34200000000000003},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.497,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.42899999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51100000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.39100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:08:34.979 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:34.980 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:34.980 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:34.981 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:08:54.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:08:55.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 Processor -- start 2024-02-10T00:08:55.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 -- start start 2024-02-10T00:08:55.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f83380a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:55.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f833813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83380a62d0 con 0x7f83380a5a70 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8338064220 con 0x7f8338063e50 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.109+0000 7f833dde3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83380a67f0 con 0x7f83380a5660 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f833813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83377fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f83380a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8337fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f83380a5a70 0x7f833806d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53036/0 (socket says 172.21.15.89:53036) 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8337fff700 1 -- 172.21.15.89:0/2872625785 learned_addr learned my addr 172.21.15.89:0/2872625785 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83367fc700 1 -- 172.21.15.89:0/2872625785 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83257859 0 0) 0x7f83380a62d0 con 0x7f83380a5a70 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 -- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 msgr2=0x7f83380a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f83380a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 -- 172.21.15.89:0/2872625785 >> v1:172.21.15.89:6789/0 conn(0x7f83380a5a70 legacy=0x7f833806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 -- 172.21.15.89:0/2872625785 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380a7510 con 0x7f83380a5660 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83377fe700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f83380a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f8336ffd700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f833813b6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8328009910 tx=0x7f83280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f5a1d3b6d40fa9 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:55.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83367fc700 1 -- 172.21.15.89:0/2872625785 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800b680 con 0x7f83380a5660 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83367fc700 1 -- 172.21.15.89:0/2872625785 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832800b7e0 con 0x7f83380a5660 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.110+0000 7f83367fc700 1 -- 172.21.15.89:0/2872625785 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800bba0 con 0x7f83380a5660 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 -- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 msgr2=0x7f833813b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f833813b6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8328009910 tx=0x7f83280091a0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 -- 172.21.15.89:0/2872625785 shutdown_connections 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f83380a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 --2- 172.21.15.89:0/2872625785 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f833813b6c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 -- 172.21.15.89:0/2872625785 >> 172.21.15.89:0/2872625785 conn(0x7f833806c7c0 msgr2=0x7f8338063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 -- 172.21.15.89:0/2872625785 shutdown_connections 2024-02-10T00:08:55.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.111+0000 7f833dde3700 1 -- 172.21.15.89:0/2872625785 wait complete. 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.112+0000 7f833dde3700 1 Processor -- start 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.112+0000 7f833dde3700 1 -- start start 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f833814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 0x7f8338067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338098f20 con 0x7f83380a5a70 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833814c940 con 0x7f8338063e50 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f833dde3700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f833814cc00 con 0x7f83380a5660 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8337fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 0x7f8338067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:47396/0 (socket says 172.21.15.89:47396) 2024-02-10T00:08:55.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 -- 172.21.15.89:0/4003002542 learned_addr learned my addr 172.21.15.89:0/4003002542 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f83377fe700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f833814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 -- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 msgr2=0x7f833814bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f833814bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 -- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 msgr2=0x7f8338067eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 0x7f8338067eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8336ffd700 1 -- 172.21.15.89:0/4003002542 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c009420 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.113+0000 7f8337fff700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 0x7f8338067eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f8336ffd700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8328013000 tx=0x7f8328017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800bb60 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328000c90 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8328009420 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832801a660 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.114+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833813dc40 con 0x7f83380a5660 2024-02-10T00:08:55.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.115+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f8328006c70 con 0x7f83380a5660 2024-02-10T00:08:55.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.115+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833814bde0 con 0x7f83380a5660 2024-02-10T00:08:55.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.115+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f832805ccb0 con 0x7f83380a5660 2024-02-10T00:08:55.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.119+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f8328005bd0 con 0x7f83380a5660 2024-02-10T00:08:55.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.266+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f833804c710 con 0x7f8324045f50 2024-02-10T00:08:55.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.273+0000 7f831f7fe700 1 -- 172.21.15.89:0/4003002542 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280846 (unknown 2965378022 0 2965286886) 0x7f833804c710 con 0x7f8324045f50 2024-02-10T00:08:55.279 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 >> v1:172.21.15.89:6816/47970 conn(0x7f8324045f50 legacy=0x7f8324048400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 msgr2=0x7f8338067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8328013000 tx=0x7f8328017000 comp rx=0 tx=0).stop 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 shutdown_connections 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83380a5a70 0x7f8338067eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8338063e50 0x7f833814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 --2- 172.21.15.89:0/4003002542 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f83380a5660 0x7f8338067970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:08:55.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 >> 172.21.15.89:0/4003002542 conn(0x7f833806c7c0 msgr2=0x7f833806d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:08:55.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 shutdown_connections 2024-02-10T00:08:55.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:08:55.276+0000 7f833dde3700 1 -- 172.21.15.89:0/4003002542 wait complete. 2024-02-10T00:08:55.282 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:08:55.289 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-02-10T00:08:54.196842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003207"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986226,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.39700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33700000000000002,"15min":0.32900000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41499999999999998,"5min":0.5,"15min":0.5},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.48299999999999998,"5min":0.504,"15min":0.504},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38100000000000001}]}]},{"osd":2,"up_from":29,"seq":124554051634,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.438,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.47799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.375}]},{"osd":1,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.498,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Feb 10 00:07:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.35999999999999999},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.316},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.51700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35299999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084339,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.25,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.32300000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.45500000000000002,"5min":0.505,"15min":0.505},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27900000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.45100000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 10 00:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.31,"5min":0.25,"15min":0.25},"max":{"1min":0.47899999999999998,"5min":0.497,"15min":0.497},"last":0.33700000000000002}]}]},{"osd":1,"up_from":28,"seq":120259084339,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.312},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.311},"min":{"1min":0.24299999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Feb 10 00:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34100000000000003,"15min":0.32600000000000001},"min":{"1min":0.25700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.34200000000000003},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.497,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Feb 10 00:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.377},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51100000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:08:55.344 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:55.345 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:55.345 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:08:55.346 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-10T00:09:15.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-10T00:09:15.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.475+0000 7f4e0b566700 1 Processor -- start 2024-02-10T00:09:15.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.475+0000 7f4e0b566700 1 -- start start 2024-02-10T00:09:15.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e0b566700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e0406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e0b566700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e0413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e0b566700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e040b1a10 con 0x7f4e0413f060 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e0b566700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0406dbb0 con 0x7f4e04063740 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e0b566700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0413f500 con 0x7f4e0406f7c0 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e09302700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e0406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e0413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e09b03700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4e0413f060 0x7f4e040a26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55314/0 (socket says 172.21.15.89:55314) 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e09b03700 1 -- 172.21.15.89:0/2303628746 learned_addr learned my addr 172.21.15.89:0/2303628746 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 -- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 msgr2=0x7f4e0406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e0406dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 -- 172.21.15.89:0/2303628746 >> v1:172.21.15.89:6789/0 conn(0x7f4e0413f060 legacy=0x7f4e040a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 -- 172.21.15.89:0/2303628746 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04063b10 con 0x7f4e0406f7c0 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e09302700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e0406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4e08b01700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e0413eb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4df400bbc0 tx=0x7f4df400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdbd4828b4a9373 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4dfbfff700 1 -- 172.21.15.89:0/2303628746 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400d9c0 con 0x7f4e0406f7c0 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4dfbfff700 1 -- 172.21.15.89:0/2303628746 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400db20 con 0x7f4e0406f7c0 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.476+0000 7f4dfbfff700 1 -- 172.21.15.89:0/2303628746 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400dec0 con 0x7f4e0406f7c0 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 -- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 msgr2=0x7f4e0413eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e0413eb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4df400bbc0 tx=0x7f4df400b430 comp rx=0 tx=0).stop 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 -- 172.21.15.89:0/2303628746 shutdown_connections 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e0406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2303628746 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e0413eb20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 -- 172.21.15.89:0/2303628746 >> 172.21.15.89:0/2303628746 conn(0x7f4e0406a820 msgr2=0x7f4e040b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 -- 172.21.15.89:0/2303628746 shutdown_connections 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.477+0000 7f4e0b566700 1 -- 172.21.15.89:0/2303628746 wait complete. 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.478+0000 7f4e0b566700 1 Processor -- start 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.478+0000 7f4e0b566700 1 -- start start 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e04134770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 0x7f4e04134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0409a570 con 0x7f4e0413f060 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0409a830 con 0x7f4e04063740 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e0b566700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040995d0 con 0x7f4e0406f7c0 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e08b01700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e04134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09b03700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 0x7f4e04134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54220/0 (socket says 172.21.15.89:54220) 2024-02-10T00:09:15.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 -- 172.21.15.89:0/2851557032 learned_addr learned my addr 172.21.15.89:0/2851557032 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 -- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 msgr2=0x7f4e04134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e04134770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 -- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 msgr2=0x7f4e04134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 0x7f4e04134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 -- 172.21.15.89:0/2851557032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009420 con 0x7f4e04063740 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e08b01700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e04134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09b03700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 0x7f4e04134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.479+0000 7f4e09302700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e30 tx=0x7f4e000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00015070 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000bb20 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df400b6d0 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000bea0 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0413b710 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.480+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0413b900 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.481+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f4e00019620 con 0x7f4e04063740 2024-02-10T00:09:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.481+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f4e0005f020 con 0x7f4e04063740 2024-02-10T00:09:15.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.484+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mon.1 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138516 (secure 0 0 0) 0x7f4e0003d360 con 0x7f4e04063740 2024-02-10T00:09:15.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.635+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 --> v1:172.21.15.89:6816/47970 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e0404c710 con 0x7f4de8045f20 2024-02-10T00:09:15.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.642+0000 7f4df97fa700 1 -- 172.21.15.89:0/2851557032 <== mgr.14098 v1:172.21.15.89:6816/47970 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280879 (unknown 2965378022 0 332231818) 0x7f4e0404c710 con 0x7f4de8045f20 2024-02-10T00:09:15.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-02-10T00:09:15.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.644+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 >> v1:172.21.15.89:6816/47970 conn(0x7f4de8045f20 legacy=0x7f4de80483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 msgr2=0x7f4e04099090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e30 tx=0x7f4e000091a0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 shutdown_connections 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e0413f060 0x7f4e04134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e04063740 0x7f4e04099090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 --2- 172.21.15.89:0/2851557032 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7f4e0406f7c0 0x7f4e04134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 >> 172.21.15.89:0/2851557032 conn(0x7f4e0406a820 msgr2=0x7f4e04135d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 shutdown_connections 2024-02-10T00:09:15.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.645+0000 7f4e0b566700 1 -- 172.21.15.89:0/2851557032 wait complete. 2024-02-10T00:09:15.655 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-02-10T00:09:15.658 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-02-10T00:09:14.201751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":148227379,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":6144,"num_read_kb":2952149,"num_write":65353,"num_write_kb":9046235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71869,"ondisk_log_size":71869,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537844,"kb_used_data":291348,"kb_used_omap":840,"kb_used_meta":1245623,"kb_avail":375949516,"statfs":{"total":386547056640,"available":384972304384,"internally_reserved":0,"allocated":298340352,"data_stored":297222810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":860677,"internal_metadata":1275518459},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002805"},"pg_stats":[{"pgid":"4.3f","version":"19'843","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.630357+0000","last_change":"2024-02-10T00:05:39.630313+0000","last_active":"2024-02-10T00:05:39.630357+0000","last_peered":"2024-02-10T00:05:39.630357+0000","last_clean":"2024-02-10T00:05:39.630357+0000","last_became_active":"2024-02-10T00:04:54.390213+0000","last_became_peered":"2024-02-10T00:04:54.390213+0000","last_unstale":"2024-02-10T00:05:39.630357+0000","last_undegraded":"2024-02-10T00:05:39.630357+0000","last_fullsized":"2024-02-10T00:05:39.630357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'843","last_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_deep_scrub":"19'843","last_deep_scrub_stamp":"2024-02-10T00:05:39.630204+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.630204+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:59:44.939331+0000","scrub_duration":0.0017476060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21772,"num_write":790,"num_write_kb":163857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'828","reported_seq":973,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.829118+0000","last_change":"2024-02-10T00:06:04.829088+0000","last_active":"2024-02-10T00:06:04.829118+0000","last_peered":"2024-02-10T00:06:04.829118+0000","last_clean":"2024-02-10T00:06:04.829118+0000","last_became_active":"2024-02-10T00:04:51.473129+0000","last_became_peered":"2024-02-10T00:04:51.473129+0000","last_unstale":"2024-02-10T00:06:04.829118+0000","last_undegraded":"2024-02-10T00:06:04.829118+0000","last_fullsized":"2024-02-10T00:06:04.829118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'828","last_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_deep_scrub":"19'828","last_deep_scrub_stamp":"2024-02-10T00:06:04.828978+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.828978+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:09:26.727787+0000","scrub_duration":0.0019297349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44277,"num_write":786,"num_write_kb":213838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'783","reported_seq":928,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:44.192529+0000","last_change":"2024-02-10T00:05:44.192494+0000","last_active":"2024-02-10T00:05:44.192529+0000","last_peered":"2024-02-10T00:05:44.192529+0000","last_clean":"2024-02-10T00:05:44.192529+0000","last_became_active":"2024-02-10T00:04:50.482039+0000","last_became_peered":"2024-02-10T00:04:50.482039+0000","last_unstale":"2024-02-10T00:05:44.192529+0000","last_undegraded":"2024-02-10T00:05:44.192529+0000","last_fullsized":"2024-02-10T00:05:44.192529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:05:44.192361+0000","last_clean_scrub_stamp":"2024-02-10T00:05:44.192361+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:29:11.971394+0000","scrub_duration":0.0020725890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41102,"num_write":735,"num_write_kb":115478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'771","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.041186+0000","last_change":"2024-02-10T00:06:06.041156+0000","last_active":"2024-02-10T00:06:06.041186+0000","last_peered":"2024-02-10T00:06:06.041186+0000","last_clean":"2024-02-10T00:06:06.041186+0000","last_became_active":"2024-02-10T00:04:50.473211+0000","last_became_peered":"2024-02-10T00:04:50.473211+0000","last_unstale":"2024-02-10T00:06:06.041186+0000","last_undegraded":"2024-02-10T00:06:06.041186+0000","last_fullsized":"2024-02-10T00:06:06.041186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-02-10T00:06:06.041038+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.041038+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:00.398439+0000","scrub_duration":0.0018207760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14044,"num_write":713,"num_write_kb":86974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'760","reported_seq":852,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.982538+0000","last_change":"2024-02-10T00:06:15.982484+0000","last_active":"2024-02-10T00:06:15.982538+0000","last_peered":"2024-02-10T00:06:15.982538+0000","last_clean":"2024-02-10T00:06:15.982538+0000","last_became_active":"2024-02-10T00:04:54.347950+0000","last_became_peered":"2024-02-10T00:04:54.347950+0000","last_unstale":"2024-02-10T00:06:15.982538+0000","last_undegraded":"2024-02-10T00:06:15.982538+0000","last_fullsized":"2024-02-10T00:06:15.982538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'760","last_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_deep_scrub":"19'760","last_deep_scrub_stamp":"2024-02-10T00:06:15.982370+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.982370+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:42.448371+0000","scrub_duration":0.0021961569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20166,"num_write":714,"num_write_kb":64742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'786","reported_seq":886,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:29.116588+0000","last_change":"2024-02-10T00:06:29.116560+0000","last_active":"2024-02-10T00:06:29.116588+0000","last_peered":"2024-02-10T00:06:29.116588+0000","last_clean":"2024-02-10T00:06:29.116588+0000","last_became_active":"2024-02-10T00:04:54.382503+0000","last_became_peered":"2024-02-10T00:04:54.382503+0000","last_unstale":"2024-02-10T00:06:29.116588+0000","last_undegraded":"2024-02-10T00:06:29.116588+0000","last_fullsized":"2024-02-10T00:06:29.116588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-02-10T00:06:29.116439+0000","last_clean_scrub_stamp":"2024-02-10T00:06:29.116439+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:58:03.177820+0000","scrub_duration":0.0020306439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14008,"num_write":738,"num_write_kb":122945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'813","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.181681+0000","last_change":"2024-02-10T00:06:54.181631+0000","last_active":"2024-02-10T00:06:54.181681+0000","last_peered":"2024-02-10T00:06:54.181681+0000","last_clean":"2024-02-10T00:06:54.181681+0000","last_became_active":"2024-02-10T00:04:54.387156+0000","last_became_peered":"2024-02-10T00:04:54.387156+0000","last_unstale":"2024-02-10T00:06:54.181681+0000","last_undegraded":"2024-02-10T00:06:54.181681+0000","last_fullsized":"2024-02-10T00:06:54.181681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'813","last_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_deep_scrub":"19'813","last_deep_scrub_stamp":"2024-02-10T00:06:54.181494+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.181494+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:04:37.374208+0000","scrub_duration":0.001824228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":34159,"num_write":773,"num_write_kb":139221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'722","reported_seq":817,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.333076+0000","last_change":"2024-02-10T00:06:10.333047+0000","last_active":"2024-02-10T00:06:10.333076+0000","last_peered":"2024-02-10T00:06:10.333076+0000","last_clean":"2024-02-10T00:06:10.333076+0000","last_became_active":"2024-02-10T00:04:50.473134+0000","last_became_peered":"2024-02-10T00:04:50.473134+0000","last_unstale":"2024-02-10T00:06:10.333076+0000","last_undegraded":"2024-02-10T00:06:10.333076+0000","last_fullsized":"2024-02-10T00:06:10.333076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'722","last_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_deep_scrub":"19'722","last_deep_scrub_stamp":"2024-02-10T00:06:10.332927+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.332927+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:11:15.117506+0000","scrub_duration":0.001690139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19101,"num_write":671,"num_write_kb":64557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'816","reported_seq":946,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.078583+0000","last_change":"2024-02-10T00:06:24.078554+0000","last_active":"2024-02-10T00:06:24.078583+0000","last_peered":"2024-02-10T00:06:24.078583+0000","last_clean":"2024-02-10T00:06:24.078583+0000","last_became_active":"2024-02-10T00:04:54.357166+0000","last_became_peered":"2024-02-10T00:04:54.357166+0000","last_unstale":"2024-02-10T00:06:24.078583+0000","last_undegraded":"2024-02-10T00:06:24.078583+0000","last_fullsized":"2024-02-10T00:06:24.078583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:06:24.078455+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.078455+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:35:04.973249+0000","scrub_duration":0.0019033940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":34003,"num_write":764,"num_write_kb":164445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'762","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.390268+0000","last_change":"2024-02-10T00:06:19.390242+0000","last_active":"2024-02-10T00:06:19.390268+0000","last_peered":"2024-02-10T00:06:19.390268+0000","last_clean":"2024-02-10T00:06:19.390268+0000","last_became_active":"2024-02-10T00:04:50.473536+0000","last_became_peered":"2024-02-10T00:04:50.473536+0000","last_unstale":"2024-02-10T00:06:19.390268+0000","last_undegraded":"2024-02-10T00:06:19.390268+0000","last_fullsized":"2024-02-10T00:06:19.390268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:06:19.390143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.390143+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:53:43.043640+0000","scrub_duration":0.001838987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":41638,"num_write":724,"num_write_kb":134423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'735","reported_seq":864,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.345412+0000","last_change":"2024-02-10T00:06:21.345381+0000","last_active":"2024-02-10T00:06:21.345412+0000","last_peered":"2024-02-10T00:06:21.345412+0000","last_clean":"2024-02-10T00:06:21.345412+0000","last_became_active":"2024-02-10T00:04:50.468194+0000","last_became_peered":"2024-02-10T00:04:50.468194+0000","last_unstale":"2024-02-10T00:06:21.345412+0000","last_undegraded":"2024-02-10T00:06:21.345412+0000","last_fullsized":"2024-02-10T00:06:21.345412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'735","last_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_deep_scrub":"19'735","last_deep_scrub_stamp":"2024-02-10T00:06:21.345273+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.345273+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:05.261747+0000","scrub_duration":0.0018315269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44324,"num_write":708,"num_write_kb":97013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'740","reported_seq":1531,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.833937+0000","last_change":"2024-02-10T00:06:10.833902+0000","last_active":"2024-02-10T00:06:10.833937+0000","last_peered":"2024-02-10T00:06:10.833937+0000","last_clean":"2024-02-10T00:06:10.833937+0000","last_became_active":"2024-02-10T00:05:36.189973+0000","last_became_peered":"2024-02-10T00:05:36.189973+0000","last_unstale":"2024-02-10T00:06:10.833937+0000","last_undegraded":"2024-02-10T00:06:10.833937+0000","last_fullsized":"2024-02-10T00:06:10.833937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'740","last_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_deep_scrub":"19'740","last_deep_scrub_stamp":"2024-02-10T00:06:10.833777+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.833777+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:06:13.730212+0000","scrub_duration":0.00177593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":34334,"num_write":717,"num_write_kb":142837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'823","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:53.769741+0000","last_change":"2024-02-10T00:05:53.769705+0000","last_active":"2024-02-10T00:05:53.769741+0000","last_peered":"2024-02-10T00:05:53.769741+0000","last_clean":"2024-02-10T00:05:53.769741+0000","last_became_active":"2024-02-10T00:04:54.359192+0000","last_became_peered":"2024-02-10T00:04:54.359192+0000","last_unstale":"2024-02-10T00:05:53.769741+0000","last_undegraded":"2024-02-10T00:05:53.769741+0000","last_fullsized":"2024-02-10T00:05:53.769741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'823","last_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_deep_scrub":"19'823","last_deep_scrub_stamp":"2024-02-10T00:05:53.769599+0000","last_clean_scrub_stamp":"2024-02-10T00:05:53.769599+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:33:31.951959+0000","scrub_duration":0.0018652650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":60099,"num_write":782,"num_write_kb":147233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'816","reported_seq":955,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:47.426963+0000","last_change":"2024-02-10T00:05:47.426916+0000","last_active":"2024-02-10T00:05:47.426963+0000","last_peered":"2024-02-10T00:05:47.426963+0000","last_clean":"2024-02-10T00:05:47.426963+0000","last_became_active":"2024-02-10T00:04:51.488711+0000","last_became_peered":"2024-02-10T00:04:51.488711+0000","last_unstale":"2024-02-10T00:05:47.426963+0000","last_undegraded":"2024-02-10T00:05:47.426963+0000","last_fullsized":"2024-02-10T00:05:47.426963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-02-10T00:05:47.426768+0000","last_clean_scrub_stamp":"2024-02-10T00:05:47.426768+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:09:18.825715+0000","scrub_duration":0.0021514020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":44173,"num_write":766,"num_write_kb":199806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'870","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:57.033985+0000","last_change":"2024-02-10T00:05:57.033955+0000","last_active":"2024-02-10T00:05:57.033985+0000","last_peered":"2024-02-10T00:05:57.033985+0000","last_clean":"2024-02-10T00:05:57.033985+0000","last_became_active":"2024-02-10T00:04:50.468671+0000","last_became_peered":"2024-02-10T00:04:50.468671+0000","last_unstale":"2024-02-10T00:05:57.033985+0000","last_undegraded":"2024-02-10T00:05:57.033985+0000","last_fullsized":"2024-02-10T00:05:57.033985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'870","last_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_deep_scrub":"19'870","last_deep_scrub_stamp":"2024-02-10T00:05:57.033843+0000","last_clean_scrub_stamp":"2024-02-10T00:05:57.033843+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:15:20.536804+0000","scrub_duration":0.002116125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":43385,"num_write":808,"num_write_kb":176955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'787","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.217327+0000","last_change":"2024-02-10T00:06:45.217286+0000","last_active":"2024-02-10T00:06:45.217327+0000","last_peered":"2024-02-10T00:06:45.217327+0000","last_clean":"2024-02-10T00:06:45.217327+0000","last_became_active":"2024-02-10T00:04:54.398596+0000","last_became_peered":"2024-02-10T00:04:54.398596+0000","last_unstale":"2024-02-10T00:06:45.217327+0000","last_undegraded":"2024-02-10T00:06:45.217327+0000","last_fullsized":"2024-02-10T00:06:45.217327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'787","last_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_deep_scrub":"19'787","last_deep_scrub_stamp":"2024-02-10T00:06:45.217135+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.217135+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:21:08.044778+0000","scrub_duration":0.002463186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24630,"num_write":745,"num_write_kb":68390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'868","reported_seq":1001,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:51.073358+0000","last_change":"2024-02-10T00:06:51.073326+0000","last_active":"2024-02-10T00:06:51.073358+0000","last_peered":"2024-02-10T00:06:51.073358+0000","last_clean":"2024-02-10T00:06:51.073358+0000","last_became_active":"2024-02-10T00:04:54.394713+0000","last_became_peered":"2024-02-10T00:04:54.394713+0000","last_unstale":"2024-02-10T00:06:51.073358+0000","last_undegraded":"2024-02-10T00:06:51.073358+0000","last_fullsized":"2024-02-10T00:06:51.073358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:06:51.073215+0000","last_clean_scrub_stamp":"2024-02-10T00:06:51.073215+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:34:39.440632+0000","scrub_duration":0.0018423700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29872,"num_write":826,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'706","reported_seq":801,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.023664+0000","last_change":"2024-02-10T00:05:55.023637+0000","last_active":"2024-02-10T00:05:55.023664+0000","last_peered":"2024-02-10T00:05:55.023664+0000","last_clean":"2024-02-10T00:05:55.023664+0000","last_became_active":"2024-02-10T00:04:51.492869+0000","last_became_peered":"2024-02-10T00:04:51.492869+0000","last_unstale":"2024-02-10T00:05:55.023664+0000","last_undegraded":"2024-02-10T00:05:55.023664+0000","last_fullsized":"2024-02-10T00:05:55.023664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'706","last_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_deep_scrub":"19'706","last_deep_scrub_stamp":"2024-02-10T00:05:55.023526+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.023526+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:55:46.435534+0000","scrub_duration":0.0019241989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25886,"num_write":668,"num_write_kb":92586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'849","reported_seq":1778,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.565788+0000","last_change":"2024-02-10T00:05:43.565760+0000","last_active":"2024-02-10T00:05:43.565788+0000","last_peered":"2024-02-10T00:05:43.565788+0000","last_clean":"2024-02-10T00:05:43.565788+0000","last_became_active":"2024-02-10T00:05:37.196233+0000","last_became_peered":"2024-02-10T00:05:37.196233+0000","last_unstale":"2024-02-10T00:05:43.565788+0000","last_undegraded":"2024-02-10T00:05:43.565788+0000","last_fullsized":"2024-02-10T00:05:43.565788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'849","last_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_deep_scrub":"19'849","last_deep_scrub_stamp":"2024-02-10T00:05:43.565659+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.565659+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:28:56.256349+0000","scrub_duration":0.001881972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":58092,"num_write":802,"num_write_kb":212846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":363,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'783","reported_seq":908,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.246417+0000","last_change":"2024-02-10T00:06:40.246375+0000","last_active":"2024-02-10T00:06:40.246417+0000","last_peered":"2024-02-10T00:06:40.246417+0000","last_clean":"2024-02-10T00:06:40.246417+0000","last_became_active":"2024-02-10T00:04:54.362670+0000","last_became_peered":"2024-02-10T00:04:54.362670+0000","last_unstale":"2024-02-10T00:06:40.246417+0000","last_undegraded":"2024-02-10T00:06:40.246417+0000","last_fullsized":"2024-02-10T00:06:40.246417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'783","last_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_deep_scrub":"19'783","last_deep_scrub_stamp":"2024-02-10T00:06:40.246219+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.246219+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:14:45.955616+0000","scrub_duration":0.0025333460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27355,"num_write":740,"num_write_kb":85258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'816","reported_seq":970,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.197559+0000","last_change":"2024-02-10T00:05:38.197559+0000","last_active":"2024-02-10T00:05:38.197559+0000","last_peered":"2024-02-10T00:05:38.197559+0000","last_clean":"2024-02-10T00:05:38.197559+0000","last_became_active":"2024-02-10T00:05:38.193832+0000","last_became_peered":"2024-02-10T00:05:38.193832+0000","last_unstale":"2024-02-10T00:05:38.197559+0000","last_undegraded":"2024-02-10T00:05:38.197559+0000","last_fullsized":"2024-02-10T00:05:38.197559+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:45:38.556508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56828,"num_write":764,"num_write_kb":150734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'851","reported_seq":982,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.031064+0000","last_change":"2024-02-10T00:06:04.031038+0000","last_active":"2024-02-10T00:06:04.031064+0000","last_peered":"2024-02-10T00:06:04.031064+0000","last_clean":"2024-02-10T00:06:04.031064+0000","last_became_active":"2024-02-10T00:04:50.472737+0000","last_became_peered":"2024-02-10T00:04:50.472737+0000","last_unstale":"2024-02-10T00:06:04.031064+0000","last_undegraded":"2024-02-10T00:06:04.031064+0000","last_fullsized":"2024-02-10T00:06:04.031064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'851","last_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_deep_scrub":"19'851","last_deep_scrub_stamp":"2024-02-10T00:06:04.030918+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.030918+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:19:53.649534+0000","scrub_duration":0.0019033170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38836,"num_write":810,"num_write_kb":213192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'793","reported_seq":983,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:09.085602+0000","last_change":"2024-02-10T00:07:09.085574+0000","last_active":"2024-02-10T00:07:09.085602+0000","last_peered":"2024-02-10T00:07:09.085602+0000","last_clean":"2024-02-10T00:07:09.085602+0000","last_became_active":"2024-02-10T00:04:54.362087+0000","last_became_peered":"2024-02-10T00:04:54.362087+0000","last_unstale":"2024-02-10T00:07:09.085602+0000","last_undegraded":"2024-02-10T00:07:09.085602+0000","last_fullsized":"2024-02-10T00:07:09.085602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-02-10T00:07:09.085469+0000","last_clean_scrub_stamp":"2024-02-10T00:07:09.085469+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:14:16.460852+0000","scrub_duration":0.0018904289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":75801,"num_write":745,"num_write_kb":163113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'833","reported_seq":976,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:30.341647+0000","last_change":"2024-02-10T00:06:30.341615+0000","last_active":"2024-02-10T00:06:30.341647+0000","last_peered":"2024-02-10T00:06:30.341647+0000","last_clean":"2024-02-10T00:06:30.341647+0000","last_became_active":"2024-02-10T00:04:54.352617+0000","last_became_peered":"2024-02-10T00:04:54.352617+0000","last_unstale":"2024-02-10T00:06:30.341647+0000","last_undegraded":"2024-02-10T00:06:30.341647+0000","last_fullsized":"2024-02-10T00:06:30.341647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:06:30.341484+0000","last_clean_scrub_stamp":"2024-02-10T00:06:30.341484+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:29:59.169051+0000","scrub_duration":0.0021736669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":45955,"num_write":798,"num_write_kb":180037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'833","reported_seq":1757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.406190+0000","last_change":"2024-02-10T00:05:37.406148+0000","last_active":"2024-02-10T00:05:37.406190+0000","last_peered":"2024-02-10T00:05:37.406190+0000","last_clean":"2024-02-10T00:05:37.406190+0000","last_became_active":"2024-02-10T00:05:36.187440+0000","last_became_peered":"2024-02-10T00:05:36.187440+0000","last_unstale":"2024-02-10T00:05:37.406190+0000","last_undegraded":"2024-02-10T00:05:37.406190+0000","last_fullsized":"2024-02-10T00:05:37.406190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:37.406039+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.406039+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:25:33.582361+0000","scrub_duration":0.0018285479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63582,"num_write":789,"num_write_kb":159586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'854","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:02.395705+0000","last_change":"2024-02-10T00:06:02.395654+0000","last_active":"2024-02-10T00:06:02.395705+0000","last_peered":"2024-02-10T00:06:02.395705+0000","last_clean":"2024-02-10T00:06:02.395705+0000","last_became_active":"2024-02-10T00:04:51.493580+0000","last_became_peered":"2024-02-10T00:04:51.493580+0000","last_unstale":"2024-02-10T00:06:02.395705+0000","last_undegraded":"2024-02-10T00:06:02.395705+0000","last_fullsized":"2024-02-10T00:06:02.395705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'854","last_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_deep_scrub":"19'854","last_deep_scrub_stamp":"2024-02-10T00:06:02.395528+0000","last_clean_scrub_stamp":"2024-02-10T00:06:02.395528+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:26:48.208449+0000","scrub_duration":0.0020370290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":20869,"num_write":803,"num_write_kb":145212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'795","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.228066+0000","last_change":"2024-02-10T00:06:23.228036+0000","last_active":"2024-02-10T00:06:23.228066+0000","last_peered":"2024-02-10T00:06:23.228066+0000","last_clean":"2024-02-10T00:06:23.228066+0000","last_became_active":"2024-02-10T00:04:54.399876+0000","last_became_peered":"2024-02-10T00:04:54.399876+0000","last_unstale":"2024-02-10T00:06:23.228066+0000","last_undegraded":"2024-02-10T00:06:23.228066+0000","last_fullsized":"2024-02-10T00:06:23.228066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'795","last_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_deep_scrub":"19'795","last_deep_scrub_stamp":"2024-02-10T00:06:23.227909+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.227909+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:54:58.218656+0000","scrub_duration":0.0021882239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22570,"num_write":744,"num_write_kb":85668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1470","reported_seq":1528,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:45.236162+0000","last_change":"2024-02-10T00:06:45.236129+0000","last_active":"2024-02-10T00:06:45.236162+0000","last_peered":"2024-02-10T00:06:45.236162+0000","last_clean":"2024-02-10T00:06:45.236162+0000","last_became_active":"2024-02-10T00:04:51.504061+0000","last_became_peered":"2024-02-10T00:04:51.504061+0000","last_unstale":"2024-02-10T00:06:45.236162+0000","last_undegraded":"2024-02-10T00:06:45.236162+0000","last_fullsized":"2024-02-10T00:06:45.236162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1470","last_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_deep_scrub":"49'1470","last_deep_scrub_stamp":"2024-02-10T00:06:45.236009+0000","last_clean_scrub_stamp":"2024-02-10T00:06:45.236009+0000","objects_scrubbed":3,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T12:05:33.100251+0000","scrub_duration":0.034582688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1339,"num_write_kb":21180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'767","reported_seq":891,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:03.058006+0000","last_change":"2024-02-10T00:07:03.057963+0000","last_active":"2024-02-10T00:07:03.058006+0000","last_peered":"2024-02-10T00:07:03.058006+0000","last_clean":"2024-02-10T00:07:03.058006+0000","last_became_active":"2024-02-10T00:04:54.353152+0000","last_became_peered":"2024-02-10T00:04:54.353152+0000","last_unstale":"2024-02-10T00:07:03.058006+0000","last_undegraded":"2024-02-10T00:07:03.058006+0000","last_fullsized":"2024-02-10T00:07:03.058006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:07:03.057843+0000","last_clean_scrub_stamp":"2024-02-10T00:07:03.057843+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:22:33.358997+0000","scrub_duration":0.0020050210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":42640,"num_write":719,"num_write_kb":105029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'555","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.408604+0000","last_change":"2024-02-10T00:06:03.408579+0000","last_active":"2024-02-10T00:06:03.408604+0000","last_peered":"2024-02-10T00:06:03.408604+0000","last_clean":"2024-02-10T00:06:03.408604+0000","last_became_active":"2024-02-10T00:04:54.363643+0000","last_became_peered":"2024-02-10T00:04:54.363643+0000","last_unstale":"2024-02-10T00:06:03.408604+0000","last_undegraded":"2024-02-10T00:06:03.408604+0000","last_fullsized":"2024-02-10T00:06:03.408604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'555","last_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_deep_scrub":"49'555","last_deep_scrub_stamp":"2024-02-10T00:06:03.408489+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.408489+0000","objects_scrubbed":2,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:03:52.646190+0000","scrub_duration":0.015471097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5554976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":5624,"num_write":443,"num_write_kb":9794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'785","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.120281+0000","last_change":"2024-02-10T00:06:27.120252+0000","last_active":"2024-02-10T00:06:27.120281+0000","last_peered":"2024-02-10T00:06:27.120281+0000","last_clean":"2024-02-10T00:06:27.120281+0000","last_became_active":"2024-02-10T00:04:50.473724+0000","last_became_peered":"2024-02-10T00:04:50.473724+0000","last_unstale":"2024-02-10T00:06:27.120281+0000","last_undegraded":"2024-02-10T00:06:27.120281+0000","last_fullsized":"2024-02-10T00:06:27.120281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:06:27.120148+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.120148+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:26:23.296471+0000","scrub_duration":0.0020012179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42435,"num_write":731,"num_write_kb":105768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1116","reported_seq":1184,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:05.115872+0000","last_change":"2024-02-10T00:07:05.115843+0000","last_active":"2024-02-10T00:07:05.115872+0000","last_peered":"2024-02-10T00:07:05.115872+0000","last_clean":"2024-02-10T00:07:05.115872+0000","last_became_active":"2024-02-10T00:04:54.397568+0000","last_became_peered":"2024-02-10T00:04:54.397568+0000","last_unstale":"2024-02-10T00:07:05.115872+0000","last_undegraded":"2024-02-10T00:07:05.115872+0000","last_fullsized":"2024-02-10T00:07:05.115872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1116","last_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_deep_scrub":"49'1116","last_deep_scrub_stamp":"2024-02-10T00:07:05.115740+0000","last_clean_scrub_stamp":"2024-02-10T00:07:05.115740+0000","objects_scrubbed":2,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:21:33.562378+0000","scrub_duration":0.022263788999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":992,"num_write_kb":12770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'764","reported_seq":924,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:48.236282+0000","last_change":"2024-02-10T00:06:48.236248+0000","last_active":"2024-02-10T00:06:48.236282+0000","last_peered":"2024-02-10T00:06:48.236282+0000","last_clean":"2024-02-10T00:06:48.236282+0000","last_became_active":"2024-02-10T00:04:54.353628+0000","last_became_peered":"2024-02-10T00:04:54.353628+0000","last_unstale":"2024-02-10T00:06:48.236282+0000","last_undegraded":"2024-02-10T00:06:48.236282+0000","last_fullsized":"2024-02-10T00:06:48.236282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'764","last_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_deep_scrub":"19'764","last_deep_scrub_stamp":"2024-02-10T00:06:48.236143+0000","last_clean_scrub_stamp":"2024-02-10T00:06:48.236143+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:54:31.669447+0000","scrub_duration":0.0019176200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61807,"num_write":729,"num_write_kb":138569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'145","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:37.009856+0000","last_change":"2024-02-10T00:06:37.009816+0000","last_active":"2024-02-10T00:06:37.009856+0000","last_peered":"2024-02-10T00:06:37.009856+0000","last_clean":"2024-02-10T00:06:37.009856+0000","last_became_active":"2024-02-10T00:04:54.358387+0000","last_became_peered":"2024-02-10T00:04:54.358387+0000","last_unstale":"2024-02-10T00:06:37.009856+0000","last_undegraded":"2024-02-10T00:06:37.009856+0000","last_fullsized":"2024-02-10T00:06:37.009856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'145","last_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_deep_scrub":"49'145","last_deep_scrub_stamp":"2024-02-10T00:06:37.009684+0000","last_clean_scrub_stamp":"2024-02-10T00:06:37.009684+0000","objects_scrubbed":2,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:10:08.408632+0000","scrub_duration":0.0043019620000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'831","reported_seq":958,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:25.176407+0000","last_change":"2024-02-10T00:06:25.176379+0000","last_active":"2024-02-10T00:06:25.176407+0000","last_peered":"2024-02-10T00:06:25.176407+0000","last_clean":"2024-02-10T00:06:25.176407+0000","last_became_active":"2024-02-10T00:04:54.350637+0000","last_became_peered":"2024-02-10T00:04:54.350637+0000","last_unstale":"2024-02-10T00:06:25.176407+0000","last_undegraded":"2024-02-10T00:06:25.176407+0000","last_fullsized":"2024-02-10T00:06:25.176407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'831","last_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_deep_scrub":"19'831","last_deep_scrub_stamp":"2024-02-10T00:06:25.176270+0000","last_clean_scrub_stamp":"2024-02-10T00:06:25.176270+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:13:53.873909+0000","scrub_duration":0.0025335919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36484,"num_write":789,"num_write_kb":113713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'998","reported_seq":1057,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.642786+0000","last_change":"2024-02-10T00:05:45.642759+0000","last_active":"2024-02-10T00:05:45.642786+0000","last_peered":"2024-02-10T00:05:45.642786+0000","last_clean":"2024-02-10T00:05:45.642786+0000","last_became_active":"2024-02-10T00:04:54.354455+0000","last_became_peered":"2024-02-10T00:04:54.354455+0000","last_unstale":"2024-02-10T00:05:45.642786+0000","last_undegraded":"2024-02-10T00:05:45.642786+0000","last_fullsized":"2024-02-10T00:05:45.642786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'998","last_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_deep_scrub":"49'998","last_deep_scrub_stamp":"2024-02-10T00:05:45.642667+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.642667+0000","objects_scrubbed":2,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:37:24.420696+0000","scrub_duration":0.013607233999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":879,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'877","reported_seq":1081,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:02.023041+0000","last_change":"2024-02-10T00:07:02.023015+0000","last_active":"2024-02-10T00:07:02.023041+0000","last_peered":"2024-02-10T00:07:02.023041+0000","last_clean":"2024-02-10T00:07:02.023041+0000","last_became_active":"2024-02-10T00:04:54.390092+0000","last_became_peered":"2024-02-10T00:04:54.390092+0000","last_unstale":"2024-02-10T00:07:02.023041+0000","last_undegraded":"2024-02-10T00:07:02.023041+0000","last_fullsized":"2024-02-10T00:07:02.023041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'877","last_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_deep_scrub":"19'877","last_deep_scrub_stamp":"2024-02-10T00:07:02.022902+0000","last_clean_scrub_stamp":"2024-02-10T00:07:02.022902+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:52:49.030132+0000","scrub_duration":0.001867416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":86604,"num_write":825,"num_write_kb":131426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"49'401","reported_seq":460,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.102071+0000","last_change":"2024-02-10T00:05:52.102042+0000","last_active":"2024-02-10T00:05:52.102071+0000","last_peered":"2024-02-10T00:05:52.102071+0000","last_clean":"2024-02-10T00:05:52.102071+0000","last_became_active":"2024-02-10T00:04:54.347438+0000","last_became_peered":"2024-02-10T00:04:54.347438+0000","last_unstale":"2024-02-10T00:05:52.102071+0000","last_undegraded":"2024-02-10T00:05:52.102071+0000","last_fullsized":"2024-02-10T00:05:52.102071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:52.101922+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.101922+0000","objects_scrubbed":4,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:35:20.870350+0000","scrub_duration":0.015787394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194947,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":297,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'868","reported_seq":1042,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:52.403304+0000","last_change":"2024-02-10T00:05:52.403282+0000","last_active":"2024-02-10T00:05:52.403304+0000","last_peered":"2024-02-10T00:05:52.403304+0000","last_clean":"2024-02-10T00:05:52.403304+0000","last_became_active":"2024-02-10T00:04:54.363378+0000","last_became_peered":"2024-02-10T00:04:54.363378+0000","last_unstale":"2024-02-10T00:05:52.403304+0000","last_undegraded":"2024-02-10T00:05:52.403304+0000","last_fullsized":"2024-02-10T00:05:52.403304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-02-10T00:05:52.403194+0000","last_clean_scrub_stamp":"2024-02-10T00:05:52.403194+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:16:25.319630+0000","scrub_duration":0.0018679059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":61130,"num_write":818,"num_write_kb":216605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'667","reported_seq":731,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:41.170853+0000","last_change":"2024-02-10T00:06:41.170812+0000","last_active":"2024-02-10T00:06:41.170853+0000","last_peered":"2024-02-10T00:06:41.170853+0000","last_clean":"2024-02-10T00:06:41.170853+0000","last_became_active":"2024-02-10T00:04:54.384865+0000","last_became_peered":"2024-02-10T00:04:54.384865+0000","last_unstale":"2024-02-10T00:06:41.170853+0000","last_undegraded":"2024-02-10T00:06:41.170853+0000","last_fullsized":"2024-02-10T00:06:41.170853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-02-10T00:06:41.170689+0000","last_clean_scrub_stamp":"2024-02-10T00:06:41.170689+0000","objects_scrubbed":7,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:40:38.101238+0000","scrub_duration":0.035124852999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":562,"num_write_kb":12588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'833","reported_seq":1014,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.734436+0000","last_change":"2024-02-10T00:05:49.734410+0000","last_active":"2024-02-10T00:05:49.734436+0000","last_peered":"2024-02-10T00:05:49.734436+0000","last_clean":"2024-02-10T00:05:49.734436+0000","last_became_active":"2024-02-10T00:04:54.358030+0000","last_became_peered":"2024-02-10T00:04:54.358030+0000","last_unstale":"2024-02-10T00:05:49.734436+0000","last_undegraded":"2024-02-10T00:05:49.734436+0000","last_fullsized":"2024-02-10T00:05:49.734436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:49.734297+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.734297+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:18:42.396026+0000","scrub_duration":0.0018310749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":70160,"num_write":772,"num_write_kb":162643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'392","reported_seq":459,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:56.335925+0000","last_change":"2024-02-10T00:05:56.335894+0000","last_active":"2024-02-10T00:05:56.335925+0000","last_peered":"2024-02-10T00:05:56.335925+0000","last_clean":"2024-02-10T00:05:56.335925+0000","last_became_active":"2024-02-10T00:04:54.370378+0000","last_became_peered":"2024-02-10T00:04:54.370378+0000","last_unstale":"2024-02-10T00:05:56.335925+0000","last_undegraded":"2024-02-10T00:05:56.335925+0000","last_fullsized":"2024-02-10T00:05:56.335925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'392","last_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_deep_scrub":"49'392","last_deep_scrub_stamp":"2024-02-10T00:05:56.335801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:56.335801+0000","objects_scrubbed":5,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:30:22.394954+0000","scrub_duration":0.021984198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":282,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'880","reported_seq":1113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.299888+0000","last_change":"2024-02-10T00:06:01.299854+0000","last_active":"2024-02-10T00:06:01.299888+0000","last_peered":"2024-02-10T00:06:01.299888+0000","last_clean":"2024-02-10T00:06:01.299888+0000","last_became_active":"2024-02-10T00:04:54.350848+0000","last_became_peered":"2024-02-10T00:04:54.350848+0000","last_unstale":"2024-02-10T00:06:01.299888+0000","last_undegraded":"2024-02-10T00:06:01.299888+0000","last_fullsized":"2024-02-10T00:06:01.299888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-02-10T00:06:01.299733+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.299733+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:42:08.145860+0000","scrub_duration":0.0022648439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":94990,"num_write":836,"num_write_kb":231293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'116","reported_seq":172,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:07.053413+0000","last_change":"2024-02-10T00:06:07.053387+0000","last_active":"2024-02-10T00:06:07.053413+0000","last_peered":"2024-02-10T00:06:07.053413+0000","last_clean":"2024-02-10T00:06:07.053413+0000","last_became_active":"2024-02-10T00:04:54.349634+0000","last_became_peered":"2024-02-10T00:04:54.349634+0000","last_unstale":"2024-02-10T00:06:07.053413+0000","last_undegraded":"2024-02-10T00:06:07.053413+0000","last_fullsized":"2024-02-10T00:06:07.053413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'116","last_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_deep_scrub":"49'116","last_deep_scrub_stamp":"2024-02-10T00:06:07.053292+0000","last_clean_scrub_stamp":"2024-02-10T00:06:07.053292+0000","objects_scrubbed":1,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:01:15.645781+0000","scrub_duration":0.0029998329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'810","reported_seq":950,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194849+0000","last_change":"2024-02-10T00:05:35.326715+0000","last_active":"2024-02-10T00:05:37.194849+0000","last_peered":"2024-02-10T00:05:37.194849+0000","last_clean":"2024-02-10T00:05:37.194849+0000","last_became_active":"2024-02-10T00:05:35.320772+0000","last_became_peered":"2024-02-10T00:05:35.320772+0000","last_unstale":"2024-02-10T00:05:37.194849+0000","last_undegraded":"2024-02-10T00:05:37.194849+0000","last_fullsized":"2024-02-10T00:05:37.194849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:30:31.830034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57090,"num_write":751,"num_write_kb":88315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":365,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'479","reported_seq":537,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:43.366050+0000","last_change":"2024-02-10T00:05:43.366022+0000","last_active":"2024-02-10T00:05:43.366050+0000","last_peered":"2024-02-10T00:05:43.366050+0000","last_clean":"2024-02-10T00:05:43.366050+0000","last_became_active":"2024-02-10T00:04:54.403829+0000","last_became_peered":"2024-02-10T00:04:54.403829+0000","last_unstale":"2024-02-10T00:05:43.366050+0000","last_undegraded":"2024-02-10T00:05:43.366050+0000","last_fullsized":"2024-02-10T00:05:43.366050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'479","last_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_deep_scrub":"40'479","last_deep_scrub_stamp":"2024-02-10T00:05:43.365914+0000","last_clean_scrub_stamp":"2024-02-10T00:05:43.365914+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:55:55.020609+0000","scrub_duration":0.001399679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":8354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'808","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.102404+0000","last_change":"2024-02-10T00:06:42.102375+0000","last_active":"2024-02-10T00:06:42.102404+0000","last_peered":"2024-02-10T00:06:42.102404+0000","last_clean":"2024-02-10T00:06:42.102404+0000","last_became_active":"2024-02-10T00:04:54.356896+0000","last_became_peered":"2024-02-10T00:04:54.356896+0000","last_unstale":"2024-02-10T00:06:42.102404+0000","last_undegraded":"2024-02-10T00:06:42.102404+0000","last_fullsized":"2024-02-10T00:06:42.102404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-02-10T00:06:42.102257+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.102257+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T04:17:15.018693+0000","scrub_duration":0.002241917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":46002,"num_write":762,"num_write_kb":140246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'501","reported_seq":562,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:14.388105+0000","last_change":"2024-02-10T00:06:14.388080+0000","last_active":"2024-02-10T00:06:14.388105+0000","last_peered":"2024-02-10T00:06:14.388105+0000","last_clean":"2024-02-10T00:06:14.388105+0000","last_became_active":"2024-02-10T00:04:50.474269+0000","last_became_peered":"2024-02-10T00:04:50.474269+0000","last_unstale":"2024-02-10T00:06:14.388105+0000","last_undegraded":"2024-02-10T00:06:14.388105+0000","last_fullsized":"2024-02-10T00:06:14.388105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'501","last_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_deep_scrub":"49'501","last_deep_scrub_stamp":"2024-02-10T00:06:14.387995+0000","last_clean_scrub_stamp":"2024-02-10T00:06:14.387995+0000","objects_scrubbed":7,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:58:07.485209+0000","scrub_duration":0.026112570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":399,"num_write_kb":8402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'741","reported_seq":874,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:58.283368+0000","last_change":"2024-02-10T00:05:58.283332+0000","last_active":"2024-02-10T00:05:58.283368+0000","last_peered":"2024-02-10T00:05:58.283368+0000","last_clean":"2024-02-10T00:05:58.283368+0000","last_became_active":"2024-02-10T00:04:54.400479+0000","last_became_peered":"2024-02-10T00:04:54.400479+0000","last_unstale":"2024-02-10T00:05:58.283368+0000","last_undegraded":"2024-02-10T00:05:58.283368+0000","last_fullsized":"2024-02-10T00:05:58.283368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'741","last_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_deep_scrub":"19'741","last_deep_scrub_stamp":"2024-02-10T00:05:58.283185+0000","last_clean_scrub_stamp":"2024-02-10T00:05:58.283185+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:31:42.727030+0000","scrub_duration":0.0020516750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40676,"num_write":706,"num_write_kb":110296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'401","reported_seq":454,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:45.191451+0000","last_change":"2024-02-10T00:05:45.191414+0000","last_active":"2024-02-10T00:05:45.191451+0000","last_peered":"2024-02-10T00:05:45.191451+0000","last_clean":"2024-02-10T00:05:45.191451+0000","last_became_active":"2024-02-10T00:04:50.478565+0000","last_became_peered":"2024-02-10T00:04:50.478565+0000","last_unstale":"2024-02-10T00:05:45.191451+0000","last_undegraded":"2024-02-10T00:05:45.191451+0000","last_fullsized":"2024-02-10T00:05:45.191451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'401","last_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_deep_scrub":"49'401","last_deep_scrub_stamp":"2024-02-10T00:05:45.191279+0000","last_clean_scrub_stamp":"2024-02-10T00:05:45.191279+0000","objects_scrubbed":2,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:34:38.027912+0000","scrub_duration":0.015010808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":285,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'872","reported_seq":1075,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194136+0000","last_change":"2024-02-10T00:05:35.322914+0000","last_active":"2024-02-10T00:05:37.194136+0000","last_peered":"2024-02-10T00:05:37.194136+0000","last_clean":"2024-02-10T00:05:37.194136+0000","last_became_active":"2024-02-10T00:05:35.317925+0000","last_became_peered":"2024-02-10T00:05:35.317925+0000","last_unstale":"2024-02-10T00:05:37.194136+0000","last_undegraded":"2024-02-10T00:05:37.194136+0000","last_fullsized":"2024-02-10T00:05:37.194136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T23:58:26.998331+0000","last_clean_scrub_stamp":"2024-02-09T23:58:26.998331+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:48:38.282207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":83652,"num_write":828,"num_write_kb":180800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":383,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'426","reported_seq":489,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.805666+0000","last_change":"2024-02-10T00:06:03.805634+0000","last_active":"2024-02-10T00:06:03.805666+0000","last_peered":"2024-02-10T00:06:03.805666+0000","last_clean":"2024-02-10T00:06:03.805666+0000","last_became_active":"2024-02-10T00:04:51.472704+0000","last_became_peered":"2024-02-10T00:04:51.472704+0000","last_unstale":"2024-02-10T00:06:03.805666+0000","last_undegraded":"2024-02-10T00:06:03.805666+0000","last_fullsized":"2024-02-10T00:06:03.805666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'426","last_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_deep_scrub":"49'426","last_deep_scrub_stamp":"2024-02-10T00:06:03.805537+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.805537+0000","objects_scrubbed":2,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:00:49.073900+0000","scrub_duration":0.013040932999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":310,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'847","reported_seq":993,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:35.247702+0000","last_change":"2024-02-10T00:06:35.247669+0000","last_active":"2024-02-10T00:06:35.247702+0000","last_peered":"2024-02-10T00:06:35.247702+0000","last_clean":"2024-02-10T00:06:35.247702+0000","last_became_active":"2024-02-10T00:04:54.367744+0000","last_became_peered":"2024-02-10T00:04:54.367744+0000","last_unstale":"2024-02-10T00:06:35.247702+0000","last_undegraded":"2024-02-10T00:06:35.247702+0000","last_fullsized":"2024-02-10T00:06:35.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'847","last_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_deep_scrub":"19'847","last_deep_scrub_stamp":"2024-02-10T00:06:35.247543+0000","last_clean_scrub_stamp":"2024-02-10T00:06:35.247543+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:51:21.446782+0000","scrub_duration":0.001913271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":37768,"num_write":802,"num_write_kb":177261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'743","reported_seq":804,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:13.305138+0000","last_change":"2024-02-10T00:06:13.305105+0000","last_active":"2024-02-10T00:06:13.305138+0000","last_peered":"2024-02-10T00:06:13.305138+0000","last_clean":"2024-02-10T00:06:13.305138+0000","last_became_active":"2024-02-10T00:04:54.385027+0000","last_became_peered":"2024-02-10T00:04:54.385027+0000","last_unstale":"2024-02-10T00:06:13.305138+0000","last_undegraded":"2024-02-10T00:06:13.305138+0000","last_fullsized":"2024-02-10T00:06:13.305138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'743","last_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_deep_scrub":"49'743","last_deep_scrub_stamp":"2024-02-10T00:06:13.304985+0000","last_clean_scrub_stamp":"2024-02-10T00:06:13.304985+0000","objects_scrubbed":2,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:48:21.045027+0000","scrub_duration":0.013181643999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":630,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'820","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.784832+0000","last_change":"2024-02-10T00:05:55.784802+0000","last_active":"2024-02-10T00:05:55.784832+0000","last_peered":"2024-02-10T00:05:55.784832+0000","last_clean":"2024-02-10T00:05:55.784832+0000","last_became_active":"2024-02-10T00:04:54.352181+0000","last_became_peered":"2024-02-10T00:04:54.352181+0000","last_unstale":"2024-02-10T00:05:55.784832+0000","last_undegraded":"2024-02-10T00:05:55.784832+0000","last_fullsized":"2024-02-10T00:05:55.784832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-02-10T00:05:55.784698+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.784698+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:50:20.502234+0000","scrub_duration":0.0019692239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18021,"num_write":776,"num_write_kb":93754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'149","reported_seq":205,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.194942+0000","last_change":"2024-02-10T00:05:37.153749+0000","last_active":"2024-02-10T00:05:37.194942+0000","last_peered":"2024-02-10T00:05:37.194942+0000","last_clean":"2024-02-10T00:05:37.194942+0000","last_became_active":"2024-02-10T00:04:54.348548+0000","last_became_peered":"2024-02-10T00:04:54.348548+0000","last_unstale":"2024-02-10T00:05:37.194942+0000","last_undegraded":"2024-02-10T00:05:37.194942+0000","last_fullsized":"2024-02-10T00:05:37.194942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'149","last_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_deep_scrub":"19'149","last_deep_scrub_stamp":"2024-02-10T00:05:37.153636+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.153636+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:18:47.531612+0000","scrub_duration":0.001443461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'833","reported_seq":1705,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:55.983720+0000","last_change":"2024-02-10T00:05:55.983671+0000","last_active":"2024-02-10T00:05:55.983720+0000","last_peered":"2024-02-10T00:05:55.983720+0000","last_clean":"2024-02-10T00:05:55.983720+0000","last_became_active":"2024-02-10T00:05:37.198929+0000","last_became_peered":"2024-02-10T00:05:37.198929+0000","last_unstale":"2024-02-10T00:05:55.983720+0000","last_undegraded":"2024-02-10T00:05:55.983720+0000","last_fullsized":"2024-02-10T00:05:55.983720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:55.983562+0000","last_clean_scrub_stamp":"2024-02-10T00:05:55.983562+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:02:44.248623+0000","scrub_duration":0.001621585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":26954,"num_write":790,"num_write_kb":122717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'1170","reported_seq":1236,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:03.387273+0000","last_change":"2024-02-10T00:06:03.387244+0000","last_active":"2024-02-10T00:06:03.387273+0000","last_peered":"2024-02-10T00:06:03.387273+0000","last_clean":"2024-02-10T00:06:03.387273+0000","last_became_active":"2024-02-10T00:04:54.369719+0000","last_became_peered":"2024-02-10T00:04:54.369719+0000","last_unstale":"2024-02-10T00:06:03.387273+0000","last_undegraded":"2024-02-10T00:06:03.387273+0000","last_fullsized":"2024-02-10T00:06:03.387273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1170","last_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_deep_scrub":"49'1170","last_deep_scrub_stamp":"2024-02-10T00:06:03.387149+0000","last_clean_scrub_stamp":"2024-02-10T00:06:03.387149+0000","objects_scrubbed":4,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:59:18.700052+0000","scrub_duration":0.023447783999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":1055,"num_write_kb":12776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'921","reported_seq":1046,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.131863+0000","last_change":"2024-02-10T00:05:38.131795+0000","last_active":"2024-02-10T00:05:38.131863+0000","last_peered":"2024-02-10T00:05:38.131863+0000","last_clean":"2024-02-10T00:05:38.131863+0000","last_became_active":"2024-02-10T00:04:54.348619+0000","last_became_peered":"2024-02-10T00:04:54.348619+0000","last_unstale":"2024-02-10T00:05:38.131863+0000","last_undegraded":"2024-02-10T00:05:38.131863+0000","last_fullsized":"2024-02-10T00:05:38.131863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'921","last_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_deep_scrub":"19'921","last_deep_scrub_stamp":"2024-02-10T00:05:38.131689+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.131689+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:36:33.885812+0000","scrub_duration":0.0018343000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":40087,"num_write":873,"num_write_kb":98483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'461","reported_seq":521,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:39.309247+0000","last_change":"2024-02-10T00:05:39.309217+0000","last_active":"2024-02-10T00:05:39.309247+0000","last_peered":"2024-02-10T00:05:39.309247+0000","last_clean":"2024-02-10T00:05:39.309247+0000","last_became_active":"2024-02-10T00:04:54.351723+0000","last_became_peered":"2024-02-10T00:04:54.351723+0000","last_unstale":"2024-02-10T00:05:39.309247+0000","last_undegraded":"2024-02-10T00:05:39.309247+0000","last_fullsized":"2024-02-10T00:05:39.309247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'461","last_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_deep_scrub":"49'461","last_deep_scrub_stamp":"2024-02-10T00:05:39.309118+0000","last_clean_scrub_stamp":"2024-02-10T00:05:39.309118+0000","objects_scrubbed":2,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:09:56.577080+0000","scrub_duration":0.015437662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":392,"num_write_kb":9123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'769","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.191518+0000","last_change":"2024-02-10T00:05:32.176524+0000","last_active":"2024-02-10T00:05:37.191518+0000","last_peered":"2024-02-10T00:05:37.191518+0000","last_clean":"2024-02-10T00:05:37.191518+0000","last_became_active":"2024-02-10T00:04:54.355674+0000","last_became_peered":"2024-02-10T00:04:54.355674+0000","last_unstale":"2024-02-10T00:05:37.191518+0000","last_undegraded":"2024-02-10T00:05:37.191518+0000","last_fullsized":"2024-02-10T00:05:37.191518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'769","last_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_deep_scrub":"19'769","last_deep_scrub_stamp":"2024-02-10T00:05:32.176408+0000","last_clean_scrub_stamp":"2024-02-10T00:05:32.176408+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:48:09.089585+0000","scrub_duration":0.0016825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37067,"num_write":737,"num_write_kb":127596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'358","reported_seq":418,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:07:04.117304+0000","last_change":"2024-02-10T00:07:04.117275+0000","last_active":"2024-02-10T00:07:04.117304+0000","last_peered":"2024-02-10T00:07:04.117304+0000","last_clean":"2024-02-10T00:07:04.117304+0000","last_became_active":"2024-02-10T00:04:54.405119+0000","last_became_peered":"2024-02-10T00:04:54.405119+0000","last_unstale":"2024-02-10T00:07:04.117304+0000","last_undegraded":"2024-02-10T00:07:04.117304+0000","last_fullsized":"2024-02-10T00:07:04.117304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'358","last_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_deep_scrub":"49'358","last_deep_scrub_stamp":"2024-02-10T00:07:04.117175+0000","last_clean_scrub_stamp":"2024-02-10T00:07:04.117175+0000","objects_scrubbed":3,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:27:30.255762+0000","scrub_duration":0.011266004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719827,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":1637,"num_write":253,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'777","reported_seq":1599,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:12.830056+0000","last_change":"2024-02-10T00:06:12.830033+0000","last_active":"2024-02-10T00:06:12.830056+0000","last_peered":"2024-02-10T00:06:12.830056+0000","last_clean":"2024-02-10T00:06:12.830056+0000","last_became_active":"2024-02-10T00:05:35.320033+0000","last_became_peered":"2024-02-10T00:05:35.320033+0000","last_unstale":"2024-02-10T00:06:12.830056+0000","last_undegraded":"2024-02-10T00:06:12.830056+0000","last_fullsized":"2024-02-10T00:06:12.830056+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:12.829951+0000","last_clean_scrub_stamp":"2024-02-10T00:06:12.829951+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:32:37.681303+0000","scrub_duration":0.001463062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34609,"num_write":715,"num_write_kb":100731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"48'1830","reported_seq":1890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.288232+0000","last_change":"2024-02-10T00:05:37.288186+0000","last_active":"2024-02-10T00:05:37.288232+0000","last_peered":"2024-02-10T00:05:37.288232+0000","last_clean":"2024-02-10T00:05:37.288232+0000","last_became_active":"2024-02-10T00:04:54.397139+0000","last_became_peered":"2024-02-10T00:04:54.397139+0000","last_unstale":"2024-02-10T00:05:37.288232+0000","last_undegraded":"2024-02-10T00:05:37.288232+0000","last_fullsized":"2024-02-10T00:05:37.288232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1830","last_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_deep_scrub":"48'1830","last_deep_scrub_stamp":"2024-02-10T00:05:37.288084+0000","last_clean_scrub_stamp":"2024-02-10T00:05:37.288084+0000","objects_scrubbed":2,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:35:48.688903+0000","scrub_duration":0.01444434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1702,"num_write_kb":13040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'777","reported_seq":933,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:06.333887+0000","last_change":"2024-02-10T00:06:06.333839+0000","last_active":"2024-02-10T00:06:06.333887+0000","last_peered":"2024-02-10T00:06:06.333887+0000","last_clean":"2024-02-10T00:06:06.333887+0000","last_became_active":"2024-02-10T00:04:54.371275+0000","last_became_peered":"2024-02-10T00:04:54.371275+0000","last_unstale":"2024-02-10T00:06:06.333887+0000","last_undegraded":"2024-02-10T00:06:06.333887+0000","last_fullsized":"2024-02-10T00:06:06.333887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-02-10T00:06:06.333730+0000","last_clean_scrub_stamp":"2024-02-10T00:06:06.333730+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:27:13.418734+0000","scrub_duration":0.0021331969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":37489,"num_write":735,"num_write_kb":110414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:28.342092+0000","last_change":"2024-02-10T00:06:28.342055+0000","last_active":"2024-02-10T00:06:28.342092+0000","last_peered":"2024-02-10T00:06:28.342092+0000","last_clean":"2024-02-10T00:06:28.342092+0000","last_became_active":"2024-02-10T00:04:50.469677+0000","last_became_peered":"2024-02-10T00:04:50.469677+0000","last_unstale":"2024-02-10T00:06:28.342092+0000","last_undegraded":"2024-02-10T00:06:28.342092+0000","last_fullsized":"2024-02-10T00:06:28.342092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:28.341910+0000","last_clean_scrub_stamp":"2024-02-10T00:06:28.341910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:49:39.392675+0000","scrub_duration":0.0015632879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'224","reported_seq":283,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:42.571357+0000","last_change":"2024-02-10T00:05:42.571303+0000","last_active":"2024-02-10T00:05:42.571357+0000","last_peered":"2024-02-10T00:05:42.571357+0000","last_clean":"2024-02-10T00:05:42.571357+0000","last_became_active":"2024-02-10T00:04:54.401496+0000","last_became_peered":"2024-02-10T00:04:54.401496+0000","last_unstale":"2024-02-10T00:05:42.571357+0000","last_undegraded":"2024-02-10T00:05:42.571357+0000","last_fullsized":"2024-02-10T00:05:42.571357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'224","last_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_deep_scrub":"49'224","last_deep_scrub_stamp":"2024-02-10T00:05:42.571158+0000","last_clean_scrub_stamp":"2024-02-10T00:05:42.571158+0000","objects_scrubbed":2,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:37:11.276955+0000","scrub_duration":0.016065622000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'745","reported_seq":879,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.442998+0000","last_change":"2024-02-10T00:05:41.442969+0000","last_active":"2024-02-10T00:05:41.442998+0000","last_peered":"2024-02-10T00:05:41.442998+0000","last_clean":"2024-02-10T00:05:41.442998+0000","last_became_active":"2024-02-10T00:04:54.364954+0000","last_became_peered":"2024-02-10T00:04:54.364954+0000","last_unstale":"2024-02-10T00:05:41.442998+0000","last_undegraded":"2024-02-10T00:05:41.442998+0000","last_fullsized":"2024-02-10T00:05:41.442998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'745","last_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_deep_scrub":"19'745","last_deep_scrub_stamp":"2024-02-10T00:05:41.442860+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.442860+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:06:48.680541+0000","scrub_duration":0.001901628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41311,"num_write":699,"num_write_kb":112051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:40.112759+0000","last_change":"2024-02-10T00:06:40.112731+0000","last_active":"2024-02-10T00:06:40.112759+0000","last_peered":"2024-02-10T00:06:40.112759+0000","last_clean":"2024-02-10T00:06:40.112759+0000","last_became_active":"2024-02-10T00:04:54.361794+0000","last_became_peered":"2024-02-10T00:04:54.361794+0000","last_unstale":"2024-02-10T00:06:40.112759+0000","last_undegraded":"2024-02-10T00:06:40.112759+0000","last_fullsized":"2024-02-10T00:06:40.112759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:40.112627+0000","last_clean_scrub_stamp":"2024-02-10T00:06:40.112627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:57:47.212954+0000","scrub_duration":0.001669748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'684","reported_seq":740,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.133235+0000","last_change":"2024-02-10T00:05:41.133208+0000","last_active":"2024-02-10T00:05:41.133235+0000","last_peered":"2024-02-10T00:05:41.133235+0000","last_clean":"2024-02-10T00:05:41.133235+0000","last_became_active":"2024-02-10T00:04:51.513238+0000","last_became_peered":"2024-02-10T00:04:51.513238+0000","last_unstale":"2024-02-10T00:05:41.133235+0000","last_undegraded":"2024-02-10T00:05:41.133235+0000","last_fullsized":"2024-02-10T00:05:41.133235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'684","last_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_deep_scrub":"49'684","last_deep_scrub_stamp":"2024-02-10T00:05:41.133099+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.133099+0000","objects_scrubbed":2,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:59:03.210529+0000","scrub_duration":0.004196679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":550,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'846","reported_seq":1034,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:01.370957+0000","last_change":"2024-02-10T00:06:01.370911+0000","last_active":"2024-02-10T00:06:01.370957+0000","last_peered":"2024-02-10T00:06:01.370957+0000","last_clean":"2024-02-10T00:06:01.370957+0000","last_became_active":"2024-02-10T00:04:51.507465+0000","last_became_peered":"2024-02-10T00:04:51.507465+0000","last_unstale":"2024-02-10T00:06:01.370957+0000","last_undegraded":"2024-02-10T00:06:01.370957+0000","last_fullsized":"2024-02-10T00:06:01.370957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'846","last_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_deep_scrub":"19'846","last_deep_scrub_stamp":"2024-02-10T00:06:01.370816+0000","last_clean_scrub_stamp":"2024-02-10T00:06:01.370816+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:49.738233+0000","scrub_duration":0.0017889799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":72105,"num_write":794,"num_write_kb":217663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.593661+0000","last_change":"2024-02-10T00:06:26.593636+0000","last_active":"2024-02-10T00:06:26.593661+0000","last_peered":"2024-02-10T00:06:26.593661+0000","last_clean":"2024-02-10T00:06:26.593661+0000","last_became_active":"2024-02-10T00:04:54.357491+0000","last_became_peered":"2024-02-10T00:04:54.357491+0000","last_unstale":"2024-02-10T00:06:26.593661+0000","last_undegraded":"2024-02-10T00:06:26.593661+0000","last_fullsized":"2024-02-10T00:06:26.593661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:26.593525+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.593525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:41:08.726023+0000","scrub_duration":0.0015761729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'795","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:47.190231+0000","last_change":"2024-02-10T00:06:47.190201+0000","last_active":"2024-02-10T00:06:47.190231+0000","last_peered":"2024-02-10T00:06:47.190231+0000","last_clean":"2024-02-10T00:06:47.190231+0000","last_became_active":"2024-02-10T00:04:51.498158+0000","last_became_peered":"2024-02-10T00:04:51.498158+0000","last_unstale":"2024-02-10T00:06:47.190231+0000","last_undegraded":"2024-02-10T00:06:47.190231+0000","last_fullsized":"2024-02-10T00:06:47.190231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'795","last_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_deep_scrub":"49'795","last_deep_scrub_stamp":"2024-02-10T00:06:47.190107+0000","last_clean_scrub_stamp":"2024-02-10T00:06:47.190107+0000","objects_scrubbed":2,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:50:28.683674+0000","scrub_duration":0.019170342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":654,"num_write_kb":20776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'723","reported_seq":834,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.350583+0000","last_change":"2024-02-10T00:06:26.350548+0000","last_active":"2024-02-10T00:06:26.350583+0000","last_peered":"2024-02-10T00:06:26.350583+0000","last_clean":"2024-02-10T00:06:26.350583+0000","last_became_active":"2024-02-10T00:04:50.467153+0000","last_became_peered":"2024-02-10T00:04:50.467153+0000","last_unstale":"2024-02-10T00:06:26.350583+0000","last_undegraded":"2024-02-10T00:06:26.350583+0000","last_fullsized":"2024-02-10T00:06:26.350583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'723","last_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_deep_scrub":"19'723","last_deep_scrub_stamp":"2024-02-10T00:06:26.350408+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.350408+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:44:17.410667+0000","scrub_duration":0.0019580660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29441,"num_write":675,"num_write_kb":55997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:38.096688+0000","last_change":"2024-02-10T00:06:38.096659+0000","last_active":"2024-02-10T00:06:38.096688+0000","last_peered":"2024-02-10T00:06:38.096688+0000","last_clean":"2024-02-10T00:06:38.096688+0000","last_became_active":"2024-02-10T00:04:54.388460+0000","last_became_peered":"2024-02-10T00:04:54.388460+0000","last_unstale":"2024-02-10T00:06:38.096688+0000","last_undegraded":"2024-02-10T00:06:38.096688+0000","last_fullsized":"2024-02-10T00:06:38.096688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:38.096558+0000","last_clean_scrub_stamp":"2024-02-10T00:06:38.096558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:55:28.492545+0000","scrub_duration":0.0016425420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:09.334961+0000","last_change":"2024-02-10T00:06:09.334923+0000","last_active":"2024-02-10T00:06:09.334961+0000","last_peered":"2024-02-10T00:06:09.334961+0000","last_clean":"2024-02-10T00:06:09.334961+0000","last_became_active":"2024-02-10T00:04:50.474800+0000","last_became_peered":"2024-02-10T00:04:50.474800+0000","last_unstale":"2024-02-10T00:06:09.334961+0000","last_undegraded":"2024-02-10T00:06:09.334961+0000","last_fullsized":"2024-02-10T00:06:09.334961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-02-10T00:06:09.334828+0000","last_clean_scrub_stamp":"2024-02-10T00:06:09.334828+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:53:02.483229+0000","scrub_duration":0.0052861849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'1402","reported_seq":1462,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:26.177867+0000","last_change":"2024-02-10T00:06:26.177837+0000","last_active":"2024-02-10T00:06:26.177867+0000","last_peered":"2024-02-10T00:06:26.177867+0000","last_clean":"2024-02-10T00:06:26.177867+0000","last_became_active":"2024-02-10T00:04:54.383655+0000","last_became_peered":"2024-02-10T00:04:54.383655+0000","last_unstale":"2024-02-10T00:06:26.177867+0000","last_undegraded":"2024-02-10T00:06:26.177867+0000","last_fullsized":"2024-02-10T00:06:26.177867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1402","last_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_deep_scrub":"49'1402","last_deep_scrub_stamp":"2024-02-10T00:06:26.177721+0000","last_clean_scrub_stamp":"2024-02-10T00:06:26.177721+0000","objects_scrubbed":2,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:11:39.905878+0000","scrub_duration":0.023047615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1280,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'810","reported_seq":919,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.284270+0000","last_change":"2024-02-10T00:06:15.284226+0000","last_active":"2024-02-10T00:06:15.284270+0000","last_peered":"2024-02-10T00:06:15.284270+0000","last_clean":"2024-02-10T00:06:15.284270+0000","last_became_active":"2024-02-10T00:04:54.383137+0000","last_became_peered":"2024-02-10T00:04:54.383137+0000","last_unstale":"2024-02-10T00:06:15.284270+0000","last_undegraded":"2024-02-10T00:06:15.284270+0000","last_fullsized":"2024-02-10T00:06:15.284270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:06:15.284121+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.284121+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:55:34.585479+0000","scrub_duration":0.0022908910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31397,"num_write":771,"num_write_kb":85918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:10.329837+0000","last_change":"2024-02-10T00:06:10.329798+0000","last_active":"2024-02-10T00:06:10.329837+0000","last_peered":"2024-02-10T00:06:10.329837+0000","last_clean":"2024-02-10T00:06:10.329837+0000","last_became_active":"2024-02-10T00:04:54.397254+0000","last_became_peered":"2024-02-10T00:04:54.397254+0000","last_unstale":"2024-02-10T00:06:10.329837+0000","last_undegraded":"2024-02-10T00:06:10.329837+0000","last_fullsized":"2024-02-10T00:06:10.329837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:10.329688+0000","last_clean_scrub_stamp":"2024-02-10T00:06:10.329688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:11:04.469754+0000","scrub_duration":0.0016490859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'700","reported_seq":1043,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:15.027128+0000","last_change":"2024-02-10T00:06:15.027098+0000","last_active":"2024-02-10T00:06:15.027128+0000","last_peered":"2024-02-10T00:06:15.027128+0000","last_clean":"2024-02-10T00:06:15.027128+0000","last_became_active":"2024-02-10T00:04:51.489069+0000","last_became_peered":"2024-02-10T00:04:51.489069+0000","last_unstale":"2024-02-10T00:06:15.027128+0000","last_undegraded":"2024-02-10T00:06:15.027128+0000","last_fullsized":"2024-02-10T00:06:15.027128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'700","last_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_deep_scrub":"49'700","last_deep_scrub_stamp":"2024-02-10T00:06:15.027006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:15.027006+0000","objects_scrubbed":1,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:56:04.867954+0000","scrub_duration":0.0071036909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564995,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":287,"num_read_kb":1715,"num_write":586,"num_write_kb":10069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'841","reported_seq":945,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:17.945134+0000","last_change":"2024-02-10T00:06:17.945108+0000","last_active":"2024-02-10T00:06:17.945134+0000","last_peered":"2024-02-10T00:06:17.945134+0000","last_clean":"2024-02-10T00:06:17.945134+0000","last_became_active":"2024-02-10T00:04:50.476609+0000","last_became_peered":"2024-02-10T00:04:50.476609+0000","last_unstale":"2024-02-10T00:06:17.945134+0000","last_undegraded":"2024-02-10T00:06:17.945134+0000","last_fullsized":"2024-02-10T00:06:17.945134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:17.944992+0000","last_clean_scrub_stamp":"2024-02-10T00:06:17.944992+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:19:38.921423+0000","scrub_duration":0.001934849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":40098,"num_write":801,"num_write_kb":142643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:44.181110+0000","last_change":"2024-02-10T00:06:44.181076+0000","last_active":"2024-02-10T00:06:44.181110+0000","last_peered":"2024-02-10T00:06:44.181110+0000","last_clean":"2024-02-10T00:06:44.181110+0000","last_became_active":"2024-02-10T00:04:54.348906+0000","last_became_peered":"2024-02-10T00:04:54.348906+0000","last_unstale":"2024-02-10T00:06:44.181110+0000","last_undegraded":"2024-02-10T00:06:44.181110+0000","last_fullsized":"2024-02-10T00:06:44.181110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:44.180943+0000","last_clean_scrub_stamp":"2024-02-10T00:06:44.180943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:13:51.914431+0000","scrub_duration":0.001713996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'1024","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:54.068090+0000","last_change":"2024-02-10T00:06:54.068064+0000","last_active":"2024-02-10T00:06:54.068090+0000","last_peered":"2024-02-10T00:06:54.068090+0000","last_clean":"2024-02-10T00:06:54.068090+0000","last_became_active":"2024-02-10T00:04:51.514380+0000","last_became_peered":"2024-02-10T00:04:51.514380+0000","last_unstale":"2024-02-10T00:06:54.068090+0000","last_undegraded":"2024-02-10T00:06:54.068090+0000","last_fullsized":"2024-02-10T00:06:54.068090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1024","last_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_deep_scrub":"39'1024","last_deep_scrub_stamp":"2024-02-10T00:06:54.067954+0000","last_clean_scrub_stamp":"2024-02-10T00:06:54.067954+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:51:53.303944+0000","scrub_duration":0.0013889410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":8589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'810","reported_seq":1004,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:48.142120+0000","last_change":"2024-02-10T00:05:48.142092+0000","last_active":"2024-02-10T00:05:48.142120+0000","last_peered":"2024-02-10T00:05:48.142120+0000","last_clean":"2024-02-10T00:05:48.142120+0000","last_became_active":"2024-02-10T00:04:51.513284+0000","last_became_peered":"2024-02-10T00:04:51.513284+0000","last_unstale":"2024-02-10T00:05:48.142120+0000","last_undegraded":"2024-02-10T00:05:48.142120+0000","last_fullsized":"2024-02-10T00:05:48.142120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-02-10T00:05:48.141991+0000","last_clean_scrub_stamp":"2024-02-10T00:05:48.141991+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:25:51.800724+0000","scrub_duration":0.001847827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":71906,"num_write":768,"num_write_kb":163721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'424","reported_seq":484,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:42.176368+0000","last_change":"2024-02-10T00:06:42.176312+0000","last_active":"2024-02-10T00:06:42.176368+0000","last_peered":"2024-02-10T00:06:42.176368+0000","last_clean":"2024-02-10T00:06:42.176368+0000","last_became_active":"2024-02-10T00:04:54.353159+0000","last_became_peered":"2024-02-10T00:04:54.353159+0000","last_unstale":"2024-02-10T00:06:42.176368+0000","last_undegraded":"2024-02-10T00:06:42.176368+0000","last_fullsized":"2024-02-10T00:06:42.176368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'424","last_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_deep_scrub":"49'424","last_deep_scrub_stamp":"2024-02-10T00:06:42.176207+0000","last_clean_scrub_stamp":"2024-02-10T00:06:42.176207+0000","objects_scrubbed":2,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T09:08:36.181558+0000","scrub_duration":0.0041664620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":317,"num_write_kb":4252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:08.329847+0000","last_change":"2024-02-10T00:06:08.329820+0000","last_active":"2024-02-10T00:06:08.329847+0000","last_peered":"2024-02-10T00:06:08.329847+0000","last_clean":"2024-02-10T00:06:08.329847+0000","last_became_active":"2024-02-10T00:04:50.473200+0000","last_became_peered":"2024-02-10T00:04:50.473200+0000","last_unstale":"2024-02-10T00:06:08.329847+0000","last_undegraded":"2024-02-10T00:06:08.329847+0000","last_fullsized":"2024-02-10T00:06:08.329847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:08.329704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:08.329704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:30:46.813635+0000","scrub_duration":0.0015709859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'841","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:33.093824+0000","last_change":"2024-02-10T00:06:33.093803+0000","last_active":"2024-02-10T00:06:33.093824+0000","last_peered":"2024-02-10T00:06:33.093824+0000","last_clean":"2024-02-10T00:06:33.093824+0000","last_became_active":"2024-02-10T00:04:54.350712+0000","last_became_peered":"2024-02-10T00:04:54.350712+0000","last_unstale":"2024-02-10T00:06:33.093824+0000","last_undegraded":"2024-02-10T00:06:33.093824+0000","last_fullsized":"2024-02-10T00:06:33.093824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-02-10T00:06:33.093704+0000","last_clean_scrub_stamp":"2024-02-10T00:06:33.093704+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T00:16:45.449566+0000","scrub_duration":0.0015710940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":58727,"num_write":797,"num_write_kb":161273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:22.265370+0000","last_change":"2024-02-10T00:06:22.265329+0000","last_active":"2024-02-10T00:06:22.265370+0000","last_peered":"2024-02-10T00:06:22.265370+0000","last_clean":"2024-02-10T00:06:22.265370+0000","last_became_active":"2024-02-10T00:04:54.360717+0000","last_became_peered":"2024-02-10T00:04:54.360717+0000","last_unstale":"2024-02-10T00:06:22.265370+0000","last_undegraded":"2024-02-10T00:06:22.265370+0000","last_fullsized":"2024-02-10T00:06:22.265370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T00:06:22.265222+0000","last_clean_scrub_stamp":"2024-02-10T00:06:22.265222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:22:02.249438+0000","scrub_duration":0.00147769,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'739","reported_seq":791,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:31.088445+0000","last_change":"2024-02-10T00:06:31.088380+0000","last_active":"2024-02-10T00:06:31.088445+0000","last_peered":"2024-02-10T00:06:31.088445+0000","last_clean":"2024-02-10T00:06:31.088445+0000","last_became_active":"2024-02-10T00:04:50.471817+0000","last_became_peered":"2024-02-10T00:04:50.471817+0000","last_unstale":"2024-02-10T00:06:31.088445+0000","last_undegraded":"2024-02-10T00:06:31.088445+0000","last_fullsized":"2024-02-10T00:06:31.088445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'739","last_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_deep_scrub":"49'739","last_deep_scrub_stamp":"2024-02-10T00:06:31.088272+0000","last_clean_scrub_stamp":"2024-02-10T00:06:31.088272+0000","objects_scrubbed":1,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:07:38.325953+0000","scrub_duration":0.0062339530000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":697,"num_write_kb":5571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'800","reported_seq":1659,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:19.682959+0000","last_change":"2024-02-10T00:06:19.682905+0000","last_active":"2024-02-10T00:06:19.682959+0000","last_peered":"2024-02-10T00:06:19.682959+0000","last_clean":"2024-02-10T00:06:19.682959+0000","last_became_active":"2024-02-10T00:05:35.320060+0000","last_became_peered":"2024-02-10T00:05:35.320060+0000","last_unstale":"2024-02-10T00:06:19.682959+0000","last_undegraded":"2024-02-10T00:06:19.682959+0000","last_fullsized":"2024-02-10T00:06:19.682959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-02-10T00:06:19.682797+0000","last_clean_scrub_stamp":"2024-02-10T00:06:19.682797+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:33:57.633815+0000","scrub_duration":0.0018703490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37064,"num_write":763,"num_write_kb":138785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":359,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:18.986133+0000","last_change":"2024-02-10T00:06:18.986106+0000","last_active":"2024-02-10T00:06:18.986133+0000","last_peered":"2024-02-10T00:06:18.986133+0000","last_clean":"2024-02-10T00:06:18.986133+0000","last_became_active":"2024-02-10T00:04:54.348599+0000","last_became_peered":"2024-02-10T00:04:54.348599+0000","last_unstale":"2024-02-10T00:06:18.986133+0000","last_undegraded":"2024-02-10T00:06:18.986133+0000","last_fullsized":"2024-02-10T00:06:18.986133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-02-10T00:06:18.986006+0000","last_clean_scrub_stamp":"2024-02-10T00:06:18.986006+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T02:53:27.029345+0000","scrub_duration":0.011684689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":12299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'812","reported_seq":964,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:16.761459+0000","last_change":"2024-02-10T00:06:16.761423+0000","last_active":"2024-02-10T00:06:16.761459+0000","last_peered":"2024-02-10T00:06:16.761459+0000","last_clean":"2024-02-10T00:06:16.761459+0000","last_became_active":"2024-02-10T00:04:51.470559+0000","last_became_peered":"2024-02-10T00:04:51.470559+0000","last_unstale":"2024-02-10T00:06:16.761459+0000","last_undegraded":"2024-02-10T00:06:16.761459+0000","last_fullsized":"2024-02-10T00:06:16.761459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-02-10T00:06:16.761324+0000","last_clean_scrub_stamp":"2024-02-10T00:06:16.761324+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T06:13:03.665222+0000","scrub_duration":0.0018516240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42048,"num_write":763,"num_write_kb":155130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'423","reported_seq":479,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:23.375183+0000","last_change":"2024-02-10T00:06:23.375154+0000","last_active":"2024-02-10T00:06:23.375183+0000","last_peered":"2024-02-10T00:06:23.375183+0000","last_clean":"2024-02-10T00:06:23.375183+0000","last_became_active":"2024-02-10T00:04:50.467586+0000","last_became_peered":"2024-02-10T00:04:50.467586+0000","last_unstale":"2024-02-10T00:06:23.375183+0000","last_undegraded":"2024-02-10T00:06:23.375183+0000","last_fullsized":"2024-02-10T00:06:23.375183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'423","last_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_deep_scrub":"49'423","last_deep_scrub_stamp":"2024-02-10T00:06:23.375057+0000","last_clean_scrub_stamp":"2024-02-10T00:06:23.375057+0000","objects_scrubbed":2,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:15:32.788295+0000","scrub_duration":0.013305574000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":303,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'785","reported_seq":918,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-02-10T00:05:37.195601+0000","last_change":"2024-02-10T00:05:36.660000+0000","last_active":"2024-02-10T00:05:37.195601+0000","last_peered":"2024-02-10T00:05:37.195601+0000","last_clean":"2024-02-10T00:05:37.195601+0000","last_became_active":"2024-02-10T00:04:54.371125+0000","last_became_peered":"2024-02-10T00:04:54.371125+0000","last_unstale":"2024-02-10T00:05:37.195601+0000","last_undegraded":"2024-02-10T00:05:37.195601+0000","last_fullsized":"2024-02-10T00:05:37.195601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'785","last_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_deep_scrub":"19'785","last_deep_scrub_stamp":"2024-02-10T00:05:36.659911+0000","last_clean_scrub_stamp":"2024-02-10T00:05:36.659911+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:21:12.811787+0000","scrub_duration":0.0015665060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48901,"num_write":747,"num_write_kb":199974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'623","reported_seq":690,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:51.290603+0000","last_change":"2024-02-10T00:05:51.290575+0000","last_active":"2024-02-10T00:05:51.290603+0000","last_peered":"2024-02-10T00:05:51.290603+0000","last_clean":"2024-02-10T00:05:51.290603+0000","last_became_active":"2024-02-10T00:04:54.399661+0000","last_became_peered":"2024-02-10T00:04:54.399661+0000","last_unstale":"2024-02-10T00:05:51.290603+0000","last_undegraded":"2024-02-10T00:05:51.290603+0000","last_fullsized":"2024-02-10T00:05:51.290603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'623","last_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_deep_scrub":"49'623","last_deep_scrub_stamp":"2024-02-10T00:05:51.290475+0000","last_clean_scrub_stamp":"2024-02-10T00:05:51.290475+0000","objects_scrubbed":4,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:45:41.902516+0000","scrub_duration":0.029593495000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":498,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'762","reported_seq":912,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:54.804159+0000","last_change":"2024-02-10T00:05:54.804129+0000","last_active":"2024-02-10T00:05:54.804159+0000","last_peered":"2024-02-10T00:05:54.804159+0000","last_clean":"2024-02-10T00:05:54.804159+0000","last_became_active":"2024-02-10T00:04:54.352020+0000","last_became_peered":"2024-02-10T00:04:54.352020+0000","last_unstale":"2024-02-10T00:05:54.804159+0000","last_undegraded":"2024-02-10T00:05:54.804159+0000","last_fullsized":"2024-02-10T00:05:54.804159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'762","last_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_deep_scrub":"19'762","last_deep_scrub_stamp":"2024-02-10T00:05:54.804017+0000","last_clean_scrub_stamp":"2024-02-10T00:05:54.804017+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T03:05:09.036477+0000","scrub_duration":0.0019605899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50490,"num_write":712,"num_write_kb":105851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'255","reported_seq":314,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:04.373664+0000","last_change":"2024-02-10T00:06:04.373633+0000","last_active":"2024-02-10T00:06:04.373664+0000","last_peered":"2024-02-10T00:06:04.373664+0000","last_clean":"2024-02-10T00:06:04.373664+0000","last_became_active":"2024-02-10T00:04:54.372618+0000","last_became_peered":"2024-02-10T00:04:54.372618+0000","last_unstale":"2024-02-10T00:06:04.373664+0000","last_undegraded":"2024-02-10T00:06:04.373664+0000","last_fullsized":"2024-02-10T00:06:04.373664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'255","last_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_deep_scrub":"49'255","last_deep_scrub_stamp":"2024-02-10T00:06:04.373541+0000","last_clean_scrub_stamp":"2024-02-10T00:06:04.373541+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T08:57:21.755268+0000","scrub_duration":0.014877314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4577358,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":124,"num_write_kb":4534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'833","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:38.260143+0000","last_change":"2024-02-10T00:05:38.260120+0000","last_active":"2024-02-10T00:05:38.260143+0000","last_peered":"2024-02-10T00:05:38.260143+0000","last_clean":"2024-02-10T00:05:38.260143+0000","last_became_active":"2024-02-10T00:04:54.404722+0000","last_became_peered":"2024-02-10T00:04:54.404722+0000","last_unstale":"2024-02-10T00:05:38.260143+0000","last_undegraded":"2024-02-10T00:05:38.260143+0000","last_fullsized":"2024-02-10T00:05:38.260143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'833","last_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_deep_scrub":"19'833","last_deep_scrub_stamp":"2024-02-10T00:05:38.260015+0000","last_clean_scrub_stamp":"2024-02-10T00:05:38.260015+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:06:56.644727+0000","scrub_duration":0.0017024760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":34944,"num_write":798,"num_write_kb":139412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'205","reported_seq":259,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:21.072094+0000","last_change":"2024-02-10T00:06:21.072064+0000","last_active":"2024-02-10T00:06:21.072094+0000","last_peered":"2024-02-10T00:06:21.072094+0000","last_clean":"2024-02-10T00:06:21.072094+0000","last_became_active":"2024-02-10T00:04:50.478186+0000","last_became_peered":"2024-02-10T00:04:50.478186+0000","last_unstale":"2024-02-10T00:06:21.072094+0000","last_undegraded":"2024-02-10T00:06:21.072094+0000","last_fullsized":"2024-02-10T00:06:21.072094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'205","last_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_deep_scrub":"49'205","last_deep_scrub_stamp":"2024-02-10T00:06:21.071967+0000","last_clean_scrub_stamp":"2024-02-10T00:06:21.071967+0000","objects_scrubbed":3,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:38:53.956127+0000","scrub_duration":0.012543683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":99,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'869","reported_seq":1007,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:41.594949+0000","last_change":"2024-02-10T00:05:41.594910+0000","last_active":"2024-02-10T00:05:41.594949+0000","last_peered":"2024-02-10T00:05:41.594949+0000","last_clean":"2024-02-10T00:05:41.594949+0000","last_became_active":"2024-02-10T00:04:51.467450+0000","last_became_peered":"2024-02-10T00:04:51.467450+0000","last_unstale":"2024-02-10T00:05:41.594949+0000","last_undegraded":"2024-02-10T00:05:41.594949+0000","last_fullsized":"2024-02-10T00:05:41.594949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'869","last_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_deep_scrub":"19'869","last_deep_scrub_stamp":"2024-02-10T00:05:41.594801+0000","last_clean_scrub_stamp":"2024-02-10T00:05:41.594801+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T11:26:22.497256+0000","scrub_duration":0.0017832499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45857,"num_write":824,"num_write_kb":134970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'838","reported_seq":951,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:34.261842+0000","last_change":"2024-02-10T00:06:34.261814+0000","last_active":"2024-02-10T00:06:34.261842+0000","last_peered":"2024-02-10T00:06:34.261842+0000","last_clean":"2024-02-10T00:06:34.261842+0000","last_became_active":"2024-02-10T00:04:51.494125+0000","last_became_peered":"2024-02-10T00:04:51.494125+0000","last_unstale":"2024-02-10T00:06:34.261842+0000","last_undegraded":"2024-02-10T00:06:34.261842+0000","last_fullsized":"2024-02-10T00:06:34.261842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-02-10T00:06:34.261667+0000","last_clean_scrub_stamp":"2024-02-10T00:06:34.261667+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:46:20.923143+0000","scrub_duration":0.0017873889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32993,"num_write":787,"num_write_kb":131119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'892","reported_seq":1078,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:24.192429+0000","last_change":"2024-02-10T00:06:24.192400+0000","last_active":"2024-02-10T00:06:24.192429+0000","last_peered":"2024-02-10T00:06:24.192429+0000","last_clean":"2024-02-10T00:06:24.192429+0000","last_became_active":"2024-02-10T00:04:54.350777+0000","last_became_peered":"2024-02-10T00:04:54.350777+0000","last_unstale":"2024-02-10T00:06:24.192429+0000","last_undegraded":"2024-02-10T00:06:24.192429+0000","last_fullsized":"2024-02-10T00:06:24.192429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'892","last_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_deep_scrub":"19'892","last_deep_scrub_stamp":"2024-02-10T00:06:24.192291+0000","last_clean_scrub_stamp":"2024-02-10T00:06:24.192291+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T10:49:14.022533+0000","scrub_duration":0.0019088589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63575,"num_write":839,"num_write_kb":171603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'857","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:05:49.099517+0000","last_change":"2024-02-10T00:05:49.099491+0000","last_active":"2024-02-10T00:05:49.099517+0000","last_peered":"2024-02-10T00:05:49.099517+0000","last_clean":"2024-02-10T00:05:49.099517+0000","last_became_active":"2024-02-10T00:04:54.349576+0000","last_became_peered":"2024-02-10T00:04:54.349576+0000","last_unstale":"2024-02-10T00:05:49.099517+0000","last_undegraded":"2024-02-10T00:05:49.099517+0000","last_fullsized":"2024-02-10T00:05:49.099517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'857","last_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_deep_scrub":"19'857","last_deep_scrub_stamp":"2024-02-10T00:05:49.099380+0000","last_clean_scrub_stamp":"2024-02-10T00:05:49.099380+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T05:46:10.210491+0000","scrub_duration":0.0021108780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":45931,"num_write":817,"num_write_kb":153595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'767","reported_seq":940,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:27.164322+0000","last_change":"2024-02-10T00:06:27.164280+0000","last_active":"2024-02-10T00:06:27.164322+0000","last_peered":"2024-02-10T00:06:27.164322+0000","last_clean":"2024-02-10T00:06:27.164322+0000","last_became_active":"2024-02-10T00:04:54.352378+0000","last_became_peered":"2024-02-10T00:04:54.352378+0000","last_unstale":"2024-02-10T00:06:27.164322+0000","last_undegraded":"2024-02-10T00:06:27.164322+0000","last_fullsized":"2024-02-10T00:06:27.164322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'767","last_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_deep_scrub":"19'767","last_deep_scrub_stamp":"2024-02-10T00:06:27.164168+0000","last_clean_scrub_stamp":"2024-02-10T00:06:27.164168+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T01:06:31.380025+0000","scrub_duration":0.0020283010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":67596,"num_write":724,"num_write_kb":123332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'697","reported_seq":808,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-02-10T00:06:46.165546+0000","last_change":"2024-02-10T00:06:46.165520+0000","last_active":"2024-02-10T00:06:46.165546+0000","last_peered":"2024-02-10T00:06:46.165546+0000","last_clean":"2024-02-10T00:06:46.165546+0000","last_became_active":"2024-02-10T00:04:51.507663+0000","last_became_peered":"2024-02-10T00:04:51.507663+0000","last_unstale":"2024-02-10T00:06:46.165546+0000","last_undegraded":"2024-02-10T00:06:46.165546+0000","last_fullsized":"2024-02-10T00:06:46.165546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'697","last_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_deep_scrub":"19'697","last_deep_scrub_stamp":"2024-02-10T00:06:46.165400+0000","last_clean_scrub_stamp":"2024-02-10T00:06:46.165400+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-11T07:07:16.608222+0000","scrub_duration":0.0020269820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36940,"num_write":650,"num_write_kb":108595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5345,"num_read_kb":2807850,"num_write":48846,"num_write_kb":8770954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3238,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51744,"ondisk_log_size":51744,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":147637011,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":682,"num_read_kb":144194,"num_write":16350,"num_write_kb":272990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295387136,"data_stored":295274022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":856682,"internal_metadata":0},"log_size":20008,"ondisk_log_size":20008,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986230,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407516,"kb_used_data":98068,"kb_used_omap":166,"kb_used_meta":309273,"kb_avail":93964324,"statfs":{"total":96636764160,"available":96219467776,"internally_reserved":0,"allocated":100421632,"data_stored":100126596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":316696191},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.30599999999999999,"15min":0.29499999999999998},"min":{"1min":0.25600000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.318},"min":{"1min":0.27300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Feb 10 00:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.33100000000000002},"min":{"1min":0.25600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":0.504,"15min":0.504},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Feb 10 00:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.34200000000000003},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.5,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36799999999999999}]}]},{"osd":2,"up_from":29,"seq":124554051638,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":365388,"kb_used_data":61380,"kb_used_omap":11,"kb_used_meta":303988,"kb_avail":94006452,"statfs":{"total":96636764160,"available":96262606848,"internally_reserved":0,"allocated":62853120,"data_stored":62581296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11346,"internal_metadata":311284654},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:08:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.318,"15min":0.307},"min":{"1min":0.22800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35199999999999998,"15min":0.32800000000000001},"min":{"1min":0.25900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Feb 10 00:08:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.435}]},{"osd":3,"last update":"Sat Feb 10 00:08:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.376,"15min":0.36199999999999999},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38600000000000001,"15min":0.371},"min":{"1min":0.314,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35799999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084343,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389200,"kb_used_data":72200,"kb_used_omap":258,"kb_used_meta":316733,"kb_avail":93982640,"statfs":{"total":96636764160,"available":96238223360,"internally_reserved":0,"allocated":73932800,"data_stored":73650478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":324335530},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 00:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.311,"15min":0.29799999999999999},"min":{"1min":0.26000000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.437,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Feb 10 00:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36199999999999999,"15min":0.33800000000000002},"min":{"1min":0.29299999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.501,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.34499999999999997},"min":{"1min":0.313,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 10 00:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.47099999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.36199999999999999},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33700000000000002}]}]},{"osd":1,"up_from":28,"seq":120259084343,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375740,"kb_used_data":59700,"kb_used_omap":404,"kb_used_meta":315627,"kb_avail":93996100,"statfs":{"total":96636764160,"available":96252006400,"internally_reserved":0,"allocated":61132800,"data_stored":60864440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":323202084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 00:08:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.315},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.376},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.314},"min":{"1min":0.224,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Feb 10 00:08:57 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.245,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.34499999999999997},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.438}]},{"osd":3,"last update":"Sat Feb 10 00:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.378,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56200000000000006,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":72900608,"data_stored":72869555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":264278,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":60096512,"data_stored":60081573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":414684,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62410752,"data_stored":62388797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7351,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":99979264,"data_stored":99934097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":170369,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-10T00:09:15.666 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:09:15.666 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:09:15.666 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-09T23:58:26.998331+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=23, tm_min=58, tm_sec=26, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=10, tm_hour=0, tm_min=5, tm_sec=28, tm_wday=5, tm_yday=41, tm_isdst=0) 2024-02-10T00:09:15.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub 2024-02-10T00:09:15.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.813+0000 7fc7c87f6700 1 Processor -- start 2024-02-10T00:09:15.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 -- start start 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c00a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7c00a9440 0x7fc7c00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c0064220 con 0x7fc7c00a9440 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00a80d0 con 0x7fc7c00a9070 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c87f6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c013f810 con 0x7fc7c0063e50 2024-02-10T00:09:15.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c5d91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c6d93700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7c00a9440 0x7fc7c00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c6592700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c00a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c5d91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54222/0 (socket says 172.21.15.89:54222) 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c6d93700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7c00a9440 0x7fc7c00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54206/0 (socket says 172.21.15.89:54206) 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.814+0000 7fc7c5d91700 1 -- 172.21.15.89:0/1669309827 learned_addr learned my addr 172.21.15.89:0/1669309827 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 -- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 msgr2=0x7fc7c00a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c00a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 -- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 msgr2=0x7fc7c00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 -- 172.21.15.89:0/1669309827 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c013fab0 con 0x7fc7c00a9440 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c5d91700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6592700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c00a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c6d93700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9440 0x7fc7c00b01c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80098e0 tx=0x7fc7b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7622ac37e428319c server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c5590700 1 -- 172.21.15.89:0/1669309827 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8011630 con 0x7fc7c00a9440 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c5590700 1 -- 172.21.15.89:0/1669309827 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8011790 con 0x7fc7c00a9440 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c5590700 1 -- 172.21.15.89:0/1669309827 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8011b30 con 0x7fc7c00a9440 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9440 msgr2=0x7fc7c00b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.815+0000 7fc7c87f6700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9440 0x7fc7c00b01c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80098e0 tx=0x7fc7b80091a0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1669309827 shutdown_connections 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9440 0x7fc7c00b01c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c00a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 --2- 172.21.15.89:0/1669309827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9070 0x7fc7c00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1669309827 >> 172.21.15.89:0/1669309827 conn(0x7fc7c006d8c0 msgr2=0x7fc7c0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1669309827 shutdown_connections 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1669309827 wait complete. 2024-02-10T00:09:15.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.816+0000 7fc7c87f6700 1 Processor -- start 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 -- start start 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 0x7fc7c01512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9440 0x7fc7c0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c006a1b0 con 0x7fc7c00a9070 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00af0a0 con 0x7fc7c00a9440 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c87f6700 1 -- --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00acab0 con 0x7fc7c0063e50 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c5d91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 0x7fc7c01512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 --2- >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c0150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3302/0 says I am v2:172.21.15.89:56130/0 (socket says 172.21.15.89:56130) 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 -- 172.21.15.89:0/1544411626 learned_addr learned my addr 172.21.15.89:0/1544411626 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c5d91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 0x7fc7c01512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54218/0 (socket says 172.21.15.89:54218) 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6d93700 1 --2- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9440 0x7fc7c0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 -- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9440 msgr2=0x7fc7c0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 --2- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7c00a9440 0x7fc7c0151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 -- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 msgr2=0x7fc7c01512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 --2- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 0x7fc7c01512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c6592700 1 -- 172.21.15.89:0/1544411626 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009a20 con 0x7fc7c0063e50 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.817+0000 7fc7c5d91700 1 --2- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7c00a9070 0x7fc7c01512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7c6592700 1 --2- 172.21.15.89:0/1544411626 >> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] conn(0x7fc7c0063e50 0x7fc7c0150d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c1a0 tx=0x7fc7bc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc00cce0 con 0x7fc7c0063e50 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc00f040 con 0x7fc7c0063e50 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1544411626 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b00094f0 con 0x7fc7c0063e50 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014690 con 0x7fc7c0063e50 2024-02-10T00:09:15.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.818+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1544411626 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8009420 con 0x7fc7c0063e50 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.819+0000 7fc7c87f6700 1 -- 172.21.15.89:0/1544411626 --> [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7c00ae4e0 con 0x7fc7c0063e50 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.819+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fc7bc014a00 con 0x7fc7c0063e50 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.819+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4230+0+0 (secure 0 0 0) 0x7fc7bc05be70 con 0x7fc7c0063e50 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.819+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 --> v1:172.21.15.89:6804/50752 -- command(tid 1: {"prefix": "get_command_descriptions", "pgid": "4.2b"}) v1 -- 0x7fc7a4052f10 con 0x7fc7a404f1f0 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.819+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== mon.2 v2:172.21.15.89:3302/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7bc05e4b0 con 0x7fc7c0063e50 2024-02-10T00:09:15.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-02-10T00:09:15.820+0000 7fc7b67fc700 1 -- 172.21.15.89:0/1544411626 <== osd.2 v1:172.21.15.89:6804/50752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fc7a4052f10 con 0x7fc7a404f1f0 2024-02-10T00:09:15.850 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-02-10T00:09:15.850 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-02-10T00:09:15.850 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-02-10T00:09:15.850 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:bench [] [] [] [] 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs debug_inject_read_zeros 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs files list 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs stats 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator dump block 2024-02-10T00:09:15.851 INFO:teuthology.orchestra.run.smithi089.stderr:Error EINVAL: invalid command 2024-02-10T00:09:15.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-10T00:09:15.852 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub' 2024-02-10T00:09:15.854 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-10T00:09:15.855 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-10T00:09:15.855 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:15.863 INFO:tasks.ceph.mds.a:Stopped 2024-02-10T00:09:15.863 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-10T00:09:15.863 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:15.911 INFO:tasks.ceph.mds.b:Stopped 2024-02-10T00:09:15.912 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-10T00:09:15.912 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:15.963 INFO:tasks.ceph.mds.c:Stopped 2024-02-10T00:09:15.963 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-10T00:09:15.963 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-10T00:09:15.963 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.039 INFO:tasks.ceph.osd.0:Stopped 2024-02-10T00:09:16.039 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-10T00:09:16.039 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.115 INFO:tasks.ceph.osd.1:Stopped 2024-02-10T00:09:16.115 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-10T00:09:16.115 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.187 INFO:tasks.ceph.osd.2:Stopped 2024-02-10T00:09:16.187 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-10T00:09:16.187 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.255 INFO:tasks.ceph.osd.3:Stopped 2024-02-10T00:09:16.255 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-10T00:09:16.256 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-10T00:09:16.256 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.315 INFO:tasks.ceph.mgr.x:Stopped 2024-02-10T00:09:16.316 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-10T00:09:16.316 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.379 INFO:tasks.ceph.mgr.y:Stopped 2024-02-10T00:09:16.379 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-10T00:09:16.380 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-10T00:09:16.380 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.430 INFO:tasks.ceph.mon.a:Stopped 2024-02-10T00:09:16.430 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-10T00:09:16.430 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.480 INFO:tasks.ceph.mon.b:Stopped 2024-02-10T00:09:16.481 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-10T00:09:16.481 INFO:teuthology.orchestra.run:waiting for 300 2024-02-10T00:09:16.531 INFO:tasks.ceph.mon.c:Stopped 2024-02-10T00:09:16.532 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-10T00:09:16.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'missing required features' | head -n 1 2024-02-10T00:09:16.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:09:16.608 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-10T00:09:16.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:09:16.894 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-10T00:09:17.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:09:17.009 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-10T00:09:17.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:09:17.085 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-10T00:09:17.170 INFO:tasks.ceph:Archiving mon data... 2024-02-10T00:09:17.172 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/data/mon.a.tgz 2024-02-10T00:09:17.172 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-02-10T00:09:17.190 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.YjxNNBMgtq 2024-02-10T00:09:17.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.YjxNNBMgtq 2024-02-10T00:09:17.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.YjxNNBMgtq 2024-02-10T00:09:17.466 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.YjxNNBMgtq is 522KB 2024-02-10T00:09:17.565 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.YjxNNBMgtq 2024-02-10T00:09:17.581 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/data/mon.b.tgz 2024-02-10T00:09:17.582 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-02-10T00:09:17.637 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.EIFMVGnP2Y 2024-02-10T00:09:17.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.EIFMVGnP2Y 2024-02-10T00:09:17.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.EIFMVGnP2Y 2024-02-10T00:09:17.909 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.EIFMVGnP2Y is 532KB 2024-02-10T00:09:18.013 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.EIFMVGnP2Y 2024-02-10T00:09:18.031 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/data/mon.c.tgz 2024-02-10T00:09:18.031 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-02-10T00:09:18.087 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.gkLTTdQ7eE 2024-02-10T00:09:18.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gkLTTdQ7eE 2024-02-10T00:09:18.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.gkLTTdQ7eE 2024-02-10T00:09:18.359 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.gkLTTdQ7eE is 532KB 2024-02-10T00:09:18.456 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.gkLTTdQ7eE 2024-02-10T00:09:18.473 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-10T00:09:18.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-10T00:09:18.517 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-10T00:09:18.521 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-10T00:09:18.599 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-10T00:09:18.619 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-10T00:09:18.640 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-10T00:09:18.640 INFO:tasks.ceph:Archiving crash dumps... 2024-02-10T00:09:18.642 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi089/crash 2024-02-10T00:09:18.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-10T00:09:18.668 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi164/crash 2024-02-10T00:09:18.669 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-10T00:09:18.699 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi183/crash 2024-02-10T00:09:18.700 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-10T00:09:18.732 INFO:tasks.ceph:Compressing logs... 2024-02-10T00:09:18.732 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T00:09:18.735 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T00:09:18.744 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T00:09:18.773 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37214.log 2024-02-10T00:09:18.811 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54014.log 2024-02-10T00:09:18.811 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2024-02-10T00:09:18.811 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52080.log 2024-02-10T00:09:18.811 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54014.log: /var/log/ceph/ceph-client.admin.48667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2024-02-10T00:09:18.811 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54014.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52080.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49500.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47021.log 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2024-02-10T00:09:18.812 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55981.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47021.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48452.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43718.log: /var/log/ceph/ceph-client.admin.48249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41670.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48452.log.gz 2024-02-10T00:09:18.813 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42137.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53698.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53943.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42137.log: /var/log/ceph/ceph-client.admin.49861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42137.log.gz 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52546.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52546.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52275.log 2024-02-10T00:09:18.814 INFO:teuthology.orchestra.run.smithi089.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.53943.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52546.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54578.log: /var/log/ceph/ceph-client.admin.52275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54970.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42494.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52275.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54970.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46129.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46333.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2024-02-10T00:09:18.815 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46027.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46129.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55460.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46027.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55460.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46027.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55460.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41721.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50204.log 2024-02-10T00:09:18.816 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41721.log.gz/var/log/ceph/ceph-client.admin.50204.log: 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50204.log.gz 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54061.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53404.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39774.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54061.log.gz 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-02-10T00:09:18.817 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55166.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42750.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39774.log.gz 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42086.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39354.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55166.log.gz 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42086.log.gz 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54431.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41558.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39354.log.gz 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2024-02-10T00:09:18.818 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54431.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41558.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49014.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54676.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49377.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56242.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54676.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49014.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46180.log 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54676.log.gz 2024-02-10T00:09:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56242.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49377.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39670.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56242.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54257.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46180.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39670.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8%/var/log/ceph/ceph-client.admin.54257.log: -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47972.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54257.log.gz 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-02-10T00:09:18.820 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43616.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49666.log: /var/log/ceph/ceph-client.admin.43616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55019.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51772.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43616.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55019.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55019.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49812.log 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-02-10T00:09:18.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54921.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49812.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49812.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52965.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54921.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 /var/log/ceph/ceph-client.admin.46970.log: --verbose -- /var/log/ceph/ceph-client.admin.40812.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54208.log 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52965.log.gz 2024-02-10T00:09:18.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56340.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40812.log.gz 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54208.log.gz/var/log/ceph/ceph-client.admin.56340.log: 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55705.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56340.log.gz 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43106.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55705.log: /var/log/ceph/ceph-client.admin.43106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45619.log 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55705.log.gz 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43106.log.gz 2024-02-10T00:09:18.823 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52177.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45619.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53796.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45619.log.gz 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52177.log.gz 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53796.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53796.log.gz 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2024-02-10T00:09:18.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50155.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53502.log 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43310.log 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41984.log 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43310.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53502.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41984.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43310.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41984.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2024-02-10T00:09:18.825 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr: 95.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46851.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48589.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50548.log: /var/log/ceph/ceph-client.admin.48589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48589.log.gz 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2024-02-10T00:09:18.826 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53453.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46537.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43514.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53649.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53453.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52128.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53649.log.gz 2024-02-10T00:09:18.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42570.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43565.log: /var/log/ceph/ceph-osd.3.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48809.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48809.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz-5 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:--verbose -- /var/log/ceph/ceph-client.admin.55068.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48809.log.gz 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45823.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54774.log 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gz 2024-02-10T00:09:18.828 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45823.log: /var/log/ceph/ceph-client.admin.54774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45823.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54774.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56087.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48985.log: /var/log/ceph/ceph-client.admin.48248.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.52401.log 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2024-02-10T00:09:18.829 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52401.log.gz 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52718.log 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43917.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52718.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52718.log.gz 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2024-02-10T00:09:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52770.log 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50473.log 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52770.log: /var/log/ceph/ceph-client.admin.50473.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52770.log.gz 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42365.log 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50473.log.gz 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52993.log 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42365.log: /var/log/ceph/ceph-client.admin.46690.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42365.log.gz 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52993.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-02-10T00:09:18.831 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53845.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40118.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53845.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40118.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49155.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49181.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53306.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45976.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49181.log.gz 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40938.log 2024-02-10T00:09:18.832 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45976.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53306.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40938.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45976.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40938.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53894.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53257.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53894.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53894.log.gz 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-02-10T00:09:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6%/var/log/ceph/ceph-client.admin.52032.log: -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7%/var/log/ceph/ceph-client.admin.46902.log: -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56030.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56030.log: /var/log/ceph/ceph-client.admin.49549.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56030.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2024-02-10T00:09:18.834 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55920.log 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52400.log: gzip /var/log/ceph/ceph-client.admin.55920.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55920.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45874.log: /var/log/ceph/ceph-client.admin.52402.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2024-02-10T00:09:18.835 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56185.log 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54823.log 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56185.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56185.log.gz 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54823.log: /var/log/ceph/ceph-mgr.x.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54823.log.gz 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42779.log 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42779.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42779.log.gz 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43844.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-02-10T00:09:18.836 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-02-10T00:09:18.837 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37237.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43769.log: /var/log/ceph/ceph-client.admin.42572.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50351.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41352.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50351.log: /var/log/ceph/ceph-client.admin.41352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41352.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41250.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42953.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.36839.log 2024-02-10T00:09:18.847 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55215.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.36839.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.36839.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55215.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55215.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52597.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53747.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48617.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53747.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53747.log.gz 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2024-02-10T00:09:18.848 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50057.log: /var/log/ceph/ceph-client.admin.46384.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53600.log: /var/log/ceph/ceph-client.admin.40690.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48959.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48959.log: /var/log/ceph/ceph-client.admin.46435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48959.log.gz 2024-02-10T00:09:18.849 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54529.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56291.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49741.log: /var/log/ceph/ceph-client.admin.54529.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56291.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54529.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56291.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54306.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49959.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54306.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54306.log.gz 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48451.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45925.log 2024-02-10T00:09:18.850 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48451.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48451.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46486.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53208.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46486.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46486.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53208.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41823.log: /var/log/ceph/ceph-mds.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48118.log 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.48118.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48118.log.gz 2024-02-10T00:09:18.851 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52542.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52542.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52542.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41301.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41301.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41301.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52399.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52399.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52399.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54110.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54110.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54110.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51983.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51983.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51983.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46741.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46741.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46741.log.gz 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-10T00:09:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-10T00:09:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2024-02-10T00:09:18.867 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50008.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2024-02-10T00:09:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48065.log 2024-02-10T00:09:18.888 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48065.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48065.log.gz 2024-02-10T00:09:18.888 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46282.log 2024-02-10T00:09:18.889 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46282.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46282.log.gz 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52769.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49598.log 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49598.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55264.log 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55264.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55264.log.gz 2024-02-10T00:09:18.900 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-10T00:09:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-02-10T00:09:18.924 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-02-10T00:09:18.924 INFO:teuthology.orchestra.run.smithi089.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-02-10T00:09:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50660.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-02-10T00:09:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50253.log 2024-02-10T00:09:18.942 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50253.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50253.log.gz 2024-02-10T00:09:18.943 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2024-02-10T00:09:18.958 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53159.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2024-02-10T00:09:18.958 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2024-02-10T00:09:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53110.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz 2024-02-10T00:09:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-02-10T00:09:18.994 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41505.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-02-10T00:09:18.994 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-10T00:09:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42749.log 2024-02-10T00:09:19.009 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-10T00:09:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42749.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42749.log.gz 2024-02-10T00:09:19.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2024-02-10T00:09:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52104.log: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-10T00:09:19.034 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2024-02-10T00:09:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55509.log 2024-02-10T00:09:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55509.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55509.log.gz 2024-02-10T00:09:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55313.log 2024-02-10T00:09:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55313.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55313.log.gz 2024-02-10T00:09:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2024-02-10T00:09:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41882.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2024-02-10T00:09:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43361.log 2024-02-10T00:09:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43361.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43361.log.gz 2024-02-10T00:09:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52056.log 2024-02-10T00:09:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52056.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52056.log.gz 2024-02-10T00:09:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46231.log 2024-02-10T00:09:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz 2024-02-10T00:09:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39829.log 2024-02-10T00:09:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39829.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39829.log.gz 2024-02-10T00:09:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2024-02-10T00:09:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42698.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2024-02-10T00:09:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-02-10T00:09:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55117.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2024-02-10T00:09:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40761.log 2024-02-10T00:09:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40761.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40761.log.gz 2024-02-10T00:09:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41772.log 2024-02-10T00:09:19.044 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41772.log.gz 2024-02-10T00:09:19.044 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2024-02-10T00:09:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46639.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2024-02-10T00:09:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52796.log 2024-02-10T00:09:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52796.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52796.log.gz 2024-02-10T00:09:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-02-10T00:09:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42368.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-02-10T00:09:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2024-02-10T00:09:19.051 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49405.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz 2024-02-10T00:09:19.051 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-02-10T00:09:19.052 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41146.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2024-02-10T00:09:19.052 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55411.log 2024-02-10T00:09:19.053 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55411.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55411.log.gz 2024-02-10T00:09:19.053 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54725.log 2024-02-10T00:09:19.054 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54725.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54725.log.gz 2024-02-10T00:09:19.054 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2024-02-10T00:09:19.055 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45772.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2024-02-10T00:09:19.055 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-02-10T00:09:19.056 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42571.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-02-10T00:09:19.056 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42902.log 2024-02-10T00:09:19.057 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42902.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42902.log.gz 2024-02-10T00:09:19.057 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41933.log 2024-02-10T00:09:19.058 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41933.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2024-02-10T00:09:19.058 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55656.log 2024-02-10T00:09:19.059 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55656.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55656.log.gz 2024-02-10T00:09:19.059 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53551.log 2024-02-10T00:09:19.060 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53551.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53551.log.gz 2024-02-10T00:09:19.060 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 2024-02-10T00:09:19.061 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43412.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2024-02-10T00:09:19.061 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2024-02-10T00:09:19.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49910.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2024-02-10T00:09:19.062 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2024-02-10T00:09:19.063 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45670.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2024-02-10T00:09:19.063 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46800.log 2024-02-10T00:09:19.064 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46800.log.gz 2024-02-10T00:09:19.064 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2024-02-10T00:09:19.065 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49209.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2024-02-10T00:09:19.065 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54355.log 2024-02-10T00:09:19.066 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54355.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54355.log.gz 2024-02-10T00:09:19.067 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41095.log 2024-02-10T00:09:19.067 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41095.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41095.log.gz 2024-02-10T00:09:19.067 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53355.log 2024-02-10T00:09:19.068 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53355.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53355.log.gz 2024-02-10T00:09:19.068 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-02-10T00:09:19.069 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48397.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-02-10T00:09:19.069 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-10T00:09:19.091 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55607.log 2024-02-10T00:09:19.102 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54872.log 2024-02-10T00:09:19.102 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55607.log.gz 2024-02-10T00:09:19.113 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54872.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54872.log.gz 2024-02-10T00:09:19.113 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2024-02-10T00:09:19.114 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-10T00:09:19.114 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48247.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2024-02-10T00:09:19.114 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51648.log 2024-02-10T00:09:19.115 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51648.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51648.log.gz 2024-02-10T00:09:19.115 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2024-02-10T00:09:19.116 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41197.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2024-02-10T00:09:19.116 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50302.log 2024-02-10T00:09:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50302.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50302.log.gz 2024-02-10T00:09:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39984.log 2024-02-10T00:09:19.118 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39984.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39984.log.gz 2024-02-10T00:09:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2024-02-10T00:09:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42035.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2024-02-10T00:09:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2024-02-10T00:09:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41403.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2024-02-10T00:09:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55863.log 2024-02-10T00:09:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55863.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55863.log.gz 2024-02-10T00:09:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-02-10T00:09:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51935.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-02-10T00:09:19.377 INFO:teuthology.orchestra.run.smithi089.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-10T00:09:22.792 INFO:teuthology.orchestra.run.smithi089.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-10T00:09:24.386 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-10T00:09:24.959 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-10T00:09:26.933 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-10T00:09:34.240 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.37237.log: 92.8% -- replaced with /var/log/ceph/ceph-client.1.37237.log.gz 2024-02-10T00:09:34.242 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-02-10T00:09:34.242 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m15.444s 2024-02-10T00:09:34.242 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m14.962s 2024-02-10T00:09:34.242 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.466s 2024-02-10T00:09:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.37214.log: 92.9% -- replaced with /var/log/ceph/ceph-client.0.37214.log.gz 2024-02-10T00:09:34.421 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-02-10T00:09:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m15.661s 2024-02-10T00:09:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m15.140s 2024-02-10T00:09:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.506s 2024-02-10T00:10:09.938 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-10T00:10:12.945 INFO:teuthology.orchestra.run.smithi089.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-10T00:10:12.947 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-02-10T00:10:12.947 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m54.197s 2024-02-10T00:10:12.947 INFO:teuthology.orchestra.run.smithi089.stderr:user 2m5.683s 2024-02-10T00:10:12.947 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m4.280s 2024-02-10T00:10:12.952 INFO:tasks.ceph:Archiving logs... 2024-02-10T00:10:12.952 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi089/log 2024-02-10T00:10:12.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T00:10:31.807 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi164/log 2024-02-10T00:10:31.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T00:10:34.461 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi183/log 2024-02-10T00:10:34.462 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T00:10:37.172 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub' 2024-02-10T00:10:37.174 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-10T00:10:37.187 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_290212a1bfd33563ba76ee5b7f0b944fdb6c5d90/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub' 2024-02-10T00:10:37.188 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-10T00:10:37.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-10T00:10:37.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-10T00:10:37.194 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-10T00:10:37.301 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-10T00:10:37.314 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-10T00:10:37.314 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T00:10:37.317 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T00:10:37.320 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T00:10:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2024-02-10T00:10:37.336 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2024-02-10T00:10:37.338 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -328us[ -316us] +/- 100ms 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 +251us[ +263us] +/- 63ms 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +3913ns[ +16us] +/- 66ms 2024-02-10T00:10:37.339 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T00:10:37.341 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T00:10:37.342 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-02-10T00:10:37.342 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 -301us[ -301us] +/- 100ms 2024-02-10T00:10:37.342 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 +269us[ +301us] +/- 63ms 2024-02-10T00:10:37.342 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -16us[ +16us] +/- 66ms 2024-02-10T00:10:37.342 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 -316us[ -303us] +/- 100ms 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 +259us[ +272us] +/- 63ms 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -36us[ -23us] +/- 66ms 2024-02-10T00:10:37.344 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T00:10:37.345 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-10T00:10:37.358 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-10T00:10:37.359 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-10T00:10:37.375 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T00:10:37.454 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T00:10:37.522 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T00:10:37.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T00:10:37.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:37.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T00:10:37.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:37.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T00:10:37.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:37.692 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-10T00:10:37.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-10T00:10:37.719 INFO:teuthology.task.internal:Duration was 1783.202804 seconds 2024-02-10T00:10:37.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-10T00:10:37.731 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-10T00:10:37.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T00:10:37.734 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T00:10:37.736 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T00:10:37.785 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T00:10:37.786 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T00:10:37.786 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T00:10:38.203 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-10T00:10:38.203 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-02-10T00:10:38.203 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T00:10:38.231 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-02-10T00:10:38.231 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T00:10:38.256 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-02-10T00:10:38.257 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T00:10:38.282 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-10T00:10:38.282 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T00:10:38.284 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T00:10:38.299 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T00:10:38.367 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-10T00:10:38.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T00:10:38.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T00:10:38.372 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T00:10:38.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-10T00:10:38.537 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-10T00:10:38.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T00:10:38.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T00:10:38.596 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T00:10:38.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-10T00:10:38.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.645 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.648 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.669 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-02-10T00:10:38.673 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-02-10T00:10:38.690 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-02-10T00:10:38.704 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:38.762 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:38.779 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T00:10:38.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T00:10:38.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-10T00:10:38.811 INFO:teuthology.task.internal:Transferring archived files... 2024-02-10T00:10:38.812 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi089 2024-02-10T00:10:38.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T00:10:38.851 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi164 2024-02-10T00:10:38.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T00:10:38.892 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534/remote/smithi183 2024-02-10T00:10:38.892 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T00:10:38.929 INFO:teuthology.task.internal:Removing archive directory... 2024-02-10T00:10:38.929 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T00:10:38.931 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T00:10:38.933 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T00:10:38.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-10T00:10:38.995 INFO:teuthology.task.internal:Not uploading archives. 2024-02-10T00:10:38.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-10T00:10:39.009 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-10T00:10:39.009 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T00:10:39.011 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T00:10:39.014 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T00:10:39.027 INFO:teuthology.orchestra.run.smithi089.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 00:10 /home/ubuntu/cephtest 2024-02-10T00:10:39.029 INFO:teuthology.orchestra.run.smithi164.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 00:10 /home/ubuntu/cephtest 2024-02-10T00:10:39.038 INFO:teuthology.orchestra.run.smithi183.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 00:10 /home/ubuntu/cephtest 2024-02-10T00:10:39.039 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-10T00:10:39.053 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-10T00:10:39.068 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi089 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub' 2024-02-10T00:10:39.068 INFO:teuthology.nuke:Checking targets against current locks 2024-02-10T00:10:39.087 DEBUG:teuthology.nuke:shortname: smithi089 2024-02-10T00:10:39.088 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T00:10:39.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.045794', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcZ0odxrGFwFkuDlW9Xe/BJAzMoBC4lOxQ9KoRExmv+JiFhgqyuMobsiFbuz6lCk+6vDcsLX80Y3DNOGAkVOM='} 2024-02-10T00:10:39.113 DEBUG:teuthology.nuke:shortname: smithi164 2024-02-10T00:10:39.113 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T00:10:39.134 DEBUG:teuthology.nuke:shortname: smithi183 2024-02-10T00:10:39.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T00:10:39.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.043238', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmWEPP5HSwhdOmzl8le8GtPRRmTc9NK68BKsSb97+NofI53vQQWiZ4r5Rr3mD9OQUWzak5i/uSvrpkSIGXGsNM='} 2024-02-10T00:10:39.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_19:35:09-fs-main-distro-default-smithi/7554534', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 23:24:00.044658', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbn3grc8ibnAG8w8nMLILDrjNRTEPt3B/r0eUWUrny7cmuT6sFjqXCsbH9mmL1aOGaXMtA0four9RlYG1sHV34='} 2024-02-10T00:10:39.169 INFO:teuthology.orchestra.console.smithi089:Power off 2024-02-10T00:10:39.170 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T00:10:39.193 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2024-02-10T00:10:39.194 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:39.212 INFO:teuthology.orchestra.console.smithi164:Power off 2024-02-10T00:10:39.212 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T00:10:39.223 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-10T00:10:39.234 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-02-10T00:10:39.234 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:39.250 INFO:teuthology.orchestra.console.smithi183:Power off 2024-02-10T00:10:39.250 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T00:10:39.260 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-02-10T00:10:39.272 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-02-10T00:10:39.273 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:39.293 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-02-10T00:10:43.227 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:43.260 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:43.299 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:43.364 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-10T00:10:43.388 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-02-10T00:10:43.500 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-02-10T00:10:47.368 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:47.622 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:47.631 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T00:10:47.724 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-02-10T00:10:47.733 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-02-10T00:10:47.744 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-02-10T00:10:47.825 INFO:teuthology.orchestra.console.smithi089:Power off completed 2024-02-10T00:10:47.834 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-02-10T00:10:47.845 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-02-10T00:10:48.248 INFO:teuthology.run:Summary data: description: fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} duration: 1783.2028040885925 failure_reason: 'Command failed on smithi089 with status 22: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.2b deep-scrub''' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-02-10T00:10:48.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:10:48.337 INFO:teuthology.run:FAIL